Experts
- Monika Fiedorowicz
- Henryk Rybinski
In the Scientists module, in the Experts tab, you can search for scientists; however, unlike the search for scientist profiles, in this tab the search is aimed at finding the best specialists in a specific discipline and according to a selected criterion. The selection is made on the basis of the scientists' achievements recorded in the knowledge base. The selection of the "best" experts can be made according to the following criteria:
total IF
total SNIP
WOS/Scopus citability
MEiN score
efficiency of Acquiring Projects
Scientific achievements (multi-criteria evaluation)
Searching is possible through the domain experts search form. General rules and search results are described in sections: Wyszukiwanie w bazie Information retrieval - result page
In addition, the search for employees has been expanded to include the ability to filter employees by:
employment status,
employment group,
position,
scientific disciplines,
academic title and degree, professional title
membership in special research team
affiliation to a unit.
In addition, a new algorithm for selecting experts more accurately identifies:
the professional group for which we are looking for experts
the period for which the achievements of experts are compared
filters limiting the output in each type of output
The screen that an end user gets when he selects a function depends on whether he is logged in or not. We will further discuss the case of an end user who is not logged in and a user who is logged in.
Search form for a non-logged-in user
A user who is not logged in has a truncated ability to define a query. This is shown in the figure below.
The user can:
select the criterion by which she wants to search for experts.
select the types of output for which she seeks an expert,
Note: the types of output available for selection depend on the selected criterion, so if the criterion of total IF parameter value is selected, it is obvious that the algorithm can consider only publications, and only from articles on the JCR list.
can ask a question about the field in which it is searching for an expert; to do so, it enters keywords characterizing the expert's area of activity - usually text characterizing the search topic. The syntax follows that of a text query (cf.Search Modes )
An important element of the algorithm is the range of years for which the items of achievement are searched. Therefore, the user can specify the period taken into account when evaluating experts. This means that the selection of the "best" experts can be limited to a certain period.
Note: the absence of a fixed period in the query, determines that the algorithm automatically sets the time interval in such a way that the considered output does not exceed a numerically defined threshold.
The user can also indicate the number of experts for which the ranking is created.
Logged-in user search form
The logged-in user's screen allows you to additionally set filters with each type of output. This is shown in the figure below:
Fig. 2 Expert search screen for logged-in user
Particularly important here is the ability to limit the group of scientists for which the ranking list is determined. This is shown in Figure 3.
Fig. 3 Filters that limit the collection of scientists
This makes it possible, for example, to search for the best doctoral students, or the best employees outside the N-number.
The user also has access to filters related to specific types of achievements. For example, for publications, it is possible to select a specific type of publication as the basis for building a scientist's ranking, such as author's monographs, or the scientist's contribution to evaluation (attribute Credited for parametric evaluation).
Presentation of the search result
After performing a search, a summary description of the profiles of experts from the indicated discipline will be displayed. As in the previous version, the expert search result is presented in tiled form:
Fig. 4 Tiled presentation of expert search result
The screen tells you what criterion was used in the search and what elements of the heritage were taken into account.
In addition, those items that were selected by the algorithm appear next to each person:
They are shown as a table in three columns:
Selected by algorithm for evaluation
Located in the field specified in the query by the user
All in the heritage
From the tiled form, you can switch to the form of a collaboration graph, which illustrates collaboration between selected authors (Collaboration tab). Collaboration between individual researchers is presented in the form of a graph, developed using data from:
projects
publications
You can narrow your search to:
of a given period of cooperation
threshold for collaboration, depending on the number of publications or projects in collaboration with a given author.
Operation of the expert search and ranking system
The expert search system works according to the following algorithm:
A. If there are certain filters applied to scientists:
The system searches for scientists
For the selected group of scientists, the system searches for achievements according to the
specified domain criterion (keywords)
user-specified types of achievements (publications, patents, projects, etc.).
user-specified period in which the best experts are sought; if the period is not specified, the system can automatically narrow the range for scientific achievements from below, so that the total number of achievements does not exceed the N threshold set for the installation;
the characteristics of the output: if for the criteria selected above the output includes more items than N, the system can automatically raise the threshold of "quality" of the publication output, increasing the threshold of the number of points of the Ministry of Science and Higher Education/MEiN;
For each scientist and for the selected output, the system recalculates the points according to the adopted criterion;
Having the score calculated, the system arranges the scientists according to the points obtained and displays K scientists in tiled form
B. If there are no filters imposed on scientists, the system implements the points (3-4) as above for the entire set of scientists, except that the output is searched across the entire knowledge base (not limited to a subset of scientists).
In the above algorithm, the score for a single item o and domain query q is calculated according to the formula:
S(q,o) = sim(q,o) × s(o)
where:
sim(q,o) is calculated according to the formula sim(q,o) = 1 - e-rel(q,o) where rel(q,o) is a measure of the similarity of the object o to the query q;
s(o) is the value of object o according to the selected expert ranking criterion.
In the case of multi-criteria selection, the unified measure is the modified MEiN scoring system, with a scoring normalization function for publications prior to 2019, so that old publications are comparable to new ones.
In the Scientists module, in the Experts tab, you can search for scientists; however, unlike the search for scientist profiles, in this tab the search is aimed at finding the best specialists in a specific discipline and according to a selected criterion. The selection is made on the basis of the scientists' achievements recorded in the knowledge base. The selection of the "best" experts can be made according to the following criteria1):
total IF
total SNIP
WOS/Scopus citability
MEiN score
design efficiency
Lifetime achievements (multi-criteria evaluation)
In addition, the search for employees has been expanded to include the ability to filter employees by:
employment status,
employment group,
position,
scientific disciplines,
academic title and degree, professional title
WZB membership
affiliation of the entity.
In addition, a new algorithm for selecting experts more accurately identifies:
the professional group for which we are looking for experts
the period for which the achievements of experts are compared
filters limiting the output in each type of output
The screen that an end user gets when he selects a function depends on whether he is logged in or not. We will further discuss the case of an end user who is not logged in and a user who is logged in.
Search form for a non-logged-in user
A user who is not logged in has a truncated ability to define a query. This is shown in the figure below.
Fig. 1 Expert search screen for a non-logged-in user
The user can:
select the criterion by which it wants to search for experts.
select the types of output for which it seeks an expert,
can ask a question about the field in which it is searching for an expert; to do so, it enters keywords characterizing the expert's area of activity - usually text characterizing the search topic. The syntax follows that of a text query (cf.Search Modes )
An important element of the algorithm is the range of years for which the items of achievement are searched. Therefore, the user can specify the period taken into account when evaluating experts. This means that the selection of the "best" experts can be limited to a certain period.
The user can also indicate the number of experts for which the ranking is created.
Logged-in user search form
The logged-in user's screen allows you to additionally set filters with each type of output. This is shown in the figure below:
Fig. 2 Expert search screen for logged-in user
Particularly important here is the ability to limit the group of scientists for which the ranking list is determined. This is shown in Figure 3.
Fig. 3 Filters that limit the collection of scientists
This makes it possible, for example, to search for the best doctoral students, or the best employees outside the N-number.
The user also has access to filters related to specific types of achievements. For example, for publications, it is possible to select a specific type of publication as the basis for building a scientist's ranking, such as author's monographs, or the scientist's contribution to evaluation (attribute Credited for parametric evaluation).
Presentation of the search result
After performing a search, a summary description of the profiles of experts from the indicated discipline will be displayed. As in the previous version, the expert search result is presented in tiled form:
Fig. 4 Tiled presentation of expert search result
The screen tells you what criterion was used in the search and what elements of the heritage were taken into account.
In addition, those items that were selected by the algorithm appear next to each person:
Fig. 5 The elements of the output selected by the algorithm
They are shown as a table in three columns:
Selected by algorithm for evaluation
Located in the field specified in the query by the user
All in the heritage
From the tiled form, you can switch to the form of a collaboration graph, which illustrates collaboration between selected authors (Collaboration tab). Collaboration between individual researchers is presented in the form of a graph, developed using data from:
projects
publications
You can narrow your search to:
of a given period of cooperation
threshold for collaboration, depending on the number of publications or projects in collaboration with a given author.
Graph of cooperation of sophisticated experts
Operation of the expert search and ranking system
The expert search system works according to the following algorithm:
A. If there are certain filters applied to scientists:
The system searches for scientists
For the selected group of scientists, the system searches for achievements according to the
specified domain criterion (keywords)
user-specified types of achievements (publications, patents, projects, etc.).
user-specified period in which the best experts are sought; if the period is not specified, the system can automatically narrow the range for scientific achievements from below, so that the total number of achievements does not exceed the N threshold set for the installation;
the characteristics of the output: if for the criteria selected above the output includes more items than N, the system can automatically raise the threshold of "quality" of the publication output, increasing the threshold of the number of points of the Ministry of Science and Higher Education/MEiN;
For each scientist and for the selected output, the system recalculates the points according to the adopted criterion;
Having the score calculated, the system arranges the scientists according to the points obtained and displays K scientists in tiled form
B. If there are no filters imposed on scientists, the system implements the points (3-4) as above for the entire set of scientists, except that the output is searched across the entire knowledge base (not limited to a subset of scientists).
In the above algorithm, the score for a single item o and domain query q is calculated according to the formula:
S(q,o) = sim(q,o) × s(o)
Where:
sim(q,o) is calculated according to the formula sim(q,o) = 1 - e-rel(q,o) where rel(q,o) is a measure of the similarity of the object o to the query q;
s(o) is the value of object o according to the selected expert ranking criterion.
In the case of multi-criteria selection, the unified measure is the modified MEiN scoring system, with a scoring normalization function for publications prior to 2019, so that old publications are comparable to new ones.