Abstract:
Investigating the Criteria for Relevance Judgment in the Electronic Space Davarpannah Mohammadreza, Ramzani Darh Abbas Ali This research, using a survey method, aims to identify the subjective and objective criteria used by students to judge the relevance of documents retrieved by search engines. The statistical population includes graduate students at Ferdowsi University who enrolled between the years 2001 and 2003 (Solar Hijri). A sample size of 335 people was determined based on Morgan's table and using the proportional stratified sampling method. The required data were collected through two separate types of questionnaires and by studying writings related to search engine ranking algorithms. Based on the findings, in addition to having specific criteria when evaluating document relevance under subjective and objective information-seeking conditions, students also assign a specific priority to each of these elements and their characteristics. A significant difference is observed among students in the four domains (inter-group and intra-group) regarding attention to relevance evaluation criteria in subjective and objective conditions. Elements such as title, language, and content have received more attention from students than other elements.
Machine summary:
Research Objectives 1- Identifying the subjective and objective criteria for measuring relevance that graduate students (humanities, basic sciences, engineering, and agriculture) utilize when evaluating and judging the relevance of retrieved documents in the web environment; 2- Measuring the difference in relevance criteria across the four fields; 3- Investigating the impact of demographic factors such as age, gender, and experience on the criteria used by students to judge document relevance; 4- Investigating the degree of conformity between users' relevance criteria and search engine ranking algorithms; 5- Identifying the reasons for selecting or not selecting documents from the perspective of students in the four fields; 6- Investigating the perceptions of the studied students regarding relevance criteria (the characteristics that users attribute to each category of relevance).
In the objective stage of assessing relevance criteria, which was examined based on the practical information-seeking conditions of the students (during an exploration session), the following six criteria categories attracted more than 50% of the total students' attention, in order: 1-Document title (including journal title, book...
" In the present research as well, the categories of "subject and Table No. 2: Subjective and objective criteria for assessing relevance from the perspective of students in four fields: humanities, basic sciences, technical and engineering, and agriculture (Refer to the page image) "content of the document" and "document abstract" obtained the fifth and third ranks respectively in objective conditions, which to some extent indicates the importance of these categories in both studies.
(
, 
, 
)
