چکیده:
Using a mixed methods design, the present study attempted to identify the factors influencing Iranian untrained EFL raters in rating group oral discussion tasks. To fulfil this aim, 16 language learners of varying proficiency levels were selected and randomly assigned to groups of four and performed a group discussion task. Thirty two untrained raters were also selected based on their volunteer participations. They listened to the audio files of the group discussions and assigned a score of one to six to each language learners based on their own judgements. They also provided comments on each language learners‟ performance pointing to why they assigned such scores. The researchers had an interview with the raters after the rating session as well. The quantitative phase investigated whether linguistic features of accuracy, fluency, complexity and amount of talk were attended to by the raters in terms of having any relationship to the scores the raters assigned. Speech rate as an index of fluency and amount of talk turned out to be significantly correlated with the scores. Of more importance was the qualitative phase with the aim of identifying other factors that may account for the scores. The comments provided by the raters on each score and the interviews were codified based on Content Analysis (CA) approach. It was found that the raters attend not only to the linguistic features in rating oral group discussions, but they are also sensitive to the interactional features like the roles the participants take in groups tasks and the overall interaction patterns of the groups. The findings of this study may shed light on group oral assessment in terms of training the raters rating group oral tests and developing rating scales specific for group oral assessment.
خلاصه ماشینی:
Factors Influencing Iranian Untrained EFL Raters Rating Group Oral Discussion Tasks: A Mixed Methods design Nasimeh Nouhi Jadesi 1*, Seyyed Ayatollah Razmjoo 2, Alireza Ahmadi 3 1 Ph. D.
Candidate, Faculty of Foreign Languages and Linguistics, Shiraz University, Iran 2 Professor, Faculty of Foreign Languages and Linguistics, Shiraz University, Iran 3 Professor, Faculty of Foreign Languages and Linguistics, Shiraz University, Iran Received: 09/05/2016 Accepted: 17/09/2016 Using a mixed methods design, the present study attempted to identify the factors influencing Iranian untrained EFL raters in rating group oral discussion tasks.
It was found that the raters attend not only to the linguistic features in rating oral group discussions, but they are also sensitive to the interactional features like the roles the participants take in groups tasks and the overall interaction patterns of the groups.
In line with general objectives, the following research questions specifically guide this study: 1- What is the relationship between the scores assigned by the experienced raters and the linguistic features (complexity, accuracy, fluency, and amount of talk) of the speech samples produced by language learners in group oral discussion tasks?
Quantitative: The linguistic feature measures of the group discussions were also estimated and for each learner an index of fluency, accuracy, complexity and amount of talk were identified to be correlated with the scores the learners received.
This finding supports the studies that have found that in rating paired or group tasks, the raters attend to mostly interactional features like „working together cooperatively‟, „turn- taking management‟ or „interactional management‟ and „interactive listening‟ (May, 2006; Galaczi, 2014; Ducasse & Brown, 2009).