Test-Takers’ Perceptions of Paired Speaking Tests and the Role of Interlocutor Variables in Pairing

Document Type : Research Article

Author

Department of English Language, Faculty of Humanities, Bu-Ali Sina University, Hamedan, Iran

Abstract

As a mixed-method study, this study investigated EFL test-takers’ perceptions of paired speaking tests and the role of interlocutor variables (i.e., peer interlocutor’s acquaintanceship, gender, and proficiency level) in pairing in a Cambridge English Language Assessment Open Center. The participants (N = 148), having experienced sitting either live paired speaking tests of Cambridge ESOL (group P, n = 53) or only IELTS solo interview, (group S, n = 48) or both (group P-S, n = 47), completed a validated Likert-scale questionnaire. Also, 63 of the participants attended, on a voluntary basis, a semistructured interview. Findings indicated group P test-takers had significantly more positive perceptions of paired/group speaking tests than their counterparts in group P-S, who, in turn, had significantly more positive perceptions of pairing than group S participants. Interview results revealed that the majority of the participants preferred friend, same-proficiency-level, and same-gender peer interlocutors. The (culture-specific) reasons for the findings are discussed in detail.

Keywords

References

Ahmadi, A., & Montasseri, Z. (2019). Interactional competence in paired vs. group oral tests. Teaching English Language, 13(1), 1-26.
Ahmadi, A., & Sadeghi, E. (2016). Assessing English language learners’ oral performance: A comparison of monologue, interview, and group oral test. Language Assessment Quarterly, 13(4), 341-358.
Bennet, R. (2012). Is linguistic ability variation in paired oral language testing problematic? ELT Journal, 66(3), 337-346.
Berry, V. (2007). Personality differences and oral test performance. Frankfurt am Main: Peter Lang.
Bonk, W., & Ockey, G. J. (2003). A many-facet Rasch analysis of the second language group oral discussion task. Language Testing, 20(1), 89-110.
Bonk, W. J., & van Moere, A. (2004). L2 group oral testing: The influence of shyness/outgoingness, match of interlocutors’ proficiency level, and gender on individual scores. Paper presented at the annual meeting of the Language Testing Research Colloquium, Temecula, California.
Borger, L. (2019). Assessing interactional skills in a paired speaking test: Raters’ interpretation of the construct. Apples - Journal of Applied Language Studies, 13(1), 151-174.
Brooks, L. (2009). Interacting in pairs in a test of oral proficiency. Language Testing, 26(3), 341-366.
Brown, A., & McNamara, T. (2004). “The devil is in the detail”: Researching gender issues in language assessment. TESOL Quarterly, 38(3), 524-538.
Canale, M., & Swain, M. (1980). Theoretical bases of communicative approaches to second language teaching and testing. Applied Linguistics, 1, 1-47.
Chambers, L., Galaczi, E. D., & Gilbert, S. (2012). Test-taker familiarity in speaking tests: Does it make a difference? Research Notes, 49, 33-40.   
Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum Associates.
Davis, L. (2009). The influence of interlocutor proficiency in a paired oral assessment. Language Testing, 26(3), 367-396.     
Dörnyei, Z. (2007). Research methods in applied linguistics. Cambridge: Cambridge University Press.
Együd, G., & Glover, P. (2001). Oral testing in pairs. ELT Journal, 55(1), 70-76.
Fox, J. (2004). Biasing for the best in language testing and learning: An interview with Merrill Swain. Language Assessment Quarterly, 1(4), 235-251.
Fulcher, G. (2015). Assessing second language speaking. Language Teaching, 48(2), 198-216.
Galaczi, E. D. (2008). Peer-peer interaction in a speaking test: The case of the First Certificate in English examination. Language Assessment Quarterly, 5(2), 89-119.
Galaczi, E. D. (2010). Paired speaking tests: An approach grounded in theory and practice. In J. Mader & Z. Ürkun (Eds.), Recent approaches to teaching and assessing speaking. IATEFL TEA SIG Conference Proceedings. Canterbury: IATEFL Publications.
Galaczi, E. D. (2014). Interactional competence across proficiency levels: How do learners manage interaction in paired speaking test? Applied Linguistics, 35(5), 553-574.
Galaczi, E. D., & Taylor, L. (2018). Interactional competence: Conceptualizations, operationalizations, and outstanding questions. Language Assessment Quarterly, 15(3), 219-236.
Humphry-Baker, A. (2000). Speaking test: Students’ perception and performance Unpublished MEd thesis, University of Manchester, Manchester.
Iwashita, N. (1998). The validity of the paired interview in oral performance assessment. Melbourne Papers in Language Testing, 5, 51-65.
Jacoby, S., & Ochs, E. (1995). Coconstruction: An introduction. Research on Language and Social Interaction, 28(3), 171-183.
Joo, M.-J. (2019). Interaction types of students in English-speaking tests. Focused on the impact of personality. International Journal of Innovative Technology and Exploring Engineering, 8(3C), 296-303.
Kramsch, C. (1986). From language proficiency to interactional competence. The Modern Language Journal, 70, 366-372.
Lam, D. M. K. (2019). Interactional competence with and without extended planning time in a group oral assessment. Language Assessment Quarterly, 16(1), 1-20.
Lantolf, J. P., & Poehner, M. E. (2004). Dynamic assessment of L2 development: Bringing the past into the future. Journal of Applied Linguistics, 1, 49-72.        
Lazaraton, A. (2002). A qualitative approach to the validation of oral language tests. Cambridge: Cambridge University Press.
Leaper, D. A., & Brawn J. R. (2019). Detecting development of speaking proficiency with a group oral test: A quantitative analysis. Language Testing, 36(2), 181-206.
Leaper, D. A., & Riazi, M. (2014). The influence of prompt on group oral tasks.  Language Testing, 31(2), 177-204.
May, L. A. (2009). Coconstructed interaction in a paired speaking test: The rater’s perspective. Language Testing, 26(3), 397-422.
May, P. (1996). Exam classes. Oxford: Oxford University Press.
McNamara, T., & Roever, C. (2006). Language testing: The social dimension. Malden, MA: Blackwell Publishing.
Nakatsuhara, F. (2006). The impact of proficiency level on conversational styles in paired speaking tests. Research Notes, 25, 15-20.
Nakatsuhara, F. (2011). Effect of test-taker characteristics and the number of participants in group oral tests. Language Testing, 28(4), 483-508.
Nitta, R., & Nakatsuhara, F. (2014). A multifaceted approach to investigating pretask planning effects on paired oral test performance. Language Testing, 31(2), 147-175.
Norton, J. (2005). The paired format in Cambridge speaking testes. ELT Journal, 59(4), 287-297.
Ockey, G. J. (2009). The effects of group members’ personalities on a test-taker’s L2 group oral discussion test scores. Language Testing, 26(2), 161-186.
O’Sullivan, B. (2002). Learner acquaintanceship and oral-proficiency test pair-task performance. Language Testing, 19(3), 277-295.
Palumbo, M. V., & Steele-Johnson, D. (2014). Do test perceptions influence test performance? Exploring stereotype threat theory. North American Journal of Psychology, 16(1), 1-12.
Roever, C., & Kasper, G. (2018). Speaking in turns and sequences: Interactional competence as a target construct in testing speaking. Language Testing, 35(3), 331-355.
Sadeghi, K., Azad Mousavi, M., & Javidi, S. (2017). Relationship between EFL learners’ self-perceived communication competence and their task-based and task-free self-assessment of speaking. Journal of Research in Applied Linguistics, 8(2), 31-50. 
Sandlund, E., Sundqvist, P., & Nyroos, L. (2016). Testing L2 talk: A review of empirical studies on second language oral proficiency testing. Language and Linguistics Compass, 10(1), 14-29.
 Saville, N., & Hargreaves, P. (1999). Assessing speaking in the revised FCE. ELT Journal, 53(1), 42-51.
Simpson, J. (2006). Differing expectations in the assessment of the speaking skills of ESOL learners. Linguistics and Education, 17, 40-55.
Song, B., & Lee, H. (2016). Interactional competence in a paired speaking test: Toward designing an evidence-based rating scale. English Language Teaching, 28(2), 133-152.
Taylor, L. (2000). Investigating the paired speaking test format. Research Notes, 2, 14-15.
Taylor, L. (2001). The paired speaking test format: Recent studies. Research Notes, 6, 15-17.
van Moere, A. (2006). Validity evidence in a university group oral test. Language Testing, 23(4), 411-440.
Vidacović, I., & Galaczi, E.D. (2013). The measurement of speaking ability 1913-2012. In C. J. Weir, I. Vidacović, & E.D. Galaczi (Eds.), Studies in language testing: Measured constructs (pp. 257-346). Cambridge: Cambridge University Press.
Wallis, D. (1995). Testing in twos—The paired format in oral examinations. UCLES presentation, TATEFL Annual Conference, York.
Weir, C., & Taylor, L. (2011). Conclusions and recommendations. In L. Taylor (Ed.), Examining speaking, research, and practice in assessing second language speaking (pp. 293-313). Cambridge:Cambridge University Press.
Young, R. F. (2008). Language and interaction. New York: Routledge.
Journal of Research in Applied Linguistics
Volume 11, Issue 1
April 2020
Pages 89-123

Files

Cited by

Share

How to cite

Statistics