Developing and Validating a Teacher Classroom Justice Scale for the Iranian EFL Context

Document Type : Research Article

Authors

1 Department of English Language and Literature, Faculty of Persian Literature and Foreign Languages, Allameh Tabataba’i University, Tehran, Iran

2 Department of Psychological, Health & Territorial Sciences, University of Chieti-Pescara, Via dei Vestini 29 - 66100 Chieti, Italy

Abstract

Classroom justice is the degree of perceived fairness in the distribution of outcomes, enactment of procedures, and teacher-student relationships in classrooms. This study aimed to develop and validate a Teacher Classroom Justice Scale (TCJS). After thoroughly reviewing the extant literature, scrutinizing the existing questionnaires, and interviewing experts in the field, a draft version of the instrument involving 46 items was developed and pilot-tested with 30 Iranian EFL teachers. Subsequently, another group entailing 398 Iranian EFL teachers answered the scale, and reliability was examined for each of its components. Subsequently, Exploratory Factor Analysis (EFA) revealed that a three-factor solution about procedural, interactional, and distributive justice could best explain the scale. Finally, the EFA results were approved through Confirmatory Factor Analysis (CFA), which showed that the finalized TCJS consists of 18 items and enjoys good psychometric properties of validity and reliability. Language instructors, researchers, and practitioners can use the present study findings by employing the TCJS to assess the perceptions of classroom justice in the particular domain of second/foreign language (L2) education.

Keywords


Adams, J. S. (1965). Inequity in social exchange. In L. Berkowitz (Ed.), Advances in experimental social psychology (pp. 267-299). Academic Press.
Bentler, P. M., & Chou, C. P. (1987). Practical issues in structural modeling. Sociological Methods & Research, 16(1), 78–117.
BERA. (2011). Ethical guidelines for educational research. Retrieved April 4, 2016, from http://content.yudu.com/Library/A2xnp5/Bera/resources/index.htm?referrerUrl=http://free.yudu.com/item/details/2023387/Bera
Berti, C., Molinari, L., & Speltini, G. (2010). Classroom justice and psychological engagement: Students’ and teachers’ representations. Social Psychology of Education, 13(4), 541–556. https://doi.org/10.1007/s11218-010-9128-9
Bies, R. J., & Moag, J. F. (1986). Interactional justice: Communication criteria of fairness. In R. J. Lewicki, B. H. Sheppard, & M. H. Bazerman (Eds.), Research on negotiation in organizations (pp. 43–55). JAI Press.
Boateng, G. O., Neilands, T. B., Frongillo, E. A., Melgar-Quiñonez, H. R., & Young, S. L. (2018). Best practices for developing and validating scales for health, social, and behavioral research: A Primer. Frontiers in Public Health, 6, 149. https://doi.org/10.3389/fpubh.2018.00149
Boomsma, A. (1982). Robustness of LISREL against small sample sizes in factor analysis models. In K. G. Joreskog & H. Wold (Eds.), Systems under indirect observation: Causality, structure, prediction (Part 1, pp. 149–173). North Holland.
Brown, T. A. (2006). Confirmatory factor analysis for applied research. The Guilford Press.
Cheng, Y. (2017). Development and preliminary validation of four brief measures of L2 language-skill-specific anxiety. System, 68, 15–25. https://doi.org/10.1016/j.system.2017.06.009
Chory, R. M. (2007). Enhancing student perceptions of fairness: The relationship between instructor credibility and classroom justice. Communication Education, 56(1), 89–105. https://doi.org/10.1080/03634520600994300
Chory, R. M., Horan, S. M., & Houser, M. L. (2017). Justice in the higher education classroom: Students’ perceptions of unfairness and responses to instructors. Innovative Higher Education, 42(4), 321–336. https://doi.org/10.1007/s10755-017-9388-9
Chory, R. M., Zhaleh, K., & Estaji, M. (2022). Perceptions of instructor injustice in COVID-19-imposed online courses: EFL students’ perceptions and experiences in focus. Communication Quarterly, 70(5), 469-494. https://doi.org/10.1080/01463373.2022.2090265
Chory-Assad, R. M., & Paulsel, M. L. (2004). Classroom justice: Student aggression and resistance as reactions to perceived unfairness. Communication Education, 53(3), 253–273. https://doi.org/10.1080/0363452042000265189
Čiuladienė, G., & Račelytė, D. (2016). Perceived unfairness in teacher-student conflict situations: Students’ point of view. Polish Journal of Applied Psychology, 14(1), 49–66. https://doi.org/10.1515/pjap-2015-0049
Cropanzano, R., & Greenberg, J. (1997). Progress in organizational justice: Tunneling through the maze. In C. L. Cooper & I. T. Robertson (Eds.), International Review of Industrial and Organizational Psychology (pp. 317–372). John Wiley & Sons.
Cropanzano, R., Fortin, M., & Kirk, J. F. (2015). How do we know when we are treated fairly? Justice rules and fairness judgments. In M. R. Buckley, A. R. Wheeler, & J. R. B. Halbesleben (Eds.), Research in personnel and human resources management (pp. 279–350). Emerald Group Publishing Limited.
Dalbert, C. (2013). Die Bedeutung schulischen Gerechtigkeitserlebens fu¨r das subjektive Wohlbefinden in der Schule [The meaning of justice experiences for subjective well-being at school]. In C. Dalbert (Ed.), Gerechtigkeit in der Schule (pp. 127–143). Springer VS.
Dalbert, C., & Stoeber, J. (2006). The personal belief in a just world and domain-specific beliefs about justice at school and in the family: A longitudinal study with adolescents. International Journal of Behavioral Development, 30(3), 200–207. https://doi.org/10.1177/0165025406063638
Derakhshan, A., Coombe, C., Zhaleh, K., & Tabatabaeian, M. (2020). Examining the roles of continuing professional development needs and views of research in English language teachers’ success. The Electronic Journal for English as a Second Language (TESL-EJ), 24(3), 1–27. http://www.tesl-ej.org/pdf/ej95/a2.pdf
Derakhshan, A., Doliński, D., Zhaleh, K., Janebi Enayat, M., & Fathi, J. (2022). A mixed-methods cross-cultural study of teacher care and teacher-student rapport in Iranian and Polish University students’ engagement in pursuing academic goals in an L2 context. System, 106, 102790. https://doi.org/10.1016/j.system.2022.102790
Deutsch, M. (1975). Equity, equality, and need: What determines which value will be used as the basis of distributive justice? Journal of Social Issues, 31(3), 137–149. https://doi.org/10.1111/j.1540-4560.1975.tb01000.x
Di Battista, S., Pivetti, M., & Berti, C. (2014). Engagement in the university context: Exploring the role of a sense of justice and social identification. Social Psychology of Education: An International Journal, 17(3), 471–490. https://doi.org/10.1007/s11218-014-9255-9
Donat, M., Gallschütz, C., & Dalbert, C. (2018). The relation between students’ justice experiences and their school refusal behavior. Social Psychology of Education, 21(2), 447–475. https://doi.org/10.1007/s11218-017-9423-9
Dörnyei, Z. (2003). Questionnaires in second language research: Construction, administration, and processing. Lawrence Erlbaum.
Ehrhardt, N., Pretsch, J., Herrmann, I., & Schmitt, M. (2018). Observing justice in the primary school classroom. Zeitschrift Für Erziehungswissenschaft, 19(1), 157–190. https://doi.org/10.1007/s11618-015-0664-0
Estaji, M., & Zhaleh, K. (2021a). Exploring Iranian teachers’ perceptions of classroom justice and its dimensions in EFL instructional contexts. Language Related Research, 12(3), 277–314. https://doi.org/10.29252/LRR.12.3.10
Estaji, M., & Zhaleh, K. (2021b). Teachers’ perceptions, experiences, and challenges of incorporating justice in English as a foreign language classrooms. Polish Psychological Bulletin, 52(3), 251–269. https://doi.org/10.24425/ppb.2021.137889
Estaji, M., & Zhaleh, K. (2022a). Experiences, causes, and solutions for injustice in Covid-19 online classes: Evidence from university EFL students in Iran. LEARN Journal: Language Education and Acquisition Research Network, 15(2), 436-467. https://so04.tci-thaijo.org/index.php/LEARN/article/view/259936
Estaji, M., & Zhaleh, K. (2022b). Iranian EFL teachers’ expectations and perceptions about teacher classroom justice training. TEFLIN Journal, 33(2), 272-291. http://doi.org/10.15639/teflinjournal.v33i2/272-291
Estaji, M., & Zhaleh, K. (2022c). The enactment of classroom justice through explicit instruction: Deciphering the changes in English as a foreign language teachers’ perceptions and practices. Frontiers in Psychology, 13, 821763. https://doi.org/10.3389/fpsyg.2022.821763
Field, A. (2018). Discovering statistics using IBM SPSS statistics (5th ed.). SAGE Publications.
Fornell, C. & Larcker, D. F. (1981). Evaluating structural equation models with unobservable variables and measurement error. Journal of Marketing Research, 18(1), 39–50. https://doi.org/10.1177/002224378101800104
Gao, L. X., & Zhang, L. J. (2020). Teacher learning in difficult times: Examining foreign language teachers’ cognitions about online teaching to tide over COVID-19. Frontiers in Psychology, 11, 2396. https://doi.org/10.3389/fpsyg.2020.549653
Gasser, L., Grütter, J., Buholzer, A., & Wettstein, A. (2018). Emotionally supportive classroom interactions and students' perceptions of their teachers as caring and just. Learning and Instruction, 54, 82–92. https://doi.org/10.1016/j.learninstruc.2017.08.003
Ghaedsharafi, A., Yamini, M., & Dehghan, F. (2019). Investigating predictors of high school students’ negative attitudes towards learning English by developing, validating, and running a questionnaire. Journal of Research in Applied Linguistics, 10(2), 136–158. https://doi.org/10.22055/RALS.2019.14721
Gorard, S. (2012). Experiencing fairness at school: An international study. International Journal of Educational Research, 53(3), 127–137. https://doi.org/10.1016/j.ijer.2012.03.003
Gouveia-Pereira, M., Vala, J., Palmonari, A., & Rubini, M. (2003). School experience, relational justice, and legitimation of institutional authorities. European Journal of Psychology of Education, 18(3), 309–325. https://doi.org/10.1007/BF03173251
Horan, S. M., & Myers, S. (2009). An exploration of college instructors’ use of classroom justice, power, and behavior alteration techniques. Communication Education, 58, 483–496. http://doi.org/10.1080/03634520903055981
Horan, S. M., Chory, R. M., & Goodboy, A. K. (2010). Understanding students’ classroom justice experiences and responses. Communication Education, 59(4), 453–474. https://doi.org/10.1080/03634523.2010.487282
Hu, L., & Bentler, P. M. (1999). Cut-off criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. SEM, 6(1), 1–55. https://doi.org/10.1080/10705519909540118
Hwang, M., & Lee, H.-K. (2017). Development and validation of the English writing strategy inventory. System, 68, 60–71. https://doi.org/10.1016/j.system.2017.06.014
Kazemi, A. (2008). Social psychology of justice: Origins, central issues, recent developments, and future directions. Nordic Psychology, 60(3) 209–234. https://doi.org/10.1027/1901-2276.60.3.209
Kazemi, A. (2016). Examining the interplay of justice perceptions, motivation, and school achievement among secondary school students. Social Justice Research, 29(1), 103–118. https://doi.org/10.1007/s11211-016-0261-2
Kline, R. B. (2016). Principles and practice of structural equation modeling (4th ed.). The Guilford Press.
Lizzio, A., Wilson, K., & Hadaway, V. (2007). University students' perceptions of a fair learning environment: A social justice perspective. Assessment & Evaluation in Higher Education, 32(2), 195–213. https://doi.org/10.1080/02602930600801969
Mameli, C., Biolcati, R., Passini, S., & Mancini, G. (2018). School context and subjective distress: The influence of teacher justice and school-specific well-being on adolescents’ psychological health. School Psychology International, 39(5), 1–17. https://doi.org/10.1177/0143034318794226
Mameli, C., Caricati, L., & Molinari, L. (2020). That’s not fair! The effects of teacher justice and academic achievement on Self and Other’s resistant agency. British Journal of Educational Psychology, 90(4), 933–947. https://doi.org/10.1111/bjep.12335
Mercer, S., & Dörnyei, Z. (2020). Engaging language learners in contemporary classrooms. Cambridge University Press.
Mirshojaee, S. B., Sahragard, R., Razmjoo, S. A., & Ahmadi, A. (2019). Iranian language teachers’ passion for the profession: A qualitative study. Journal of Research in Applied Linguistics, 10(2), 44–69. https://doi.org/10.22055/RALS.2019.14717
Nassaji, H. (2020). Good qualitative research. Language Teaching Research, 24(4), 427–431. https://doi.org/10.1177/1362168820941288
Nunnally J. C. (1978). Psychometric theory. McGraw-Hill.
Pallant, J. (2016). SPSS survival manual: A step by step guide to data analysis using SPSS program (6th ed.). McGraw-Hill Education.
Pnevmatikos, D., & Trikkaliotis, I. (2012). Procedural justice in a classroom where teacher implements differentiated instruction. In D. Alt & R. Reingold (Eds.), Changes in teachers’ moral role. From passive observer to moral and democratic leadership (pp. 155–163). Sense Publishers.
Rasooli, A. (2020, 29 May-4 June). Rethinking survey validation processes: Lessons learned from a systematic review of classroom justice instruments [Paper Presentation]. Annual Conference of the Canadian Society for the Study of Education, Western University, Canada.
Rasooli, A., DeLuca, C., Rasegh, A., & Fathi, S. (2019). Students’ critical incidents of fairness in classroom assessment: An empirical study. Social Psychology of Education, 22(3), 701–722. https://doi.org/10.1080/0969594X.2019.1593105
Rasooli, A., Zandi, H., & DeLuca, C. (2018). Re-conceptualizing classroom assessment fairness: A systematic meta-ethnography of assessment literature and beyond. Studies in Educational Evaluation, 56, 164–181. https://doi.org/10.1016/j.stueduc.2017.12.008
Raykov, T., & Marcoulides, G. A. (2011). Introduction to psychometric theory. Routledge, Taylor & Francis Group.
Resh, N., & Sabbagh, C. (2016). Justice and education. In C. Sabbagh & M. Schmitt (Eds.), Handbook of social justice theory and research (pp. 349–367). Springer.
Resh, N., & Sabbagh, C. (2017). Sense of justice in school and civic behavior. Social Psychology of Education, 20(2), 387–409. https://doi.org/10.1007/s11218-017-9375-0
Robbins, T. L., & Jeffords, B. C. (2009). Practicing what we preach: Justice and ethical instruction in management education. Ethics and Education, 4(1), 93-102. https://doi.org/10.1080/17449640902861562
Rodrigues, I. B., Adachi, J, D., Beattie, K. A., & MacDermid, J. C. (2017). Development and validation of a new tool to measure the facilitators, barriers and preferences to exercise in people with osteoporosis. BMC Musculoskeletal Disorders, 18(1), 540. https://doi.org/10.1186/s12891-017-1914-5
Roffey, S. (2011). Changing behaviour in schools: Promoting positive relationships and well-being. SAGE.
Sabbagh, C., & Resh, N. (2014). Citizenship orientations in a divided society: A comparison of three groups of Israeli junior-high students—secular Jews, religious Jews, and Israeli Arabs. Education, Citizenship, and Social Justice, 9(1), 34–54. https://doi.org/10.1177/1746197913497662
Sabbagh, C., & Resh, N. (2016). Unfolding justice research in the realm of education. Social Justice Research, 29(1), 1–13. https://doi.org/10.1007/s11211-016-0262-1
Sonnleitner, P., & Kovacs, C. (2020). Differences between students’ and teachers’ fairness perceptions: Exploring the potential of a self-administered questionnaire to improve teachers’ assessment practices. Frontiers in Education, 5, 1–14. https://doi.org/10.3389/feduc.2020.00017
Stevens, J. P. (2002). Applied multivariate statistics for the social sciences (4th ed.). Erlbaum.
Tabachnick, B. G., & Fidell, L. S. (2018). Using multivariate statistics (7th ed.). Pearson.
Thibaut, J. W., & Walker, L. (1975). Procedural justice: A psychological analysis. Lawrence Erlbaum Associates.
Tripp, T. M., Jiang, L., Olson, K., & Graso, M. (2019). The fair process effect in the classroom: Reducing the influence of grades on student evaluations of teachers. Journal of Marketing Education, 41(3), 1–12. https://doi.org/10.1177/0273475318772618
Tyler, T. R. (1987). Procedural justice research. Social Justice Research, 1(1), 41–65. https://doi.org/10.1007/BF01049383
Van Prooijen, J.-W., & van der Kloot, W. A. (2001). Confirmatory analysis of exploratively obtained factor structures. Educational and Psychological Measurement, 61(5), 777–792. https://doi.org/10.1177/00131640121971518
Watkins, M. W. (2006). Determining parallel analysis criteria. Journal of Modern Applied Statistical Methods, 5(2), 344–346.
Worthington, R. L., & Whittaker, T. A. (2006). Scale development research: A content analysis and recommendations for best practices. The Counseling Psychologist 34(6), 806–838. https://doi.org/10.1177/0011000006288127
Zhaleh, K., Estaji, M., & Berti, C. (2022). Conceptualizing classroom justice in second/foreign language education: past, present, & future directions of research & practice. Journal of Critical Applied Linguistics Studies (JCALS), 1(1), 32-49.  https://doi.org/10.22034/jcals.1.1.32
Zhaleh, K., Ghonsooly, B., & Pishghadam, R. (2018). Effects of conceptions of intelligence and ambiguity tolerance on teacher burnout: A case of Iranian EFL teachers. Journal of Research in Applied Linguistics, 9(2), 118-140. https://doi.org/10.22055/RALS.2018.13796