Reid, S., West, T. (2021). Measuring the Frequency of Critical Thinking in a Second Language Academic Discussion Course. In D. Koyama (Ed.), Development of Innovative Pedagogical Practices for a Modern Learning Experience (pp 237-268). Jagadhri, HR: CSMFL Publications. https://dx.doi.org/10.46679/978819484836309
As technology and globalization increase the chances of exposure to information, learners’ Critical Thinking (CT) and researchers’ ability to measure it will play an important role in developing modern educational experiences. This is particularly the case for English language learners who wish to enter tertiary education in English-speaking countries (Liaw, 2007; Wagner, 2010). Emphasis on such skills is increasingly a facet of language education in Japanese contexts. This can be seen in changes implemented by the Japan Ministry of Education, Culture, Sports, Science, and Technology which have encouraged a focus on CT in English language courses during recent years (MEXT, 2011). However, it can be difficult for second language (L2) learners to exhibit CT in an L2 (Bali, 2015; Luk & Lin, 2015). Measuring CT in learner output has also proven difficult, which can be an obstacle to further integrating CT in L2 pedagogy. Studies exploring ways of measuring CT in an L2 have largely focused on written work (e.g., Davidson & Dunham, 1997; Floyd, 2011; Stapleton, 2001), while analysis of CT in spoken L2 discourse has seen little attention. As a result, little advice can be found on practical steps for teachers to help learners display CT when speaking in an L2.
This chapter describes a study of arguments made during group discussions in an L2 English Discussion course at a Japanese university. A corpus of spontaneous spoken discourse recorded during class was analyzed to measure the frequency of CT displayed in an academic setting where CT was not an explicit focus of the course. Arguments in the corpus were identified using Ramage et al.’s (2016) model of argument criteria, and a categorization system was developed in which discourse was classified as displaying either objective reasoning or subjective reasoning. Participants were found to have used approximately 72% objective and 28% subjective reasoning. However, further analysis revealed an important qualitative difference in arguments identified as incorporating objective reasoning. The results of the study suggest two areas that may help teachers promote an increase in student usage of CT: the importance of question prompts in orienting learners towards CT in their answers, and a specific focus on the role of pronoun usage in taking a subjective or objective stance.
Keywords: Higher-order thinking skills, pronoun usage, corpus linguistics, argumentation
Adolphs, S., & Knight, D. (2010). Building a spoken corpus: What are the basics? In A. O’Keeffe & M. McCarthy (Eds.), The Routledge handbook of corpus linguistics (pp. 38–52). Routledge. https://doi.org/10.4324/9780203856949.ch4
Alagozlu, N. (2007). Critical thinking and voice in EFL writing. The Asian EFL Journal Quarterly, 9(3), 118–136.
Bali, M. (2015). Critical Thinking through a multicultural lens: Cultural challenges of teaching critical thinking.In M. Davies & R. Barnett (Eds.), The Palgrave Handbook of Critical Thinking in Higher Education (pp. 317–334). Macmillan. https://doi.org/10.1057/9781137378057_20
Barnawi, O. Z. (2011). Finding a place for critical thinking and self-voice in college English as a foreign language. Writing Classrooms, 4(2), 190–197. https://doi.org/10.5539/elt.v4n2p190
Buck, J. (2017). Developing the Rikkyo English discussion corpus. In G. Brooks (Ed.), The 2016 PanSIG Journal (pp. 25–30).JALT.
Chirgwin, S. K., & Huijser, H. (2015). Cultural variance, critical thinking, and indigenous knowledges: Exploring a both-ways approach. In M. Davies & R. Barnett (Eds.), The Palgrave handbook of critical thinking in higher education. (pp. 335–350). Macmillan. https://doi.org/10.1057/9781137378057_21
Crosthwaite, P., Boynton, A., & Cole, S. (2017). Exploring rater conceptions of academic stance and engagement during group tutorial discussion assessment. Journal of English for Academic Purposes, 28, 1–13. https://doi.org/10.1016/j.jeap.2017.04.004
Davidson, B. W., & Dunham, R. A. (1997). Assessing EFL student progress in critical thinking with the Ennis-Weir Critical Thinking Essay Test. JALT Journal, 19(1), 43–57. http://jalt-publications.org/jj/articles/2704-assessing-efl-student-progress-critical-thinking-ennis-weir-critical-thinking-essay
Ennis, R. H. (2011). The nature of critical thinking: An outline of critical thinking dispositions and abilities. https://education.illinois.edu/docs/default-source/faculty-documents/robert-ennis/thenatureofcriticalthinking_51711_000.pdf?sfvrsn=7bb51288_2
Facione, P. A. (1990). Critical thinking: A Statement of expert consensus for purposes of educational assessment and instruction. https://files.eric.ed.gov/fulltext/ED315423.pdf
Fisher, A. (2011) Critical thinking – An introduction. (2nd ed.). Cambridge University Press.
Liaw, M. (2007). Content-based reading and writing for critical thinking skills in an EFL context. English Teaching & Learning, 31(2), 45–87. https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.580.288&rep=rep1&type=pdf
Luk, J., & Lin, A. (2015). Voices without words: Doing critical literate talk in English as a second language. TESOL Quarterly, 49(1), 67-91. https://doi.org/10.1002/tesq.161
McEnery, T., Xiao, R., & Tono, Y. (2006). Corpus-based language studies: An advanced resource book. Routledge.
MEXT. (2011). Koutougakkou gakushuushidouyouryou [The course of study for foreign languages for senior high school], provisional English version. Retrieved from http://www.mext.go.jp/a_menu/shotou/new-cs/youryou/eiyaku/__icsFiles/afieldfile/2011/04/11/1298353_9.pdf
Moon, J. (2008). Critical thinking: An exploration of theory and practice. Routledge.
Moore, T. J. (2011). Critical thinking and language: The challenge of generic skills and disciplinary discourses. Continuum.
Morikawa, S., Harrington, L., & Shiina, K. (2012). Critical thinking in a Japanese university current affairs course. Papers on Languages and Culture, (6), 117–113. https://www.cphe.chiba-u.jp/ge/activity/archive/pdf/plc06-09.pdf
Nunn, R., & Caroline Brandt, C. (2016) A phenomenological approach to teaching reflective writing. English Scholarship Beyond Borders, 2(1), 130–151. http://englishscholarsbeyondborders.org/wp-content/uploads/2016/02/Roger-Nunn-and-Caroline-Brandt.pdf
Opitz, T. A. (2016). The efficacy of drilling backchannels in a CLT context: A corpus analysis of Japanese ESL learners. New Directions in Teaching and Learning English Discussion, 4(1), 200–210.
Opitz, T. A. (2017). Tracking lexical development in the EDC classroom: RED corpus study #2. New Directions in Teaching and Learning English Discussion, 5(1), 208–214.
Paul, R., & Elder, L. (1996). Using intellectual standards to assess student reasoning. Retrieved September 6, 2006, from http://www.criticalthinking.org/resources/ TRK12-using-intellectual-standards.shtml
Paul, R., & Elder, L. (2008). Defining critical thinking. https://www.criticalthinking.org/pages/defining-critical-thinking/766
Possin, K. (2014). Critique of the Watson-Glaser Critical Thinking Appraisal Test: The more you know, the lower your score. Informal Logic, 34(4), 393–416. https://doi.org/10.22329/il.v34i4.4141
Ramage, J. D., Bean, J. C., & Johnson, J. (2016). Writing arguments: A rhetoric with readings (10thed.). Pearson.
Rear, D. (2012). The dilemma of critical thinking: Conformism and non-conformism in Japanese education policy. In T. Isles & P. Matanle (Eds.), Researching twenty-first century Japan: New perspectives for the electronic age (pp. 119–137). Lexington Books.
Sinclair, J. (2005). Corpus and text-basic principles. In M. Wynne (Ed.), Developing linguistic corpora: A guide to good practice (pp. 1–16). Oxbow Books.
Stapleton, P. (2001). Assessing critical thinking in the writing of Japanese university students: Insights about assumptions and content familiarity. Written Communication, 18(4), 506–548. https://doi.org/10.1177/0741088301018004004
Stroupe, R. R. (2006). Integrating critical thinking throughout ESL curricula. TESL Reporter, 39(2), 42–61.