Revisiting Linguistic Evaluation of ELT Coursebooks in the Era of AI

Authors

DOI:

https://doi.org/10.5281/zenodo.18835734

Keywords:

ELT coursebooks, linguistic evaluation, corpus linguistics, artificial intelligence, language teaching materials.

Abstract

This study revisits linguistic evaluation of English language teaching (ELT) coursebooks in light of recent developments in corpus linguistics and artificial intelligence (AI). While traditional coursebook evaluation has largely emphasised pedagogical and practical criteria, emerging research highlights the need for more systematic analysis of linguistic content, including lexical, grammatical, and discourse features. Drawing on a structured review of previous studies, this conceptual investigation examines how corpus-informed and AI-supported tools have been applied to linguistic analysis of ELT materials and identifies key trends, challenges, and methodological gaps. The findings indicate growing reliance on automated lexical and syntactic analysis, alongside persistent limitations in discourse-level evaluation and theoretical integration. The study argues that AI-supported tools should function as analytical supports rather than autonomous evaluators and emphasises the importance of grounding data-driven analysis in established linguistic theory. This reconceptualisation contributes to a clearer methodological understanding of linguistic evaluation in the era of AI.

References

Alaqlobi, O., Alduais, A., Qasem, F., & Alasmari, M. (2024). Artificial intelligence in applied (linguistics): a content analysis and future prospects. Literature, Linguistics & Criticism, 11(1), 2382422. https://doi.org/10.1080/23311983.2024.2382422

Barlow, M. (2011). Corpus linguistics and theoretical linguistics. International Journal of Corpus Linguistics, 16(1), 3-44. https://doi.org/10.1075/ijcl.16.1.02bar

Biber, D., Conrad, S., & Reppen, R. (2012). Corpus Linguistics: Investigating Language Structure and Use. Cambridge University Press. https://doi.org/10.1017/CBO9780511804489

Biber, D., Gray, B., & Poonpon, K. (2011). Should We Use Characteristics of Conversation to Measure Grammatical Complexity in L2 Writing Development? TESOL Quarterly, 45(1), 5-35. https://doi.org/10.5054/tq.2011.244483

Chapelle, C. A., & Chung, Y.-R. (2010). The promise of NLP and speech processing technologies in language assessment. Language Testing, 27(3), 301-315. https://doi.org/10.1177/0265532210364405

Chen, A. C.-H. (2016). A critical evaluation of text difficulty development in ELT textbook series: A corpus-based approach using variability neighbor clustering. System, 58, 64-81. https://doi.org/10.1016/j.system.2016.03.011

Cooper, C. R. (2025). Predicting the CEFR level of English listening texts with machine learning methods. Research Methods in Applied Linguistics, 4(3), 100234. https://doi.org/10.1016/j.rmal.2025.100234

Coxhead, A. (2000). A New Academic Word List. TESOL Quarterly, 34(2), 213-238. https://doi.org/10.2307/3587951

Crossley, S. A., Kyle, K., & McNamara, D. S. (2016). The tool for the automatic analysis of text cohesion (TAACO): Automatic assessment of local, global, and text cohesion. Behavior Research Methods, 48. https://doi.org/10.3758/s13428-015-0651-7

Cunningsworth, A. (1995). Choosing Your Coursebook. Heineman.

Curry, N., & McEnery, T. (2025). Corpus linguistics for language teaching and learning: A research agenda. Language Teaching, 58(2), 232-251. https://doi.org/10.1017/S0261444824000430

Curry, N., Baker, P., & Brookes, G. (2024). Generative AI for corpus approaches to discourse studies: A critical evaluation of ChatGPT. Applied Corpus Linguistics, 4(1), 100082. https://doi.org/10.1016/j.acorp.2023.100082

Curry, N., McEnery, T., & Brookes, G. (2025). A question of alignment – AI, GenAI and applied linguistics. Annual Review of Applied Linguistics, 45, 315-336. https://doi.org/10.1017/S0267190525000017

Ferdian, N. R., & Nirwana, B. (2021). Nursing Students’ Reflections on English Role-Play Activities in ESP Class. ELS Journal on Interdisciplinary Studies in Humanities, 4(4), 452–457. https://doi.org/10.34050/elsjish.v4i4.18706

Garth, A. (2022). Grammar Practice Activities in ELT Textbooks: Types, Order, and Interrelated Series. English Teaching, 77(3), 3-28. https://doi.org/10.15858/engtea.77.3.202209.3

Ghazali, R. C., Hanid, M. F., Said, M. N., & Lee, H. Y. (2025). Artificial Intelligence (AI) Tools and Learning Strategies for English Literacy: A Systematic Literature Review. International Journal of Academic Research in Progressive Education and Development, 14(4), 610-629. https://doi.org/10.6007/IJARPED/v14-i4/26661

Gholampour, S., & Mehrabi, D. (2023). Literature Review of ELT Textbook Evaluation. MEXTESOL Journal, 47(2), 1-7. http://www.mextesol.net/journal/public/files/b0a199c31e73359372dbedde223fdb7d.pdf

Graesser, A. C., McNamara, D. S., Louwerse, M. M., & Cai, Z. (2004). Coh-Metrix: Analysis of text on cohesion and language. Behavior Research Methods, Instruments, & Computers, 36, 193-202. https://doi.org/10.3758/BF03195564

Groenewald, E. S., Pallavi, Rani, S., Singla, P., Howard, E., & Groenewald, C. A. (2024). Artificial Intelligence in Linguistics Research: Applications in Language Acquisition and Analysis. NATURALISTA CAMPANO, 28(1), 1253-1262. https://www.museonaturalistico.it/index.php/journal/article/view/239/190

Heatley, A., Nation, I. S., & Coxhead, A. (2002). RANGE and FREQUENCY programs. Web VP Classic v.4.1 (User redesign Sept 2025). http://www.victoria.ac.nz/lals/staff/paul-nation.aspx

Hoang, H., & Crosthwaite, P. (2024). A comparative analysis of multiword units in the reading and listening input of English textbooks. System, 121, 103224. https://doi.org/10.1016/j.system.2024.103224

Hyland, K. (2004). Disciplinary Discourses: Social Interactions in Academic Writing. University of Michigan Press ELT. https://doi.org/10.3998/mpub.6719

Khojasteh, L., & Mukundan, J. (2025). A Systematic Review of Corpus-Based Methodologies in Textbook Analyses and Evaluation. Language Teaching Research Quarterly, 47, 175-195. https://doi.org/10.32038/ltrq.2025.47.10

Kyaw, E. M., & Jie, D. (2025). Systematic Review of Artificial Intelligence Integration in English Language Teaching: Trends, Applications, and Pedagogical Implications. English Education, Linguistics, and Literature Journal, 4(2), 153-181. https://journal.unupurwokerto.ac.id/index.php/educalitra/article/view/502

Kyle, K., & Crossley, S. A. (2015). Automatically Assessing Lexical Sophistication: Indices, Tools, Findings, and Application. TESOL Quarterly, 49(4), 757-786. https://doi.org/10.1002/tesq.194

Li, C., Wang, X., & Qian, L. (2025). Exploring Syntactic Complexity and Text Readability in an ELT Textbook Series for Chinese English Majors. SAGE Open, 15(1), 1-17. https://doi.org/10.1177/21582440251323619

Ly, C. K. (2024). Applying Role-Play Technique on Improving EFL Students’ Language Learning: A Case Study at a Vietnamese University. Journal of Knowledge Learning and Science Technology, 3(4), 1-10. https://doi.org/10.60087/jklst.v3.n4.p1

Ly, C. K. (2025). Language Teaching Materials Evaluation: Principles from Theoretical Perspectives. World Conference on Emerging Science, Innovation and Policy 2025. 3. Poland: Futurity Research Publishing. https://doi.org/10.5281/zenodo.15961001

Mai, N. H., Lien, N. N., & Trang, N. H. (2024). Lexical Demands and Features of English Textbooks for Vietnamese 10th Graders: An In-depth Comparison of Listening Sections. SAGE Open, 14(4), 1-15. https://doi.org/10.1177/21582440241299247

Matouq, G., & Alqabba, H. (2025). Building and Cleaning Corpora for Linguistic Analysis: A Practical Guide. Applied Language Learning, 34(1), 23-50. https://www.dliflc.edu/ojs/ALL/article/view/32/26

McDonough, J., Shaw, C., & Masuhara, H. (2013). Materials and Methods in ELT: A Teacher's Guide. (3rd, Ed.) Wiley-Blackwell.

McEnery, T., & Hardie, A. (2012). Corpus Linguistics: Method, Theory and Practice. Cambridge University Press. https://doi.org/10.1017/CBO9780511981395

Nation, I. S. (2018). Learning Vocabulary in Another Language. Cambridge University Press. https://doi.org/10.1017/CBO9781139858656

Önem, E. E. (2025). AI in Applied Linguistics: Implications, Limitations, and Issues. Dil Eğitimi ve Araştırmaları Dergisi, 11(2), 957-969. https://doi.org/10.31464/jlere.1671085

Römer, U. (2005). Progressives, Patterns, Pedagogy: A corpus-driven approach to English progressive forms, functions, contexts and didactics. John Benjamins Publishing Company. https://doi.org/10.1075/scl.18

Sameephet, B., Poonpon, K., Pradutshon, N., & Chansanam, W. (2025). Automated Vocabulary Profiling of TOEIC Listening Materials: A CEFR-Aligned Approach for EFL Learners. HighTech and Innovation Journal, 6(3), 991-1012. https://doi.org/10.28991/HIJ-2025-06-03-015

Shak, M. S., Albakri, I. S., Shukor, S. S., & Tahir, M. H. (2022). Criteria in English language textbook evaluation checklists: A systematic review. International Association for Research on Textbooks and Educational Media, 14(1), 1-19. https://doi.org/10.21344/iartem.v14i1.978

Skela, J., & Burazer, L. (2021). The Architecture of ELT Coursebooks: The Internal Organization of Coursebook Units. Journal for Foreign Languages, 13(1), 383-407. https://doi.org/10.4312/vestnik.13.383-407

Sun, Y., & Dang, T. N. (2020). Vocabulary in high-school EFL textbooks: Texts and learner knowledge. System, 93, 102279. https://doi.org/10.1016/j.system.2020.102279

To, V. (2018). Linguistic Complexity Analysis: A Case Study of Commonly-Used Textbooks in Vietnam. Sage Open, 8(3), 1-13. https://doi.org/10.1177/2158244018787586

Tomlinson, B. (2011). Materials Development in Language Teaching. Cambridge University Press. https://doi.org/10.1017/9781139042789

Tomlinson, B. (2013). Developing Principled Frameworks for Materials Development. In B. Tomlinson, & B. Tomlinson (Ed.), Developing Materials for Language Teaching (2nd ed., pp. 95-118). London: Bloomsbury.

Tran, T. N., & Ly, C. K. (2025). Integrating Information Technology in Foreign Language Education: Theoretical Foundations and Pedagogical Applications. Ho Chi Minh City University of Education Publishing House.

Xu, J., & Ye, F. (2025). Two decades of research on ELT textbook content: A bibliometric and content analysis. Studies in Second Language Learning and Teaching, 1-26. https://doi.org/10.14746/ssllt.39278

Yang, H., & Kyun, S. (2022). The current research trend of artificial intelligence in language learning: A systematic empirical literature review from an activity theory perspective. Australasian Journal of Educational Technology, 38(5), 180-210. https://doi.org/10.14742/ajet.7492

Zhang, X. (2017). A critical review of literature on English language teaching textbook evaluation: What systemic functional linguistics can offer. Journal of Language and Cultural Education, 5(1), 78-102. https://doi.org/10.1515/jolace-2017-0005

Downloads

Published

2026-02-03