Exploring Research Trends on PISA in Mathematics: A Systematic Review Using Bibliometric Analysis

Nur Riski Hasanah, Turmudi Turmudi, Dadang Juandi, Mohd Zaidi Bin Amiruddin

Abstract


Research on the development of PISA studies in the mathematics domain has not been widely or specifically reported in scientific publications. Although the emphasis on PISA research has been evident in recent years. PISA data and reports in the mathematics domain are not readily available. Meanwhile, these reports are needed by many researchers to increase mathematics outcomes. Therefore, a bibliometric analyses is needed to report the results. This study aims to review PISA studies in the mathematics domain with bibliometric and bibliographic analysis. The analysis in this study used documents from the Scopus database published from 2013 - 2023. The analysis includes performance, citation, co-word, and co-authorship supported by VOSviewer and Rstudio applications. The results of the analysis show that publication and citation trends fluctuate down, up, and static in a certain range of years. Analysis of documents, sources, authors, organizations, and countries is also reported. The top five documents with the most citations focused on factors affecting PISA results, problem-solving difficulties, problem development, and student achievement. The documents also discussed analysis of student errors, development of PISA item contexts, and other variabels. The most productive authors focused on the keywords of mathematics problem design and student answer analysis. The keywords that appeared the most were factors that influence PISA in  content, process and context components. Based on the top documents and keywords that often appear, teachers and policy makers can make evaluation and analysis materials to improve the learning process so that they can achieve the expected PISA scores.

 

Penelitian tentang pengembangan studi PISA dalam domain matematika belum banyak dilaporkan secara luas atau secara khusus dalam publikasi ilmiah. Meskipun penekanan pada penelitian PISA telah terlihat dalam beberapa tahun terakhir. Data dan laporan PISA dalam domain matematika belum tersedia. Sementara itu, laporan-laporan ini dibutuhkan oleh banyak peneliti untuk meningkatkan hasil matematika. Oleh karena itu, analisis bibliometrik diperlukan untuk melaporkan hasil-hasil tersebut. Penelitian ini bertujuan untuk meninjau studi PISA dalam domain matematika dengan analisis bibliometrik dan bibliografi. Analisis dalam penelitian ini menggunakan dokumen dari database Scopus yang diterbitkan dari tahun 2013 - 2023. Analisis yang dilakukan meliputi performa, sitasi, co-word, dan co-authorship yang didukung oleh aplikasi VOSviewer dan Rstudio. Hasil analisis menunjukkan bahwa tren publikasi dan sitasi berfluktuasi turun, naik, dan statis dalam rentang tahun tertentu. Analisis dokumen, sumber, penulis, organisasi, dan negara juga dilaporkan. Lima dokumen teratas dengan kutipan terbanyak berfokus pada faktor-faktor yang mempengaruhi hasil PISA, kesulitan dalam menyelesaikan soal, pengembangan soal, dan prestasi siswa. Dokumen-dokumen tersebut juga membahas analisis kesalahan siswa, pengembangan konteks soal PISA, dan variabel-variabel lainnya. Penulis yang paling produktif berfokus pada kata kunci desain soal matematika dan analisis jawaban siswa. Kata kunci yang paling banyak muncul adalah faktor-faktor yang mempengaruhi PISA pada komponen konten, proses, dan konteks. Berdasarkan dokumen teratas dan kata kunci yang sering muncul, guru dan pengambil kebijakan dapat membuat bahan evaluasi dan analisis untuk meningkatkan proses pembelajaran agar dapat mencapai skor PISA yang diharapkan.

 


Full Text:

PDF

References


Addey, C., & Sellar, S. (2020). The rise of international large-scale assessments and rationales for participation. In The Legacy of Jullien's Work for Comparative Education (pp. 132-150). Routledge.

Ahyan, S., Zulkardi, Z., & Darmawijoyo, D. (2014). Developing mathematics problems based on PISA level of change and relationships content. Journal on Mathematics Education, 5(1), 47-56.

Aria, M., & Cuccurullo, C. (2017). bibliometrix: An R-tool for comprehensive science mapping analysis. Journal of informetrics, 11(4), 959-975.

Baird, J. A., Johnson, S., Hopfenbeck, T. N., Isaacs, T., Sprague, T., Stobart, G., & Yu, G. (2016). On the supranational spell of PISA in policy. Educational Research, 58(2), 121-138.

Donthu, N., Kumar, S., Pandey, N., Pandey, N., & Mishra, A. (2021). Mapping the electronic word-of-mouth (eWOM) research: A systematic review and bibliometric analysis. Journal of Business Research, 135, 758-773.

Gasparyan, A. Y., Yessirkepov, M., Voronov, A. A., Trukhachev, V. I., Kostyukova, E. I., Gerasimov, A. N., & Kitas, G. D. (2016). Specialist bibliographic databases. Journal of Korean Medical Science, 31(5), 660.

Hodonu-Wusu, J. O., & Lazarus, G. N. (2018). Major trends in LIS research: A bibliometric analysis. Library Philosophy and Practice, 1.

Hayat, B., & Yusuf, S. (2010). Benchmark internasional mutu pendidikan. Jakarta: Bumi Aksara.

Hernández-Torrano, D., & Courtney, M. G. (2021). Modern international large-scale assessment in education: An integrative review and mapping of the literature. Large-Scale Assessments in Education, 9(1), 17.

Hopfenbeck, T. N., & Görgen, K. (2017). The politics of PISA: The media, policy and public responses in Norway and England. European Journal of Education, 52(2), 192-205.

Hopfenbeck, T. N., Lenkeit, J., El Masri, Y., Cantrell, K., Ryan, J., & Baird, J. A. (2018). Lessons learned from PISA: A systematic review of peer-reviewed articles on the programme for international student assessment. Scandinavian Journal of Educational Research, 62(3), 333-353.

Koo, M. (2017). A bibliometric analysis of two decades of aromatherapy research. BMC research notes, 10, 1-9.

Lingard, B., Thompson, G., & Sellar, S. (2016). National testing in schools. Oxon, United Kingdom: Routledge.

Martens, K., & Niemann, D. (2013). When do numbers count? The differential impact of the PISA rating and ranking on education policy in Germany and the US. German Politics, 22(3), 314-332.

Meyer, H. D. (2014). The OECD as pivot of the emerging global educational accountability regime: How accountable are the accountants?. Teachers College Record, 116(9), 1–20.

Meyer, H. D., & Benavot, A. (Eds.). (2013, May). PISA, power, and policy: The emergence of global educational governance. Symposium Books Ltd.

Fuad, M., & Suyanto, E. (2022). A bibliometric analysis of technology-based foreign language learning during the COVID-19 pandemic: Direction for Indonesia language learning. International Journal of Information and Education Technology, 12(10), 983-995.

Perrier, L., Lightfoot, D., Kealey, M. R., Straus, S. E., & Tricco, A. C. (2016). Knowledge synthesis research: a bibliometric analysis. Journal of Clinical Epidemiology, 73, 50–57.

Hastedt, D., & Rocher, T. (2020). International Large-Scale Assessments in Education: A Brief Guide. IEA Compass: Briefs in Education. Number 10. International Association for the Evaluation of Educational Achievement.

Sälzer, C., & Roczen, N. (2018). Assessing global competence in PISA 2018: Challenges and approaches to capturing a complex construct. International journal of development education and global learning, 10(1).

Teig, N., Scherer, R., & Olsen, R. V. (2022). A systematic review of studies investigating science teaching and learning: over two decades of TIMSS and PISA. International Journal of Science Education, 44(12), 2035-2058.

Thompson, G., Sellar, S., & Lingard, B. (2015). The life of data: Evolving national testing. In National Testing in Schools (pp. 212-229). Routledge.

Xiaomin, L., & Auld, E. (2020). A historical perspective on the OECD’s ‘humanitarian turn’: PISA for Development and the Learning Framework 2030. Comparative Education, 56(4), 503-521.


Refbacks

  • There are currently no refbacks.


Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.

INDEXING: