Higher-order thinking in STEM and science education: A systematic review of constructs, frameworks, and applications
Downloads
This systematic review synthesizes how Higher-Order Thinking (HOT) is defined, theoretically framed, implemented, and assessed in STEM and science education. A Scopus search conducted on January 13, 2025 identified empirical qualitative, quantitative, and mixed-methods studies published between 2014 and 2024. Following PRISMA 2020 procedures, 24 studies met the predefined eligibility criteria and were included in the narrative and thematic synthesis. Methodological quality was appraised using the Mixed Methods Appraisal Tool, with appraisal findings used to calibrate the strength of interpretation rather than exclude eligible studies. The synthesis identified four recurring and overlapping HOT construct families: critical thinking and argumentation, problem-solving and scientific reasoning, creativity and innovation, and metacognition and self-regulation. Bloom’s revised taxonomy was the most visible cognitive taxonomy, primarily guiding learning objectives and assessment design, while constructivist, inquiry-based, problem-based, discovery, and metacognitive models structured learning processes. No included study operationalized the SOLO Taxonomy as its primary empirical framework. Active and technology-supported approaches—including digital games, Internet of Things–supported investigation, educational robotics, flipped learning, online metacognitive instruction, and digital assessment—were generally associated with favorable HOT outcomes, although evidence strength varied because many studies used non-randomized, short-term, or context-specific designs. The review contributes an integrated analytical map linking HOT constructs, framework functions, learning activities, technologies, and assessment practices. It highlights the need for clearer construct–instrument alignment, stronger longitudinal and transfer designs, and sustained teacher professional development.
Afikah, A., Astuti, S. R. D., Suyanta, S., Jumadi, J., & Rohaeti, E. (2022). Mobile learning in science education to improve higher-order thinking skills (HOTS) and communication skills: A systematic review. International Journal of Advanced Computer Science and Applications, 13(7), 698–704. https://doi.org/10.14569/IJACSA.2022.0130782
Agustian, H. Y., Finne, L. T., Jørgensen, J. T., Pedersen, M. I., Christiansen, F. V., Gammelgaard, B., & Nielsen, J. A. (2022). Learning outcomes of university chemistry teaching in laboratories: A systematic review of empirical literature. Review of Education, 10(2). https://doi.org/10.1002/rev3.3360
Amalina, I. K., & Vidákovich, T. (2022). An integrated STEM-based mathematical problem-solving test: Developing and reporting psychometric evidence. Journal on Mathematics Education, 13(4), 587–604. https://doi.org/10.22342/jme.v13i4.pp587-604
Ambarwati, D., & Suyatna, A. (2018). Interactive design for self-study and developing students’ critical thinking skills in electromagnetic radiation topic. Journal of Physics: Conference Series, 948, 012039. https://doi.org/10.1088/1742-6596/948/1/012039
Amin, S., Utaya, S., Bachri, S., Sumarmi, S., & Susilo, S. (2020). Effect of problem-based learning on critical thinking skill and environmental attitude. Journal for the Education of Gifted Young Scientists, 8(2), 743–755. https://doi.org/10.17478/jegys.650344
Awang Noh, S. N., Mat Zin, N. A., & Mohamed, H. (2020). Serious games requirements for higher-order thinking skills in science education. International Journal of Advanced Computer Science and Applications, 11(6), 211–216. https://doi.org/10.14569/IJACSA.2020.0110627
Bolat, A., & Karamustafaoğlu, S. (2024). Investigation of the items prepared by teachers who received training on item preparation measuring higher-order thinking skills. Participatory Educational Research, 11(6), 189–215. https://doi.org/10.17275/per.24.86.11.6
Caratozzolo, P., Lara-Prieto, V., Hosseini, S., & Membrillo-Hernández, J. (2022). The use of video essays and podcasts to enhance creativity and critical thinking in engineering. International Journal on Interactive Design and Manufacturing, 16(3), 1231–1251. https://doi.org/10.1007/s12008-022-00952-8
Chang, H.-Y., Liang, J.-C., & Tsai, C.-C. (2020). Students’ context-specific epistemic justifications, prior knowledge, engagement, and socioscientific reasoning in a mobile augmented reality learning environment. Journal of Science Education and Technology, 29(3), 399–408. https://doi.org/10.1007/s10956-020-09825-9
Chistyakov, A. A., Zhdanov, S. P., Avdeeva, E. L., Dyadichenko, E. A., Kunitsyna, M. L., & Yagudina, R. I. (2023). Exploring the characteristics and effectiveness of project-based learning for science and STEAM education. Eurasia Journal of Mathematics, Science and Technology Education, 19(5), em2256. https://doi.org/10.29333/ejmste/13128
Chung, E. Y. (2019). Facilitating learning of community-based rehabilitation through problem-based learning in higher education. BMC Medical Education, 19(1), 433. https://doi.org/10.1186/s12909-019-1868-4
Cormas, P. C. (2016). Sequenced integration and the identification of a problem-solving approach through a learning process. Eurasia Journal of Mathematics, Science and Technology Education, 12(9), 2557–2574. https://doi.org/10.12973/eurasia.2016.1258a
Cumming, M. M., Bettini, E., & Chow, J. C. (2023). High-quality systematic literature reviews in special education: Promoting coherence, contextualization, generativity, and transparency. Exceptional Children, 89(4), 412–431. https://doi.org/10.1177/00144029221146576
Darmaji, D., Astalini, A., Kamid, K., & Triani, E. (2024). The influence of generic skills on gender differences in scientific processing and critical thinking in physics motion dynamics. Jurnal Ilmiah Ilmu Terapan Universitas Jambi, 8(2), 524–537. https://doi.org/10.22437/jiituj.v8i2.37237
Darwis, R. H., Alimuddin, A., & Patimbangi, A. (2024). Higher-order thinking and critical thinking skills in problem-based learning environments: A systematic review. Journal of Learning and Development Studies, 4(2), 21–33. https://doi.org/10.32996/jlds.2024.2.2.3
Dewi, N. R., Listiaji, P., Akhlis, I., Kurniawan, I. O., & Widyaningrum, R. A. (2023). Project-based laboratory rotation blended learning model to train students’ critical thinking and collaboration in physics course. E3S Web of Conferences, 400, 01023. https://doi.org/10.1051/e3sconf/202340001023
Doolittle, P., Wojdak, K., & Walters, A. (2023). Defining active learning: A restricted systematic review. Teaching and Learning Inquiry, 11. https://doi.org/10.20343/teachlearninqu.11.25
Fathonah, S., Cahyono, E., Haryani, S., Sarwi, S., & Lestari, N. H. (2024). Application of multirepresentation-based creative problem-solving learning models to improve critical and creative thinking skills for students. International Journal of Cognitive Research in Science, Engineering and Education, 12(1), 185–200. https://doi.org/10.23947/2334-8496-2024-12-1-185-200
Fleming, J. I., McLucas, A. S., & Cook, B. G. (2023). Review of four preregistration registries for special education researchers. Remedial and Special Education, 44(6), 495–505. https://doi.org/10.1177/07419325231160293
Gard, A. M., Shariq, D., Albrecht, A., Lurie, A., Kim, H. C., Mitchell, C., & Hyde, L. W. (2025). A window into the state of the science: Current reporting practices related to generalizability in MRI and functional MRI studies. Advances in Methods and Practices in Psychological Science, 8(3). https://doi.org/10.1177/25152459251372115
Giroux, P., & Freiman, V. (2022a). Éditorial: Faire le point sur les compétences du 21e siècle. Revue hybride de l’éducation, 5(2), i–ix. https://doi.org/10.1522/rhe.v5i2.1371
Giroux, P., & Freiman, V. (2022b). Faire le point sur les compétences du 21e siècle. Revue hybride de l’éducation, 6(1), i–vii. https://doi.org/10.1522/rhe.v6i1.1471
Gouvea, J. S. (2023). Integrating computation into science education. CBE—Life Sciences Education, 22(3), fe2. https://doi.org/10.1187/cbe.23-05-0093
Hussein, M. H., Ow, S. H., Cheong, L. S., & Thong, M.-K. (2019). A digital game-based learning method to improve students’ critical thinking skills in elementary science. IEEE Access, 7, 96309–96318. https://doi.org/10.1109/ACCESS.2019.2929089
Irawati, F. I. M., & Sulisworo, D. (2023). Utilising smart water monitoring with IoT in science learning with problem-based learning model: Impact on critical thinking skills and the role of learning interest. Journal of Pedagogical Research, 7(4), 69–80. https://doi.org/10.33902/JPR.202323708
Ishmail, H., & Ngene, N. C. (2024). Improving diversity in learning activities in a teaching curriculum in higher medical education. Journal of Medical Education and Curricular Development, 11. https://doi.org/10.1177/23821205241293487
Itoi, K. (2024). Fostering inclusive learning and 21st-century skills: Creating translanguaging spaces in university content and language integrated learning courses. International Journal of Applied Linguistics, 36(1), 51–61. https://doi.org/10.1111/ijal.12643
Jaipal-Jamani, K. (2024). Educational robotics and preservice teachers: STEM problem-solving skills and self-efficacy to teach. Canadian Journal of Learning and Technology, 50(4 Special Issue), 1–21. https://doi.org/10.21432/cjlt28599
Jais, A., Yahaya, N., & Ibrahim, N. H. (2021). Sustainable development for teachers’ questioning techniques for higher-order thinking skills (HOTS). International Journal of Academic Research in Business and Social Sciences, 11(1). https://doi.org/10.6007/ijarbss/v11-i1/8163
Kanphukiew, S., & Nuangchalerm, P. (2024). Enhancing scientific problem-solving and learning achievement of lower secondary students through active learning. Jurnal Pendidikan IPA Indonesia, 13(1), 172–181. https://doi.org/10.15294/jpii.v13i1.47672
Katende, E. N. (2023). Critical thinking in curriculum content: The case of Uganda. Journal of Education and Practice, 7(8), 1–18. https://doi.org/10.47941/jep.1564
Khurma, O. A., & El Zein, F. (2024). Inquiry skills teaching and its relationship with UAE secondary school students’ critical thinking: Systematic review of science teachers’ perspectives. Eurasia Journal of Mathematics, Science and Technology Education, 20(2). https://doi.org/10.29333/ejmste/14155
Kimmel, M., & van Alphen, F. (2025). The spectrum of distributed creativity: Tango dancing and its generative modalities. Psychology of Aesthetics, Creativity, and the Arts, 19(1), 112–132. https://doi.org/10.1037/aca0000515
Kinoshita, H. (2022). Teaching of critical thinking skills by science teachers in Japanese primary schools. Journal of Baltic Science Education, 21(5), 801–816. https://doi.org/10.33225/jbse/22.21.801
Koyunlu Ünlü, Z., & Dökme, I. (2017). Science teacher candidates’ epistemological beliefs and critical thinking disposition. Eurasian Journal of Educational Research, 72, 203–220. https://doi.org/10.14689/ejer.2017.72.11
Kožuh, I., Krajnc, R., Hadjileontiadis, L. J., & Debevc, M. (2018). Assessment of problem solving ability in novice programmers. PLOS ONE, 13(9), e0201919. https://doi.org/10.1371/journal.pone.0201919
Liu, J., Ma, Y., Sun, X., Zhu, Z., & Xu, Y. (2021). A systematic review of higher-order thinking by visualizing its structure through HistCite and CiteSpace software. The Asia-Pacific Education Researcher, 31(6), 635–645. https://doi.org/10.1007/s40299-021-00614-5
Liu, L. Q., & Mehigan, S. (2021). A systematic review of interventions used to enhance implementation of and compliance with the World Health Organization Surgical Safety Checklist in adult surgery. AORN Journal, 114(2), 159–170. https://doi.org/10.1002/aorn.13469
Loof, H. D., Pauw, J. B., & Petegem, P. V. (2022). Integrated STEM education: The effects of a long-term intervention on students’ cognitive performance. European Journal of STEM Education, 7(1), 13. https://doi.org/10.20897/ejsteme/12738
López-Nicolás, R., López-López, J. A., Rubio-Aparicio, M., & Sánchez-Meca, J. (2021). A meta-review of transparency- and reproducibility-related reporting practices in published meta-analyses on clinical psychological interventions (2000–2020). Behavior Research Methods, 54(1), 334–349. https://doi.org/10.3758/s13428-021-01644-z
Mak, H. W. F., Cheung, C. K., Lau, J., Chan, S. C. W., & Li, P. H. (2025). Transparency, reproducibility, and accessibility of clinical and experimental studies in allergy (TRACES): Study design and protocol. Journal of Allergy and Clinical Immunology: Global, 4(2), 100447. https://doi.org/10.1016/j.jacig.2025.100447
Marthaliakirana, A. D., Suwono, H., Saefi, M., & Gofur, A. (2022). Problem-based learning with metacognitive prompts for enhancing argumentation and critical thinking of secondary school students. Eurasia Journal of Mathematics, Science and Technology Education, 18(9), em2148. https://doi.org/10.29333/ejmste/12304
Maryani, I., Prasetyo, Z. K., Wilujeng, I., & Purwanti, S. (2022). Promoting higher-order thinking skills during online learning: The integration of metacognition in science for higher education. International Journal of Evaluation and Research in Education, 11(4), 1980–1988. https://doi.org/10.11591/ijere.v11i4.23129
Mayo-Wilson, E., Grant, S., Supplee, L., Kianersi, S., Amin, A., DeHaven, A., & Mellor, D. T. (2021). Evaluating implementation of the Transparency and Openness Promotion (TOP) Guidelines: The TRUST process for rating journal policies, procedures, and practices. Research Integrity and Peer Review, 6(1). https://doi.org/10.1186/s41073-021-00112-8
McMahon, K., Clark, I., Stensæth, K., Odell-Miller, H., Wosch, T., Bukowska, A. A., & Baker, F. A. (2022). Exploring shared musical experiences in dementia care: A worked example of a qualitative systematic review and thematic synthesis. International Journal of Qualitative Methods, 21. https://doi.org/10.1177/16094069221127509
Mejía-Cáceres, M. A., Rieckmann, M., & Folena Araújo, M. L. (2023). Political discourses as a resource for climate change education: Promoting critical thinking by closing the gap between science education and political education. Sustainability, 15(8). https://doi.org/10.3390/su15086672
Meschede, T., Haque, Z., Warfield, M. E., Melchior, A., Burack, C., & Hoover, M. (2022). Transforming STEM outcomes: Results from a seven-year follow-up study of an after-school robotics program’s impacts on freshman students. School Science and Mathematics, 122(7), 343–357. https://doi.org/10.1111/ssm.12552
Müller, S., & Pietzner, V. (2020). Comparative study of divergent thinking among participants in a German science competition and pupils in a control group. Eurasia Journal of Mathematics, Science and Technology Education, 16(10), em1883. https://doi.org/10.29333/ejmste/8408
Mutseekwa, C., & Maeresera, J. (2024). Evaluating contexts for implementing a competency-based curriculum in South and Eastern Africa: A meta-narrative review. The Curriculum Journal, 36(3), 368–383. https://doi.org/10.1002/curj.301
Nusantari, E., Abdul, A., Damopolii, I., Alghafri, A. S. R., & Bakkar, B. S. (2021). Combination of discovery learning and metacognitive knowledge strategy to enhance students’ critical thinking skills. European Journal of Educational Research, 10(4), 1781–1791. https://doi.org/10.12973/EU-JER.10.4.1781
Parent, S., Caron, J., & Adams, G. (2022). Réflexion théorique et expérientielle sur le développement des compétences du 21e siècle des élèves en classe flexible au primaire. Revue hybride de l’éducation, 6(1), 57–91. https://doi.org/10.1522/rhe.v6i1.1249
Pouw, W. T. J. L., van Gog, T., Zwaan, R. A., & Paas, F. (2016). Augmenting instructional animations with a body analogy to help children learn about physical systems. Frontiers in Psychology, 7, 860. https://doi.org/10.3389/fpsyg.2016.00860
Pujani, N. M., Arsana, K. G. Y., Suma, K., Selamet, K., & Erlina, N. (2022). The effectiveness of introduction to astronomy teaching materials to improve problem-solving and generic science skills. Jurnal Pendidikan IPA Indonesia, 11(2), 333–340. https://doi.org/10.15294/jpii.v11i2.34801
Pujawan, I. G. N., Rediani, N. N., Antara, I. G. W. S., Putri, N. N., & Bayu, G. W. (2022). Revised Bloom taxonomy-oriented learning activities to develop scientific literacy and creative thinking skills. Jurnal Pendidikan IPA Indonesia, 11(1), 47–60. https://doi.org/10.15294/jpii.v11i1.34628
Rachmawati, D. L., & Purwati, O. (2021). EFL teachers’ attitudes and competence in developing HOTS-based formative assessment. Journal of English Educators Society, 6(2). https://doi.org/10.21070/jees.v6i2.1060
Redshaw, J. (2024). The recursive grammar of mental time travel. Philosophical Transactions of the Royal Society B: Biological Sciences, 379(1913). https://doi.org/10.1098/rstb.2023.0412
Rehmat, A. P., & Hartley, K. (2020). Building engineering awareness: Problem-based learning approach for STEM integration. Interdisciplinary Journal of Problem-Based Learning, 14(1), 1–15. https://doi.org/10.14434/ijpbl.v14i1.28636
Remington, T. F., Chou, P., & Topa, B. (2023). Experiential learning through STEM: Recent initiatives in the United States. International Journal of Training and Development, 27(3–4), 327–359. https://doi.org/10.1111/ijtd.12302
Reyna, J., & Meier, P. (2020). Co-creation of knowledge using mobile technologies and digital media as pedagogical devices in undergraduate STEM education. Research in Learning Technology, 28. https://doi.org/10.25304/rlt.v28.2356
Ruzaman, N. K., & Rosli, D. I. (2020). Inquiry-based education: Innovation in participatory inquiry paradigm. International Journal of Emerging Technologies in Learning, 15(10), 4–15. https://doi.org/10.3991/ijet.v15i10.11460
Sandoval-Lentisco, A., Tortajada, M., López-Nicolás, R., López-López, J. A., Wagenmakers, E., Sánchez-Meca, J., & Hardwicke, T. E. (2025). Preregistration of psychology meta-analyses: A cross-sectional study of prevalence and practice. Advances in Methods and Practices in Psychological Science, 8(1). https://doi.org/10.1177/25152459241300113
Sasson, I., & Tifferet, S. (2025). Active and passive explicit instruction in question-formulating in higher education. The Curriculum Journal. https://doi.org/10.1002/curj.70004
Shou, X., Han, K., & Sheng-quan, L. (2025). Primary students’ core dimension of higher-order thinking in science: Measurement and reflections. Psychology in the Schools, 62(11), 4760–4778. https://doi.org/10.1002/pits.70035
Sidiq, Y., Ishartono, N., Desstya, A., Prayitno, H. J., Anif, S., & Hidayat, M. L. (2021). Improving elementary school students’ critical thinking skill in science through HOTS-based science questions: A quasi-experimental study. Jurnal Pendidikan IPA Indonesia, 10(3), 378–386. https://doi.org/10.15294/JPII.V10I3.30891
Smet, C. D., Raileanu, M.-B., & Roméro, M. (2021). Étude de la littérature sur la créativité en sciences de l’éducation dans les pays francophones. McGill Journal of Education / Revue des sciences de l’éducation de McGill, 55(3), 588–618. https://doi.org/10.7202/1083424ar
Sotiriou, S. A., Lazoudis, A., & Bogner, F. X. (2020). Inquiry-based learning and e-learning: How to serve high and low achievers. Smart Learning Environments, 7(1), 29. https://doi.org/10.1186/s40561-020-00130-x
Suardana, I. N., Redhana, I. W., & Yunithasari, N. P. M. (2020). Students’ critical thinking skills comparison in discovery learning based on constructing concept mapping and mind mapping. Journal of Physics: Conference Series, 1521(4), 042089. https://doi.org/10.1088/1742-6596/1521/4/042089
Suwardika, G., Sopandi, A. T., Indrawan, I. P. O., & Masakazu, K. (2024). A flipped classroom with whiteboard animation and modules to enhance students’ self-regulation, critical thinking and communication skills: A conceptual framework and its implementation. Asian Association of Open Universities Journal, 19(2), 135–152. https://doi.org/10.1108/AAOUJ-10-2023-0115
Tractenberg, R. E., Lindvall, J. M., Attwood, T. K., & Via, A. (2019). The Mastery Rubric for Bioinformatics: A tool to support design and evaluation of career-spanning education and training. PLOS ONE, 14(11), e0225256. https://doi.org/10.1371/journal.pone.0225256
Tremblay, C., & Poëllhuber, B. (2022). Analyse qualitative de référentiels de compétences du XXIe siècle, numériques et informationnelles: Tendances mondiales observées. Formation et Profession, 30(2), 1. https://doi.org/10.18162/fp.2022.648
Triana, H., Abustang, P. B., Utomo, E., Rakhman, G. G. F., & Fahrurrozi, F. (2023). Assessment evaluation using SOLO taxonomy for measuring levels of critical thinking skills: PYP International Baccalaureate case study. Prisma Sains: Jurnal Pengkajian Ilmu dan Pembelajaran Matematika dan IPA IKIP Mataram, 11(2), 581. https://doi.org/10.33394/j-ps.v11i2.7894
Wilson, R., Hrubý, A., Perez-Zapata, D. I., van der Kleij, S. W., & Apperly, I. A. (2023). Is recursive “mindreading” really an exception to limitations on recursive thinking? Journal of Experimental Psychology: General, 152(5), 1454–1468. https://doi.org/10.1037/xge0001322
Wrzesien, M., & Alcañiz Raya, M. (2010). Learning in serious virtual worlds: Evaluation of learning effectiveness and appeal to students in the E-Junior project. Computers & Education, 55(1), 178–187. https://doi.org/10.1016/j.compedu.2010.01.003
Yanti, F. A., & Thohir, M. A. (2024). Higher-order thinking skills in science learning: A systematic review from 2014–2023. International Journal of Evaluation and Research in Education, 13(4), 2419–2427. https://doi.org/10.11591/ijere.v13i4.28082
Zana, F. M., Sa’dijah, C., & Susiswo, S. (2024). The cognitive alignment of mathematics teachers’ assessments and its curriculum. International Journal of Evaluation and Research in Education, 13(3), 1561. https://doi.org/10.11591/ijere.v13i3.26814
Zhang, W., & Wang, Z. (2021). Theory and practice of VR/AR in K–12 science education: A systematic review. Sustainability, 13(22), 12646. https://doi.org/10.3390/su132212646
Zhou, Y., Ning, Y., Chen, J., Zhang, W., & Wijaya, T. T. (2024). Development and validation of a mathematical higher-order thinking scale for high school students. Psychology in the Schools, 61(8), 3160–3192. https://doi.org/10.1002/pits.23213
Zuhaida, A. (2018). Implementation of basic chemistry experiment based on metacognition to increase problem-solving and build concept understanding. Journal of Physics: Conference Series, 1006, 012041. https://doi.org/10.1088/1742-6596/1006/1/012041
Zulfiani, Z., Suwarna, I. P., Muin, A., Mulyati, T., & El Islami, R. A. Z. (2023). Developing the MathSci 21st app: Enhancing higher-order thinking skills assessment in mathematics and science education within an Islamic context. International Journal of Advanced and Applied Sciences, 10(8), 19–31. https://doi.org/10.21833/ijaas.2023.08.003
Copyright (c) 2026 Muhali Muhali, Hunaepi Hunaepi, Ni Nyoman Sri Putu Verawati

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Authors who publish with Review Journal of Higher-Order Thinking and Metacognition agree to the following terms:
- For all articles published in Review Journal of Higher-Order Thinking and Metacognition, copyright is retained by the authors. The authors grant the publisher permission to announce the work under specific conditions. When the manuscript is accepted for publication, the authors agree to implement a non-exclusive transfer of publishing rights to the journals.
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution-ShareAlike 4.0 International License that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

