|  e-ISSN: 2718-0107

Original article | Base for Electronic Educational Sciences 2024, Vol. 5(2) 74-96

The Effect of Educational Robotic Applications on Academic Achievement: A Meta-Analytic and Meta-Thematic Study

Muhterem Akgün & İsmail Hakan Akgün

pp. 74 - 96   |  DOI: https://doi.org/10.29329/bedu.2024.1064.5   |  Manu. Number: MANU-2406-03-0005

Published online: September 30, 2024  |   Number of Views: 12  |  Number of Download: 28


Abstract

In this study, the effect of educational robotic applications on academic achievement was examined using meta-analytic and meta-thematic methods. The CMA program was used in the analysis of the quantitative data in the study, and since it was determined that there was heterogeneity between the studies. As a result of the quantitative findings of the study, it was determined that educational robotic applications had a strong positive effect on the academic achievement of the students (Hedge's g = 0.822). According to the results of the research, it was concluded that it had the most significant effect on students' academic success in the fields of science (Hedge's g = 1.134) and algorithm (Hedge's g = 1.121) according to the courses, and at the secondary school level (g = 0874, Qbetween = 1.608, p = 0.000) has been reached. As a result of the qualitative findings obtained from the study, it was determined that educational robotic applications contributed positively to students' learning in many cognitive, affective, and social aspects such as classroom participation, active learning, motivation, cooperation, and communication. According to the results of the research, it can be said that educational robotic environments have many positive effects such as relating to real life, learning by doing and experiencing, provides concrete experiences, active participation, but there are problems such as technical problems, time consuming and making learning difficult.

Keywords: Educational Robotics, meta-analysis, meta-thematic, academic achievement


How to Cite this Article?

APA 6th edition
Akgun, M. & Akgun, I.H. (2024). The Effect of Educational Robotic Applications on Academic Achievement: A Meta-Analytic and Meta-Thematic Study . Base for Electronic Educational Sciences, 5(2), 74-96. doi: 10.29329/bedu.2024.1064.5

Harvard
Akgun, M. and Akgun, I. (2024). The Effect of Educational Robotic Applications on Academic Achievement: A Meta-Analytic and Meta-Thematic Study . Base for Electronic Educational Sciences, 5(2), pp. 74-96.

Chicago 16th edition
Akgun, Muhterem and Ismail Hakan Akgun (2024). "The Effect of Educational Robotic Applications on Academic Achievement: A Meta-Analytic and Meta-Thematic Study ". Base for Electronic Educational Sciences 5 (2):74-96. doi:10.29329/bedu.2024.1064.5.

References

    Akarca, T. A. (2019). Examination of the teaching of "water" theme to science teacher candidates with Lego robotics applications in terms of various variables. Unpublished Master thesis, Ondokuz Mayıs University.

    *Akca, Ö.F. (2020). The Effect of Inquiry-Based Robotic Activities in Science Centers on Students' Conceptual Achievement, Logical Thinking and the Development of Science Process Skills. Unpublished Master thesis. Gazi University Üniversitesi, Institute of Education Sciences

    Akman-Selçuk N.  (2019). Examination of educational robotics applications in terms of course motivation, robotic attitudes and achievements of secondary school students. Unpublished Doctorate Thesis. İstanbul University.

    Alimisis, D. (2013). Educational robotics: Open questions and new challenges. Themes in Science and Technology Education, 6(1), 63-71.

    *Altakhayneh, B. (2020). The impact of using the LEGO education program on mathematics achievement of different levels of elementary students. European Journal of Educational Research, 9(2), 603-610. https://doi.org/10.12973/eujer.9.2.603

    Aslan, A., Göksu, İ., & Atıcı, B. (2016). Teachers' opinions on the information technology course and information technology teacher. Journal of Educatıonal and Instructıonal Studıes In The World, 6 (1), 41-49.

    Atasoy, B., Yüksel, A. & Özdemir, S. (2018). The Impact of Educational Robotic Applications on 21st Century Skills,  International Computer and Instructional Technologies Education Symposium, İzmir, Turkey, pp.335-336, 2018               

    Athanasiou, L., Mikropoulos, T. A., & Mavridis, D. (2018, June). Robotics Interventions for Improving Educational Outcomes-A Meta-analysis. In International Conference on Technology and Innovation in Learning, Teaching and Education (pp. 91-102). Springer, Cham.

    Avcı, B. (2017). The effect of Lego mindstorms robotics projects on pre-service teachers' technological pedagogical content knowledge, problem solving skills and scientific creativity. Unpublished Master thesis, Marmara University.

    Aydın, N. (2019). The effect of STEM and STEM-Based Robotics Activities on Secondary School Students' Reflective Thinking for Problem Solving, mental risk taking and motivating strategies in learning. Unpublished Master Thesis. Erzincan Binali Yıldırım University.

    *Badeleh, A. (2019). The effects of robotics training on students’ creativity and learning in physics. Education and Information Technologies, 1-13.

    Bal, N. (2019).  The Effect of Basic Robotics Education on Secondary School Students' 21st Century Skills and Computational Thinking Skills. Unpublished Master Thesis. Hatay Mustafa Kemal University.

    Barak, M.  & Assal, M.  (2018).  Robotics and  STEM learning:  Students’  achievements  in  assignments according to the  P3  Task Taxonomy—practice,  problem  solving,  and projects. International Journal of Technology and Design Education, 28(1), 121-144. Doi: 10.1007/s10798-016-9385-9

    *Barker, B.S. & Ansorge, J.  (2007) Robotics as Means to Increase Achievement Scores in an Informal Learning Environment, Journal of Research on Technology in Education, 39:3, 229-243, DOI: 10.1080/15391523.2007.10782481

    Batdı, V. (2017). The effect of multiple intelligences on academic achievement: A meta-analytic and thematic study. Educational Sciences: Theory & Practice, 17, 2057–2092. doi:10.12738/estp.2017.6.0104

    Batdı, V. (2019). Meta-thematic analysis. Anı Publishing.

    Begg, C. B. (1994). Publication bias. The handbook of research synthesis, 25, 299-409.

    Berland, M.  and Wilensky,  U.  (2015). Comparing virtual and physical robotics environments for supporting complex systems and computational thinking. Journal of Science Education and Technology,24(5), 628-647. Doi: 10.1007/s10956-015-9552-x

    Borenstein, M., Higgins, J. P., Hedges, L. V., & Rothstein, H. R. (2017). Basics of meta‐analysis: I2 is not an absolute measure of heterogeneity. Research synthesis methods, 8(1), 5-18.

    Botelho, S. S., Braz, L. G., & Rodrigues, R. N. (2012). Exploring creativity and sociability with an accessible educational robotic kit. InProc. 3rd Int. Conf. on Robotics in Education (RiE 2012), Prague, Czech Republic (pp. 55-60).

    *Boyraz, A. (2019). The Effect of Collaborative Learning Method Enriched with Legos on Primary School Seventh Grade Students' Achievement in the Unit of the Structure and Properties of Matter. Unpublished Mastery Thesis. Erciyes University.

    Catlin, D. and Blamires, M. 2010. The principles of Educational Robotic Applications (ERA): a framework for understanding and developing educational robots and their activities. In: Clayson, J. and Kalas̆, I. (ed.) Constructionism 2010: Constructionist Approaches to Creative Learning, Thinking and Education: Lessons for the 21st Century: Proceedings for Constructionism 2010: The 12th Euro Logo Conference, 16-20 August, 2010 Paris, France Paris The 12th Euro Logo conference

    *Chin, K. Y., Hong, Z. W. and Chen, Y. L. (2014). Impact of using an educational robot-based learning system on students’ motivation in elementary education. IEEE Transactions on Learning Technologies, 7(4), 333-345. Doi: 10.1109/TLT.2014.2346756

    Ching, Y.  H., Yang, D., Wang, S., Baek, Y., Swanson, S.  and Chittoori,  B.  (2019). Elementary school student development of STEM attitudes and perceived learning in a STEM integrated robotics curriculum. Tech Trends, 63(5), 590-601. Doi: 10.1007/s11528-019-00388-0

    *Çakır, S. (2019). The Effect of Robotic Coding Applications on Learning Products in the Unit of "Microscopic Living Beings and Our Environment" in the 4th Grade Science Lesson. Unpublished Masters Thesis. Zonguldak Bülent Ecevit University. 

    *Çam, E. (2019). The effect of robotic assisted programming education on problem solving skills, academic achievement and motivation. Unpublished Doctoral Thesis. Sakarya University. 

    Çelik, Ş.B. (2019). The effect of robotic programming education on secondary school students' critical thinking skills. Unpublished Mastery Thesis. Süleyman Demirel University.

    *Çukurbaşı, B. (2016). The effect of problem-based teaching practices supported by the flipped classroom model and lego-logo applications on the achievement and motivation of high school students. Unpublished Mastery Thesis. Sakarya University.

    Dinçer, S. (2014). Applied Meta-analysis in Educational Sciences. Pegem Akademi.

    Dizman, A. (2018). The Effect of Coding, Robotics, 3D Design and Game Design Education on Problem Solving Skills and Metacognitive Awareness Levels of 11-14 Age Group Students. Unpublished Mastery Thesis. Bahçeşehir University. İstanbul.

    Dönmez, İ. (2017). Opinions of students and team coaches about robotic tournaments within the framework of STEM education (science heroes meet example). Journal of Educational Science and Technology Research, 2(1), 25-42.

    Durak, H. Y., Yılmaz, F. G. K. & Yılmaz, R. (2018). Examining the opinions of secondary school students about the use of robot design activities in programming teaching, Aegean Journal of Educational Technologies, 2(2), 32-43.

    Egger, M., Smith, G. D., & Phillips, A. N. (1997). Meta-analysis: principles and procedures. Bmj, 315(7121), 1533-1537.

    Eguchi, A. (2010). What is educational robotics? Theories behind it and practical implementation. In D. Gibson &B. Dodge (eds.), Proceedings of Society for Information Technology & Teacher Education International Conference 2010 (pp. 4006-4014). Chesapeake, VA: AACE.

    Eguchi, A. (2014). Educational robotics for promoting 21st century skills. Journal of Automation Mobile Robotics and Intelligent Systems, 8(1), 5-11.

    *Eraytaç, Ö.F. (2019). The Effect of Block-Based Coding Method on the Academic Achievement of Secondary School Students in Robotic Coding Education. Unpublished Master’s Thesis.  Çukurova University.  

    Erdoğan, Ö., Kurt, M. ve Toy, M. (2020). Investigation of the Effects of Robotic Applications on Some 21st Century Skills of Science Teacher Candidates,  Eurasian Journal of Social and Economic Studies, 7(4), 117-137.

    Erten, E.  (2019). A case study on coding and robotics teaching. Unpublished Mastery Thesis. Balıkesir University.

    *Gündoğdu, B. (2020). The Effect of Teaching Algorithms with Lego Robotics to Vocational High School Students on Computer Thinking, Cognitive Load and Success. Unpublished master's thesis. Atatürk University. 

    *Hangün, M. E. (2019). The effect of robot programming education on students' mathematics achievement, mathematics anxiety, programming self-efficacy and STEM attitude. Unpublished master's thesis, Fırat University, Elazığ.

    Harel, I., & Papert, S. (1990). Software design as a learning environment. Interactive learning environments, 1(1), 1-32.

    Hedges, L. & Olkin, I. (2014). Statistical methods for meta-analysis. Academic press.

    *Hong, Z. W., Huang, Y. M., Hsu, M. & Shen, W. W. (2016). Authoring robot-assisted instructional materials for improving learning performance and motivation in EFL classrooms. Journal of Educational Technology &Society, 19(1), 337-349.

    *Huang, K.  H., Yang, T.  M. & Cheng, C.  C. (2013).  Engineering to see and move:  Teaching computer programming with flowcharts vs. LEGO robots. International Journal of Emerging Technologies in Learning (iJET), 8(4), 23-26.

    Kabátová, M., & Pekárová, J. (2010). Learning how to teach robotics. In Constructionism 2010 conference.

    Karademir, T. (2018). Technological rhythms: the use of robotic applications in music education. Elementary Education Online, 17(2).

    Kasalak, İ. (2017). The Effect of Robotic Coding Activities on Secondary School Students' Self-Efficacy Perceptions Regarding Coding and Student Experiences Regarding the Activities. Unpublished Master's thesis, Hacettepe University.

    Kaya, M., Korkmaz, Ö. & Çakır, R. (2020). The Effect of Gamified Robot Activities on Middle School Students' Problem Solving and Computational Thinking Skills. Aegean Journal of Education, 21(1), 54-70.

    Kazez, H. (2015). The effect of lego moreto math educational tool on mathematical problem solving, fluency, comprehension and reasoning skills in primary school 2nd graders: a case study. Unpublished master's thesis. Fırat University, Elazığ.

    *Kert, S. B., Erkoç, M. F., & Yeni, S. (2020). The effect of robotics on six graders’ academic achievement, computational thinking skills and conceptual knowledge levels. Thinking Skills and Creativity, 38, 100714.

    *Kılınç, A. (2014). The Use of iRobotics Technology in 7th Grade Light Unit Teaching. Unpublished master's thesis. Erciyes University. 

    Kıran, B. (2018). Investigation of the behaviors and views of gifted secondary school students on creative, reflective thinking and problem-solving skills in project-based basic robotics education processes. Unpublished Master's thesis, Başkent University, İstanbul.

    Koç, A. & Böyük, U. (2013). Technology-based learning in science and technology education: Robotics applications. Journal of Turkish Science Education, 10(1), 139-155.

    *Korkmaz, Ö. (2018). The effect of scratch-and lego Mindstorms Ev3-Based programming activities on academic achievement, problem-solving skills and logical-mathematical thinking skills of students. MOJES: Malaysian Online Journal of Educational Sciences, 4(3), 73-88.

    *Kuş, M. (2016). The Effect of Robotic Modules on the Teaching of Force and Motion Unit of Secondary School Students. Unpublished master's thesis. İstanbul University, İstanbul.

    *Li, Y., Huang, Z., Jiang, M. ve Chang, T. W. (2016). The effect on pupils' science performance and problem-solving ability through Lego:  An engineering design-based modeling approach. Journal of Educational Technology & Society, 19(3), 143-156.

    Littell, J. H., Corcoran, J., & Pillai, V. (2008). Systematic reviews and meta-analysis. Oxford University Press.

    LOGO (2020). Logo (programming language).  https://en.wikipedia.org/wiki/Logo_(programming_language) Date of access: 29.09.2020

    Menegatti, E., & Moro, M. (2010, November). Educational robotics from high-school to master of science. In Workshop Proceedings of Intl. Conf. on Simulation, Modeling and Programming for Autonomous Robots (SIMPAR 2010) (pp. 639-648).

    Miles, M. B. & Huberman, A. M. (1994). Qualitative data analysis: An expanded source book (2nd Ed.). Thousand Oaks: Sage Publications.

    Mitnik, R., Recabarren, M., Nussbaum, M., & Soto, A. (2009). Collaborative robotic instruction: A graph teaching experience. Computers & Education, 53(2), 330-342.

    Negrini, L., & Giang, C. (2019). How do pupils perceive educational robotics as a tool to improve their 21st century skills?. Journal of e-Learning and Knowledge Society, 15(2).

    Nourbakhsh, I. R., Crowley, K., Bhave, A., Hamner, E., Hsiu, T., Perez-Bergquist, A., ... & Wilkinson, K. (2005). The robotic autonomy mobile robotics course: Robot design, curriculum design and educational assessment. Autonomous Robots, 18(1), 103-127.

    Numanoğlu, M. ve Keser, H. (2017). The use of robots in programming teaching - mbot example. Bartın Faculty of Education Journal, 6(2), 497-515.

    Oblinger, D., & Oblinger, J. (2005). Educating the net generation. Retrieved from https://www.educause.edu/ir/library/PDF/pub7101.PDF

    *Özdoğru, E. (2013). The effect of Lego program-based science and technology education for physical phenomena learning domain on students' academic achievement, scientific process skills and attitudes towards science and technology lesson, Unpublished Doctoral dissertation, Dokuz Eylül University, İzmir.

    *Özer, F. (2019). The Effect of Robot Use in Coding Education on Secondary School Students' Achievement, Motivation and Problem-Solving Skills. Unpublished master's thesis. Hacettepe University, Ankara.

    Özkandemir, O. (2019). A sample study on the use of robotics and coding programs in primary school music lessons. Unpublished master's thesis. Marmara University.

    Papert, S. (1999). What is Logo? Who needs it. Logo philosophy and implementation.

    Partnership for 21st centurt skills (P21, 2006). 21. Century Skills. https://www.battelleforkids.org/networks/p21 Date of Access: 02.01. 2019

    Petitti, D. B. (2001). Approaches to heterogeneity in meta‐analysis. Statistics in medicine, 20(23), 3625-3633.

    *Pirrone, C., Tienken, C. H., Pagano, T., & Di Nuovo, S. (2018, January). The influence of building block play on mathematics achievement and logical and divergent thinking in Italian primary school mathematics classes. In The Educational Forum (Vol. 82, No. 1, pp. 40-58). Routledge.

    Prensky, M. (2001). Digital Natives, Digital Immigrants Part 1.On the Horizon, 1-6.

    Resnick, M. (2012). Reviving Papert's dream. Educational Technology, 52(4), 42-46.

    Rosenthal, R., & DiMatteo, M. R. (2001). Meta-analysis: Recent developments in quantitative methods for literature reviews. Annual review of psychology, 52(1), 59-82.

    Rosenthal, R., & Di Matteo, M. R. (2002). Meta‐analysis. Stevens' handbook of experimental psychology.

    *Saygılı Yıldırım, T. (2020). The Effect of Problem Based Learning Approach on Success, Positive Emotion and Computational Thinking in Robotic Coding Teaching. Unpublished master's thesis. Çanakkale Onsekiz Mart University.

    *Sanders, T. S. (2020). A Causal-Comparative Study of the Relationship between Fifth-Grade Girls’ Mathematics Achievement and Participation in a Code-Based Robotics Program Unpublished Doctoral dissertation, Northcentral University.

    Silik, Y. (2016). The effect of educational robotics applications on problem solving skills of pre-service science teachers. Unpublished Master's thesis, Karadeniz Technical University, Trabzon.

    Stager, G. Seymour Papert (1928–2016). Nature 537, 308. https://doi.org/10.1038/537308a

    Stovold, E., Beecher, D., Foxlee, R., & Noel-Storr, A. (2014). Study flow diagrams in Cochrane systematic review updates: an adapted PRISMA flow diagram. Systematic reviews, 3(1), 1-5.

    Sutton, A. J. (2009). Publication bias. The handbook of research synthesis and meta-analysis, 2, 435-452.

    Şenol, A. K. & Büyük, U. (2015). Robotic Supported Science and Technology Laboratory Applications: Robolab. Electronic Turkish Studies, 10(3).

    *Şimşek, K. (2019). Investigation of the Effects of Robotic Coding Applications on Academic Achievement and Scientific Process Skills of 6th Grade Students in the Matter and Heat unit of Science Course, Unpublished Doctoral dissertation, Marmara University, İstanbul.

    Tapscott, D. (1998). Growing up digital: The rise of the net generation. Toronto: McGraw- Hill.

    Thalheimer, W.,& Cook, S. (2002). How to calculate effect sizes from published research: A simplified methodology. Work-Learning Research, 1, 1-9.

    Thompson, S. G., & Sharp, S. J. (1999). Explaining heterogeneity in meta‐analysis: a comparison of methods. Statistics in medicine, 18(20), 2693-2708.

    Turkish Language Society [TDK, 2020]. https://sozluk.gov.tr/ Access Date: 30.09.2020

    *Ulloa-Higuera, J. (2019). Academic achievement and participation in out-of-school educational robotics competitions for high school Latino/a students in Southern California. Unpublished Master’s Thesis. Brandman University, Irvine, California

    Wagner, T. (2008). Rigor redefined. Educational leadership, 66(2), 20-24.

    Vassie, C., Smith, S., & Leedham-Green, K. (2020). Factors impacting on retention, success and equitable participation in clinical academic careers: a scoping review and meta-thematic synthesis. BMJ open, 10(3), e033480.

    Yenikalaycı, N. & Harman, G. (2020) Views of Science Students on the Application of Black Lightning with Arduino. Trakya Education Journal, 10(3), 704-725.

    Yıldırım, A. ve Şimşek, H. (2006). Qualitative research methods in the social sciences. Seçkin Publishing.

    Yükseltürk, E. & Curaoğlu, O. (2019). Challenges of Using Block-based Tools in Programming Education, Alanya 6th International Educational Sciences Symposium.

    *Uşengül, L. (2019). The effect of Lego Wedo 2.0 education on students' academic achievement and attitudes towards science and computational thinking skills, Unpublished master's thesis, Fırat University, Elazığ.

    Uşun, S. (2004). Fundamentals of Computer Assisted Instruction. Nobel Publishing.

    Viera, A. J., & Garrett, J. M. (2005). Understanding interobserver agreement: the kappa statistic. Fam med, 37(5), 360-363.

    *Yolcu, V. (2018). The effect of using robotics in programming education on academic achievement, computational thinking skills and learning transfer. Unpublished master's thesis. Süleyman Demirel University, Isparta.