The evaluation of GAENE 2.1 in Greek students

Miltiadis Manikas; Ioannis Leonardos; Katerina Plakitsi; Konstantinos Sotiropoulos

doi:10.29333/mathsciteacher/13069

Full Text (PDF)

Miltiadis Manikas ¹ ^* , Ioannis Leonardos ¹ , Katerina Plakitsi ² , Konstantinos Sotiropoulos ¹

More Detail

¹ Department of Biological Applications & Technology, University of Ioannina, GREECE² Department of Early Childhood Education, University of Ioannina, GREECE^* Corresponding Author

Abstract

The acceptance of evolution by Greek students aged 17 has never been actually measured neither via a poll survey nor with the application of any of the existing psychometric tools that have been developed for this purpose. In this research, GAENE 2.1 was chosen because it is a one-dimensional tool that can only measure the acceptance of evolution and does not contain items related to the understanding of evolution and the respondent’s religious beliefs. The assessment of the appropriateness of the tool for our sample was tested with the criteria of Rasch model. Despite the fact that some of GAENE 2.1 items may not show the expected statistical fit and probably overestimates the levels of acceptance of evolution, the tool is appropriated to measure with efficiently and effectively way the acceptance of evolution in the specific sample.

Keywords

acceptance of evolution
GAENE 2.1
Rasch analysis

License

This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Article Type: Research Article

Journal of Mathematics and Science Teacher, 2023, Volume 3, Issue 1, Article No: em031

https://doi.org/10.29333/mathsciteacher/13069

Publication date: 14 Mar 2023

Article Views: 567

Article Downloads: 412

Open Access References How to cite this article

References

AAAS. (2011). Vision and change in undergraduate biology education: A call to action. AAAS.
AERA. (2014). Standards for educational and psychological testing. AERA
Andrich, D., & Marais, I. (2019). A course in Rasch Measurement Theory: Measurement in the educational, social and health sciences. Springer Nature Singapore Pte Ltd. https://doi.org/10.1007/978-981-13-7496-8
Arnold, J. C., Boone W. J., Kremer K., & Mayer J. (2018). Assessment of competencies in scientific inquiry through the application of Rasch measurement techniques. Education and Sciences, 8(184), 1-20. https://doi.org/10.3390/educsci8040184
Athanasiou, K., & Papadopoulou, P. (2012). Conceptual ecology of the evolution acceptance among Greek education students: Knowledge, religious practices and social influences. International Journal of Science Education, 34(6), 903-924. https://doi.org/10.1080/09500693.2011.586072
Athanasiou, K., & Papadopoulou, P. (2015). Evolution theory teaching and learning: What conclusions can we get from comparisons of teachers; and students’ conceptual ecologies in Greece and Turkey? EURASIA Journal of Mathematics, Science & Technology Education, 11(4), 841-853. https://doi.org/10.12973/Eurasia.2015.1443a
Athanasiou, K., Katakos, E., & Papadopoulou, P. (2012). Conceptual ecology of the evolution acceptance among Greek education students: The contribution of knowledge increase. Journal of Biological Education, 46(4), 234-241. https://doi.org/10.1080/00219266.2012.716780
Athanasiou, K., Katakos, E., & Papadopoulou, P. (2016). Acceptance of evolution as one of the factors structuring the conceptual ecology of the evolutionary theory of Greek secondary school teachers. Evolution: Education and Outreach, 9(1), 7. https://doi.org/10.1186/s12052-016-0058-7
Barnes, E. M., Dunlop, H. M., Holt, E. A., Zheng, Y., & Brownell, S. E. (2019). Different evolution acceptance instruments lead to different research findings. Evolution: Education and Outreach, 12(4), 1-17. https://doi.org/10.1186/s12052-019-0096-z
Boone, W. J. (2016). Rasch analysis for instrument development: Why, when, and how? Life Sciences Education, 15(4), 1-7. https://doi.org/10.1187/cbe.16-04-0148
Boone, W. J., & Noltemeyer, A. (2017). Rach analysis: A primer for school psychology researchers and practitioners. Cogent Education, 4(1416898), 1-13. https://doi.org/10.1080/2331186X.2017.1416898
Boone, W. J., Staver, J. R., & Yale, M. S. (2014). Rasch analysis in the human sciences. Springer. https://doi.org/10.1007/978-94-007-6857-4
Creswell, J. W. (2012). Educational research: Planning, conducting and evaluating quantitative and qualitative research (4th Edn.). Pearson Education Inc.
Cronbach, L. J. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16(3), 297-334. https://doi.org/10.1007/bf02310555
Dawkins, R. (2009). The greatest show on earth. FreePress, TransWorld.
DeMars, C., & Linacre, J. M. (2004). Mapping multidimensionality. Rasch Measurement Transactions, 18(3), 9990-9991.
Dobzhansky, T. (1973). Nothing in biology makes sense except in the light of evolution. The American Biology Teacher, 35(3), 125-129. https://doi.org/10.2307/4444260
Dunk, R. D. P., Barnes, M. P., Reiss, M. J., Alters, B. Asghar, A., Carter, B. E., Cotner, S., Glaze, A. L., Hawley, P. H., Jensen, J. L., Mead, L. S., Nadelson, L. S., Nelson, C. E., Pobiner, B., Scott, E. C., Shtulman, A., Sinatra, G. M., Southerland, S. A., Walter, E. M., … Dunk, J. R. W. (2019). Evolution education is a complex landscape. Nature, Ecology and Evolution, 3, 327-329. https://doi.org/10.1038/s41559-019-0802-9
Eder, E., Seidl, V., Lange, J., & Dittmar, G. (2018). Evolution education in the German-speaking countries. In D. Hasan, & L. A. Borgerding (Eds.), Evolution education around the globe (pp. 235-260). Spinger. https://doi.org/10.1007/978-3-319-90939-4_13
Fisher, J. R. (2007). Rasch measurement transaction. Transaction of Rasch Measurement, 21(1), 1095.
Gallup. (2019). Evolution, creationism, intelleigent design. Gallup.com. https://news.gallup.com/poll/21814/evolution-creationism-intelligent-design.aspx?version=print
Gardner, P. L. (1995). Measuring attitubes to science: Uni-dimensionality and internal consistency revised. Research in Science Education, 25(3), 283-289. https://doi.org/10.1007/bf02357402
Gregory, T. R. (2009). Understanding natural selection: Essential concepts and common misconceptions. Evolution: Education and Outreach, 2(2), 156. https://doi.org/10.1007/s12052-009-0128-1
Hagell, P. (2014). Testing rating scale unidimensionality using the Principal Component Analysis (PCA)/t-test protocol with the Rasch model: The primacy of theory over statistics. Open Journal of Statistics, 4, 456-465. https://doi.org/10.4236.ojs.2014.46044
Harms, U., & Reiss, M. J. (2019). The present status of evolution education. In U. harms, & M. J. reiss (Eds.), Evolution education re-considered: Understanding what works (pp. 1-20). Springer. https://doi.org/10.1007/978-3-030-14698-6
Heale, R., & Twycross, A., (2015). Validity and reliability in quantitative studies. Evidence-Based Nursing, 18(3), 66-67. https://doi.org/10.1136/eb-2015-102129
Kampourakis, K., & Zogza, V. (2008). Students’ intuitive explanations of the causes of homologies and adaptations. Science & Education, 17(1), 27-47. https://doi.org/10.1007/s11191-007-9075-9
Katakos, S., & Athanasiou, K. (2020). The ‘geological argument’ as an Instrument for the acceptance of the theory of evolution among Greece science teachers. Journal of Cell Biology and Genetics, 3(3), 183-186.
Kazempour, M., & Amirshokoohi, A., (2018). Evolution education in Iran: Shattering myths about teaching evolution in an Islamic state. In D. Hasan, & L. A. Borgerding (Eds.), Evolution education around the globe (pp. 281-295). Spinger. https://doi.org/10.1007/978-3-319-90939-4_15
Knapp, T. R. (1990). Treating ordinal scales as interval scales an attempt to resolve the controversy. Nursing Research, 39(2), 121-123. https://doi.org/10.1097/00006199-199003000-00019
Koumara, A., & Plakitsi, K., (2020). The degree that nature of scientific knowledge aspects are included in the science class of Greek high schools. World Journal of Education, 10(5), 1-17. https://doi.org/10.5430/wje.v10n5p1
Kuschmierz, P., Beniermann, A., Bergmann, A., Pinxten, R., Aivelo, T., Berniak-Wozny, J., Bohlin, G., Bugallo-Rodriguez, A., Cardia, P., Cavadas, B. F. B. P., Cebesoy, U. B., Cvetkovic, D. D., Demarsy, E., Dordevic, M. S., Drobniak, S. M., Dubchak, L., Dvorakova, R. M., Fancovicova, J., Fortin, … Graf, D. (2021). European first-year university students accept evolution but lack substantial knowledge about it: A standardized European cross-country assessment. Evolution: Education and Outreach, 14, 17. https://doi.org/10.1186/s12052-021-00158-8
Kuzon, W. M., Urbanchek, M. G., & McCabe, S. (1996). The seven deadly sins of statistical analysis. Annals of Plastic Surgery, 37(3), 265-272. https://doi.org/10.1097/00000637-199609000-00006
Lennox, G. J. (1992). The philosophy of biology. In S. H. Merrilee (Ed.), Introduction to the philosophy of science. Prentice-Hall.
Linacre, J. M. (1997). KR-20 or Rasch reliability: Which tells the “truth”? Rasch Measurement Transactions, 11(3), 580-581.
Linacre, J. M. (2002). What do infit and outfit, mean-square and standardized mean? Rasch Measurement Transactions, 16(2), 878.
Linacre, J. M. (2022). WINSTEPS. Rasch measurement computer program. Winsteps.com. https://www.winsteps.com/winman/copyright.htm
Linacre, J. M., (2021). A user’s guide to Winsteps ministeps Rasch-model computer programs. Winsteps.com. http://www.winsteps.com/winsteps.htm
Mantelas, N., & Mavrikaki, E. (2020). Religiosity and students’ acceptance of evolution. International Journal of Science Education, 42(18), 3071-3092. https://doi.org/10.1080/09500693.2020.1851066
Mead, L. S., Kohn, C., Warwick, A., & Schwartz, K., (2019). Applying measurement standards to evolution education assessment instruments. Evolution: Education & Outreach, 12(5), 1-14. https://doi.org/10.1186/s12052-019-0097-y
Metzger, K. J., Montplairir, D., Haines, D., & Nickodem, K. (2018). Investigating undergraduate health sciences students’ acceptance of evolution using MATE and GAENE. Evolution: Education & Outreach, 11(10), 1-18. https://doi.org/10.1186/s12052-018-0084-8
Miller, J. D., Scott, E. C., & Okamoto S. (2006). Public acceptance of evolution. Science, 313(5788), 765-766. https://doi.org/10.1126/science.1126746
NGSS Lead States. (2013). Next generation science standards: For states by states. The National Academies Press.
Planinic, M., Boone, W. J., Susac, A, & Ivanjek, L. (2019). Rasch analysis in physics education research: Why measurement matters. Physical Review Physics Education Research, 15(020111), 1-14. https://doi.org/10.1103/PhysRevPhysEducRes.15.020111
Prinou, L., Halkia, K., & Skordoulis, C. (2008). What conceptions do Greek school students form about biological evolution? Evolution: Education & Outreach, 1(3), 312-317. https://doi.org/10.1007/s12052-008-0051-x
Quessada, M.-P., & Clément, P. (2018). Evolution education in France: Evolution is widely taught and accepted. In D. Hasan, & L. A. Borgerding (Eds.), Evolution education around the globe (pp. 213-233). Spinger. https://doi.org/10.1007/978-3-319-90939-4_12
Rachmatullah, A., Nehm, R., Roshayanti, F., & Ha, M. (2018). Evolution education in Indonesia: Pre-service biology teacher’s knowledge, reasoningh models and acceptance of evolution. In D. Hasan, & L. A. Borgerding (Eds.), Evolution education around the globe (pp. 335-355). Spinger. https://doi.org/10.1007/978-3-319-90939-4_18
Raiche, G. (2005). Critical eigevalue sizes (variances) in standardized residual principal components analysis. Rasch Measurement Transactions, 19(1), 1012.
Romine, W. L., Todd, A. N., & Walter, E. M. (2018). A closer look at the items within three measures of evolution acceptance: Analysis of the MATE, I-SEA, and GAENE aw a single corpus of items. Evolution: Education and Outreach, 11, 17. https://doi.org/10.1186/s12052-018-0093-7
Romine, W. L., Walter, E. M., Bosse E., & Todd A. N. (2017). Understanding patterns of evolution acceptance-a new implementantion of the measure of acceptance of the theory of evolution (MATE) with Midwestern University students. Journal of Research in Science Teaching, 54(4), 642-671. https://doi.org/10.1002/tea.21380
Rutledge, M. L., & Warden, M. A. (1999). The development and validition of the measure of acceptance of the theory of evolution instrument. School Science and Mathematics Journal, 99(1), 13-18. https://doi.org/10.1111/j.1949-8594.1999.tb17441.x
Rutledge, M., & L., Sadler, K. C. (2007). Reliability of the measure of acceptance of the theory of evolution (MATE) instrument with university students. The American Biology Teacher, 69(6), 332-335. https://doi.org/10.1662/0002-7685(2007)69[332:ROTMOA]2.0.CO;2
Sbeglia, G. C., & Nehm, R. H. (2018). Measuring evolution acceptance using the GAENE: Influences of gender, race, degree-plan, and instruction. Evolution: Education & Outreach, 11(18), 1-14. https://doi.org/10.1186/s12052-019-0097-y
Schumacker, R. E. (2016). Reliability: A Rasch perspective. Educational and Psychological Measurement, 67(3), 394-409. https://doi.org/10.1177/0013164406294776
Sfendourakis, S. (2021). In Darwin’s mirror. University Publications of Crete.
Smith, M. U. (2010). Current status of research in teaching and learning evolution: I. Philosophical/epistemological issues. Science Education, 19(6-8), 523-538. https://doi.org/10.1007/s11191-009-9215-5
Smith, Jr., E. V., Conrad, K. M., Chang, K., & Piazza, J. (2002). An introduction to rasch measurement for scale development and person assessment. Journal of Nursing Measurement, 10(3), 189-206. https://doi.org/10.1891/jnum.10.3.189.52562
Smith, M. U., Snyder, S. W., & Devereaux, R. S. (2016). The GAENE-generalized acceptance of evolution evaluation: Development of a new measure of evolution acceptance. Journal of Research in Science Teaching, 53(9), 1289-1315. https://doi.org/10.1002/tea.21328
Special Eurobarometer 225. (2014). Special Eurobarometer 225: Social values, science & technology (v1.00). European Commission, Directorate-General for Communication. http://data.europa.eu/88u/dataset/S448_63_1_EBS225
Stasinakis, P., & Athanasiou K. (2016). Investigating Greek biology teachers’ attitudes towards evolution teaching with respect to their pedagogical content knowledge: Suggestions for their professional development. EURASIA Journal of Mathematics, Science & Technology Education, 12(6), 1605-161753. https://doi.org/10.12973/Eurasia.2016.1249a
Stasinakis, P., & Kampourakis, K. (2018). Evolution education in Greece. In D. Hasan, & L. A. Borgerding (Eds.), Evolution education around the globe (pp. 195-212). Spinger. https://doi.org/10.1007/978-3-319-90939-4_11
Stevens, S. S. (1946). On the theory of scales measurement. Science, 103(2684), 677-680. https://doi.org/10.1126/science.103.2684.677
Taber, K.S. (2018). The use of Cronbach’s alpha when developing and reporting research instruments in science education. Research in Science Education, 48, 1273-1296. https://doi.org/10.1007/s11165-016-9602-2
Tennant, A., & Conaghan, P. G. (2007). The Rasch measurement model in rheumatology: What is it and why use it? When should it be applied, and what should one look for in a Rasch paper? Arthritis & Rheumatism (Arthritis Care & Research) 57(8), 1358-1362. https://doi.org/10.1002/art.23108
Tormakangas, K. (2011). Advantages of the Rasch measurement model in analysing educational tests: An applicator's reflection. Educational Research and Evaluation, 17(5), 307-320. https://doi.org/10.1080/13803611.2011.630562
Wright, B. D., & Linacre, J. M. (1994). Reasonable mean-square fit values. Rasch Measurement Transactions, 8(3), 370.
Wu, H., & Leung, S.-O. (2017). Can Likert scales be treated as interval scales?–A simulation study. Journal of Social Service Research, 0(0), 1-6. https://doi.org/10.1080/01488376.2017.1329775

How to cite this article

APA

Manikas, M., Leonardos, I., Plakitsi, K., & Sotiropoulos, K. (2023). The evaluation of GAENE 2.1 in Greek students. Journal of Mathematics and Science Teacher, 3(1), em031. https://doi.org/10.29333/mathsciteacher/13069

Vancouver

Manikas M, Leonardos I, Plakitsi K, Sotiropoulos K. The evaluation of GAENE 2.1 in Greek students. Journal of Mathematics and Science Teacher. 2023;3(1):em031. https://doi.org/10.29333/mathsciteacher/13069

AMA

Manikas M, Leonardos I, Plakitsi K, Sotiropoulos K. The evaluation of GAENE 2.1 in Greek students. Journal of Mathematics and Science Teacher. 2023;3(1), em031. https://doi.org/10.29333/mathsciteacher/13069

Chicago

Manikas, Miltiadis, Ioannis Leonardos, Katerina Plakitsi, and Konstantinos Sotiropoulos. "The evaluation of GAENE 2.1 in Greek students". Journal of Mathematics and Science Teacher 2023 3 no. 1 (2023): em031. https://doi.org/10.29333/mathsciteacher/13069

Harvard

Manikas, M., Leonardos, I., Plakitsi, K., and Sotiropoulos, K. (2023). The evaluation of GAENE 2.1 in Greek students. Journal of Mathematics and Science Teacher, 3(1), em031. https://doi.org/10.29333/mathsciteacher/13069

MLA

Manikas, Miltiadis et al. "The evaluation of GAENE 2.1 in Greek students". Journal of Mathematics and Science Teacher, vol. 3, no. 1, 2023, em031. https://doi.org/10.29333/mathsciteacher/13069