Development of Culturally Based Standardized Scale in Visible Learning for Instructional Leaders

Flora A. Patag^1,

¹Graduate School of Education,University of Nueva Caceres, Naga City, Philippines

Cite this paper:
Flora A. Patag. Development of Culturally Based Standardized Scale in Visible Learning for Instructional Leaders. American Journal of Educational Research. 2024; 12(4):128-140. doi: 10.12691/education-12-4-2

Abstract

The study developed a culturally based standardized scale in Visible Learning for instructional leaders. Descriptive developmental research and qualitative descriptive research were employed in the study. Purposive sampling was used to select expert and target population judges who knew about visible learning, culture, and scale development. The measurement scale development followed the following procedures: Defining the knowledge domain that defined the domains in the most precise terms and then reviewing the literature. This stage searches for knowledge on standardizing scale instruments, gathering conceptual and operational definitions of visible learning and culture. The second stage is item development. This stage covered domain identification, item generation, and content validity. This also covered the specification of response format, and the pooled items were organized per domain. The third stage was scale development, where the different items were organized into measuring constructs. Items on culture were integrated into the different domains of visual learning to describe visual learning in Bicol classrooms. Theoretical or face validation of the developed scale was the fourth stage. This phase utilized expert and population judges to evaluate the items' content relevance and technical quality. The fifth stage was semantic validation, a confirmatory step to gauge the effectiveness of the developed scale when the pilot tested it on respondents. The sixth stage is statistical or empirical validation. The developed scale instrument was administered to the target population to determine its reliability. With Cronbach's alpha of 0.652, the developed culturally based scale possessed internal data consistency. Expert validators, starting from content validity until semantic validation, also established the validity of the scale instrument. Results of the statistical validation revealed that the school where the newly developed scale instrument exemplified visible learning to a great extent.

Keywords:
visible learning culture scale culture-based scale development standardized scale instrument instructional leaders cronbach's alpha

This work is licensed under a Creative Commons Attribution 4.0 International License. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/

References:

[1]	Department of Education, Republic of the Philippines. (2019). Assessment and testing in the K to 12 Curriculum. .
[2]	Hoffmann, J. D., et al. (2022). Building useful, web-based educational assessment tools for students, with students: A demonstration with the school climate walkthrough. Assessment in Education: Principles, Policy & Practice.
[3]	Kemethofer, D., et al. (2022). Does educational leadership enhance instructional quality and student achievement? The case of Austrian primary school leaders. International Journal of Leadership in Education.
[4]	Reardon, S. F., et al. (2018). The geography of racial/ethnic test score gaps. Educational Researcher, 47(3), 129–141.
[5]	Anderson, C. L. (2017). You cannot afford to live here.CORE. .
[6]	Jackson, C.K., et al. (2020). Teacher effects on student achievement and height: A cautionary tale. Journal of Labor Economics, 38(1), 323–354.
[7]	Gupta, N., & Joshi, R. (2014). Emotional competence in relation to parental involvement among adolescents. Indian Journal of Positive Psychology, 5(1), 94–97.
[8]	Urbanovic, J., et al. (2023). Reducing student achievement gaps: A case of Polish schools in Lithuania. INTED2023 Proceedings.
[9]	Hoque, K. E., et al. (2023). The factors associated with teachers; job satisfaction and their impacts on students&; achievement: a review (2010–2021). Humanities and Social Sciences Communications, 10, 1-14.
[10]	Hattie, J. (2019). Visible Learning: Feedback. Routledge
[11]	Doyle, L., et al. (2016). An overview of mixed methods research – revisited. Journal of Research in Nursing, 21(8), 623–635.
[12]	Mahoney, J. L., et al. (2018). An update on social and emotional learning outcome research. Phi Delta Kappan, 100(4), 18–23.
[13]	Idrus, F., et al. (2023). Exploring preservice teachers' experiences of implementing culturally responsive teaching in the ESL classrooms. Theory and Practice in Language Studies, 13(3), 766–776.
[14]	Özüdoğru, M. (2022). Understanding the experiences of teacher candidates related to online flipped learning in relation to Community of Inquiry framework. Journal of Computer Assisted Learning. Wiley Online Library.
[15]	Brock, A., & Hundley, H. (2017). The Growth Mindset Playbook. Simon and Schuster.
[16]	Dweck, C. S. (2007). Mindset: The new psychology of success. Random House Incorporated.
[17]	Hildrew, C. (2018). Becoming a growth mindset school: The power of mindset to transform teaching, leadership, and learning. Routledge.
[18]	Fisher, D., & Frey, N. (2018). Raise reading volume through access, choice, discussion, and book talks. The Reading Teacher.
[19]	Hattie, J. (2023). Visible Learning: The sequel: A synthesis of over 2,100 meta-analyses related to achievement. Routledge.
[20]	Martorana, C. (2022). Using the motivational framework for culturally responsive teaching to guide assignment design and implementation. Currents in Teaching & Learning, 13(2), 49-65.
[21]	Hattie, J. (2012). Visible learning for teachers. Maximizing impact on learning. New York, USA, Routledge.
[22]	Hattie, J., & Zierer, K. (2018). 10 Mindframes for Visible Learning: Teaching for success. Routledge.
[23]	Corwin. (2023, June). About MetaX. Visible learning MetaX. https:// www.visiblelearningmetax.com/ research_methodology.
[24]	Zacarian, D., & Soto, I. (2020). Responsive schooling for culturally and linguistically diverse students. W.W. Norton & Company.
[25]	Nolan, A., & Raban, B. (2015). Theories into practice.Teaching Solutions.
[26]	Nieto, S. (2013). Finding joy in teaching students of diverse backgrounds. Heinemann.
[27]	Westernoff, F., et al. (2021). Powerful practices for supporting English learners: Elevating diverse assets and identities. Corwin.
[28]	Walker-Dalhouse, D. (2021). Classroom relationships. In R.Powell & S.C. Cantrell (Eds.), A framework for culturally responsive practices: Implementing the culturally responsive instruction observation protocol (CRIOP) in K-8 classrooms (pp. 1-27). Myers Education Press.
[29]	Gollnick, D. M., & Chinn, P. C. (2017). Multicultural education in a pluralistic society (10th ed.). Pearson.
[30]	Cushner, K. H., et al. (2019). Human diversity in education: An intercultural approach (9th ed.). McGraw Hill Education.
[31]	Trumbull, E., & Pacheco, M. (2005). Leading with diversity: Cultural competencies for teacher preparation and professional development. The Education Alliance, Brown University.
[32]	Banks, J. (2016). Cultural diversity and education: Foundations, curriculum, and teaching. Routledge.
[33]	Will, M., & Najarro, I. (2022, April 18). What is culturally responsive teaching? Education Week. https:// www.edweek.org/ teaching-learning/culturally-responsive-teaching-culturally-responsive-pedagogy/2022/04.
[34]	Mensah, F. M. (2021). Culturally relevant and culturally responsive: Two theories of practice for science teaching. National Science Teaching Association. .
[35]	Snyder, S., & Fenner, D. S. (2021). Culturally responsive teaching for multilingual learners: Tools for equity. Corwin.
[36]	Gay, G. (2018). Culturally responsive teaching: Theory, research, and practice (3rd ed.). Teachers College Press.
[37]	Lazar, A. M., et al, (2022). Introduction: Culturally sustaining literacy pedagogy: From relevance to performance. In S. C. Cantrell, D. Walker Dalhouse & A. M. Lazar (Eds.), Culturally sustaining literacy pedagogies: Honoring students' heritages, literacies, and languages (pp. 1-15). Teachers College Press, Columbia University.
[38]	Alim, H. S., et al. (2020). Culturally sustaining pedagogies: A critical framework for centering communities. In N. S. Nasir, C. D. Lee, R. Pea, & M. Mckinney de Royston (Eds.), Handbook of the cultural foundations of Learning (pp. 261–276). Routledge.
[39]	Renandya, W. A. (2022). The Goldilocks principle: Not too hot, Not too cold. holdilocks-principle-not-too-hot-not-too-cold/.
[40]	DeWitt, P. (2014). The Goldilocks' principle: Meeting the needs of special education students. Education Week. .
[41]	Hattie, J. (2009). Visible learning: A synthesis of over 800 meta-analyses relating to achievement. Routledge.
[42]	Hattie, J., Masters, D., & Birch, K. (2015). Visible Learning into Action: International Case Studies of Impact (1st ed.). Corwin Press.
[43]	Hair, J. F., J. R., et al. (2019). Development and validation of attitudes measurement scales: Fundamental and practical aspects. RAUSP Management Journal, 54(4).
[44]	Boateng, G. O., et al. (2018). Best practices for developing and validating scales for health, social, and behavioral research: A primer. Frontiers in Public Health.
[45]	Kyriazos, T. A., & Stalikas, A. (2018). Applied psychometrics: The steps of scale development and standardization process. Psychology, 9(11).
[46]	Carpenter, S. (2018). Ten Steps in Scale Development and Reporting: A Guide for Researchers, Communication Methods, and Measures, 12:1, 25-44.
[47]	Richey, R., et al. (2004). Developmental research: Studies of Instructional design and Development. https:// www. researchgate.net/publication/263963734_Developmental_research Bradshaw et al., (2017). Employing a Qualitative Description Approach in Health Care Research. Glob Qual Nurs Res. 2017 Nov 24;4:2333393617742282.
[48]	Kim H. et al., (2017). Characteristics of Qualitative Descriptive Studies: A Systematic Review. Res Nurs Health. 2017 Feb;40(1):23-42.
[49]	DeVellis, R. F. (2017). Scale Development: Theory and Applications (4th ed.). Thousand Oaks, CA: Sage.
[50]	Morgado, F. F. R., et al, (2017). Scale development: Ten main limitations and recommendations to improve future research practices. Psicologia: Reflexão e Crítica, 30, Article 3.