Development, Standardization and Application of Chemistry Achievement Test Using the One-Parameter Logistic Model (1-Plm) of Item Response Theory (Irt)

Oku Kingsley¹ and Iweka Fidelis^1,

¹Department of Educational Psychology, Guidance & Counselling, Faculty of Education, University of Port Harcourt, Nigeria

Cite this paper:
Oku Kingsley and Iweka Fidelis. Development, Standardization and Application of Chemistry Achievement Test Using the One-Parameter Logistic Model (1-Plm) of Item Response Theory (Irt). American Journal of Educational Research. 2018; 6(3):238-257. doi: 10.12691/education-6-3-11

Abstract

This study was centered on the Development, Standardization and Application of Chemistry Achievement Test using the One-Parameter Logistic Model of Item Response Theory. Eight research questions and one hypothesis guided the study. The hypothesis was tested at 0.05 level of significance. The research design was instrumentation research. The Researcher developed an instrument titled “OKUKINS Chemistry Achievement Test (OKUKINS CAT) consisting of 80 items. A proportional stratified random sampling technique was used to obtain a sample of 200 students from a population of 19,082 Senior Secondary School Two (SS II) students from Delta Central Senatorial District of Delta State. The sample was further divided into two equal parts (set A and set B) representing sample A and B respectively while the original sample represent sample O. The OKUKINS CAT yielded favourable statistics under the One-Parameter Logistic Model (1-PLM) with regards to the difficulty (b) parameters and ability estimates. Analyses done using the Xcalibre 4.2 software confirmed suitable indices of b parameters as prescribed by the Xcalibre manual. Using sample O, b parameters ranged from -2.417 to +2.834. Using sample A, b parameters ranged from -2.115 to +2.293. Using sample B, the b parameters ranged from -2.138 to +2.960. The validity of the instrument was estimated using the fit statistics. The results indicated perfect fit of One-Parameter Logistic Model ( 1-PLM). Using sample O, 74 items out of the 80 items of the OKUKINS CAT fitted the 1-PLM. Using sample A, 79 items out of the 80 items of the OKUKINS CAT fitted the 1-PLM. Using sample B, all the 80 items which constitute the OKUKINS CAT fitted the 1-PLM. The study also revealed that gender has no significant influence on academic achievement in chemistry. Based on the findings, it was recommended among others that, all examination bodies such as JAMB, WAEC, NECO and NABTEB should re-visit and review their test items using IRT models since this has been recommended by the International Testing Commission.

Keywords:
ability estimates difficulty parameter standard errors of measurement item characteristic curves item response theory one-parameter logistic model

This work is licensed under a Creative Commons Attribution 4.0 International License. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/

References:

[1]	Oku, K. (2015) Measures for achieving academic excellence. Paper presented at the lesser chapter All Saints’ Cathedral (Anglican Communion), Ughelli Delta State, during the AYF youth week celebration.
[2]	Iweka, F. (2014) Comprehensive guide to test construction and administration. Omoku: Chifas Nigeria.
[3]	Steinmagr, R, Meibner, A, Weidinger, A.F,& Wirthwein, L. (2015). Academic achievement. Retrieved from http://www.Oxford bibliographies.com/view/document/obo-9780199756810/obo-9780199756810-0108. Xml.
[4]	Magno, C. (2009). Demonstrating the difference between classical test theory and item response theory using derived test data. The international journal of educational and psychological assessment, 1(1), 1-11.
[5]	Ojerinde, D. (2013) Classical Test Theory VS Item Response Theory: An evaluation of the comparability of item analysis results. Retrieved from http://ui.edu.ng/sites/default/files/PROF%20OJERINDE%27S%20LECTURE%20(Autosaved).pdf.
[6]	Kpolovie, P.J. (2014) Test measurement and evaluation in education. Owerr i: Springfield.
[7]	Bomo, C. A. (2015) Application of Item Response Theory in the development of students’ attitude towards Mathematics Tests. Unpublished dissertation, University of Port Harcourt. 1-6.
[8]	Baker, F. B. (2001) The Basics of Item Response Theory. USA: ERIC Clearinghouse on Assessment and Evaluation.
[9]	Anne, M.H. (2015) Why is chemistry important? Retrieved from https://www.thoughtco.com/why-is-chemistry-important-604144.
[10]	Jason, S. (2013) The importance of chemistry in everyday life. Retrieved from https://sciencezoneja.wordpress.com/2013/12/24/the-importance-of-chemistry-in-everyday-life/.
[11]	Ogunbanwo, R. A. (2014) Analysis of students’ performance in West African Senior Certificate Examination in boarding and day secondary schools in Kano metropolis, Nigeria. Master Thesis, Ahmadu Bello University, Zaria.
[12]	Wheadon, (2014) Classification: Accuracy and consistency under item response theory models using the package classify. Journal of statistical software, 56, issue 10.
[13]	Dayalata, A. & Obinne, E. (2013) Test item validity: Item response theory(IRT) perspective Nigeria. Research journal in organizational psychology and education studies, 2(1),
[14]	Kpolovie, P. J. & Emekene, C.O. (2016) Psychometric advent of advanced progressive matrices- smart version (APM-SV) for use in Nigeria. European journal of statistics and probability, 4(3), 20-30.
[15]	Omobola, O.A & Adedoyin, J. A (2015) Assessing the comparability between Classical Test Theory (CTT) and Item Response Theory (IRT) models in meters. Herald journal of education and general studies 2(3), 107 -114.
[16]	Emekene, C.O. (2017) Psychometric analysis of the advanced progressive matrices scale for use in Nigeria. Ph.D Thesis, University of Port Harcourt.
[17]	Oku, K. (2008) Comparison of academic achievement of sandwich and regular postgraduate students of the University of Port Harcourt. Unpublished master thesis, University of Port Harcourt.
[18]	Ileh, L. N. (2017) Development and validation of Mathematics achievement test for continuous assessment in junior secondary schools in Delta State. Unpublished thesis, Delta State University, Abraka.
[19]	Akpochafo, W. P.( 2003) Gender related differences and academic achievement in junior secondary school social studies. Journal of educational research and development, 2(1), 35-42.