Dear Label_Name,

Greetings! I hope you are well.

I am writing on behalf of an international publishing house, Science and Education Publishing, USA (http://www.sciepub.com).

Science and Education Publishing (SciEP) is a multidisciplinary open access publisher of Journals covering the fields of Science, Technology and Medicine. All SciEP publications are subject to high-quality peer review, editorial and production processes and are freely available online.

Welcome to the April, 2013 edition of SciEP newsletter, providing monthly summaries of articles on science & education related topics of interest to scientist and professionals. The mission of our journals is to provide an open access forum for publishing new findings on issues pertinent to scientific and academic field. We also invite you to submit original research papers, review articles, short reports, or case studies are considered for publication in our Multidisciplinary Journals.

American Journal of Public Health Research
DOI: 10.12691/ajphr-1-1-3

The Implementation of a Tele-Homecare System with Service Oriented Architecture and HL7 Message Transmission Standard
Ching-Sung Wang

American Journal of Medical and Biological Research
DOI: 10.12691/ajmbr-1-1-2

The Influence of Ethanol on Pyruvate Kinases Activity in Vivo, in Vitro, in Silico
Lelevich Sergey Vladimirovich, Khrustalev Vladislav Victorovich, Barkovsky Eugene Victorovich, Shedogubova Tatyana Aleksandrovna

American Journal of Medical Sciences and Medicine
DOI: 10.12691/ajmsm-1-1-1

Clinical and Histological Features in Wegener Granulomatosis
Li Cavoli Gioacchino, Passantino Rita, Bono Luisa, Tortorici Calogera, Ferrantelli Angelo, Giammarresi Carlo, Rotolo Ugo

American Journal of Infectious Diseases and Microbiology
DOI: 10.12691/ajidm-1-1-2

The Curse of Lymphatic Filariasis: Would the Continual Use of Diethylcarbamazine Eliminate this Scourge in Papua New Guinea?
Anne Lanham, Lillian Mwanri

We have released issues of some journals on February 2013.
American Journal of Public Health Research
American Journal of Medical Sciences and Medicine
American Journal of Medical and Biological Research
American Journal of Pharmacological Sciences
American Journal of Clinical Medicine Research
American Journal of Nursing Research
American Journal of Cancer Prevention
American Journal of Medicine Studies
American Journal of Infectious Diseases and Microbiology
American Journal of Cardiovascular Disease Research
American Journal of Biomedical Research
American Journal of Mechanical Engineering
American Journal of Microbiological Research
Journal of Preventive Medicine
American Journal of Food and Nutrition
American Journal of Hypertension Research
American Journal of Sports Science and Medicine
Journal of Cancer Research and Treatment
American Journal of Zoological Research
Journal of Biomedical Engineering and Technology
American Journal of Microbiological Research
Biomedical Science and Engineering

We are pleased to announce that submissions are now being accepted for peer review for all the journals across all our subject areas in SciEP.

Please submit your manuscript via our online submission system:
http://www.sciepub.com/author/signin

To unsubscribe from our mailing list, please click on the following link: unsubscribe

I am looking forward to hearing from you.

Kind regards,

David Rain
Email:join@sciepub.com
Science and Education Publishing (http://www.sciepub.com)

Development and Evaluation of Fill in Multiple Blank Questions as an Effective Tool in Online Autograded Assessments

Jimoh Tijani

Department of General Studies, Jubail Industrial College, P. O. Box 10099, Jubail Industrial City 31961, Saudi Arabia

Abstract: This article describes the development, implementation, and evaluation of fill in multiple blanks questions (FIMBQs) in an online auto-graded homework assessments. Different forms of questions that are either numerical or words or both were developed. Results analysis provided feedbacks for formative assessment of teaching and learning.

Keywords: online-homework, auto-graded, assessments, Fill in Multiple blanks, blackboard, questions, feedbacks

Received October 06, 2018; Revised November 27, 2018; Accepted December 28, 2018

Citation: Jimoh Tijani, Development and Evaluation of Fill in Multiple Blank Questions as an Effective Tool in Online Autograded Assessments. American Journal of Educational Research, 6 (12). 1715-1718. January 2018. doi:10.12691/education-6-12-19

1. Introduction

A student’s success in Chemistry course is strongly correlated to the on-task studying of material through solving homework problems [1,2]. Online homework has the advantages over handwritten, due to increased efficiency in distributing, collecting, grading [3], and timeliness of feedback [4].

Computer based testing programs adapted items rarely beyond multiple-choice questions [5], even though there are indications that this form of assessment predominantly tests only lower levels of cognitive skills [6]. Fill in Multiple blanks questions (FIMBQs), have been found to be comparable tool to MCQ, which takes off the guessing element and provide more reliable student’s competency test [7].

FIMBQs can be found among other type questions in many different online homework software packages [8] and on supplemental websites provided by Textbook publishers [4]. Blackboard is a leading example of a virtual learning environment, which many universities have chosen as their e-learning platform [9].

This paper focused is on how to create and implement auto-graded online FIMBQs on a Blackboard, without using any additional software package and the kind of feedbacks that can be a useful tool for formative assessments.

Table 1.

1.1. Homework Assignments

Homework in General Chemistry, Jubail Industrial College, constitute 5% of the total grade on the course, for the last 3 years, we have been using blackboard successfully to deploy our homework. Initially, we deployed 25-30, randomized different types to the students. Lately, we adopted the use of questions sets from a database containing pools of questions to minimized cheating. In the last homework each student received 13 MCQs, 3 true or false questions, 6 matching questions, 7 FIMBQs delivered in 8 questions sets. The evaluations were collected by running the item analysis at the end of the assessments, the results as indicated in Table 1, below showing the percentage of students the got the various questions correct in some of the FIMBQs. The values in the table are subjective and may vary for different years and semester, but on the overall, they provided useful feedback for both teachers and students. Questions without evaluation are taken from online tutorials (2.3, 2.4 and 2.8).

2. Fill in Multiple Blanks Questions (FIMBQs)

For FIMBQs, feature blank spaces, to be filled with appropriate words, phrases or numbers. Student’s answers are graded automatically, by matching with answers already provided by the instructor [10]. FIMBQ were successfully applied to short answers questions, naming of compounds, writing chemical formulas, balancing equations, stoichiometry calculations, numerical calculation questions etc.

2.1. Naming and Writing Chemical Formulas for Inorganic Compounds

The naming of inorganic compounds were assessed using FIMBQs. The grading rubrics has about four correct answers for the names of HgS, this is because of the differences between the new and old method of naming Hg²⁺ as mercury (II) ion or mercuric ion and also the two names of S²⁻ sulphide ion (British system) and sulfide ions (American system). It is important to select for the evaluation method ‘contains’ rather than ‘exact match’ or ‘pattern match’ to accommodate the wide range of answers, which may result from spaces between the oxidation number and names. The variations in the grading rubrics are less in naming main group metals (as the oxidation number of the metal is not required in the name) and also in the naming of molecular compounds.

Figure 1.

The item analysis shows that the question has good discrimination index (0.62 and 0.78, for sections A and B respectively). The comparatively low percentages of pass for HgS, was because some of the students ignored the oxidation of Hg.

In writing the chemical formulas from the names, ionic compounds should be represented by their correct chemical formulas, which are written on the basis of valences [11]. For chemical formulas involving polyatomic ions such as nitrate, and phosphate, parentheses followed by appropriate subscripts are used [12]. Blackboard has a limitation of the inability of the examinees to write the number of atoms in the subscript forms.

2.2. Definitions and Short Answer Questions

When using short answer questions to test student knowledge of definitions, consider having a mix of questions, some that supply the term and require the students to provide the definition. These type of questions can be structured as FIMBQs. This mix format will better test student knowledge because it doesn’t rely solely on recognition or recall of the term [13].

Figure 2.

The feedback from the item analysis shows that most students in both sections did very well and the discrimination factors are 0.32 and 0.79 for section A and B respectively.

Figure 3.

2.3. Naming and Writing Chemical Formulas for Organic Compounds

In FIMBQs it is very important to keep the answers simple and limited to as few words as possible to avoid mismatched answer due to extra spaces or order of answer. In Figure 3, questions i and ii are ideal types of question that has simple answers compare to question iii that have a long answer with numbers, words and dashes.

Drawing structural formula is only possible by using external applet such as MarvinSketch or Chemwindow [3,14]. Condensed structural formulas can be used and answers such as CH₃CH=CH₂, CH₂CHCH₃, CH₃-CH=CH₂ can be part of the rubric for the answers. Ph- used as substituted benzene.

2.4. Calculations with Units

Calculation questions such as calculation of molar masses, moles, temperature conversions, concentrations etc. can be also be asked and graded automatically using FIMBQs. The advantage of FIMBQs over calculated numeric option on a Blackboard is the ability to ask the students to write both numeric answer and alphabetical unit Figure 4.

Figure 4.

2.5. Multi-Steps Calculation

Multi-steps calculation such as determination of limiting reaction and calculation of mass of the products formed was deployed using FIMBQ. Partial credit was awarded even if the final answer is not correct.

Figure 5.

The feedback from these type of questions enable the instructor to know the percentage of students that understood the first step and have problems in other steps, 55 % and 44% of section A and B respectively students that got the first step, fail the second step. (Table 1, question 3).

2.6. Scientific Notations

The answers of the some questions are either very big or very small as the result they needed to be represented with scientific notations, such as 1.03 x (10^24) or 1.03e+24 or any other forms. Such technical difficulties can be eliminated by using two multiple blanks, one for digits and others for the exponential value as in the Figure 6.

The relatively lower percentage of pass for this question compare to other questions, was found to be some student did not pay attention to the order of the question (items 1, 2) in Arabic enable Window is display as 2, 1 from left to right (Table 1, question 4).

Figure 6.

For all the calculation problems, it is important to select for the evaluation method ‘contains’ rather than ‘exact match’ or ‘pattern match’ to accommodate a wide range of answers.

2.7. Chemical Equations

Balancing chemical equations, completing products, converting words equations to chemical equations and classification of chemical were successfully assessed using FIMBQs [15]. However, partial credit to the answer may be checked to encourage students, even though chemical equations needed to be completely balanced as there is nothing as a partially balanced equation.

Balance the following equation and indicate the type of reactions. Do not leave any blank empty, if the number of moles are 1, you must write 1 in the blank.

Figure 7.

The item analysis indicated that all the students did very well and slightly lower percentages for the classification reaction, compared to balancing equation, may not be unrelated to the requirement of recall knowledge (Table 1, question 5).

2.8. Questions in the form of a Table

FIMBQs was used to mimic the paper homework by implementing questions in the tabular form. Numerical calculations and short words or phrases could be applicable to this types of questions.

Figure 8.

3. Conclusions

This article shows that FIMBQs can mimic most of the forms of questions that can be admitted on the paper-based homework and it’s also an excellent test tool for examining students understanding, comprehension, knowledge of absorption and retention. The chances for guessing are minimal as predetermined answers sets are not provided. All the questions with items analysis were found to have good discrimination index, which is also an indication for its effectiveness.

Acknowledgments

Facilities provided by Jubail Industrial College of Royal Commission for Jubail and Yanbu are gratefully acknowledged. The author is grateful to Dr. Yunusa Umar for his help during preparation of the manuscript.

References

[1]   | David, B. S.; Allen, R. P. Pencil-Paper Learning Should Be Combined with Online Homework Software: J. Chem. Educ. 2015, 92, 1965-1970.
[2]   | Jack, F. E.; Junelyn, P. Online Homework Put to the Test: A Report on the Impact of Two Online Learning Systems on Student Performance in General Chemistry: J. Chem. Educ. 2013, 90, 1137-1143.
[3]   | Timothy, P. O.; Grainne, C. H. Using Structural-Based Organic Chemistry Online Tutorials with Automated Correction for Practice and Review: J. Chem. Educ. 2014, 91, 1851-1854.
[4]   | Hunter, S. A. Does Online Homework Increase Motivation to Complete Homework, Master Teachers Program. West Point, NY, 2015, available at https://www.usma.edu/cfe/Literature/Hunter_15.pdf (Accessed November 2018).
[5]   | Che-Yu K.; Hsin-Kai, W. Toward an Integrated Model for Designing Assessment Systems: An Analysis of the Current Status of Computer-based Assessments in Science, Computers & education, 2013, 68 388-403.
[6]   | Miran Z, Igor B.; Dragutin, K. Using Online Assessments to Stimulate Learning Strategies and Achievement of Learning Goals, Computers & education, 2015, 91 32-45.
[7]   | Medawela, R. M. S. H. B.; Ratnayake, L. R. D. R. D.; Abeyasinghe, L. U. M. A. W.; Jayasinghe, D. R.; Marambe, N. K. Effectiveness of FIBQs over MCQs in Assessing Final Year Dental Undergraduate Students. Edu. Med. 2018, 19 (2), 72-76.
[8]   | Cheryl, B. F. Comparison of Features, Electronic Homework Management Systems, J. Chem. Educ. 2009, 86, 693.
[9]   | Blackboard Inc. https://en.wikipedia.org/wiki/Blackboard_Inc. (Accessed November 2018).
[10]   | https://en-us.help.blackboard.com/Learn/Instructor/Tests_Pools_ Surveys/040_Question_Types/Fill_in_Multiple_Blanks_Questions (Accessed November 2018).
[11]   | Brown, T. L.; LeMay, jr. H. E.; Bursten, B. Murphy, C. J, Woodward, P. M. Chemistry, 2015 The Central Science, Pearson Publishing, Inc. 13nd edition, pg. 104.
[12]   | Doris, K. Chemical Principles Revisited, The Chemical Equation Part I: Simple Reaction: J. Chem. Educ. 1978, 3, 184-189.
[13]   | https://uwaterloo.ca/centre-for-teaching-excellence/teaching-resources/teaching-tips/developing-assignments/exams/questions-types-characteristics-suggestions.(Accessed November 2018).
[14]   | Parker, L. L.; Loudon, G. M. Case Study Using Online Homework in Undergraduate Organic Chemistry: Results and Students Attitudes. J. Chem. Educ. 2013, 90, 37-44.
[15]   | Tijani, J. Auto-graded chemical equation problems in online Blackboard assessments: World J. Chem. Edu. 2017, 5 (3), 91-93.