Comparative analysis of two methods of scoring word problems in mathematics: Implications on test validity and reliability

Date of Publication

1986

Document Type

Dissertation

Degree Name

Doctor of Philosophy in Science Education Major in Mathematics

Subject Categories

Mathematics

College

Br. Andrew Gonzalez FSC College of Education

Department/Unit

Science Education

Thesis Adviser

Melecio C. Deauna

Defense Panel Chair

Alberto Campos

Defense Panel Member

Herminia D. Torres
Severino D. Diesto
Rose Marie Salazar-Clemena

Abstract/Summary

This study compares two methods of scoring word problems in mathematics ('without criteria' and 'with criteria') in terms of reliability and validity of a test consisting of 12 word problems appropriate for high school sophomores enrolled in the external units of the Mindanao State University. This test was administered to 96 third year high school students belonging to the better sections of the four schools randomly chosen from the Mindanao State University - external units, including MSU-Science High School. Of these test papers, twenty (grouped into two of ten papers each) were randomly selected and six photocopies were made of each test papers for four teachers to rate. Given that each item is worth a maximum of ten points, phase 1 of this study required the raters to mark them using 'without criteria' which corresponds to their usual way of marking. After a week, phase 2 directed the same raters to mark each problem of the remaining photocopies using 'with criteria' or based on the criteria: representation (3 points), equation (4 points), computation (2 points), and answer (1 point).
Reliability includes three coefficients: 1) inter-rater reliability coefficient 2) stability coefficient and 3) internal consistency coefficient. The relationship between the students' second year mathematics grades and the scores obtained by each rater from 'without criteria' or 'with criteria' method of scoring explains the validity of the test. With the aid of Pearson product-moment method, split-half technique (corrected by Spearman-Brown prophecy formula), T- (and Z-) tests for both the dependent and independent samples, and analysis of variance, this study arrived at the following conclusions: 'with criteria' method of scoring word problems in mathematics produced better objectivity and higher reliability, preserved the homogeneity of the students involved in the study, slightly increased internal consistency of word problems in mathematics test, slightly increased the validity of the test, and partial knowledge of the students is given greater credit when 'with criteria' method was used.

Abstract Format

html

Language

English

Format

Print

Accession Number

TG01470

Shelf Location

Archives, The Learning Commons, 12F Henry Sy Sr. Hall

Physical Description

123 leaves, 28 cm.

Keywords

Word problems (Mathematics)

This document is currently not available here.

Share

COinS