Title
An optimal test design to evaluate the ability of an examinee
using the stress-strength model and the up-and-down method

Authors

Hideo Hirose, Takenori Sakumura


Source

"8th Hawaii International Conference on Statistics, Mathematics and Related Fields", January 13-15, 2009, the Hilton Hawaiian Village Beach Resort & Spa in Honolulu


Abstract

Although the item response theory, the IRT, have widely been used to test systems such as the TOEFL, it is not so well known to teachers of mathematics in universities and colleges. The superiority of the IRT over the classical test method is also valid in mathematics in universities and high schools. However, the number of problems in mathematics to be tested in short time period is strictly limited, in particular in univserisies. An accurate and efficient method to evaluate the abilities of students is strongly required. In this paper, we propose to use the up-and-down method to estimate the students' abilities. The stress-strength model is also incorporated. We have found that this newly proposed method works well. Assuming that the ability of an examinee follows a normal distribution $N(mu, sigma^2)$ and the problems follow normal distributions $N(kd, tau^2)$, the optimal strategy for obtaining the estimates $mu$ and $sigma$ accurately is to set the up-and-down distance $d$ to be $sqrt{sigma^2 + tau^2}/2 le d le 3sqrt{sigma^2 + tau^2}/2$.

@


Key Words
Item response theory, stress-strength model, e-learning, up-and-down method, optimal design.

Citation

@

Times Cited in Web of Science:

Cited in Books: