DEVELOPING COMPUTERIZED ADAPTIVE TESTING TO ASSESS THE READING COMPREHENSION COMPETENCE OF 10TH GRADERS

Tran Thi Hoa; Le Thai Hung; Hoang Lan Huong; Dang Thi May

Le Thai Hung	hunglethai82@gmail.com	VNU University of Education, Vietnam National University, Hanoi 144 Xuan Thuy, Cau Giay, Hanoi, Vietnam
Tran Thi Hoa	tranhoak56@gmail.com	VNU University of Education, Vietnam National University, Hanoi 144 Xuan Thuy, Cau Giay, Hanoi, Vietnam
Dang Thi May	dangmaykhgd@gmail.com	VNU University of Education, Vietnam National University, Hanoi 144 Xuan Thuy, Cau Giay, Hanoi, Vietnam
Hoang Lan Huong	huonghoangsp@gmail.com	VNU University of Education, Vietnam National University, Hanoi 144 Xuan Thuy, Cau Giay, Hanoi, Vietnam

Summary:

Computerized Adaptive Testing (CAT) is a form of assessment test which requires fewer test questions to arrive at precise measurements of examinees’ competence. One of the core technical components in building a CAT is mathematical algorithms which estimate examinee’s ability and select the most appropriate test questions for the estimation. Those mathematical algorithms serve as a locomotive in operating the system of adaptive multiple-choice questions on computers. Our research aims to develop the essential mathematical algorithms to a computerised system of adaptive multiple-choice tests. We also build a question bank of 500 multiple-choice questions standardised by IRT theory with the difficulty level follows the normal distribution satisfying Kolmogorov-Smirnov test to measure the reading comprehension competence of students in grade 10. The initial outcome of our experiment on the question bank shows that the question bank satisfies the requirements from a psychometric model and the constructed mathematical algorithms meets the criteria to apply in computerised adaptive testing.

View file

Keywords:

Computerized Adaptive Testing

competence measurement

reading comprehension competence

Refers:

[1] Sái Công Hồng, Lê Thái Hưng, Lê Thị Hoàng Hà, Lê Đức Ngọc (2017), Giáo trình Kiểm tra đánh giá trong dạy học, NXB Đại học Quốc gia Hà Nội.

[2] A. Primacop, (1976), Phương pháp đọc sách, NXB Giáo dục, Hà Nội, tr.19.

[3] Bộ Giáo dục và Đào tạo, (2014), Tài liệu tập huấn dạy học và kiểm tra, đánh giá kết quả học tập theo định hướng phát triển năng lực học sinh.

[4] Nguyễn Hải Châu - Lê Thị Mỹ Hà, (2012), PISA và các dạng câu hỏi, NXB Giáo dục Việt Nam

[5] Đỗ Thu Hà - Viện Khoa học Giáo dục Việt Nam, Vận dụng cách thiết kế câu hỏi đánh giá năng lực đọc hiểu của PISA vào môn Ngữ văn.

[6] Nguyễn Thái Hòa, (2004), Vấn đề đọc hiểu và dạy đọc hiểu, Tạp chí Thông tin Khoa học Sư phạm, số 8.

[7] Nguyễn Thanh Hùng, (2017), Kĩ năng đọc hiểu Văn, NXB Đại học Sư phạm, Hà Nội.

[8] Alison Wolf, (1995), Competence-Based Assessment

[9] Eric Witty - Barbara Gaston, (2008), Competency Based Learning and Assessment, ETITO.

[10] Organization for Economic Cooperation and Development, (2002).

[11] Rod Powers - Jennifer Lawler, (2007), ASVAB For Dummies, John Wiley @Sons Published house.

[12] Reckase, M. D, (2003), Item pool design for computerized adaptive tests, Paper presented at annual meeting of the National Council on Measurement in Education, Chicago, IL.

[13] Quebec Educational Reform, (2005).

[14] Singapore Workforce Development Agency – Quality Assurabce Division, (2012), Develop competency – based assessment, plans version 1.

[15] Weiss, D. J. & Kingsbury, G. G, (1984), Application of computerized adaptive testing to educational problems Journal of Educational Measurement, 21, p.361-375

Journal:

No. 24, December 2019

VIETNAM JOURNAL OF EDUCATIONAL SCIENCES

THE VIETNAM NATIONAL INSTITUTE OF EDUCATIONAL SCIENCES

DEVELOPING COMPUTERIZED ADAPTIVE TESTING TO ASSESS THE READING COMPREHENSION COMPETENCE OF 10TH GRADERS