: Wim J. van der Linden, Cees A. W. Glas
: Wim J. van der Linden, Cees A.W. Glas
: Elements of Adaptive Testing Theory and Practice
: Springer-Verlag
: 9780387854618
: 1
: CHF 129.60
:
: Methoden der empirischen und qualitativen Sozialforschung
: English
: 433
: Wasserzeichen/DRM
: PC/MAC/eReader/Tablet
: PDF
The arrival of the computer in educational and psychological testing has led to the current popularity of adaptive testing---a testing format in which the computer uses statistical information about the test items to automatically adapt their selection to a real-time update of the test taker's ability estimate. This book covers such key features of adaptive testing as item selection and ability estimation, adaptive testing with multidimensional abilities, sequencing adaptive test batteries, multistage adaptive testing, item-pool design and maintenance, estimation of item and item-family parameters, item and person fit, as well as adaptive mastery and classification testing. It also shows how these features are used in the daily operations of several large-scale adaptive testing programs.
Preface5
Contributors9
Contents11
Part I Item Selection and Ability Estimation14
1 Item Selection and Ability Estimation in Adaptive Testing15
1.1 Introduction15
1.2 Classical Procedures17
1.2.1 Notation and Some Statistical Concepts17
1.2.2 Ability Estimators19
1.2.3 Choice of Estimator20
1.2.4 Classical Item-Selection Criteria23
1.3 Modern Procedures24
1.3.1 Maximum Global-Information Criterion25
1.3.2 Likelihood-Weighted Information Criterion27
1.3.3 Fully Bayesian Criteria28
1.3.4 Bayesian Criteria with Collateral Information30
1.3.5 Bayesian Criteria with Random Item Parameters33
1.3.6 Miscellaneous Criteria35
1.3.7 Evaluation of Item-Selection Criteria and Ability Estimators36
1.4 Concluding Remarks39
References40
2 Constrained Adaptive Testing with Shadow Tests43
2.1 Introduction43
2.2 Review of Existing Methods for Constrained CAT45
2.2.1 Item-Pool Partitioning45
2.2.2 Weighted-Deviation Method45
2.2.3 Maximum Priority Index Method45
2.2.4 Testlet-Based Adaptive Testing46
2.2.5 Multistage Testing46
2.2.6 Evaluation of Existing Approaches47
2.3 Constrained CAT with Shadow Tests48
2.4 Technical Implementation49
2.4.1 Basic Notation and Definitions50
2.4.2 IP Model for Shadow Test51
2.4.3 Numerical Aspects53
2.5 Four Applications to Adaptive Testing Problems54
2.5.1 CAT with Large Numbers of Nonstatistical Constraints55
2.5.2 CAT with Response-Time Constraints55
2.5.3 CAT with Item-Exposure Control59
2.5.4 CAT with Equated Number-Correct Scores62
2.6 Concluding Remarks65
References65
3 Principles of Multidimensional Adaptive Testing68
3.1 Introduction68
3.2 Literature Review69
3.3 Multidimensional Item Selection and Scoring70
3.3.1 Prior Density71
3.3.2 Likelihood Function72
3.3.3 Posterior Density74
3.3.4 Item Selection76
3.3.5 Posterior Inference79
3.4 Example80
3.4.1 Initialization80
3.4.2 Item Selection81
3.4.3 Provisional Ability Estimation82
3.4.4 Item Selection and Scoring Cycle82
3.5 Discussion84
3.6 Appendix: Computational Formulas84
References85
4 Multidimensional Adaptive Testing with Kullback–Leibler Information Item Selection87
4.1 Multidimensional IRT model88
4.2 Bayesian Estimation of bold0mu mumu *89
4.3 Kullback–Leibler Information91
4.3.1 Mutual Information94
4.4 Item Selection Using KL Information94
4.4.1 Posterior Expected Kullback–Leibler Information95
4.4.2 KL Distance between Subsequent Posteriors97
4.4.3 Mutual Information98
4.5 Relationship between Selection Criteria99
4.6 Special Status of Some of the Ability Parameters101
4.6.1 Nuisance Abilities101
4.6.2 Composite Ability104
4.7 Posterior Covariance107
4.8 Conclusion109
References110
5 Sequencing an Adaptive Test Battery112
5.1 Introduction112
5.2 Multilevel Model114
5.3 Empirical Bayes Approach115
5.3.1 Selection of Initial Pool115
5.3.2 Selection of First Test117
5.3.3 Administration of First Test118
5.3.4 Selection of Subsequent Tests119
5.3.5 Administration of Subsequent Tests120
5.4 Simulation Study120
5.4.1 Design of Study121
5.4.2 Results122
5.5 Concluding Remarks125
5.6 Appendix: Computational Approach126
References127
Part II Applications in Large-Scale Testing Programs129
6 Adaptive Tests for Measuring Anxiety and Depression130
6.1 Introduction130
6.2 Development of CAT Systems132
6.2.1 Patient Samples for Empirical Item Analyses132
6.2.2 Definition of Target Construct133
6.2.3 Initial Item Pool133
6.2.4 Test Dimensionality134
6.2.5 Nonparametric Analyses134
6.2.6 DIF Analysis135
6.2.7 Item Calibration136
6.2.8 Investigation of Model Fit136
6.2.9 Item Banks137
6.2.10 CAT Algorithm137
6.2.11 Delivery System138
6.3 Evaluation Studies138
6.4 Discussion140
References141
7 MATHCAT: A Flexible Testing System in Mathematics Education for Adults144
7.1 Introduction144
7.2 The Item Bank for Numerical and Mathematical Skills145