Sample interview questions: Can you explain the process of item selection and test assembly for computerized adaptive testing (CAT)?
Sample answer:
Item Selection and Test Assembly for Computerized Adaptive Testing (CAT)
Computerized adaptive testing (CAT) is a type of computerized testing that adapts to the ability level of the test taker. This is done by selecting items that are appropriate for the test taker’s current level of ability and continuing to administer items until a reliable estimate of the test taker’s ability has been obtained.
The process of item selection and test assembly for CAT can be divided into the following steps:
- Item Pool Development:
- A large pool of items is developed that cover the content domain being tested.
-
Items are carefully selected to ensure that they are:
- Relevant to the content domain
- Appropriate for the target population
- Free from bias
- Of appropriate difficulty
- Statistically sound
-
Item Calibration:
- Items are calibrated to determine their difficulty and discrimination parameters.
- This is done using a sample of test takers who represent the target population.
- Item difficulty is estimated as the proportion of test takers who answer the item correctly.
-
Item discrimination is estimated as the correlation between the item score and the total test score.
-
Test Assembly:
- A CAT algorithm is used to assemble a test for each test taker.
- The algorithm selects items that are appropriate for the test taker’s current level of ability.
-
The algorithm continues to administer items until a reliable estimate of the test taker’s ability has been obtained.
-
Adaptive Ite… Read full answer