Quiz: Psychometric Foundations and Test Reliability — 8 Fragen

1. How do Classical Test Theory and Item Response Theory primarily differ in their approach to psychometric measurement?

A. Classical Test Theory was developed in the 1960s, whereas Item Response Theory was developed in the 1920s.

B. Classical Test Theory is only applicable to sensory-motor tasks, while Item Response Theory applies to all psychological attributes.

C. Classical Test Theory models observed scores as the sum of true scores and error, while Item Response Theory analyzes individual items and estimates person ability at the item level.

D. Classical Test Theory focuses on qualitative analysis of test items, whereas Item Response Theory uses only qualitative data.

Answer: (C)

Erklärung

Classical Test Theory models observed scores as the sum of true scores and error, focusing on overall test reliability, while Item Response Theory analyzes individual items and estimates person ability at the item level, focusing on item characteristics.

2. What are the typical response formats used in optimal and typical psychological tests?

A. True/False and Likert scales for optimal tests; open-ended questions for typical tests

B. Multiple-choice questions for optimal tests; true/False questions for typical tests

C. Binary choices and Likert scales for optimal tests; constructed responses for typical tests

D. Constructed responses and multiple-choice items for optimal tests; binary choices and ordered categories for typical tests

Answer: (D)

Erklärung

Optimal tests often use constructed responses and multiple-choice items to measure ability and reduce biases, while typical tests use binary choices and ordered categories for ease of administration but are more susceptible to response biases.

3. What is a key feature of well-constructed multiple-choice items?

A. Options should be presented horizontally for clarity

B. All options should be correct to increase difficulty

C. Options should be similar in length and complexity

D. Distractors should be plausible and mutually exclusive

Answer: (D)

Erklärung

Distractors should be plausible and mutually exclusive to maintain assessment validity, as stated in the source.

4. How do dichotomous and polytomous scoring methods differ in evaluating test responses?

A. Dichotomous scoring considers the difficulty of questions, whereas polytomous scoring does not.

B. Dichotomous scoring assigns responses as correct or incorrect, while polytomous scoring grades responses based on quality levels.

C. Dichotomous scoring is subjective, while polytomous scoring is always objective.

D. Dichotomous scoring is used only in multiple-choice tests, whereas polytomous scoring is exclusive to essay assessments.

Answer: (B)

Erklärung

Dichotomous scoring assigns responses as correct or incorrect, while polytomous scoring grades responses based on quality levels, as supported by the source.

5. Which statement matches the topic "Item analysis: difficulty, discrimination, and validity indices"?

A. Item Difficulty Index : a measure of how many respondents answer an item correctly or choose a specific response, reflecting the proportion of correct responses or the ease of the item

B. Test Mental : a psychological measurement tool designed to assess individual differences in sensory-motor tasks, introduced by Galton and Catell in the 19th century

C. Relación : a quantitative or qualitative connection between variables, such as the correlation or association measured in psychometric analysis

D. Pequeño repaso : a brief review or summary of foundational concepts in psychometrics, emphasizing its historical development from early sensory tests to modern models

Answer: (A)

Erklärung

This statement comes directly from the course section dedicated to this topic: Item Difficulty Index : a measure of how many respondents answer an item correctly or choose a specific response, reflecting the proportion of correct responses or the ease of the item.

6. What is reliability in Classical Test Theory?

A. A measurement property indicating the consistency, stability, and internal coherence of test scores

B. The degree to which a test measures what it claims to measure

C. The correlation between different test forms

D. A measure of the accuracy of test scores

Answer: (A)

Erklärung

Reliability in Classical Test Theory is defined as a measurement property indicating the consistency, stability, and internal coherence of test scores, based on the assumption that observed scores are composed of true scores plus error.

7. Which statement matches the topic "Sources of measurement error and reliability types"?

A. Test Mental : a psychological measurement tool designed to assess individual differences in sensory-motor tasks, introduced by Galton and Catell in the 19th century

B. Transient errors result from temporary influences that affect retest scores, such as mood or fatigue. Specificity errors are caused by differences in item content or test format, impacting…

C. Pequeño repaso : a brief review or summary of foundational concepts in psychometrics, emphasizing its historical development from early sensory tests to modern models

D. Relación : a quantitative or qualitative connection between variables, such as the correlation or association measured in psychometric analysis

Answer: (B)

Erklärung

This statement comes directly from the course section dedicated to this topic: Transient errors result from temporary influences that affect retest scores, such as mood or fatigue. Specificity errors are caused by differences in item content or test format, impacting….

8. How can a test administrator practically improve the reliability of a test?

A. By reducing the number of response options

B. By increasing the number of test items

C. By shortening the test duration

D. By using more subjective scoring

Answer: (B)

Erklärung

Increasing the number of test items generally enhances reliability by raising the variance of true scores more rapidly than that of error scores, thus making results more consistent.