![](/olcweb/styles/shared/spacer.gif) |
1 | ![](/olcweb/styles/shared/spacer.gif) | ![](/olcweb/styles/shared/spacer.gif) Which of the following statements most likely involves using data in a way that is not valid? |
| ![](/olcweb/styles/shared/spacer.gif) | A)![](/olcweb/styles/shared/spacer.gif) | University data indicate that the highest paid professors have the most publications. |
| ![](/olcweb/styles/shared/spacer.gif) | B)![](/olcweb/styles/shared/spacer.gif) | Students who can type more than 80 words per minute will receive a typing award. |
| ![](/olcweb/styles/shared/spacer.gif) | C)![](/olcweb/styles/shared/spacer.gif) | All of the teachers interviewed described the principal as "outstanding." |
| ![](/olcweb/styles/shared/spacer.gif) | D)![](/olcweb/styles/shared/spacer.gif) | The English teacher does not assign students a grade less than "B." |
![](/olcweb/styles/shared/spacer.gif) |
![](/olcweb/styles/shared/spacer.gif) |
2 | ![](/olcweb/styles/shared/spacer.gif) | ![](/olcweb/styles/shared/spacer.gif) Which of the following is content-related evidence of validity? |
| ![](/olcweb/styles/shared/spacer.gif) | A)![](/olcweb/styles/shared/spacer.gif) | Test items are at an appropriate reading level. |
| ![](/olcweb/styles/shared/spacer.gif) | B)![](/olcweb/styles/shared/spacer.gif) | Observed participant characteristics are consistent with responses on a scale. |
| ![](/olcweb/styles/shared/spacer.gif) | C)![](/olcweb/styles/shared/spacer.gif) | Scores obtained on two administrations of the instrument are consistent. |
| ![](/olcweb/styles/shared/spacer.gif) | D)![](/olcweb/styles/shared/spacer.gif) | Scores are correlated with scores obtained on another instrument. |
![](/olcweb/styles/shared/spacer.gif) |
![](/olcweb/styles/shared/spacer.gif) |
3 | ![](/olcweb/styles/shared/spacer.gif) | ![](/olcweb/styles/shared/spacer.gif) The best construct-related evidence of validity comes from |
| ![](/olcweb/styles/shared/spacer.gif) | A)![](/olcweb/styles/shared/spacer.gif) | a series of studies of the instrument. |
| ![](/olcweb/styles/shared/spacer.gif) | B)![](/olcweb/styles/shared/spacer.gif) | a validity coefficient that is near 0. |
| ![](/olcweb/styles/shared/spacer.gif) | C)![](/olcweb/styles/shared/spacer.gif) | careful review of the instrument by experts. |
| ![](/olcweb/styles/shared/spacer.gif) | D)![](/olcweb/styles/shared/spacer.gif) | data-based predictions that prove to be correct. |
![](/olcweb/styles/shared/spacer.gif) |
![](/olcweb/styles/shared/spacer.gif) |
4 | ![](/olcweb/styles/shared/spacer.gif) | ![](/olcweb/styles/shared/spacer.gif) Which of the following statements accurately portrays the relationship of reliability to validity? |
| ![](/olcweb/styles/shared/spacer.gif) | A)![](/olcweb/styles/shared/spacer.gif) | Inferences must be valid before the scores can be reliable. |
| ![](/olcweb/styles/shared/spacer.gif) | B)![](/olcweb/styles/shared/spacer.gif) | Scores must be reliable before inferences can be valid. |
| ![](/olcweb/styles/shared/spacer.gif) | C)![](/olcweb/styles/shared/spacer.gif) | The more valid the inference is, the higher the reliability of the score must be. |
| ![](/olcweb/styles/shared/spacer.gif) | D)![](/olcweb/styles/shared/spacer.gif) | Score reliability is not related to inference validity. |
![](/olcweb/styles/shared/spacer.gif) |
![](/olcweb/styles/shared/spacer.gif) |
5 | ![](/olcweb/styles/shared/spacer.gif) | ![](/olcweb/styles/shared/spacer.gif) Which of the following is most likely to be the alternate forms reliability coefficient for a well-established standardized test? |
| ![](/olcweb/styles/shared/spacer.gif) | A)![](/olcweb/styles/shared/spacer.gif) | -0.93 |
| ![](/olcweb/styles/shared/spacer.gif) | B)![](/olcweb/styles/shared/spacer.gif) | +0.46 |
| ![](/olcweb/styles/shared/spacer.gif) | C)![](/olcweb/styles/shared/spacer.gif) | +0.89 |
| ![](/olcweb/styles/shared/spacer.gif) | D)![](/olcweb/styles/shared/spacer.gif) | +1.42 |
![](/olcweb/styles/shared/spacer.gif) |
![](/olcweb/styles/shared/spacer.gif) |
6 | ![](/olcweb/styles/shared/spacer.gif) | ![](/olcweb/styles/shared/spacer.gif) The method for checking reliability that should not be used when measuring an unstable construct is |
| ![](/olcweb/styles/shared/spacer.gif) | A)![](/olcweb/styles/shared/spacer.gif) | the test-retest method. |
| ![](/olcweb/styles/shared/spacer.gif) | B)![](/olcweb/styles/shared/spacer.gif) | the equivalent forms method. |
| ![](/olcweb/styles/shared/spacer.gif) | C)![](/olcweb/styles/shared/spacer.gif) | the internal-consistency method. |
| ![](/olcweb/styles/shared/spacer.gif) | D)![](/olcweb/styles/shared/spacer.gif) | finding the level of scoring agreement of multiple observers. |
![](/olcweb/styles/shared/spacer.gif) |
![](/olcweb/styles/shared/spacer.gif) |
7 | ![](/olcweb/styles/shared/spacer.gif) | ![](/olcweb/styles/shared/spacer.gif) An expectancy table is shown below.
| Observer's behavior rating | Disciplinary Action is Taken | | Often | Sometimes | Never | Excellent | 6 | 4 | A | Typical | 13 | B | 11 | Problem | C | 7 | 2 |
What numbers put in place of "A," "B," and "C" would provide the best criterion-related evidence of validity? |
| ![](/olcweb/styles/shared/spacer.gif) | A)![](/olcweb/styles/shared/spacer.gif) | A = 62, B = 2, C = 8 |
| ![](/olcweb/styles/shared/spacer.gif) | B)![](/olcweb/styles/shared/spacer.gif) | A = 71, B = 49, C = 38 |
| ![](/olcweb/styles/shared/spacer.gif) | C)![](/olcweb/styles/shared/spacer.gif) | A = 4, B = 3, C = 8 |
| ![](/olcweb/styles/shared/spacer.gif) | D)![](/olcweb/styles/shared/spacer.gif) | A = 1, B = 6, C = 51 |
![](/olcweb/styles/shared/spacer.gif) |
![](/olcweb/styles/shared/spacer.gif) |
8 | ![](/olcweb/styles/shared/spacer.gif) | ![](/olcweb/styles/shared/spacer.gif) What are the two forms of criterion-related validity? |
| ![](/olcweb/styles/shared/spacer.gif) | A)![](/olcweb/styles/shared/spacer.gif) | correlational and content |
| ![](/olcweb/styles/shared/spacer.gif) | B)![](/olcweb/styles/shared/spacer.gif) | predictive and correlational |
| ![](/olcweb/styles/shared/spacer.gif) | C)![](/olcweb/styles/shared/spacer.gif) | predictive and concurrent |
| ![](/olcweb/styles/shared/spacer.gif) | D)![](/olcweb/styles/shared/spacer.gif) | criterion and predictive |
![](/olcweb/styles/shared/spacer.gif) |
![](/olcweb/styles/shared/spacer.gif) |
9 | ![](/olcweb/styles/shared/spacer.gif) | ![](/olcweb/styles/shared/spacer.gif) To obtain evidence of predictive validity a researcher will have to |
| ![](/olcweb/styles/shared/spacer.gif) | A)![](/olcweb/styles/shared/spacer.gif) | consult another researcher. |
| ![](/olcweb/styles/shared/spacer.gif) | B)![](/olcweb/styles/shared/spacer.gif) | review all of the instruments. |
| ![](/olcweb/styles/shared/spacer.gif) | C)![](/olcweb/styles/shared/spacer.gif) | gather instrument data and criterion data at nearly the same time. |
| ![](/olcweb/styles/shared/spacer.gif) | D)![](/olcweb/styles/shared/spacer.gif) | allow a time interval to elapse between administration of the instrument and obtaining the criterion scores. |
![](/olcweb/styles/shared/spacer.gif) |
![](/olcweb/styles/shared/spacer.gif) |
10 | ![](/olcweb/styles/shared/spacer.gif) | ![](/olcweb/styles/shared/spacer.gif) A researcher administers a history aptitude test to a group of middle school students and later compares their test scores with their end-of-the-semester grade in history. This is an example of obtaining evidence of |
| ![](/olcweb/styles/shared/spacer.gif) | A)![](/olcweb/styles/shared/spacer.gif) | predictive validity. |
| ![](/olcweb/styles/shared/spacer.gif) | B)![](/olcweb/styles/shared/spacer.gif) | concurrent validity. |
| ![](/olcweb/styles/shared/spacer.gif) | C)![](/olcweb/styles/shared/spacer.gif) | content related evidence of validity. |
![](/olcweb/styles/shared/spacer.gif) |
![](/olcweb/styles/shared/spacer.gif) |
11 | ![](/olcweb/styles/shared/spacer.gif) | ![](/olcweb/styles/shared/spacer.gif) Which of the following is not one of the three best-known ways to obtain a reliability coefficient? |
| ![](/olcweb/styles/shared/spacer.gif) | A)![](/olcweb/styles/shared/spacer.gif) | test-retest |
| ![](/olcweb/styles/shared/spacer.gif) | B)![](/olcweb/styles/shared/spacer.gif) | equivalent forms |
| ![](/olcweb/styles/shared/spacer.gif) | C)![](/olcweb/styles/shared/spacer.gif) | internal consistency |
| ![](/olcweb/styles/shared/spacer.gif) | D)![](/olcweb/styles/shared/spacer.gif) | concurrent |
![](/olcweb/styles/shared/spacer.gif) |
![](/olcweb/styles/shared/spacer.gif) |
12 | ![](/olcweb/styles/shared/spacer.gif) | ![](/olcweb/styles/shared/spacer.gif) Which of the following are the three best known ways to obtain a reliability coefficient? |
| ![](/olcweb/styles/shared/spacer.gif) | A)![](/olcweb/styles/shared/spacer.gif) | predictive, concurrent, and equivalent forms |
| ![](/olcweb/styles/shared/spacer.gif) | B)![](/olcweb/styles/shared/spacer.gif) | test-retest, equivalent forms, and internal consistency |
| ![](/olcweb/styles/shared/spacer.gif) | C)![](/olcweb/styles/shared/spacer.gif) | test-retest, concurrent, and equivalent forms |
![](/olcweb/styles/shared/spacer.gif) |
![](/olcweb/styles/shared/spacer.gif) |
13 | ![](/olcweb/styles/shared/spacer.gif) | ![](/olcweb/styles/shared/spacer.gif) To obtain evidence of concurrent validity a researcher will have to |
| ![](/olcweb/styles/shared/spacer.gif) | A)![](/olcweb/styles/shared/spacer.gif) | consult another researcher. |
| ![](/olcweb/styles/shared/spacer.gif) | B)![](/olcweb/styles/shared/spacer.gif) | review all of the instruments. |
| ![](/olcweb/styles/shared/spacer.gif) | C)![](/olcweb/styles/shared/spacer.gif) | gather instrument data and criterion data at nearly the same time. |
| ![](/olcweb/styles/shared/spacer.gif) | D)![](/olcweb/styles/shared/spacer.gif) | allow a time interval to elapse between administration of the instrument and obtaining the criterion scores. |
![](/olcweb/styles/shared/spacer.gif) |
![](/olcweb/styles/shared/spacer.gif) |
14 | ![](/olcweb/styles/shared/spacer.gif) | ![](/olcweb/styles/shared/spacer.gif) If a researcher wishes to obtain content-related evidence of validity, a common way to do this is to |
| ![](/olcweb/styles/shared/spacer.gif) | A)![](/olcweb/styles/shared/spacer.gif) | have a friend look over the instrument and give feedback. |
| ![](/olcweb/styles/shared/spacer.gif) | B)![](/olcweb/styles/shared/spacer.gif) | obtain a Kuder-Richardson analysis. |
| ![](/olcweb/styles/shared/spacer.gif) | C)![](/olcweb/styles/shared/spacer.gif) | review the instrument very carefully. |
| ![](/olcweb/styles/shared/spacer.gif) | D)![](/olcweb/styles/shared/spacer.gif) | have an individual who knows enough about what is to be measured review the content and format of the instrument and judge whether it is appropriate. |
![](/olcweb/styles/shared/spacer.gif) |
![](/olcweb/styles/shared/spacer.gif) |
15 | ![](/olcweb/styles/shared/spacer.gif) | ![](/olcweb/styles/shared/spacer.gif) What are the three main types of evidence on validity that a researcher might collect? |
| ![](/olcweb/styles/shared/spacer.gif) | A)![](/olcweb/styles/shared/spacer.gif) | content-related evidence, criterion-related on validity, construct-related evidence |
| ![](/olcweb/styles/shared/spacer.gif) | B)![](/olcweb/styles/shared/spacer.gif) | historical evidence, criterion-related evidence |
| ![](/olcweb/styles/shared/spacer.gif) | C)![](/olcweb/styles/shared/spacer.gif) | content-related evidence, laboratory evidence, construct-related evidence |
| ![](/olcweb/styles/shared/spacer.gif) | D)![](/olcweb/styles/shared/spacer.gif) | content-related evidence, criterion-related evidence, observation-related evidence |
![](/olcweb/styles/shared/spacer.gif) |