Which of the following sources of validity evidence are teachers most likely to collect?
A. Test content
B. Response processes
C. Internal structure
D. Relations to other variables
Which of the following rules is often recommended for the generation of matching
items?
A. Order all of the premises alphabetically, but arrange the responses in an
unpredictable manner.
B. Place the premises for an item on one page, then put most of the responses for that
item on the following page.
C. Ideally, both the premises and the responses should represent fundamentally
heterogeneous lists.
D. Employ relatively brief lists, placing the shorter words or phrases at the right.
What is the chief role of the National Assessment of Educational Progress (NAEP)?
A. To compare the academic performances of U.S. students with those of students in
other nations
B. To promote more consistent curriculum targets in the 50 U.S. states
C. To monitor U.S. students’ academic achievement over time
D. To satisfy the measurement requirements of any state whose officials wish to
measure students’ mastery of specific content standards
As employed by most of today’s educators, to which of the following is the expression,
“content standard” most equivalent?
A. Performance standard
B. Content validity
C. Curricular goal
D. Curricular assessment
Which of the following is not an element typically embodied in performance tests?
A. Judgmental appraisal of students’ responses
B. Prespecified evaluative criteria for judging students’ responses
C. Multiple evaluative criteria
D. A direct link to a preexisting content standard
If classroom teachers set out to improve their own tests using judgmental approaches,
which of the following review criteria is not a factor teachers ought to consider?
A. Adherence to item-specific guidelines and general item-writing rules
B. Absence of any significant gaps in a test’s content coverage
C. Each item’s likely contribution to a valid score-based inference about a student’s
status
D. The likelihood that, if a test is seen by parents, those parents will recognize the
suitability of an item’s content coverage
Which of the following contentions about affective assessment in the classroom is not
accurate?
A. If classroom affective assessment is introduced, it substantially diminishes the
attention given to the measurement of higher-level cognitive outcomes.
B. Classroom affective assessment typically focuses a teacher’s instructional concerns
more directly on the promotion of affective objectives for students.
C. Anonymity enhancement procedures for classroom affective assessment are
extremely desirable.
D. If affective assessment is to take place in classrooms, many teachers will need to
learn about affect-focused instructional techniques.
Which of the following phrases is most commonly used to describe a portfolio focused
on a student’s self-evaluative and ongoing improvement in the quality of work
products?
A. Working portfolio
B. Showcase portfolio
C. Formative portfolio
D. Summative portfolio
Which of the following statements most accurately reflects the relationship between
students’ aptitude and their achievement?
A. Both aptitude and achievement are equivalent to a traditional conception of
intelligence.
B. Whereas aptitude tends to reflect potential, achievement tends to reflect prior
learning.
C. Actually, achievement is little more than an operationalization of aptitude.
D. The level of a student’s aptitude can never exceed the level of the student’s
achievement.
Which of the following conceptions of assessment validity is most consonant with the
Standards for Educational and Psychological Testing released in 2014 by AERA, APA,
and NCME?
A. The accuracy of score-based interpretations for intended test uses
B. How consistently a test measures whatever it measures
C. The appropriateness of a test’s usage
D. The accuracy of score-based inferences about test-takers
What kind of evidence is most eagerly sought by the commercial testing firms that
develop academic aptitude tests?
A. Relations to other variables evidence of validity
B. Evidence that a test is regarded by some as face-valid
C. Test content evidence of validity
D. Evidence that the consequences of a test’s use will be appropriate
Which statement best characterized this nation’s current use of formative assessment?
A. Most teachers now employ the formative-assessment process in their classes.
B. Although research-supported, formative assessment is not widely used.
C. Only a five-strategies approach to formative assessment is often encountered.
D. A four-levels approach to formative assessment is used in the lower grades.
Which of the following is an item-writing guideline for the construction of multiple-
choice items?
A. Generally, especially with young children, the stem should consist of an incomplete
statement rather than direct question.
B. Don”t ever use “all-of-the-above” alternatives, but use a “none-of-the-above”
alternative to increase an item’s difficulty.
C. Typically, make the later answer options, such as “C” and “D,” the correct answers.
D. Supply clues to the correct answer by using alternatives of dissimilar lengths.
Cronbach’s coefficient alpha and the Kuder-Richardson reliability formulae are
examples of:
A. Test-retest coefficients
B. Alternate-form coefficients
C. Internal-consistency coefficients
D. None of the above
Which of the following is the most troublesome problem facing those educators who
wish to rely heavily on the use of performance tests?
A. Generating tasks for performance tests
B. Scoring students’ responses to a performance test’s task(s)
C. Making valid inferences about students’ generalized skill-mastery
D. Persuading students to respond seriously to a performance test’s task(s)
As most educators currently use the expression, “content standard,” to which of the
following is that phrase most equivalent?
A. The level of proficiency sought for students
B. A performance standard
C. Content-related evidence of validity
D. A curricular aim
What sort of instructional outcome is Mr. Bevins seeking to accomplish when he wants
his biology students to “develop a sincere respect for the scientific process”?
A. Cognitive
B. Affective
C. Psychomotor
D. None of the above
Which of the following are most responsible for the Common Core State Standards?
A. APA and AERA
B. PARCC and SBAC
C. CCSSO and NGA
D. NAGB and NAEP
Which of the following is the most often misinterpreted score-interpretation indicator
used with standardized tests?
A. Raw score
B. Percentile
C. Stanine
D. Grade-equivalent score
Which of the following statements best describes the relationship among the three
sanctioned forms of reliability evidence?
A. All three types of evidence are essentially equivalent.
B. Est-retest reliability evidence is more important than either internal-consistency
evidence or alternate-form evidence.
C. The three forms of evidence represent fundamentally different ways of representing a
test’s consistency.
D. The three forms of evidence differ in their significance because internal-consistency
evidence of a test’s reliability is a necessary condition for the other two types of
consistency.
The National Assessment of Educational Progress (NAEP):
A. is a mandatory examination in reading and mathematics that must be taken annually
by a sample of students in each state.
B. was first established in 1996 by the U.S. Congress to serve as an accountability
oriented nation’s “report card.”
C. assesses national samples of U.S. students at three grade levels every few years in
certain academic subjects.
D. sets forth prescribed assessment frameworks at three grade levels, such frameworks
to be followed by the 50 states in framing their own state content standards.
One of the following rules for the construction of essay items is accurate. The other
three rules are not. Which is the correct rule?
A. Force students to allocate their time judiciously by never indicating how much time
should be expended on a particular item.
B. Give students an opportunity to match their achievement levels with the essay test by
allowing them to choose, from optional items, those they will answer.
C. Construct all essay items so the student’s task for each item is unambiguously
described.
D. Judge the quality of a given set of essay items by seeing how accurately a tryout
group of students can comprehend what responses are sought.
Which of the following is typically recommended for use with students who have the
most serious cognitive disabilities?
A. Alternate assessments
B. Assessment accommodations
C. No assessments whatsoever
D. Regular assessments
Select the one accurate guideline below for teachers who are scoring students’
responses to essay items.
A. Early on during the scoring process, depending on students’ responses, decide how
much weight you should give to the mechanics of writing.
B. Be sure your students identify their own essay responses clearly so you can take
students’ aptitudes into consideration.
C. Prepare at least a tentative scoring key in advance of judging students’ responses to
any item.
D. Score every student’s response using two approaches: first holistically, then
analytically.
Differential item functioning (DIF) is employed in connection with which of the
following approaches to bias-detection?
A. Empirical approaches
B. Judgmental approaches
C. Both empirical and judgmental approaches
D. Neither empirical nor judgmental approaches
What should be the two major fairness concerns of a classroom teacher who wishes to
eliminate bias in the teacher’s assessment instruments?
A. Unfair penalization and reliability of items in the teacher’s tests
B. Offensiveness and absence-of-bias in items in the teacher’s tests
C. Offensiveness and unfair penalization of items in the teacher’s tests
D. Disparate impact and offensiveness of items in the teacher’s tests
Which of the following is generally conceded to be a key component of formative
assessment?
A. Data obtained via standardized achievement tests
B. A heavy emphasis on using students’ classroom test results as a dominant factor in
determining students’ grades
C. The framework provided by a learning progression’s building blocks
D. A teacher’s exclusive reliance on the collection of data using constructed-response
tests.
Which of the rules given below accurately reflects one of the guidelines generally given
to classroom teachers who must score students’ responses to essay items?
A. Score an entire test, that is, the student’s responses to all items, before going on to
the next student’s test.
B. After all answers to all essay items have been scored, decide how much weight you
should giveif anyto such factors as spelling, punctuation, and grammar.
C. Attempt to apply Bloom’s Cognitive Taxonomy to the scoring process.
D. Prepare a tentative scoring key prior to judging any student’s responsebeing ready to
modify it if this seems warranted during the scoring.
Which of the following is not an item-writing rule for the creation of binary-choice
items?
A. Include only a single concept in any statement.
B. Phrase items so that a superficial analysis by students will suggest an incorrect
answer.
C. Rarely use statements containing double negatives, although single or triple
negatives are acceptable.
D. Keep item-length similar for both of the binary categories being assessed.
If Mr. Higgins, a fourth-grade teacher, tries to evaluate his major exams by ascertaining
the degree to which his test’s items are functioning in a similar manner, what kind of
test-evaluative evidence is this?
A. Test-retest reliability evidence
B. Alternate-form reliability evidence
C. Internal-consistency reliability evidence
D. None of the above
A rubric is a scoring guide to be employed in judging students’ responses to
constructed-response assessments such as a performance test. Which one of the
following elements is the least necessary feature of a properly constructed rubric?
A. An identification of the evaluative criteria to be used in appraising a student’s
response
B. A designation of a performance standard required for skill-mastery
C. Descriptions of different quality levels associated with each evaluative criterion
D. An indication of whether a holistic or analytic scoring approach is to be used