Essential competencies for program evaluators include
a. interpersonal competence
b. reflective practice
c. situational analysis
d. systematic inquiry
The following categorizations of evaluation approaches or theories provided insights
into evaluation history and practice. Stufflebeam’s method was examined by:
a. reducing the number of approaches in to one approach only.
b. synthesizing multiple approaches in the research.
c. considering the potential use in the research work.
d. all of the above.
Evaluators are advised
a. to adhere to one specific approach.
b. to use a combination of approaches, which depends on the context.
c. to emphasis the historical significance
d. a, b
Any evaluation program has limitations, which are illustrated in the Decision-Oriented
approaches. Which of the following criticisms is accurate?
a. There is too much focus on decisions.
b. The evaluator’s inability to respond to significant questions.
c. The evaluation approach assumes that the decisions can be clearly identified in
advance.
d. All of the above.
The “Object” of evaluation can be characterized by the following factors:
a. Dimensions of the program
b. Implementation timing/resources
c. Contextual events or circumstances
d. All of these.
Organizational learning requires that
a. departments work efficiently together.
b. departments and systems to work efficiently together.
c. administration to work on goals only.
Development of the questionnaire requires that the evaluator consider which of the
following issues?
a. Sequencing questions
b. Wording questions
c. Soliciting answers
d. Giving instructions
Fetterman’s Empowerment Evaluation incorporates
a. evaluation as means of improvement.
b. use of evaluation, concepts, techniques to foster self determination.
c. capacity-building for a global network of evaluators.
d. the control of the evaluator over decisions concerning the evaluation
Which statements are false about research and evaluation?
a. A researcher and evaluator seek conclusions rather than judgments.
b. Research seeks conclusions, which has explored and established causal relationships.
c. Evaluation leads to judgments, which may have an immediate impact on
stakeholders.
Key elements of Eisner’s educational approach focuses on the critical dimensions
include the following:
a. description
b. development of themes
c. interpretation
d. evaluation
Logical Positivism, seen in social sciences, has the following premise:
a. Discover the statistical probability on one reality and establish laws and theories
about how it works.
b. Maintain close contact with the researchers and the participants that are being
studied.
c. Use subjectivity by the researchers.
d. All of these
The planning used in the convergent phase would encompass the following questions:
a. Who would use information?
b. Would an answer reduce present uncertainty or provide information not now readily
available?
c. Would the scope or comprehensiveness of the evaluation be seriously limited if this
question were dropped?
d. All of the above
Evaluation criteria are based upon standards, which include the
a. level of performance expected to any evaluation
b. relative standards
c. absolute standards
d. subsets of the criteria
The approaches that have been used for program-oriented evaluation include the
following:
a. Development of taxonomies of educational objectives
b. National Performance Review
c. Aspen Institute
d. All of these
The evaluator should be aware of the following pertinent information for developing an
appropriate design. Which of the following should be considered? Evaluations should
be
a. conducted in a sequential and linear manner.
b. conducted in a flexible manner.
c. emphasizing a clear understanding of the purpose and role of the evaluator.
d. based on all theories for evaluation design.
Accreditation controversies have politicized the process of evaluating the institutions;
these have been seen in the following:
a. Which institutions should receive funding by the U. S. Department of Education?
b. Whether or not the regional accrediting association should be used as a formative
approach, rather than the summative approach used by the U. S. Department of
Education?
c. Does the assessment on student outcomes and the evaluation of faculty performance
provide sufficient evidence in the accreditation process?
d. How does neutrality of the evaluator’s affect the transparency of the process?
Direct informational uses of evaluation by policy makers, program managers, and
program staff include:
a. judging the overall value of a program and its relative value and cost compared with
competing programs.
b. examining whether the operators of a project neglected to evaluate in order appease
funding sources.
c. informing only the stakeholders who have more power about the approach
d. describing the alternate methods of evaluation
The planning stage of evaluation incorporates a systematic approach to working with all
parties. These include the following:
a. Gather data regarding the political context.
b. Describe the successes of the goals and do not emphasize the areas of weaknesses.
c. Work directly with the advisory group to establish the goals.
Which of the following are considered key steps for selecting an appropriate sampling
method?
a. Is this study a case study?
b. Which unit of interest represents a range of characteristics?
c. Is generalizing the results beyond the sample a priority?
d. All of above.
Sources of information may be categorized in the following manner:
a. Existing data found in extant evaluations and status reports.
b. Commonly used information is found in organizational policies.
c. Client involvement includes the identification of useful sources.
d. All of the above.
Strengths of the participatory approaches emphasizes the
a. increase understanding of the process.
b. use of evaluation by stakeholders
c. increasing understanding of the programs and organization development
d. all of them.
Evaluators use the logic models for the following purpose, which include
a. assisting program staff to articulate how the program may achieve its goals
b. formalizing the elements of evaluation for a long period of time
c. building capacity in terms of understanding evaluation.
d. enhancing the ability to think critically.
Timing of evaluation reports may vary and may be guided by a series of
communication, which is given to the stakeholders. These may be called
a. scheduled interim reports
b. unscheduled interim reports.
c. final reports
d. all of the above.
Collecting evaluative information requires the evaluators to view the methods used and
to understand the criteria for the method. One must understand the following:
a. Interpreting results and draw evaluation conclusions
b. Collecting the information
c. Analyzing the information
d. Developing procedures for collecting information
Evaluation standards do the following:
a. Assist the design of the study.
b. Judges the quality of the particular evaluation.
c. Informs the public for further evaluation studies.
d. All of the above
The planning used in the divergent phase has this progression:
a. needs assessment, process, outcomes
b. context, monitoring, outcomes
c. a, b
d. none of the above
Paul Duignan presented his approach to mainstreaming evaluation. Which are
considered the elements?
a. Eliminate roles for internal and external evaluators.
b. Promote one meta-approach to evaluation not many approaches.
c. Use a set of evaluation terms that emphasizes that evaluation takes place across a
program’s life cycle.
d. Demystifies evaluation.
Which one of the following is considered to be prominent in a responsive evaluation?
a. Communicate with stakeholders
b. Identify program scope, data needs, and issues
c. Project outcomes or results at the beginning of investigation
d. Use one instrument for all observers
Donaldson prescribes the steps for theory development, which includes some of the
following:
a. Engage relevant stakeholders
b. Develop more than one draft of program theory
c. Consult with existing research and evaluations that are relevant to the theory
d. Examine the program theory critically to link with the outcomes.
Quasi-experimental designs exemplify the following characteristics:
a. trends for change
b. compare two groups
c. uses existing data only
d. all of above.
The planning stage of evaluation identifies criteria or factors to judge the program
success through the use of
a. formative evaluation.
b. summative evaluation.
c. critical analysis.
d. observations only.
Decision-oriented evaluation approaches is considered a
a. systems approach to the stages of program development.
b. method that identifies the information needs of the primary uses.
c. performance monitoring method that incorporates this evaluation approach.
d. all of these.
Objectives-oriented approach is used by many school districts in curriculum review
process. The components of this approach includes the following:
a. Purposes of the goals are specified.
b. Evaluator works with all stakeholders.
c. Outcomes are determined on the use of the program.
d. All of these
Evaluators take the following steps in completing the evaluation process. Which of the
following is included in the process?
a. Interpret results and draw evaluative conclusions
b. Collect and analyze the information
c. Determining the appropriate conditions for collecting information
d. All of the above
Which of the following areas are important for the evaluators to understand when an
evaluation is initiated?
a. Resources
b. Purpose
c. Users and use
d. All of the above.
There are many different data sources and methods that are used in an evaluation.
Evaluators may select the source and methods, which have the following
characteristic(s)?
a. Dependent on the nature of the evaluation question
b. Context of the program
c. Nature of credible evidence for stakeholders and clients
d. All of the above
Evaluation has emerged in many forms through the years. Which one is considered a
true statement?
a. Sixty different proposals appeared from 1960-1990.
b. These proposals were implemented with varying degrees of fidelity.
c. There is no dominant evaluation theory or approach that has agreement.
d. All of these
What are the factors that influence evaluation today?
a. Evaluations need to consider and build cultural competence.
b. There is a growing awareness that evaluators must understand the culture for their
program.
c. Building evaluation capacity is essential for an organization.
d. All of these.
The planning stage of evaluation is important because there is
a. an identification of stakeholders.
b. an identification of the intended users.
c. an identification of the audiences.
d. all of the above.
Modern-day approaches to evaluation were
a. subjective evaluation.
b. expertise-oriented.
c. consumer-oriented.
d. all of these
The functions that are common to evaluations include
a. information collecting.
b. organization.
c. analysis.
d. reporting.
Which of the following are considered purposes of evaluation reporting and reports?
a. Demonstrating accountability
b. Bringing an issue to the attention of others (agenda setting)
c. Exploring and investigating problems
d. All of the above
The different approaches to evaluation are considered to be (Mark all that are true
statements)
a. natural.
b. able to stand alone as one approach only.
c. combined with other approaches
d. needs to be synthesized.
Which are key aspects on the impact of program evaluations?
a. Improve individuals
b. Improve policy
c. Improve decision-making
d. Improve programs