To classify the different evaluation approaches, which of the following factors guide the
research?
a. Use of participatory evaluation to promote stakeholders’ participation.
b. Provide information to improve the quality of decisions that impact programming.
c. Design questions that focus on the objectives, standards and theory.
d. Focus on the quality of the project that is being assessed.
Bradley Cousins coined the term P-PE for Practical Participatory Evaluation and is
supported by the following research:
a. Communication, contact and collaboration is primary between evaluators and
primary stakeholders.
b. Evaluators need to concentrate on the use of a particular study to provide results.
c. Organizational culture has links to how stakeholders think and evaluate.
d. Knowledge is constructed through preconceived research practices.
In the comparison between expertise-oriented and consumer-oriented approaches,
which is considered a true statement?
a. Expertise-oriented approach has the contribution because it articulates criteria using
checklists.
b. Consumer-oriented approach uses checklists and formative-summative methods.
c. Scriven is a researcher who is associated with expertise-oriented approach
d. Eisner is a researcher who is associated with consumer-oriented approach.
Educational, social and private sector programs have developed
a. methods for evaluation that have proven effective for their forecasting goals.
b. full fledged evaluation training for leaders.
c. evaluation systems that have had rapid growth during the past four decades.
d. sophisticated evaluation systems as compared to professions in law or accounting.
Expertise-oriented approach is
a. seen in the evaluation the merits of an institution.
b. used by educational administration in their training of principals.
c. used by a team of experts who complement each other in this process.
d. all of these
The American Evaluation Association’s Guiding Principles state that evaluators should
a. allow all governmental agencies to review the evaluation.
b. discuss the strengths and limitations of the evaluation process.
c. communicate the approaches that were used.
d. All of the above
Evaluators stressed that context and values are very important in the Constructivist
Paradigm. This paradigm had the following approach:
a. One setting may differ from another in terms of education, social, or economic
programs.
b. Researchers focus on understand our world which the multiple realities or
experiences of stakeholders.
c. Evaluation results stress an understanding of a specific program rather than a set of
laws or theories.
d. All of these
Traditional stakeholder-based evaluations is different from participatory evaluation in
that
a. evaluators work in partnership and shares decisions regarding the evaluation.
b. evaluators work in large groups of stakeholders to portray their views and
perspectives.
c. stakeholders have limited input in the study.
d. evaluator includes the partial involvement in only a few stages.
Evaluability assessment was decided to meet the following criteria:
a. Defined goals and priority information
b. Plausible program objectives
c. Funded resources for the evaluation
d. Diverse agreement on the intended use
An increasingly popular method of obtaining qualitative information from a group of
individuals is the focus groups. How did this method evolve?
a. Emerged from the field of marking
b. Developed through use of determining needs assessment and monitoring studies for
formative evaluations
c. Suggested new methods that pose problems with existing programs.
d. All of the following.
Greene describes the following stakeholders:
a. Decision-makers
b. Administrators
c. Intended beneficiaries
d. Community representatives within a geographical area
Summarizing an evaluation plan includes which of the following component(s)?
a. Evaluation question
b. Sampling
c. Interpretation procedures
d. Analysis procedures
The evaluator in the Naturalistic approach has the following role:
a. Responding to the perspective of the members
b. Being able to manipulate or control the process
c. Understand the process of outcomes.
d. Compares the observations to the structured framework for evaluation.
How would use assess the importance of evaluation and understand its limitations?
a. Citizens look for evaluation for accountability and believe in the accuracy of the
results.
b. Policymakers and decision makers use evaluation for shared decision-making with
their constituents
c. Stakeholders will understand a new of thinking and reasoning which encourages
innovation and experimenting in our society.
Kirkhart’s integrated theory discusses the following pathway, which will influence
process. Which are the components included in this pathway?
a. Evaluation findings
b. Minority Group Influence
c. Agenda Setting
d. Opinion Elaboration
Evaluators determine the approach based
a. upon previous experience.
b. on the context to which the evaluation is conducted.
c. his/her professional expertise.
Understanding the Program Evaluation Standards, the evaluator would need to know
about
a. utility.
b. feasibility.
c. propriety.
d. accuracy.
The term, “politics”, implies there
a. is a science with government.
b. are guiding or influential policies that are created by government.
c. is a holistic approach to understand the complexities and relationships between
people in society.
d. all of these
Brinkerhoff and colleagues (1983) developed a set of useful questions for the planning
stages for evaluation report. Which of the following applies?
a. Are report audiences defined as program managers, school principal, or faculty?
b. Are report audiences sufficiently comprehensive in their definition?
c. Will the evaluation report be balanced in the information presented?
d. Will the report plan be always responsive to all stakeholders?
Scriven’s criteria included the following necessary items:
a. Need, Market
b. Performance-True field trials
c. Technology support
d. Cost-effectiveness
Cultural competence is important to evaluation. Which of these reasons are true?
a. Identify the issues of concern to stakeholders.
b. Consider one perspective which is credible evidence of program success.
c. Increase the legitimacy, including those that are skeptical of evaluation and methods.
d. To give power and opportunities to improve social equity and democratic values.
The evaluation plan should follow the steps in the development of a design. Which are
appropriate for this design?
a. Select a design, which identifies appropriate sources of information.
b. Determine appropriate conditions for collecting information and methods/techniques.
c. Specify how the evaluation will be conducted.
d. Establish evaluation agreements and contract.
The commonality in participant-oriented approaches in evaluation:
a. Evaluators have a common goal,
b. The use of stakeholders provides ownership to the process.
c. There are common methods that are implemented to gather data.
d. All of these.
The implications of evaluation as a political activity emphasized that
a. evaluation was influenced by the public forces of society.
b. evaluators had to be concerned about the training and the methods that were used.
c. scholarly disciplines are present in social sciences and psychology.
d. all of these
The roles of the evaluators are varied depending upon the project and the stakeholders.
They may act as a facilitator or collaborator or stimulator of dialogue among diverse
groups. Which skills are important to the evaluator?
a. Managerial
b. Relationship-building with clients
c. Being an outside expert for a project
d. All of these
The consumer-oriented evaluation approach relies on experts to
a. to determine the merit or worth of a product, program, or policy
b. to judge the quality of something.
c. make their decision based upon the direct audience they serve.
d. all of the above.
Informal and formal evaluation form a continuum of judgment, which may include
more than methods and rules. As a program evaluator, one must focus on which of the
following elements:
a. judgments of previous instructors
b. structured framework to analyze the data
c. private interpretations based upon experience
d. past practice
The evaluation plan should follow the steps in the development of a design. Which are
appropriate for this design?
a. Select a design, which identifies appropriate sources of information.
b. Determine appropriate conditions for collecting information and methods/techniques.
c. Specify how the evaluation will be conducted.
d. Establish evaluation agreements and contract.
Program evaluation has had a powerful impact on organizational learning because
a. this method would enhance capacity to build their knowledge base and investigate
methods for forecasting goals.
b. this built a foundation for history, where goals and objectives were stable.
c. it kept the logical steps in having members follow the “way it was!”
Information categories are
a. status reports.
b. existing data.
c. Institutional Review Boards.
d. policies that restrict information sources.
Evaluators recognize the importance of having training in methods within their
discipline. Which of these traditions are tied to the intellectual contexts for evaluation?
a. The policy influence tradition discusses funding options only.
b. The experimental tradition concentrated on research beyond the laboratory setting.
c. The case/context tradition is firmly rooted in testing and assessment.
d. All of these.
Evaluators who informally assess programs can be influenced by several factors, which
include
a. experience and judgment
b. reasoning and generalization
c. experience, judgment, reasoning, and generalization
d. intuition and guesses
Surveys may be used when the number of sources is too large for cost effective
interviewing. Common uses include the following:
a. Survey of intended target audiences to learn about the knowledge, behaviors or skills.
b. Survey of family members to learn about program outcomes
c. Survey of program deliverers to learn about how program is implemented
d. Survey of participants upon completion of the program