Chapter_7 Experimental_and_Quasi_Experimental_Designs
1. Experimentation is an approach to research best suited for exploration.
a. True
b. False
2. The defining feature of an experiment lies in the control of the independent variable by the experimenter.
a. True
b. False
3. The independent variable in a classical experiment must be a ratio level variable.
a. True
b. False
4. In the classical experiment subjects are measured on the independent variable before the experiment begins and
again after the dependent variable has been manipulated by the researcher.
a. True
b. False
5. The main reason that experiments in criminal justice are so easy to complete is that the researcher need only secure
one experimental and one control group for any project.
a. True
b. False
6. The threat of is a concern any time the researcher begins with subjects who exhibit extreme values on the dependent
variable.
a. True
b. False
7. Construct validity is concerned with the ability to generalize from the results of the experimental group to the control
group.
a. True
b. False
8. There may be legal reasons why randomization cannot be used in criminal justice research to assign subjects to
either a control group or an experimental group.
a. True
b. False
9. In case-oriented research a large number of cases are examined in order to understand a small number of variables.
a. True
b. False
10. While the interrupted time series can be used in cause-and-effect studies, it is really useless in applied studies.
a. True
b. False
11. How many attributes does a dichotomous variable have?
a. 0
b. 1
c. 2
d. 4
12. Which of the following is least accurate?
a. experimentation is appropriate for hypothesis testing
b. experiments are well suited to research involving well-defined concepts
c. experiments cannot be used in the study of criminal justice policy because they require a hypothesis to test
d. experiments are appropriate for evaluation research
13. Which of the following is not a central feature of the classical experiment?
a. variables
b. time order
c. concepts
d. groups
14. Which of the following is true concerning independent and dependent variables in classical experiments?
a. a variable can be an independent in one experiment and a dependent in another
b. once a variable is designated as an independent variable in one experiment, it can never be used as a
dependent variable in another
c. a classical experiment examines the effect of a dependent variable on an independent variable
d. an independent variable in a classical experiment is viewed as the effect because it is dependent upon another
variable
15. Researchers conduct experiments copiously in an attempt to develop a more generalized understanding about:
a. criminal behavior
b. the sciences
c. the world we live in
d. human behavior
16. Social science researchers use a control group that hasn’t received the experimental stimulus in order to do what?
a. to measure the effect of the independent variable upon the control group
b. as another measure of the effect the independent variable has upon the dependent variable in the experimental
group
c. as another measure of the effect the independent variable has upon the dependent variable in the control
group
d. to measure the effect of the dependent variable upon the independent variable in the control group
17. Which of the following statements is accurate?
a. to guard against the “Hawthorne effect” in medical research scientists will give a placebo to the experimental
group
b. to guard against the “Hawthorne effect” in medical research scientists will give the experimental group the
independent variable
c. to guard against the “Hawthorne effect” in medical research scientists will give a placebo to the control group
d. there is no way to guard against the “Hawthorne effect” in medical research
18. The first decision for selecting subjects for an experiment is:
a. deciding how particular members of the target population will be selected
b. deciding on the target population
c. threats to internal validity
d. threats to external validity
19. Which example below is not a random assignment to experimental groups?
a. assign numbers to subjects, put corresponding numbers in a hat and pull out numbers, place the first subject in
the experimental group and the second subject in the control group and continue until all numbers are used
b. ask subjects whether they prefer to be in the experimental group or the control group then assign subjects
based on their preference
c. flip a coin assigning subjects getting a head to the control group and those getting a tail to the experimental
group
d. use a random number generator after assigning numbers to your subjects
20. Which of the following phrases is most true concerning random assignment to groups?
a. “all other things being equal”
b. “use your best guess”
c. “it is close enough for government work”
d. “you are never 100% sure, so don’t worry about it”
21. Which of the following is not considered a threat to internal validity in an experimental design?
a. maturation
b. instrumentation
c. randomization
d. statistical regression
22. Which of the following is not an accurate example of threats to internal validity of experiments?
a. subjects dropping out of an experiment is a form of mortality
b. creaming is a form of selection bias
c. control group members work harder as a form of compensatory rivalry
d. ability to measure subjects consistently over time
23. Shortening the time between pretest and posttest or perhaps even offering cash payments to participants in an
experiment are techniques that may be used to:
a. limit diffusion
b. decrease experimental mortality
c. decrease the effects of instrumentation
d. control threats to testing
24. Two dimensions to generalizability are:
a. construct validity and external validity
b. compensatory rivalry and external validity
c. construct validity and compensatory rivalry
d. none of the above
25. Experimentation is best suited for hypothesis testing in:
a. explanatory studies
b. evaluation studies
c. physical studies
d. both explanatory and evaluation studies
26. Which of the following is accurate?
a. threats to internal validity are increased by carefully controlling conditions
b. threats to external validity are decreased by carefully controlling conditions
c. threats to generalizability of research findings in experiments are unrelated to internal validity
d. threats to external validity are increased by carefully controlling conditions
27. When using a nonequivalent-groups design the researcher will handle subject assignment to groups by:
a. random assignment to experimental and control groups
b. allowing subjects to pick which group they want to be in
c. matching subjects in the experimental group to those in the comparison group.
d. assignment by convenience
28. In Widom’s study of the effects of child abuse and its impact upon later criminal offenses, she selected a sample of
children with court records of being abuse victims and gathered a comparison group that was matched on gender,
race, age and socioeconomic status. The technique used in this case was:
a. individual matching
b. aggregate matching
c. randomization
d. all of the above
29. A group of students who completed a research methods class at the local college were given a questionnaire to
assess their feelings about the homeless and after were randomly assigned to either the experimental group or the
control group. The experimental group was required to volunteer at the local homeless shelter while the control group
was not. After one month of volunteering, members of both groups were asked to complete the questionnaire on
feelings concerning the homeless again. What type of research design is this?
a. a quasi-experimental design
b. a classical experimental design
c. a time–series design
d. an interrupted time-series design
30. Graduates majoring in criminal justice and graduates majoring in psychology from the State University were part of a
study to assess employment success of those receiving their degrees in May 2002. Six months after graduation a
questionnaire was sent out asking about their job seeking success. What type of design is this?
a. a double–blind experiment
b. a non-equivalent groups design
c. a time–series design
d. a cohort design
31. Essentially, an experiment examines the effect of:
a. the world we live in
b. modern science
c. an independent variable on a dependent variable
d. science on sociology
32. The threat of history refers to:
a. some subjects with have had history classes and others not
b. the realization that some subjects have learned from history while others have not
c. events external to the experiment that will impact the results
d. the fact that only current, relevant subjects need be studied
33. Maturation as a threat to internal validity in experiments refers to:
a. some subjects are older than others
b. as people grow and change, results can be impacted
c. only subjects over the age of 21 are mature enough to be part of an experiment
d. none of the above
Chapter_7 Experimental_and_Quasi_Experimental_Designs
34. In an experiment subjects are given a pre-test in an effort to assess their attitudes about a new federal sentencing
law that Congress is debating. Subjects assigned to the experimental group are given a series of lectures by experts
on the impact the new law will have on prison populations. Immediately after the last lecture, a post-test is given to
measure any attitude changes. Anticipating what the test is designed to measure (because of the lectures) those in
the experimental group are subject to the threat of:
a. diffusion
b. statistical regression
c. instrumentation
d. testing
35. Which of the following would be an example of selection bias?
a. volunteers
b. random assignment to experimental and control groups
c. matching on experimental and comparison groups
d. making sure that the quotas are the same for the experimental and comparison groups with respect to
important variables
36. Which of the following would be an example of experimental mortality?
a. a subject deciding that he/she wants to participate
b. inmates in an experiment at the state maximum security prison being moved to a minimum state prison
c. police officers within one year of retirement participating in a job satisfaction study
d. police officers change their behavior during a study because of a new law that was passed
37. Sometimes it is not possible to separate subjects from experimental and control groups and the result is that they may
discuss the research. What is the threat that this situation poses?
a. causal time order
b. experimental mortality
c. diffusion or imitation of treatments
d. statistical regression
38. The threat to the internal validity of an experiment that is called compensatory treatment refers to which of the
following situations?
a. the control group subjects being paid while the experimental group subjects are not
b. the experimental group subjects being paid while the control group subjects are not
c. the subjects in the control group feel deprived of something they consider valuable
d. there is no threat to internal validity called compensatory treatment
39. You have just completed the LSAT and scored 112. Your roommate who is no smarter than you took the LSAT
with you and scored 165. You were so upset with your score that you decided to take the test again and you
convinced your roommate to take it with you for moral support. You both received scores on the second exam of
150. What accounted for the differences in scores?
a. statistical regression
b. testing
c. instrumentation
d. maturation
40. The goal of the classical experiment is for the researcher to:
a. have control over the dependent variable
b. have control over the independent variable
c. measure the effect the dependent variable has upon the independent variable
d. make sure the subjects in the control group get the independent variable and those in the experimental group
do not
41. When neither the subjects nor the researcher can identify which group is the control group and which is the
experimental group the design is said to be:
a. cross-sectional
b. double–blind
c. a blind experiment
d. of no value
42. In criminal justice experiments, what serves as a guard against the effects of the experiments themselves as well as
events that may occur outside the laboratory during the course of experiments?
a. variable groups
b. control groups
c. administrative groups
d. posttest groups
43. External validity in an experimental design refers to:
a. the researcher’s ability to be sure that they are measuring what they think they are measuring
b. the lack of concern with issues internal to the study
c. the ability to apply findings to other populations
d. the ability to know your measures are consistent
44. Dr. Smith was interested in whether there would be a reduction in the number of crimes in the central city once
closed-circuit cameras went up and were monitored by police. To accomplish this study Dr. Smith looked at the
police records for the four square block area where the cameras were installed each week for six months. Dr. Smith
was using what method?
a. cohort design
b. time–series design
c. classical experiment
d. quasi-experimental design
45. To assess the impact of child abuse upon later criminality, Dr. Rose chose to select some adults whose names
appeared as child abuse victims in local police records and another group of adults who were not victims of abuse.
What technique is being employed?
a. cohort design
b. classical experiment
c. double-blind experiment
d. nonequivalent-group design
46. In social scientific experiments, as in medical experiments, the danger of experimenter bias is further reduced to the
extent that the operational definitions of the dependent variables are:
a. clear and precise
b. controlled
c. tested and retested
d. scientifically proven
47. What type of design is illustrated in the following diagram?
Experimental Group 0 X 0
Control Group 0 0
Measurement time1 time2 time3
a. time–series design
b. classical experiment
c. cohort design
d. nonequivalent-groups design
48. What can help rule out the threats to internal validity in an experimental design?
a. proper selection and assignment of subjects to groups
b. large sample size
c. small sample size
d. nothing can rule out threats to internal validity
49. What technique can be used to help reduce the threat to experimental mortality?
a. increasing the sample size
b. decreasing the sample size
c. shorten the time between the pretest and the posttest
d. select only subjects who are female
50. What process is accomplished by assigning the odd numbered subjects to the experimental group and the even-
numbered subjects to the control group?
a. basic scientific theory
b. independent relation
c. false positive evaluation
d. random assignment
51. If randomization is not possible, what should the researcher do?
a. pre and posttest
b. use the classical design
c. consider using a quasi-experimental design
d. randomization is always possible
52. The central features of what experiment type include (1) independent and dependent variables, (2) pretesting and
posttesting, and (3) experimental and control groups created through random assignment?
a. casual experiments
b. statistical experiments
c. classical experiments
d. cardinal experiments
53. How does a cohort design differ from other quasi-experimental designs?
a. the use of random assignment to control and experimental groups
b. the use of matching to assign subjects to control and experimental groups
c. there is some date or event in common to all members of the control and the experimental groups
d. all quasi-experimental designs are basically the same
54. An interrupted time-series design can be very useful in what type of research?
a. applied research
b. exploratory research
c. descriptive research
d. double–blind research
55. Which is accurate concerning the interrupted time-series design?
a. some event stops or interrupts the research
b. control group subjects are often envious of the attention the experimental group subjects get and interrupt the
study
c. makes a long series of observations before and after introducing the experimental treatment
d. none of the above are accurate
56. A questionnaire is sent to 1,000 police departments in Florida and gathers information on the number of sick days
officers use after being involved in a shooting incident. This is an example of what type of research?
a. variable-oriented research
b. case-oriented research
c. experimental design
d. cohort design
57. The statement, ‘there are no simple formulas for designing an experimental or quasi-experimental study’ suggests:
a. that there is an infinite variety of ways to design a study
b. that there is a finite variety of ways to design a study
c. that the one constant is the use of randomization in experiments
d. experiments and quasi-experiments should be used only as a last resort
58. To guard against most threats to internal validity in the classical experiment the researcher should:
a. focus upon external validity
b. focus upon generalizability
c. use random assignment
d. put subjects only in experimental groups
59. Which of the following statements is true?
a. non–equivalent-groups and time-series designs are two general types of quasi-experiments
b. experiments and time-series designs are two general types of quasi-experiments
c. all research purposes are amenable to the use of experimental designs
d. all of the above are true
60. The classical experiment makes it possible to satisfy this criterion for cause in two ways. First, the posttest measures
for the experimental group (stimulus present) are compared with those for the:
a. control group (stimulus not present)
b. random group (stimulus not present)
c. variable group (stimulus not present)
d. none of the above
61. Which of the following is not illustrative of the case study method?
a. it is an in-depth analysis of one or a few cases
b. the cases can be individuals, groups, organizations or aggregates
c. the study can be both qualitative and quantitative
d. observing a group who has similar cases in the court systems
62. In general, testing refers to changes in how subjects respond to measurement, whereas instrumentation is concerned
with:
a. the world we live in
b. changes in the measurement process itself
c. the scientific hypothesis
d. the motive for the experiment itself
63. When it is not possible to create groups through randomization, what options do you have for the research design?
a. a classical experiment
b. non–equivalent groups
c. surveys
d. pre and post tests
64. In the case where the experimental groups and the control groups are not equivalent, which of the following should
not be used to address this issue?
a. proceed with the experiment because you can address the issues during your statistical analysis
b. match the groups on important variables
c. use comparison groups instead of control groups
d. match groups on any variables that are significant for the fluctuation in the dependent variable
65. With regard to experimentation and subject selection, what does random assignment serve to eliminate?
a. systematic bias
b. false positive results
c. experimental morality
d. ambiguity
66. All but which of the following are examples of double–blind studies?
a. medical experiments where a new drug is tested and one group gets the new drug and the other gets a
placebo and the researcher does not know who got which drug
b. domestic violence studies where intervention is designed to reduce repeat offenses by focusing upon victim
strategies when the victim does not know whether they are in the control or experimental group
c. any study where the researchers and the subjects do not know whether they are in the experimental or control
groups
d. any study where the researchers know who is in the experimental and control groups but promise not to tell
the subjects
67. One threat to internal validity in criminal justice research that is not very significant is
a. history, because few things happen on a grand scale that would impact criminal justice research
b. maturation, because criminal justice subjects are not in research studies long enough to mature
c. statistical regression, because subjects in the criminal justice system are likely to score lower than the mean
anyway
d. the concern about the publication of the findings
68. How can a researcher be sure that threats to internal validity are being ruled out in the design?
a. sorting out what threats are applicable in which settings
b. comparing the results of several post-tests
c. random selection will rule out, or greatly reduce the chances for statistical regression
d. all the above
69. Which of the following would not be likely to impact a study’s external validity?
a. do research in the natural setting
b. experiments where there is too much control of conditions
c. using an unrepresentative sample
d. applied studies reduce external validity
70. In Martin Gill’s research on the effectiveness of CCTV projects in the UK, which of the following techniques did he
use?
a. the research measured fear of crime by citizens before and after the cameras went up
b. the research measured police data before the cameras went up
c. comparison was made only in the area where cameras were in use
d. measured if the offenders changed the type of crimes they were committing
71. In a classical experiment the independent variable is the cause and the dependent variable is the
____________________.
72. In a classical experiment the researcher uses a to offset the effects of the experiment
itself.
73. The mere fact that subjects know they are being studied can cause them to change their behavior. This phenomenon
is known as the ____________________.
74. A(n) experiment guards against experimenters’ tendency to prejudge results by
eliminating the possibility of either the researcher or the subjects knowing which group is the control and which group
is the experimental.
75. The main reason why is used to select subjects for control and experimental groups in a
classical experiment is that the groups will be statistically equivalent.
Chapter_7 Experimental_and_Quasi_Experimental_Designs
76. validity becomes an issue when findings are based on small samples of cases.
77. With respect to internal validity issues, testing refers to changes in how subjects respond to measurement while
refers to changes in the measurement process itself.
78. When referring to whether results from experiments conducted in one setting would be obtained in other settings, our
main concern is one of validity.
79. When random assignment to experimental and control groups is not possible the researcher may be forced to use
a(n) ____________________ design.
80. Instead of making one pre-test and one post-test measure the makes a longer series of
observations before and after introducing an experimental treatment.
81. When there is a study of a large number of variables that are associated with a small number of cases or subjects,
the researcher is engaged in ____________________ research.
82. An example of variable-oriented research is the design.
83. Accidental spillover of an experimental stimulus to the control group is an example of treatment
____________________.
84. Creaming, or skimming the best, risks off the top to be incorporated in an experiment, is a threat to
____________________.
85. refers to the ability to take findings from an experiment and apply them to the real world.
86. Explain why experimentation is not well suited for the purposes of description and exploration.
87. Explain the classical experiment in terms of the following:
-Independent and dependent variables
-Pre-testing and Post-testing
–Experimental and Control groups
88. Explain the role of randomization in classical experiments.
89. Identify and discuss at least five threats to internal validity in experimental designs. Include in your answer ways of
controlling for each of the threats you identify.
90. Give two specific examples of research where a quasi-experimental design would be more appropriate than a
classical experiment. Why would each of your examples not fit the classical experiment model?