1
Chapter 19 Mixed Methods Research: Integrating Qualitative and Quantitative
Methods
Suggested Activities
1. To familiarize students with mixed-methods research consider the abstracts from examples of
recent mixed-methods studies. Handout 19.1 provides example abstracts with references to
use. Answers for those provided are found below. As an in-class exercise, group students in
pairs or small groups and allow them to select one of the abstracts and answer the following:
a. State the perceived purpose of the study.
b. Based upon the abstract would you expect that the study as conducted is QUAL-quan or
QUAN-qual? Provide a rationale for your answer.
c. List one data source that is likely quantitative and one data source that is likely
qualitative.
Student answers will likely be more elaborate than the brief answers below. I have used this
exercise and with abstracts such as these that are pretty clear, it usually takes 15-20 minutes if
your students work in small groups and then you briefly review each abstract as an entire
group.
Kemker, Barron, & Harmes (2007).
a. State the perceived purpose of the study.
b. Based upon the abstract would you expect that the study as conducted is QUAL-
quan or QUAN-qual? Provide a rationale for your answer
c. List one data source that is likely quantitative and one data source that is likely
qualitative.
Ross, McDonald, Alberg, & McSparrin-Gallagher (2007)
a. State the perceived purpose of the study.
2
b. Based upon the abstract would you expect that the study as conducted is QUAL-
quan or QUAN-qual? Provide a rationale for your answer.
c. List one data source that is likely quantitative and one data source that is likely
qualitative.
Sammons, P., Day, C., Kington, A., Gu, Q., Stobart, G., & Smees, R. (2007)
a. State the perceived purpose of the study.
b. Based upon the abstract would you expect that the study as conducted is QUAL-
quan or QUAN-qual? Provide a rationale for your answer.
c. List one data source that is likely quantitative and one data source that is likely
qualitative.
Sorensen, P., Twidle, J., Childs, A., & Godwin, J. (2007)
a. State the perceived purpose of the study.
Very generally, the purpose of the study is to examine Internet use by teachers in
3
b. Based upon the abstract would you expect that the study as conducted is QUAL-
quan or QUAN-qual? Provide a rationale for your answer.
c. List one data source that is likely quantitative and one data source that is likely
qualitative.
2. To support the Chapter 19 content, have the class read and discuss in class the following article:
Achinstein, Ogawa, & Speilgman (2004). The content of the article is of interest to many because
it includes policy, teacher beliefs, and teacher development. Several methods of data collection
and data reporting are included in the study. For example, among other data collected, the
researchers employed observations, case studies, and questionnaires. Findings are reported both
descriptively and through inferential analyses. Have students read the article and document the
data sources, the provided rationale if available or an implicit reason why the data source was
included, how the data were collected, and how the data were reported. Some of the data
reported relies on quantitative descriptive information that is implicit to the study design.
Encourage learners to use a matrix, such as the one shown below, to organize their reading and
their answer.
Achinstein, B., Ogawa, R. T., & Speiglman, A. (2004). Are we creating separate and unequal
tracks of teachers? The effects of state policy, local conditions, and teacher characteristics
on new teacher socialization. American Educational Research Journal, 41(3), 557-604.
Data source
Rationale
How collected
How reported
4
3. As noted in the text, action research often includes either a qualitative or mixed-methods
approach. For Chapter 19, have students work in pairs to address the following questions.
Students will need about 20 minutes. After students have answered these questions it is
beneficial to use them as class discussion not only to support Chapter 19 content but also to
provide a foundation for the use of this case for Chapter 20 activities. Possible directions and
answers for each question are provided. Your students’ responses will vary.
Please answer the following questions based upon Ellen’s case.
1. Why might Ellen want to address her issue by using a mixed-methods approach? Support
your response.
2. Generate a general research topic for Ellen’s study that uses a mixed-methods approach.
If you were Ellen, how might you approach this study?
3. Identify the quantitative data sources you would use to address this study. What research
questions would you answer and how would you analyze these data?
4. Identify the qualitative data sources you would use to address this study. What guiding
hypothesis would you use and who would you select as participants?
5. Classify your study as QUAN-qual, QUAL-quan, or QUAN-QUAL. Support your
response.
Possible responses to the above questions:
5
Please answer the following questions based upon Ellen’s case.
1. Why might Ellen want to address her issue by using a mixed-methods approach? Support
your response.
2. Generate a general research topic for Ellen’s study that uses a mixed-methods
approach.
If you were Ellen, how might you approach this study?
3. Identify the quantitative data sources you would use to address this study. What research
questions would you answer and how would you analyze these data?
4. Identify the qualitative data sources you would use to address this study. What guiding
hypothesis would you use and whom would you select as participants? Why would you
select these participants?
5. Classify your study as QUAN-qual, QUAL-quan, or QUAN-QUAL. Support your \
response.
6
4. Sage publishes the Journal of Mixed Methods Research that can serve as an excellent resource for
your course as you cover Chapter 19 content. The website can provide you with links to a free
issue if your library does not subscribe. If your students to have access to the journal, the
editorials are great to use as a foundation to extend Chapter 19 content as they often discuss
methodological issues of mixed methods. The journal is broad and includes studies from many
areas of research that your students will find interesting. One article published by Hart and
colleagues (2009) and referenced below provides a review and retrospective of ten years of mixed
methods in mathematics education. It is a nice article to use because it is a mixed method study
of mixed methods. Guided questions that can stimulate discussion are provided.
Hart, L.C., Smith, S. Z., Swars, S.L., & Smith, M.E. (2009). An examination of research
methods in mathematics education. Journal of Mixed Methods Research, 3(1), 26-41.
1. How does this article compare to other articles that you have read in research journals?
Note two observations.
2. The authors provide several definitions of mixed methods research. Which are similar
to the stance taken by your text? Are there any that seem inconsistent with the
perspective shared by your text?
3. Focus specifically on the second research purpose shared by
the authors.
As your text notes the integration and weight of mixed methods data is critical in mixed
methods designs. What do the authors conclude regarding this research focus? Do their
findings surprise you? Why or why not?
4. Having read this article, what is one ‘take home’ message you received from the authors
regarding the use of mixed methods in education?
Possible responses to the above questions:
1. How does this article compare to other articles that you have read in research journals?
Note two observations.
7
2. The authors provide several definitions of mixed methods research. Which are similar to
the stance taken by your text? Are there any that seem inconsistent with the perspective
shared by your text?
3. Focus specifically on the second research purpose shared by the authors.
4. Having read this article, what is one ‘take home’ message you received from the authors
regarding the use of mixed methods in education?
8
Chapter 19 Test Items
1. Of the following, which is a characteristic of qualitative research methods?
a. Qualitative researchers employ deductive approach.
b. Qualitative researchers describe relationships.
c. Qualitative researchers focus on cause-effect relationships.
d. Qualitative researchers identify hypothesis to test.
2. Of the following, which is a characteristic of quantitative research methods?
a. Quantitative researchers employ an inductive approach.
b. Quantitative researchers describe relationships.
c. Quantitative researchers focus on cause-effect relationships.
d. Quantitative researchers work with a “guiding hypothesis”
3. By definition, mixed-methods research designs
a. include both relationship questions and difference questions in the same study.
b. include both descriptive and inferential statistics in the analysis.
c. include both quantitative and qualitative data.
d. include a number of quantitative measures of student performance.
• 4. Of the following, which best illustrates an example of a mixed-methods study?
a. Jenka uses interviews and observations in her study of transitional students.
b. Vanda conducts observations and supplements her findings with class grades.
c. Micky uses percentages of successful transitions from the district and class grades.
d. Svec interviews both parents and their children regarding transition.
• 5. Of the following, which best illustrates an example of a mixed-methods study
that addresses selection of a major at a large land-grant university?
a. Karen uses high school grades, university grades, and scores on a career placement
survey to predict students’ major.
b. Jonna uses high school grades, SAT scores, and university placement exam scores to
classify likely success in a given major.
c. Bonnie interviews high school students about their career aspirations and follows them
through their second year of university collecting interview data every 3 months..
d. Pui-wa collects career placement survey data and conducts follow-up interviews with
a portion of the respondents selected based upon their major.
• 6. Of the following, which best illustrates an example of a mixed-methods study
that addresses homework practices and student achievement?
a. Barb conducts interviews with students and parents and examines student
standardized test scores.
b. Akasha collects PSAT scores, class grades, and end of year standardized test scores
c. Lee conducts observations of activities during a homework club and interviews
parents, teachers, and students.
d. Kareem uses SES data collected from the school, including parents’ education level,
family income, and neighborhood and student test scores.
9
7. Which of the following is a concern regarding mixed-methods studies compared to either
qualitative or quantitative research? Mixed-methods research
a. generally includes instrumentation that is deemed less reliable than other forms of
research.
b. has greater external validity threats than are found in other forms of research.
c. requires greater understanding of a broad range of research methods than other forms
of research.
d. is generally less ethical when compared to other forms of research.
8. A study that relies primarily on quantitative data and uses qualitative data to follow up is
considered an example of a(n) ___________ approach to mixed methods design.
a. triangulation
b. interpretation
c. exploratory
d. explanatory
• 9. Paola is interested in what young children pay attention to when they play online games.
She uses an eyegaze measure that gives her the location and duration of what the children
look at while playing, over time. She conducts interviews with children that seem to
display specific patterns of behavior based upon the eyegaze data. Paola’s strategy can
best be described as a(n) ______________ approach to mixed methods design.
a. interpretation
b. exploratory
c. explanatory
d. triangulation
10. A study that relies primarily on qualitative data and uses quantitative data for building is
referred to as a(n) _______________ mixed-methods design.
a. triangulation
b. interpretation
c. exploratory
d. explanatory
• 11. Hadasa conducted systematic observations of high school sports teams and coded
displays of student athlete frustration. It appeared from these observations that coaching
style might be related to athlete frustration. She conducted a self-report survey that asked
student athletes to respond regarding their degree of perceived frustration and coaching
style so she could conduct correlational analyses to further explore her question.
Hadasa’s study can best be described as a(n) _________ mixed-methods design.
a. exploratory
b. interpretation
c. triangulation
d. explanatory
12. Those studies that use quantitative and qualitative methods equally to examine a research
question are referred to as which type of mixed-methods designs?
a. Triangulation
b. Interpretation
c. Exploratory
d. Explanatory
• 13. Lisa is interested in how the general public feels about nanotechnology. She
conducts a survey through the mail and also follows up by identifying key personnel in
the community and interviewing them. Lisa’s mixed-methods study is best described as
one that employs a(n) ____________ design.
a. triangulation
b. interpretation
c. exploratory
d. explanatory
• 14. Pete is interested in the effectiveness of the new creative writing curriculum. He
observes classes using the new curriculum, interviews students and teachers about their
perceptions of the curriculum, and then examines end of year state-wide writing test
grades. Pete’s mixed-methods study is best described as one that employs a(n)
_____________ design.
a. triangulation
b. interpretation
c. exploratory
d. explanatory
• 15.-16. Tacita is interested in how teachers’ classroom management practices change over time.
She conducts observations of 8 teachers’ classrooms over the course of five years. She
interviews the teachers and follows up with counts of referral data, disciplinary notes in
children’s files, and number of notes home per teacher per year.
• 15. Tacita’s design can best be described as a __________ mixed-methods design.
a. triangulation
b. interpretation
c. exploratory
d. explanatory
• 16. Tacita’s study is also an example of a _______ research design.
a. QUAN–QUAL
b. QUAN–qual
c. QUAL-quan
d. Quantitative
17. In QUAN–QUAL research designs
a. the researcher equally weighs the two forms of data collection.
b. the researcher might supplement quantitative data with case vignettes.
c. the researcher might supplement qualitative data with questionnaire data.
d. the researcher might start with case studies and add census data.
• 18. Nancy is studying after-school programs that are housed in the district’s school
buildings. She interviews staff, students, and parents, observes programs, and reviews
school board documents that illustrate how the after-school programs developed. She
also administered a survey to enrolled children that rated satisfaction with their program.
Which type of research does Nancy’s study illustrate?
a. Qualitative research
b. Quantitative research
c. QUAL-quan research
d. QUAN–qual research
• 19. Chris is studying computer lab culture in post-secondary schools. He goes to the
local 24-hour lab and observes four times a week for an academic year. He occasionally
seeks some information from those in the lab about what they are doing via informal
interviews. Chris is best illustrating
a. qualitative research.
b. QUAL–QUAN research.
c. QUAN-qual research.
d. QUAL–quan research.
• 20. Rich is studying social competencies of hearing-impaired children. He selects
five children that he studies through observation in multiple contexts, including their
classrooms, their extra-curricular activities, and their family life. Rich is best illustrating
a. qualitative research.
b. QUAN-QUAL research.
c. QUAN-qual research.
d. QUAL–quan research.
• 21. Caelan is interested in the trading card culture in elementary schools. He has noticed
that many children go through a phase of playing with and trading cards with their peers.
He decides to more systematically observe children’s behaviors while they are given free
time. His study will be primarily observational although he may conduct follow up
informal interviews with the children and their teachers. Caelan’s study is best described
as a ___________ design study.
a. qualitative
b. quantitative
c. QUAL-quan
d. QUAN-qual
• 22. Babukar is conducting a study on children who are suspended for bringing
weapons to schools. He collects data from achievement tests, aptitude measures, and
questionnaires that consider children’s connection to school. He also conducts
interviews with suspended children, their teachers, and their parents. He interprets these
data to decide if there is a typical profile of students who are suspended for such offenses.
Babukar is best illustrating which type of mixed methods designs?
a. Triangulation
b. Exploratory
c. Explanatory
d. QUAL-quan
• 23. Marcy is interested in the achievement of low-SES high achieving females in
rural school districts. She uses measures of achievement in her analysis and tracks the
students’ grades from middle school to high school graduation. Marcy’s study is an
example of ______________ research.
a. QUAN–QUAL
b. quantitative
c. QUAL– quan
d. QUAN–qual
• 24. Brenda studies first-generation college students. She uses institutional data that
tracks these students from high-school into college until subsequent drop-out or
graduation. She uses their student grades, major, and inventories of their feelings of
success and attitudes about college. She also interviews a select number of the students.
Brenda’s study is best described as a _____________ study.
a. QUAN–QUAL
b. quantitative
c. QUAL– quan
d. QUAN–qual
• 25. In the wake of a recent school violence incident, Laura studied people’s reactions
at the school through the simultaneous use of observations, interviews, and surveys, and
triangulated these data. Laura’s research is best classified as
a. qualitative.
b. QUAN-QUAL.
c. QUAL– quan.
d. QUAN–qual.
26. The QUAN-qual model of mixed methods design is also known as
a. triangulation.
b. interpretation.
c. exploratory.
d. explanatory.
27. The QUAN-QUAL model of mixed methods design is also known as
a. triangulation.
b. interpretation.
c. exploratory.
d. explanatory.
28. The QUAL-quan model of mixed methods design is also known as
a. triangulation.
b. interpretation.
c. exploratory.
d. explanatory.
29. When researchers follow up on outliers or extreme cases with qualitative methods based
upon their quantitative data, they are employing a(n) __________ approach to mixed-
methods research.
a. triangulation.
b. interpretation.
c. exploratory.
d. explanatory.
30. When researchers obtain themes and specific statements from individuals to create new
scales and items for questionnaires, they are said to be employing a(n)
________________ approach to mixed-methods research.
a. triangulation.
b. interpretation.
c. exploratory.
d. explanatory.
31. For classification purposes, the primary differences among mixed-methods designs as
presented in your text, relates to all EXCEPT which of the following?
a. Data analysis
b. Sequence
c. Interpretation
d. Priority
• 32. Marci has collected qualitative data and survey data. She codes the qualitative
data and quantifies it and then compares these data to her survey data. Marci is best
displaying which type of mixed-methods design?
a. Triangulation
b. Explanatory
c. Exploratory
d. Descriptive
• 33. Sevil found through his study of college bound students that some high achieving female
mathematics students elect to pursue mathematics related fields and others do not
consider such fields. He conducts follow-up interviews with some of the young women
that are, and some that are not, pursuing mathematics degrees. Sevil is best displaying
which type of mixed-methods design?
a. Triangulation
b. Explanatory
c. Exploratory
d. Descriptive
• 34. Jesa is conducting a study that examines the way that school board members
make decisions. She attends and observes a number of school board meetings. After
each, she follows up with key personnel using informal interviews based upon her
observations at the meetings. She develops key themes that she thinks describe the
different factors that go into members’ decision-making. She then generates a survey
that includes these factors and asks participants to rate the relative importance of each of
these factors. Jesa’s study could best be described as
a. QUAN-QUAL.
b. Explanatory.
c. QUAN-qual.
d. Exploratory.
• 35. Jordon conducts interviews and observations at several residential camps. She
finds that the first-time camping experience seems to vary considerably based upon birth
order. She uses birth-order as a nominal variable as she analyzes her satisfaction survey
results. Jordon is best displaying which type of mixed-methods designs?
a. Triangulation
b. Explanatory
c. Exploratory
d. Descriptive
• 36. Mekeal collected achievement data and open–ended questionnaire data. He
coded the qualitative questionnaire data and used the themes to explain some differences
in the achievement data. Mekeal’s approach best illustrates a
a. quantitative study.
b. QUAN-QUAL study.
c. QUAL-quan study.
d. QUAN-qual study.
• 37. Roshia combines her qualitative and quantitative data for her study on the
relationship between extra-curricular activities and high-school students’ mental health.
In her study she conducted a test to screen students based upon their mental health. She
also surveyed participants regarding their extra-curricular activities. Roshia then
conducted surveys with those individuals who were involved in extracurricular activities
and displayed some mental health concerns. Roshia’s mixed-methods study is best
categorized as a
a. quantitative study.
b. QUAN-QUAL study.
c. QUAL-quan study.
d. QUAN-qual study.
• 38. Ms. Crabtree is conducting a study that examines time in rank for university professors of
Higher Education at teaching colleges. She collects institutional data from a sample of
teaching colleges in the Mid-Western United States. She follows that up with interviews
of representative Deans, department heads, and program directors. Ms. Crabtree’s study
can best be described as
a. Quantitative
b. Qualitative
c. Mixed-methods
d. Multi-level
• 39. In a study that examined the high-stakes assessment practices of school districts, Maria
first examined scores on the state assessment and then selected cases based upon sound
practices and conducted in-depth interviews at these district sites. This study best
illustrates which of the following approaches to research?
a. Quantitative
b. Qualitative
c. Experimental
d. Mixed-methods
• 40. Missy examined the correspondence between districts indicators of social economic
status and number of foreign language courses offered. Her study can best be described
as
a. Quantitative.
b. Qualitative.
c. Mixed-methods.
d. Experimental.
• 41. Lorrie is conducting a study that examines the benefits of gardening for stress.
She surveys community garden members regarding garden activities and administers a
self-report stress and anxiety questionnaire. She then interviews those who fit her
profiles of the 2 x 2 matrix of gardening and stress. Lorrie’s study can best be described
as
a. Qualitative
b. Experimental
c. QUAN–QUAL
d. Correlatoinal
• 42. Ron relies on observations and interviews to explore questions of the experience
of participation in a track and field meet. His study can best be described as
a. Quantitative
b. Qualitative
c. Mixed-methods
d. Multi-level
• 43. Mechteld is primarily interested in strategies that increase students’ interest and
achievement in mathematics. She administers interest questionnaires and correlates them
with mathematics achievement. She then does a few follow up interviews with those
who do not have high interest but do have high achievement. Mechteld’s study is best
classified as
a. QUAN-qual
b. QUAN–QUAL
c. Quan-QUAL
d. Quantitative
44. Dalina, a mixed-methods researcher first identifies the purpose of the study she will
conduct. Next she will
a. state the design of the study.
b. determine which data will have more weight.
c. state the research questions.
d. begin to collect initial data.
Chapter 19 Answers