Analyzing Mixed Methods Articles (Worksheet)
Phillip Olt
Read your assigned mixed methods article, and then work through the questions below. If describing something specific from the article, you must identify / quote it with a page number citation (not just “yes”).
Example
Question 6: Did the findings / results directly answer the research questions? Were they clearly presented so that you thoroughly understood them? How so, or how not?
Answer: That question is difficult to answer, because the authors did not include their research questions in this study. They loosely articulated a purpose (“…to understand teachers’ perceptions of delivering state standardized tests…” on p. 213), and they did not seem to answer that question. Their “Findings” section, however, did not seem to clearly address that. Their findings were organized under the headings “Anxiety about Financial Stability” (p. 215), “Anger at Administration” (p. 215), and “No Time for Teaching” (p. 217). Some of that content did seem to reflect upon delivering standardized tests, but much of it did not. Now, reading each of those sections was clear to me. They included simple data tables with descriptive statistics and then some quotes from participants to illustrate those numerical findings.
1. Did the author(s) provide an introduction to their article (even if there is no heading labeled “Introduction;” note the abstract is not an introduction)? If so, did it effectively introduce the reader to topic and hook the reader to continue reading? How so, or how not?
[Insert Response Here]
2. Did the author(s) provide a review of the literature (even if it is not named as such in a heading)? If so, was it timely (i.e. majority of citations from within 5 years of publication)? Did it prepare the reader to understand the major topics of the study / findings and/or establish a gap in the literature addressed in this study? How so, or how not?
[Insert Response Here]
3. What approach to mixed methods research did the author(s) use to study their topic (exs. explanatory sequential, concurrent)? Did the author(s) present at least three clear research questions (quantitative, qualitative, and a mixing question)? Did the approach to research align with those research question(s)? How so, or how not?
[Insert Response Here]
4. Describe the participants in this study. How were they selected? Are they appropriate and adequate for addressing the research questions? How so, or how not?
[Insert Response Here]
5. What were the methods of data collection, and how did the author(s) use them in this study? How did the author(s) analyze the data?
[Insert Response Here]
6. How did the author(s) address the quality and integrity of the article (exs., validity, reliability, significance, trustworthiness)?
[Insert Response Here]
7. Did the findings / results directly answer the research question(s)? Were they clearly presented so that you thoroughly understood them? How so, or how not?
[Insert Response Here]
8. Did the discussion / conclusion include applications for theory, research, and/or practice? If so, do you believe they were appropriate? Why, or why not?
[Insert Response Here]
9. What did you learn from the content of the article, and how could that be applied to your current or future desired professional situation?
[Insert Response Here]
10. Rate the author(s)’ methodology as a whole number from 1 (horrible) to 5 (awesome) and explain why.
[Insert Response Here]