how to read a qualitative research paper

- Google Chrome

Intended for healthcare professionals

Access provided by Google Indexer
My email alerts
BMA member login
Username * Password * Forgot your log in details? Need to activate BMA Member Log In Log in via OpenAthens Log in via your institution

Search form

Advanced search
Search responses
Search blogs
Critically appraising...

Critically appraising qualitative research

Related content
Peer review
Ayelet Kuper , assistant professor 1 ,
Lorelei Lingard , associate professor 2 ,
Wendy Levinson , Sir John and Lady Eaton professor and chair 3
1 Department of Medicine, Sunnybrook Health Sciences Centre, and Wilson Centre for Research in Education, University of Toronto, 2075 Bayview Avenue, Room HG 08, Toronto, ON, Canada M4N 3M5
2 Department of Paediatrics and Wilson Centre for Research in Education, University of Toronto and SickKids Learning Institute; BMO Financial Group Professor in Health Professions Education Research, University Health Network, 200 Elizabeth Street, Eaton South 1-565, Toronto
3 Department of Medicine, Sunnybrook Health Sciences Centre
Correspondence to: A Kuper ayelet94{at}post.harvard.edu

Six key questions will help readers to assess qualitative research

Summary points

Appraising qualitative research is different from appraising quantitative research

Qualitative research papers should show appropriate sampling, data collection, and data analysis

Transferability of qualitative research depends on context and may be enhanced by using theory

Ethics in qualitative research goes beyond review boards’ requirements to involve complex issues of confidentiality, reflexivity, and power

Over the past decade, readers of medical journals have gained skills in critically appraising studies to determine whether the results can be trusted and applied to their own practice settings. Criteria have been designed to assess studies that use quantitative methods, and these are now in common use.

In this article we offer guidance for readers on how to assess a study that uses qualitative research methods by providing six key questions to ask when reading qualitative research (box 1). However, the thorough assessment of qualitative research is an interpretive act and requires informed reflective thought rather than the simple application of a scoring system.

Box 1 Key questions to ask when reading qualitative research studies

Was the sample used in the study appropriate to its research question, were the data collected appropriately, were the data analysed appropriately, can i transfer the results of this study to my own setting, does the study adequately address potential ethical issues, including reflexivity.

Overall: is what the researchers did clear?

One of the critical decisions in a qualitative study is whom or what to include in the sample—whom to interview, whom to observe, what texts to analyse. An understanding that qualitative research is based in experience and in the construction of meaning, combined with the specific research question, should guide the sampling process. For example, a study of the experience of survivors of domestic violence that examined their reasons for not seeking help from healthcare providers might focus on interviewing a sample of such survivors (rather than, for example, healthcare providers, social services workers, or academics in the field). The sample should be broad enough to capture the many facets of a phenomenon, and limitations to the sample should be clearly justified. Since the answers to questions of experience and meaning also relate to people’s social affiliations (culture, religion, socioeconomic group, profession, etc), it is also important that the researcher acknowledges these contexts in the selection of a study sample.

In contrast with quantitative approaches, qualitative studies do not usually have predetermined sample sizes. Sampling stops when a thorough understanding of the phenomenon under study has been reached, an end point that is often called saturation. Researchers consider samples to be saturated when encounters (interviews, observations, etc) with new participants no longer elicit trends or themes not already raised by previous participants. Thus, to sample to saturation, data analysis has to happen while new data are still being collected. Multiple sampling methods may be used to broaden the understanding achieved in a study (box 2). These sampling issues should be clearly articulated in the methods section.

Box 2 Qualitative sampling methods for interviews and focus groups 9

Examples are for a hypothetical study of financial concerns among adult patients with chronic renal failure receiving ongoing haemodialysis in a single hospital outpatient unit.

Typical case sampling —sampling the most ordinary, usual cases of a phenomenon

The sample would include patients likely to have had typical experiences for that haemodialysis unit and patients who fit the profile of patients in the unit for factors found on literature review. Other typical cases could be found via snowball sampling (see below)

Deviant case sampling —sampling the most extreme cases of a phenomenon

The sample would include patients likely to have had different experiences of relevant aspects of haemodialysis. For example, if most patients in the unit are 60-70 years old and recently began haemodialysis for diabetic nephropathy, researchers might sample the unmarried university student in his 20s on haemodialysis since childhood, the 32 year old woman with lupus who is now trying to get pregnant, and the 90 year old who newly started haemodialysis due to an adverse reaction to radio-opaque contrast dye. Other deviant cases could be found via theoretical and/or snowball sampling (see below)

Critical case sampling —sampling cases that are predicted (based on theoretical models or previous research) to be especially information-rich and thus particularly illuminating

The nature of this sample depends on previous research. For example, if research showed that marital status was a major determinant of financial concerns for haemodialysis patients, then critical cases might include patients whose marital status changed while on haemodialysis

Maximum-variation sampling —sampling as wide a range of perspectives as possible to capture the broadest set of information and experiences)

The sample would include typical, deviant, and critical cases (as above), plus any other perspectives identified

Confirming-disconfirming sampling —Sampling both individuals or texts whose perspectives are likely to confirm the researcher’s developing understanding of the phenomenon under study and those whose perspectives are likely to challenge that understanding

The sample would include patients whose experiences would likely either confirm or disconfirm what the researchers had already learnt (from other patients) about financial concerns among patients in the haemodialysis unit. This could be accomplished via theoretical and/or snowball sampling (see below)

Snowball sampling —sampling participants found by asking current participants in a study to recommend others whose experiences would be relevant to the study

Current participants could be asked to provide the names of others in the unit who they thought, when asked about financial concerns, would either share their views (confirming), disagree with their views (disconfirming), have views typical of patients on their unit (typical cases), or have views different from most other patients on their unit (deviant cases)

Theoretical sampling —sampling individuals or texts whom the researchers predict (based on theoretical models or previous research) would add new perspectives to those already represented in the sample

Researchers could use their understanding of known issues for haemodialysis patients that would, in theory, relate to financial concerns to ensure that the relevant perspectives were represented in the study. For example, if, as the research progressed, it turned out that none of the patients in the sample had had to change or leave a job in order to accommodate haemodialysis scheduling, the researchers might (based on previous research) choose to intentionally sample patients who had left their jobs because of the time commitment of haemodialysis (but who could not do peritoneal dialysis) and others who had switched to jobs with more flexible scheduling because of their need for haemodialysis

It is important that a qualitative study carefully describes the methods used in collecting data. The appropriateness of the method(s) selected to use for the specific research question should be justified, ideally with reference to the research literature. It should be clear that methods were used systematically and in an organised manner. Attention should be paid to specific methodological challenges such as the Hawthorne effect, 1 whereby the presence of an observer may influence participants’ behaviours. By using a technique called thick description, qualitative studies often aim to include enough contextual information to provide readers with a sense of what it was like to have been in the research setting.

Another technique that is often used is triangulation, with which a researcher uses multiple methods or perspectives to help produce a more comprehensive set of findings. A study can triangulate data, using different sources of data to examine a phenomenon in different contexts (for example, interviewing palliative patients who are at home, those who are in acute care hospitals, and those who are in specialist palliative care units); it can also triangulate methods, collecting different types of data (for example, interviews, focus groups, observations) to increase insight into a phenomenon.

Another common technique is the use of an iterative process, whereby concurrent data analysis is used to inform data collection. For example, concurrent analysis of an interview study about lack of adherence to medications among a particular social group might show that early participants seem to be dismissive of the efforts of their local pharmacists; the interview script might then be changed to include an exploration of this phenomenon. The iterative process constitutes a distinctive qualitative tradition, in contrast to the tradition of stable processes and measures in quantitative studies. Iterations should be explicit and justified with reference to the research question and sampling techniques so that the reader understands how data collection shaped the resulting insights.

Qualitative studies should include a clear description of a systematic form of data analysis. Many legitimate analytical approaches exist; regardless of which is used, the study should report what was done, how, and by whom. If an iterative process was used, it should be clearly delineated. If more than one researcher analysed the data (which depends on the methodology used) it should be clear how differences between analyses were negotiated. Many studies make reference to a technique called member checking, wherein the researcher shows all or part of the study’s findings to participants to determine if they are in accord with their experiences. 2 Studies may also describe an audit trail, which might include researchers’ analysis notes, minutes of researchers’ meetings, and other materials that could be used to follow the research process.

The contextual nature of qualitative research means that careful thought must be given to the potential transferability of its results to other sociocultural settings. Though the study should discuss the extent of the findings’ resonance with the published literature, 3 much of the onus of assessing transferability is left to readers, who must decide if the setting of the study is sufficiently similar for its results to be transferable to their own context. In doing so, the reader looks for resonance—the extent that research findings have meaning for the reader.

Transferability may be helped by the study’s discussion of how its results advance theoretical understandings that are relevant to multiple situations. For example, a study of patients’ preferences in palliative care may contribute to theories of ethics and humanity in medicine, thus suggesting relevance to other clinical situations such as the informed consent exchange before treatment. We have explained elsewhere in this series the importance of theory in qualitative research, and there are many who believe that a key indicator of quality in qualitative research is its contribution to advancing theoretical understanding as well as useful knowledge. This debate continues in the literature, 4 but from a pragmatic perspective most qualitative studies in health professions journals emphasise results that relate to practice; theoretical discussions tend to be published elsewhere.

Reflexivity is particularly important within the qualitative paradigm. Reflexivity refers to recognition of the influence a researcher brings to the research process. It highlights potential power relationships between the researcher and research participants that might shape the data being collected, particularly when the researcher is a healthcare professional or educator and the participant is a patient, client, or student. 5 It also acknowledges how a researcher’s gender, ethnic background, profession, and social status influence the choices made within the study, such as the research question itself and the methods of data collection. 6 7

Research articles written in the qualitative paradigm should show evidence both of reflexive practice and of consideration of other relevant ethical issues. Ethics in qualitative research should extend beyond prescriptive guidelines and research ethics boards into a thorough exploration of the ethical consequences of collecting personal experiences and opening those experiences to public scrutiny (a detailed discussion of this problem within a research report may, however, be limited by the practicalities of word count limitations). 8 Issues of confidentiality and anonymity can become quite complex when data constitute personal reports of experience or perception; the need to minimise harm may involve not only protection from external scrutiny but also mechanisms to mitigate potential distress to participants from sharing their personal stories.

In conclusion: is what the researchers did clear?

The qualitative paradigm includes a wide range of theoretical and methodological options, and qualitative studies must include clear descriptions of how they were conducted, including the selection of the study sample, the data collection methods, and the analysis process. The list of key questions for beginning readers to ask when reading qualitative research articles (see box 1) is intended not as a finite checklist, but rather as a beginner’s guide to a complex topic. Critical appraisal of particular qualitative articles may differ according to the theories and methodologies used, and achieving a nuanced understanding in this area is fairly complex.

Journal articles

Greenhalgh T. How to read a paper: papers that go beyond numbers. BMJ 1997;315:740-3.

Mays N, Pope C. Qualitative research: Rigour and qualitative research. BMJ 1995;311:109-12.

Mays N, Pope C. Qualitative research in health care: assessing quality in qualitative research. BMJ 2000;320:50-2.

Popay J, Rogers A, Williams G. Rationale and standards for the systematic review of qualitative literature in health services research. Qual Health Res 1998;8:341-51.

Internet resources

National Health Service Public Health Resource Unit. Critical appraisal skills programme: qualitative research appraisal tool . 2006. www.phru.nhs.uk/Doc_Links/Qualitative%20Appraisal%20Tool.pdf

Cite this as: BMJ 2008;337:a1035

Related to doi: , 10.1136/bmj.a288
doi: , 10.1136/bmj.39602.690162.47
doi: , 10.1136/bmj.a1020
doi: , 10.1136/bmj.a879
doi: 10.1136/bmj.a949

This is the last in a series of six articles that aim to help readers to critically appraise the increasing number of qualitative research articles in clinical journals. The series editors are Ayelet Kuper and Scott Reeves.

For a definition of general terms relating to qualitative research, see the first article in this series.

Contributors: AK wrote the first draft of the article and collated comments for subsequent iterations. LL and WL made substantial contributions to the structure and content, provided examples, and gave feedback on successive drafts. AK is the guarantor.

Funding: None.

Competing interests: None declared.

Provenance and peer review: Commissioned; externally peer reviewed.

↵ Holden JD. Hawthorne effects and research into professional practice. J Evaluation Clin Pract 2001 ; 7 : 65 -70. OpenUrl CrossRef PubMed Web of Science
↵ Hammersley M, Atkinson P. Ethnography: principles in practice . 2nd ed. London: Routledge, 1995 .
↵ Silverman D. Doing qualitative research . Thousand Oaks, CA: Sage, 2000 .
↵ Mays N, Pope C. Qualitative research in health care: assessing quality in qualitative research. BMJ 2000 ; 320 : 50 -2. OpenUrl FREE Full Text
↵ Lingard L, Kennedy TJ. Qualitative research in medical education . Edinburgh: Association for the Study of Medical Education, 2007 .
↵ Seale C. The quality of qualitative research . London: Sage, 1999 .
↵ Wallerstein N. Power between evaluator and community: research relationships within New Mexico’s healthier communities. Soc Sci Med 1999 ; 49 : 39 -54. OpenUrl CrossRef PubMed Web of Science
↵ Mauthner M, Birch M, Jessop J, Miller T, eds. Ethics in qualitative research . Thousand Oaks, CA: Sage, 2002 .
↵ Kuzel AJ. Sampling in qualitative inquiry. In: Crabtree F, Miller WL, eds. Doing qualitative research . 2nd ed. Thousand Oaks, CA: Sage, 1999 :33-45.

Chapter 1. Introduction

“Science is in danger, and for that reason it is becoming dangerous” -Pierre Bourdieu, Science of Science and Reflexivity

Why an Open Access Textbook on Qualitative Research Methods?

I have been teaching qualitative research methods to both undergraduates and graduate students for many years. Although there are some excellent textbooks out there, they are often costly, and none of them, to my mind, properly introduces qualitative research methods to the beginning student (whether undergraduate or graduate student). In contrast, this open-access textbook is designed as a (free) true introduction to the subject, with helpful, practical pointers on how to conduct research and how to access more advanced instruction.

Textbooks are typically arranged in one of two ways: (1) by technique (each chapter covers one method used in qualitative research); or (2) by process (chapters advance from research design through publication). But both of these approaches are necessary for the beginner student. This textbook will have sections dedicated to the process as well as the techniques of qualitative research. This is a true “comprehensive” book for the beginning student. In addition to covering techniques of data collection and data analysis, it provides a road map of how to get started and how to keep going and where to go for advanced instruction. It covers aspects of research design and research communication as well as methods employed. Along the way, it includes examples from many different disciplines in the social sciences.

The primary goal has been to create a useful, accessible, engaging textbook for use across many disciplines. And, let’s face it. Textbooks can be boring. I hope readers find this to be a little different. I have tried to write in a practical and forthright manner, with many lively examples and references to good and intellectually creative qualitative research. Woven throughout the text are short textual asides (in colored textboxes) by professional (academic) qualitative researchers in various disciplines. These short accounts by practitioners should help inspire students. So, let’s begin!

What is Research?

When we use the word research , what exactly do we mean by that? This is one of those words that everyone thinks they understand, but it is worth beginning this textbook with a short explanation. We use the term to refer to “empirical research,” which is actually a historically specific approach to understanding the world around us. Think about how you know things about the world. [1] You might know your mother loves you because she’s told you she does. Or because that is what “mothers” do by tradition. Or you might know because you’ve looked for evidence that she does, like taking care of you when you are sick or reading to you in bed or working two jobs so you can have the things you need to do OK in life. Maybe it seems churlish to look for evidence; you just take it “on faith” that you are loved.

Only one of the above comes close to what we mean by research. Empirical research is research (investigation) based on evidence. Conclusions can then be drawn from observable data. This observable data can also be “tested” or checked. If the data cannot be tested, that is a good indication that we are not doing research. Note that we can never “prove” conclusively, through observable data, that our mothers love us. We might have some “disconfirming evidence” (that time she didn’t show up to your graduation, for example) that could push you to question an original hypothesis , but no amount of “confirming evidence” will ever allow us to say with 100% certainty, “my mother loves me.” Faith and tradition and authority work differently. Our knowledge can be 100% certain using each of those alternative methods of knowledge, but our certainty in those cases will not be based on facts or evidence.

For many periods of history, those in power have been nervous about “science” because it uses evidence and facts as the primary source of understanding the world, and facts can be at odds with what power or authority or tradition want you to believe. That is why I say that scientific empirical research is a historically specific approach to understand the world. You are in college or university now partly to learn how to engage in this historically specific approach.

In the sixteenth and seventeenth centuries in Europe, there was a newfound respect for empirical research, some of which was seriously challenging to the established church. Using observations and testing them, scientists found that the earth was not at the center of the universe, for example, but rather that it was but one planet of many which circled the sun. [2] For the next two centuries, the science of astronomy, physics, biology, and chemistry emerged and became disciplines taught in universities. All used the scientific method of observation and testing to advance knowledge. Knowledge about people , however, and social institutions, however, was still left to faith, tradition, and authority. Historians and philosophers and poets wrote about the human condition, but none of them used research to do so. [3]

It was not until the nineteenth century that “social science” really emerged, using the scientific method (empirical observation) to understand people and social institutions. New fields of sociology, economics, political science, and anthropology emerged. The first sociologists, people like Auguste Comte and Karl Marx, sought specifically to apply the scientific method of research to understand society, Engels famously claiming that Marx had done for the social world what Darwin did for the natural world, tracings its laws of development. Today we tend to take for granted the naturalness of science here, but it is actually a pretty recent and radical development.

To return to the question, “does your mother love you?” Well, this is actually not really how a researcher would frame the question, as it is too specific to your case. It doesn’t tell us much about the world at large, even if it does tell us something about you and your relationship with your mother. A social science researcher might ask, “do mothers love their children?” Or maybe they would be more interested in how this loving relationship might change over time (e.g., “do mothers love their children more now than they did in the 18th century when so many children died before reaching adulthood?”) or perhaps they might be interested in measuring quality of love across cultures or time periods, or even establishing “what love looks like” using the mother/child relationship as a site of exploration. All of these make good research questions because we can use observable data to answer them.

What is Qualitative Research?

“All we know is how to learn. How to study, how to listen, how to talk, how to tell. If we don’t tell the world, we don’t know the world. We’re lost in it, we die.” -Ursula LeGuin, The Telling

At its simplest, qualitative research is research about the social world that does not use numbers in its analyses. All those who fear statistics can breathe a sigh of relief – there are no mathematical formulae or regression models in this book! But this definition is less about what qualitative research can be and more about what it is not. To be honest, any simple statement will fail to capture the power and depth of qualitative research. One way of contrasting qualitative research to quantitative research is to note that the focus of qualitative research is less about explaining and predicting relationships between variables and more about understanding the social world. To use our mother love example, the question about “what love looks like” is a good question for the qualitative researcher while all questions measuring love or comparing incidences of love (both of which require measurement) are good questions for quantitative researchers. Patton writes,

Qualitative data describe. They take us, as readers, into the time and place of the observation so that we know what it was like to have been there. They capture and communicate someone else’s experience of the world in his or her own words. Qualitative data tell a story. ( Patton 2002:47 )

Qualitative researchers are asking different questions about the world than their quantitative colleagues. Even when researchers are employed in “mixed methods” research ( both quantitative and qualitative), they are using different methods to address different questions of the study. I do a lot of research about first-generation and working-college college students. Where a quantitative researcher might ask, how many first-generation college students graduate from college within four years? Or does first-generation college status predict high student debt loads? A qualitative researcher might ask, how does the college experience differ for first-generation college students? What is it like to carry a lot of debt, and how does this impact the ability to complete college on time? Both sets of questions are important, but they can only be answered using specific tools tailored to those questions. For the former, you need large numbers to make adequate comparisons. For the latter, you need to talk to people, find out what they are thinking and feeling, and try to inhabit their shoes for a little while so you can make sense of their experiences and beliefs.

Examples of Qualitative Research

You have probably seen examples of qualitative research before, but you might not have paid particular attention to how they were produced or realized that the accounts you were reading were the result of hours, months, even years of research “in the field.” A good qualitative researcher will present the product of their hours of work in such a way that it seems natural, even obvious, to the reader. Because we are trying to convey what it is like answers, qualitative research is often presented as stories – stories about how people live their lives, go to work, raise their children, interact with one another. In some ways, this can seem like reading particularly insightful novels. But, unlike novels, there are very specific rules and guidelines that qualitative researchers follow to ensure that the “story” they are telling is accurate , a truthful rendition of what life is like for the people being studied. Most of this textbook will be spent conveying those rules and guidelines. Let’s take a look, first, however, at three examples of what the end product looks like. I have chosen these three examples to showcase very different approaches to qualitative research, and I will return to these five examples throughout the book. They were all published as whole books (not chapters or articles), and they are worth the long read, if you have the time. I will also provide some information on how these books came to be and the length of time it takes to get them into book version. It is important you know about this process, and the rest of this textbook will help explain why it takes so long to conduct good qualitative research!

Example 1 : The End Game (ethnography + interviews)

Corey Abramson is a sociologist who teaches at the University of Arizona. In 2015 he published The End Game: How Inequality Shapes our Final Years ( 2015 ). This book was based on the research he did for his dissertation at the University of California-Berkeley in 2012. Actually, the dissertation was completed in 2012 but the work that was produced that took several years. The dissertation was entitled, “This is How We Live, This is How We Die: Social Stratification, Aging, and Health in Urban America” ( 2012 ). You can see how the book version, which was written for a more general audience, has a more engaging sound to it, but that the dissertation version, which is what academic faculty read and evaluate, has a more descriptive title. You can read the title and know that this is a study about aging and health and that the focus is going to be inequality and that the context (place) is going to be “urban America.” It’s a study about “how” people do something – in this case, how they deal with aging and death. This is the very first sentence of the dissertation, “From our first breath in the hospital to the day we die, we live in a society characterized by unequal opportunities for maintaining health and taking care of ourselves when ill. These disparities reflect persistent racial, socio-economic, and gender-based inequalities and contribute to their persistence over time” ( 1 ). What follows is a truthful account of how that is so.

Cory Abramson spent three years conducting his research in four different urban neighborhoods. We call the type of research he conducted “comparative ethnographic” because he designed his study to compare groups of seniors as they went about their everyday business. It’s comparative because he is comparing different groups (based on race, class, gender) and ethnographic because he is studying the culture/way of life of a group. [4] He had an educated guess, rooted in what previous research had shown and what social theory would suggest, that people’s experiences of aging differ by race, class, and gender. So, he set up a research design that would allow him to observe differences. He chose two primarily middle-class (one was racially diverse and the other was predominantly White) and two primarily poor neighborhoods (one was racially diverse and the other was predominantly African American). He hung out in senior centers and other places seniors congregated, watched them as they took the bus to get prescriptions filled, sat in doctor’s offices with them, and listened to their conversations with each other. He also conducted more formal conversations, what we call in-depth interviews, with sixty seniors from each of the four neighborhoods. As with a lot of fieldwork , as he got closer to the people involved, he both expanded and deepened his reach –

By the end of the project, I expanded my pool of general observations to include various settings frequented by seniors: apartment building common rooms, doctors’ offices, emergency rooms, pharmacies, senior centers, bars, parks, corner stores, shopping centers, pool halls, hair salons, coffee shops, and discount stores. Over the course of the three years of fieldwork, I observed hundreds of elders, and developed close relationships with a number of them. ( 2012:10 )

When Abramson rewrote the dissertation for a general audience and published his book in 2015, it got a lot of attention. It is a beautifully written book and it provided insight into a common human experience that we surprisingly know very little about. It won the Outstanding Publication Award by the American Sociological Association Section on Aging and the Life Course and was featured in the New York Times . The book was about aging, and specifically how inequality shapes the aging process, but it was also about much more than that. It helped show how inequality affects people’s everyday lives. For example, by observing the difficulties the poor had in setting up appointments and getting to them using public transportation and then being made to wait to see a doctor, sometimes in standing-room-only situations, when they are unwell, and then being treated dismissively by hospital staff, Abramson allowed readers to feel the material reality of being poor in the US. Comparing these examples with seniors with adequate supplemental insurance who have the resources to hire car services or have others assist them in arranging care when they need it, jolts the reader to understand and appreciate the difference money makes in the lives and circumstances of us all, and in a way that is different than simply reading a statistic (“80% of the poor do not keep regular doctor’s appointments”) does. Qualitative research can reach into spaces and places that often go unexamined and then reports back to the rest of us what it is like in those spaces and places.

Example 2: Racing for Innocence (Interviews + Content Analysis + Fictional Stories)

Jennifer Pierce is a Professor of American Studies at the University of Minnesota. Trained as a sociologist, she has written a number of books about gender, race, and power. Her very first book, Gender Trials: Emotional Lives in Contemporary Law Firms, published in 1995, is a brilliant look at gender dynamics within two law firms. Pierce was a participant observer, working as a paralegal, and she observed how female lawyers and female paralegals struggled to obtain parity with their male colleagues.

Fifteen years later, she reexamined the context of the law firm to include an examination of racial dynamics, particularly how elite white men working in these spaces created and maintained a culture that made it difficult for both female attorneys and attorneys of color to thrive. Her book, Racing for Innocence: Whiteness, Gender, and the Backlash Against Affirmative Action , published in 2012, is an interesting and creative blending of interviews with attorneys, content analyses of popular films during this period, and fictional accounts of racial discrimination and sexual harassment. The law firm she chose to study had come under an affirmative action order and was in the process of implementing equitable policies and programs. She wanted to understand how recipients of white privilege (the elite white male attorneys) come to deny the role they play in reproducing inequality. Through interviews with attorneys who were present both before and during the affirmative action order, she creates a historical record of the “bad behavior” that necessitated new policies and procedures, but also, and more importantly , probed the participants ’ understanding of this behavior. It should come as no surprise that most (but not all) of the white male attorneys saw little need for change, and that almost everyone else had accounts that were different if not sometimes downright harrowing.

I’ve used Pierce’s book in my qualitative research methods courses as an example of an interesting blend of techniques and presentation styles. My students often have a very difficult time with the fictional accounts she includes. But they serve an important communicative purpose here. They are her attempts at presenting “both sides” to an objective reality – something happens (Pierce writes this something so it is very clear what it is), and the two participants to the thing that happened have very different understandings of what this means. By including these stories, Pierce presents one of her key findings – people remember things differently and these different memories tend to support their own ideological positions. I wonder what Pierce would have written had she studied the murder of George Floyd or the storming of the US Capitol on January 6 or any number of other historic events whose observers and participants record very different happenings.

This is not to say that qualitative researchers write fictional accounts. In fact, the use of fiction in our work remains controversial. When used, it must be clearly identified as a presentation device, as Pierce did. I include Racing for Innocence here as an example of the multiple uses of methods and techniques and the way that these work together to produce better understandings by us, the readers, of what Pierce studied. We readers come away with a better grasp of how and why advantaged people understate their own involvement in situations and structures that advantage them. This is normal human behavior , in other words. This case may have been about elite white men in law firms, but the general insights here can be transposed to other settings. Indeed, Pierce argues that more research needs to be done about the role elites play in the reproduction of inequality in the workplace in general.

Example 3: Amplified Advantage (Mixed Methods: Survey Interviews + Focus Groups + Archives)

The final example comes from my own work with college students, particularly the ways in which class background affects the experience of college and outcomes for graduates. I include it here as an example of mixed methods, and for the use of supplementary archival research. I’ve done a lot of research over the years on first-generation, low-income, and working-class college students. I am curious (and skeptical) about the possibility of social mobility today, particularly with the rising cost of college and growing inequality in general. As one of the few people in my family to go to college, I didn’t grow up with a lot of examples of what college was like or how to make the most of it. And when I entered graduate school, I realized with dismay that there were very few people like me there. I worried about becoming too different from my family and friends back home. And I wasn’t at all sure that I would ever be able to pay back the huge load of debt I was taking on. And so I wrote my dissertation and first two books about working-class college students. These books focused on experiences in college and the difficulties of navigating between family and school ( Hurst 2010a, 2012 ). But even after all that research, I kept coming back to wondering if working-class students who made it through college had an equal chance at finding good jobs and happy lives,

What happens to students after college? Do working-class students fare as well as their peers? I knew from my own experience that barriers continued through graduate school and beyond, and that my debtload was higher than that of my peers, constraining some of the choices I made when I graduated. To answer these questions, I designed a study of students attending small liberal arts colleges, the type of college that tried to equalize the experience of students by requiring all students to live on campus and offering small classes with lots of interaction with faculty. These private colleges tend to have more money and resources so they can provide financial aid to low-income students. They also attract some very wealthy students. Because they enroll students across the class spectrum, I would be able to draw comparisons. I ended up spending about four years collecting data, both a survey of more than 2000 students (which formed the basis for quantitative analyses) and qualitative data collection (interviews, focus groups, archival research, and participant observation). This is what we call a “mixed methods” approach because we use both quantitative and qualitative data. The survey gave me a large enough number of students that I could make comparisons of the how many kind, and to be able to say with some authority that there were in fact significant differences in experience and outcome by class (e.g., wealthier students earned more money and had little debt; working-class students often found jobs that were not in their chosen careers and were very affected by debt, upper-middle-class students were more likely to go to graduate school). But the survey analyses could not explain why these differences existed. For that, I needed to talk to people and ask them about their motivations and aspirations. I needed to understand their perceptions of the world, and it is very hard to do this through a survey.

By interviewing students and recent graduates, I was able to discern particular patterns and pathways through college and beyond. Specifically, I identified three versions of gameplay. Upper-middle-class students, whose parents were themselves professionals (academics, lawyers, managers of non-profits), saw college as the first stage of their education and took classes and declared majors that would prepare them for graduate school. They also spent a lot of time building their resumes, taking advantage of opportunities to help professors with their research, or study abroad. This helped them gain admission to highly-ranked graduate schools and interesting jobs in the public sector. In contrast, upper-class students, whose parents were wealthy and more likely to be engaged in business (as CEOs or other high-level directors), prioritized building social capital. They did this by joining fraternities and sororities and playing club sports. This helped them when they graduated as they called on friends and parents of friends to find them well-paying jobs. Finally, low-income, first-generation, and working-class students were often adrift. They took the classes that were recommended to them but without the knowledge of how to connect them to life beyond college. They spent time working and studying rather than partying or building their resumes. All three sets of students thought they were “doing college” the right way, the way that one was supposed to do college. But these three versions of gameplay led to distinct outcomes that advantaged some students over others. I titled my work “Amplified Advantage” to highlight this process.

These three examples, Cory Abramson’s The End Game , Jennifer Peirce’s Racing for Innocence, and my own Amplified Advantage, demonstrate the range of approaches and tools available to the qualitative researcher. They also help explain why qualitative research is so important. Numbers can tell us some things about the world, but they cannot get at the hearts and minds, motivations and beliefs of the people who make up the social worlds we inhabit. For that, we need tools that allow us to listen and make sense of what people tell us and show us. That is what good qualitative research offers us.

How Is This Book Organized?

This textbook is organized as a comprehensive introduction to the use of qualitative research methods. The first half covers general topics (e.g., approaches to qualitative research, ethics) and research design (necessary steps for building a successful qualitative research study). The second half reviews various data collection and data analysis techniques. Of course, building a successful qualitative research study requires some knowledge of data collection and data analysis so the chapters in the first half and the chapters in the second half should be read in conversation with each other. That said, each chapter can be read on its own for assistance with a particular narrow topic. In addition to the chapters, a helpful glossary can be found in the back of the book. Rummage around in the text as needed.

Chapter Descriptions

Chapter 2 provides an overview of the Research Design Process. How does one begin a study? What is an appropriate research question? How is the study to be done – with what methods ? Involving what people and sites? Although qualitative research studies can and often do change and develop over the course of data collection, it is important to have a good idea of what the aims and goals of your study are at the outset and a good plan of how to achieve those aims and goals. Chapter 2 provides a road map of the process.

Chapter 3 describes and explains various ways of knowing the (social) world. What is it possible for us to know about how other people think or why they behave the way they do? What does it mean to say something is a “fact” or that it is “well-known” and understood? Qualitative researchers are particularly interested in these questions because of the types of research questions we are interested in answering (the how questions rather than the how many questions of quantitative research). Qualitative researchers have adopted various epistemological approaches. Chapter 3 will explore these approaches, highlighting interpretivist approaches that acknowledge the subjective aspect of reality – in other words, reality and knowledge are not objective but rather influenced by (interpreted through) people.

Chapter 4 focuses on the practical matter of developing a research question and finding the right approach to data collection. In any given study (think of Cory Abramson’s study of aging, for example), there may be years of collected data, thousands of observations , hundreds of pages of notes to read and review and make sense of. If all you had was a general interest area (“aging”), it would be very difficult, nearly impossible, to make sense of all of that data. The research question provides a helpful lens to refine and clarify (and simplify) everything you find and collect. For that reason, it is important to pull out that lens (articulate the research question) before you get started. In the case of the aging study, Cory Abramson was interested in how inequalities affected understandings and responses to aging. It is for this reason he designed a study that would allow him to compare different groups of seniors (some middle-class, some poor). Inevitably, he saw much more in the three years in the field than what made it into his book (or dissertation), but he was able to narrow down the complexity of the social world to provide us with this rich account linked to the original research question. Developing a good research question is thus crucial to effective design and a successful outcome. Chapter 4 will provide pointers on how to do this. Chapter 4 also provides an overview of general approaches taken to doing qualitative research and various “traditions of inquiry.”

Chapter 5 explores sampling . After you have developed a research question and have a general idea of how you will collect data (Observations? Interviews?), how do you go about actually finding people and sites to study? Although there is no “correct number” of people to interview , the sample should follow the research question and research design. Unlike quantitative research, qualitative research involves nonprobability sampling. Chapter 5 explains why this is so and what qualities instead make a good sample for qualitative research.

Chapter 6 addresses the importance of reflexivity in qualitative research. Related to epistemological issues of how we know anything about the social world, qualitative researchers understand that we the researchers can never be truly neutral or outside the study we are conducting. As observers, we see things that make sense to us and may entirely miss what is either too obvious to note or too different to comprehend. As interviewers, as much as we would like to ask questions neutrally and remain in the background, interviews are a form of conversation, and the persons we interview are responding to us . Therefore, it is important to reflect upon our social positions and the knowledges and expectations we bring to our work and to work through any blind spots that we may have. Chapter 6 provides some examples of reflexivity in practice and exercises for thinking through one’s own biases.

Chapter 7 is a very important chapter and should not be overlooked. As a practical matter, it should also be read closely with chapters 6 and 8. Because qualitative researchers deal with people and the social world, it is imperative they develop and adhere to a strong ethical code for conducting research in a way that does not harm. There are legal requirements and guidelines for doing so (see chapter 8), but these requirements should not be considered synonymous with the ethical code required of us. Each researcher must constantly interrogate every aspect of their research, from research question to design to sample through analysis and presentation, to ensure that a minimum of harm (ideally, zero harm) is caused. Because each research project is unique, the standards of care for each study are unique. Part of being a professional researcher is carrying this code in one’s heart, being constantly attentive to what is required under particular circumstances. Chapter 7 provides various research scenarios and asks readers to weigh in on the suitability and appropriateness of the research. If done in a class setting, it will become obvious fairly quickly that there are often no absolutely correct answers, as different people find different aspects of the scenarios of greatest importance. Minimizing the harm in one area may require possible harm in another. Being attentive to all the ethical aspects of one’s research and making the best judgments one can, clearly and consciously, is an integral part of being a good researcher.

Chapter 8 , best to be read in conjunction with chapter 7, explains the role and importance of Institutional Review Boards (IRBs) . Under federal guidelines, an IRB is an appropriately constituted group that has been formally designated to review and monitor research involving human subjects . Every institution that receives funding from the federal government has an IRB. IRBs have the authority to approve, require modifications to (to secure approval), or disapprove research. This group review serves an important role in the protection of the rights and welfare of human research subjects. Chapter 8 reviews the history of IRBs and the work they do but also argues that IRBs’ review of qualitative research is often both over-inclusive and under-inclusive. Some aspects of qualitative research are not well understood by IRBs, given that they were developed to prevent abuses in biomedical research. Thus, it is important not to rely on IRBs to identify all the potential ethical issues that emerge in our research (see chapter 7).

Chapter 9 provides help for getting started on formulating a research question based on gaps in the pre-existing literature. Research is conducted as part of a community, even if particular studies are done by single individuals (or small teams). What any of us finds and reports back becomes part of a much larger body of knowledge. Thus, it is important that we look at the larger body of knowledge before we actually start our bit to see how we can best contribute. When I first began interviewing working-class college students, there was only one other similar study I could find, and it hadn’t been published (it was a dissertation of students from poor backgrounds). But there had been a lot published by professors who had grown up working class and made it through college despite the odds. These accounts by “working-class academics” became an important inspiration for my study and helped me frame the questions I asked the students I interviewed. Chapter 9 will provide some pointers on how to search for relevant literature and how to use this to refine your research question.

Chapter 10 serves as a bridge between the two parts of the textbook, by introducing techniques of data collection. Qualitative research is often characterized by the form of data collection – for example, an ethnographic study is one that employs primarily observational data collection for the purpose of documenting and presenting a particular culture or ethnos. Techniques can be effectively combined, depending on the research question and the aims and goals of the study. Chapter 10 provides a general overview of all the various techniques and how they can be combined.

The second part of the textbook moves into the doing part of qualitative research once the research question has been articulated and the study designed. Chapters 11 through 17 cover various data collection techniques and approaches. Chapters 18 and 19 provide a very simple overview of basic data analysis. Chapter 20 covers communication of the data to various audiences, and in various formats.

Chapter 11 begins our overview of data collection techniques with a focus on interviewing , the true heart of qualitative research. This technique can serve as the primary and exclusive form of data collection, or it can be used to supplement other forms (observation, archival). An interview is distinct from a survey, where questions are asked in a specific order and often with a range of predetermined responses available. Interviews can be conversational and unstructured or, more conventionally, semistructured , where a general set of interview questions “guides” the conversation. Chapter 11 covers the basics of interviews: how to create interview guides, how many people to interview, where to conduct the interview, what to watch out for (how to prepare against things going wrong), and how to get the most out of your interviews.

Chapter 12 covers an important variant of interviewing, the focus group. Focus groups are semistructured interviews with a group of people moderated by a facilitator (the researcher or researcher’s assistant). Focus groups explicitly use group interaction to assist in the data collection. They are best used to collect data on a specific topic that is non-personal and shared among the group. For example, asking a group of college students about a common experience such as taking classes by remote delivery during the pandemic year of 2020. Chapter 12 covers the basics of focus groups: when to use them, how to create interview guides for them, and how to run them effectively.

Chapter 13 moves away from interviewing to the second major form of data collection unique to qualitative researchers – observation . Qualitative research that employs observation can best be understood as falling on a continuum of “fly on the wall” observation (e.g., observing how strangers interact in a doctor’s waiting room) to “participant” observation, where the researcher is also an active participant of the activity being observed. For example, an activist in the Black Lives Matter movement might want to study the movement, using her inside position to gain access to observe key meetings and interactions. Chapter 13 covers the basics of participant observation studies: advantages and disadvantages, gaining access, ethical concerns related to insider/outsider status and entanglement, and recording techniques.

Chapter 14 takes a closer look at “deep ethnography” – immersion in the field of a particularly long duration for the purpose of gaining a deeper understanding and appreciation of a particular culture or social world. Clifford Geertz called this “deep hanging out.” Whereas participant observation is often combined with semistructured interview techniques, deep ethnography’s commitment to “living the life” or experiencing the situation as it really is demands more conversational and natural interactions with people. These interactions and conversations may take place over months or even years. As can be expected, there are some costs to this technique, as well as some very large rewards when done competently. Chapter 14 provides some examples of deep ethnographies that will inspire some beginning researchers and intimidate others.

Chapter 15 moves in the opposite direction of deep ethnography, a technique that is the least positivist of all those discussed here, to mixed methods , a set of techniques that is arguably the most positivist . A mixed methods approach combines both qualitative data collection and quantitative data collection, commonly by combining a survey that is analyzed statistically (e.g., cross-tabs or regression analyses of large number probability samples) with semi-structured interviews. Although it is somewhat unconventional to discuss mixed methods in textbooks on qualitative research, I think it is important to recognize this often-employed approach here. There are several advantages and some disadvantages to taking this route. Chapter 16 will describe those advantages and disadvantages and provide some particular guidance on how to design a mixed methods study for maximum effectiveness.

Chapter 16 covers data collection that does not involve live human subjects at all – archival and historical research (chapter 17 will also cover data that does not involve interacting with human subjects). Sometimes people are unavailable to us, either because they do not wish to be interviewed or observed (as is the case with many “elites”) or because they are too far away, in both place and time. Fortunately, humans leave many traces and we can often answer questions we have by examining those traces. Special collections and archives can be goldmines for social science research. This chapter will explain how to access these places, for what purposes, and how to begin to make sense of what you find.

Chapter 17 covers another data collection area that does not involve face-to-face interaction with humans: content analysis . Although content analysis may be understood more properly as a data analysis technique, the term is often used for the entire approach, which will be the case here. Content analysis involves interpreting meaning from a body of text. This body of text might be something found in historical records (see chapter 16) or something collected by the researcher, as in the case of comment posts on a popular blog post. I once used the stories told by student loan debtors on the website studentloanjustice.org as the content I analyzed. Content analysis is particularly useful when attempting to define and understand prevalent stories or communication about a topic of interest. In other words, when we are less interested in what particular people (our defined sample) are doing or believing and more interested in what general narratives exist about a particular topic or issue. This chapter will explore different approaches to content analysis and provide helpful tips on how to collect data, how to turn that data into codes for analysis, and how to go about presenting what is found through analysis.

Where chapter 17 has pushed us towards data analysis, chapters 18 and 19 are all about what to do with the data collected, whether that data be in the form of interview transcripts or fieldnotes from observations. Chapter 18 introduces the basics of coding , the iterative process of assigning meaning to the data in order to both simplify and identify patterns. What is a code and how does it work? What are the different ways of coding data, and when should you use them? What is a codebook, and why do you need one? What does the process of data analysis look like?

Chapter 19 goes further into detail on codes and how to use them, particularly the later stages of coding in which our codes are refined, simplified, combined, and organized. These later rounds of coding are essential to getting the most out of the data we’ve collected. As students are often overwhelmed with the amount of data (a corpus of interview transcripts typically runs into the hundreds of pages; fieldnotes can easily top that), this chapter will also address time management and provide suggestions for dealing with chaos and reminders that feeling overwhelmed at the analysis stage is part of the process. By the end of the chapter, you should understand how “findings” are actually found.

The book concludes with a chapter dedicated to the effective presentation of data results. Chapter 20 covers the many ways that researchers communicate their studies to various audiences (academic, personal, political), what elements must be included in these various publications, and the hallmarks of excellent qualitative research that various audiences will be expecting. Because qualitative researchers are motivated by understanding and conveying meaning , effective communication is not only an essential skill but a fundamental facet of the entire research project. Ethnographers must be able to convey a certain sense of verisimilitude , the appearance of true reality. Those employing interviews must faithfully depict the key meanings of the people they interviewed in a way that rings true to those people, even if the end result surprises them. And all researchers must strive for clarity in their publications so that various audiences can understand what was found and why it is important.

The book concludes with a short chapter ( chapter 21 ) discussing the value of qualitative research. At the very end of this book, you will find a glossary of terms. I recommend you make frequent use of the glossary and add to each entry as you find examples. Although the entries are meant to be simple and clear, you may also want to paraphrase the definition—make it “make sense” to you, in other words. In addition to the standard reference list (all works cited here), you will find various recommendations for further reading at the end of many chapters. Some of these recommendations will be examples of excellent qualitative research, indicated with an asterisk (*) at the end of the entry. As they say, a picture is worth a thousand words. A good example of qualitative research can teach you more about conducting research than any textbook can (this one included). I highly recommend you select one to three examples from these lists and read them along with the textbook.

A final note on the choice of examples – you will note that many of the examples used in the text come from research on college students. This is for two reasons. First, as most of my research falls in this area, I am most familiar with this literature and have contacts with those who do research here and can call upon them to share their stories with you. Second, and more importantly, my hope is that this textbook reaches a wide audience of beginning researchers who study widely and deeply across the range of what can be known about the social world (from marine resources management to public policy to nursing to political science to sexuality studies and beyond). It is sometimes difficult to find examples that speak to all those research interests, however. A focus on college students is something that all readers can understand and, hopefully, appreciate, as we are all now or have been at some point a college student.

Patton’s Ten Suggestions for Doing Qualitative Research

The following ten suggestions were made by Michael Quinn Patton in his massive textbooks Qualitative Research and Evaluations Methods . This book is highly recommended for those of you who want more than an introduction to qualitative methods. It is the book I relied on heavily when I was a graduate student, although it is much easier to “dip into” when necessary than to read through as a whole. Patton is asked for “just one bit of advice” for a graduate student considering using qualitative research methods for their dissertation. Here are his top ten responses, in short form, heavily paraphrased, and with additional comments and emphases from me:

Make sure that a qualitative approach fits the research question. The following are the kinds of questions that call out for qualitative methods or where qualitative methods are particularly appropriate: questions about people’s experiences or how they make sense of those experiences; studying a person in their natural environment; researching a phenomenon so unknown that it would be impossible to study it with standardized instruments or other forms of quantitative data collection.
Study qualitative research by going to the original sources for the design and analysis appropriate to the particular approach you want to take (e.g., read Glaser and Straus if you are using grounded theory )
Find a dissertation adviser who understands or at least who will support your use of qualitative research methods. You are asking for trouble if your entire committee is populated by quantitative researchers, even if they are all very knowledgeable about the subject or focus of your study (maybe even more so if they are!)
Really work on design. Doing qualitative research effectively takes a lot of planning. Even if things are more flexible than in quantitative research, a good design is absolutely essential when starting out.
Practice data collection techniques, particularly interviewing and observing. There is definitely a set of learned skills here! Do not expect your first interview to be perfect. You will continue to grow as a researcher the more interviews you conduct, and you will probably come to understand yourself a bit more in the process, too. This is not easy, despite what others who don’t work with qualitative methods may assume (and tell you!)
Have a plan for analysis before you begin data collection. This is often a requirement in IRB protocols , although you can get away with writing something fairly simple. And even if you are taking an approach, such as grounded theory, that pushes you to remain fairly open-minded during the data collection process, you still want to know what you will be doing with all the data collected – creating a codebook? Writing analytical memos? Comparing cases? Having a plan in hand will also help prevent you from collecting too much extraneous data.
Be prepared to confront controversies both within the qualitative research community and between qualitative research and quantitative research. Don’t be naïve about this – qualitative research, particularly some approaches, will be derided by many more “positivist” researchers and audiences. For example, is an “n” of 1 really sufficient? Yes! But not everyone will agree.
Do not make the mistake of using qualitative research methods because someone told you it was easier, or because you are intimidated by the math required of statistical analyses. Qualitative research is difficult in its own way (and many would claim much more time-consuming than quantitative research). Do it because you are convinced it is right for your goals, aims, and research questions.
Find a good support network. This could be a research mentor, or it could be a group of friends or colleagues who are also using qualitative research, or it could be just someone who will listen to you work through all of the issues you will confront out in the field and during the writing process. Even though qualitative research often involves human subjects, it can be pretty lonely. A lot of times you will feel like you are working without a net. You have to create one for yourself. Take care of yourself.
And, finally, in the words of Patton, “Prepare to be changed. Looking deeply at other people’s lives will force you to look deeply at yourself.”
We will actually spend an entire chapter ( chapter 3 ) looking at this question in much more detail! ↵
Note that this might have been news to Europeans at the time, but many other societies around the world had also come to this conclusion through observation. There is often a tendency to equate “the scientific revolution” with the European world in which it took place, but this is somewhat misleading. ↵
Historians are a special case here. Historians have scrupulously and rigorously investigated the social world, but not for the purpose of understanding general laws about how things work, which is the point of scientific empirical research. History is often referred to as an idiographic field of study, meaning that it studies things that happened or are happening in themselves and not for general observations or conclusions. ↵
Don’t worry, we’ll spend more time later in this book unpacking the meaning of ethnography and other terms that are important here. Note the available glossary ↵

An approach to research that is “multimethod in focus, involving an interpretative, naturalistic approach to its subject matter. This means that qualitative researchers study things in their natural settings, attempting to make sense of, or interpret, phenomena in terms of the meanings people bring to them. Qualitative research involves the studied use and collection of a variety of empirical materials – case study, personal experience, introspective, life story, interview, observational, historical, interactional, and visual texts – that describe routine and problematic moments and meanings in individuals’ lives." ( Denzin and Lincoln 2005:2 ). Contrast with quantitative research .

In contrast to methodology, methods are more simply the practices and tools used to collect and analyze data. Examples of common methods in qualitative research are interviews , observations , and documentary analysis . One’s methodology should connect to one’s choice of methods, of course, but they are distinguishable terms. See also methodology .

A proposed explanation for an observation, phenomenon, or scientific problem that can be tested by further investigation. The positing of a hypothesis is often the first step in quantitative research but not in qualitative research. Even when qualitative researchers offer possible explanations in advance of conducting research, they will tend to not use the word “hypothesis” as it conjures up the kind of positivist research they are not conducting.

The foundational question to be addressed by the research study. This will form the anchor of the research design, collection, and analysis. Note that in qualitative research, the research question may, and probably will, alter or develop during the course of the research.

An approach to research that collects and analyzes numerical data for the purpose of finding patterns and averages, making predictions, testing causal relationships, and generalizing results to wider populations. Contrast with qualitative research .

Data collection that takes place in real-world settings, referred to as “the field;” a key component of much Grounded Theory and ethnographic research. Patton ( 2002 ) calls fieldwork “the central activity of qualitative inquiry” where “‘going into the field’ means having direct and personal contact with people under study in their own environments – getting close to people and situations being studied to personally understand the realities of minutiae of daily life” (48).

The people who are the subjects of a qualitative study. In interview-based studies, they may be the respondents to the interviewer; for purposes of IRBs, they are often referred to as the human subjects of the research.

The branch of philosophy concerned with knowledge. For researchers, it is important to recognize and adopt one of the many distinguishing epistemological perspectives as part of our understanding of what questions research can address or fully answer. See, e.g., constructivism , subjectivism, and objectivism .

An approach that refutes the possibility of neutrality in social science research. All research is “guided by a set of beliefs and feelings about the world and how it should be understood and studied” (Denzin and Lincoln 2005: 13). In contrast to positivism , interpretivism recognizes the social constructedness of reality, and researchers adopting this approach focus on capturing interpretations and understandings people have about the world rather than “the world” as it is (which is a chimera).

The cluster of data-collection tools and techniques that involve observing interactions between people, the behaviors, and practices of individuals (sometimes in contrast to what they say about how they act and behave), and cultures in context. Observational methods are the key tools employed by ethnographers and Grounded Theory .

Research based on data collected and analyzed by the research (in contrast to secondary “library” research).

The process of selecting people or other units of analysis to represent a larger population. In quantitative research, this representation is taken quite literally, as statistically representative. In qualitative research, in contrast, sample selection is often made based on potential to generate insight about a particular topic or phenomenon.

A method of data collection in which the researcher asks the participant questions; the answers to these questions are often recorded and transcribed verbatim. There are many different kinds of interviews - see also semistructured interview , structured interview , and unstructured interview .

The specific group of individuals that you will collect data from. Contrast population.

The practice of being conscious of and reflective upon one’s own social location and presence when conducting research. Because qualitative research often requires interaction with live humans, failing to take into account how one’s presence and prior expectations and social location affect the data collected and how analyzed may limit the reliability of the findings. This remains true even when dealing with historical archives and other content. Who we are matters when asking questions about how people experience the world because we, too, are a part of that world.

The science and practice of right conduct; in research, it is also the delineation of moral obligations towards research participants, communities to which we belong, and communities in which we conduct our research.

An administrative body established to protect the rights and welfare of human research subjects recruited to participate in research activities conducted under the auspices of the institution with which it is affiliated. The IRB is charged with the responsibility of reviewing all research involving human participants. The IRB is concerned with protecting the welfare, rights, and privacy of human subjects. The IRB has the authority to approve, disapprove, monitor, and require modifications in all research activities that fall within its jurisdiction as specified by both the federal regulations and institutional policy.

Research, according to US federal guidelines, that involves “a living individual about whom an investigator (whether professional or student) conducting research: (1) Obtains information or biospecimens through intervention or interaction with the individual, and uses, studies, or analyzes the information or biospecimens; or (2) Obtains, uses, studies, analyzes, or generates identifiable private information or identifiable biospecimens.”

One of the primary methodological traditions of inquiry in qualitative research, ethnography is the study of a group or group culture, largely through observational fieldwork supplemented by interviews. It is a form of fieldwork that may include participant-observation data collection. See chapter 14 for a discussion of deep ethnography.

A form of interview that follows a standard guide of questions asked, although the order of the questions may change to match the particular needs of each individual interview subject, and probing “follow-up” questions are often added during the course of the interview. The semi-structured interview is the primary form of interviewing used by qualitative researchers in the social sciences. It is sometimes referred to as an “in-depth” interview. See also interview and interview guide .

A method of observational data collection taking place in a natural setting; a form of fieldwork . The term encompasses a continuum of relative participation by the researcher (from full participant to “fly-on-the-wall” observer). This is also sometimes referred to as ethnography , although the latter is characterized by a greater focus on the culture under observation.

A research design that employs both quantitative and qualitative methods, as in the case of a survey supplemented by interviews.

An epistemological perspective that posits the existence of reality through sensory experience similar to empiricism but goes further in denying any non-sensory basis of thought or consciousness. In the social sciences, the term has roots in the proto-sociologist August Comte, who believed he could discern “laws” of society similar to the laws of natural science (e.g., gravity). The term has come to mean the kinds of measurable and verifiable science conducted by quantitative researchers and is thus used pejoratively by some qualitative researchers interested in interpretation, consciousness, and human understanding. Calling someone a “positivist” is often intended as an insult. See also empiricism and objectivism.

A place or collection containing records, documents, or other materials of historical interest; most universities have an archive of material related to the university’s history, as well as other “special collections” that may be of interest to members of the community.

A method of both data collection and data analysis in which a given content (textual, visual, graphic) is examined systematically and rigorously to identify meanings, themes, patterns and assumptions. Qualitative content analysis (QCA) is concerned with gathering and interpreting an existing body of material.

A word or short phrase that symbolically assigns a summative, salient, essence-capturing, and/or evocative attribute for a portion of language-based or visual data (Saldaña 2021:5).

Usually a verbatim written record of an interview or focus group discussion.

The primary form of data for fieldwork , participant observation , and ethnography . These notes, taken by the researcher either during the course of fieldwork or at day’s end, should include as many details as possible on what was observed and what was said. They should include clear identifiers of date, time, setting, and names (or identifying characteristics) of participants.

The process of labeling and organizing qualitative data to identify different themes and the relationships between them; a way of simplifying data to allow better management and retrieval of key themes and illustrative passages. See coding frame and codebook.

A methodological tradition of inquiry and approach to analyzing qualitative data in which theories emerge from a rigorous and systematic process of induction. This approach was pioneered by the sociologists Glaser and Strauss (1967). The elements of theory generated from comparative analysis of data are, first, conceptual categories and their properties and, second, hypotheses or generalized relations among the categories and their properties – “The constant comparing of many groups draws the [researcher’s] attention to their many similarities and differences. Considering these leads [the researcher] to generate abstract categories and their properties, which, since they emerge from the data, will clearly be important to a theory explaining the kind of behavior under observation.” (36).

A detailed description of any proposed research that involves human subjects for review by IRB. The protocol serves as the recipe for the conduct of the research activity. It includes the scientific rationale to justify the conduct of the study, the information necessary to conduct the study, the plan for managing and analyzing the data, and a discussion of the research ethical issues relevant to the research. Protocols for qualitative research often include interview guides, all documents related to recruitment, informed consent forms, very clear guidelines on the safekeeping of materials collected, and plans for de-identifying transcripts or other data that include personal identifying information.

[How to read a qualitative research paper?]

Affiliations.

1 Radboudumc, afd. Eerstelijnsgeneeskunde, Nijmegen.
2 Contact: P. Lucassen ([email protected]).
PMID: 30212018

Many readers of medical journals are trained in the 'quantitative approach'. This can therefore lead to the misinterpretation of results from qualitative research. By considering four key points, readers can interpret a qualitative paper. The chosen research method should fit the research question. Within medicine, the most common types of qualitative research are: (a) in-depth interviews, (b) focus groups, (c) participating observation, and (d) document analysis. The researchers should sufficiently describe their own role in the study. The results should be illustrated with quotes from study participants. The research should be conducted in a technically correct manner. Certain characteristics will highlight this, such as iterative data collection and saturation, the latter meaning that data collection was discontinued when no new insights or themes were identified anymore. The conclusion should be drawn from results obtained within the study. A common error made by researchers is to interpret the results from a qualitative study in a quantitative manner.

Data Collection*
Qualitative Research*
Research Design*

Search Menu
Sign in through your institution
Browse content in Arts and Humanities
Browse content in Archaeology
Anglo-Saxon and Medieval Archaeology
Archaeological Methodology and Techniques
Archaeology by Region
Archaeology of Religion
Archaeology of Trade and Exchange
Biblical Archaeology
Contemporary and Public Archaeology
Environmental Archaeology
Historical Archaeology
History and Theory of Archaeology
Industrial Archaeology
Landscape Archaeology
Mortuary Archaeology
Prehistoric Archaeology
Underwater Archaeology
Zooarchaeology
Browse content in Architecture
Architectural Structure and Design
History of Architecture
Residential and Domestic Buildings
Theory of Architecture
Browse content in Art
Art Subjects and Themes
History of Art
Industrial and Commercial Art
Theory of Art
Biographical Studies
Byzantine Studies
Browse content in Classical Studies
Classical History
Classical Philosophy
Classical Mythology
Classical Literature
Classical Reception
Classical Art and Architecture
Classical Oratory and Rhetoric
Greek and Roman Papyrology
Greek and Roman Epigraphy
Greek and Roman Law
Greek and Roman Archaeology
Late Antiquity
Religion in the Ancient World
Digital Humanities
Browse content in History
Colonialism and Imperialism
Diplomatic History
Environmental History
Genealogy, Heraldry, Names, and Honours
Genocide and Ethnic Cleansing
Historical Geography
History by Period
History of Emotions
History of Agriculture
History of Education
History of Gender and Sexuality
Industrial History
Intellectual History
International History
Labour History
Legal and Constitutional History
Local and Family History
Maritime History
Military History
National Liberation and Post-Colonialism
Oral History
Political History
Public History
Regional and National History
Revolutions and Rebellions
Slavery and Abolition of Slavery
Social and Cultural History
Theory, Methods, and Historiography
Urban History
World History
Browse content in Language Teaching and Learning
Language Learning (Specific Skills)
Language Teaching Theory and Methods
Browse content in Linguistics
Applied Linguistics
Cognitive Linguistics
Computational Linguistics
Forensic Linguistics
Grammar, Syntax and Morphology
Historical and Diachronic Linguistics
History of English
Language Evolution
Language Reference
Language Acquisition
Language Variation
Language Families
Lexicography
Linguistic Anthropology
Linguistic Theories
Linguistic Typology
Phonetics and Phonology
Psycholinguistics
Sociolinguistics
Translation and Interpretation
Writing Systems
Browse content in Literature
Bibliography
Children's Literature Studies
Literary Studies (Romanticism)
Literary Studies (American)
Literary Studies (Asian)
Literary Studies (European)
Literary Studies (Eco-criticism)
Literary Studies (Modernism)
Literary Studies - World
Literary Studies (1500 to 1800)
Literary Studies (19th Century)
Literary Studies (20th Century onwards)
Literary Studies (African American Literature)
Literary Studies (British and Irish)
Literary Studies (Early and Medieval)
Literary Studies (Fiction, Novelists, and Prose Writers)
Literary Studies (Gender Studies)
Literary Studies (Graphic Novels)
Literary Studies (History of the Book)
Literary Studies (Plays and Playwrights)
Literary Studies (Poetry and Poets)
Literary Studies (Postcolonial Literature)
Literary Studies (Queer Studies)
Literary Studies (Science Fiction)
Literary Studies (Travel Literature)
Literary Studies (War Literature)
Literary Studies (Women's Writing)
Literary Theory and Cultural Studies
Mythology and Folklore
Shakespeare Studies and Criticism
Browse content in Media Studies
Browse content in Music
Applied Music
Dance and Music
Ethics in Music
Ethnomusicology
Gender and Sexuality in Music
Medicine and Music
Music Cultures
Music and Media
Music and Religion
Music and Culture
Music Education and Pedagogy
Music Theory and Analysis
Musical Scores, Lyrics, and Libretti
Musical Structures, Styles, and Techniques
Musicology and Music History
Performance Practice and Studies
Race and Ethnicity in Music
Sound Studies
Browse content in Performing Arts
Browse content in Philosophy
Aesthetics and Philosophy of Art
Epistemology
Feminist Philosophy
History of Western Philosophy
Metaphysics
Moral Philosophy
Non-Western Philosophy
Philosophy of Language
Philosophy of Mind
Philosophy of Perception
Philosophy of Science
Philosophy of Action
Philosophy of Law
Philosophy of Religion
Philosophy of Mathematics and Logic
Practical Ethics
Social and Political Philosophy
Browse content in Religion
Biblical Studies
Christianity
East Asian Religions
History of Religion
Judaism and Jewish Studies
Qumran Studies
Religion and Education
Religion and Health
Religion and Politics
Religion and Science
Religion and Law
Religion and Art, Literature, and Music
Religious Studies
Browse content in Society and Culture
Cookery, Food, and Drink
Cultural Studies
Customs and Traditions
Ethical Issues and Debates
Hobbies, Games, Arts and Crafts
Natural world, Country Life, and Pets
Popular Beliefs and Controversial Knowledge
Sports and Outdoor Recreation
Technology and Society
Travel and Holiday
Visual Culture
Browse content in Law
Arbitration
Browse content in Company and Commercial Law
Commercial Law
Company Law
Browse content in Comparative Law
Systems of Law
Competition Law
Browse content in Constitutional and Administrative Law
Government Powers
Judicial Review
Local Government Law
Military and Defence Law
Parliamentary and Legislative Practice
Construction Law
Contract Law
Browse content in Criminal Law
Criminal Procedure
Criminal Evidence Law
Sentencing and Punishment
Employment and Labour Law
Environment and Energy Law
Browse content in Financial Law
Banking Law
Insolvency Law
History of Law
Human Rights and Immigration
Intellectual Property Law
Browse content in International Law
Private International Law and Conflict of Laws
Public International Law
IT and Communications Law
Jurisprudence and Philosophy of Law
Law and Politics
Law and Society
Browse content in Legal System and Practice
Courts and Procedure
Legal Skills and Practice
Primary Sources of Law
Regulation of Legal Profession
Medical and Healthcare Law
Browse content in Policing
Criminal Investigation and Detection
Police and Security Services
Police Procedure and Law
Police Regional Planning
Browse content in Property Law
Personal Property Law
Study and Revision
Terrorism and National Security Law
Browse content in Trusts Law
Wills and Probate or Succession
Browse content in Medicine and Health
Browse content in Allied Health Professions
Arts Therapies
Clinical Science
Dietetics and Nutrition
Occupational Therapy
Operating Department Practice
Physiotherapy
Radiography
Speech and Language Therapy
Browse content in Anaesthetics
General Anaesthesia
Neuroanaesthesia
Clinical Neuroscience
Browse content in Clinical Medicine
Acute Medicine
Cardiovascular Medicine
Clinical Genetics
Clinical Pharmacology and Therapeutics
Dermatology
Endocrinology and Diabetes
Gastroenterology
Genito-urinary Medicine
Geriatric Medicine
Infectious Diseases
Medical Toxicology
Medical Oncology
Pain Medicine
Palliative Medicine
Rehabilitation Medicine
Respiratory Medicine and Pulmonology
Rheumatology
Sleep Medicine
Sports and Exercise Medicine
Community Medical Services
Critical Care
Emergency Medicine
Forensic Medicine
Haematology
History of Medicine
Browse content in Medical Skills
Clinical Skills
Communication Skills
Nursing Skills
Surgical Skills
Browse content in Medical Dentistry
Oral and Maxillofacial Surgery
Paediatric Dentistry
Restorative Dentistry and Orthodontics
Surgical Dentistry
Medical Ethics
Medical Statistics and Methodology
Browse content in Neurology
Clinical Neurophysiology
Neuropathology
Nursing Studies
Browse content in Obstetrics and Gynaecology
Gynaecology
Occupational Medicine
Ophthalmology
Otolaryngology (ENT)
Browse content in Paediatrics
Neonatology
Browse content in Pathology
Chemical Pathology
Clinical Cytogenetics and Molecular Genetics
Histopathology
Medical Microbiology and Virology
Patient Education and Information
Browse content in Pharmacology
Psychopharmacology
Browse content in Popular Health
Caring for Others
Complementary and Alternative Medicine
Self-help and Personal Development
Browse content in Preclinical Medicine
Cell Biology
Molecular Biology and Genetics
Reproduction, Growth and Development
Primary Care
Professional Development in Medicine
Browse content in Psychiatry
Addiction Medicine
Child and Adolescent Psychiatry
Forensic Psychiatry
Learning Disabilities
Old Age Psychiatry
Psychotherapy
Browse content in Public Health and Epidemiology
Epidemiology
Public Health
Browse content in Radiology
Clinical Radiology
Interventional Radiology
Nuclear Medicine
Radiation Oncology
Reproductive Medicine
Browse content in Surgery
Cardiothoracic Surgery
Gastro-intestinal and Colorectal Surgery
General Surgery
Neurosurgery
Paediatric Surgery
Peri-operative Care
Plastic and Reconstructive Surgery
Surgical Oncology
Transplant Surgery
Trauma and Orthopaedic Surgery
Vascular Surgery
Browse content in Science and Mathematics
Browse content in Biological Sciences
Aquatic Biology
Biochemistry
Bioinformatics and Computational Biology
Developmental Biology
Ecology and Conservation
Evolutionary Biology
Genetics and Genomics
Microbiology
Molecular and Cell Biology
Natural History
Plant Sciences and Forestry
Research Methods in Life Sciences
Structural Biology
Systems Biology
Zoology and Animal Sciences
Browse content in Chemistry
Analytical Chemistry
Computational Chemistry
Crystallography
Environmental Chemistry
Industrial Chemistry
Inorganic Chemistry
Materials Chemistry
Medicinal Chemistry
Mineralogy and Gems
Organic Chemistry
Physical Chemistry
Polymer Chemistry
Study and Communication Skills in Chemistry
Theoretical Chemistry
Browse content in Computer Science
Artificial Intelligence
Computer Architecture and Logic Design
Game Studies
Human-Computer Interaction
Mathematical Theory of Computation
Programming Languages
Software Engineering
Systems Analysis and Design
Virtual Reality
Browse content in Computing
Business Applications
Computer Security
Computer Games
Computer Networking and Communications
Digital Lifestyle
Graphical and Digital Media Applications
Operating Systems
Browse content in Earth Sciences and Geography
Atmospheric Sciences
Environmental Geography
Geology and the Lithosphere
Maps and Map-making
Meteorology and Climatology
Oceanography and Hydrology
Palaeontology
Physical Geography and Topography
Regional Geography
Soil Science
Urban Geography
Browse content in Engineering and Technology
Agriculture and Farming
Biological Engineering
Civil Engineering, Surveying, and Building
Electronics and Communications Engineering
Energy Technology
Engineering (General)
Environmental Science, Engineering, and Technology
History of Engineering and Technology
Mechanical Engineering and Materials
Technology of Industrial Chemistry
Transport Technology and Trades
Browse content in Environmental Science
Applied Ecology (Environmental Science)
Conservation of the Environment (Environmental Science)
Environmental Sustainability
Environmentalist Thought and Ideology (Environmental Science)
Management of Land and Natural Resources (Environmental Science)
Natural Disasters (Environmental Science)
Nuclear Issues (Environmental Science)
Pollution and Threats to the Environment (Environmental Science)
Social Impact of Environmental Issues (Environmental Science)
History of Science and Technology
Browse content in Materials Science
Ceramics and Glasses
Composite Materials
Metals, Alloying, and Corrosion
Nanotechnology
Browse content in Mathematics
Applied Mathematics
Biomathematics and Statistics
History of Mathematics
Mathematical Education
Mathematical Finance
Mathematical Analysis
Numerical and Computational Mathematics
Probability and Statistics
Pure Mathematics
Browse content in Neuroscience
Cognition and Behavioural Neuroscience
Development of the Nervous System
Disorders of the Nervous System
History of Neuroscience
Invertebrate Neurobiology
Molecular and Cellular Systems
Neuroendocrinology and Autonomic Nervous System
Neuroscientific Techniques
Sensory and Motor Systems
Browse content in Physics
Astronomy and Astrophysics
Atomic, Molecular, and Optical Physics
Biological and Medical Physics
Classical Mechanics
Computational Physics
Condensed Matter Physics
Electromagnetism, Optics, and Acoustics
History of Physics
Mathematical and Statistical Physics
Measurement Science
Nuclear Physics
Particles and Fields
Plasma Physics
Quantum Physics
Relativity and Gravitation
Semiconductor and Mesoscopic Physics
Browse content in Psychology
Affective Sciences
Clinical Psychology
Cognitive Psychology
Cognitive Neuroscience
Criminal and Forensic Psychology
Developmental Psychology
Educational Psychology
Evolutionary Psychology
Health Psychology
History and Systems in Psychology
Music Psychology
Neuropsychology
Organizational Psychology
Psychological Assessment and Testing
Psychology of Human-Technology Interaction
Psychology Professional Development and Training
Research Methods in Psychology
Social Psychology
Browse content in Social Sciences
Browse content in Anthropology
Anthropology of Religion
Human Evolution
Medical Anthropology
Physical Anthropology
Regional Anthropology
Social and Cultural Anthropology
Theory and Practice of Anthropology
Browse content in Business and Management
Business Ethics
Business Strategy
Business History
Business and Technology
Business and Government
Business and the Environment
Comparative Management
Corporate Governance
Corporate Social Responsibility
Entrepreneurship
Health Management
Human Resource Management
Industrial and Employment Relations
Industry Studies
Information and Communication Technologies
International Business
Knowledge Management
Management and Management Techniques
Operations Management
Organizational Theory and Behaviour
Pensions and Pension Management
Public and Nonprofit Management
Strategic Management
Supply Chain Management
Browse content in Criminology and Criminal Justice
Criminal Justice
Criminology
Forms of Crime
International and Comparative Criminology
Youth Violence and Juvenile Justice
Development Studies
Browse content in Economics
Agricultural, Environmental, and Natural Resource Economics
Asian Economics
Behavioural Finance
Behavioural Economics and Neuroeconomics
Econometrics and Mathematical Economics
Economic History
Economic Systems
Economic Methodology
Economic Development and Growth
Financial Markets
Financial Institutions and Services
General Economics and Teaching
Health, Education, and Welfare
History of Economic Thought
International Economics
Labour and Demographic Economics
Law and Economics
Macroeconomics and Monetary Economics
Microeconomics
Public Economics
Urban, Rural, and Regional Economics
Welfare Economics
Browse content in Education
Adult Education and Continuous Learning
Care and Counselling of Students
Early Childhood and Elementary Education
Educational Equipment and Technology
Educational Strategies and Policy
Higher and Further Education
Organization and Management of Education
Philosophy and Theory of Education
Schools Studies
Secondary Education
Teaching of a Specific Subject
Teaching of Specific Groups and Special Educational Needs
Teaching Skills and Techniques
Browse content in Environment
Applied Ecology (Social Science)
Climate Change
Conservation of the Environment (Social Science)
Environmentalist Thought and Ideology (Social Science)
Natural Disasters (Environment)
Social Impact of Environmental Issues (Social Science)
Browse content in Human Geography
Cultural Geography
Economic Geography
Political Geography
Browse content in Interdisciplinary Studies
Communication Studies
Museums, Libraries, and Information Sciences
Browse content in Politics
African Politics
Asian Politics
Chinese Politics
Comparative Politics
Conflict Politics
Elections and Electoral Studies
Environmental Politics
Ethnic Politics
European Union
Foreign Policy
Gender and Politics
Human Rights and Politics
Indian Politics
International Relations
International Organization (Politics)
International Political Economy
Irish Politics
Latin American Politics
Middle Eastern Politics
Political Behaviour
Political Economy
Political Institutions
Political Methodology
Political Communication
Political Philosophy
Political Sociology
Political Theory
Politics and Law
Politics of Development
Public Policy
Public Administration
Quantitative Political Methodology
Regional Political Studies
Russian Politics
Security Studies
State and Local Government
UK Politics
US Politics
Browse content in Regional and Area Studies
African Studies
Asian Studies
East Asian Studies
Japanese Studies
Latin American Studies
Middle Eastern Studies
Native American Studies
Scottish Studies
Browse content in Research and Information
Research Methods
Browse content in Social Work
Addictions and Substance Misuse
Adoption and Fostering
Care of the Elderly
Child and Adolescent Social Work
Couple and Family Social Work
Direct Practice and Clinical Social Work
Emergency Services
Human Behaviour and the Social Environment
International and Global Issues in Social Work
Mental and Behavioural Health
Social Justice and Human Rights
Social Policy and Advocacy
Social Work and Crime and Justice
Social Work Macro Practice
Social Work Practice Settings
Social Work Research and Evidence-based Practice
Welfare and Benefit Systems
Browse content in Sociology
Childhood Studies
Community Development
Comparative and Historical Sociology
Economic Sociology
Gender and Sexuality
Gerontology and Ageing
Health, Illness, and Medicine
Marriage and the Family
Migration Studies
Occupations, Professions, and Work
Organizations
Population and Demography
Race and Ethnicity
Social Theory
Social Movements and Social Change
Social Research and Statistics
Social Stratification, Inequality, and Mobility
Sociology of Religion
Sociology of Education
Sport and Leisure
Urban and Rural Studies
Browse content in Warfare and Defence
Defence Strategy, Planning, and Research
Land Forces and Warfare
Military Administration
Military Life and Institutions
Naval Forces and Warfare
Other Warfare and Defence Issues
Peace Studies and Conflict Resolution
Weapons and Equipment

The Oxford Handbook of Qualitative Research

A newer edition of this book is available.

< Previous chapter
Next chapter >

31 Writing Up Qualitative Research

Jane F. Gilgun, School of Social Work, University of Minnesota, Twin Cities

Published: 04 August 2014
Cite Icon Cite
Permissions Icon Permissions

This chapter provides guidelines for writing journal articles based on qualitative approaches. The guidelines are part of the tradition of the Chicago School of Sociology and the author’s experience as a writer and reviewer. The guidelines include understanding experiences in context, immersion, interpretations grounded in accounts of informants’ lived experiences, and research as action-oriented. The chapter also covers writing articles that report findings based on ethnographies, autoethnographies, performances, poetry, and photography and other graphic media.

How researchers write up results for journal publications depends on the purposes of the research and the methodologies they use. Some topics are standard, such as statements about methods and methodologies, but how to represent other topics, like related research and theory, reflexivity, and informants’ accounts, may vary. For example, articles based on ethnographic research may be structured differently from writing up research whose purpose is theory development. Journal editors and reviewers often are familiar with variations in style of write-ups, but, when they are not, they may ask for modifications that violate the methodological principles of the research. A common reviewer request is for percentages, which has little meaning in almost all forms of qualitative research because the purpose of the research is to identify patterns of meanings and not distributions of variables. For example, Irvine’s (2013) ethnography of the meanings of pets to homeless people shows a variety of meaning without giving the number of participants from which she drew.

Authors sometimes move easily through the review process, but most often they do not, not only because reviewers might not “get it,” but also because authors have left out, underemphasized, or been less than clear about aspects of their research that reviewers and editors believe are important. Working with editors and reviewers frequently results in improved articles.

The purpose of this chapter is to provide guidelines for writing journal articles based on qualitative approaches. My intended audience is composed of researchers, reviewers for journals, and journal editors. Reviewers for funding agencies may also find this chapter useful. I use the terms “journal article” and “research report” as synonyms, even though some journal articles are not reports of research. I have derived the guidelines from ideas associated with the Chicago School of Sociology and my experience as an author and reviewer. Although the Chicago School was, as Becker (1999) wrote, “open to various ways of doing sociology” (p. 10), the ideas in this chapter are part of the tradition, but they are not representative of the entire tradition. Furthermore, the ideas are not fixed but are open-ended because they evolve over time. I have followed the principles of the Chicago School of Sociology throughout my career, augmented by updates to these ideas, experiments with other traditions, and the sense I make of my own experiences as researcher, author, and reviewer.

The ideas on which I draw include understanding experiences in context, immersion, interpretations grounded in accounts of informants’ lived experiences, and research as action-oriented ( Bulmer, 1984 ; Faris, 1967 ; Gilgun, 1999 d ; 2005 a ; 2012 a ; 2013 b ). To follow these principles, researchers do in-depth studies that take into account the multiple contextual factors that influence meanings and interpretations, seek multiple points of view, and often use multiple methods such as interviews, observations, and document analysis. Researchers do this style of research not only because what they learn is interesting, but because they want to do useful research; that is, research that leads to social actions and even transformations in policies, programs, and interventions. Authors and reviewers pay attention to these principles. Authors convey them in their write-ups, and reviewers look for them as they develop their appraisals.

Excellent writing up of qualitative research matches these principles. In other words, write-ups convey lived experience within multiple contexts, multiple points of view, and analyses that deepen understandings. In addition, if the research is applied, then authors write about how findings may contribute to quality of life. Qualitative researchers from other traditions may follow similar or different guidelines in their write-ups, and I sometimes note other styles of write-ups. Often these variations are related to terminology and not procedures. The reach of the Chicago School of Sociology is wide and deep.

Following these guidelines does not guarantee an easy review process, but this article will be helpful to researchers as they plan and craft their articles and as they respond to reviewers’ and editors’ comments. After almost thirty years of publishing research based on qualitative approaches, almost as many years as a reviewer, and the editing of three collections of qualitative research reports ( Gilgun, Daly, & Handel, 1992 ; Gilgun & Sussman, 1996 : Gilgun & Sands, 2012 ), I am positioned to offer helpful guidelines, not only to authors but also to reviewers and journal editors.

I begin this chapter with a discussion of general principles and then cover the content of typical sections of research reports. Some of the general material fits into various sections of reports, such as methods and findings. In those cases, I do not repeat material already covered and assume that my writing is clear enough so that readers know how the general material fits into particular sections of articles.

Although most of this chapter addresses the writing of conventional research reports, I also cover writing articles that report findings through ethnographies, autoethnographies, performances, poetry, and photography and other graphic media. Ethnographies are based on researchers’ immersion in the field, where they do extensive observations, interviews, and often document analysis (see Block, 2012 ). Geertz’s (1973) notion of “thick description” is associated with ethnographies. Thick description is characterized by research reports that show the matrix of meanings that researchers identify and attempt to represent in their reports. Autoethnographies are in-depth reflective accounts of individual lives that the narrators themselves write ( Ellis, 2009 ). Ethnographies and autoethnographies involve reflections on meanings, contexts, and other wider influences on individual lives. They are studies of intersections of individual lives and wider cultural themes and practices. Reports of these types of research can look different from conventional research reports in that they appear less formal; the usual sections of methods, literature review, findings, and analysis may have different names; and the sections may be in places that fit the logical flow of the research and not the typical structure of introductory material, methods, results, and discussion. Despite these superficial differences, researchers who write these kinds of articles seek to deepen understandings and hope to move audiences to action through conveying lived experience in context and through multiple points of view. They also typically seek transformations of persons and societies. Links between these forms of research and Chicago School traditions are self-evident.

Some General Principles

Research reports that have these characteristics depend on the quality of the data on which the reports are based, the quality of the analysis, and the skills of researchers in conveying the analysis concisely and with “grab” ( Glaser, 1978 ), which means writing that is vivid and memorable ( Gilgun, 2005 b ). Grab brings findings to life. With grab, human experiences jump off the page. Priority is given to the voices of research participants, whom I call informants, with citations and the wisdom of other researchers providing important contextual information. The voices and analyses of researchers do not dominate ( Gilgun, 2005 c ), except in some articles whose purpose is theory development or the presentation of a theory. Researcher analyses often are important, especially in putting forth social action recommendations that stem from the experiences of informants.

A well-done report shows consistency between research traditions and the writing-up of research. For example, reflexivity statements, writing with grab, and copious excerpts from fieldnotes, interviews, and documents of various sorts are consistent with phenomenological approaches whose emphasis is on lived experience and interpretations that informants make of their experiences. Researchers new to qualitative research, however, often mix their traditions without realizing it, which works when the traditions are compatible. When the traditions are not compatible, the write-ups can be confusing and even contradictory ( Gilgun, 2005 d ). Some authors may write in distanced, third-person styles while attempting to convey informants’ lived experiences. These scholars may, therefore, have difficulty getting their articles accepted. Hopefully, this chapter will facilitate the writing of research reports that show consistency across their many parts and save scholars from rejections of work over which they have taken much care.

Details on These General Principles

In this section, I provide more detail on writing up qualitative research. I begin with a discussion of the need for high-quality data, high-quality analysis, and grab. I then move on to the details of the report, such as the place of prior research and theory, contents of methods sections, organization of findings, and the balance between descriptive material and authors’ interpretations. Dilemmas abound. Writing up qualitative research is not for the faint of heart.

High-Quality Data

Since qualitative researchers seek to understand the subjective experiences of research informants in various contexts, high-quality data result in large part from the degree that researchers practice immersion and to the degree that both researchers and informants develop rapport and engage with each other. Through active engagement, informants share their experiences with the kind of detail that brings their experiences to life. How to develop rapport is beyond the scope of this article, but openness and acceptance of whatever informants say are fundamental to engagement. Interviewers do not have to agree with the values that informants’ accounts convey, as when I interview murderers and rapists ( Gilgun, 2008 ), but we do maintain a neutrality that allows the dialogue to continue ( Gilgun & Anderson, 2013 ). The content of interviews is not about us and our preferences, but about understanding informants.

Prolonged engagement can result in quality data. In interview research, prolonged engagement allows for informants’ multiple perspectives to emerge, including inconsistencies, contradictions, ambiguities, and ambivalences. In addition, prolonged engagement facilitates the kind of trust needed for informants to share personal, sensitive information in detail, which are the kinds of data that qualitative researchers seek. Prolonged engagement also gives researchers time to reflect on what they are learning and experiencing through the interviews. This provides opportunities to develop new understandings and test new understandings through subsequent research. Their understandings thus deepen and broaden. Informants, too, can reflect, reconsider, and deepen the accounts they share.

Prolonged engagement means in-depth interviews, typically multiple interviews of more than an hour each. As mentioned earlier, time between interviews allows researchers and informants to reflect on the previous interview and prepare for the next. Researchers can do background reading, discuss emerging ideas with others, and formulate pertinent new questions. Informants may retrieve long-forgotten memories and interpretations through interviews. If they have only one interview, they have no opportunity to share with researchers the material that arises after the single interview is concluded.

There are exceptions to multiple interviews as necessary for immersion and high-quality data. When researchers have expertise in interviewing and when the topic is focused, one interview of between ninety minutes to two hours could provide some depth. Even under these conditions, however, more than one interview is ideal. I did a study that involved one ninety-minute interview with perpetrators of child sexual abuse in order to understand the circumstances under which their abusive behaviors became known to law enforcement. Thus, the interview was focused. The interviewees were volunteers who had talked about the topic many times in the course of their involvement in sex abuse treatment programs. They shared their stories with depth and breadth. I, too, was well-prepared. By then, I had had about twenty-five years of experience interviewing people about personal, sensitive topics. The informants provided accounts not only because the topic was focused, but because they were willing to share and I was willing to listen and to ask questions about their sexually abusive behaviors. With one interview, however, I knew relatively little about their social histories and general worldviews. Thus, I did not have the specifics necessary to place their accounts into context. The material they provided remained valuable and resulted in one publication ( Sharma & Gilgun, 2008 ) and others in planning stages. I prefer two or more interviews because of the importance of contextual data.

In observational studies, prolonged engagement means that researchers do multiple observations over time to obtain the nuances and details that compose human actions. Observational studies often have interview components and also may have document analysis as well. In document analysis, prolonged engagement means researchers base their analyses on an ample storehouse of documents and not just flit in and out of the documents. The quality of document analysis depends on whether the analysis shows multiple perspectives, patterns, and variations within patterns. Ethnographies have these characteristics. Block’s (2012) ethnographic research on AIDS orphans in Lesotho, Africa, is an example of a well-done ethnography.

Sample Size

In principle, the size of the sample and the depth of the interview affect whether researchers can claim immersion. The more depth and breadth each case in a study has, the smaller the sample size can be. For example, researchers can engage in immersion through a single in-depth case study when they do multiple interviews and if multiple facets of the case are examined. Case studies are investigations of single units. The case can be composed of an individual, a couple, a family, a group, a nation, or a region. Single case studies are useful in the illustration, development, and testing of theories, as well as in in-depth descriptions.

The more focused the questions, the larger the sample will be. A study on long-term marriage would require a minimum of two or three interviews because the topic is complicated. The sample would include at least ten participants and up to twenty or thirty, depending on the number of interviews, to account for some of the many patterns that are likely to emerge in a study of a topic this complex. In the one-interview study I did of how sexual abuse came to the notice of law enforcement, one interview was adequate because of the tight focus of the question. Yet, I used a sample size of thirty-two to maximize the possibility of identifying a variety of patterns, which the study accomplished. As mentioned, the one interview, however, did not allow me to contextualize the stories the informants told. Fortunately, I have another large sample that involved multiple, in-depth interviews in which informants discussed multiple contexts over time. This other study was helpful to me in understanding the accounts from the single-interview study.

Recruitment can be difficult. When it is, researchers may not be able to obtain an adequate sample. For example, a sample of seven participants engaging in a single sixty- to ninety-minute interview may not provide enough data on which to base a credible analysis. In a similar vein, articles based on a single or even a few focus groups may not provide enough depth to be informative. Some depth is possible if, in a single-interview study of less than fifteen or twenty interviewees, researchers meet with informants a second time to go over what researchers understand about informants’ accounts. This sometimes is called member-checking , and it provides additional data on which to base the analysis. In summary, the more depth and breadth to a study, the smaller the sample size can be—even as small as one or two—depending on the questions and the complexity of the cases.

Quality of the Analysis

A quality analysis begins with initial planning of the research and continues until the article is accepted for publication. An excellent research report has transparency , meaning the write-up is clear in what researchers did, how they did it, and why. I often tell students they can do almost anything reasonable and ethical, as long as they make a clear account in the write-up.

During planning, some researchers identify those concepts that they can use as sensitizing concepts once in the field. Transparency about the sources of sensitizing concepts characterizes well-done reports. The sources are literature reviews and reflexivity statements. Most researchers, however, have only a limited awareness of the importance of being clear about the sources of sensitizing concepts and other notions that become part of research coding schemes. Sensitizing concepts are notions that researchers identify before beginning their research and that help researchers notice and name social processes that they might not have noticed otherwise ( Blumer, 1986 ). Other researchers wait until data analysis to begin to identify concepts that they may use as codes and that may also become core concepts that organize findings. Either approach is acceptable and depends on purpose and methodologies.

During data collection, researchers reflect on what they are learning, typically talk to other researchers about their emerging understandings, and read relevant research and theory to enlarge and deepen their understandings. Researchers also keep fieldnotes that are a form of reflection. Based on their various reflections, researchers can reformulate interview and research questions and formulate new ones, do within—and across—case comparisons while in the field, and develop new insights into the meanings of the material.

Also, while in the field, researchers identify promising patterns of meanings and identify tentative core concepts, sometimes called categories , which are ideas that organize the copious material that they amass. Once researchers identify tentative core concepts, they seek to test whether they hold up, and, when they do, they further develop the patterns and concepts. Sometimes researchers think they have “struck gold” when they identify a possible core concept or pattern, only to find that the data—or metaphorical vein of gold—peter out (Phyllis Stern, personal communication, November 2002). They then go on to identify and follow-up on other concepts and patterns that show promise of becoming viable.

Core concepts become viable when researchers are able to dimensionalize them ( Schatzman, 1991 ) through selective coding ( Corbin & Strauss, 2008 ). This means that researchers have found data that show the multiple facets of concepts, such as patterns and exceptions to any general patterns. Authors may use other terms to describe what they did, such as thematic analysis. What is important is to describe the processes and produces; and what researchers call them is of less importance.

Core concepts may begin as sensitizing concepts. Researchers sometimes identify, name, and code core concepts through notions that are part of their general stores of knowledge but were not part of the literature review or reflexivity statement. Glaser (1978) called the practice “theoretical sensitivity.” The names researchers choose may be words or phrases informants have used. However derived, core concepts are central to the organization of findings ( Gilgun, 2012 a ).

At some point, data collection stops, but analysis does not. Researchers carry analysis that occurred in the field into the next phases of the research. Immersion at this point means that researchers read and code transcripts of interviews, observations, and any documentary material they find useful. They carry forward the core concepts they identified in the field. An example of a core concept is “resilience,” which in my own research organized a great deal of interview material. The concept of resilience has been an organizing idea in several of the articles I have written and plan to write ( Gilgun, 1996 a ; 1996 b ; 2002 a ; 2002 b ; 2004 a ; 2004 b ; 2005 a ; 2006 , 2008 ; 2010 ; Gilgun & Abrams, 2005 ; Gilgun, Keskinen, Marti, & Rice, 1999 ; Gilgun, Klein, & Pranis, 2000 ).

Corbin and Strauss (2008) stated that selective coding helps researchers to decide if a concept can become a core concept, meaning it organizes a great deal of data that have multiple dimensions. An example of dimensionalization is a study of social workers in Australia whose clients were Aboriginal people. The researchers identified several core concepts, among them critical self-awareness ( Bennet, Zubrzycki, & Bacon, 2011 ). The dimensions of critical self-awareness included understanding motivations to work with Aboriginal people, fears of working with Aboriginal people, and personalization and internalization of the anger that some Aboriginal people express.

Like many other researchers, Bennet et al. (2011) were not working within an explicit Chicago School tradition. They therefore do not use terms such as core concepts, dimensionalization, and selective coding. Instead, they described their procedures as thematic analysis, conceptual mapping, and a search for meaning. However, they did use the term “saturation,” which is part of the Chicago School tradition.

A single core concept or multiple related core concepts compose research reports. The Bennet et al. (2011) article, for example, linked multiple core concepts. The authors showed how critical self-awareness leads to meaningful relationships that in turn connect to “acquiring Aboriginal knowledge” (p. 30).

With viable core concepts and rich data, researchers are positioned to present their findings in ways that are memorable and interesting; that is, with “grab” ( Glaser, 1978 ). “Grab” requires compelling descriptive material: excerpts from interviews, field notes, and various types of documents, as well as researchers’ paraphrases of these materials. An example of a research report with grab is Irvine’s (2013) account of her study of the meanings of pets to homeless people. She provided vivid descriptions of her interactions with the participants and compelling quotes that show what pets mean. Here, an example from Denise’s account of her relationship with her cat Ivy:

I have a history with depression up to suicide ideation, and Ivy, I refer to her as my suicide barrier. And I don’t say that in any light way. I would say, most days, she’s the reason why I keep going.... She is the only source of daily, steady affection and companionship that I have. (p. 19)

These and other quotes, as well as Irvine’s well-written, detailed descriptive material, show what grab means.

Grab equates with excellence in writing. Irvine’s (2013) article is an example. In terms of the grab of her article, her work is in the Chicago School tradition. She wrote in the first person. She told complete stories in which she quoted extensively from the interviews, described the persons she interviewed and the settings in which she interviewed them, and provided biographical sketches. Robert Park and Ernest Burgess, both of whom trained generations of graduate students in qualitative research at the University of Chicago in the first quarter of the twentieth century, held seminars on the use of literary techniques, such as those used in novels and autobiographies, in writing up research ( Bulmer, 1984 ; Gilgun, 1999 d ; 2012 a ). These educators wanted researchers to report on their “first-hand observation.” Park told a class of graduate students to

[g]o and sit in the lounges of the luxury hotels and on the doorsteps of the flophouses; sit on the Gold Coast settees and on the slum shakedowns; sit in the Orchestra Hall and in the Star and Garter Burlesk. In short, gentlemen [sic], go get the seat of your pants dirty. ( McKinney, 1966 , p. 71)

Park suggested to Pauline Young (1928 ; 1932) to “think and feel” like the residents of Russian Town, the subject of her dissertation, published in 1932 ( Faris, 1967 ). Irvine’s work shows these qualities. She immersed herself in the settings, she conducted in-depth interviews, and she conveyed her first-hand experiences in vivid terms.

The Chicago School also encouraged students to write in the first person. A good example is a report by Dollard (1937) , who was concerned about the racial practices of the Southern town where he was doing fieldwork. He said he was afraid that other white people watched as he talked to “Negroes” on his front porch, when he knew that custom regarding the “proper” place of “Negroes” was at the back door. He wrote

My Negro friend brought still another Negro up on the porch to meet me. Should we shake hands? Would he be insulted if I did not, or would he accept the situation? I kept my hands in pockets and did not do it, a device that was often useful in resolving such a situation. (p. 7)

This description is a portrait of a pivotal moment in Dollard’s fieldwork, and it is full of connotations about the racist practices of the time ( Gilgun, 1999 d ; 2012 a ).

Irvine (2013) also wrote in the first person. Here’s an example:

I met Trish on a cold December day in Boulder. She stood on the median at the exit of a busy shopping center with her Jack Russell Terrier bundled up in a dog bed beside her. She was “flying a sign,” or panhandling, with a piece of cardboard neatly lettered in black marker to read, “Sober. Doing the best I can. Please help.” (p. 14)

These two excerpts illustrate a methodological point Small (1916) made in his chapter on the first fifty years of sociological research in the United States: namely, the importance of going beyond “technical treatises” and providing first-person “frank judgments” that can help future generations interpret sociology. Without such contexts, “the historical significance of treatises will be misunderstood” (p. 722). Throughout his chapter, Small wrote in the first-person and provided his views—or frank judgments—on the events he narrated. From then until now, research reports in the Chicago tradition are vivid and contextual, conveying to the extent possible what it was like to be persons in situations.

There are many other examples of well-done research reports. Eck’s (2013) article on never-married men includes the basic elements that are present in almost all reports based on qualitative methods. It is transparent in its procedures, situated within scholarly traditions, well-organized, vivid, and instructive both for those new to qualitative research and for long-term researchers like me. The other articles I cite in this chapter also show many desirable qualities in research reports.

Research Report Sections

The main sections of standard reports based on qualitative methods are the same as for articles based on other types of methods: Introduction, Methods, Findings, and Discussion. The American Psychological Association (APA) manual (2009) provides information on what goes into each of these sections. Research reports in sociology journals follow a similar format, although the citation style is slightly different. The American Sociological Association uses first and last names in the reference section, a practice I support. In articles based on qualitative approaches, researchers sometimes change the names of sections, add or omit some, or reorder them. When changes are made, the general guideline is whether the changes make sense and are consistent with the purpose of the research. As Saldaña (2003) pointed out, researchers choose how to present their findings on the basis of credibility, vividness, and persuasive qualities and not for the sake of novelty. Because some articles report findings as fictionalized accounts, poetry, plays, songs, and performances (including plays), it makes sense that the sections on these findings vary from the standard format that I discuss here.

Although there are no rigid rules about how to write journal articles based on qualitative research, much depends on the methodological perspectives, purposes of the research, and the editorial guidelines of particular journals. For example, if researchers want to develop a theory, it is important to be clear from the beginning of the article to state this as the purpose of the research. The entire article should then focus on how the authors developed the theory. Research and theory cited in the literature review should have direct relevance to the substantive area on which the authors theorized. The methods section should explain what the researchers did to develop the theory. The findings section should begin with a statement of the theory that the researchers developed. The rest of the findings section should usually be composed of three parts. The first is composed of excerpts from those data that support the concepts of the theory. This is the grounding of the theory in something clear and concrete. The second is the authors’ thinking or interpretation of the meanings of each of the concepts. The third is an analysis of how the theory contributes to what is already known, such as how the findings elaborate on and call into question what is known. Thus, a research report on the development of a theory should contain a lot of scholarship that others have developed.

A report based on narrative principles or one based on an ethnography should contain copious excerpts from interviews, citing less scholarship than an article whose purpose is to develop theory. However, it is good practice to bring in related research and theory in the results section when this literature helps in interpretation, when findings have connections to other bodies of thought, and when findings are facets of a larger issue. In my now older publication on incest perpetrators ( Gilgun, 1995 ), the editors suggested that I show that when therapists engage in sexual relationships with clients, they are engaging in abuses of power similar to those of incest perpetrators. I was at first indignant that the editors wanted me to do even more work on the article, but I soon was glad they did. It is important to show that incest or any human phenomenon is not isolated from other phenomenon but is part of a larger picture. Doing so fit my purposes, which was to show how to do theory-testing/theory-guided qualitative research. Showing how findings fit into related research and theory is part of this type of research.

Whenever researchers are ready to submit an article for publication, it is wise to read recent issues of journals in which they would like to publish. If they can identify an article whose structure, methodologies, and general purpose are similar to theirs, they could study how those authors presented their material. If, for example, in a report on narrative research, the introductory material is relatively brief, and the findings and discussion sections compose most of the pages, researchers would do well to format their articles in similar ways. I study journals in which I have interest and model much of my own articles after those published in these journals. I make sure, however, that I cover topics that in my judgment are important to cover.

Prior Research and Theory

In my experience, something as simple as the place of prior research and theory can get complicated in the writing of reports based on qualitative research, even when the purpose of the article is primarily descriptive and is not to construct an explicit theory. In general, related research and theory literature can be presented at the beginning of a report as part of a review of pertinent research and theory, in the findings section when prior work helps in the interpretation and analysis of findings, or in the discussion section, where authors may reflect on how their findings add to, undermine, or correct what is known and even add something new.

Readers expect and journal editors typically want articles to begin with literature review, with some exceptions. A perusal of journals that publish qualitative studies shows this. Yet there are exceptions. Valásquez (2011) began her report on her encounter with scientology with an extended and rather meandering first-person narrative. Her literature review began toward the end of the article. She tailored the review to the report that preceded it. In this article and others, the literature review helped in the interpretation of findings and helped to situate the report in its scholarly contexts. In other articles, the literature review appears in the introductory section. This sets the scholarly context of the research, highlights the significance of topics, and identifies gaps in knowledge. Neither authors nor reviewers should have rigid expectations about where the scholarship of others belongs. It belongs where it makes the most sense and has the most impact.

For many, the placement of literature reviews seems self-evident. Yet, some well-known approaches, such as grounded theory, can set authors up for confusion about where the literature review belongs. This can result in delays in writing up their results. The procedures of grounded theory are open-ended and designed to find new aspects of phenomena—often underresearched—and then develop theories from the findings. At the outset of their work, researchers cannot anticipate what they will find. Therefore, teachers such as Strauss and Glaser advised students not to do literature reviews until they had identified basic social processes that become the focus of the research ( Covan, 2007 ; Glaser & Strauss, 1967 ).

How, then, do researchers write up research reports when they are doing an open-ended study that, by definition, will culminate in unanticipated findings? Do they write their reports as records on how they proceeded chronologically, or do they follow APA style and the dominant tradition that says the literature review comes first? For the most part, I follow the tradition, as, apparently, do most researchers. However, to structure reports in this way sometimes feels strained and artificial. I would prefer to write a more chronological account, in which I can share with readers the lines of inquiry and procedures I followed. The literature review at the beginning of the report, therefore, would be brief. The methods section is quite detailed in how I went about developing the theory. The findings section would have the three-part format I discussed earlier: statement of the theory, presentations of excerpts that support assertions that certain concepts compose the theory, my interpretation of the meanings of the concepts and the excerpts that support them, and then the use of related research and theory to further develop the theory and to situate it in its scholarly traditions.

In all but one of the research reports that I have published, I did the literature after I had identified findings. The one exception was research I did based on the method of analytic induction, in which researchers can use literature reviews to focus their research from the outset ( Gilgun, 1995 , 2007 ). In this research, I used concepts from theories on justice and care to analyze transcripts of interviews I had previously conducted on how perpetrators view child sexual abuse. Even though I was familiar with the transcripts, I found that the concepts of justice and care and their definitions sensitized me to see things in the material that I had not noticed as I did data collection and during previous analyses of the data.

Furthermore, in writing up the results, I brought in research that was not part of the literature review to help me to interpret findings and to show how findings fit with and added to what was already known. I did not place this material in the introductory literature review. Placing related research and theory as parts of the results and discussion sections is common and may be necessary in articles that are reporting on a theory that the authors developed. For descriptive studies whose purpose is not theory-building, such as ethnographies, some findings sections include the addition of research and theory not present in the introductory section. Often, however, authors do not follow this pattern. An example is found in Ahmed (2013) , who described how migrants experience settling into a new country. She presents excerpts from interviews and her interpretation of them, including organizing them into a typology, but she does not bring additional research and theory into her interpretations.

Tensions can arise between how much space to give to literature reviews and how much to allot to presentation of informants’ accounts/findings ( Gilgun, 2005 c ). This happened in the most recent article I co-wrote, which is on mothers’ perspectives on the signs of child sexual abuse ( Gilgun & Anderson, 2013 ). We believed the literature review was important because it not only set up our research but summarized a great deal of information that was important to our intended audience of social service professionals. We also wanted to anticipate the expectations of reviewers and the journal editor. Yet, we put much effort into making the literature review as concise as possible in order to have reasonable space for findings. We wrote the literature review before we did data analysis. When we wrote up the results, the first draft was probably three times longer than any journal article could be.

We had written case studies first to be sure that we understood each case in detail. We had wanted to share what the women said in the kind of detail that had helped us deepen our own understandings, so we cut back on the case material. The article was still too long. We decided to exclude the few instances we had in which women knew of the abuse but tried to handle it themselves or did not believe the children when told. We did more summarizing of the literature review. We eliminated many references.

After much effort, we finally had a manuscript that was the required length of twenty-two pages. It included a literature review that set up the research in good form, an adequate accounting of the method, and findings that conveyed with grab the complexities of the signs and lack of signs of child sexual abuse. We wove points made in the literature review into our interpretations, yet we had to leave out important patterns for the sake of space. The editor’s decision was a revise and resubmit, which we did. The main recommendation was to elaborate on applications. This was a great suggestion, and we dug deep to think about this. We are pleased with the results. We had to do further reading on topics we had not anticipated at the onset of our project, and we squeezed in a few new citations in the discussion section that related to implications of the research. This additional material greatly enhanced the meanings and usefulness of the research.

There is much more to say about qualitative research and literature reviews. Sometimes researchers get stuck, as I have more than once. I have research that I have not yet published because I have been unable to figure out how to do the multiple literature reviews I think I must show how my theory builds on, adds to, and challenges what is already known. I have written up this research as conference papers, where expectations about literature reviews are more relaxed ( Gilgun, 1996c , 1998 , 1999c , 2000 ). One of these. papers was on a comprehensive theory of interpersonal violence ( Gilgun, 2000 ). I wanted to write my theory first and then show how the findings contribute to what is already known. Doing so doesn’t seem so outlandish today, and I now can imagine writing it up exactly as I would want to. At the same time, I wonder if I would? I really don’t know if any journal that would publish a theory of violence would also accept an article that places a literature review after findings. Furthermore, my writing up of the theory would take so many pages that I would not have enough space to do a comprehensive literature review. As of today, the theory I am developing has links to sixteen or more bodies of literature. No way can I publish a journal-length article that will accommodate that much research and theory!

So, here I am, many years into the development of a comprehensive theory, still reflecting on how to create journal articles out of my analysis. I have published many articles in social media outlets exploring ideas that are the basis for the theory. I have put these articles into collections that are available on the internet ( Gilgun, 2012 b ; 2012 c ; 2013 a ). The theory is so complex that writing bits and pieces over the years and having a place to put them have been very helpful.

Finally, some articles may cite few if any related research and theory. This may fit articles whose purpose is to convey lived experience that stands on its own. These articles feature performances, plays, autoethnographies, fictionalized accounts, poetry, and song, among others. Egbe (2013) wrote two poems that she explained were accounts of her experiences of doing research in Nigeria with young smokers. She said she was “dazed by the vast opportunity this method gives a researcher to dig deep into a research problem and be submerged into the world of participants” (p. 353). Her two-page article is composed of two poems and her explanation. The article showed grab, evidence of immersion, experiences in contexts, and multiple perspectives. Her work, therefore, followed well-established guidelines for writing up qualitative research. Egbe not only omitted a literature review, but she did not write about how to use the results of her research, assuming that its uses are self-evident. Obviously, she thought a literature review unnecessary; the reviewers and journal editors agreed with her.

Reflexivity Statements

A growing number of journals encourage researchers to include reflexivity statements in research reports. Researchers may place these in the introductory material of an article, after the literature review and before the methods section; this probably is the most important place to put them because reflexivity statements often influence the focus and design of the research, including the choice of sensitizing concepts and codes. Reflexivity statements may also appear in the methods and findings and methods sections when important. Reflexivity statements are accounts of researchers’ experiences with the topic of research; accounts of their expectations regarding informant issues and their relationships to informants, especially in regard to power differentials and other ethical concerns; and accounts of their reflections on various issues related to possible experiences that informants may have had. They also may include the experience they had while participating in the research ( D’Cruz, Gillingham, & Melendez, 2007 ; Presser, 2005 ). My article on doing research on violence is an extended reflexivity statement ( Gilgun, 2008 ). There appears to be no standard content for reflexivity statements and no standard places for them to appear. Personal and professional experiences and reflections on power differentials may be the emergent standard. Whatever decisions researchers make about reflexivity statements, they alert audiences to researchers’ perspectives, which can be helpful to readers as they attempt to make sense of research reports.

An example of a reflexivity statement is found in Winter (2010) work. Winter is a practitioner turned researcher who had a previous relationship as a guardian ad litem with the children with whom she later conducted the research that she was reporting. Winter was reflexive about the implications of her prior relationship with these children. I imagine, based on my own experience, that she put only a fraction of her thinking into her article. Not only did she write in her reflexivity statement that she had a prior relationship with the children, but she also wrote about the ethical issues involved.

Ethical issues have a place in reflexivity statements. I have run into ethical questions over the course of my research career. One situation that stands out is the encounter I had with a mother and her eleven-year-old daughter who had participated in my dissertation research on child sexual abuse ( Gilgun, 1983 ). The mother cried and told her daughter how sorry she was that she had been unable to protect her from sexual abuse. The girl was touched but did not seem to know what to do. I suggested that she go stand by her mother. When she got close, the mother and daughter hugged each other and cried. This is a significant event with ethical implications that I included in the findings section of my dissertation and in a subsequent research report ( Gilgun, 1984 ). The ethical issue is, first, whether I should have stepped out of my role as detached researcher and guided the girl to go to her mother, and, second, whether I should have made my blurring of boundaries public by publishing them.

As far as the placement of reflexivity statements, the initial statement has a logical location after the literature review because the reflexivity statement contributes to the development of the research questions, the identification of sensitizing concepts, the interview schedule, and the overall design of research procedures. Accounts of ongoing reflexivity could be part the findings section and of the discussion section. Reflexivity statements are not a standard part of research reports, but they can contribute to readers’ understandings of the research.

Along with the literature review, reflexivity statements contribute to practical and applied significance statements and may also help to identify gaps in knowledge. Literature reviews and reflexivity statements contain key concepts. The concepts that researchers define at the end of introductory sections typically become codes during analysis, although researchers may not label the concepts as codes either in the introductory section or in the methods section. I am unsure why such labeling has not become routine. When concepts carry the label code , this clarifies where codes come from. Without naming codes and stating where they come from, much of analysis is mystified. Many reports read as if the codes appear out of nowhere during analysis. Even Glaser’s (1978) notion of theoretical sensitivity mystifies the origins of codes. How, for example, do researchers become theoretically sensitive? What if researchers are beginning their scholarly careers? How theoretically sensitive are they ( Covan, 2007 )? What are the implications for the quality of the analysis?

Research Questions, Hypotheses, and Definitions

The final part of the introductory section of a research report is devoted to research questions, hypotheses to be tested (if any), and definitions of core concepts. In general, in qualitative research, hypotheses are statements of relationships between concepts. Theories usually are composed of two or more hypotheses, although, at times, some researchers may use the term theory to designate a single hypothesis ( Gilgun, 2005 b ). Concepts are extractions from concrete data. Sometimes concepts are called second-order concepts and data first-order concepts .

Research questions may be absent. In their place are purpose statements that make the focus of the report clear. Hypotheses are rarely present in qualitative research. When they are, the purpose of the research is to test them and typically to develop them more fully. This type of research has in the past been called analytic induction ( Gilgun, 1995 e), whereas a more up-to-date version of qualitative hypothesis testing and theory-guided research is called deductive qualitative analysis ( Gilgun, 2005 d ; 2013 ). Analytic induction and deductive qualitative analysis are part of the Chicago School tradition.

Methods Section

Most methods sections for reports based on qualitative approaches have the same elements as any other research report. Descriptions of the sample, recruitment, interview schedule, and plans for data analysis are standard. The APA manual provides guidelines ( American Psychological Association, 2009 ) that fit many types of qualitative research reports. However, reports based on autoethnographies, poetry, and performances may have brief or no methods sections. As is clear by now, the report’s contents depend on the purposes and methodologies of the research and on the editorial requirements of journals.

Accounts of Methodologies

In writing up qualitative research, methods sections usually contain a brief overview of the research methodology, which is the set of principles that guided the research. The following is an account of the methodology used in a research report on cancer treatment in India:

For this project we drew upon interpretive traditions within qualitative research. This involved us taking an in-depth exploratory approach to data collection, aimed at documenting the subjective and complex experiences of the respondents. Our aim was to achieve a detailed understanding of the varying positions adhered to, and to locate those within a broader spectrum underlying beliefs and/or agendas. ( Broom & Doron, 2013 , p. 57)

Sometimes, statements of methodology are much more elaborate, but in research reports, such a statement is sufficient, again depending on the editorial policies of particular journals. A few citations, which this article had, round out an adequate statement of methodology.

However, many reports are written in a clear and straightforward way with scant or no account of methodologies. Examples are the work of Eck (2013) and Spermon, Darlington, and Gibney (2013) . These kinds of well-done write-ups might eventually be considered generic. Spermon et al. said their study was phenomenological, which sets up assumptions that the report will be primarily descriptive. In actuality, the intent was to develop theory. Such mixing of methodologies may be the wave of the future; in many ways, distinctions between phenomenological studies whose purposes are descriptive and those whose purposes are to build theory are blurred. Such blurring may have been the case for decades because it is possible and often desirable to build theories based on phenomenological perspectives; that is, in-depth descriptions of lived experience. However, authors are wise to state in one place what their methodologies are and how they put them to use, such as for descriptive purposes or for theory-building.

Description of Sample

Placing descriptions of sample size and the demographics of the sample in the methods sections is typical. As mentioned earlier, evaluation of sample size depends on the depth and breadth of the study. The more depth a study has, the smaller the number of cases can be. The more breadth and the sharper the focus, the larger sample sizes typically are. Samples on which a study is based must provide enough material on which to base a credible article. A sample size of one may be adequate if researchers show their work demonstrates the basic principles of almost all forms of qualitative research: perspectives of persons who participate in the research, researcher immersion into the settings or the life stories of persons interviewed, multiple perspectives, contextual information of various types, and applications. Autoethnographies often have an n of one, but joint autoethnographies are possible. Ethnographies may not give a sample size, as was the case in the performance ethnography of Valásquez (2011) who wrote in the first person about her experience with scientology. In her first-person ethnography, Irvine (2013) also did not mention sample size. She said that the narratives she used for the article were from a larger study on the meanings of animals to people who have no homes. She did not describe the usual demographics of age, gender, social class, and ethnicity.

Most articles describe the demographics of the sample. In a recently accepted article ( Gilgun & Anderson, 2013 ), I saw no relevance in mentioning the size of the larger sample from which we drew in order to tell the stories of how mothers responded to their learning that their husbands or life partners had sexually abused their children. We included an exact count of the larger sample because we assumed that it would be the journal’s expectations. We also gave particulars of the demographics. Except for social class and ethnicity, we saw little relevance for the other descriptors. These status variables were relevant to us because most of the sample was white and middle or upper class. This is important because much research on child sexual abuse is done with poor people, and there are stereotypes that poor families and families of color are more likely to experience incest than are white middle and upper class families. Overall, as with some other issues related to writing, the adequacy of the sample description depends on the methodological principles of the research and the journal’s editorial policies.

Recruitment

Accounts of recruitment procedures are important because researchers want to show that their work is ethical. Respect for the autonomy or freedom of choice of participants needs to be demonstrated. In addition, often the persons in whose lives we are interested have vulnerabilities. To show that the research procedures have not exploited these vulnerabilities is part of ethical considerations. Most articles have these accounts. Furthermore, when there are accounts of recruitment procedures, it becomes obvious why the sample is not randomly selected. Irvine’s (2013) account of recruitment is exemplary. She recruited through veterinary clinics that took care of the pets of homeless persons. She did not approach potential participants herself. Doing so risked making refusals difficult. The staff informed persons of the research and its purposes. If individuals said they were interested, they gave permission for the staff to give their names to researchers. The research interviews took place in the clinics.

The ethics of recruitment revolve around values, such as respect for autonomy, dignity, and worth. Other ethical issues that are important to mention in reports include the use of incentives for participation. Although many human subjects committees now require monetary incentives for participation, this has ethical implications. Irvine (2013) solved this by giving gift cards after the interviews were completed. Reports on ethical issues have a place in methods sections.

Data Collection and Analysis

Accounts of data collection and analysis are part of the methods section. Data collection procedures should be detailed for many reasons. Primary among them is the need for transparency in terms of the ethical standards the researchers followed, as well as the need to allow for replication of the study. Such details also provide guidelines for others who might be interested in using the methods. In addition, there are many different schools of thought and procedures for each of the methods used with the three general types of data collection: interviews, observations, and documents. It is helpful to state which particular data collection procedures the researchers used. Researchers often provide examples of the kinds of questions asked and procedures used for recording observations and excerpts from documents. Some researchers may omit such an accounting, as with some autoethnographies and articles that turn research material into performances.

How researchers analyzed data is part of the methods sections. As with data collection, there are so many types of analysis that researchers need to describe the particular forms that they used. For figuring out how to report on data analysis, researchers would do well to study articles in journals in which they want to publish. Irvine (2013) used a method of analysis I have never heard of called “personal narrative analysis” (p. 8). She gave enough detail to provide the general idea of what she did and a sufficient number of citations for additional information.

The level of detail can vary. In some sociology journals, for example, researchers may say little about analysis and sometimes little about data collection. This is because the journal editors, reviewers, and those who publish in and read the articles have assumptions that they for the most part take for granted. Even in these journals, however, researchers may want to account for their analytic procedures, especially if they are writing on topics outside of what is usual in such journals.

Other journals require a great deal of detail. In those instances, researchers first decide what they think is essential and then shape their accounts to fit what appears to be usual practice in the journal. The following paragraphs describe data analysis in a recently accepted article on signs of child sexual abuse in families ( Gilgun & Anderson, 2013 ).

Data Analysis

In the analysis of data, the first author read the transcripts multiple times and coded them for instances related to disclosures of child sexual abuse and associated signs of the abuse, such as how and when the women first learned of the abuse or suspected it was occurring in their families, their responses, and their reflections on the signs of abuse they might have missed, as well as child and perpetrator behaviors that they did not realize were related to child sexual abuse. Their initial and longer term responses and reflections were also coded. The second author independently read and coded about one-third of the transcripts using this coding scheme to arrive at a 100 percent agreement.

Sources of the codes were our professional experiences in the area of child sexual abuse, the review of research, and the first author’s familiarity with the content of the interviews because she had been the interviewer. These codes served as sensitizing concepts, which, as Blumer (1986) explained, are ideas that guide researchers to see aspects of phenomena that they might otherwise not notice. Although altering researchers’ ideas to what might be significant serves an obvious useful purpose, sensitizing concepts might also may blind researchers to other aspects of phenomena that might be important. Therefore, we also used negative case analysis, which is a procedure that guides researchers to look for aspects of phenomena that contradict or do not fit with emerging understandings. In this way, researchers are positioned to see patterns, variations within patterns, exceptions, and contradictions in findings ( Becker et al., 1961 ; Bogdan & Biklen, 2007 ; Cressey, 1953 ; Lindesmith, 1947 ).

As we wrote this section, we were aware of the limited space that we had to fill. Yet we were committed to accounting for where our codes came from for reviewers and editors who may be unfamiliar with pre-established codes. As discussed earlier, many reports are written as if codes appear by magic. We decided that, in this report, we would be as clear as possible about where our codes came from. We also reasoned that we would have to call on the authority of well-respected methodologists if reviewers and editors had questions about what we had done. Furthermore, we were aware of the dated nature of the references; we could do nothing about that because there has not been much written recently about pre-established codes. I have written about this quite a bit, but as one of the authors, I not only had to be anonymous during the review process, but I could not be the sole authority.

Generalizability

Many reviewers and editors have questions about the generalizability of the results of qualitative research. Authors themselves sometimes question the generalizability of their own findings. That’s why it remains important to provide clear guidelines in research reports about how the authors view the usefulness of their findings. The following ideas may be helpful to authors as they write their reports and to reviewers who are positioned as gatekeepers. The results of qualitative research are not meant to be generalized in a probabilistic sense. But because dropouts and refusals limit the randomness of samples, most forms of research can’t be generalized in a probabilistic sense.

Conversely, as Cronbach (1975) wrote almost forty years ago, the results of any form of research are working hypotheses that must be tested in local settings. Thus, the applicability of qualitative or any other kind of research can be demonstrated only through attempts at application. Do the findings illuminate other situations? Do the results provide researchers, policy makers, and direct practitioners with ideas on how to proceed? Those who apply the research expect to have to adjust findings to fit particular new situations. Many researchers and some journal editors and reviewers know through common sense and everyday experience how to use the results of qualitative research. Our personal lives are extended case studies. What we learn in one situation, we carry over into another. We know we have to test what we have learned in past situations for fit with new situations. If we do not, we impose our ideas on situations that may demand new perspectives. This common practice of applying results to all situations is disrespectful of local conditions and autonomy of persons. We want to avoid such disrespect in how we suggest readers use the results of our research.

Trustworthiness and Authenticity

Pointing out the trustworthiness of procedures and the findings that result from them sometimes are parts of methods sections. Related to trustworthiness are issues of authenticity ( Guba & Lincoln, 2005 ). Both trustworthiness and authenticity arise from immersion, seeking to understand the perspectives of others in context, reflexivity, and seeking multiple points of view. Researchers who have applied these principles will produce reports that are trustworthy and authentic. In addition, the reports will have grab. Extended discussions related to these issues are beyond the scope of this chapter and the scope of research reports as well.

I get more requests for revisions of methods sections, especially for accounts of data collection and analysis, than for any other parts of a manuscript. This is not surprising, given the multiple possible variations. I never know who the reviewers will be and what their expectations are. I rely first on my beliefs about what I want in the procedures section and then I study articles the journal has already publishes. I include what journal editors appear to expect, but I also add information that I think is important, even when it is not part of what I see in methods sections.

Findings Sections

Findings sections in research reports include both descriptive and conceptual material. Descriptive material is composed of researchers’ paraphrasing and summarizing of what they found and excerpts from interviews, fieldnotes, and documents. The descriptive material, at its best, is detailed and lively; it not only is informative, it has grab. This material contributes to understandings of human experiences in context. In addition, descriptive material is the basis of researchers’ theorizing and it also provides documentation and illustrations of assertions that researchers make.

Conceptual material comprises the analysis and is made up of inferences such as the general statements, concepts, and hypotheses that researchers develop from the material (data). One way to think about the relationship between descriptive and conceptual material is to think of descriptive material as composed of first-order concepts and conceptual material as composed of second-order concepts. Each type depends on the other. Credible conceptual material is based on descriptive material, some of which is contained in the article. Qualitative research yields mountains of data, a fraction of which can be placed into a published article.

As with other sections of research reports, findings sections have many possible variations that depend on the purpose of the research and the methodologies on which the research is based. Thus, the findings can range from heavily descriptive to heavily conceptual. Heavily conceptual research reports arise from research whose purpose is theoretical, in which researchers set out to test, refine, reformulate, or develop theory. Theoretical reports require some descriptive material to show the basis of theoretical statements, but they are often relatively short on descriptive material.

Reports that are primarily descriptive are composed of excerpts from data. Theoretical material appears in often subtle ways, such as in the form of concepts that organize findings. Irvine’s (2013) study of homeless people and their pets is largely descriptive, composed of excerpts from the interviews and Irvine’s paraphrases and narration of what she did, how, and when. The findings were narrative case studies based on interviews and observations. The details of the narratives were vivid and had the kind of grab that Glaser (1978) recommended. They showed multiples perspectives and variations on what it meant to homeless informants to have pets in their lives. The first three pages were a review of relevant literature and a presentation of method. The last five pages were a discussion of the findings.

As lengthy as the descriptive material is, conceptual material frames the entire report. In the literature review, Irvine introduced notions of positive identity, generativity, and redemption. She used them to analyze her data and organize findings, which were the narrative case studies. She used the concept of redemption as the core or organizing concept, going into some detail about how the research material supports the significance of this idea of pets as redemptive for homeless people.

This analysis is based squarely on the descriptive material. For instance, Irvine wrote that in the stories she presented in her article, “animals provide the vehicle for redemption.” She illustrated this point with a quote from one of the narratives and then reminded readers that the narratives “contain variations on the theme” of “ life is better because this animal is in it ” (p. 20; emphasis in original). Readers do not take this on faith because the basis of this general statement in presented multiple times in the case studies. Irvine has much more material on which she based these ideas, but there is not enough room in a journal-length article to show all of her evidence.

An example of an article that is theoretical in purpose and short on descriptive material is found in the work of Cordeau (2012) . She developed a grounded theory of the “transition from student to professional nurse” when student nurses work with “mannequins as simulated patients” (p. 90). Based on interviews, observations, and reports that the students wrote on their clinical experiences, the study was composed of about 10 percent descriptive material. This material included excerpts interviews and student reports. In the results section, she used this descriptive material to illustrate and possibly document the grounded theory she constructed. The theory’s “core category” was “linking,” which had four components, called properties. She documented the properties, primarily with her own thinking about her research material and also with excerpts from interviews, observations, and student reports.

Like Irvine’s (2013) study, the purpose of Cordeau’s (2012) work was applied where she wanted to build theory that would contribute to the development of clinical expertise in nursing students. She also devoted about one page of her study to applications.

Core Concepts

I’ve previously provided an extended discussion of core concepts. This section highlights some key points and illustrates them. Core concepts, often called core categories , organize findings. I prefer the term concept because concept is the term used in discussing theory, such as “concepts are the building blocks of theory,” and theory is one of several possible products of qualitative research. Researchers decide on which concepts are core in the course of analysis. Researchers are ready to write up their reports when they have settled on, named, and dimensionalized one or more core concepts. The terms “core concepts” and “core categories” are associated with grounded theory ( Charmaz, 2006 ; Corbin & Strauss, 2008 ), but they are useful in other types of qualitative research, such as interpretive phenomenology and narrative analysis. Core concepts both organize findings and, typically, bring together a great deal of information. The term “dimension” means that researchers account for as many aspects of the core concepts as they can in order to show the multiple perspectives and patterns that typically compose concepts.

In reporting on core concepts, I recommend that researchers name them, introduce them, describe them using excerpts from the research material, comment on them, and then situate each of the concepts and their commentaries within their scholarly contexts. As discussed earlier, this shows how the findings fit with what is already known, or add to, force modification of, or refute what is known. Although many researchers, do not situate findings in their scholarly contexts, they usually cover the other topics.

No matter how authors report findings, they should do so with grab. An example of a report exemplary for its grab is the work of Scott (2003) on what it means to be a professional with a physical disability. Scott began her article not with a literature review but with three reviewer comments on other articles she had written. She then stated that the present article was a response to these comments. She followed up with a description of three male students who waited to speak to her after class about her disability and the notion of embodiment that she discussed in class. She brought in related literature throughout the article. Through her own reflections, reports on how others have responded to her, reports on the accounts that three other women with disabilities gave to her as a person with cerebral palsy, and her literature review, Scott not only showed the meanings of disabilities to persons who have them, but also what others say about their own disabilities, what some people who are able-bodied say about women with disabilities, and how all of this connects to what is known about disabilities and to wide-spread beliefs about disabilities. Her article is full of grab, such as the header that read, “The Day I Became Human.” With the authors’ own experience as the centerpiece, this article exemplifies write-ups that demonstrate the meanings of lived experience in various contexts, immersion, grab, and implications for social action. The analysis she presented as part of her findings is exemplary.

In the production of quality research, no matter the type of write-up, there are no short cuts. Research reports based on poetry, for example, are held to the same standards as any other article: grab, immersion, lived experience in context, and implications for action. In addition, such research reports typically locate themselves within social and human sciences traditions. Furman’s (2007) reflections and analysis of poetry that he wrote over the course of many years provide an example of how poetry can be used in qualitative analysis. This kind of research is a type of document analysis. In performance studies, researchers create a theater production of informant’s accounts of their experiences whose purpose is to transform audiences and move them to action ( Saldaña, 2003 ). The performances are the equivalent of research reports and when they are effective, they have the four characteristics of qualitative research under discussion.

Discussion Sections

In traditional research reports, the discussion section follows the results section. In discussion sections, authors reflect on findings, including what the findings are, how findings contribute to understandings of phenomena of interest, the lines of inquiry the results open up, and implications for policy and practice. Other generic topics to consider are those related to the focus of the journal. For example, if the journal’s focus is related to health, then authors show how findings are related to health.

Discussion sections present the author with opportunities to advocate for how his or her research can be used. The applied purposes of Irvine’s (2013) research come through when she devoted an entire page to make observations about implications. She pointed out how her research contributes to a transformation of images of homeless persons as isolated to images of them as engaged in relationships not only with their pets but with other persons, too. She noted that rehousing homeless persons requires a change in policy that would allow them to have pets. Furthermore, she said that caring for a pet “can turn things around” (p. 24).

In the discussion section I wrote with Anderson ( Gilgun & Anderson, 2013 ), we addressed methodological issues, such as the probable existence of other patterns in addition to those we identified and the nonrandom nature of our sample. We also acknowledged the difficulties in working with families in which child sexual abuse has occurred. Since qualitative researchers want to understand lived experiences, we had to prepare ourselves to deal effectively in research areas that are difficult emotionally for us as researchers. Although we may acknowledge the emotional challenges of some topics in reflexivity statements, discussion sections are opportunities for authors to acknowledge the difficulties of using the results we produce. In the article I wrote with Anderson, we made such an acknowledgment, one that we hoped would facilitate more effective practice. We wrote

Practitioners themselves may experience shock, rage, and disgust. The practice of neutrality, in its therapeutic sense, is important in these cases ( Gil & Johnson, 1993 ; Rober, 2011 ). Neutrality means that practitioners maintain their analytic stances while at the same time they remain attuned not only to service users but also to themselves. When practicing neutrality, service providers regulate their own emotional responses in order to remain emotionally available to service users. Neutrality also means that service providers remain open-minded so that they can hear stories that they may not expect to hear; in other words, to make room for the unexpected ( Rober, 2011 ). Attunement to inner processes is a form of reflection that can facilitate the development of trust between service users and providers. When providers are reflective, they are less likely to tune out, close down, and otherwise stop listening to what services users express. When they listen and hear what service users say, they are more likely to facilitate the best possible outcomes in difficult situations ( Weingarten, 2012 ).

Doing research on lived experience can be difficult for informants and for researchers. Acknowledgment of the implications of these difficulties for users of the research has a place in discussion sections.

In summary, most articles are fairly straightforward in their write-ups: focused literature reviews, reflexivity statements in many cases, clear statements of purpose, clarity about sources of research questions and/or hypotheses, identification and definition of key concepts, identification of codes the researcher develops from literature reviews and reflexivity statements, succinct accounting of methods, and findings organized logically by core concepts around which the researcher organizes the multiple dimensions of those concepts. Excellent writing makes articles interesting and accessible. Some kinds of write-ups deviate from these components, but they are held to the same standards of immersion, experiences in context, multiple perspectives, and implications for action and other applications. When authors have the good fortune to have a recommendation to revise and resubmit, suggestions for revisions often improve the quality of the article.

The seemingly endless variations that are possible in the write-up of qualitative research makes writing and reviewing manuscripts challenging, especially when compared to traditions in which rigid rules prevail. However, it is important that approaches to qualitative research continue to evolve to meet with our ever-changing understandings of human phenomena. The clarity and transparency of reports are the fundamental guidelines for making judgments about quality. I often tell my students that the guidelines for doing qualitative research are flexible, and what is important is to be clear about what you did, why you did it, and what you came up with.

The notion of grab is central to write-up. Since qualitative research seeks to understand lived experiences, it is logical that findings report on the lived experiences in vivid terms, replete with quotes from data. This is not to undermine the importance of analysis, but grab is possible even in write-ups that require a great deal of analysis. Grab becomes possible because researchers must provide the evidence for the theories and concepts they develop.

When there are questions about priorities related to informants’ voices, researchers’ interpretations, and prior research, I hope that authors, reviewers, and editors remember that as important as analysis and previous work may be, the voices of informants bring these other important parts of manuscripts to life. Researchers make decisions about whose voices take priority.

There is no one way to respond to these dilemmas. Authors must make their own decisions about what is important to them and then search for journals that will welcome what they want to convey. It’s important to consider pushing the boundaries and writing an article in a way that the researcher thinks will best convey his or her findings.

The importance of quality data, quality analysis, and “grab” are foundational. I began this chapter with a discussion of the balance between description and analysis. I then considered core concepts as organizers of findings, the place of literature reviews, styles of presenting methods and methodologies, and the balance between the voices of informants and researchers. I concluded with the many variations in types of reports that result from the various purposes that qualitative research projects can have. There are many different types of qualitative research and many styles of write-ups. This chapter may sensitize readers to enduring issues in the writing of research reports. Like qualitative research itself, there are multiple points of view on how to write up qualitative research.

Ahmed, A. ( 2013 ). Structural narrative analysis: Understanding experiences of lifestyle migration through two plot typologies. Qualitative Inquiry , 19 , 231–243.

Google Scholar

American Psychological Association. ( 2009 ). The publication manual of the American Psychological Association (6th ed.). Washington, DC: American Psychological Association.

Google Preview

Becker, H. S. ( 1999 ). The Chicago School, so-called. Qualitative Sociology , 22 (1), 3–12.

Becker, H. S. , Geer, B. , Hughes, E. C. , & Strauss, A. L. ( 1961 ). Boys in white: Student culture in medical school . Chicago: University of Chicago Press.

Block, E. ( 2012 ). “That’s what I see:” Enhancing AIDS intervention research through deep ethnography. Qualitative Social Work 14 ( 4 ), 379–394.

Bogdan, R. C. , & Biklen, S. K. ( 2007 ). Qualitative research for education: An introduction to theories and methods (5th ed.). Boston, MA: Allyn & Bacon.

Bennet, B. , Zubrzycki, J. , & Bacon, V. ( 2011 ). What do we know? The experiences of social workers working alongside aboriginal people. Australian Social Work , 64 (1), 20–37.

Blumer, H. ( 1986 ). The methodological position of symbolic interactionism. In H. Blumer (Ed.), Symbolic interactionism: Perspective and method (pp. 1–60). Berkeley: University of California Press.

Bulmer, M. ( 1984 ). The Chicago School of Sociology: Institutionalization, diversity, and the rise of sociological research . Chicago: University of Chicago Press.

Broom, A. F. , & Doron, A. ( 2013 ). Traditional medicines, collective negotiation, and representations of risks in Indian cancer care. Qualitative Health Research , 23 (1), 54–65.

Charmaz, K. ( 2006 ). Constructing Grounded Theory: A practical guide through qualitative analysis . London: Sage.

Corbin, J. , & Straus, A. ( 2008 ). Basics of qualitative research (3rd. ed.). Thousand Oaks, CA: Sage.

Cordeau, M. A. ( 2012 ). Linking the transition: A substantive theory of high stakes clinical simulation. Advances in Nursing Science , 35 (3), E90–E102.

Covan, E. K. ( 2007 ). The discovery of grounded theory in practice: The legacy of multiple methods. In A. Bryant & K. Charmaz (Eds.), The Sage handbook of grounded theory (pp. 58–93). Thousand Oaks, CA: Sage.

Cressey, D. R. ( 1953 ). Other people’s money . Belmont, CA: Wadsworth.

Cronbach, L. ( 1975 ). Beyond the two disciplines of scientific psychology. American Psychologist , 30 , 116–127.

D’Cruz, H. , Gillingham, P. , & Melendez, S. ( 2007 ). Reflexivity, its meanings and relevance for social work: A critical review of the literature. British Journal of Social Work , 37 (1), 73–90.

Dollard, J. ( 1937 ). Caste and class in a southern town . New Haven, CT: Yale University Press.

Eck, B. ( 2013 ). How never-married men make sense of an unintended identity. Journal of Contemporary Ethnography , 42 (1), 31–63.

Egbe, C. O. ( 2013 ). Descriptive poems on a qualitative research with young smokers in southern Nigeria (2013). Qualitative Inquiry , 19 (5), 353–354.

Ellis, C. ( 2009 ). Revision: Autoethnographic reflections on life and work . Walnut Creek, CA: Left Coast Press.

Faris, R. E. L. ( 1967 ). Chicago sociology 1920-1932 . Chicago: University of Chicago Press.

Furman, R. ( 2007 ). Poetry and narrative as qualitative data: Explorations into existential theory. The Indo-Pacific Journal of Phenomenology , 7 , 1–9.

Geertz, C. ( 1973 ). The interpretation of culture . New York: Basic.

Gil, E. , & Johnson, T. C. ( 1993 ). Sexualized children: Assessment and treatment of sexualized children and children who molest . Rockville, MD: Launch Press.

Gilgun, J. F. ( 1983 ). The sexual abuse of the young female in life course perspective. 3058 . Ann Arbor, MI: Dissertations Abstracts International.

Gilgun, J. F. (1984). A non-coercive method of helping children discuss their own sexual abuse. Part II: An example of intervention by multiple qualitative case studies. Scribd.com . Retrieved from http://www.scribd.com/doc/117051267/A-Non-Coercive-Method-of-Helping-Children-Discuss-Their-Own-Sexual-Abuse .

Gilgun, J. F. ( 1995 ). “We shared something special”: The moral discourse of incest perpetrators. Journal of Marriage and the Family , 57 , 265–281.

Gilgun, J. F. ( 1996 a). Human development and adversity in ecological perspective: Part 1: A conceptual framework. Families in Society , 77 , 395–402.

Gilgun, J. F. ( 1996 b). Human development and adversity in ecological perspective, Part 2: Three patterns. Families in Society , 77 , 459–576.

Gilgun, Jane F. (l996c November). The phenomenology of family violence. Paper presented at the Preconference Workshop on Theory Construction and Research Methodology, National Council on Family Relations, Kansas City, MO, November 5.

Gilgun, J. F. (1998, November). A comprehensive theory of family violence. Paper presented at the 28th Preconference Workshop on Theory Construction and Research Methodology, National Council on Family Relations , Milwaukee, WI.

Gilgun, J. F. ( 1999 a). CASPARS: New tools for assessing client risks and strengths. Families in Society , 80 (5), 450–459.

Gilgun, J. F. (1999c, November). In their own words: Men talk about their violence . Paper presented at the 29th Preconference Workshop on Theory Construction and Research Methodology, National Council on Family Relations , Irvine, CA.

Gilgun, Jane F. ( 1999 d ). Methodological pluralism and qualitative family research. In Suzanne K. Steinmetz , Marvin B. Sussman , and Gary W. Peterson (Eds.), Handbook of Marriage and the Family (2nd ed.) (pp. 219–261). New York: Plenum.

Gilgun, J. F. (2000, June 25–28). A comprehensive theory of interpersonal violence . Paper presented at the Victimization of Children and Youth: An International Research Conference, Durham, NH .

Gilgun, J. F. ( 2002 a). Completing the circle: American Indian medicine wheels and the promotion of resilience in children and youth in care. Journal of Human Behavior and the Social Environment , 6 (2), 65–84.

Gilgun, J. F. ( 2002 b). Social work and the assessment of the potential for violence. In T. N. Tiong & I. Dodds (Eds.), Social work around the world II (pp. 58–74). Berne, Switzerland: International Federation of Social Workers.

Gilgun, J. F. ( 2004 a). A strengths-based approach to child and family assessment. In D. R. Catheral (Ed.), Handbook of stress, trauma and the family (pp. 307–324). New York: Bruner-Routledge.

Gilgun, J. F. ( 2004 b). The 4-D: Strengths-based assessments for youth who’ve experienced adversities. Journal of Human Behavior in the Social Environment , 10 (4), 51–73 .

Gilgun, J. F. ( 2005 a). Evidence-based practice, descriptive research, and the resilience-schema-gender-brain (RSGB) assessment. British Journal of Social Work , 35 (6), 843–862.

Gilgun, J. F. ( 2005 b). “ Grab” and good science: Writing up the results of qualitative research. Qualitative Health Research , 15 (2), 256–262.

Gilgun, J. F. ( 2005 c). Lighten up! The citation dilemma in qualitative research. Qualitative Health Research , 15 (5), 721–725.

Gilgun, J. F. ( 2005 d). Qualitative research and family psychology. Journal of Family Psychology , 19 (1), 40–50.

Gilgun, J. F. ( 2006 ). Children and adolescents with problematic sexual behaviors: Lessons from research on resilience. In R. Longo & D. Prescott (Eds.), Current perspectives on working with sexually aggressive youth and youth with sexual behavior problems (pp. 383–394). Holyoke, MA: Neari Press.

Gilgun, Jane F. (2007, November). The legacy of the Chicago School of Sociology for family theory-building, Pre-Conference Workshop on Theory Construction and Research Methodology, National Council on Family Relation, Pittsburgh, PA, November 7.

Gilgun, J. F. ( 2008 ). Lived experience, reflexivity, and research on perpetrators of interpersonal violence. Qualitative Social Work , 7 (2), 181–197.

Gilgun, J. F. ( 2010 ). Reflections on 25 years of research on violence. Reflections: Narratives of Professional Helping , 16 (4), 50–59.

Gilgun, J. F. ( 2012 a). Enduring themes in qualitative family research. Journal of Family Theory and Review , 4 , 80–95.

Gilgun, J. F. (2012b). School shootings are not senseless and other essays on violence . Amazon. http://www.amazon.com/s/ref=nb_sb_noss?url=search-alias%3Ddigital-text&field-keywords=school+shootings+are+not+senseless . Retrieved 2 January 2014.

Gilgun, J. F. (2012c). The thin blue line of police brutality & other essays . Amazon. http://www.amazon.com/s/ref=nb_sb_noss?url=search-alias%3Ddigital-text&field-keywords=the+thin+blue+line+of+police+brutality&rh=n%3A133140011%2Ck%3Athe+thin+blue+line+of+police+brutality . Retrieved 2 January 2014.

Gilgun, J. F. (2013a). The logic of murderous rampages & other essays on violence and its prevention (2nd ed.). Amazon. http://www.amazon.com/Murderous-Rampages-Essays-Violence-Prevention-ebook/dp/B00AYPR18A/ref=sr_1_2?s=digital-text&ie=UTF8&qid=1388681278&sr=1-2&keywords=the+logic+of+murderous+rampages . Retrieved 2 January 2014.

Gilgun, J. F. ( 2013 b). Qualitative family research: Enduring themes and contemporary variations. In G. F. Peterson & K. Bush (Eds.), Handbook of marriage and the family (3rd ed., pp. 91–119). New York: Plenum.

Gilgun, J. F. , & Abrams, L. S. ( 2005 ). Gendered adaptations, resilience, and the perpetration of violence. In M. Ungar (Ed.), Handbook for working with children and Youth: Pathways to resilience across cultures and context (pp. 57–70). Toronto: University of Toronto Press.

Gilgun, J. F. , & Anderson, G. ( 2013 ). Mothers’ perspectives on signs of child sexual abuse in their families. Families in Society , 94 (4), 259–267.

Gilgun, J. F. , Daly, K. , & Handel, G. (Eds.). ( 1992 ). Qualitative methods in family research . Newbury Park, CA: SAGE Publications.

Gilgun, J. F. , Keskinen, S. , Marti, D. J. , & Rice, K. ( 1999 ). Clinical applications of the CASPARS instruments: Boys who act out sexually. Families in Society , 80 (6), 629–641.

Gilgun, J. F. , Klein, C. , & Pranis, K. ( 2000 ). The significance of resources in models of risk. Journal of Interpersonal Violence , 14 , 627–646.

Gilgun, J. F. , & Sands, R. G. (Eds.). ( 2012 ). Special issue: The contributions of qualitative approaches to developmental intervention research. Qualitative Social Work: Research and Practice , 11 (4), 80–95.

Gilgun, J. F. , & Sussman, M. B. (Eds.). ( 1996 ). The methods and methodologies of qualitative family research . New York: Haworth. Also published as a special issue of Marriage and Family Review , 41 (1–2).

Glaser, B. ( 1978 ). Theoretical sensitivity . Mill Valley, CA: Sociology Press.

Glaser, B. , & Strauss, A. ( 1967 ). The discovery of grounded theory . Chicago: Aldine.

Guba, E. G. , & Lincoln, Y. S. ( 2005 ). Paradigmatic controversies, contradictions, and emerging confluences. In N. K. Denzin & Y. S. Lincoln (Eds.), The Sage handbook of qualitative research (3rd ed.). Thousand Oaks, CA: Sage.

Irvine, L. ( 2013 ). Animals as lifechangers and lifesavers: Pets in the redemptive narratives of homeless people. Journal of Contemporary Ethnography , 42 (1), 3–30.

Lindesmith, A. ( 1947 ). Opiate addictions . Bloomington, IN: Principia.

McKinney, J. C. ( 1966 ). Constructive typology and social theory . New York: Appleton-Century-Crofts.

Presser, L. ( 2005 ). Negotiating power and narrative in research: Implications for feminist methodology. Signs: Journal of Women in Culture and Society , 30 (4), 2067–2090.

Rober, P. ( 2011 ). The therapist’s experiencing in family therapy practice. Journal of Family Therapy , 33 , 233–255.

Saldaña, J. ( 2003 ). Dramatizing data: A primer. Qualitative Inquiry , 9 , 218–236.

Schatzman, L. ( 1991 ). Dimensional analysis: Notes on an alternative approach to the grounding of theory in qualitative research. In D. R. Maines (Ed.), Social organizations and social process: Essays in honor of Anselm Strauss (pp. 303–314). New York: Aldine de Gruyter.

Scott, J. A. ( 2003 ). Problematizing a researcher’s performance of “insider status:” An autoethnography of “designer disabled” identity. Qualitative Inquiry , 19 , 101–115.

Sharma, A. , & Gilgun, J. F. ( 2008 ). What perpetrators say about child sexual abuse. Indian Journal of Social Work , 69 (3), 321–338.

Small, A. W. ( 1916 ). Fifty years of sociology in the United States, 1865–1915. American Journal of Sociology , 21 , 712–864.

Spermon, D. Darlington, Y , & Gibney, P. ( 2013 ). Complex posttraumatic stress disorder: Voice of healing. Qualitative Health Research , 24 (1), 43–53.

Velásquez, G. ( 2011 ). Inside the Church of Scientology: An ethnographic performance script. Qualitative Inquiry , 17 , 824–836.

Weingarten, K. ( 2012 ). Sorrow: A therapist’s reflection on the inevitable and the unknowable. Family Process , 51 (4), 440–455.

Winter, K. ( 2010 ). The perspectives of young children in care. Child and Family Social Work , 15 , 186–195.

Young, P. V. (l928). The reorganization of Jewish family life in America. Social Forces , 7 , 238–243.

Young, P. V. (l932). The Pilgrims of Russian Town . Chicago: University of Chicago Press.

About Oxford Academic
Publish journals with us
University press partners
What we publish
New features
Open access
Institutional account management
Rights and permissions
Get help with access
Accessibility
Advertising
Media enquiries
Oxford University Press
Oxford Languages
University of Oxford

Oxford University Press is a department of the University of Oxford. It furthers the University's objective of excellence in research, scholarship, and education by publishing worldwide

Copyright © 2024 Oxford University Press
Cookie settings
Cookie policy
Privacy policy
Legal notice

This Feature Is Available To Subscribers Only

This PDF is available to Subscribers Only

For full access to this pdf, sign in to an existing account, or purchase an annual subscription.

Open access
Published: 27 May 2020

How to use and assess qualitative research methods

Loraine Busetto ORCID: orcid.org/0000-0002-9228-7875 1 ,
Wolfgang Wick 1 , 2 &
Christoph Gumbinger 1

Neurological Research and Practice volume 2 , Article number: 14 ( 2020 ) Cite this article

742k Accesses

307 Citations

84 Altmetric

Metrics details

This paper aims to provide an overview of the use and assessment of qualitative research methods in the health sciences. Qualitative research can be defined as the study of the nature of phenomena and is especially appropriate for answering questions of why something is (not) observed, assessing complex multi-component interventions, and focussing on intervention improvement. The most common methods of data collection are document study, (non-) participant observations, semi-structured interviews and focus groups. For data analysis, field-notes and audio-recordings are transcribed into protocols and transcripts, and coded using qualitative data management software. Criteria such as checklists, reflexivity, sampling strategies, piloting, co-coding, member-checking and stakeholder involvement can be used to enhance and assess the quality of the research conducted. Using qualitative in addition to quantitative designs will equip us with better tools to address a greater range of research problems, and to fill in blind spots in current neurological research and practice.

The aim of this paper is to provide an overview of qualitative research methods, including hands-on information on how they can be used, reported and assessed. This article is intended for beginning qualitative researchers in the health sciences as well as experienced quantitative researchers who wish to broaden their understanding of qualitative research.

What is qualitative research?

Qualitative research is defined as “the study of the nature of phenomena”, including “their quality, different manifestations, the context in which they appear or the perspectives from which they can be perceived” , but excluding “their range, frequency and place in an objectively determined chain of cause and effect” [ 1 ]. This formal definition can be complemented with a more pragmatic rule of thumb: qualitative research generally includes data in form of words rather than numbers [ 2 ].

Why conduct qualitative research?

Because some research questions cannot be answered using (only) quantitative methods. For example, one Australian study addressed the issue of why patients from Aboriginal communities often present late or not at all to specialist services offered by tertiary care hospitals. Using qualitative interviews with patients and staff, it found one of the most significant access barriers to be transportation problems, including some towns and communities simply not having a bus service to the hospital [ 3 ]. A quantitative study could have measured the number of patients over time or even looked at possible explanatory factors – but only those previously known or suspected to be of relevance. To discover reasons for observed patterns, especially the invisible or surprising ones, qualitative designs are needed.

While qualitative research is common in other fields, it is still relatively underrepresented in health services research. The latter field is more traditionally rooted in the evidence-based-medicine paradigm, as seen in " research that involves testing the effectiveness of various strategies to achieve changes in clinical practice, preferably applying randomised controlled trial study designs (...) " [ 4 ]. This focus on quantitative research and specifically randomised controlled trials (RCT) is visible in the idea of a hierarchy of research evidence which assumes that some research designs are objectively better than others, and that choosing a "lesser" design is only acceptable when the better ones are not practically or ethically feasible [ 5 , 6 ]. Others, however, argue that an objective hierarchy does not exist, and that, instead, the research design and methods should be chosen to fit the specific research question at hand – "questions before methods" [ 2 , 7 , 8 , 9 ]. This means that even when an RCT is possible, some research problems require a different design that is better suited to addressing them. Arguing in JAMA, Berwick uses the example of rapid response teams in hospitals, which he describes as " a complex, multicomponent intervention – essentially a process of social change" susceptible to a range of different context factors including leadership or organisation history. According to him, "[in] such complex terrain, the RCT is an impoverished way to learn. Critics who use it as a truth standard in this context are incorrect" [ 8 ] . Instead of limiting oneself to RCTs, Berwick recommends embracing a wider range of methods , including qualitative ones, which for "these specific applications, (...) are not compromises in learning how to improve; they are superior" [ 8 ].

Research problems that can be approached particularly well using qualitative methods include assessing complex multi-component interventions or systems (of change), addressing questions beyond “what works”, towards “what works for whom when, how and why”, and focussing on intervention improvement rather than accreditation [ 7 , 9 , 10 , 11 , 12 ]. Using qualitative methods can also help shed light on the “softer” side of medical treatment. For example, while quantitative trials can measure the costs and benefits of neuro-oncological treatment in terms of survival rates or adverse effects, qualitative research can help provide a better understanding of patient or caregiver stress, visibility of illness or out-of-pocket expenses.

How to conduct qualitative research?

Given that qualitative research is characterised by flexibility, openness and responsivity to context, the steps of data collection and analysis are not as separate and consecutive as they tend to be in quantitative research [ 13 , 14 ]. As Fossey puts it : “sampling, data collection, analysis and interpretation are related to each other in a cyclical (iterative) manner, rather than following one after another in a stepwise approach” [ 15 ]. The researcher can make educated decisions with regard to the choice of method, how they are implemented, and to which and how many units they are applied [ 13 ]. As shown in Fig. 1 , this can involve several back-and-forth steps between data collection and analysis where new insights and experiences can lead to adaption and expansion of the original plan. Some insights may also necessitate a revision of the research question and/or the research design as a whole. The process ends when saturation is achieved, i.e. when no relevant new information can be found (see also below: sampling and saturation). For reasons of transparency, it is essential for all decisions as well as the underlying reasoning to be well-documented.

Iterative research process

While it is not always explicitly addressed, qualitative methods reflect a different underlying research paradigm than quantitative research (e.g. constructivism or interpretivism as opposed to positivism). The choice of methods can be based on the respective underlying substantive theory or theoretical framework used by the researcher [ 2 ].

Data collection

The methods of qualitative data collection most commonly used in health research are document study, observations, semi-structured interviews and focus groups [ 1 , 14 , 16 , 17 ].

Document study

Document study (also called document analysis) refers to the review by the researcher of written materials [ 14 ]. These can include personal and non-personal documents such as archives, annual reports, guidelines, policy documents, diaries or letters.

Observations

Observations are particularly useful to gain insights into a certain setting and actual behaviour – as opposed to reported behaviour or opinions [ 13 ]. Qualitative observations can be either participant or non-participant in nature. In participant observations, the observer is part of the observed setting, for example a nurse working in an intensive care unit [ 18 ]. In non-participant observations, the observer is “on the outside looking in”, i.e. present in but not part of the situation, trying not to influence the setting by their presence. Observations can be planned (e.g. for 3 h during the day or night shift) or ad hoc (e.g. as soon as a stroke patient arrives at the emergency room). During the observation, the observer takes notes on everything or certain pre-determined parts of what is happening around them, for example focusing on physician-patient interactions or communication between different professional groups. Written notes can be taken during or after the observations, depending on feasibility (which is usually lower during participant observations) and acceptability (e.g. when the observer is perceived to be judging the observed). Afterwards, these field notes are transcribed into observation protocols. If more than one observer was involved, field notes are taken independently, but notes can be consolidated into one protocol after discussions. Advantages of conducting observations include minimising the distance between the researcher and the researched, the potential discovery of topics that the researcher did not realise were relevant and gaining deeper insights into the real-world dimensions of the research problem at hand [ 18 ].

Semi-structured interviews

Hijmans & Kuyper describe qualitative interviews as “an exchange with an informal character, a conversation with a goal” [ 19 ]. Interviews are used to gain insights into a person’s subjective experiences, opinions and motivations – as opposed to facts or behaviours [ 13 ]. Interviews can be distinguished by the degree to which they are structured (i.e. a questionnaire), open (e.g. free conversation or autobiographical interviews) or semi-structured [ 2 , 13 ]. Semi-structured interviews are characterized by open-ended questions and the use of an interview guide (or topic guide/list) in which the broad areas of interest, sometimes including sub-questions, are defined [ 19 ]. The pre-defined topics in the interview guide can be derived from the literature, previous research or a preliminary method of data collection, e.g. document study or observations. The topic list is usually adapted and improved at the start of the data collection process as the interviewer learns more about the field [ 20 ]. Across interviews the focus on the different (blocks of) questions may differ and some questions may be skipped altogether (e.g. if the interviewee is not able or willing to answer the questions or for concerns about the total length of the interview) [ 20 ]. Qualitative interviews are usually not conducted in written format as it impedes on the interactive component of the method [ 20 ]. In comparison to written surveys, qualitative interviews have the advantage of being interactive and allowing for unexpected topics to emerge and to be taken up by the researcher. This can also help overcome a provider or researcher-centred bias often found in written surveys, which by nature, can only measure what is already known or expected to be of relevance to the researcher. Interviews can be audio- or video-taped; but sometimes it is only feasible or acceptable for the interviewer to take written notes [ 14 , 16 , 20 ].

Focus groups

Focus groups are group interviews to explore participants’ expertise and experiences, including explorations of how and why people behave in certain ways [ 1 ]. Focus groups usually consist of 6–8 people and are led by an experienced moderator following a topic guide or “script” [ 21 ]. They can involve an observer who takes note of the non-verbal aspects of the situation, possibly using an observation guide [ 21 ]. Depending on researchers’ and participants’ preferences, the discussions can be audio- or video-taped and transcribed afterwards [ 21 ]. Focus groups are useful for bringing together homogeneous (to a lesser extent heterogeneous) groups of participants with relevant expertise and experience on a given topic on which they can share detailed information [ 21 ]. Focus groups are a relatively easy, fast and inexpensive method to gain access to information on interactions in a given group, i.e. “the sharing and comparing” among participants [ 21 ]. Disadvantages include less control over the process and a lesser extent to which each individual may participate. Moreover, focus group moderators need experience, as do those tasked with the analysis of the resulting data. Focus groups can be less appropriate for discussing sensitive topics that participants might be reluctant to disclose in a group setting [ 13 ]. Moreover, attention must be paid to the emergence of “groupthink” as well as possible power dynamics within the group, e.g. when patients are awed or intimidated by health professionals.

Choosing the “right” method

As explained above, the school of thought underlying qualitative research assumes no objective hierarchy of evidence and methods. This means that each choice of single or combined methods has to be based on the research question that needs to be answered and a critical assessment with regard to whether or to what extent the chosen method can accomplish this – i.e. the “fit” between question and method [ 14 ]. It is necessary for these decisions to be documented when they are being made, and to be critically discussed when reporting methods and results.

Let us assume that our research aim is to examine the (clinical) processes around acute endovascular treatment (EVT), from the patient’s arrival at the emergency room to recanalization, with the aim to identify possible causes for delay and/or other causes for sub-optimal treatment outcome. As a first step, we could conduct a document study of the relevant standard operating procedures (SOPs) for this phase of care – are they up-to-date and in line with current guidelines? Do they contain any mistakes, irregularities or uncertainties that could cause delays or other problems? Regardless of the answers to these questions, the results have to be interpreted based on what they are: a written outline of what care processes in this hospital should look like. If we want to know what they actually look like in practice, we can conduct observations of the processes described in the SOPs. These results can (and should) be analysed in themselves, but also in comparison to the results of the document analysis, especially as regards relevant discrepancies. Do the SOPs outline specific tests for which no equipment can be observed or tasks to be performed by specialized nurses who are not present during the observation? It might also be possible that the written SOP is outdated, but the actual care provided is in line with current best practice. In order to find out why these discrepancies exist, it can be useful to conduct interviews. Are the physicians simply not aware of the SOPs (because their existence is limited to the hospital’s intranet) or do they actively disagree with them or does the infrastructure make it impossible to provide the care as described? Another rationale for adding interviews is that some situations (or all of their possible variations for different patient groups or the day, night or weekend shift) cannot practically or ethically be observed. In this case, it is possible to ask those involved to report on their actions – being aware that this is not the same as the actual observation. A senior physician’s or hospital manager’s description of certain situations might differ from a nurse’s or junior physician’s one, maybe because they intentionally misrepresent facts or maybe because different aspects of the process are visible or important to them. In some cases, it can also be relevant to consider to whom the interviewee is disclosing this information – someone they trust, someone they are otherwise not connected to, or someone they suspect or are aware of being in a potentially “dangerous” power relationship to them. Lastly, a focus group could be conducted with representatives of the relevant professional groups to explore how and why exactly they provide care around EVT. The discussion might reveal discrepancies (between SOPs and actual care or between different physicians) and motivations to the researchers as well as to the focus group members that they might not have been aware of themselves. For the focus group to deliver relevant information, attention has to be paid to its composition and conduct, for example, to make sure that all participants feel safe to disclose sensitive or potentially problematic information or that the discussion is not dominated by (senior) physicians only. The resulting combination of data collection methods is shown in Fig. 2 .

Possible combination of data collection methods

Attributions for icons: “Book” by Serhii Smirnov, “Interview” by Adrien Coquet, FR, “Magnifying Glass” by anggun, ID, “Business communication” by Vectors Market; all from the Noun Project

The combination of multiple data source as described for this example can be referred to as “triangulation”, in which multiple measurements are carried out from different angles to achieve a more comprehensive understanding of the phenomenon under study [ 22 , 23 ].

Data analysis

To analyse the data collected through observations, interviews and focus groups these need to be transcribed into protocols and transcripts (see Fig. 3 ). Interviews and focus groups can be transcribed verbatim , with or without annotations for behaviour (e.g. laughing, crying, pausing) and with or without phonetic transcription of dialects and filler words, depending on what is expected or known to be relevant for the analysis. In the next step, the protocols and transcripts are coded , that is, marked (or tagged, labelled) with one or more short descriptors of the content of a sentence or paragraph [ 2 , 15 , 23 ]. Jansen describes coding as “connecting the raw data with “theoretical” terms” [ 20 ]. In a more practical sense, coding makes raw data sortable. This makes it possible to extract and examine all segments describing, say, a tele-neurology consultation from multiple data sources (e.g. SOPs, emergency room observations, staff and patient interview). In a process of synthesis and abstraction, the codes are then grouped, summarised and/or categorised [ 15 , 20 ]. The end product of the coding or analysis process is a descriptive theory of the behavioural pattern under investigation [ 20 ]. The coding process is performed using qualitative data management software, the most common ones being InVivo, MaxQDA and Atlas.ti. It should be noted that these are data management tools which support the analysis performed by the researcher(s) [ 14 ].

From data collection to data analysis

Attributions for icons: see Fig. 2 , also “Speech to text” by Trevor Dsouza, “Field Notes” by Mike O’Brien, US, “Voice Record” by ProSymbols, US, “Inspection” by Made, AU, and “Cloud” by Graphic Tigers; all from the Noun Project

How to report qualitative research?

Protocols of qualitative research can be published separately and in advance of the study results. However, the aim is not the same as in RCT protocols, i.e. to pre-define and set in stone the research questions and primary or secondary endpoints. Rather, it is a way to describe the research methods in detail, which might not be possible in the results paper given journals’ word limits. Qualitative research papers are usually longer than their quantitative counterparts to allow for deep understanding and so-called “thick description”. In the methods section, the focus is on transparency of the methods used, including why, how and by whom they were implemented in the specific study setting, so as to enable a discussion of whether and how this may have influenced data collection, analysis and interpretation. The results section usually starts with a paragraph outlining the main findings, followed by more detailed descriptions of, for example, the commonalities, discrepancies or exceptions per category [ 20 ]. Here it is important to support main findings by relevant quotations, which may add information, context, emphasis or real-life examples [ 20 , 23 ]. It is subject to debate in the field whether it is relevant to state the exact number or percentage of respondents supporting a certain statement (e.g. “Five interviewees expressed negative feelings towards XYZ”) [ 21 ].

How to combine qualitative with quantitative research?

Qualitative methods can be combined with other methods in multi- or mixed methods designs, which “[employ] two or more different methods [ …] within the same study or research program rather than confining the research to one single method” [ 24 ]. Reasons for combining methods can be diverse, including triangulation for corroboration of findings, complementarity for illustration and clarification of results, expansion to extend the breadth and range of the study, explanation of (unexpected) results generated with one method with the help of another, or offsetting the weakness of one method with the strength of another [ 1 , 17 , 24 , 25 , 26 ]. The resulting designs can be classified according to when, why and how the different quantitative and/or qualitative data strands are combined. The three most common types of mixed method designs are the convergent parallel design , the explanatory sequential design and the exploratory sequential design. The designs with examples are shown in Fig. 4 .

Three common mixed methods designs

In the convergent parallel design, a qualitative study is conducted in parallel to and independently of a quantitative study, and the results of both studies are compared and combined at the stage of interpretation of results. Using the above example of EVT provision, this could entail setting up a quantitative EVT registry to measure process times and patient outcomes in parallel to conducting the qualitative research outlined above, and then comparing results. Amongst other things, this would make it possible to assess whether interview respondents’ subjective impressions of patients receiving good care match modified Rankin Scores at follow-up, or whether observed delays in care provision are exceptions or the rule when compared to door-to-needle times as documented in the registry. In the explanatory sequential design, a quantitative study is carried out first, followed by a qualitative study to help explain the results from the quantitative study. This would be an appropriate design if the registry alone had revealed relevant delays in door-to-needle times and the qualitative study would be used to understand where and why these occurred, and how they could be improved. In the exploratory design, the qualitative study is carried out first and its results help informing and building the quantitative study in the next step [ 26 ]. If the qualitative study around EVT provision had shown a high level of dissatisfaction among the staff members involved, a quantitative questionnaire investigating staff satisfaction could be set up in the next step, informed by the qualitative study on which topics dissatisfaction had been expressed. Amongst other things, the questionnaire design would make it possible to widen the reach of the research to more respondents from different (types of) hospitals, regions, countries or settings, and to conduct sub-group analyses for different professional groups.

How to assess qualitative research?

A variety of assessment criteria and lists have been developed for qualitative research, ranging in their focus and comprehensiveness [ 14 , 17 , 27 ]. However, none of these has been elevated to the “gold standard” in the field. In the following, we therefore focus on a set of commonly used assessment criteria that, from a practical standpoint, a researcher can look for when assessing a qualitative research report or paper.

Assessors should check the authors’ use of and adherence to the relevant reporting checklists (e.g. Standards for Reporting Qualitative Research (SRQR)) to make sure all items that are relevant for this type of research are addressed [ 23 , 28 ]. Discussions of quantitative measures in addition to or instead of these qualitative measures can be a sign of lower quality of the research (paper). Providing and adhering to a checklist for qualitative research contributes to an important quality criterion for qualitative research, namely transparency [ 15 , 17 , 23 ].

Reflexivity

While methodological transparency and complete reporting is relevant for all types of research, some additional criteria must be taken into account for qualitative research. This includes what is called reflexivity, i.e. sensitivity to the relationship between the researcher and the researched, including how contact was established and maintained, or the background and experience of the researcher(s) involved in data collection and analysis. Depending on the research question and population to be researched this can be limited to professional experience, but it may also include gender, age or ethnicity [ 17 , 27 ]. These details are relevant because in qualitative research, as opposed to quantitative research, the researcher as a person cannot be isolated from the research process [ 23 ]. It may influence the conversation when an interviewed patient speaks to an interviewer who is a physician, or when an interviewee is asked to discuss a gynaecological procedure with a male interviewer, and therefore the reader must be made aware of these details [ 19 ].

Sampling and saturation

The aim of qualitative sampling is for all variants of the objects of observation that are deemed relevant for the study to be present in the sample “ to see the issue and its meanings from as many angles as possible” [ 1 , 16 , 19 , 20 , 27 ] , and to ensure “information-richness [ 15 ]. An iterative sampling approach is advised, in which data collection (e.g. five interviews) is followed by data analysis, followed by more data collection to find variants that are lacking in the current sample. This process continues until no new (relevant) information can be found and further sampling becomes redundant – which is called saturation [ 1 , 15 ] . In other words: qualitative data collection finds its end point not a priori , but when the research team determines that saturation has been reached [ 29 , 30 ].

This is also the reason why most qualitative studies use deliberate instead of random sampling strategies. This is generally referred to as “ purposive sampling” , in which researchers pre-define which types of participants or cases they need to include so as to cover all variations that are expected to be of relevance, based on the literature, previous experience or theory (i.e. theoretical sampling) [ 14 , 20 ]. Other types of purposive sampling include (but are not limited to) maximum variation sampling, critical case sampling or extreme or deviant case sampling [ 2 ]. In the above EVT example, a purposive sample could include all relevant professional groups and/or all relevant stakeholders (patients, relatives) and/or all relevant times of observation (day, night and weekend shift).

Assessors of qualitative research should check whether the considerations underlying the sampling strategy were sound and whether or how researchers tried to adapt and improve their strategies in stepwise or cyclical approaches between data collection and analysis to achieve saturation [ 14 ].

Good qualitative research is iterative in nature, i.e. it goes back and forth between data collection and analysis, revising and improving the approach where necessary. One example of this are pilot interviews, where different aspects of the interview (especially the interview guide, but also, for example, the site of the interview or whether the interview can be audio-recorded) are tested with a small number of respondents, evaluated and revised [ 19 ]. In doing so, the interviewer learns which wording or types of questions work best, or which is the best length of an interview with patients who have trouble concentrating for an extended time. Of course, the same reasoning applies to observations or focus groups which can also be piloted.

Ideally, coding should be performed by at least two researchers, especially at the beginning of the coding process when a common approach must be defined, including the establishment of a useful coding list (or tree), and when a common meaning of individual codes must be established [ 23 ]. An initial sub-set or all transcripts can be coded independently by the coders and then compared and consolidated after regular discussions in the research team. This is to make sure that codes are applied consistently to the research data.

Member checking

Member checking, also called respondent validation , refers to the practice of checking back with study respondents to see if the research is in line with their views [ 14 , 27 ]. This can happen after data collection or analysis or when first results are available [ 23 ]. For example, interviewees can be provided with (summaries of) their transcripts and asked whether they believe this to be a complete representation of their views or whether they would like to clarify or elaborate on their responses [ 17 ]. Respondents’ feedback on these issues then becomes part of the data collection and analysis [ 27 ].

Stakeholder involvement

In those niches where qualitative approaches have been able to evolve and grow, a new trend has seen the inclusion of patients and their representatives not only as study participants (i.e. “members”, see above) but as consultants to and active participants in the broader research process [ 31 , 32 , 33 ]. The underlying assumption is that patients and other stakeholders hold unique perspectives and experiences that add value beyond their own single story, making the research more relevant and beneficial to researchers, study participants and (future) patients alike [ 34 , 35 ]. Using the example of patients on or nearing dialysis, a recent scoping review found that 80% of clinical research did not address the top 10 research priorities identified by patients and caregivers [ 32 , 36 ]. In this sense, the involvement of the relevant stakeholders, especially patients and relatives, is increasingly being seen as a quality indicator in and of itself.

How not to assess qualitative research

The above overview does not include certain items that are routine in assessments of quantitative research. What follows is a non-exhaustive, non-representative, experience-based list of the quantitative criteria often applied to the assessment of qualitative research, as well as an explanation of the limited usefulness of these endeavours.

Protocol adherence

Given the openness and flexibility of qualitative research, it should not be assessed by how well it adheres to pre-determined and fixed strategies – in other words: its rigidity. Instead, the assessor should look for signs of adaptation and refinement based on lessons learned from earlier steps in the research process.

Sample size

For the reasons explained above, qualitative research does not require specific sample sizes, nor does it require that the sample size be determined a priori [ 1 , 14 , 27 , 37 , 38 , 39 ]. Sample size can only be a useful quality indicator when related to the research purpose, the chosen methodology and the composition of the sample, i.e. who was included and why.

Randomisation

While some authors argue that randomisation can be used in qualitative research, this is not commonly the case, as neither its feasibility nor its necessity or usefulness has been convincingly established for qualitative research [ 13 , 27 ]. Relevant disadvantages include the negative impact of a too large sample size as well as the possibility (or probability) of selecting “ quiet, uncooperative or inarticulate individuals ” [ 17 ]. Qualitative studies do not use control groups, either.

Interrater reliability, variability and other “objectivity checks”

The concept of “interrater reliability” is sometimes used in qualitative research to assess to which extent the coding approach overlaps between the two co-coders. However, it is not clear what this measure tells us about the quality of the analysis [ 23 ]. This means that these scores can be included in qualitative research reports, preferably with some additional information on what the score means for the analysis, but it is not a requirement. Relatedly, it is not relevant for the quality or “objectivity” of qualitative research to separate those who recruited the study participants and collected and analysed the data. Experiences even show that it might be better to have the same person or team perform all of these tasks [ 20 ]. First, when researchers introduce themselves during recruitment this can enhance trust when the interview takes place days or weeks later with the same researcher. Second, when the audio-recording is transcribed for analysis, the researcher conducting the interviews will usually remember the interviewee and the specific interview situation during data analysis. This might be helpful in providing additional context information for interpretation of data, e.g. on whether something might have been meant as a joke [ 18 ].

Not being quantitative research

Being qualitative research instead of quantitative research should not be used as an assessment criterion if it is used irrespectively of the research problem at hand. Similarly, qualitative research should not be required to be combined with quantitative research per se – unless mixed methods research is judged as inherently better than single-method research. In this case, the same criterion should be applied for quantitative studies without a qualitative component.

The main take-away points of this paper are summarised in Table 1 . We aimed to show that, if conducted well, qualitative research can answer specific research questions that cannot to be adequately answered using (only) quantitative designs. Seeing qualitative and quantitative methods as equal will help us become more aware and critical of the “fit” between the research problem and our chosen methods: I can conduct an RCT to determine the reasons for transportation delays of acute stroke patients – but should I? It also provides us with a greater range of tools to tackle a greater range of research problems more appropriately and successfully, filling in the blind spots on one half of the methodological spectrum to better address the whole complexity of neurological research and practice.

Availability of data and materials

Not applicable.

Abbreviations

Endovascular treatment

Randomised Controlled Trial

Standard Operating Procedure

Standards for Reporting Qualitative Research

Philipsen, H., & Vernooij-Dassen, M. (2007). Kwalitatief onderzoek: nuttig, onmisbaar en uitdagend. In L. PLBJ & H. TCo (Eds.), Kwalitatief onderzoek: Praktische methoden voor de medische praktijk . [Qualitative research: useful, indispensable and challenging. In: Qualitative research: Practical methods for medical practice (pp. 5–12). Houten: Bohn Stafleu van Loghum.

Chapter Google Scholar

Punch, K. F. (2013). Introduction to social research: Quantitative and qualitative approaches . London: Sage.

Kelly, J., Dwyer, J., Willis, E., & Pekarsky, B. (2014). Travelling to the city for hospital care: Access factors in country aboriginal patient journeys. Australian Journal of Rural Health, 22 (3), 109–113.

Article Google Scholar

Nilsen, P., Ståhl, C., Roback, K., & Cairney, P. (2013). Never the twain shall meet? - a comparison of implementation science and policy implementation research. Implementation Science, 8 (1), 1–12.

Howick J, Chalmers I, Glasziou, P., Greenhalgh, T., Heneghan, C., Liberati, A., Moschetti, I., Phillips, B., & Thornton, H. (2011). The 2011 Oxford CEBM evidence levels of evidence (introductory document) . Oxford Center for Evidence Based Medicine. https://www.cebm.net/2011/06/2011-oxford-cebm-levels-evidence-introductory-document/ .

Eakin, J. M. (2016). Educating critical qualitative health researchers in the land of the randomized controlled trial. Qualitative Inquiry, 22 (2), 107–118.

May, A., & Mathijssen, J. (2015). Alternatieven voor RCT bij de evaluatie van effectiviteit van interventies!? Eindrapportage. In Alternatives for RCTs in the evaluation of effectiveness of interventions!? Final report .

Google Scholar

Berwick, D. M. (2008). The science of improvement. Journal of the American Medical Association, 299 (10), 1182–1184.

Article CAS Google Scholar

Christ, T. W. (2014). Scientific-based research and randomized controlled trials, the “gold” standard? Alternative paradigms and mixed methodologies. Qualitative Inquiry, 20 (1), 72–80.

Lamont, T., Barber, N., Jd, P., Fulop, N., Garfield-Birkbeck, S., Lilford, R., Mear, L., Raine, R., & Fitzpatrick, R. (2016). New approaches to evaluating complex health and care systems. BMJ, 352:i154.

Drabble, S. J., & O’Cathain, A. (2015). Moving from Randomized Controlled Trials to Mixed Methods Intervention Evaluation. In S. Hesse-Biber & R. B. Johnson (Eds.), The Oxford Handbook of Multimethod and Mixed Methods Research Inquiry (pp. 406–425). London: Oxford University Press.

Chambers, D. A., Glasgow, R. E., & Stange, K. C. (2013). The dynamic sustainability framework: Addressing the paradox of sustainment amid ongoing change. Implementation Science : IS, 8 , 117.

Hak, T. (2007). Waarnemingsmethoden in kwalitatief onderzoek. In L. PLBJ & H. TCo (Eds.), Kwalitatief onderzoek: Praktische methoden voor de medische praktijk . [Observation methods in qualitative research] (pp. 13–25). Houten: Bohn Stafleu van Loghum.

Russell, C. K., & Gregory, D. M. (2003). Evaluation of qualitative research studies. Evidence Based Nursing, 6 (2), 36–40.

Fossey, E., Harvey, C., McDermott, F., & Davidson, L. (2002). Understanding and evaluating qualitative research. Australian and New Zealand Journal of Psychiatry, 36 , 717–732.

Yanow, D. (2000). Conducting interpretive policy analysis (Vol. 47). Thousand Oaks: Sage University Papers Series on Qualitative Research Methods.

Shenton, A. K. (2004). Strategies for ensuring trustworthiness in qualitative research projects. Education for Information, 22 , 63–75.

van der Geest, S. (2006). Participeren in ziekte en zorg: meer over kwalitatief onderzoek. Huisarts en Wetenschap, 49 (4), 283–287.

Hijmans, E., & Kuyper, M. (2007). Het halfopen interview als onderzoeksmethode. In L. PLBJ & H. TCo (Eds.), Kwalitatief onderzoek: Praktische methoden voor de medische praktijk . [The half-open interview as research method (pp. 43–51). Houten: Bohn Stafleu van Loghum.

Jansen, H. (2007). Systematiek en toepassing van de kwalitatieve survey. In L. PLBJ & H. TCo (Eds.), Kwalitatief onderzoek: Praktische methoden voor de medische praktijk . [Systematics and implementation of the qualitative survey (pp. 27–41). Houten: Bohn Stafleu van Loghum.

Pv, R., & Peremans, L. (2007). Exploreren met focusgroepgesprekken: de ‘stem’ van de groep onder de loep. In L. PLBJ & H. TCo (Eds.), Kwalitatief onderzoek: Praktische methoden voor de medische praktijk . [Exploring with focus group conversations: the “voice” of the group under the magnifying glass (pp. 53–64). Houten: Bohn Stafleu van Loghum.

Carter, N., Bryant-Lukosius, D., DiCenso, A., Blythe, J., & Neville, A. J. (2014). The use of triangulation in qualitative research. Oncology Nursing Forum, 41 (5), 545–547.

Boeije H: Analyseren in kwalitatief onderzoek: Denken en doen, [Analysis in qualitative research: Thinking and doing] vol. Den Haag Boom Lemma uitgevers; 2012.

Hunter, A., & Brewer, J. (2015). Designing Multimethod Research. In S. Hesse-Biber & R. B. Johnson (Eds.), The Oxford Handbook of Multimethod and Mixed Methods Research Inquiry (pp. 185–205). London: Oxford University Press.

Archibald, M. M., Radil, A. I., Zhang, X., & Hanson, W. E. (2015). Current mixed methods practices in qualitative research: A content analysis of leading journals. International Journal of Qualitative Methods, 14 (2), 5–33.

Creswell, J. W., & Plano Clark, V. L. (2011). Choosing a Mixed Methods Design. In Designing and Conducting Mixed Methods Research . Thousand Oaks: SAGE Publications.

Mays, N., & Pope, C. (2000). Assessing quality in qualitative research. BMJ, 320 (7226), 50–52.

O'Brien, B. C., Harris, I. B., Beckman, T. J., Reed, D. A., & Cook, D. A. (2014). Standards for reporting qualitative research: A synthesis of recommendations. Academic Medicine : Journal of the Association of American Medical Colleges, 89 (9), 1245–1251.

Saunders, B., Sim, J., Kingstone, T., Baker, S., Waterfield, J., Bartlam, B., Burroughs, H., & Jinks, C. (2018). Saturation in qualitative research: Exploring its conceptualization and operationalization. Quality and Quantity, 52 (4), 1893–1907.

Moser, A., & Korstjens, I. (2018). Series: Practical guidance to qualitative research. Part 3: Sampling, data collection and analysis. European Journal of General Practice, 24 (1), 9–18.

Marlett, N., Shklarov, S., Marshall, D., Santana, M. J., & Wasylak, T. (2015). Building new roles and relationships in research: A model of patient engagement research. Quality of Life Research : an international journal of quality of life aspects of treatment, care and rehabilitation, 24 (5), 1057–1067.

Demian, M. N., Lam, N. N., Mac-Way, F., Sapir-Pichhadze, R., & Fernandez, N. (2017). Opportunities for engaging patients in kidney research. Canadian Journal of Kidney Health and Disease, 4 , 2054358117703070–2054358117703070.

Noyes, J., McLaughlin, L., Morgan, K., Roberts, A., Stephens, M., Bourne, J., Houlston, M., Houlston, J., Thomas, S., Rhys, R. G., et al. (2019). Designing a co-productive study to overcome known methodological challenges in organ donation research with bereaved family members. Health Expectations . 22(4):824–35.

Piil, K., Jarden, M., & Pii, K. H. (2019). Research agenda for life-threatening cancer. European Journal Cancer Care (Engl), 28 (1), e12935.

Hofmann, D., Ibrahim, F., Rose, D., Scott, D. L., Cope, A., Wykes, T., & Lempp, H. (2015). Expectations of new treatment in rheumatoid arthritis: Developing a patient-generated questionnaire. Health Expectations : an international journal of public participation in health care and health policy, 18 (5), 995–1008.

Jun, M., Manns, B., Laupacis, A., Manns, L., Rehal, B., Crowe, S., & Hemmelgarn, B. R. (2015). Assessing the extent to which current clinical research is consistent with patient priorities: A scoping review using a case study in patients on or nearing dialysis. Canadian Journal of Kidney Health and Disease, 2 , 35.

Elsie Baker, S., & Edwards, R. (2012). How many qualitative interviews is enough? In National Centre for Research Methods Review Paper . National Centre for Research Methods. http://eprints.ncrm.ac.uk/2273/4/how_many_interviews.pdf .

Sandelowski, M. (1995). Sample size in qualitative research. Research in Nursing & Health, 18 (2), 179–183.

Sim, J., Saunders, B., Waterfield, J., & Kingstone, T. (2018). Can sample size in qualitative research be determined a priori? International Journal of Social Research Methodology, 21 (5), 619–634.

Download references

Acknowledgements

no external funding.

Author information

Authors and affiliations.

Department of Neurology, Heidelberg University Hospital, Im Neuenheimer Feld 400, 69120, Heidelberg, Germany

Loraine Busetto, Wolfgang Wick & Christoph Gumbinger

Clinical Cooperation Unit Neuro-Oncology, German Cancer Research Center, Heidelberg, Germany

Wolfgang Wick

You can also search for this author in PubMed Google Scholar

Contributions

LB drafted the manuscript; WW and CG revised the manuscript; all authors approved the final versions.

Corresponding author

Correspondence to Loraine Busetto .

Ethics declarations

Ethics approval and consent to participate, consent for publication, competing interests.

The authors declare no competing interests.

Additional information

Publisher’s note.

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ .

Reprints and permissions

About this article

Cite this article.

Busetto, L., Wick, W. & Gumbinger, C. How to use and assess qualitative research methods. Neurol. Res. Pract. 2 , 14 (2020). https://doi.org/10.1186/s42466-020-00059-z

Download citation

Received : 30 January 2020

Accepted : 22 April 2020

Published : 27 May 2020

DOI : https://doi.org/10.1186/s42466-020-00059-z

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

Qualitative research
Mixed methods
Quality assessment

Neurological Research and Practice

ISSN: 2524-3489

Submission enquiries: Access here and click Contact Us
General enquiries: [email protected]

how to read a qualitative research paper

How To Read A Paper

Papers that go beyond numbers (qualitative research) Trisha Greenhalgh, Rod Taylor
Papers that summarise other papers (systematic reviews and meta-analyses) Trisha Greenhalgh
Papers that tell you what things cost (economic analyses) Trisha Greenhalgh
Papers that report diagnostic or screening tests Trisha Greenhalgh
Papers that report drug trials Trisha Greenhalgh
Statistics for the non-statistician. II: “Significant” relations and their pitfalls Trisha Greenhalgh
Statistics for the non-statistician Trisha Greenhalgh
Assessing the methodological quality of published papers Trisha Greenhalgh
Getting your bearings (deciding what the paper is about) Trisha Greenhalgh
The Medline database Trisha Greenhalgh

Follow us on

Content links.

Collections
Health in South Asia
Women’s, children’s & adolescents’ health
News and views
BMJ Opinion
Rapid responses
Editorial staff
BMJ in the USA
BMJ in South Asia
Submit your paper
BMA members
Subscribers
Advertisers and sponsors

Explore BMJ

Our company
BMJ Careers
BMJ Learning
BMJ Masterclasses
BMJ Journals
BMJ Student
Academic edition of The BMJ
BMJ Best Practice
The BMJ Awards
Email alerts
Activate subscription

Information

USC Libraries
Research Guides

Organizing Your Social Sciences Research Paper

Reading Research Effectively
Purpose of Guide
Design Flaws to Avoid
Independent and Dependent Variables
Glossary of Research Terms
Narrowing a Topic Idea
Broadening a Topic Idea
Extending the Timeliness of a Topic Idea
Academic Writing Style
Applying Critical Thinking
Choosing a Title
Making an Outline
Paragraph Development
Research Process Video Series
Executive Summary
The C.A.R.S. Model
Background Information
The Research Problem/Question
Theoretical Framework
Citation Tracking
Content Alert Services
Evaluating Sources
Primary Sources
Secondary Sources
Tiertiary Sources
Scholarly vs. Popular Publications
Qualitative Methods
Quantitative Methods
Insiderness
Using Non-Textual Elements
Limitations of the Study
Common Grammar Mistakes
Writing Concisely
Avoiding Plagiarism
Footnotes or Endnotes?
Further Readings
Generative AI and Writing
USC Libraries Tutorials and Other Guides
Bibliography

Reading a Scholarly Article or Research Paper

Identifying a research problem to investigate requires a preliminary search for and critical review of the literature in order to gain an understanding about how scholars have examined a topic. Scholars rarely structure research studies in a way that can be followed like a story; they are complex and detail-intensive and often written in a descriptive and conclusive narrative form. However, in the social and behavioral sciences, journal articles and stand-alone research reports are generally organized in a consistent format that makes it easier to compare and contrast studies and to interpret their contents.

General Reading Strategies

W hen you first read an article or research paper, focus on asking specific questions about each section. This strategy can help with overall comprehension and with understanding how the content relates [or does not relate] to the problem you want to investigate. As you review more and more studies, the process of understanding and critically evaluating the research will become easier because the content of what you review will begin to coalescence around common themes and patterns of analysis. Below are recommendations on how to read each section of a research paper effectively. Note that the sections to read are out of order from how you will find them organized in a journal article or research paper.

1. Abstract

The abstract summarizes the background, methods, results, discussion, and conclusions of a scholarly article or research paper. Use the abstract to filter out sources that may have appeared useful when you began searching for information but, in reality, are not relevant. Questions to consider when reading the abstract are:

Is this study related to my question or area of research?
What is this study about and why is it being done ?
What is the working hypothesis or underlying thesis?
What is the primary finding of the study?
Are there words or terminology that I can use to either narrow or broaden the parameters of my search for more information?

2. Introduction

If, after reading the abstract, you believe the paper may be useful, focus on examining the research problem and identifying the questions the author is trying to address. This information is usually located within the first few paragraphs of the introduction or in the concluding paragraph. Look for information about how and in what way this relates to what you are investigating. In addition to the research problem, the introduction should provide the main argument and theoretical framework of the study and, in the last paragraphs of the introduction, describe what the author(s) intend to accomplish. Questions to consider when reading the introduction include:

What is this study trying to prove or disprove?
What is the author(s) trying to test or demonstrate?
What do we already know about this topic and what gaps does this study try to fill or contribute a new understanding to the research problem?
Why should I care about what is being investigated?
Will this study tell me anything new related to the research problem I am investigating?

3. Literature Review

The literature review describes and critically evaluates what is already known about a topic. Read the literature review to obtain a big picture perspective about how the topic has been studied and to begin the process of seeing where your potential study fits within the domain of prior research. Questions to consider when reading the literature review include:

W hat other research has been conducted about this topic and what are the main themes that have emerged?
What does prior research reveal about what is already known about the topic and what remains to be discovered?
What have been the most important past findings about the research problem?
How has prior research led the author(s) to conduct this particular study?
Is there any prior research that is unique or groundbreaking?
Are there any studies I could use as a model for designing and organizing my own study?

4. Discussion/Conclusion

The discussion and conclusion are usually the last two sections of text in a scholarly article or research report. They reveal how the author(s) interpreted the findings of their research and presented recommendations or courses of action based on those findings. Often in the conclusion, the author(s) highlight recommendations for further research that can be used to develop your own study. Questions to consider when reading the discussion and conclusion sections include:

What is the overall meaning of the study and why is this important? [i.e., how have the author(s) addressed the " So What? " question].
What do you find to be the most important ways that the findings have been interpreted?
What are the weaknesses in their argument?
Do you believe conclusions about the significance of the study and its findings are valid?
What limitations of the study do the author(s) describe and how might this help formulate my own research?
Does the conclusion contain any recommendations for future research?

5. Methods/Methodology

The methods section describes the materials, techniques, and procedures for gathering information used to examine the research problem. If what you have read so far closely supports your understanding of the topic, then move on to examining how the author(s) gathered information during the research process. Questions to consider when reading the methods section include:

Did the study use qualitative [based on interviews, observations, content analysis], quantitative [based on statistical analysis], or a mixed-methods approach to examining the research problem?
What was the type of information or data used?
Could this method of analysis be repeated and can I adopt the same approach?
Is enough information available to repeat the study or should new data be found to expand or improve understanding of the research problem?

6. Results

After reading the above sections, you should have a clear understanding of the general findings of the study. Therefore, read the results section to identify how key findings were discussed in relation to the research problem. If any non-textual elements [e.g., graphs, charts, tables, etc.] are confusing, focus on the explanations about them in the text. Questions to consider when reading the results section include:

W hat did the author(s) find and how did they find it?
Does the author(s) highlight any findings as most significant?
Are the results presented in a factual and unbiased way?
Does the analysis of results in the discussion section agree with how the results are presented?
Is all the data present and did the author(s) adequately address gaps?
What conclusions do you formulate from this data and does it match with the author's conclusions?

7. References

The references list the sources used by the author(s) to document what prior research and information was used when conducting the study. After reviewing the article or research paper, use the references to identify additional sources of information on the topic and to examine critically how these sources supported the overall research agenda. Questions to consider when reading the references include:

Do the sources cited by the author(s) reflect a diversity of disciplinary viewpoints, i.e., are the sources all from a particular field of study or do the sources reflect multiple areas of study?
Are there any unique or interesting sources that could be incorporated into my study?
What other authors are respected in this field, i.e., who has multiple works cited or is cited most often by others?
What other research should I review to clarify any remaining issues or that I need more information about?

NOTE: A final strategy in reviewing research is to copy and paste the title of the source [journal article, book, research report] into Google Scholar . If it appears, look for a "cited by" followed by a hyperlinked number [e.g., Cited by 45]. This number indicates how many times the study has been subsequently cited in other, more recently published works. This strategy, known as citation tracking, can be an effective means of expanding your review of pertinent literature based on a study you have found useful and how scholars have cited it. The same strategies described above can be applied to reading articles you find in the list of cited by references.

Reading Tip

Specific Reading Strategies

Effectively reading scholarly research is an acquired skill that involves attention to detail and an ability to comprehend complex ideas, data, and theoretical concepts in a way that applies logically to the research problem you are investigating. Here are some specific reading strategies to consider.

As You are Reading

Focus on information that is most relevant to the research problem; skim over the other parts.
As noted above, read content out of order! This isn't a novel; you want to start with the spoiler to quickly assess the relevance of the study.
Think critically about what you read and seek to build your own arguments; not everything may be entirely valid, examined effectively, or thoroughly investigated.
Look up the definitions of unfamiliar words, concepts, or terminology. A good scholarly source is Credo Reference .

Taking notes as you read will save time when you go back to examine your sources. Here are some suggestions:

Mark or highlight important text as you read [e.g., you can use the highlight text feature in a PDF document]
Take notes in the margins [e.g., Adobe Reader offers pop-up sticky notes].
Highlight important quotations; consider using different colors to differentiate between quotes and other types of important text.
Summarize key points about the study at the end of the paper. To save time, these can be in the form of a concise bulleted list of statements [e.g., intro has provides historical background; lit review has important sources; good conclusions].

Write down thoughts that come to mind that may help clarify your understanding of the research problem. Here are some examples of questions to ask yourself:

Do I understand all of the terminology and key concepts?
Do I understand the parts of this study most relevant to my topic?
What specific problem does the research address and why is it important?
Are there any issues or perspectives the author(s) did not consider?
Do I have any reason to question the validity or reliability of this research?
How do the findings relate to my research interests and to other works which I have read?

Adapted from text originally created by Holly Burt, Behavioral Sciences Librarian, USC Libraries, April 2018.

Another Reading Tip

When is it Important to Read the Entire Article or Research Paper

Laubepin argues, "Very few articles in a field are so important that every word needs to be read carefully." However, this implies that some studies are worth reading carefully. As painful and time-consuming as it may seem, there are valid reasons for reading a study from beginning to end. Here are some examples:

Studies Published Very Recently . The author(s) of a recent, well written study will provide a survey of the most important or impactful prior research in the literature review section. This can establish an understanding of how scholars in the past addressed the research problem. In addition, the most recently published sources will highlight what is currently known and what gaps in understanding currently exist about a topic, usually in the form of the need for further research in the conclusion .
Surveys of the Research Problem . Some papers provide a comprehensive analytical overview of the research problem. Reading this type of study can help you understand underlying issues and discover why scholars have chosen to investigate the topic. This is particularly important if the study was published very recently because the author(s) should cite all or most of the key prior research on the topic. Note that, if it is a long-standing problem, there may be studies that specifically review the literature to identify gaps that remain. These studies often include the word "review" in their title [e.g., Hügel, Stephan, and Anna R. Davies. "Public Participation, Engagement, and Climate Change Adaptation: A Review of the Research Literature." Wiley Interdisciplinary Reviews: Climate Change 11 (July-August 2020): https://doi.org/10.1002/ wcc.645].
Highly Cited . If you keep coming across the same citation to a study while you are reviewing the literature, this implies it was foundational in establishing an understanding of the research problem or the study had a significant impact within the literature [either positive or negative]. Carefully reading a highly cited source can help you understand how the topic emerged and how it motivated scholars to further investigate the problem. It also could be a study you need to cite as foundational in your own paper to demonstrate to the reader that you understand the roots of the problem.
Historical Overview . Knowing the historical background of a research problem may not be the focus of your analysis. Nevertheless, carefully reading a study that provides a thorough description and analysis of the history behind an event, issue, or phenomenon can add important context to understanding the topic and what aspect of the problem you may want to examine further.
Innovative Methodological Design . Some studies are significant and should be read in their entirety because the author(s) designed a unique or innovative approach to researching the problem. This may justify reading the entire study because it can motivate you to think creatively about pursuing an alternative or non-traditional approach to examining your topic of interest. These types of studies are generally easy to identify because they are often cited in others works because of their unique approach to investigating the research problem.
Cross-disciplinary Approach . R eviewing studies produced outside of your discipline is an essential component of investigating research problems in the social and behavioral sciences. Consider reading a study that was conducted by author(s) based in a different discipline [e.g., an anthropologist studying political cultures; a study of hiring practices in companies published in a sociology journal]. This approach can generate a new understanding or a unique perspective about the topic . If you are not sure how to search for studies published in a discipline outside of your major or of the course you are taking, contact a librarian for assistance.

Laubepin, Frederique. How to Read (and Understand) a Social Science Journal Article . Inter-University Consortium for Political and Social Research (ISPSR), 2013; Shon, Phillip Chong Ho. How to Read Journal Articles in the Social Sciences: A Very Practical Guide for Students . 2nd edition. Thousand Oaks, CA: Sage, 2015; Lockhart, Tara, and Mary Soliday. "The Critical Place of Reading in Writing Transfer (and Beyond): A Report of Student Experiences." Pedagogy 16 (2016): 23-37; Maguire, Moira, Ann Everitt Reynolds, and Brid Delahunt. "Reading to Be: The Role of Academic Reading in Emergent Academic and Professional Student Identities." Journal of University Teaching and Learning Practice 17 (2020): 5-12.

<< Previous: 1. Choosing a Research Problem
Next: Narrowing a Topic Idea >>
Last Updated: May 30, 2024 9:38 AM
URL: https://libguides.usc.edu/writingguide

Criteria for Good Qualitative Research: A Comprehensive Review

Regular Article
Open access
Published: 18 September 2021
Volume 31 , pages 679–689, ( 2022 )

Cite this article

You have full access to this open access article

Drishti Yadav ORCID: orcid.org/0000-0002-2974-0323 1

86k Accesses

32 Citations

72 Altmetric

Explore all metrics

This review aims to synthesize a published set of evaluative criteria for good qualitative research. The aim is to shed light on existing standards for assessing the rigor of qualitative research encompassing a range of epistemological and ontological standpoints. Using a systematic search strategy, published journal articles that deliberate criteria for rigorous research were identified. Then, references of relevant articles were surveyed to find noteworthy, distinct, and well-defined pointers to good qualitative research. This review presents an investigative assessment of the pivotal features in qualitative research that can permit the readers to pass judgment on its quality and to condemn it as good research when objectively and adequately utilized. Overall, this review underlines the crux of qualitative research and accentuates the necessity to evaluate such research by the very tenets of its being. It also offers some prospects and recommendations to improve the quality of qualitative research. Based on the findings of this review, it is concluded that quality criteria are the aftereffect of socio-institutional procedures and existing paradigmatic conducts. Owing to the paradigmatic diversity of qualitative research, a single and specific set of quality criteria is neither feasible nor anticipated. Since qualitative research is not a cohesive discipline, researchers need to educate and familiarize themselves with applicable norms and decisive factors to evaluate qualitative research from within its theoretical and methodological framework of origin.

Good Qualitative Research: Opening up the Debate

Beyond qualitative/quantitative structuralism: the positivist qualitative research and the paradigmatic disclaimer.

What is Qualitative in Research

Avoid common mistakes on your manuscript.

Introduction

“… It is important to regularly dialogue about what makes for good qualitative research” (Tracy, 2010 , p. 837)

To decide what represents good qualitative research is highly debatable. There are numerous methods that are contained within qualitative research and that are established on diverse philosophical perspectives. Bryman et al., ( 2008 , p. 262) suggest that “It is widely assumed that whereas quality criteria for quantitative research are well‐known and widely agreed, this is not the case for qualitative research.” Hence, the question “how to evaluate the quality of qualitative research” has been continuously debated. There are many areas of science and technology wherein these debates on the assessment of qualitative research have taken place. Examples include various areas of psychology: general psychology (Madill et al., 2000 ); counseling psychology (Morrow, 2005 ); and clinical psychology (Barker & Pistrang, 2005 ), and other disciplines of social sciences: social policy (Bryman et al., 2008 ); health research (Sparkes, 2001 ); business and management research (Johnson et al., 2006 ); information systems (Klein & Myers, 1999 ); and environmental studies (Reid & Gough, 2000 ). In the literature, these debates are enthused by the impression that the blanket application of criteria for good qualitative research developed around the positivist paradigm is improper. Such debates are based on the wide range of philosophical backgrounds within which qualitative research is conducted (e.g., Sandberg, 2000 ; Schwandt, 1996 ). The existence of methodological diversity led to the formulation of different sets of criteria applicable to qualitative research.

Among qualitative researchers, the dilemma of governing the measures to assess the quality of research is not a new phenomenon, especially when the virtuous triad of objectivity, reliability, and validity (Spencer et al., 2004 ) are not adequate. Occasionally, the criteria of quantitative research are used to evaluate qualitative research (Cohen & Crabtree, 2008 ; Lather, 2004 ). Indeed, Howe ( 2004 ) claims that the prevailing paradigm in educational research is scientifically based experimental research. Hypotheses and conjectures about the preeminence of quantitative research can weaken the worth and usefulness of qualitative research by neglecting the prominence of harmonizing match for purpose on research paradigm, the epistemological stance of the researcher, and the choice of methodology. Researchers have been reprimanded concerning this in “paradigmatic controversies, contradictions, and emerging confluences” (Lincoln & Guba, 2000 ).

In general, qualitative research tends to come from a very different paradigmatic stance and intrinsically demands distinctive and out-of-the-ordinary criteria for evaluating good research and varieties of research contributions that can be made. This review attempts to present a series of evaluative criteria for qualitative researchers, arguing that their choice of criteria needs to be compatible with the unique nature of the research in question (its methodology, aims, and assumptions). This review aims to assist researchers in identifying some of the indispensable features or markers of high-quality qualitative research. In a nutshell, the purpose of this systematic literature review is to analyze the existing knowledge on high-quality qualitative research and to verify the existence of research studies dealing with the critical assessment of qualitative research based on the concept of diverse paradigmatic stances. Contrary to the existing reviews, this review also suggests some critical directions to follow to improve the quality of qualitative research in different epistemological and ontological perspectives. This review is also intended to provide guidelines for the acceleration of future developments and dialogues among qualitative researchers in the context of assessing the qualitative research.

The rest of this review article is structured in the following fashion: Sect. Methods describes the method followed for performing this review. Section Criteria for Evaluating Qualitative Studies provides a comprehensive description of the criteria for evaluating qualitative studies. This section is followed by a summary of the strategies to improve the quality of qualitative research in Sect. Improving Quality: Strategies . Section How to Assess the Quality of the Research Findings? provides details on how to assess the quality of the research findings. After that, some of the quality checklists (as tools to evaluate quality) are discussed in Sect. Quality Checklists: Tools for Assessing the Quality . At last, the review ends with the concluding remarks presented in Sect. Conclusions, Future Directions and Outlook . Some prospects in qualitative research for enhancing its quality and usefulness in the social and techno-scientific research community are also presented in Sect. Conclusions, Future Directions and Outlook .

For this review, a comprehensive literature search was performed from many databases using generic search terms such as Qualitative Research , Criteria , etc . The following databases were chosen for the literature search based on the high number of results: IEEE Explore, ScienceDirect, PubMed, Google Scholar, and Web of Science. The following keywords (and their combinations using Boolean connectives OR/AND) were adopted for the literature search: qualitative research, criteria, quality, assessment, and validity. The synonyms for these keywords were collected and arranged in a logical structure (see Table 1 ). All publications in journals and conference proceedings later than 1950 till 2021 were considered for the search. Other articles extracted from the references of the papers identified in the electronic search were also included. A large number of publications on qualitative research were retrieved during the initial screening. Hence, to include the searches with the main focus on criteria for good qualitative research, an inclusion criterion was utilized in the search string.

From the selected databases, the search retrieved a total of 765 publications. Then, the duplicate records were removed. After that, based on the title and abstract, the remaining 426 publications were screened for their relevance by using the following inclusion and exclusion criteria (see Table 2 ). Publications focusing on evaluation criteria for good qualitative research were included, whereas those works which delivered theoretical concepts on qualitative research were excluded. Based on the screening and eligibility, 45 research articles were identified that offered explicit criteria for evaluating the quality of qualitative research and were found to be relevant to this review.

Figure 1 illustrates the complete review process in the form of PRISMA flow diagram. PRISMA, i.e., “preferred reporting items for systematic reviews and meta-analyses” is employed in systematic reviews to refine the quality of reporting.

PRISMA flow diagram illustrating the search and inclusion process. N represents the number of records

Criteria for Evaluating Qualitative Studies

Fundamental criteria: general research quality.

Various researchers have put forward criteria for evaluating qualitative research, which have been summarized in Table 3 . Also, the criteria outlined in Table 4 effectively deliver the various approaches to evaluate and assess the quality of qualitative work. The entries in Table 4 are based on Tracy’s “Eight big‐tent criteria for excellent qualitative research” (Tracy, 2010 ). Tracy argues that high-quality qualitative work should formulate criteria focusing on the worthiness, relevance, timeliness, significance, morality, and practicality of the research topic, and the ethical stance of the research itself. Researchers have also suggested a series of questions as guiding principles to assess the quality of a qualitative study (Mays & Pope, 2020 ). Nassaji ( 2020 ) argues that good qualitative research should be robust, well informed, and thoroughly documented.

Qualitative Research: Interpretive Paradigms

All qualitative researchers follow highly abstract principles which bring together beliefs about ontology, epistemology, and methodology. These beliefs govern how the researcher perceives and acts. The net, which encompasses the researcher’s epistemological, ontological, and methodological premises, is referred to as a paradigm, or an interpretive structure, a “Basic set of beliefs that guides action” (Guba, 1990 ). Four major interpretive paradigms structure the qualitative research: positivist and postpositivist, constructivist interpretive, critical (Marxist, emancipatory), and feminist poststructural. The complexity of these four abstract paradigms increases at the level of concrete, specific interpretive communities. Table 5 presents these paradigms and their assumptions, including their criteria for evaluating research, and the typical form that an interpretive or theoretical statement assumes in each paradigm. Moreover, for evaluating qualitative research, quantitative conceptualizations of reliability and validity are proven to be incompatible (Horsburgh, 2003 ). In addition, a series of questions have been put forward in the literature to assist a reviewer (who is proficient in qualitative methods) for meticulous assessment and endorsement of qualitative research (Morse, 2003 ). Hammersley ( 2007 ) also suggests that guiding principles for qualitative research are advantageous, but methodological pluralism should not be simply acknowledged for all qualitative approaches. Seale ( 1999 ) also points out the significance of methodological cognizance in research studies.

Table 5 reflects that criteria for assessing the quality of qualitative research are the aftermath of socio-institutional practices and existing paradigmatic standpoints. Owing to the paradigmatic diversity of qualitative research, a single set of quality criteria is neither possible nor desirable. Hence, the researchers must be reflexive about the criteria they use in the various roles they play within their research community.

Improving Quality: Strategies

Another critical question is “How can the qualitative researchers ensure that the abovementioned quality criteria can be met?” Lincoln and Guba ( 1986 ) delineated several strategies to intensify each criteria of trustworthiness. Other researchers (Merriam & Tisdell, 2016 ; Shenton, 2004 ) also presented such strategies. A brief description of these strategies is shown in Table 6 .

It is worth mentioning that generalizability is also an integral part of qualitative research (Hays & McKibben, 2021 ). In general, the guiding principle pertaining to generalizability speaks about inducing and comprehending knowledge to synthesize interpretive components of an underlying context. Table 7 summarizes the main metasynthesis steps required to ascertain generalizability in qualitative research.

Figure 2 reflects the crucial components of a conceptual framework and their contribution to decisions regarding research design, implementation, and applications of results to future thinking, study, and practice (Johnson et al., 2020 ). The synergy and interrelationship of these components signifies their role to different stances of a qualitative research study.

Essential elements of a conceptual framework

In a nutshell, to assess the rationale of a study, its conceptual framework and research question(s), quality criteria must take account of the following: lucid context for the problem statement in the introduction; well-articulated research problems and questions; precise conceptual framework; distinct research purpose; and clear presentation and investigation of the paradigms. These criteria would expedite the quality of qualitative research.

How to Assess the Quality of the Research Findings?

The inclusion of quotes or similar research data enhances the confirmability in the write-up of the findings. The use of expressions (for instance, “80% of all respondents agreed that” or “only one of the interviewees mentioned that”) may also quantify qualitative findings (Stenfors et al., 2020 ). On the other hand, the persuasive reason for “why this may not help in intensifying the research” has also been provided (Monrouxe & Rees, 2020 ). Further, the Discussion and Conclusion sections of an article also prove robust markers of high-quality qualitative research, as elucidated in Table 8 .

Quality Checklists: Tools for Assessing the Quality

Numerous checklists are available to speed up the assessment of the quality of qualitative research. However, if used uncritically and recklessly concerning the research context, these checklists may be counterproductive. I recommend that such lists and guiding principles may assist in pinpointing the markers of high-quality qualitative research. However, considering enormous variations in the authors’ theoretical and philosophical contexts, I would emphasize that high dependability on such checklists may say little about whether the findings can be applied in your setting. A combination of such checklists might be appropriate for novice researchers. Some of these checklists are listed below:

The most commonly used framework is Consolidated Criteria for Reporting Qualitative Research (COREQ) (Tong et al., 2007 ). This framework is recommended by some journals to be followed by the authors during article submission.

Standards for Reporting Qualitative Research (SRQR) is another checklist that has been created particularly for medical education (O’Brien et al., 2014 ).

Also, Tracy ( 2010 ) and Critical Appraisal Skills Programme (CASP, 2021 ) offer criteria for qualitative research relevant across methods and approaches.

Further, researchers have also outlined different criteria as hallmarks of high-quality qualitative research. For instance, the “Road Trip Checklist” (Epp & Otnes, 2021 ) provides a quick reference to specific questions to address different elements of high-quality qualitative research.

Conclusions, Future Directions, and Outlook

This work presents a broad review of the criteria for good qualitative research. In addition, this article presents an exploratory analysis of the essential elements in qualitative research that can enable the readers of qualitative work to judge it as good research when objectively and adequately utilized. In this review, some of the essential markers that indicate high-quality qualitative research have been highlighted. I scope them narrowly to achieve rigor in qualitative research and note that they do not completely cover the broader considerations necessary for high-quality research. This review points out that a universal and versatile one-size-fits-all guideline for evaluating the quality of qualitative research does not exist. In other words, this review also emphasizes the non-existence of a set of common guidelines among qualitative researchers. In unison, this review reinforces that each qualitative approach should be treated uniquely on account of its own distinctive features for different epistemological and disciplinary positions. Owing to the sensitivity of the worth of qualitative research towards the specific context and the type of paradigmatic stance, researchers should themselves analyze what approaches can be and must be tailored to ensemble the distinct characteristics of the phenomenon under investigation. Although this article does not assert to put forward a magic bullet and to provide a one-stop solution for dealing with dilemmas about how, why, or whether to evaluate the “goodness” of qualitative research, it offers a platform to assist the researchers in improving their qualitative studies. This work provides an assembly of concerns to reflect on, a series of questions to ask, and multiple sets of criteria to look at, when attempting to determine the quality of qualitative research. Overall, this review underlines the crux of qualitative research and accentuates the need to evaluate such research by the very tenets of its being. Bringing together the vital arguments and delineating the requirements that good qualitative research should satisfy, this review strives to equip the researchers as well as reviewers to make well-versed judgment about the worth and significance of the qualitative research under scrutiny. In a nutshell, a comprehensive portrayal of the research process (from the context of research to the research objectives, research questions and design, speculative foundations, and from approaches of collecting data to analyzing the results, to deriving inferences) frequently proliferates the quality of a qualitative research.

Prospects : A Road Ahead for Qualitative Research

Irrefutably, qualitative research is a vivacious and evolving discipline wherein different epistemological and disciplinary positions have their own characteristics and importance. In addition, not surprisingly, owing to the sprouting and varied features of qualitative research, no consensus has been pulled off till date. Researchers have reflected various concerns and proposed several recommendations for editors and reviewers on conducting reviews of critical qualitative research (Levitt et al., 2021 ; McGinley et al., 2021 ). Following are some prospects and a few recommendations put forward towards the maturation of qualitative research and its quality evaluation:

In general, most of the manuscript and grant reviewers are not qualitative experts. Hence, it is more likely that they would prefer to adopt a broad set of criteria. However, researchers and reviewers need to keep in mind that it is inappropriate to utilize the same approaches and conducts among all qualitative research. Therefore, future work needs to focus on educating researchers and reviewers about the criteria to evaluate qualitative research from within the suitable theoretical and methodological context.

There is an urgent need to refurbish and augment critical assessment of some well-known and widely accepted tools (including checklists such as COREQ, SRQR) to interrogate their applicability on different aspects (along with their epistemological ramifications).

Efforts should be made towards creating more space for creativity, experimentation, and a dialogue between the diverse traditions of qualitative research. This would potentially help to avoid the enforcement of one's own set of quality criteria on the work carried out by others.

Moreover, journal reviewers need to be aware of various methodological practices and philosophical debates.

It is pivotal to highlight the expressions and considerations of qualitative researchers and bring them into a more open and transparent dialogue about assessing qualitative research in techno-scientific, academic, sociocultural, and political rooms.

Frequent debates on the use of evaluative criteria are required to solve some potentially resolved issues (including the applicability of a single set of criteria in multi-disciplinary aspects). Such debates would not only benefit the group of qualitative researchers themselves, but primarily assist in augmenting the well-being and vivacity of the entire discipline.

To conclude, I speculate that the criteria, and my perspective, may transfer to other methods, approaches, and contexts. I hope that they spark dialog and debate – about criteria for excellent qualitative research and the underpinnings of the discipline more broadly – and, therefore, help improve the quality of a qualitative study. Further, I anticipate that this review will assist the researchers to contemplate on the quality of their own research, to substantiate research design and help the reviewers to review qualitative research for journals. On a final note, I pinpoint the need to formulate a framework (encompassing the prerequisites of a qualitative study) by the cohesive efforts of qualitative researchers of different disciplines with different theoretic-paradigmatic origins. I believe that tailoring such a framework (of guiding principles) paves the way for qualitative researchers to consolidate the status of qualitative research in the wide-ranging open science debate. Dialogue on this issue across different approaches is crucial for the impending prospects of socio-techno-educational research.

Amin, M. E. K., Nørgaard, L. S., Cavaco, A. M., Witry, M. J., Hillman, L., Cernasev, A., & Desselle, S. P. (2020). Establishing trustworthiness and authenticity in qualitative pharmacy research. Research in Social and Administrative Pharmacy, 16 (10), 1472–1482.

Article Google Scholar

Barker, C., & Pistrang, N. (2005). Quality criteria under methodological pluralism: Implications for conducting and evaluating research. American Journal of Community Psychology, 35 (3–4), 201–212.

Bryman, A., Becker, S., & Sempik, J. (2008). Quality criteria for quantitative, qualitative and mixed methods research: A view from social policy. International Journal of Social Research Methodology, 11 (4), 261–276.

Caelli, K., Ray, L., & Mill, J. (2003). ‘Clear as mud’: Toward greater clarity in generic qualitative research. International Journal of Qualitative Methods, 2 (2), 1–13.

CASP (2021). CASP checklists. Retrieved May 2021 from https://casp-uk.net/casp-tools-checklists/

Cohen, D. J., & Crabtree, B. F. (2008). Evaluative criteria for qualitative research in health care: Controversies and recommendations. The Annals of Family Medicine, 6 (4), 331–339.

Denzin, N. K., & Lincoln, Y. S. (2005). Introduction: The discipline and practice of qualitative research. In N. K. Denzin & Y. S. Lincoln (Eds.), The sage handbook of qualitative research (pp. 1–32). Sage Publications Ltd.

Google Scholar

Elliott, R., Fischer, C. T., & Rennie, D. L. (1999). Evolving guidelines for publication of qualitative research studies in psychology and related fields. British Journal of Clinical Psychology, 38 (3), 215–229.

Epp, A. M., & Otnes, C. C. (2021). High-quality qualitative research: Getting into gear. Journal of Service Research . https://doi.org/10.1177/1094670520961445

Guba, E. G. (1990). The paradigm dialog. In Alternative paradigms conference, mar, 1989, Indiana u, school of education, San Francisco, ca, us . Sage Publications, Inc.

Hammersley, M. (2007). The issue of quality in qualitative research. International Journal of Research and Method in Education, 30 (3), 287–305.

Haven, T. L., Errington, T. M., Gleditsch, K. S., van Grootel, L., Jacobs, A. M., Kern, F. G., & Mokkink, L. B. (2020). Preregistering qualitative research: A Delphi study. International Journal of Qualitative Methods, 19 , 1609406920976417.

Hays, D. G., & McKibben, W. B. (2021). Promoting rigorous research: Generalizability and qualitative research. Journal of Counseling and Development, 99 (2), 178–188.

Horsburgh, D. (2003). Evaluation of qualitative research. Journal of Clinical Nursing, 12 (2), 307–312.

Howe, K. R. (2004). A critique of experimentalism. Qualitative Inquiry, 10 (1), 42–46.

Johnson, J. L., Adkins, D., & Chauvin, S. (2020). A review of the quality indicators of rigor in qualitative research. American Journal of Pharmaceutical Education, 84 (1), 7120.

Johnson, P., Buehring, A., Cassell, C., & Symon, G. (2006). Evaluating qualitative management research: Towards a contingent criteriology. International Journal of Management Reviews, 8 (3), 131–156.

Klein, H. K., & Myers, M. D. (1999). A set of principles for conducting and evaluating interpretive field studies in information systems. MIS Quarterly, 23 (1), 67–93.

Lather, P. (2004). This is your father’s paradigm: Government intrusion and the case of qualitative research in education. Qualitative Inquiry, 10 (1), 15–34.

Levitt, H. M., Morrill, Z., Collins, K. M., & Rizo, J. L. (2021). The methodological integrity of critical qualitative research: Principles to support design and research review. Journal of Counseling Psychology, 68 (3), 357.

Lincoln, Y. S., & Guba, E. G. (1986). But is it rigorous? Trustworthiness and authenticity in naturalistic evaluation. New Directions for Program Evaluation, 1986 (30), 73–84.

Lincoln, Y. S., & Guba, E. G. (2000). Paradigmatic controversies, contradictions and emerging confluences. In N. K. Denzin & Y. S. Lincoln (Eds.), Handbook of qualitative research (2nd ed., pp. 163–188). Sage Publications.

Madill, A., Jordan, A., & Shirley, C. (2000). Objectivity and reliability in qualitative analysis: Realist, contextualist and radical constructionist epistemologies. British Journal of Psychology, 91 (1), 1–20.

Mays, N., & Pope, C. (2020). Quality in qualitative research. Qualitative Research in Health Care . https://doi.org/10.1002/9781119410867.ch15

McGinley, S., Wei, W., Zhang, L., & Zheng, Y. (2021). The state of qualitative research in hospitality: A 5-year review 2014 to 2019. Cornell Hospitality Quarterly, 62 (1), 8–20.

Merriam, S., & Tisdell, E. (2016). Qualitative research: A guide to design and implementation. San Francisco, US.

Meyer, M., & Dykes, J. (2019). Criteria for rigor in visualization design study. IEEE Transactions on Visualization and Computer Graphics, 26 (1), 87–97.

Monrouxe, L. V., & Rees, C. E. (2020). When I say… quantification in qualitative research. Medical Education, 54 (3), 186–187.

Morrow, S. L. (2005). Quality and trustworthiness in qualitative research in counseling psychology. Journal of Counseling Psychology, 52 (2), 250.

Morse, J. M. (2003). A review committee’s guide for evaluating qualitative proposals. Qualitative Health Research, 13 (6), 833–851.

Nassaji, H. (2020). Good qualitative research. Language Teaching Research, 24 (4), 427–431.

O’Brien, B. C., Harris, I. B., Beckman, T. J., Reed, D. A., & Cook, D. A. (2014). Standards for reporting qualitative research: A synthesis of recommendations. Academic Medicine, 89 (9), 1245–1251.

O’Connor, C., & Joffe, H. (2020). Intercoder reliability in qualitative research: Debates and practical guidelines. International Journal of Qualitative Methods, 19 , 1609406919899220.

Reid, A., & Gough, S. (2000). Guidelines for reporting and evaluating qualitative research: What are the alternatives? Environmental Education Research, 6 (1), 59–91.

Rocco, T. S. (2010). Criteria for evaluating qualitative studies. Human Resource Development International . https://doi.org/10.1080/13678868.2010.501959

Sandberg, J. (2000). Understanding human competence at work: An interpretative approach. Academy of Management Journal, 43 (1), 9–25.

Schwandt, T. A. (1996). Farewell to criteriology. Qualitative Inquiry, 2 (1), 58–72.

Seale, C. (1999). Quality in qualitative research. Qualitative Inquiry, 5 (4), 465–478.

Shenton, A. K. (2004). Strategies for ensuring trustworthiness in qualitative research projects. Education for Information, 22 (2), 63–75.

Sparkes, A. C. (2001). Myth 94: Qualitative health researchers will agree about validity. Qualitative Health Research, 11 (4), 538–552.

Spencer, L., Ritchie, J., Lewis, J., & Dillon, L. (2004). Quality in qualitative evaluation: A framework for assessing research evidence.

Stenfors, T., Kajamaa, A., & Bennett, D. (2020). How to assess the quality of qualitative research. The Clinical Teacher, 17 (6), 596–599.

Taylor, E. W., Beck, J., & Ainsworth, E. (2001). Publishing qualitative adult education research: A peer review perspective. Studies in the Education of Adults, 33 (2), 163–179.

Tong, A., Sainsbury, P., & Craig, J. (2007). Consolidated criteria for reporting qualitative research (COREQ): A 32-item checklist for interviews and focus groups. International Journal for Quality in Health Care, 19 (6), 349–357.

Tracy, S. J. (2010). Qualitative quality: Eight “big-tent” criteria for excellent qualitative research. Qualitative Inquiry, 16 (10), 837–851.

Download references

Open access funding provided by TU Wien (TUW).

Author information

Authors and affiliations.

Faculty of Informatics, Technische Universität Wien, 1040, Vienna, Austria

Drishti Yadav

You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Drishti Yadav .

Ethics declarations

Conflict of interest.

The author declares no conflict of interest.

Additional information

Publisher's note.

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Yadav, D. Criteria for Good Qualitative Research: A Comprehensive Review. Asia-Pacific Edu Res 31 , 679–689 (2022). https://doi.org/10.1007/s40299-021-00619-0

Download citation

Accepted : 28 August 2021

Published : 18 September 2021

Issue Date : December 2022

DOI : https://doi.org/10.1007/s40299-021-00619-0

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

Qualitative research
Evaluative criteria
Find a journal
Publish with us
Track your research

UNC Libraries
HSL Subject Research
Qualitative Research Resources
Finding Qualitative Studies

Qualitative Research Resources: Finding Qualitative Studies

Created by health science librarians.

What is Qualitative Research?
Qualitative Research Basics
Special Topics
Training Opportunities: UNC & Beyond
Help at UNC
Qualitative Software for Coding/Analysis
Software for Audio, Video, Online Surveys

About this Page

Ready-built sets of search terms, database-specific search strategies, general qual search strategies, web resources.

Assessing Qualitative Research
Writing Up Your Research
Integrating Qualitative Research into Systematic Reviews
Publishing Qualitative Research
Presenting Qualitative Research
Qualitative & Libraries: a few gems
Data Repositories

Why is this information important?

Electronic databases for health science literature, such as PubMed or CINAHL, often do not index qualitative health studies very clearly.
Authors also do not always identify their methods using the word "qualitative" in their titles or abstracts; in some cases they may use terminology for a specific qualitative method instead.
Often, that means that it is hard to find qualitative studies in common health science databases like PubMed

On this page you'll find:

articles that describe and evaluate search strategies for finding qualitative research
articles that provide search strategies for specific databases
web resources on search filters and finding qualitative articles in databases
links to sets of search terms to use when searching for qualitative research
Hedges: Evidence Based Health Informatics, McMaster University contains qualitative hedges for Medline, PsycInfo, and Embase
ISSG Search Filters Resource: Qualitative Research Filters The InterTASC Information Specialists' Sub-Group Search Filter Resource is a collaborative venture to identify, assess and test search filters designed to retrieve research by study design or focus. The Search Filters Resource aims to provide easy access to published and unpublished search filters. It also provides information and guidance on how to critically appraise search filters, study design filters in progress and information on the development and use of search filters. Inclusion of a search filter is not an endorsement of its validity or a recommendation.
PubMed Health Services Research Queries Using Research Methodology Filters

A Few Articles on Search Strategies for Specific Databases

Wilczynski NL, Marks S, Haynes RB.2007. Search strategies for identifying qualitative studies in CINAHL. Qualitative Health Research 17(5):705-10.

Walters LA, Wilczynski NL, Haynes RB; Hedges Team. 2006. Developing optimal search strategies for retrieving clinically relevant qualitative studies in EMBASE. Qualitative Health Research 16(1):162-8.

Wong SS, Wilczynski NL, Haynes RB, Hedges Team. 2004. Developing optimal search strategies for detecting clinically relevant qualitative studies in MEDLINE. Medinfo 11: 311-316.

McKibbon KA, Wilczynski NL, Haynes RB. 2006. Developing optimal search strategies for retrieving qualitative studies in PsycINFO. Evaluation and the Health Professions 29: 440-454.

CINAHL & PsycINFO :

Rosumeck S, Wagner M, Wallraf S, Euler U. A validation study revealed differences in design and performance of search filters for qualitative research in PsycINFO and CINAHL . J Clin Epidemiol. 2020 Dec;128:101-108. doi: 10.1016/j.jclinepi.2020.09.031. Epub 2020 Sep 26. PMID: 32987157.

MEDLINE, CINAHL, Social Science Citation Index (SSCI) :

DeJean D, Giacomini M, Simeonov D, Smith A. Finding Qualitative Research Evidence for Health Technology Assessment . Qual Health Res. 2016 Aug;26(10):1307-17. doi: 10.1177/1049732316644429. Epub 2016 Apr 26. PMID: 27117960.

MEDLINE, EMBASE, CINAHL, PsycINFO :

A Few Articles on General Search Strategies for Qualitative Literature

Booth, A. (2016). Searching for qualitative research for inclusion in systematic reviews: A structured methodological review . Systematic Reviews, 5 doi:http://dx.doi.org.libproxy.lib.unc.edu/10.1186/s13643-016-0249-x

Cook, A., D. Smith, and A. Booth. 2012. Beyond PICO: the SPIDER tool for qualitative evidence synthesis. Qualitative Health Research 10: 1435-1443.

Evans, D. 2002. Database searches for qualitative research . Journal of the Medical Libraries Association , 90(3): 290-293.

Flemming K, Briggs M. 2007. Electronic searching to locate qualitative research: evaluation of three strategies. J Adv Nurs . 57(1):95-100

Gorecki CA, Brown JM, Briggs M, Nixon J. 2010. Evaluation of five search strategies in retrieving qualitative patient-reported electronic data on the impact of pressure ulcers on quality of life . J Adv Nurs . 66(3):645-52

Grant MJ. 2004 How does your searching grow? A survey of search preferences and the use of optimal search strategies in the identification of qualitative research. Health Info Libr J . 21(1):21-32

Littleton, D, S Marsalis, D Z Bliss. 2004. Searching the literature by design . Western Journal of Nursing Research 26(8): 891-908.

Methley, A.M., S. Campbell, C. Chew-Graham, R. McNally, and S. Cheraghi-Sohi. 2014. PICO, PICOS, and SPIDER: a comparison study of specificity and sensitivity in three search tools for qualitative systematic reviews . BMC Health Serv Res 14: 579.

Pearson, M., Moxham, T., & Ashton, K. 2011. Effectiveness of Search Strategies for Qualitative Research About Barriers and Facilitators of Program Delivery . Evaluation & the Health Professions , 34(3), 297–308. https://doi.org/10.1177/0163278710388029

Petticrew, Mark and Helen Roberts. 2008. Systematic Reviews in the Social Sciences: A Practical Guide. Chapter 4: How to Find the Studies: The Literature Search . Blackwell Publishing: Oxford, UK.

Shaw RL, Booth A, Sutton AJ, Miller T, Smith JA, Young B, et al. 2004. Finding qualitative research: an evaluation of search strategies . BMC Med Res Methodol 4:5

Campbell Collaboration Information Retrieval Guide Campbell Collaboration is an organization that guides and publishes systematic reviews. This resource is their publication on searching strategies and finding articles; it is not specific to qualitative studies but offers useful hints.
NYU Libraries: Locating Qualitative Research Includes a good starting list of qualitative keywords for a general keyword based search strategy that can be cut and pasted into any database plus database specific strategies for CINAHL, Medline (including PubMed), and PsycINFO (with APA Index Terms). Note that PsycINFO via OVID strategies would need to be translated for UNC's Ebsco version.
University of Washington LibGuide: Finding Qualitative Research Articles This guide gives some basic general search strategies when looking for qualitative literature, as well as specific search strategies for specific databases (CINAHL, PubMed, PsycInfo), books, and grey literature.
<< Previous: Software for Audio, Video, Online Surveys
Next: Assessing Qualitative Research >>
Last Updated: May 14, 2024 12:50 PM
URL: https://guides.lib.unc.edu/qual

An official website of the United States government

The .gov means it’s official. Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

The site is secure. The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Publications
Account settings

Preview improvements coming to the PMC website in October 2024. Learn More or Try it out now .

Advanced Search
Journal List
Am J Pharm Educ
v.74(8); 2010 Oct 11

Presenting and Evaluating Qualitative Research

The purpose of this paper is to help authors to think about ways to present qualitative research papers in the American Journal of Pharmaceutical Education . It also discusses methods for reviewers to assess the rigour, quality, and usefulness of qualitative research. Examples of different ways to present data from interviews, observations, and focus groups are included. The paper concludes with guidance for publishing qualitative research and a checklist for authors and reviewers.

INTRODUCTION

Policy and practice decisions, including those in education, increasingly are informed by findings from qualitative as well as quantitative research. Qualitative research is useful to policymakers because it often describes the settings in which policies will be implemented. Qualitative research is also useful to both pharmacy practitioners and pharmacy academics who are involved in researching educational issues in both universities and practice and in developing teaching and learning.

Qualitative research involves the collection, analysis, and interpretation of data that are not easily reduced to numbers. These data relate to the social world and the concepts and behaviors of people within it. Qualitative research can be found in all social sciences and in the applied fields that derive from them, for example, research in health services, nursing, and pharmacy. 1 It looks at X in terms of how X varies in different circumstances rather than how big is X or how many Xs are there? 2 Textbooks often subdivide research into qualitative and quantitative approaches, furthering the common assumption that there are fundamental differences between the 2 approaches. With pharmacy educators who have been trained in the natural and clinical sciences, there is often a tendency to embrace quantitative research, perhaps due to familiarity. A growing consensus is emerging that sees both qualitative and quantitative approaches as useful to answering research questions and understanding the world. Increasingly mixed methods research is being carried out where the researcher explicitly combines the quantitative and qualitative aspects of the study. 3 , 4

Like healthcare, education involves complex human interactions that can rarely be studied or explained in simple terms. Complex educational situations demand complex understanding; thus, the scope of educational research can be extended by the use of qualitative methods. Qualitative research can sometimes provide a better understanding of the nature of educational problems and thus add to insights into teaching and learning in a number of contexts. For example, at the University of Nottingham, we conducted in-depth interviews with pharmacists to determine their perceptions of continuing professional development and who had influenced their learning. We also have used a case study approach using observation of practice and in-depth interviews to explore physiotherapists' views of influences on their leaning in practice. We have conducted in-depth interviews with a variety of stakeholders in Malawi, Africa, to explore the issues surrounding pharmacy academic capacity building. A colleague has interviewed and conducted focus groups with students to explore cultural issues as part of a joint Nottingham-Malaysia pharmacy degree program. Another colleague has interviewed pharmacists and patients regarding their expectations before and after clinic appointments and then observed pharmacist-patient communication in clinics and assessed it using the Calgary Cambridge model in order to develop recommendations for communication skills training. 5 We have also performed documentary analysis on curriculum data to compare pharmacist and nurse supplementary prescribing courses in the United Kingdom.

It is important to choose the most appropriate methods for what is being investigated. Qualitative research is not appropriate to answer every research question and researchers need to think carefully about their objectives. Do they wish to study a particular phenomenon in depth (eg, students' perceptions of studying in a different culture)? Or are they more interested in making standardized comparisons and accounting for variance (eg, examining differences in examination grades after changing the way the content of a module is taught). Clearly a quantitative approach would be more appropriate in the last example. As with any research project, a clear research objective has to be identified to know which methods should be applied.

Types of qualitative data include:

Audio recordings and transcripts from in-depth or semi-structured interviews
Structured interview questionnaires containing substantial open comments including a substantial number of responses to open comment items.
Audio recordings and transcripts from focus group sessions.
Field notes (notes taken by the researcher while in the field [setting] being studied)
Video recordings (eg, lecture delivery, class assignments, laboratory performance)
Case study notes
Documents (reports, meeting minutes, e-mails)
Diaries, video diaries
Observation notes
Press clippings
Photographs

RIGOUR IN QUALITATIVE RESEARCH

Qualitative research is often criticized as biased, small scale, anecdotal, and/or lacking rigor; however, when it is carried out properly it is unbiased, in depth, valid, reliable, credible and rigorous. In qualitative research, there needs to be a way of assessing the “extent to which claims are supported by convincing evidence.” 1 Although the terms reliability and validity traditionally have been associated with quantitative research, increasingly they are being seen as important concepts in qualitative research as well. Examining the data for reliability and validity assesses both the objectivity and credibility of the research. Validity relates to the honesty and genuineness of the research data, while reliability relates to the reproducibility and stability of the data.

The validity of research findings refers to the extent to which the findings are an accurate representation of the phenomena they are intended to represent. The reliability of a study refers to the reproducibility of the findings. Validity can be substantiated by a number of techniques including triangulation use of contradictory evidence, respondent validation, and constant comparison. Triangulation is using 2 or more methods to study the same phenomenon. Contradictory evidence, often known as deviant cases, must be sought out, examined, and accounted for in the analysis to ensure that researcher bias does not interfere with or alter their perception of the data and any insights offered. Respondent validation, which is allowing participants to read through the data and analyses and provide feedback on the researchers' interpretations of their responses, provides researchers with a method of checking for inconsistencies, challenges the researchers' assumptions, and provides them with an opportunity to re-analyze their data. The use of constant comparison means that one piece of data (for example, an interview) is compared with previous data and not considered on its own, enabling researchers to treat the data as a whole rather than fragmenting it. Constant comparison also enables the researcher to identify emerging/unanticipated themes within the research project.

STRENGTHS AND LIMITATIONS OF QUALITATIVE RESEARCH

Qualitative researchers have been criticized for overusing interviews and focus groups at the expense of other methods such as ethnography, observation, documentary analysis, case studies, and conversational analysis. Qualitative research has numerous strengths when properly conducted.

Strengths of Qualitative Research

Issues can be examined in detail and in depth.
Interviews are not restricted to specific questions and can be guided/redirected by the researcher in real time.
The research framework and direction can be quickly revised as new information emerges.
The data based on human experience that is obtained is powerful and sometimes more compelling than quantitative data.
Subtleties and complexities about the research subjects and/or topic are discovered that are often missed by more positivistic enquiries.
Data usually are collected from a few cases or individuals so findings cannot be generalized to a larger population. Findings can however be transferable to another setting.

Limitations of Qualitative Research

Research quality is heavily dependent on the individual skills of the researcher and more easily influenced by the researcher's personal biases and idiosyncrasies.
Rigor is more difficult to maintain, assess, and demonstrate.
The volume of data makes analysis and interpretation time consuming.
It is sometimes not as well understood and accepted as quantitative research within the scientific community
The researcher's presence during data gathering, which is often unavoidable in qualitative research, can affect the subjects' responses.
Issues of anonymity and confidentiality can present problems when presenting findings
Findings can be more difficult and time consuming to characterize in a visual way.

PRESENTATION OF QUALITATIVE RESEARCH FINDINGS

The following extracts are examples of how qualitative data might be presented:

Data From an Interview.

The following is an example of how to present and discuss a quote from an interview.

The researcher should select quotes that are poignant and/or most representative of the research findings. Including large portions of an interview in a research paper is not necessary and often tedious for the reader. The setting and speakers should be established in the text at the end of the quote.

The student describes how he had used deep learning in a dispensing module. He was able to draw on learning from a previous module, “I found that while using the e learning programme I was able to apply the knowledge and skills that I had gained in last year's diseases and goals of treatment module.” (interviewee 22, male)

This is an excerpt from an article on curriculum reform that used interviews 5 :

The first question was, “Without the accreditation mandate, how much of this curriculum reform would have been attempted?” According to respondents, accreditation played a significant role in prompting the broad-based curricular change, and their comments revealed a nuanced view. Most indicated that the change would likely have occurred even without the mandate from the accreditation process: “It reflects where the profession wants to be … training a professional who wants to take on more responsibility.” However, they also commented that “if it were not mandated, it could have been a very difficult road.” Or it “would have happened, but much later.” The change would more likely have been incremental, “evolutionary,” or far more limited in its scope. “Accreditation tipped the balance” was the way one person phrased it. “Nobody got serious until the accrediting body said it would no longer accredit programs that did not change.”

Data From Observations

The following example is some data taken from observation of pharmacist patient consultations using the Calgary Cambridge guide. 6 , 7 The data are first presented and a discussion follows:

Pharmacist: We will soon be starting a stop smoking clinic. Patient: Is the interview over now? Pharmacist: No this is part of it. (Laughs) You can't tell me to bog off (sic) yet. (pause) We will be starting a stop smoking service here, Patient: Yes. Pharmacist: with one-to-one and we will be able to help you or try to help you. If you want it. In this example, the pharmacist has picked up from the patient's reaction to the stop smoking clinic that she is not receptive to advice about giving up smoking at this time; in fact she would rather end the consultation. The pharmacist draws on his prior relationship with the patient and makes use of a joke to lighten the tone. He feels his message is important enough to persevere but he presents the information in a succinct and non-pressurised way. His final comment of “If you want it” is important as this makes it clear that he is not putting any pressure on the patient to take up this offer. This extract shows that some patient cues were picked up, and appropriately dealt with, but this was not the case in all examples.

Data From Focus Groups

This excerpt from a study involving 11 focus groups illustrates how findings are presented using representative quotes from focus group participants. 8

Those pharmacists who were initially familiar with CPD endorsed the model for their peers, and suggested it had made a meaningful difference in the way they viewed their own practice. In virtually all focus groups sessions, pharmacists familiar with and supportive of the CPD paradigm had worked in collaborative practice environments such as hospital pharmacy practice. For these pharmacists, the major advantage of CPD was the linking of workplace learning with continuous education. One pharmacist stated, “It's amazing how much I have to learn every day, when I work as a pharmacist. With [the learning portfolio] it helps to show how much learning we all do, every day. It's kind of satisfying to look it over and see how much you accomplish.” Within many of the learning portfolio-sharing sessions, debates emerged regarding the true value of traditional continuing education and its outcome in changing an individual's practice. While participants appreciated the opportunity for social and professional networking inherent in some forms of traditional CE, most eventually conceded that the academic value of most CE programming was limited by the lack of a systematic process for following-up and implementing new learning in the workplace. “Well it's nice to go to these [continuing education] events, but really, I don't know how useful they are. You go, you sit, you listen, but then, well I at least forget.”

The following is an extract from a focus group (conducted by the author) with first-year pharmacy students about community placements. It illustrates how focus groups provide a chance for participants to discuss issues on which they might disagree.

Interviewer: So you are saying that you would prefer health related placements? Student 1: Not exactly so long as I could be developing my communication skill. Student 2: Yes but I still think the more health related the placement is the more I'll gain from it. Student 3: I disagree because other people related skills are useful and you may learn those from taking part in a community project like building a garden. Interviewer: So would you prefer a mixture of health and non health related community placements?

GUIDANCE FOR PUBLISHING QUALITATIVE RESEARCH

Qualitative research is becoming increasingly accepted and published in pharmacy and medical journals. Some journals and publishers have guidelines for presenting qualitative research, for example, the British Medical Journal 9 and Biomedcentral . 10 Medical Education published a useful series of articles on qualitative research. 11 Some of the important issues that should be considered by authors, reviewers and editors when publishing qualitative research are discussed below.

Introduction.

A good introduction provides a brief overview of the manuscript, including the research question and a statement justifying the research question and the reasons for using qualitative research methods. This section also should provide background information, including relevant literature from pharmacy, medicine, and other health professions, as well as literature from the field of education that addresses similar issues. Any specific educational or research terminology used in the manuscript should be defined in the introduction.

The methods section should clearly state and justify why the particular method, for example, face to face semistructured interviews, was chosen. The method should be outlined and illustrated with examples such as the interview questions, focusing exercises, observation criteria, etc. The criteria for selecting the study participants should then be explained and justified. The way in which the participants were recruited and by whom also must be stated. A brief explanation/description should be included of those who were invited to participate but chose not to. It is important to consider “fair dealing,” ie, whether the research design explicitly incorporates a wide range of different perspectives so that the viewpoint of 1 group is never presented as if it represents the sole truth about any situation. The process by which ethical and or research/institutional governance approval was obtained should be described and cited.

The study sample and the research setting should be described. Sampling differs between qualitative and quantitative studies. In quantitative survey studies, it is important to select probability samples so that statistics can be used to provide generalizations to the population from which the sample was drawn. Qualitative research necessitates having a small sample because of the detailed and intensive work required for the study. So sample sizes are not calculated using mathematical rules and probability statistics are not applied. Instead qualitative researchers should describe their sample in terms of characteristics and relevance to the wider population. Purposive sampling is common in qualitative research. Particular individuals are chosen with characteristics relevant to the study who are thought will be most informative. Purposive sampling also may be used to produce maximum variation within a sample. Participants being chosen based for example, on year of study, gender, place of work, etc. Representative samples also may be used, for example, 20 students from each of 6 schools of pharmacy. Convenience samples involve the researcher choosing those who are either most accessible or most willing to take part. This may be fine for exploratory studies; however, this form of sampling may be biased and unrepresentative of the population in question. Theoretical sampling uses insights gained from previous research to inform sample selection for a new study. The method for gaining informed consent from the participants should be described, as well as how anonymity and confidentiality of subjects were guaranteed. The method of recording, eg, audio or video recording, should be noted, along with procedures used for transcribing the data.

Data Analysis.

A description of how the data were analyzed also should be included. Was computer-aided qualitative data analysis software such as NVivo (QSR International, Cambridge, MA) used? Arrival at “data saturation” or the end of data collection should then be described and justified. A good rule when considering how much information to include is that readers should have been given enough information to be able to carry out similar research themselves.

One of the strengths of qualitative research is the recognition that data must always be understood in relation to the context of their production. 1 The analytical approach taken should be described in detail and theoretically justified in light of the research question. If the analysis was repeated by more than 1 researcher to ensure reliability or trustworthiness, this should be stated and methods of resolving any disagreements clearly described. Some researchers ask participants to check the data. If this was done, it should be fully discussed in the paper.

An adequate account of how the findings were produced should be included A description of how the themes and concepts were derived from the data also should be included. Was an inductive or deductive process used? The analysis should not be limited to just those issues that the researcher thinks are important, anticipated themes, but also consider issues that participants raised, ie, emergent themes. Qualitative researchers must be open regarding the data analysis and provide evidence of their thinking, for example, were alternative explanations for the data considered and dismissed, and if so, why were they dismissed? It also is important to present outlying or negative/deviant cases that did not fit with the central interpretation.

The interpretation should usually be grounded in interviewees or respondents' contributions and may be semi-quantified, if this is possible or appropriate, for example, “Half of the respondents said …” “The majority said …” “Three said…” Readers should be presented with data that enable them to “see what the researcher is talking about.” 1 Sufficient data should be presented to allow the reader to clearly see the relationship between the data and the interpretation of the data. Qualitative data conventionally are presented by using illustrative quotes. Quotes are “raw data” and should be compiled and analyzed, not just listed. There should be an explanation of how the quotes were chosen and how they are labeled. For example, have pseudonyms been given to each respondent or are the respondents identified using codes, and if so, how? It is important for the reader to be able to see that a range of participants have contributed to the data and that not all the quotes are drawn from 1 or 2 individuals. There is a tendency for authors to overuse quotes and for papers to be dominated by a series of long quotes with little analysis or discussion. This should be avoided.

Participants do not always state the truth and may say what they think the interviewer wishes to hear. A good qualitative researcher should not only examine what people say but also consider how they structured their responses and how they talked about the subject being discussed, for example, the person's emotions, tone, nonverbal communication, etc. If the research was triangulated with other qualitative or quantitative data, this should be discussed.

Discussion.

The findings should be presented in the context of any similar previous research and or theories. A discussion of the existing literature and how this present research contributes to the area should be included. A consideration must also be made about how transferrable the research would be to other settings. Any particular strengths and limitations of the research also should be discussed. It is common practice to include some discussion within the results section of qualitative research and follow with a concluding discussion.

The author also should reflect on their own influence on the data, including a consideration of how the researcher(s) may have introduced bias to the results. The researcher should critically examine their own influence on the design and development of the research, as well as on data collection and interpretation of the data, eg, were they an experienced teacher who researched teaching methods? If so, they should discuss how this might have influenced their interpretation of the results.

Conclusion.

The conclusion should summarize the main findings from the study and emphasize what the study adds to knowledge in the area being studied. Mays and Pope suggest the researcher ask the following 3 questions to determine whether the conclusions of a qualitative study are valid 12 : How well does this analysis explain why people behave in the way they do? How comprehensible would this explanation be to a thoughtful participant in the setting? How well does the explanation cohere with what we already know?

CHECKLIST FOR QUALITATIVE PAPERS

This paper establishes criteria for judging the quality of qualitative research. It provides guidance for authors and reviewers to prepare and review qualitative research papers for the American Journal of Pharmaceutical Education . A checklist is provided in Appendix 1 to assist both authors and reviewers of qualitative data.

ACKNOWLEDGEMENTS

Thank you to the 3 reviewers whose ideas helped me to shape this paper.

Appendix 1. Checklist for authors and reviewers of qualitative research.

Introduction

□ Research question is clearly stated.
□ Research question is justified and related to the existing knowledge base (empirical research, theory, policy).
□ Any specific research or educational terminology used later in manuscript is defined.
□ The process by which ethical and or research/institutional governance approval was obtained is described and cited.
□ Reason for choosing particular research method is stated.
□ Criteria for selecting study participants are explained and justified.
□ Recruitment methods are explicitly stated.
□ Details of who chose not to participate and why are given.
□ Study sample and research setting used are described.
□ Method for gaining informed consent from the participants is described.
□ Maintenance/Preservation of subject anonymity and confidentiality is described.
□ Method of recording data (eg, audio or video recording) and procedures for transcribing data are described.
□ Methods are outlined and examples given (eg, interview guide).
□ Decision to stop data collection is described and justified.
□ Data analysis and verification are described, including by whom they were performed.
□ Methods for identifying/extrapolating themes and concepts from the data are discussed.
□ Sufficient data are presented to allow a reader to assess whether or not the interpretation is supported by the data.
□ Outlying or negative/deviant cases that do not fit with the central interpretation are presented.
□ Transferability of research findings to other settings is discussed.
□ Findings are presented in the context of any similar previous research and social theories.
□ Discussion often is incorporated into the results in qualitative papers.
□ A discussion of the existing literature and how this present research contributes to the area is included.
□ Any particular strengths and limitations of the research are discussed.
□ Reflection of the influence of the researcher(s) on the data, including a consideration of how the researcher(s) may have introduced bias to the results is included.

Conclusions

□ The conclusion states the main finings of the study and emphasizes what the study adds to knowledge in the subject area.

6 Qualitative data examples for thorough market researchers

Types of qualitative data in market research, 6 qualitative data examples, get nuanced insights from qualitative market research.

There are plenty of ways to gather consumer insights for fresh campaigns and better products, but qualitative research is up there with the best sources of insight.

This guide is packed with examples of how to turn qualitative data into actionable insights, to spark your creativity and sharpen your research strategy. You’ll see how qualitative data, especially through surveys, opens doors to deeper understanding by inviting consumers to share their experiences and thoughts freely, in their own words — and how qualitative data can transform your brand.

Before we dig into some examples of how qualitative data can empower your teams to make focused, confident and quick decisions on anything from product to marketing, let’s go back to basics. We can categorize qualitative data into roughly three categories: binary, nominal and ordinal data. Here’s how each of them is used in qualitative data analysis.

Binary data

Binary data represents a choice between two distinct options, like ‘yes’ or ‘no’. In market research, this type of qualitative data is useful for filtering responses or making clear distinctions in consumer preferences.

Binary data in qualitative research is great for straightforward insights, but has its limits. Here’s a quick guide on when to use it and when to opt for qualitative data that is more detailed:

Binary data is great for:

Quick Yes/No questions : like “Have you used our app? Yes or No.”
Initial screening : to quickly sort participants for further studies.
Clear-cut answers : absolute factors, such as ownership or usage.

Avoid binary data for:

Understanding motivations : it lacks the depth to explore why behind actions.
Measuring intensity : can’t show how much someone likes or uses something.
Detail needed for product development : misses the nuanced feedback necessary for innovations.

Nominal data

Nominal data categorizes responses without implying any order. For example, when survey respondents choose their favorite brand from a list, the data collected is nominal, offering insights into brand preferences among different demographics.

Some other examples of qualitative data that can be qualified as nominal are asking participants to name their primary information source about products in categories like social media, friends, or online reviews. Or in focus groups, discussing brand perceptions could classify brands into categories such as luxury, budget-friendly, or eco-conscious, based on participant descriptions.

Nominal data is great for:

Categorizing responses : such as types of consumer complaints (product quality, customer service, delivery issues).
Identifying preferences : like favorite product categories (beverages, electronics, apparel).
Segmentation : grouping participants based on attributes (first-time buyers, loyal customers).

Nominal data is not for:

Measuring quantities : it can’t quantify how much more one category is preferred over another.
Ordering or ranking responses : it doesn’t indicate which category is higher or lower in any hierarchy.
Detailed behavioral analysis : While it can group behaviors, it doesn’t delve into the frequency or intensity of those behaviors.

Ordinal data

Ordinal data introduces a sense of order, ranking preferences or satisfaction levels. In qualitative analysis, it’s particularly useful for understanding how consumers prioritize features or products, giving researchers a clearer picture of market trends.

Other examples of qualitative data analyses that use ordinal data, are for instance a study on consumer preferences for coffee flavors, participants might rank flavors in order of preference, providing insights into flavor trends. You can also get ordinal data from focus groups on things like customer satisfaction surveys or app usability, by asking users to rate their ease of use or happiness on an ordinal scale.

Ordinal data is great for:

Ranking preferences : asking participants to rank product features from most to least important.
Measuring satisfaction levels : using scales like “very satisfied,” “satisfied,” “neutral,” “dissatisfied,” “very dissatisfied.”
Assessing Agreement : with statements on a scale from “strongly agree” to “strongly disagree.”

Ordinal data is not for:

Quantifying differences : it doesn’t show how much more one rank is preferred over another, just the order.
Precise measurements : can’t specify the exact degree of satisfaction or agreement, only relative positions.

This mix of qualitative and quantitative data will give you a well-rounded view of participant attitudes and preferences.

The things you can do with qualitative data are endless. But this article shouldn’t turn into a work of literature, so we’ll highlight six ways to collect qualitative data and give you examples of how to use these qualitative research methods to get actionable results.

How to get qual insights with Attest

You can get to the heart of what your target customers think, with reliable qualitative insights from Attest Video Responses

1. Highlighting brand loyalty drivers with open-ended surveys and questionnaires

Open-ended surveys and questionnaires are great at finding out what makes customers choose and stick with a brand. Here’s why this qualitative data analysis tool is so good for gathering qualitative data on things like brand loyalty and customer experience:

Straight from the source

Open-ended survey responses show the actual thoughts and feelings of your target audience in their own words, while still giving you structure in your data analysis.

Understanding ‘why’

Numbers can show us how many customers are loyal; open-ended survey responses explain why they are. You can also easily add thematic analysis to the mix by counting certain keywords or phrases.

Guiding decisions

The insights from these surveys can help a brand decide where to focus its efforts, from making sure their marketing highlights what customers love most to improving parts of their product.

Surveys are one of the most versatile and efficient qualitative data collection methods out there. We want to bring the power of qualitative data analysis to every business and make it easy to gather qualitative data from the people who matter most to your brand. Check out our survey templates to hit the ground running. And you’re not limited to textual data as your only data source — we also enable you to gather video responses to get additional context from non verbal cues and more.

2. Trend identification with observation notes

Observation notes are a powerful qualitative data analysis tool for spotting trends as they naturally unfold in real-world settings. Here’s why they’re particularly valuable insights and effective for identifying new trends:

Real behavior

Observing people directly shows us how they actually interact with products or services, not just how they say they do. This can highlight emerging trends in consumer behavior or preferences before people can even put into words what they are doing and why.

Immediate insights

By watching how people engage with different products, we can quickly spot patterns or changes in behavior. This immediate feedback is invaluable for catching trends as they start.

Context matters

Observations give you context. You can see not just what people do, but where and how they do it. This context can be key to understanding why a trend is taking off.

Unprompted reactions

Since people don’t know they’re being observed for these purposes, their actions are genuine. This leads to authentic insights about what’s really catching on.

3. Understanding consumer sentiments through semi-structured interviews

Semi-structured interviews for qualitative data analysis are an effective method for data analysts to get a deep understanding of consumer sentiments. It provides a structured yet flexible approach to gather in-depth insights. Here’s why they’re particularly useful for this type of research question:

Personal connection

These interviews create a space for a real conversation, allowing consumers to share their feelings, experiences, and opinions about a brand or product in a more personal setting.

Flexibility

The format lets the interviewer explore interesting points that come up during the conversation, diving deeper into unexpected areas of discussion. This flexibility uncovers richer insights than strictly structured interviews.

Depth of understanding

By engaging in detailed discussions, brands can understand not just what consumers think but why they think that way and what stations their train of thought passes by.

Structure and surprise

Semi-structured interviews can be tailored to explore specific areas of interest while still allowing for new insights to emerge.

4. Using focus groups for informing market entry strategies

Using a focus group to inform market entry strategies provides a dynamic way to discover your potential customers’ needs, preferences, and perceptions before launching a product or entering a new market. Here’s how focus groups can be particularly effective for this kind of research goal:

Real conversations

Focus groups allow for real-time, interactive discussions, giving you a front-row seat to hear what your potential customers think and feel about your product or service idea.

Diverse Perspectives

By bringing together people from various backgrounds, a focus group can offer a wide range of views and insights, highlighting different consumer needs and contextual information that you might miss out on in a survey.

Spotting opportunities and challenges

The dynamic nature of focus groups can help uncover unique market opportunities or potential challenges that might not be evident through other research methods, like cultural nuances.

Testing ideas

A focus group is a great way to test and compare reactions to different market entry strategies, from pricing models to distribution channels, providing clear direction on what approach might work best.

5. Case studies to gain a nuanced understanding of consumers on a broad level

Case studies in qualitative research zoom in on specific stories from customers or groups using a product or service, great for gaining a nuanced understanding of consumers at a broad level. Here’s why case studies are a particularly effective qualitative data analysis tool for this type of research goal:

In-depth analysis

Case studies can provide a 360-degree look at the consumer experience, from initial awareness to post-purchase feelings.

This depth of insight reveals not just what consumers do, but why they do it, uncovering motivations, influences, and decision-making processes.

Longitudinal insight

Case studies can track changes in consumer behavior or satisfaction over time, offering a dynamic view of how perceptions evolve.

This longitudinal perspective is crucial for giving context to the lifecycle of consumer engagement with a brand.

Storytelling power

The narrative nature of case studies — when done right — makes them powerful tools for communicating complex consumer insights in an accessible and engaging way, which can be especially useful for internal strategy discussions or external marketing communications.

6. Driving product development with diary studies

Diary studies are a unique qualitative research method that involves participants recording their thoughts, experiences, or behaviors over a period of time, related to using a product or service. This qualitative data analysis method is especially valuable for driving product development for several reasons:

Real-time insights

Diary studies capture real-time user experiences and feedback as they interact with a product in their daily lives.

This ongoing documentation provides a raw, unfiltered view of how a product fits into the user’s routine, highlighting usability issues or unmet needs that might not be captured in a one-time survey or interview.

Realistic user journey mapping

By analyzing diary entries, you can map out the entire user journey, identifying critical touch points where users feel delighted, frustrated, or indifferent.

This then enables you to implement targeted improvements and innovations at the moments that matter most.

Identifying patterns

Over the course of a diary study, patterns in behavior, preferences, and challenges can emerge, which is great for thematic analysis.

It can guide product developers to prioritize features or fixes that will have the most significant impact on user satisfaction, which is especially great if they don’t know what areas to focus on first.

Qualitative research brings your consumers’ voices directly to your strategy table. The examples we’ve explored show how qualitative data analysis methods like surveys, interviews, and case studies illuminate the ‘why’ behind consumer choices, guiding more informed decisions. Using these insights means crafting products and messages that resonate deeply, ensuring your brand not only meets but exceeds consumer expectations.

Customer Research Manager

Making it personal – using tech to build connections with consumers | diageo, panel discussion – future-proofing your brand with consumer insights, attest product release: multi-market | attest’s alyssa stringer, subscribe to our newsletter.

Fill in your email and we’ll drop fresh insights and events info into your inbox each week.

* I agree to receive communications from Attest. Privacy Policy .

You're now subscribed to our mailing list to receive exciting news, reports, and other updates!

IMAGES

Example Of A Methodology For A Qualitative Research Paper
Qualitative Research Paper Critique Example
Examples Of Qualitative Research Paper : (PDF) The Town Hall Focus
Writing a Qualitative Research Paper.pdf
Qualitative Research Paper Critique Example
(PDF) Qualitative Research Paper

VIDEO

What is a research paper? How to read a research paper?
qualitative and quantitative research critique
How to Read a Quantitative Research Article
How to Publish Qualitative paper with Nvivo by Dr Jaspreet kaur
Qualitative Research Characteristics
Collective qualitative analysis

COMMENTS

How to read a paper: Papers that go beyond numbers (qualitative research)
Summary points. Qualitative methods aim to make sense of, or interpret, phenomena in terms of the meanings people bring to them. Qualitative research may define preliminary questions which can then be addressed in quantitative studies. A good qualitative study will address a clinical problem through a clearly formulated question and using more ...
Critically appraising qualitative research
Six key questions will help readers to assess qualitative research #### Summary points Over the past decade, readers of medical journals have gained skills in critically appraising studies to determine whether the results can be trusted and applied to their own practice settings. Criteria have been designed to assess studies that use quantitative methods, and these are now in common use. In ...
Chapter 1. Introduction
Although qualitative research studies can and often do change and develop over the course of data collection, it is important to have a good idea of what the aims and goals of your study are at the outset and a good plan of how to achieve those aims and goals. Chapter 2 provides a road map of the process.
How to use and assess qualitative research methods
Abstract. This paper aims to provide an overview of the use and assessment of qualitative research methods in the health sciences. Qualitative research can be defined as the study of the nature of phenomena and is especially appropriate for answering questions of why something is (not) observed, assessing complex multi-component interventions ...
Qualitative Research: Getting Started
Qualitative research was historically employed in fields such as sociology, ... More information about the collection of qualitative data may be found in the "Further Reading" section of this paper. It is essential that data gathered during interviews, focus groups, and observation sessions are stored in a retrievable format. ...
Planning Qualitative Research: Design and Decision Making for New
Given the nuance and complexity of qualitative research, this paper provides an accessible starting point from which novice researchers can begin their journey of learning about, designing, and conducting qualitative research. ... The first step is to read and re-read the transcript closely, then write a short summary of the key elements ...
Qualitative Research: Data Collection, Analysis, and Management
Further reading about "doing" qualitative research can be found at the end of this paper. CONCLUSIONS Qualitative research can help researchers to access the thoughts and feelings of research participants, which can enable development of an understanding of the meaning that people ascribe to their experiences.
What Is Qualitative Research?
Qualitative research involves collecting and analyzing non-numerical data (e.g., text, video, or audio) to understand concepts, opinions, or experiences. It can be used to gather in-depth insights into a problem or generate new ideas for research. Qualitative research is the opposite of quantitative research, which involves collecting and ...
[How to read a qualitative research paper?]
By considering four key points, readers can interpret a qualitative paper. The chosen research method should fit the research question. Within medicine, the most common types of qualitative research are: (a) in-depth interviews, (b) focus groups, (c) participating observation, and (d) document analysis. The researchers should sufficiently ...
PDF A Guide to Using Qualitative Research Methodology
However, for many research projects, there are different sorts of questions that need answering, some requiring quantitative methods, and some requiring qualitative methods. If the question is a qualitative one, then the most appropriate and rigorous way of answering it is to use qualitative methods. For instance, if you
Five Steps to Writing More Engaging Qualitative Research
A-85). Successful writing requires a writer to pay quiet diligent attention to the construction of the genre they are working in. Each genre has its own sense of verisimilitude—the bearing of truth. Each places different constraints on the writer and has different goals, forms, and structure.
31 Writing Up Qualitative Research
Abstract. This chapter provides guidelines for writing journal articles based on qualitative approaches. The guidelines are part of the tradition of the Chicago School of Sociology and the author's experience as a writer and reviewer. The guidelines include understanding experiences in context, immersion, interpretations grounded in accounts ...
Qualitative Methods
The database covers both qualitative and quantitative research methods as well as mixed methods approaches to conducting research. SAGE Research Methods Online and Cases NOTE : For a list of online communities, research centers, indispensable learning resources, and personal websites of leading qualitative researchers, GO HERE .
PDF Reporting Qualitative Research in Psychology
Chapters 4 through 7 consider the typical sections of a qualitative research paper— the introductory sections, Method, Results, and Discussion. These chapters emphasize aspects of reporting that are unique to qualitative research. They describe the general elements that should be reported in qualitative papers and can assist authors in devel-
PDF How to Read a Paper
Researchers must read papers for several reasons: to re-view them for a conference or a class, to keep current in their eld, or for a literature survey of a new eld. A typi-cal researcher will likely spend hundreds of hours every year reading papers. Learning to e ciently read a paper is a critical but rarely taught skill.
How to use and assess qualitative research methods
Quality assessment. This paper aims to provide an overview of the use and assessment of qualitative research methods in the health sciences. Qualitative research can be defined as the study of the nature of phenomena and is especially appropriate for answering questions of why something is (not) observed, assessing complex multi-component ...
How To Read A Paper
On this page you will find links to articles in the BMJ that explain how to read and interpret different kinds of research papers: Papers that go beyond numbers (qualitative research) Trisha Greenhalgh, Rod Taylor Papers that summarise other papers (systematic reviews and meta-analyses) Trisha
Organizing Your Social Sciences Research Paper
Below are recommendations on how to read each section of a research paper effectively. Note that the sections to read are out of order from how you will find them organized in a journal article or research paper. 1. Abstract. The abstract summarizes the background, methods, results, discussion, and conclusions of a scholarly article or research ...
Criteria for Good Qualitative Research: A Comprehensive Review
This review aims to synthesize a published set of evaluative criteria for good qualitative research. The aim is to shed light on existing standards for assessing the rigor of qualitative research encompassing a range of epistemological and ontological standpoints. Using a systematic search strategy, published journal articles that deliberate criteria for rigorous research were identified. Then ...
Qualitative Research Resources: Finding Qualitative Studies
Qualitative Health Research 10: 1435-1443. Evans, D. 2002. Database searches for qualitative research. Journal of the Medical Libraries Association, 90(3): 290-293. Flemming K, Briggs M. 2007. Electronic searching to locate qualitative research: evaluation of three strategies. J Adv Nurs. 57(1):95-100. Gorecki CA, Brown JM, Briggs M, Nixon J. 2010.
Presenting and Evaluating Qualitative Research
The purpose of this paper is to help authors to think about ways to present qualitative research papers in the American Journal of Pharmaceutical Education. It also discusses methods for reviewers to assess the rigour, quality, and usefulness of qualitative research. Examples of different ways to present data from interviews, observations, and ...
Communicating the Findings of Qualitative Research
The study revealed that qualitative research is a valuable approach in higher education as it allows for a deeper understanding of complex phenomena and provides a rich description of experiences ...
6 Qualitative Data Examples for Thorough Researchers
Tip: Combine nominal data with other qualitative data collection and analysis methods, like open-ended questions or observations to enrich the insights, and throw in some quantitative data to back up any claims even more. For instance, after categorizing product preferences, follow up with questions on why certain categories are preferred, which will add layers to the understanding gained from ...
How to Write a Literature Review
Examples of literature reviews. Step 1 - Search for relevant literature. Step 2 - Evaluate and select sources. Step 3 - Identify themes, debates, and gaps. Step 4 - Outline your literature review's structure. Step 5 - Write your literature review.
Dyslexia: Disclaiming Reading Ability Langke Rembong District Primary
Study This use method study descriptive with approach qualitative research conducted in several elementary schools in the district Langke Rembong, Regency Manggarai. Subject study that is student 5th grade in each school target. Data collection techniques use observation, interviews, identification and assessment.

Search form

Critically appraising qualitative research

Summary points

Box 1 Key questions to ask when reading qualitative research studies

Box 2 Qualitative sampling methods for interviews and focus groups 9

In conclusion: is what the researchers did clear?

Further reading

Journal articles

Internet resources

Chapter 1. Introduction

Why an Open Access Textbook on Qualitative Research Methods?

What is Research?

What is Qualitative Research?

Examples of Qualitative Research

Example 1 : The End Game (ethnography + interviews)

Example 2: Racing for Innocence (Interviews + Content Analysis + Fictional Stories)

Example 3: Amplified Advantage (Mixed Methods: Survey Interviews + Focus Groups + Archives)

How Is This Book Organized?

Chapter Descriptions

Recommended Reading: Other Qualitative Research Textbooks

Patton’s Ten Suggestions for Doing Qualitative Research

[How to read a qualitative research paper?]

31 Writing Up Qualitative Research

Some General Principles

Details on These General Principles

High-Quality Data

Sample Size

Quality of the Analysis

Research Report Sections

Prior Research and Theory

Reflexivity Statements

Research Questions, Hypotheses, and Definitions

Methods Section

Accounts of Methodologies

Description of Sample

Recruitment

Data Collection and Analysis

Data Analysis

Generalizability

Trustworthiness and Authenticity

Findings Sections

Core Concepts

Discussion Sections

This Feature Is Available To Subscribers Only

How to use and assess qualitative research methods

What is qualitative research?

Why conduct qualitative research?

How to conduct qualitative research?

Data collection

Document study

Observations

Semi-structured interviews

Focus groups

Choosing the “right” method

Data analysis

How to report qualitative research?

How to combine qualitative with quantitative research?

How to assess qualitative research?

Reflexivity

Sampling and saturation

Member checking

Stakeholder involvement

How not to assess qualitative research

Protocol adherence

Sample size

Randomisation

Interrater reliability, variability and other “objectivity checks”

Not being quantitative research

Availability of data and materials

Abbreviations

Acknowledgements

Author information

Contributions

Corresponding author

Ethics declarations

Additional information

Rights and permissions

About this article

Share this article

Neurological Research and Practice