5 limitations of qualitative research

• Business Intelligence Reporting
• Data Driven
• Data Analysis Method
• Business Model
• Business Analysis
• Quantitative Research
• Business Analytics
• Marketing Analytics
• Data Integration
• Digital Transformation Strategy
• Online Training
• Local Training Events

5 Strengths and 5 Limitations of Qualitative Research

Lauren Christiansen

Insight into qualitative research.

Anyone who reviews a bunch of numbers knows how impersonal that feels. What do numbers really reveal about a person's beliefs, motives, and thoughts? While it's critical to collect statistical information to identify business trends and inefficiencies, stats don't always tell the full story. Why does the customer like this product more than the other one? What motivates them to post this particular hashtag on social media? How do employees actually feel about the new supply chain process? To answer more personal questions that delve into the human experience, businesses often employ a qualitative research process.

10 Key Strengths and Limitations of Qualitative Research

Qualitative research helps entrepreneurs and established companies understand the many factors that drive consumer behavior. Because most organizations collect and analyze quantitative data, they don't always know exactly how a target market feels and what it wants. It helps researchers when they can observe a small sample size of consumers in a comfortable environment, ask questions, and let them speak. Research methodology varies depending on the industry and type of business needs. Many companies employ mixed methods to extract the insights they require to improve decision-making. While both quantitative research and qualitative methods are effective, there are limitations to both. Quantitative research is expensive, time-consuming, and presents a limited understanding of consumer needs. However, qualitative research methods generate less verifiable information as all qualitative data is based on experience. Businesses should use a combination of both methods to overcome any associated limitations.

Strengths of Qualitative Research

• Captures New Beliefs - Qualitative research methods extrapolate any evolving beliefs within a market. This may include who buys a product/service, or how employees feel about their employers.
• Fewer Limitations - Qualitative studies are less stringent than quantitative ones. Outside the box answers to questions, opinions, and beliefs are included in data collection and data analysis.
• More Versatile - Qualitative research is much easier at times for researchers. They can adjust questions, adapt to circumstances that change or change the environment to optimize results.
• Greater Speculation - Researchers can speculate more on what answers to drill down into and how to approach them. They can use instinct and subjective experience to identify and extract good data.
• More Targeted - This research process can target any area of the business or concern it may have. Researchers can concentrate on specific target markets to collect valuable information. This takes less time and requires fewer resources than quantitative studies.

Limitations of Qualitative Research

• Sample Sizes - Businesses need to find a big enough group of participants to ensure results are accurate. A sample size of 15 people is not enough to show a reliable picture of how consumers view a product. If it is not possible to find a large enough sample size, the data collected may be insufficient.
• Bias - For internal qualitative studies, employees may be biased. For example, workers may give a popular answer that colleagues agree with rather than a true opinion. This can negatively influence the outcome of the study.
• Self-Selection Bias - Businesses that call on volunteers to answer questions worry that the people who respond are not reflective of the greater group. It is better if the company selects individuals at random for research studies, particularly if they are employees. However, this changes the process from qualitative to quantitative methods.
• Artificial - It isn't typical to observe consumers in stores, gather a focus group together, or ask employees about their experiences at work. This artificiality may impact the findings, as it is outside the norm of regular behavior and interactions.
• Quality - Questions It's hard to know whether researcher questions are quality or not because they are all subjective. Researchers need to ask how and why individuals feel the way they do to receive the most accurate answers.

Key Takeaways on Strengths and Limitations of Qualitative Research

• Qualitative research helps entrepreneurs and small businesses understand what drives human behavior. It is also used to see how employees feel about workflows and tasks.
• Companies can extract insights from qualitative research to optimize decision-making and improve products or services.
• Qualitative research captures new beliefs, has fewer limitations, is more versatile, and is more targeted. It also allows researchers to speculate and insert themselves more into the research study.
• Qualitative research has many limitations which include possible small sample sizes, potential bias in answers, self-selection bias, and potentially poor questions from researchers. It also can be artificial because it isn't typical to observe participants in focus groups, ask them questions at work, or invite them to partake in this type of research method.

Must-Read Content

The Top Qualitative Research Methods for Business Success

5 Qualitative Research Examples in Action

7 Types of Qualitative Research to Look Out For

What is Qualitative Research, Really?

23 Advantages and Disadvantages of Qualitative Research

Investigating methodologies. Taking a closer look at ethnographic, anthropological, or naturalistic techniques. Data mining through observer recordings. This is what the world of qualitative research is all about. It is the comprehensive and complete data that is collected by having the courage to ask an open-ended question.

Print media has used the principles of qualitative research for generations. Now more industries are seeing the advantages that come from the extra data that is received by asking more than a “yes” or “no” question.

The advantages and disadvantages of qualitative research are quite unique. On one hand, you have the perspective of the data that is being collected. On the other hand, you have the techniques of the data collector and their own unique observations that can alter the information in subtle ways.

That’s why these key points are so important to consider.

What Are the Advantages of Qualitative Research?

1. Subject materials can be evaluated with greater detail. There are many time restrictions that are placed on research methods. The goal of a time restriction is to create a measurable outcome so that metrics can be in place. Qualitative research focuses less on the metrics of the data that is being collected and more on the subtleties of what can be found in that information. This allows for the data to have an enhanced level of detail to it, which can provide more opportunities to glean insights from it during examination.

2. Research frameworks can be fluid and based on incoming or available data. Many research opportunities must follow a specific pattern of questioning, data collection, and information reporting. Qualitative research offers a different approach. It can adapt to the quality of information that is being gathered. If the available data does not seem to be providing any results, the research can immediately shift gears and seek to gather data in a new direction. This offers more opportunities to gather important clues about any subject instead of being confined to a limited and often self-fulfilling perspective.

3. Qualitative research data is based on human experiences and observations. Humans have two very different operating systems. One is a subconscious method of operation, which is the fast and instinctual observations that are made when data is present. The other operating system is slower and more methodical, wanting to evaluate all sources of data before deciding. Many forms of research rely on the second operating system while ignoring the instinctual nature of the human mind. Qualitative research doesn’t ignore the gut instinct. It embraces it and the data that can be collected is often better for it.

4. Gathered data has a predictive quality to it. One of the common mistakes that occurs with qualitative research is an assumption that a personal perspective can be extrapolated into a group perspective. This is only possible when individuals grow up in similar circumstances, have similar perspectives about the world, and operate with similar goals. When these groups can be identified, however, the gathered individualistic data can have a predictive quality for those who are in a like-minded group. At the very least, the data has a predictive quality for the individual from whom it was gathered.

5. Qualitative research operates within structures that are fluid. Because the data being gathered through this type of research is based on observations and experiences, an experienced researcher can follow-up interesting answers with additional questions. Unlike other forms of research that require a specific framework with zero deviation, researchers can follow any data tangent which makes itself known and enhance the overall database of information that is being collected.

6. Data complexities can be incorporated into generated conclusions. Although our modern world tends to prefer statistics and verifiable facts, we cannot simply remove the human experience from the equation. Different people will have remarkably different perceptions about any statistic, fact, or event. This is because our unique experiences generate a different perspective of the data that we see. These complexities, when gathered into a singular database, can generate conclusions with more depth and accuracy, which benefits everyone.

7. Qualitative research is an open-ended process. When a researcher is properly prepared, the open-ended structures of qualitative research make it possible to get underneath superficial responses and rational thoughts to gather information from an individual’s emotional response. This is critically important to this form of researcher because it is an emotional response which often drives a person’s decisions or influences their behavior.

8. Creativity becomes a desirable quality within qualitative research. It can be difficult to analyze data that is obtained from individual sources because many people subconsciously answer in a way that they think someone wants. This desire to “please” another reduces the accuracy of the data and suppresses individual creativity. By embracing the qualitative research method, it becomes possible to encourage respondent creativity, allowing people to express themselves with authenticity. In return, the data collected becomes more accurate and can lead to predictable outcomes.

9. Qualitative research can create industry-specific insights. Brands and businesses today need to build relationships with their core demographics to survive. The terminology, vocabulary, and jargon that consumers use when looking at products or services is just as important as the reputation of the brand that is offering them. If consumers are receiving one context, but the intention of the brand is a different context, then the miscommunication can artificially restrict sales opportunities. Qualitative research gives brands access to these insights so they can accurately communicate their value propositions.

10. Smaller sample sizes are used in qualitative research, which can save on costs. Many qualitative research projects can be completed quickly and on a limited budget because they typically use smaller sample sizes that other research methods. This allows for faster results to be obtained so that projects can move forward with confidence that only good data is able to provide.

11. Qualitative research provides more content for creatives and marketing teams. When your job involves marketing, or creating new campaigns that target a specific demographic, then knowing what makes those people can be quite challenging. By going through the qualitative research approach, it becomes possible to congregate authentic ideas that can be used for marketing and other creative purposes. This makes communication between the two parties to be handled with more accuracy, leading to greater level of happiness for all parties involved.

12. Attitude explanations become possible with qualitative research. Consumer patterns can change on a dime sometimes, leaving a brand out in the cold as to what just happened. Qualitative research allows for a greater understanding of consumer attitudes, providing an explanation for events that occur outside of the predictive matrix that was developed through previous research. This allows the optimal brand/consumer relationship to be maintained.

What Are the Disadvantages of Qualitative Research?

1. The quality of the data gathered in qualitative research is highly subjective. This is where the personal nature of data gathering in qualitative research can also be a negative component of the process. What one researcher might feel is important and necessary to gather can be data that another researcher feels is pointless and won’t spend time pursuing it. Having individual perspectives and including instinctual decisions can lead to incredibly detailed data. It can also lead to data that is generalized or even inaccurate because of its reliance on researcher subjectivisms.

2. Data rigidity is more difficult to assess and demonstrate. Because individual perspectives are often the foundation of the data that is gathered in qualitative research, it is more difficult to prove that there is rigidity in the information that is collective. The human mind tends to remember things in the way it wants to remember them. That is why memories are often looked at fondly, even if the actual events that occurred may have been somewhat disturbing at the time. This innate desire to look at the good in things makes it difficult for researchers to demonstrate data validity.

3. Mining data gathered by qualitative research can be time consuming. The number of details that are often collected while performing qualitative research are often overwhelming. Sorting through that data to pull out the key points can be a time-consuming effort. It is also a subjective effort because what one researcher feels is important may not be pulled out by another researcher. Unless there are some standards in place that cannot be overridden, data mining through a massive number of details can almost be more trouble than it is worth in some instances.

4. Qualitative research creates findings that are valuable, but difficult to present. Presenting the findings which come out of qualitative research is a bit like listening to an interview on CNN. The interviewer will ask a question to the interviewee, but the goal is to receive an answer that will help present a database which presents a specific outcome to the viewer. The goal might be to have a viewer watch an interview and think, “That’s terrible. We need to pass a law to change that.” The subjective nature of the information, however, can cause the viewer to think, “That’s wonderful. Let’s keep things the way they are right now.” That is why findings from qualitative research are difficult to present. What a research gleans from the data can be very different from what an outside observer gleans from the data.

5. Data created through qualitative research is not always accepted. Because of the subjective nature of the data that is collected in qualitative research, findings are not always accepted by the scientific community. A second independent qualitative research effort which can produce similar findings is often necessary to begin the process of community acceptance.

6. Researcher influence can have a negative effect on the collected data. The quality of the data that is collected through qualitative research is highly dependent on the skills and observation of the researcher. If a researcher has a biased point of view, then their perspective will be included with the data collected and influence the outcome. There must be controls in place to help remove the potential for bias so the data collected can be reviewed with integrity. Otherwise, it would be possible for a researcher to make any claim and then use their bias through qualitative research to prove their point.

7. Replicating results can be very difficult with qualitative research. The scientific community wants to see results that can be verified and duplicated to accept research as factual. In the world of qualitative research, this can be very difficult to accomplish. Not only do you have the variability of researcher bias for which to account within the data, but there is also the informational bias that is built into the data itself from the provider. This means the scope of data gathering can be extremely limited, even if the structure of gathering information is fluid, because of each unique perspective.

8. Difficult decisions may require repetitive qualitative research periods. The smaller sample sizes of qualitative research may be an advantage, but they can also be a disadvantage for brands and businesses which are facing a difficult or potentially controversial decision. A small sample is not always representative of a larger population demographic, even if there are deep similarities with the individuals involve. This means a follow-up with a larger quantitative sample may be necessary so that data points can be tracked with more accuracy, allowing for a better overall decision to be made.

9. Unseen data can disappear during the qualitative research process. The amount of trust that is placed on the researcher to gather, and then draw together, the unseen data that is offered by a provider is enormous. The research is dependent upon the skill of the researcher being able to connect all the dots. If the researcher can do this, then the data can be meaningful and help brands and progress forward with their mission. If not, there is no way to alter course until after the first results are received. Then a new qualitative process must begin.

10. Researchers must have industry-related expertise. You can have an excellent researcher on-board for a project, but if they are not familiar with the subject matter, they will have a difficult time gathering accurate data. For qualitative research to be accurate, the interviewer involved must have specific skills, experiences, and expertise in the subject matter being studied. They must also be familiar with the material being evaluated and have the knowledge to interpret responses that are received. If any piece of this skill set is missing, the quality of the data being gathered can be open to interpretation.

11. Qualitative research is not statistically representative. The one disadvantage of qualitative research which is always present is its lack of statistical representation. It is a perspective-based method of research only, which means the responses given are not measured. Comparisons can be made and this can lead toward the duplication which may be required, but for the most part, quantitative data is required for circumstances which need statistical representation and that is not part of the qualitative research process.

The advantages and disadvantages of qualitative research make it possible to gather and analyze individualistic data on deeper levels. This makes it possible to gain new insights into consumer thoughts, demographic behavioral patterns, and emotional reasoning processes. When a research can connect the dots of each information point that is gathered, the information can lead to personalized experiences, better value in products and services, and ongoing brand development.

Limitations and Weaknesses Of Qualitative Research

Limitations and Weaknesses Of Qualitative Research: To make informed conclusions, research involves obtaining data. The analysis is founded on logical thinking, as accuracy is one of the most important components of research. Research takes several forms and may serve various purposes, depending on the methodology used. There are primarily two main research methodologies: quantitative (focused on measurement and figures) and qualitative (concerned with understanding and words).

Anyone who has looked through a lot of figures, though, is aware of how impersonal it might feel. What do figures tell us about someone’s views, motivations, and thoughts? Even while it’s important to gather statistical data to spot company trends and inefficiencies, statistics don’t always provide the whole picture.

For a long time, qualitative research has been conducted using its guiding principles. Findings from this research approach have frequently been utilized by media and marketing to provide targeted content or provide a personalized brand message.

Data from qualitative research mostly comes from observations made by people. It can provide a deeper, more complete picture of consumer behavior by providing a window into audiences’ brains that quantitative data simply cannot. Customers appreciate hearing from businesses, so talking to them helps marketers better understand who their target market is. It also helps with customer service. This improves a company’s interaction with its customers and prepares the road for consumer endorsements.

As we’ve previously said, qualitative research is done to learn more about the underlying causes and motives in-depth. Qualitative research does have constraints, though. So, in this essay, we’ll talk about the Limitations and weaknesses of qualitative research.

Recommended: Limitations and Weaknesses Of Quantitative Research

Table of Contents

What is qualitative research?

A market research technique called qualitative research concentrates on gathering information through conversational and open-ended dialogue. This approach emphasizes “ why ” rather than “ what ” others think of you. Marketers like penetrating their target audience’s brains. But to achieve that, they must conduct a qualitative study. Qualitative observations, focus groups, and in-person interviews may all give you insightful information about your market, your goods, and the attitudes and motives of your consumers.

Consider that you operate a general audience web store. Demographic investigation reveals that the majority of your consumers are men. Naturally, you’ll be curious to know why ladies aren’t making purchases from you. And you’ll be able to discover it through qualitative research.

Also see: Most Powerful and Strongest Families In the world

Limitations and Weaknesses of Qualitative Research Methods

1. The data quality is very debatable: This is where the subjective aspect of data collection in qualitative research may potentially be a drawback. Another researcher may view data that one believes is relevant and necessary to collect as meaningless and choose not to pursue it.

Individual viewpoints and instinctive choices might result in very comprehensive data. Because of its dependence on researcher subjectivism, it can also result in data that is oversimplified or even erroneous.

2. It is based on the researcher’s experience: Only the experience of the researchers participating in the process will determine the quality of the data gathered through qualitative research. A researcher who is knowledgeable about the sector must gather data that is particular to that business.

For the data to be accurate, researchers must also be skilled at conducting effective interviews, brave enough to follow up with participants, and able to establish rapport with them on a professional level.

Also see: Advantages and Disadvantages of Being an Entrepreneur

3. It is more challenging to evaluate and prove data rigidity: It is more challenging to demonstrate rigidity in collective data since individual viewpoints frequently serve as the basis of data collected in qualitative research. The human mind frequently recalls information in the way that it desires. Because of this, even if the events themselves may have been rather upsetting at the time, recollections are frequently viewed with nostalgia.

Researchers find it challenging to show the veracity of their findings because of our fundamental tendency to see the bright side of things.

4. It could take a lot of time: Data collection takes longer since researchers go off in many different directions. Additionally, sorting through all of that additional data takes time. The value of every data point is never certain since it is appraised subjectively.

In contrast to data gathered via qualitative research, data gathered through other research forms are subject to strict criteria and expectations that enable it to be reviewed and used more quickly.

Also see: How to Become A Better Version of Yourself Everyday

5. Data with uncertain values are produced: Due to the diversity of their viewpoints, even researchers may disagree on the importance of the data being gathered. The qualitative research method depends on the researcher engaged to determine what is included and what is eliminated. Due to its very subjective nature, this data collecting procedure. It is always feasible to offer detailed data, but only in cases when the researcher can put their prejudice and viewpoint aside and present the material in its unprocessed state.

6. It is not statistically significant: Its absence of statistical representation is the one drawback of qualitative research that is always present. The replies provided are not quantified because it is a perspective-based research approach only.

Although it is possible to compare results and this may result in the necessary duplication. Most situations that call for statistical representation and are outside the scope of qualitative research need quantitative data.

Also see: Differences Between Praise And Worship

7. Repeated qualitative research periods may be necessary for difficult conclusions: For brands and enterprises that must make a difficult or possibly divisive decision, the smaller sample sizes of qualitative research may be both an advantage and a drawback.

Even though the people in the sample share a lot of characteristics, a small sample is not always indicative of wider general demography. This indicates that a follow-up with a bigger quantitative sample may be required to track data points with more precision and make a better overall judgment.

8. Qualitative research-generated data isn’t often taken seriously: Findings from qualitative research are not always embraced by the scientific community because of the subjective character of the data that is gathered. To start the process of community acceptability, it is frequently required to conduct a second independent qualitative research project that can yield comparable findings.

Also see: Differences Between Objective And Subjective

9. In the course of qualitative study, hidden facts may vanish: It is entrusted to the researcher with a great deal of faith that they will obtain and then compile the hidden data that a supplier makes available. The ability of the researcher to make all the connections is essential to the research’s success.

If the researcher is successful in doing this, the data will be significant and will aid brands in advancing their goals. Otherwise, until the initial findings are acquired, there is no ability to change the course of action. The next step is to start a fresh qualitative procedure.

10. Researcher influence may have a detrimental impact on the data gathered: Qualitative research relies heavily on the abilities and observation of the researcher to provide high-quality data. A researcher’s point of view will be integrated with the data gathered if they have a biased viewpoint, which will affect the results.

Controls must be in place to assist in removing the possibility of bias so that the data gathered may be examined honestly. Otherwise, a researcher might assert anything and then utilize their bias in qualitative research to support their claim.

Also see: Advantages And Disadvantages of Cooperative Society

Any qualitative research project, in practice, has advantages and disadvantages. Thus, being aware of the constraints is essential to successful and relevant data collection. Qualitative research studies have the drawbacks of being more difficult to comprehend and are less likely to generalize to the entire community. It is essential to have a better understanding of how certain individuals and even groups think. But someone will always doubt the data’s dependability and truthfulness because of how subjective it is.

Edeh Samuel Chukwuemeka, ACMC, is a lawyer and a certified mediator/conciliator in Nigeria. He is also a developer with knowledge in various programming languages. Samuel is determined to leverage his skills in technology, SEO, and legal practice to revolutionize the legal profession worldwide by creating web and mobile applications that simplify legal research. Sam is also passionate about educating and providing valuable information to people.

Share this:

• Click to share on Twitter (Opens in new window)
• Click to share on Facebook (Opens in new window)
• Click to print (Opens in new window)
• Click to email a link to a friend (Opens in new window)
• Click to share on LinkedIn (Opens in new window)
• Click to share on WhatsApp (Opens in new window)

Leave a Comment Cancel Reply

Your email address will not be published. Required fields are marked *

Save my name, email, and website in this browser for the next time I comment.

Notify me of follow-up comments by email.

Notify me of new posts by email.

An official website of the United States government

The .gov means it’s official. Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

The site is secure. The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

• Publications
• Account settings

Preview improvements coming to the PMC website in October 2024. Learn More or Try it out now .

• Advanced Search
• Journal List
• Am J Pharm Educ
• v.74(8); 2010 Oct 11

Presenting and Evaluating Qualitative Research

The purpose of this paper is to help authors to think about ways to present qualitative research papers in the American Journal of Pharmaceutical Education . It also discusses methods for reviewers to assess the rigour, quality, and usefulness of qualitative research. Examples of different ways to present data from interviews, observations, and focus groups are included. The paper concludes with guidance for publishing qualitative research and a checklist for authors and reviewers.

INTRODUCTION

Policy and practice decisions, including those in education, increasingly are informed by findings from qualitative as well as quantitative research. Qualitative research is useful to policymakers because it often describes the settings in which policies will be implemented. Qualitative research is also useful to both pharmacy practitioners and pharmacy academics who are involved in researching educational issues in both universities and practice and in developing teaching and learning.

Qualitative research involves the collection, analysis, and interpretation of data that are not easily reduced to numbers. These data relate to the social world and the concepts and behaviors of people within it. Qualitative research can be found in all social sciences and in the applied fields that derive from them, for example, research in health services, nursing, and pharmacy. 1 It looks at X in terms of how X varies in different circumstances rather than how big is X or how many Xs are there? 2 Textbooks often subdivide research into qualitative and quantitative approaches, furthering the common assumption that there are fundamental differences between the 2 approaches. With pharmacy educators who have been trained in the natural and clinical sciences, there is often a tendency to embrace quantitative research, perhaps due to familiarity. A growing consensus is emerging that sees both qualitative and quantitative approaches as useful to answering research questions and understanding the world. Increasingly mixed methods research is being carried out where the researcher explicitly combines the quantitative and qualitative aspects of the study. 3 , 4

Like healthcare, education involves complex human interactions that can rarely be studied or explained in simple terms. Complex educational situations demand complex understanding; thus, the scope of educational research can be extended by the use of qualitative methods. Qualitative research can sometimes provide a better understanding of the nature of educational problems and thus add to insights into teaching and learning in a number of contexts. For example, at the University of Nottingham, we conducted in-depth interviews with pharmacists to determine their perceptions of continuing professional development and who had influenced their learning. We also have used a case study approach using observation of practice and in-depth interviews to explore physiotherapists' views of influences on their leaning in practice. We have conducted in-depth interviews with a variety of stakeholders in Malawi, Africa, to explore the issues surrounding pharmacy academic capacity building. A colleague has interviewed and conducted focus groups with students to explore cultural issues as part of a joint Nottingham-Malaysia pharmacy degree program. Another colleague has interviewed pharmacists and patients regarding their expectations before and after clinic appointments and then observed pharmacist-patient communication in clinics and assessed it using the Calgary Cambridge model in order to develop recommendations for communication skills training. 5 We have also performed documentary analysis on curriculum data to compare pharmacist and nurse supplementary prescribing courses in the United Kingdom.

It is important to choose the most appropriate methods for what is being investigated. Qualitative research is not appropriate to answer every research question and researchers need to think carefully about their objectives. Do they wish to study a particular phenomenon in depth (eg, students' perceptions of studying in a different culture)? Or are they more interested in making standardized comparisons and accounting for variance (eg, examining differences in examination grades after changing the way the content of a module is taught). Clearly a quantitative approach would be more appropriate in the last example. As with any research project, a clear research objective has to be identified to know which methods should be applied.

Types of qualitative data include:

• Audio recordings and transcripts from in-depth or semi-structured interviews
• Structured interview questionnaires containing substantial open comments including a substantial number of responses to open comment items.
• Audio recordings and transcripts from focus group sessions.
• Field notes (notes taken by the researcher while in the field [setting] being studied)
• Video recordings (eg, lecture delivery, class assignments, laboratory performance)
• Case study notes
• Documents (reports, meeting minutes, e-mails)
• Diaries, video diaries
• Observation notes
• Press clippings
• Photographs

RIGOUR IN QUALITATIVE RESEARCH

Qualitative research is often criticized as biased, small scale, anecdotal, and/or lacking rigor; however, when it is carried out properly it is unbiased, in depth, valid, reliable, credible and rigorous. In qualitative research, there needs to be a way of assessing the “extent to which claims are supported by convincing evidence.” 1 Although the terms reliability and validity traditionally have been associated with quantitative research, increasingly they are being seen as important concepts in qualitative research as well. Examining the data for reliability and validity assesses both the objectivity and credibility of the research. Validity relates to the honesty and genuineness of the research data, while reliability relates to the reproducibility and stability of the data.

The validity of research findings refers to the extent to which the findings are an accurate representation of the phenomena they are intended to represent. The reliability of a study refers to the reproducibility of the findings. Validity can be substantiated by a number of techniques including triangulation use of contradictory evidence, respondent validation, and constant comparison. Triangulation is using 2 or more methods to study the same phenomenon. Contradictory evidence, often known as deviant cases, must be sought out, examined, and accounted for in the analysis to ensure that researcher bias does not interfere with or alter their perception of the data and any insights offered. Respondent validation, which is allowing participants to read through the data and analyses and provide feedback on the researchers' interpretations of their responses, provides researchers with a method of checking for inconsistencies, challenges the researchers' assumptions, and provides them with an opportunity to re-analyze their data. The use of constant comparison means that one piece of data (for example, an interview) is compared with previous data and not considered on its own, enabling researchers to treat the data as a whole rather than fragmenting it. Constant comparison also enables the researcher to identify emerging/unanticipated themes within the research project.

STRENGTHS AND LIMITATIONS OF QUALITATIVE RESEARCH

Qualitative researchers have been criticized for overusing interviews and focus groups at the expense of other methods such as ethnography, observation, documentary analysis, case studies, and conversational analysis. Qualitative research has numerous strengths when properly conducted.

Strengths of Qualitative Research

• Issues can be examined in detail and in depth.
• Interviews are not restricted to specific questions and can be guided/redirected by the researcher in real time.
• The research framework and direction can be quickly revised as new information emerges.
• The data based on human experience that is obtained is powerful and sometimes more compelling than quantitative data.
• Subtleties and complexities about the research subjects and/or topic are discovered that are often missed by more positivistic enquiries.
• Data usually are collected from a few cases or individuals so findings cannot be generalized to a larger population. Findings can however be transferable to another setting.

Limitations of Qualitative Research

• Research quality is heavily dependent on the individual skills of the researcher and more easily influenced by the researcher's personal biases and idiosyncrasies.
• Rigor is more difficult to maintain, assess, and demonstrate.
• The volume of data makes analysis and interpretation time consuming.
• It is sometimes not as well understood and accepted as quantitative research within the scientific community
• The researcher's presence during data gathering, which is often unavoidable in qualitative research, can affect the subjects' responses.
• Issues of anonymity and confidentiality can present problems when presenting findings
• Findings can be more difficult and time consuming to characterize in a visual way.

PRESENTATION OF QUALITATIVE RESEARCH FINDINGS

The following extracts are examples of how qualitative data might be presented:

Data From an Interview.

The following is an example of how to present and discuss a quote from an interview.

The researcher should select quotes that are poignant and/or most representative of the research findings. Including large portions of an interview in a research paper is not necessary and often tedious for the reader. The setting and speakers should be established in the text at the end of the quote.

The student describes how he had used deep learning in a dispensing module. He was able to draw on learning from a previous module, “I found that while using the e learning programme I was able to apply the knowledge and skills that I had gained in last year's diseases and goals of treatment module.” (interviewee 22, male)

This is an excerpt from an article on curriculum reform that used interviews 5 :

The first question was, “Without the accreditation mandate, how much of this curriculum reform would have been attempted?” According to respondents, accreditation played a significant role in prompting the broad-based curricular change, and their comments revealed a nuanced view. Most indicated that the change would likely have occurred even without the mandate from the accreditation process: “It reflects where the profession wants to be … training a professional who wants to take on more responsibility.” However, they also commented that “if it were not mandated, it could have been a very difficult road.” Or it “would have happened, but much later.” The change would more likely have been incremental, “evolutionary,” or far more limited in its scope. “Accreditation tipped the balance” was the way one person phrased it. “Nobody got serious until the accrediting body said it would no longer accredit programs that did not change.”

Data From Observations

The following example is some data taken from observation of pharmacist patient consultations using the Calgary Cambridge guide. 6 , 7 The data are first presented and a discussion follows:

Pharmacist: We will soon be starting a stop smoking clinic. Patient: Is the interview over now? Pharmacist: No this is part of it. (Laughs) You can't tell me to bog off (sic) yet. (pause) We will be starting a stop smoking service here, Patient: Yes. Pharmacist: with one-to-one and we will be able to help you or try to help you. If you want it. In this example, the pharmacist has picked up from the patient's reaction to the stop smoking clinic that she is not receptive to advice about giving up smoking at this time; in fact she would rather end the consultation. The pharmacist draws on his prior relationship with the patient and makes use of a joke to lighten the tone. He feels his message is important enough to persevere but he presents the information in a succinct and non-pressurised way. His final comment of “If you want it” is important as this makes it clear that he is not putting any pressure on the patient to take up this offer. This extract shows that some patient cues were picked up, and appropriately dealt with, but this was not the case in all examples.

Data From Focus Groups

This excerpt from a study involving 11 focus groups illustrates how findings are presented using representative quotes from focus group participants. 8

Those pharmacists who were initially familiar with CPD endorsed the model for their peers, and suggested it had made a meaningful difference in the way they viewed their own practice. In virtually all focus groups sessions, pharmacists familiar with and supportive of the CPD paradigm had worked in collaborative practice environments such as hospital pharmacy practice. For these pharmacists, the major advantage of CPD was the linking of workplace learning with continuous education. One pharmacist stated, “It's amazing how much I have to learn every day, when I work as a pharmacist. With [the learning portfolio] it helps to show how much learning we all do, every day. It's kind of satisfying to look it over and see how much you accomplish.” Within many of the learning portfolio-sharing sessions, debates emerged regarding the true value of traditional continuing education and its outcome in changing an individual's practice. While participants appreciated the opportunity for social and professional networking inherent in some forms of traditional CE, most eventually conceded that the academic value of most CE programming was limited by the lack of a systematic process for following-up and implementing new learning in the workplace. “Well it's nice to go to these [continuing education] events, but really, I don't know how useful they are. You go, you sit, you listen, but then, well I at least forget.”

The following is an extract from a focus group (conducted by the author) with first-year pharmacy students about community placements. It illustrates how focus groups provide a chance for participants to discuss issues on which they might disagree.

Interviewer: So you are saying that you would prefer health related placements? Student 1: Not exactly so long as I could be developing my communication skill. Student 2: Yes but I still think the more health related the placement is the more I'll gain from it. Student 3: I disagree because other people related skills are useful and you may learn those from taking part in a community project like building a garden. Interviewer: So would you prefer a mixture of health and non health related community placements?

GUIDANCE FOR PUBLISHING QUALITATIVE RESEARCH

Qualitative research is becoming increasingly accepted and published in pharmacy and medical journals. Some journals and publishers have guidelines for presenting qualitative research, for example, the British Medical Journal 9 and Biomedcentral . 10 Medical Education published a useful series of articles on qualitative research. 11 Some of the important issues that should be considered by authors, reviewers and editors when publishing qualitative research are discussed below.

Introduction.

A good introduction provides a brief overview of the manuscript, including the research question and a statement justifying the research question and the reasons for using qualitative research methods. This section also should provide background information, including relevant literature from pharmacy, medicine, and other health professions, as well as literature from the field of education that addresses similar issues. Any specific educational or research terminology used in the manuscript should be defined in the introduction.

The methods section should clearly state and justify why the particular method, for example, face to face semistructured interviews, was chosen. The method should be outlined and illustrated with examples such as the interview questions, focusing exercises, observation criteria, etc. The criteria for selecting the study participants should then be explained and justified. The way in which the participants were recruited and by whom also must be stated. A brief explanation/description should be included of those who were invited to participate but chose not to. It is important to consider “fair dealing,” ie, whether the research design explicitly incorporates a wide range of different perspectives so that the viewpoint of 1 group is never presented as if it represents the sole truth about any situation. The process by which ethical and or research/institutional governance approval was obtained should be described and cited.

The study sample and the research setting should be described. Sampling differs between qualitative and quantitative studies. In quantitative survey studies, it is important to select probability samples so that statistics can be used to provide generalizations to the population from which the sample was drawn. Qualitative research necessitates having a small sample because of the detailed and intensive work required for the study. So sample sizes are not calculated using mathematical rules and probability statistics are not applied. Instead qualitative researchers should describe their sample in terms of characteristics and relevance to the wider population. Purposive sampling is common in qualitative research. Particular individuals are chosen with characteristics relevant to the study who are thought will be most informative. Purposive sampling also may be used to produce maximum variation within a sample. Participants being chosen based for example, on year of study, gender, place of work, etc. Representative samples also may be used, for example, 20 students from each of 6 schools of pharmacy. Convenience samples involve the researcher choosing those who are either most accessible or most willing to take part. This may be fine for exploratory studies; however, this form of sampling may be biased and unrepresentative of the population in question. Theoretical sampling uses insights gained from previous research to inform sample selection for a new study. The method for gaining informed consent from the participants should be described, as well as how anonymity and confidentiality of subjects were guaranteed. The method of recording, eg, audio or video recording, should be noted, along with procedures used for transcribing the data.

Data Analysis.

A description of how the data were analyzed also should be included. Was computer-aided qualitative data analysis software such as NVivo (QSR International, Cambridge, MA) used? Arrival at “data saturation” or the end of data collection should then be described and justified. A good rule when considering how much information to include is that readers should have been given enough information to be able to carry out similar research themselves.

One of the strengths of qualitative research is the recognition that data must always be understood in relation to the context of their production. 1 The analytical approach taken should be described in detail and theoretically justified in light of the research question. If the analysis was repeated by more than 1 researcher to ensure reliability or trustworthiness, this should be stated and methods of resolving any disagreements clearly described. Some researchers ask participants to check the data. If this was done, it should be fully discussed in the paper.

An adequate account of how the findings were produced should be included A description of how the themes and concepts were derived from the data also should be included. Was an inductive or deductive process used? The analysis should not be limited to just those issues that the researcher thinks are important, anticipated themes, but also consider issues that participants raised, ie, emergent themes. Qualitative researchers must be open regarding the data analysis and provide evidence of their thinking, for example, were alternative explanations for the data considered and dismissed, and if so, why were they dismissed? It also is important to present outlying or negative/deviant cases that did not fit with the central interpretation.

The interpretation should usually be grounded in interviewees or respondents' contributions and may be semi-quantified, if this is possible or appropriate, for example, “Half of the respondents said …” “The majority said …” “Three said…” Readers should be presented with data that enable them to “see what the researcher is talking about.” 1 Sufficient data should be presented to allow the reader to clearly see the relationship between the data and the interpretation of the data. Qualitative data conventionally are presented by using illustrative quotes. Quotes are “raw data” and should be compiled and analyzed, not just listed. There should be an explanation of how the quotes were chosen and how they are labeled. For example, have pseudonyms been given to each respondent or are the respondents identified using codes, and if so, how? It is important for the reader to be able to see that a range of participants have contributed to the data and that not all the quotes are drawn from 1 or 2 individuals. There is a tendency for authors to overuse quotes and for papers to be dominated by a series of long quotes with little analysis or discussion. This should be avoided.

Participants do not always state the truth and may say what they think the interviewer wishes to hear. A good qualitative researcher should not only examine what people say but also consider how they structured their responses and how they talked about the subject being discussed, for example, the person's emotions, tone, nonverbal communication, etc. If the research was triangulated with other qualitative or quantitative data, this should be discussed.

Discussion.

The findings should be presented in the context of any similar previous research and or theories. A discussion of the existing literature and how this present research contributes to the area should be included. A consideration must also be made about how transferrable the research would be to other settings. Any particular strengths and limitations of the research also should be discussed. It is common practice to include some discussion within the results section of qualitative research and follow with a concluding discussion.

The author also should reflect on their own influence on the data, including a consideration of how the researcher(s) may have introduced bias to the results. The researcher should critically examine their own influence on the design and development of the research, as well as on data collection and interpretation of the data, eg, were they an experienced teacher who researched teaching methods? If so, they should discuss how this might have influenced their interpretation of the results.

Conclusion.

The conclusion should summarize the main findings from the study and emphasize what the study adds to knowledge in the area being studied. Mays and Pope suggest the researcher ask the following 3 questions to determine whether the conclusions of a qualitative study are valid 12 : How well does this analysis explain why people behave in the way they do? How comprehensible would this explanation be to a thoughtful participant in the setting? How well does the explanation cohere with what we already know?

CHECKLIST FOR QUALITATIVE PAPERS

This paper establishes criteria for judging the quality of qualitative research. It provides guidance for authors and reviewers to prepare and review qualitative research papers for the American Journal of Pharmaceutical Education . A checklist is provided in Appendix 1 to assist both authors and reviewers of qualitative data.

ACKNOWLEDGEMENTS

Thank you to the 3 reviewers whose ideas helped me to shape this paper.

Appendix 1. Checklist for authors and reviewers of qualitative research.

Introduction

• □ Research question is clearly stated.
• □ Research question is justified and related to the existing knowledge base (empirical research, theory, policy).
• □ Any specific research or educational terminology used later in manuscript is defined.
• □ The process by which ethical and or research/institutional governance approval was obtained is described and cited.
• □ Reason for choosing particular research method is stated.
• □ Criteria for selecting study participants are explained and justified.
• □ Recruitment methods are explicitly stated.
• □ Details of who chose not to participate and why are given.
• □ Study sample and research setting used are described.
• □ Method for gaining informed consent from the participants is described.
• □ Maintenance/Preservation of subject anonymity and confidentiality is described.
• □ Method of recording data (eg, audio or video recording) and procedures for transcribing data are described.
• □ Methods are outlined and examples given (eg, interview guide).
• □ Decision to stop data collection is described and justified.
• □ Data analysis and verification are described, including by whom they were performed.
• □ Methods for identifying/extrapolating themes and concepts from the data are discussed.
• □ Sufficient data are presented to allow a reader to assess whether or not the interpretation is supported by the data.
• □ Outlying or negative/deviant cases that do not fit with the central interpretation are presented.
• □ Transferability of research findings to other settings is discussed.
• □ Findings are presented in the context of any similar previous research and social theories.
• □ Discussion often is incorporated into the results in qualitative papers.
• □ A discussion of the existing literature and how this present research contributes to the area is included.
• □ Any particular strengths and limitations of the research are discussed.
• □ Reflection of the influence of the researcher(s) on the data, including a consideration of how the researcher(s) may have introduced bias to the results is included.

Conclusions

• □ The conclusion states the main finings of the study and emphasizes what the study adds to knowledge in the subject area.