literature review of qualitative data

Archer Library

Qualitative research: literature review .

• Archer Library This link opens in a new window
• Schedule a Reference Appointment This link opens in a new window
• Qualitative Research Handout This link opens in a new window
• Locating Books
• ebook Collections This link opens in a new window
• A to Z Database List This link opens in a new window
• Research & Stats
• Literature Review Resources
• Citation & Reference

Exploring the literature review 

Literature review model: 6 steps.

Adapted from The Literature Review , Machi & McEvoy (2009, p. 13).

Your Literature Review

Step 2: search, boolean search strategies, search limiters, ★ ebsco & google drive.

1. Select a Topic

"All research begins with curiosity" (Machi & McEvoy, 2009, p. 14)

Selection of a topic, and fully defined research interest and question, is supervised (and approved) by your professor. Tips for crafting your topic include:

• Be specific. Take time to define your interest.
• Topic Focus. Fully describe and sufficiently narrow the focus for research.
• Academic Discipline. Learn more about your area of research & refine the scope.
• Avoid Bias. Be aware of bias that you (as a researcher) may have.
• Document your research. Use Google Docs to track your research process.
• Research apps. Consider using Evernote or Zotero to track your research.

Consider Purpose

What will your topic and research address?

In The Literature Review: A Step-by-Step Guide for Students , Ridley presents that literature reviews serve several purposes (2008, p. 16-17).  Included are the following points:

• Historical background for the research;
• Overview of current field provided by "contemporary debates, issues, and questions;"
• Theories and concepts related to your research;
• Introduce "relevant terminology" - or academic language - being used it the field;
• Connect to existing research - does your work "extend or challenge [this] or address a gap;" 
• Provide "supporting evidence for a practical problem or issue" that your research addresses.

★ Schedule a research appointment

At this point in your literature review, take time to meet with a librarian. Why? Understanding the subject terminology used in databases can be challenging. Archer Librarians can help you structure a search, preparing you for step two. How? Contact a librarian directly or use the online form to schedule an appointment. Details are provided in the adjacent Schedule an Appointment box.

2. Search the Literature

Collect & Select Data: Preview, select, and organize

AU Library is your go-to resource for this step in your literature review process. The literature search will include books and ebooks, scholarly and practitioner journals, theses and dissertations, and indexes. You may also choose to include web sites, blogs, open access resources, and newspapers. This library guide provides access to resources needed to complete a literature review.

Books & eBooks: Archer Library & OhioLINK

Databases: scholarly & practitioner journals.

Review the Library Databases tab on this library guide, it provides links to recommended databases for Education & Psychology, Business, and General & Social Sciences.

Expand your journal search; a complete listing of available AU Library and OhioLINK databases is available on the Databases  A to Z list . Search the database by subject, type, name, or do use the search box for a general title search. The A to Z list also includes open access resources and select internet sites.

Databases: Theses & Dissertations

Review the Library Databases tab on this guide, it includes Theses & Dissertation resources. AU library also has AU student authored theses and dissertations available in print, search the library catalog for these titles.

Did you know? If you are looking for particular chapters within a dissertation that is not fully available online, it is possible to submit an ILL article request . Do this instead of requesting the entire dissertation.

Newspapers:  Databases & Internet

Consider current literature in your academic field. AU Library's database collection includes The Chronicle of Higher Education and The Wall Street Journal .  The Internet Resources tab in this guide provides links to newspapers and online journals such as Inside Higher Ed , COABE Journal , and Education Week .

Search Strategies & Boolean Operators

There are three basic boolean operators:  AND, OR, and NOT.

Used with your search terms, boolean operators will either expand or limit results. What purpose do they serve? They help to define the relationship between your search terms. For example, using the operator AND will combine the terms expanding the search. When searching some databases, and Google, the operator AND may be implied.

Overview of boolean terms

About the example: Boolean searches were conducted on November 4, 2019; result numbers may vary at a later date. No additional database limiters were set to further narrow search returns.

Database Search Limiters

Database strategies for targeted search results.

Most databases include limiters, or additional parameters, you may use to strategically focus search results.  EBSCO databases, such as Education Research Complete & Academic Search Complete provide options to:

• Limit results to full text;
• Limit results to scholarly journals, and reference available;
• Select results source type to journals, magazines, conference papers, reviews, and newspapers
• Publication date

Keep in mind that these tools are defined as limiters for a reason; adding them to a search will limit the number of results returned.  This can be a double-edged sword.  How? 

• If limiting results to full-text only, you may miss an important piece of research that could change the direction of your research. Interlibrary loan is available to students, free of charge. Request articles that are not available in full-text; they will be sent to you via email.
• If narrowing publication date, you may eliminate significant historical - or recent - research conducted on your topic.
• Limiting resource type to a specific type of material may cause bias in the research results.

Use limiters with care. When starting a search, consider opting out of limiters until the initial literature screening is complete. The second or third time through your research may be the ideal time to focus on specific time periods or material (scholarly vs newspaper).

★ Truncating Search Terms

Expanding your search term at the root.

Truncating is often referred to as 'wildcard' searching. Databases may have their own specific wildcard elements however, the most commonly used are the asterisk (*) or question mark (?).  When used within your search. they will expand returned results.

Asterisk (*) Wildcard

Using the asterisk wildcard will return varied spellings of the truncated word. In the following example, the search term education was truncated after the letter "t."

Explore these database help pages for additional information on crafting search terms.

• EBSCO Connect: Searching with Wildcards and Truncation Symbols
• EBSCO Connect: Searching with Boolean Operators
• EBSCO Connect: EBSCOhost Search Tips
• EBSCO Connect: Basic Searching with EBSCO
• ProQuest Help: Search Tips
• ERIC: How does ERIC search work?

★ EBSCO Databases & Google Drive

Tips for saving research directly to Google drive.

Researching in an EBSCO database?

It is possible to save articles (PDF and HTML) and abstracts in EBSCOhost databases directly to Google drive. Select the Google Drive icon, authenticate using a Google account, and an EBSCO folder will be created in your account. This is a great option for managing your research. If documenting your research in a Google Doc, consider linking the information to actual articles saved in drive.

EBSCO Databases & Google Drive

EBSCOHost Databases & Google Drive: Managing your Research

This video features an overview of how to use Google Drive with EBSCO databases to help manage your research. It presents information for connecting an active Google account to EBSCO and steps needed to provide permission for EBSCO to manage a folder in Drive.

About the Video:  Closed captioning is available, select CC from the video menu.  If you need to review a specific area on the video, view on YouTube and expand the video description for access to topic time stamps.  A video transcript is provided below.

• EBSCOhost Databases & Google Scholar

Defining Literature Review

What is a literature review.

A definition from the Online Dictionary for Library and Information Sciences .

A literature review is "a comprehensive survey of the works published in a particular field of study or line of research, usually over a specific period of time, in the form of an in-depth, critical bibliographic essay or annotated list in which attention is drawn to the most significant works" (Reitz, 2014). 

A systemic review is "a literature review focused on a specific research question, which uses explicit methods to minimize bias in the identification, appraisal, selection, and synthesis of all the high-quality evidence pertinent to the question" (Reitz, 2014).

Recommended Reading

About this page

EBSCO Connect [Discovery and Search]. (2022). Searching with boolean operators. Retrieved May, 3, 2022 from https://connect.ebsco.com/s/?language=en_US

EBSCO Connect [Discover and Search]. (2022). Searching with wildcards and truncation symbols. Retrieved May 3, 2022; https://connect.ebsco.com/s/?language=en_US

Machi, L.A. & McEvoy, B.T. (2009). The literature review . Thousand Oaks, CA: Corwin Press: 

Reitz, J.M. (2014). Online dictionary for library and information science. ABC-CLIO, Libraries Unlimited . Retrieved from https://www.abc-clio.com/ODLIS/odlis_A.aspx

Ridley, D. (2008). The literature review: A step-by-step guide for students . Thousand Oaks, CA: Sage Publications, Inc.

Archer Librarians

Schedule an appointment.

Contact a librarian directly (email), or submit a request form. If you have worked with someone before, you can request them on the form.

• ★ Archer Library Help • Online Reqest Form
• Carrie Halquist • Reference & Instruction
• Jessica Byers • Reference & Curation
• Don Reams • Corrections Education & Reference
• Diane Schrecker • Education & Head of the IRC
• Tanaya Silcox • Technical Services & Business
• Sarah Thomas • Acquisitions & ATS Librarian
• << Previous: Research & Stats
• Next: Literature Review Resources >>
• Last Updated: Apr 23, 2024 3:47 PM
• URL: https://libguides.ashland.edu/qualitative

Archer Library • Ashland University © Copyright 2023. An Equal Opportunity/Equal Access Institution.

Chapter 9. Reviewing the Literature

What is a “literature review”.

No researcher ever comes up with a research question that is wholly novel. Someone, somewhere, has asked the same thing. Academic research is part of a larger community of researchers, and it is your responsibility, as a member of this community, to acknowledge others who have asked similar questions and to put your particular research into this greater context. It is not simply a convention or custom to begin your study with a review of previous literature (the “ lit review ”) but an important responsibility you owe the scholarly community.

Too often, new researchers pursue a topic to study and then write something like, “No one has ever studied this before” or “This area is underresearched.” It may be that no one has studied this particular group or setting, but it is highly unlikely no one has studied the foundational phenomenon of interest. And that comment about an area being underresearched? Be careful. The statement may simply signal to others that you haven’t done your homework. Rubin ( 2021 ) refers to this as “free soloing,” and it is not appreciated in academic work:

The truth of the matter is, academics don’t really like when people free solo. It’s really bad form to omit talking about the other people who are doing or have done research in your area. Partly, I mean we need to cite their work, but I also mean we need to respond to it—agree or disagree, clarify for extend. It’s also really bad form to talk about your research in a way that does not make it understandable to other academics.…You have to explain to your readers what your story is really about in terms they care about . This means using certain terminology, referencing debates in the literature, and citing relevant works—that is, in connecting your work to something else. ( 51–52 )

A literature review is a comprehensive summary of previous research on a topic. It includes both articles and books—and in some cases reports—relevant to a particular area of research. Ideally, one’s research question follows from the reading of what has already been produced. For example, you are interested in studying sports injuries related to female gymnasts. You read everything you can find on sports injuries related to female gymnasts, and you begin to get a sense of what questions remain open. You find that there is a lot of research on how coaches manage sports injuries and much about cultures of silence around treating injuries, but you don’t know what the gymnasts themselves are thinking about these issues. You look specifically for studies about this and find several, which then pushes you to narrow the question further. Your literature review then provides the road map of how you came to your very specific question, and it puts your study in the context of studies of sports injuries. What you eventually find can “speak to” all the related questions as well as your particular one.

In practice, the process is often a bit messier. Many researchers, and not simply those starting out, begin with a particular question and have a clear idea of who they want to study and where they want to conduct their study but don’t really know much about other studies at all. Although backward, we need to recognize this is pretty common. Telling students to “find literature” after the fact can seem like a purposeless task or just another hurdle for completing a thesis or dissertation. It is not! Even if you were not motivated by the literature in the first place, acknowledging similar studies and connecting your own research to those studies are important parts of building knowledge. Acknowledgment of past research is a responsibility you owe the discipline to which you belong.

Literature reviews can also signal theoretical approaches and particular concepts that you will incorporate into your own study. For example, let us say you are doing a study of how people find their first jobs after college, and you want to use the concept of social capital . There are competing definitions of social capital out there (e.g., Bourdieu vs. Burt vs. Putnam). Bourdieu’s notion is of one form of capital, or durable asset, of a “network of more or less institutionalized relationships of mutual acquaintance or recognition” ( 1984:248 ). Burt emphasizes the “brokerage opportunities” in a social network as social capital ( 1997:355 ). Putnam’s social capital is all about “facilitating coordination and cooperation for mutual benefit” ( 2001:67 ). Your literature review can adjudicate among these three approaches, or it can simply refer to the one that is animating your own research. If you include Bourdieu in your literature review, readers will know “what kind” of social capital you are talking about as well as what kind of social scientist you yourself are. They will likely understand that you are interested more in how some people are advantaged by their social capital relative to others rather than being interested in the mechanics of how social networks operate.

The literature review thus does two important things for you: firstly, it allows you to acknowledge previous research in your area of interest, thereby situating you within a discipline or body of scholars, and, secondly, it demonstrates that you know what you are talking about. If you present the findings of your research study without including a literature review, it can be like singing into the wind. It sounds nice, but no one really hears it, or if they do catch snippets, they don’t know where it is coming from.

Examples of Literature Reviews

To help you get a grasp of what a good literature review looks like and how it can advance your study, let’s take a look at a few examples.

Reader-Friendly Example: The Power of Peers

The first is by Janice McCabe ( 2016 ) and is from an article on peer networks in the journal Contexts . Contexts presents articles in a relatively reader-friendly format, with the goal of reaching a large audience for interesting sociological research. Read this example carefully and note how easily McCabe is able to convey the relevance of her own work by situating it in the context of previous studies:

Scholars who study education have long acknowledged the importance of peers for students’ well-being and academic achievement. For example, in 1961, James Coleman argued that peer culture within high schools shapes students’ social and academic aspirations and successes. More recently, Judith Rich Harris has drawn on research in a range of areas—from sociological studies of preschool children to primatologists’ studies of chimpanzees and criminologists’ studies of neighborhoods—to argue that peers matter much more than parents in how children “turn out.” Researchers have explored students’ social lives in rich detail, as in Murray Milner’s book about high school students, Freaks, Geeks, and Cool Kids , and Elizabeth Armstrong and Laura Hamilton’s look at college students, Paying for the Party . These works consistently show that peers play a very important role in most students’ lives. They tend, however, to prioritize social over academic influence and to use a fuzzy conception of peers rather than focusing directly on friends—the relationships that should matter most for student success. Social scientists have also studied the power of peers through network analysis, which is based on uncovering the web of connections between people. Network analysis involves visually mapping networks and mathematically comparing their structures (such as the density of ties) and the positions of individuals within them (such as how central a given person is within the network). As Nicholas Christakis and James Fowler point out in their book Connected , network structure influences a range of outcomes, including health, happiness, wealth, weight, and emotions. Given that sociologists have long considered network explanations for social phenomena, it’s surprising that we know little about how college students’ friends impact their experiences. In line with this network tradition, I focus on the structure of friendship networks, constructing network maps so that the differences we see across participants are due to the underlying structure, including each participant’s centrality in their friendship group and the density of ties among their friends. ( 23 )

What did you notice? In her very second sentence, McCabe uses “for example” to introduce a study by Coleman, thereby indicating that she is not going to tell you every single study in this area but is going to tell you that (1) there is a lot of research in this area, (2) it has been going on since at least 1961, and (3) it is still relevant (i.e., recent studies are still being done now). She ends her first paragraph by summarizing the body of literature in this area (after giving you a few examples) and then telling you what may have been (so far) left out of this research. In the second paragraph, she shifts to a separate interesting focus that is related to the first but is also quite distinct. Lit reviews very often include two (or three) distinct strands of literature, the combination of which nicely backgrounds this particular study . In the case of our female gymnast study (above), those two strands might be (1) cultures of silence around sports injuries and (2) the importance of coaches. McCabe concludes her short and sweet literature review with one sentence explaining how she is drawing from both strands of the literature she has succinctly presented for her particular study. This example should show you that literature reviews can be readable, helpful, and powerful additions to your final presentation.

Authoritative Academic Journal Example: Working Class Students’ College Expectations

The second example is more typical of academic journal writing. It is an article published in the British Journal of Sociology of Education by Wolfgang Lehmann ( 2009 ):

Although this increase in post-secondary enrolment and the push for university is evident across gender, race, ethnicity, and social class categories, access to university in Canada continues to be significantly constrained for those from lower socio-economic backgrounds (Finnie, Lascelles, and Sweetman 2005). Rising tuition fees coupled with an overestimation of the cost and an underestimation of the benefits of higher education has put university out of reach for many young people from low-income families (Usher 2005). Financial constraints aside, empirical studies in Canada have shown that the most important predictor of university access is parental educational attainment. Having at least one parent with a university degree significantly increases the likelihood of a young person to attend academic-track courses in high school, have high educational and career aspirations, and ultimately attend university (Andres et al. 1999, 2000; Lehmann 2007a). Drawing on Bourdieu’s various writing on habitus and class-based dispositions (see, for example, Bourdieu 1977, 1990), Hodkinson and Sparkes (1997) explain career decisions as neither determined nor completely rational. Instead, they are based on personal experiences (e.g., through employment or other exposure to occupations) and advice from others. Furthermore, they argue that we have to understand these decisions as pragmatic, rather than rational. They are pragmatic in that they are based on incomplete and filtered information, because of the social context in which the information is obtained and processed. New experiences and information can, however, also be allowed into one’s world, where they gradually or radically transform habitus, which in turn creates the possibility for the formation of new and different dispositions. Encountering a supportive teacher in elementary or secondary school, having ambitious friends, or chance encounters can spark such transformations. Transformations can be confirming or contradictory, they can be evolutionary or dislocating. Working-class students who enter university most certainly encounter such potentially transformative situations. Granfield (1991) has shown how initially dislocating feelings of inadequacy and inferiority of working-class students at an elite US law school were eventually replaced by an evolutionary transformation, in which the students came to dress, speak and act more like their middle-class and upper-class peers. In contrast, Lehmann (2007b) showed how persistent habitus dislocation led working-class university students to drop out of university. Foskett and Hemsley-Brown (1999) argue that young people’s perceptions of careers are a complex mix of their own experiences, images conveyed through adults, and derived images conveyed by the media. Media images of careers, perhaps, are even more important for working-class youth with high ambitions as they offer (generally distorted) windows into a world of professional employment to which they have few other sources of access. It has also been argued that working-class youth who do continue to university still face unique, class-specific challenges, evident in higher levels of uncertainty (Baxter and Britton 2001; Lehmann 2004, 2007a; Quinn 2004), their higher education choices (Ball et al. 2002; Brooks 2003; Reay et al. 2001) and fears of inadequacy because of their cultural outsider status (Aries and Seider 2005; Granfield 1991). Although the number of working-class university students in Canada has slowly increased, that of middle-class students at university has risen far more steeply (Knighton and Mizra 2002). These different enrolment trajectories have actually widened the participation gap, which in tum explains our continued concerns with the potential outsider status Indeed, in a study comparing first-generation working-class and traditional students who left university without graduating, Lehmann (2007b) found that first-generation working-class students were more likely to leave university very early in some cases within the first two months of enrollment. They were also more likely to leave university despite solid academic performance. Not “fitting in,” not “feeling university,” and not being able to “relate to these people” were key reasons for eventually withdrawing from university. From the preceding review of the literature, a number of key research questions arise: How do working-class university students frame their decision to attend university? How do they defy the considerable odds documented in the literature to attend university? What are the sources of information and various images that create dispositions to study at university? What role does their social-class background- or habitus play in their transition dispositions and how does this translate into expectations for university? ( 139 )

What did you notice here? How is this different from (and similar to) the first example? Note that rather than provide you with one or two illustrative examples of similar types of research, Lehmann provides abundant source citations throughout. He includes theory and concepts too. Like McCabe, Lehmann is weaving through multiple literature strands: the class gap in higher education participation in Canada, class-based dispositions, and obstacles facing working-class college students. Note how he concludes the literature review by placing his research questions in context.

Find other articles of interest and read their literature reviews carefully. I’ve included two more for you at the end of this chapter . As you learned how to diagram a sentence in elementary school (hopefully!), try diagramming the literature reviews. What are the “different strands” of research being discussed? How does the author connect these strands to their own research questions? Where is theory in the lit review, and how is it incorporated (e.g., Is it a separate strand of its own or is it inextricably linked with previous research in this area)?

One model of how to structure your literature review can be found in table 9.1. More tips, hints, and practices will be discussed later in the chapter.

Table 9.1. Model of Literature Review, Adopted from Calarco (2020:166)

Embracing Theory

A good research study will, in some form or another, use theory. Depending on your particular study (and possibly the preferences of the members of your committee), theory may be built into your literature review. Or it may form its own section in your research proposal/design (e.g., “literature review” followed by “theoretical framework”). In my own experience, I see a lot of graduate students grappling with the requirement to “include theory” in their research proposals. Things get a little squiggly here because there are different ways of incorporating theory into a study (Are you testing a theory? Are you generating a theory?), and based on these differences, your literature review proper may include works that describe, explain, and otherwise set forth theories, concepts, or frameworks you are interested in, or it may not do this at all. Sometimes a literature review sets forth what we know about a particular group or culture totally independent of what kinds of theoretical framework or particular concepts you want to explore. Indeed, the big point of your study might be to bring together a body of work with a theory that has never been applied to it previously. All this is to say that there is no one correct way to approach the use of theory and the writing about theory in your research proposal.

Students are often scared of embracing theory because they do not exactly understand what it is. Sometimes, it seems like an arbitrary requirement. You’re interested in a topic; maybe you’ve even done some research in the area and you have findings you want to report. And then a committee member reads over what you have and asks, “So what?” This question is a good clue that you are missing theory, the part that connects what you have done to what other researchers have done and are doing. You might stumble upon this rather accidentally and not know you are embracing theory, as in a case where you seek to replicate a prior study under new circumstances and end up finding that a particular correlation between behaviors only happens when mediated by something else. There’s theory in there, if you can pull it out and articulate it. Or it might be that you are motivated to do more research on racial microaggressions because you want to document their frequency in a particular setting, taking for granted the kind of critical race theoretical framework that has done the hard work of defining and conceptualizing “microaggressions” in the first place. In that case, your literature review could be a review of Critical Race Theory, specifically related to this one important concept. That’s the way to bring your study into a broader conversation while also acknowledging (and honoring) the hard work that has preceded you.

Rubin ( 2021 ) classifies ways of incorporating theory into case study research into four categories, each of which might be discussed somewhat differently in a literature review or theoretical framework section. The first, the least theoretical, is where you set out to study a “configurative idiographic case” ( 70 ) This is where you set out to describe a particular case, leaving yourself pretty much open to whatever you find. You are not expecting anything based on previous literature. This is actually pretty weak as far as research design goes, but it is probably the default for novice researchers. Your committee members should probably help you situate this in previous literature in some way or another. If they cannot, and it really does appear you are looking at something fairly new that no one else has bothered to research before, and you really are completely open to discovery, you might try using a Grounded Theory approach, which is a methodological approach that foregrounds the generation of theory. In that case, your “theory” section can be a discussion of “Grounded Theory” methodology (confusing, yes, but if you take some time to ponder, you will see how this works). You will still need a literature review, though. Ideally one that describes other studies that have ever looked at anything remotely like what you are looking at—parallel cases that have been researched.

The second approach is the “disciplined configurative case,” in which theory is applied to explain a particular case or topic. You are not trying to test the theory but rather assuming the theory is correct, as in the case of exploring microaggressions in a particular setting. In this case, you really do need to have a separate theory section in addition to the literature review, one in which you clearly define the theoretical framework, including any of its important concepts. You can use this section to discuss how other researchers have used the concepts and note any discrepancies in definitions or operationalization of those concepts. This way you will be sure to design your study so that it speaks to and with other researchers. If everyone who is writing about microaggressions has a different definition of them, it is hard for others to compare findings or make any judgments about their prevalence (or any number of other important characteristics). Your literature review section may then stand alone and describe previous research in the particular area or setting, irrespective of the kinds of theory underlying those studies.

The third approach is “heuristic,” one in which you seek to identify new variables, hypotheses, mechanisms, or paths not yet explained by a theory or theoretical framework. In a way, you are generating new theory, but it is probably more accurate to say that you are extending or deepening preexisting theory. In this case, having a single literature review that is focused on the theory and the ways the theory has been applied and understood (with all its various mechanisms and pathways) is probably your best option. The focus of the literature reviewed is less on the case and more on the theory you are seeking to extend.

The final approach is “theory testing,” which is much rarer in qualitative studies than in quantitative, where this is the default approach. Theory-testing cases are those where a particular case is used to see if an existing theory is accurate or accurate under particular circumstances. As with the heuristic approach, your literature review will probably draw heavily on previous uses of the theory, but you may end up having a special section specifically about cases very close to your own . In other words, the more your study approaches theory testing, the more likely there is to be a set of similar studies to draw on or even one important key study that you are setting your own study up in parallel to in order to find out if the theory generated there operates here.

If we wanted to get very technical, it might be useful to distinguish theoretical frameworks properly from conceptual frameworks. The latter are a bit looser and, given the nature of qualitative research, often fit exploratory studies. Theoretical frameworks rely on specific theories and are essential for theory-testing studies. Conceptual frameworks can pull in specific concepts or ideas that may or may not be linked to particular theories. Think about it this way: A theory is a story of how the world works. Concepts don’t presume to explain the whole world but instead are ways to approach phenomena to help make sense of them. Microaggressions are concepts that are linked to Critical Race Theory. One could contextualize one’s study within Critical Race Theory and then draw various concepts, such as that of microaggressions from the overall theoretical framework. Or one could bracket out the master theory or framework and employ the concept of microaggression more opportunistically as a phenomenon of interest. If you are unsure of what theory you are using, you might want to frame a more practical conceptual framework in your review of the literature.

Helpful Tips

How to maintain good notes for what your read.

Over the years, I have developed various ways of organizing notes on what I read. At first, I used a single sheet of full-size paper with a preprinted list of questions and points clearly addressed on the front side, leaving the second side for more reflective comments and free-form musings about what I read, why it mattered, and how it might be useful for my research. Later, I developed a system in which I use a single 4″ × 6″ note card for each book I read. I try only to use the front side (and write very small), leaving the back for comments that are about not just this reading but things to do or examine or consider based on the reading. These notes often mean nothing to anyone else picking up the card, but they make sense to me. I encourage you to find an organizing system that works for you. Then when you set out to compose a literature review, instead of staring at five to ten books or a dozen articles, you will have ten neatly printed pages or notecards or files that have distilled what is important to know about your reading.

It is also a good idea to store this data digitally, perhaps through a reference manager. I use RefWorks, but I also recommend EndNote or any other system that allows you to search institutional databases. Your campus library will probably provide access to one of these or another system. Most systems will allow you to export references from another manager if and when you decide to move to another system. Reference managers allow you to sort through all your literature by descriptor, author, year, and so on. Even so, I personally like to have the ability to manually sort through my index cards, recategorizing things I have read as I go. I use RefWorks to keep a record of what I have read, with proper citations, so I can create bibliographies more easily, and I do add in a few “notes” there, but the bulk of my notes are kept in longhand.

What kinds of information should you include from your reading? Here are some bulleted suggestions from Calarco ( 2020:113–114 ), with my own emendations:

• Citation . If you are using a reference manager, you can import the citation and then, when you are ready to create a bibliography, you can use a provided menu of citation styles, which saves a lot of time. If you’ve originally formatted in Chicago Style but the journal you are writing for wants APA style, you can change your entire bibliography in less than a minute. When using a notecard for a book, I include author, title, date as well as the library call number (since most of what I read I pull from the library). This is something RefWorks is not able to do, and it helps when I categorize.

I begin each notecard with an “intro” section, where I record the aims, goals, and general point of the book/article as explained in the introductory sections (which might be the preface, the acknowledgments, or the first two chapters). I then draw a bold line underneath this part of the notecard. Everything after that should be chapter specific. Included in this intro section are things such as the following, recommended by Calarco ( 2020 ):

• Key background . “Two to three short bullet points identifying the theory/prior research on which the authors are building and defining key terms.”
• Data/methods . “One or two short bullet points with information about the source of the data and the method of analysis, with a note if this is a novel or particularly effective example of that method.” I use [M] to signal methodology on my notecard, which might read, “[M] Int[erview]s (n-35), B[lack]/W[hite] voters” (I need shorthand to fit on my notecard!).
• Research question . “Stated as briefly as possible.” I always provide page numbers so I can go back and see exactly how this was stated (sometimes, in qualitative research, there are multiple research questions, and they cannot be stated simply).
• Argument/contributions . “Two to three short bullet points briefly describing the authors’ answer to the central research question and its implication for research, theory, and practice.” I use [ARG] for argument to signify the argument, and I make sure this is prominently visible on my notecard. I also provide page numbers here.

For me, all of this fits in the “intro” section, which, if this is a theoretically rich, methodologically sound book, might take up a third or even half of the front page of my notecard. Beneath the bold underline, I report specific findings or particulars of the book as they emerge chapter by chapter. Calarco’s ( 2020 ) next step is the following:

• Key findings . “Three to four short bullet points identifying key patterns in the data that support the authors’ argument.”

All that remains is writing down thoughts that occur upon finishing the article/book. I use the back of the notecard for these kinds of notes. Often, they reach out to other things I have read (e.g., “Robinson reminds me of Crusoe here in that both are looking at the effects of social isolation, but I think Robinson makes a stronger argument”). Calarco ( 2020 ) concludes similarly with the following:

• Unanswered questions . “Two to three short bullet points that identify key limitations of the research and/or questions the research did not answer that could be answered in future research.”

As I mentioned, when I first began taking notes like this, I preprinted pages with prompts for “research question,” “argument,” and so on. This was a great way to remind myself to look for these things in particular. You can do the same, adding whatever preprinted sections make sense to you, given what you are studying and the important aspects of your discipline. The other nice thing about the preprinted forms is that it keeps your writing to a minimum—you cannot write more than the allotted space, even if you might want to, preventing your notes from spiraling out of control. This can be helpful when we are new to a subject and everything seems worth recording!

After years of discipline, I have finally settled on my notecard approach. I have thousands of notecards, organized in several index card filing boxes stacked in my office. On the top right of each card is a note of the month/day I finished reading the item. I can remind myself what I read in the summer of 2010 if the need or desire ever arose to do so…those invaluable notecards are like a memento of what my brain has been up to!

Where to Start Looking for Literature

Your university library should provide access to one of several searchable databases for academic books and articles. My own preference is JSTOR, a service of ITHAKA, a not-for-profit organization that works to advance and preserve knowledge and to improve teaching and learning through the use of digital technologies. JSTOR allows you to search by several keywords and to narrow your search by type of material (articles or books). For many disciplines, the “literature” of the literature review is expected to be peer-reviewed “articles,” but some disciplines will also value books and book chapters. JSTOR is particularly useful for article searching. You can submit several keywords and see what is returned, and you can also narrow your search by a particular journal or discipline. If your discipline has one or two key journals (e.g., the American Journal of Sociology and the American Sociological Review are key for sociology), you might want to go directly to those journals’ websites and search for your topic area. There is an art to when to cast your net widely and when to refine your search, and you may have to tack back and forth to ensure that you are getting all that is relevant but not getting bogged down in all studies that might have some marginal relevance.

Some articles will carry more weight than others, and you can use applications like Google Scholar to see which articles have made and are continuing to make larger impacts on your discipline. Find these articles and read them carefully; use their literature review and the sources cited in those articles to make sure you are capturing what is relevant. This is actually a really good way of finding relevant books—only the most impactful will make it into the citations of journals. Over time, you will notice that a handful of articles (or books) are cited so often that when you see, say, Armstrong and Hamilton ( 2015 ), you know exactly what book this is without looking at the full cite. This is when you know you are in the conversation.

You might also approach a professor whose work is broadly in the area of your interest and ask them to recommend one or two “important” foundational articles or books. You can then use the references cited in those recommendations to build up your literature. Just be careful: some older professors’ knowledge of the literature (and I reluctantly add myself here) may be a bit outdated! It is best that the article or book whose references and sources you use to build your body of literature be relatively current.

Keep a List of Your Keywords

When using searchable databases, it is a good idea to keep a list of all the keywords you use as you go along so that (1) you do not needlessly duplicate your efforts and (2) you can more easily adjust your search as you get a better sense of what you are looking for. I suggest you keep a separate file or even a small notebook for this and you date your search efforts.

Here’s an example:

Table 9.2. Keep a List of Your Keywords

Think Laterally

How to find the various strands of literature to combine? Don’t get stuck on finding the exact same research topic you think you are interested in. In the female gymnast example, I recommended that my student consider looking for studies of ballerinas, who also suffer sports injuries and around whom there is a similar culture of silence. It turned out that there was in fact research about my student’s particular questions, just not about the subjects she was interested in. You might do something similar. Don’t get stuck looking for too direct literature but think about the broader phenomenon of interest or analogous cases.

Read Outside the Canon

Some scholars’ work gets cited by everyone all the time. To some extent, this is a very good thing, as it helps establish the discipline. For example, there are a lot of “Bourdieu scholars” out there (myself included) who draw ideas, concepts, and quoted passages from Bourdieu. This makes us recognizable to one another and is a way of sharing a common language (e.g., where “cultural capital” has a particular meaning to those versed in Bourdieusian theory). There are empirical studies that get cited over and over again because they are excellent studies but also because there is an “echo chamber effect” going on, where knowing to cite this study marks you as part of the club, in the know, and so on. But here’s the problem with this: there are hundreds if not thousands of excellent studies out there that fail to get appreciated because they are crowded out by the canon. Sometimes this happens because they are published in “lower-ranked” journals and are never read by a lot of scholars who don’t have time to read anything other than the “big three” in their field. Other times this happens because the author falls outside of the dominant social networks in the field and thus is unmentored and fails to get noticed by those who publish a lot in those highly ranked and visible spaces. Scholars who fall outside the dominant social networks and who publish outside of the top-ranked journals are in no way less insightful than their peers, and their studies may be just as rigorous and relevant to your work, so it is important for you to take some time to read outside the canon. Due to how a person’s race, gender, and class operate in the academy, there is also a matter of social justice and ethical responsibility involved here: “When you focus on the most-cited research, you’re more likely to miss relevant research by women and especially women of color, whose research tends to be under-cited in most fields. You’re also more likely to miss new research, research by junior scholars, and research in other disciplines that could inform your work. Essentially, it is important to read and cite responsibly, which means checking that you’re not just reading and citing the same white men and the same old studies that everyone has cited before you” ( Calarco 2020:112 ).

Consider Multiple Uses for Literature

Throughout this chapter, I’ve referred to the literature of interest in a rather abstract way, as what is relevant to your study. But there are many different ways previous research can be relevant to your study. The most basic use of the literature is the “findings”—for example, “So-and-so found that Canadian working-class students were concerned about ‘fitting in’ to the culture of college, and I am going to look at a similar question here in the US.” But the literature may be of interest not for its findings but theoretically—for example, employing concepts that you want to employ in your own study. Bourdieu’s definition of social capital may have emerged in a study of French professors, but it can still be relevant in a study of, say, how parents make choices about what preschools to send their kids to (also a good example of lateral thinking!).

If you are engaged in some novel methodological form of data collection or analysis, you might look for previous literature that has attempted that. I would not recommend this for undergraduate research projects, but for graduate students who are considering “breaking the mold,” find out if anyone has been there before you. Even if their study has absolutely nothing else in common with yours, it is important to acknowledge that previous work.

Describing Gaps in the Literature

First, be careful! Although it is common to explain how your research adds to, builds upon, and fills in gaps in the previous research (see all four literature review examples in this chapter for this), there is a fine line between describing the gaps and misrepresenting previous literature by failing to conduct a thorough review of the literature. A little humility can make a big difference in your presentation. Instead of “This is the first study that has looked at how firefighters juggle childcare during forest fire season,” say, “I use the previous literature on how working parents juggling childcare and the previous ethnographic studies of firefighters to explore how firefighters juggle childcare during forest fire season.” You can even add, “To my knowledge, no one has conducted an ethnographic study in this specific area, although what we have learned from X about childcare and from Y about firefighters would lead us to expect Z here.” Read more literature review sections to see how others have described the “gaps” they are filling.

Use Concept Mapping

Concept mapping is a helpful tool for getting your thoughts in order and is particularly helpful when thinking about the “literature” foundational to your particular study. Concept maps are also known as mind maps, which is a delightful way to think about them. Your brain is probably abuzz with competing ideas in the early stages of your research design. Write/draw them on paper, and then try to categorize and move the pieces around into “clusters” that make sense to you. Going back to the gymnasts example, my student might have begun by jotting down random words of interest: gymnasts * sports * coaches * female gymnasts * stress * injury * don’t complain * women in sports * bad coaching * anxiety/stress * careers in sports * pain. She could then have begun clustering these into relational categories (bad coaching, don’t complain culture) and simple “event” categories (injury, stress). This might have led her to think about reviewing literature in these two separate aspects and then literature that put them together. There is no correct way to draw a concept map, as they are wonderfully specific to your mind. There are many examples you can find online.

Ask Yourself, “How Is This Sociology (or Political Science or Public Policy, Etc.)?”

Rubin ( 2021:82 ) offers this suggestion instead of asking yourself the “So what?” question to get you thinking about what bridges there are between your study and the body of research in your particular discipline. This is particularly helpful for thinking about theory. Rubin further suggests that if you are really stumped, ask yourself, “What is the really big question that all [fill in your discipline here] care about?” For sociology, it might be “inequality,” which would then help you think about theories of inequality that might be helpful in framing your study on whatever it is you are studying—OnlyFans? Childcare during COVID? Aging in America? I can think of some interesting ways to frame questions about inequality for any of those topics. You can further narrow it by focusing on particular aspects of inequality (Gender oppression? Racial exclusion? Heteronormativity?). If your discipline is public policy, the big questions there might be, How does policy get enacted, and what makes a policy effective? You can then take whatever your particular policy interest is—tax reform, student debt relief, cap-and-trade regulations—and apply those big questions. Doing so would give you a handle on what is otherwise an intolerably vague subject (e.g., What about student debt relief?).

Sometimes finding you are in new territory means you’ve hit the jackpot, and sometimes it means you’ve traveled out of bounds for your discipline. The jackpot scenario is wonderful. You are doing truly innovative research that is combining multiple literatures or is addressing a new or under-examined phenomenon of interest, and your research has the potential to be groundbreaking. Congrats! But that’s really hard to do, and it might be more likely that you’ve traveled out of bounds, by which I mean, you are no longer in your discipline . It might be that no one has written about this thing—at least within your field— because no one in your field actually cares about this topic . ( Rubin 2021:83 ; emphases added)

Don’t Treat This as a Chore

Don’t treat the literature review as a chore that has to be completed, but see it for what it really is—you are building connections to other researchers out there. You want to represent your discipline or area of study fairly and adequately. Demonstrate humility and your knowledge of previous research. Be part of the conversation.

Supplement: Two More Literature Review Examples

Elites by harvey ( 2011 ).

In the last two decades, there has been a small but growing literature on elites. In part, this has been a result of the resurgence of ethnographic research such as interviews, focus groups, case studies, and participant observation but also because scholars have become increasingly interested in understanding the perspectives and behaviors of leaders in business, politics, and society as a whole. Yet until recently, our understanding of some of the methodological challenges of researching elites has lagged behind our rush to interview them.

There is no clear-cut definition of the term elite, and given its broad understanding across the social sciences, scholars have tended to adopt different approaches. Zuckerman (1972) uses the term ultraelites to describe individuals who hold a significant amount of power within a group that is already considered elite. She argues, for example, that US senators constitute part of the country’s political elite but that among them are the ultraelites: a “subset of particularly powerful or prestigious influentials” (160). She suggests that there is a hierarchy of status within elite groups. McDowell (1998) analyses a broader group of “professional elites” who are employees working at different levels for merchant and investment banks in London. She classifies this group as elite because they are “highly skilled, professionally competent, and class-specific” (2135). Parry (1998:2148) uses the term hybrid elites in the context of the international trade of genetic material because she argues that critical knowledge exists not in traditional institutions “but rather as increasingly informal, hybridised, spatially fragmented, and hence largely ‘invisible,’ networks of elite actors.” Given the undertheorization of the term elite, Smith (2006) recognizes why scholars have shaped their definitions to match their respondents . However, she is rightly critical of the underlying assumption that those who hold professional positions necessarily exert as much influence as initially perceived. Indeed, job titles can entirely misrepresent the role of workers and therefore are by no means an indicator of elite status (Harvey 2010).

Many scholars have used the term elite in a relational sense, defining them either in terms of their social position compared to the researcher or compared to the average person in society (Stephens 2007). The problem with this definition is there is no guarantee that an elite subject will necessarily translate this power and authority in an interview setting. Indeed, Smith (2006) found that on the few occasions she experienced respondents wanting to exert their authority over her, it was not from elites but from relatively less senior workers. Furthermore, although business and political elites often receive extensive media training, they are often scrutinized by television and radio journalists and therefore can also feel threatened in an interview, particularly in contexts that are less straightforward to prepare for such as academic interviews. On several occasions, for instance, I have been asked by elite respondents or their personal assistants what they need to prepare for before the interview, which suggests that they consider the interview as some form of challenge or justification for what they do.

In many cases, it is not necessarily the figureheads or leaders of organizations and institutions who have the greatest claim to elite status but those who hold important social networks, social capital, and strategic positions within social structures because they are better able to exert influence (Burt 1992; Parry 1998; Smith 2005; Woods 1998). An elite status can also change, with people both gaining and losing theirs over time. In addition, it is geographically specific, with people holding elite status in some but not all locations. In short, it is clear that the term elite can mean many things in different contexts, which explains the range of definitions. The purpose here is not to critique these other definitions but rather to highlight the variety of perspectives.

When referring to my research, I define elites as those who occupy senior-management- and board-level positions within organizations. This is a similar scope of definition to Zuckerman’s (1972) but focuses on a level immediately below her ultraelite subjects. My definition is narrower than McDowell’s (1998) because it is clear in the context of my research that these people have significant decision-making influence within and outside of the firm and therefore present a unique challenge to interview. I deliberately use the term elite more broadly when drawing on examples from the theoretical literature in order to compare my experiences with those who have researched similar groups.

”Changing Dispositions among the Upwardly Mobile” by Curl, Lareau, and Wu ( 2018 )

There is growing interest in the role of cultural practices in undergirding the social stratification system. For example, Lamont et al. (2014) critically assess the preoccupation with economic dimensions of social stratification and call for more developed cultural models of the transmission of inequality. The importance of cultural factors in the maintenance of social inequality has also received empirical attention from some younger scholars, including Calarco (2011, 2014) and Streib (2015). Yet questions remain regarding the degree to which economic position is tied to cultural sensibilities and the ways in which these cultural sensibilities are imprinted on the self or are subject to change. Although habitus is a core concept in Bourdieu’s theory of social reproduction, there is limited empirical attention to the precise areas of the habitus that can be subject to change during upward mobility as well as the ramifications of these changes for family life.

In Bourdieu’s (1984) highly influential work on the importance of class-based cultural dispositions, habitus is defined as a “durable system of dispositions” created in childhood. The habitus provides a “matrix of perceptions” that seems natural while also structuring future actions and pathways. In many of his writings, Bourdieu emphasized the durability of cultural tastes and dispositions and did not consider empirically whether these dispositions might be changed or altered throughout one’s life (Swartz 1997). His theoretical work does permit the possibility of upward mobility and transformation, however, through the ability of the habitus to “improvise” or “change” due to “new experiences” (Friedman 2016:131). Researchers have differed in opinion on the durability of the habitus and its ability to change (King 2000). Based on marital conflict in cross-class marriages, for instance, Streib (2015) argues that cultural dispositions of individuals raised in working-class families are deeply embedded and largely unchanging. In a somewhat different vein, Horvat and Davis (2011:152) argue that young adults enrolled in an alternative educational program undergo important shifts in their self-perception, such as “self-esteem” and their “ability to accomplish something of value.” Others argue there is variability in the degree to which habitus changes dependent on life experience and personality (Christodoulou and Spyridakis 2016). Recently, additional studies have investigated the habitus as it intersects with lifestyle through the lens of meaning making (Ambrasat et al. 2016). There is, therefore, ample discussion of class-based cultural practices in self-perception (Horvat and Davis 2011), lifestyle (Ambrasat et al. 2016), and other forms of taste (Andrews 2012; Bourdieu 1984), yet researchers have not sufficiently delineated which aspects of the habitus might change through upward mobility or which specific dimensions of life prompt moments of class-based conflict.

Bourdieu (1999:511; 2004) acknowledged simmering tensions between the durable aspects of habitus and those aspects that have been transformed—that is, a “fractured” or “cleft” habitus. Others have explored these tensions as a “divided” or “fragmented” habitus (Baxter and Britton 2001; Lee and Kramer 2013). Each of these conceptions of the habitus implies that changes in cultural dispositions are possible but come with costs. Exploration of the specific aspects of one’s habitus that can change and generate conflict contributes to this literature.

Scholars have also studied the costs associated with academic success for working-class undergraduates (Hurst 2010; Lee and Kramer 2013; London 1989; Reay 2017; Rondini 2016; Stuber 2011), but we know little about the lasting effects on adults. For instance, Lee and Kramer (2013) point to cross-class tensions as family and friends criticize upwardly mobile individuals for their newly acquired cultural dispositions. Documenting the tension many working-class students experience with their friends and families of origin, they find that the source of their pain or struggle is “shaped not only by their interactions with non-mobile family and friends but also within their own minds, by their own assessments of their social positions, and by how those positions are interpreted by others” (Lee and Kramer 2013:29). Hurst (2010) also explores the experiences of undergraduates who have been academically successful and the costs associated with that success. She finds that decisions about “class allegiance and identity” are required aspects of what it means to “becom[e] educated” (4) and that working-class students deal with these cultural changes differently. Jack (2014, 2016) also argues that there is diversity among lower-income students, which yields varied college experiences. Naming two groups, the “doubly disadvantaged” and the “privileged poor,” he argues that previous experience with “elite environments” (2014:456) prior to college informs students’ ability to take on dominant cultural practices, particularly around engagement, such as help seeking or meeting with professors (2016). These studies shed light on the role college might play as a “lever for mobility” (2016:15) and discuss the pain and difficulty associated with upward mobility among undergraduates, but the studies do not illuminate how these tensions unfold in adulthood. Neither have they sufficiently addressed potential enduring tensions with extended family members as well as the specific nature of the difficulties.

Some scholars point to the positive outcomes upwardly mobile youth (Lehmann 2009) and adults (Stuber 2005) experience when they maintain a different habitus than their newly acquired class position, although, as Jack (2014, 2016) shows, those experiences may vary depending on one’s experience with elite environments in their youth. Researchers have not sufficiently explored the specific aspects of the habitus that upwardly mobile adults change or the conflicts that emerge with family and childhood friends as they reach adulthood and experience colliding social worlds. We contribute to this scholarship with clear examples of self-reported changes to one’s cultural dispositions in three specific areas: “horizons,” food and health, and communication. We link these changes to enduring tension with family members, friends, and colleagues and explore varied responses to this tension based on race.

Further Readings

Bloomberg, Linda Dale, and Marie F. Volpe. 2012. Completing Your Qualitative Dissertation: A Road Map from Beginning to End . 2nd ed. Thousand Oaks, CA: SAGE. In keeping with its general approach to qualitative research, includes a “road map” for conducting a literature review.

Hart, Chris. 1998. Doing a Literature Review: Releasing the Social Science Research Imagination . London: SAGE. A how-to book dedicated entirely to conducting a literature review from a British perspective. Useful for both undergraduate and graduate students.

Machi, Lawrence A., and Brenda T. McEvoy. 2022. The Literature Review: Six Steps to Success . 4th ed. Newbury Park, CA: Corwin. A well-organized guidebook complete with reflection sections to prompt successful thinking about your literature review.

Ridley, Diana. 2008. The Literature Review: A Step-by-Step Guide for Students . London: SAGE. A highly recommended companion to conducting a literature review for doctoral-level students.

The process of systematically searching through pre-existing studies (“literature”) on the subject of research; also, the section of a presentation in which the pre-existing literature is discussed.

Follow-up questions used in a semi-structured interview  to elicit further elaboration.  Suggested prompts can be included in the interview guide  to be used/deployed depending on how the initial question was answered or if the topic of the prompt does not emerge spontaneously.

A tool for identifying relationships among ideas by visually representing them on paper.  Most concept maps depict ideas as boxes or circles (also called nodes), which are structured hierarchically and connected with lines or arrows (also called arcs). These lines are labeled with linking words and phrases to help explain the connections between concepts.  Also known as mind mapping.

The people who are the subjects of an interview-based qualitative study. In general, they are also known as the participants, and for purposes of IRBs they are often referred to as the human subjects of the research.

Introduction to Qualitative Research Methods Copyright © 2023 by Allison Hurst is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License , except where otherwise noted.

How to Perform a Systematic Literature Review pp 103–111 Cite as

Reviewing Qualitative Studies and Metasynthesis

• Edward Purssell   ORCID: orcid.org/0000-0003-3748-0864 3 &
• Niall McCrae   ORCID: orcid.org/0000-0001-9776-7694 4  
• First Online: 05 August 2020

6515 Accesses

1 Citations

Qualitative and quantitative research are fundamentally different, in philosophy, principles and practice. This has major implications for literature reviewing. A review of qualitative studies may be performed with no less systematic rigour than that of experimental trials, but the product will be interpretative rather than numerical. This chapter introduces the reader to qualitative review methods, focusong on metasynthesis.

This is a preview of subscription content, log in via an institution .

Buying options

• Available as PDF
• Read on any device
• Instant download
• Own it forever
• Available as EPUB and PDF
• Compact, lightweight edition
• Dispatched in 3 to 5 business days
• Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Buber M, Smith RG (2010) I and Thou. Martino Publishing, Mansfield Centre, CT

Google Scholar  

Pugh DS, Hickson DJ (2007) Writers on organizations, 6th edn. Penguin, London

Book   Google Scholar  

Ritzer G (1990) Metatheorizing in sociology. Sociol Forum 5:3–15. https://doi.org/10.1007/BF01115134

Article   Google Scholar  

Zhao S (1991) Metatheory, metamethod, meta-data-analysis: what, why, and how? Sociol Perspect 34:377–390. https://doi.org/10.2307/1389517

Noblit GW, Hare RD (1988) Meta-ethnography: synthesizing qualitative studies. Sage Publications, Newbury Park

Glaser BG, Strauss A (1967) The discovery of grounded theory, Aldine de Gruyter, New York

Estabrooks CA, Field PA, Morse JM (1994) Aggregating qualitative findings: an approach to theory development. Qual Health Res 4:503–511. https://doi.org/10.1177/104973239400400410

Jensen LA, Allen MN (1994) A synthesis of qualitative research on wellness-illness. Qual Health Res 4:349–369. https://doi.org/10.1177/104973239400400402

Jensen LA, Allen MN (1996) Meta-synthesis of qualitative findings. Qual Health Res 6:553–560. https://doi.org/10.1177/104973239600600407

Blackburn S (2008) The Oxford dictionary of philosophy, 2nd rev. edn. Oxford University Press, Oxford

Thorne S, Jensen L, Kearney MH et al (2004) Qualitative metasynthesis: reflections on methodological orientation and ideological agenda. Qual Health Res 14:1342–1365. https://doi.org/10.1177/1049732304269888

Article   PubMed   Google Scholar  

Barnett-Page E, Thomas J (2009) Methods for the synthesis of qualitative research: a critical review. ESRC National Centre for Research Methods, London

Walsh D, Downe S (2005) Meta-synthesis method for qualitative research: a literature review. J Adv Nurs 50:204–211. https://doi.org/10.1111/j.1365-2648.2005.03380.x

Sandelowski M, Barroso J (2007) Handbook for synthesizing qualitative research. Springer Publishing Company, New York

Ludvigsen MS, Hall EOC, Meyer G et al (2016) Using Sandelowski and Barroso’s meta-synthesis method in advancing qualitative evidence. Qual Health Res 26:320–329. https://doi.org/10.1177/1049732315576493

Noyes J, Booth A, Cargo M et al (2019) Chapter 21: Qualitative evidence. In: Higgins JPT, Thomas J, Chandler J et al (eds) Cochrane handbook for systematic reviews of interventions version 6.0 (updated July 2019). Cochrane, London. https://www.training.cochrane.org/handbook

National Institute for Health and Care Excellence (2012) Methods for the development of NICE public health guidance. Process and Methods [PMG4], 3rd edn. NICE. https://www.nice.org.uk/process/pmg4/chapter/introduction . Accessed 6 Mar 2020

Carroll C, Booth A, Leaviss J, Rick J (2013) “Best fit” framework synthesis: refining the method. BMC Med Res Methodol 13:37. https://doi.org/10.1186/1471-2288-13-37

O’Neill J, Tabish H, Welch V et al (2014) Applying an equity lens to interventions: using PROGRESS ensures consideration of socially stratifying factors to illuminate inequities in health. J Clin Epidemiol 67:56–64. https://doi.org/10.1016/j.jclinepi.2013.08.005

Finfgeld-Connett D (2006) Meta-synthesis of presence in nursing. J Adv Nurs 55:708–714. https://doi.org/10.1111/j.1365-2648.2006.03961.x

Finfgeld DL (2003) Metasynthesis: the state of the art—so far. Qual Health Res 13:893–904. https://doi.org/10.1177/1049732303253462

Duggleby W, Holtslander L, Kylma J et al (2010) Metasynthesis of the hope experience of family caregivers of persons with chronic illness. Qual Health Res 20:148–158. https://doi.org/10.1177/1049732309358329

Thorne S (2017) Metasynthetic madness: what kind of monster have we created? Qual Health Res 27:3–12. https://doi.org/10.1177/1049732316679370

Thorne S (2019) On the evolving world of what constitutes qualitative synthesis. Qual Health Res 29:3–6. https://doi.org/10.1177/1049732318813903

Bergdahl E (2019) Is meta-synthesis turning rich descriptions into thin reductions? A criticism of meta-aggregation as a form of qualitative synthesis. Nurs Inq 26:e12273. https://doi.org/10.1111/nin.12273

Lockwood C, Munn Z, Porritt K (2015) Qualitative research synthesis: methodological guidance for systematic reviewers utilizing meta-aggregation. Int J Evid Based Healthc 13:179–187. https://doi.org/10.1097/XEB.0000000000000062

Sandelowski M (1993) Rigor or rigor mortis: the problem of rigor in qualitative research revisited. Adv Nurs Sci 16:1–8. https://doi.org/10.1097/00012272-199312000-00002

Article   CAS   Google Scholar  

Download references

Author information

Authors and affiliations.

School of Health Sciences, City, University of London, London, UK

Edward Purssell

Florence Nightingale Faculty of Nursing, Midwifery & Palliative Care, King’s College London, London, UK

Niall McCrae

You can also search for this author in PubMed   Google Scholar

Corresponding author

Correspondence to Edward Purssell .

Rights and permissions

Reprints and permissions

Copyright information

© 2020 The Editor(s) (if applicable) and The Author(s), under exclusive license to Springer Nature Switzerland AG

About this chapter

Cite this chapter.

Purssell, E., McCrae, N. (2020). Reviewing Qualitative Studies and Metasynthesis. In: How to Perform a Systematic Literature Review. Springer, Cham. https://doi.org/10.1007/978-3-030-49672-2_8

Download citation

DOI : https://doi.org/10.1007/978-3-030-49672-2_8

Published : 05 August 2020

Publisher Name : Springer, Cham

Print ISBN : 978-3-030-49671-5

Online ISBN : 978-3-030-49672-2

eBook Packages : Medicine Medicine (R0)

Share this chapter

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

• Publish with us

Policies and ethics

• Find a journal
• Track your research

About Systematic Reviews

Qualitative Data Analysis in Systematic Reviews

Automate every stage of your literature review to produce evidence-based research faster and more accurately.

What is a qualitative systematic review.

A qualitative systematic review aggregates integrates and interprets data from qualitative studies, which is collected through observation, interviews, and verbal interactions. Included studies may also use other qualitative methodologies of data collection in the relevant literature. The use of qualitative systematic reviews analyzes the information and focuses on the meanings derived from it.

A qualitative systematic review generally follows the same steps as indicated by most systematic review guidelines , including the application of eligibility criteria in systematic reviews , and the steps for searching and screening available literature. All of these then conclude in the final write-up, which involves tabulating the data into a summary of findings table in the systematic review , and reporting on findings and conclusions. Qualitative systematic reviews are different in that, they incorporate qualitative studies and use only qualitative methods in analyzing and synthesizing data.

Why Are Qualitative Systematic Reviews Valuable?

Apart from the rigorous, methodical, and reproducible process used, qualitative systematic reviews derive their conclusions from qualitative data, they bring a human perspective into the process of answering the focused research question. This brings valuable findings, which cannot be expressed in quantitative means, into the view of the reader. Results that are better stated that calculated, like feelings of compliance or satisfaction following treatment using a new anti-depressant.

Another example, if a systematic review that deals with pain associated with a certain drug considers qualitative data, it can come up with conclusions that consider how subjects feel when taking the medicine, e.g., the level of pain and tolerance, etc.

Types Of Qualitative Systematic Reviews

Pioneers of qualitative systematic reviews suggest that qualitative systematic reviews can be segregated into two types: aggregated and interpretive.

Aggregated Systematic Review

An aggregated systematic review simply summarizes the collected data. It generates a summary of the studies using aggregate data obtained from individual studies within the scoped literature.

Interpretive Systematic Review

An interpretive systematic review, which is the more common of the two types, analyzes the data. From the analysis, researchers can derive a new understanding that may lead to the development of a theory and can help understand or predict behavior as it relates to the topic of the review.

Learn More About DistillerSR

(Article continues below)

How to Analyze Data in a Qualitative Systematic Review

Qualitative systematic reviews deal with a lot of textual studies. This is why undertaking one requires a well-planned, systematic, and sustainable approach, as defined in your protocol. It also helps to employ literature review software like DistillerSR to take out a significant amount of manual labor, as it automates key stages in the entire methodology.

Here are four steps to take for qualitative data analysis in systematic reviews.

Collect and Review the Data

Based on your eligibility criteria, search and screen the studies relevant to your review. This involves scouring libraries and databases, gathering documents, and printing or saving transcripts. You can also check for studies in the reference lists of already eligible studies. The recommendation of similar articles by databases during searching should also be checked.

Once you’ve collected your data, get a sense of what it contains by reading the collected studies (you’ll likely need to do this several times).

This step can be easier with systematic review software, such as DistillerSR which gives you access to more sources and applies AI to identify the literature you need.

Create And Identify Codes

Connect your data by creating and identifying common ideas. Highlight keywords, and categorize information; it may even be helpful to create concept maps for easy reference.

Develop Themes

Combine your codes and revise them into themes, recognizing recurring concepts, language, opinions, beliefs, etc.

Derive Conclusions and Summarize Findings

Present the themes that you’ve collected in a cohesive manner, using them to answer your review’s research question. Finally, derive conclusions from the data, and summarize your findings in a report.

3 Reasons to Connect

A Guide to Writing a Qualitative Systematic Review Protocol to Enhance Evidence-Based Practice in Nursing and Health Care

Affiliations.

• 1 PhD candidate, School of Nursing and Midwifey, Monash University, and Clinical Nurse Specialist, Adult and Pediatric Intensive Care Unit, Monash Health, Melbourne, Victoria, Australia.
• 2 Lecturer, School of Nursing and Midwifery, Monash University, Melbourne, Victoria, Australia.
• 3 Senior Lecturer, School of Nursing and Midwifery, Monash University, Melbourne, Victoria, Australia.
• PMID: 26790142
• DOI: 10.1111/wvn.12134

Background: The qualitative systematic review is a rapidly developing area of nursing research. In order to present trustworthy, high-quality recommendations, such reviews should be based on a review protocol to minimize bias and enhance transparency and reproducibility. Although there are a number of resources available to guide researchers in developing a quantitative review protocol, very few resources exist for qualitative reviews.

Aims: To guide researchers through the process of developing a qualitative systematic review protocol, using an example review question.

Methodology: The key elements required in a systematic review protocol are discussed, with a focus on application to qualitative reviews: Development of a research question; formulation of key search terms and strategies; designing a multistage review process; critical appraisal of qualitative literature; development of data extraction techniques; and data synthesis. The paper highlights important considerations during the protocol development process, and uses a previously developed review question as a working example.

Implications for research: This paper will assist novice researchers in developing a qualitative systematic review protocol. By providing a worked example of a protocol, the paper encourages the development of review protocols, enhancing the trustworthiness and value of the completed qualitative systematic review findings.

Linking evidence to action: Qualitative systematic reviews should be based on well planned, peer reviewed protocols to enhance the trustworthiness of results and thus their usefulness in clinical practice. Protocols should outline, in detail, the processes which will be used to undertake the review, including key search terms, inclusion and exclusion criteria, and the methods used for critical appraisal, data extraction and data analysis to facilitate transparency of the review process. Additionally, journals should encourage and support the publication of review protocols, and should require reference to a protocol prior to publication of the review results.

Keywords: guidelines; meta synthesis; qualitative; systematic review protocol.

© 2016 Sigma Theta Tau International.

• Evidence-Based Practice / standards*
• Information Seeking Behavior
• Nursing / methods
• Qualitative Research*
• Research Design / standards*
• Systematic Reviews as Topic*
• Writing / standards*

Dissertations and research projects

• Book a session
• Planning your research

Developing a theoretical framework

Reflecting on your position, extended literature reviews, presenting qualitative data.

• Quantitative research
• Writing up your research project
• e-learning and books
• SkillsCheck This link opens in a new window
• ⬅ Back to Skills Centre This link opens in a new window
• Review this resource

What is a theoretical framework?

Developing a theoretical framework for your dissertation is one of the key elements of a qualitative research project. Through writing your literature review, you are likely to have identified either a problem that need ‘fixing’ or a gap that your research may begin to fill.

The theoretical framework is your toolbox . In the toolbox are your handy tools: a set of theories, concepts, ideas and hypotheses that you will use to build a solution to the research problem or gap you have identified.

The methodology is the instruction manual: the procedure and steps you have taken, using your chosen tools, to tackle the research problem.

Why do I need a theoretical framework?

Developing a theoretical framework shows that you have thought critically about the different ways to approach your topic, and that you have made a well-reasoned and evidenced decision about which approach will work best. theoretical frameworks are also necessary for solving complex problems or issues from the literature, showing that you have the skills to think creatively and improvise to answer your research questions. they also allow researchers to establish new theories and approaches, that future research may go on to develop., how do i create a theoretical framework for my dissertation.

First, select your tools. You are likely to need a variety of tools in qualitative research – different theories, models or concepts – to help you tackle different parts of your research question.  

When deciding what tools would be best for the job of answering your research questions or problem, explore what existing research in your area has used. You may find that there is a ‘standard toolbox’ for qualitative research in your field that you can borrow from or apply to your own research.

You will need to justify why your chosen tools are best for the job of answering your research questions, at what stage they are most relevant, and how they relate to each other. Some theories or models will neatly fit together and appear in the toolboxes of other researchers. However, you may wish to incorporate a model or idea that is not typical for your research area – the ‘odd one out’ in your toolbox. If this is the case, make sure you justify and account for why it is useful to you, and look for ways that it can be used in partnership with the other tools you are using.

You should also be honest about limitations, or where you need to improvise (for example, if the ‘right’ tool or approach doesn’t exist in your area).

This video from the Skills Centre includes an overview and example of how you might create a theoretical framework for your dissertation:

How do I choose the 'right' approach?

When designing your framework and choosing what to include, it can often be difficult to know if you’ve chosen the ‘right’ approach for your research questions. One way to check this is to look for consistency between your objectives, the literature in your framework, and your overall ethos for the research. This means ensuring that the literature you have used not only contributes to answering your research objectives, but that you also use theories and models that are true to your beliefs as a researcher.

Reflecting on your values and your overall ambition for the project can be a helpful step in making these decisions, as it can help you to fully connect your methodology and methods to your research aims.

Should I reflect on my position as a researcher?

If you feel your position as a researcher has influenced your choice of methods or procedure in any way, the methodology is a good place to reflect on this.  Positionality  acknowledges that no researcher is entirely objective: we are all, to some extent, influenced by prior learning, experiences, knowledge, and personal biases. This is particularly true in qualitative research or practice-based research, where the student is acting as a researcher in their own workplace, where they are otherwise considered a practitioner/professional. It's also important to reflect on your positionality if you belong to the same community as your participants where this is the grounds for their involvement in the research (ie. you are a mature student interviewing other mature learners about their experences in higher education). 

The following questions can help you to reflect on your positionality and gauge whether this is an important section to include in your dissertation (for some people, this section isn’t necessary or relevant):

• How might my personal history influence how I approach the topic?
• How am I positioned in relation to this knowledge? Am I being influenced by prior learning or knowledge from outside of this course?
• How does my gender/social class/ ethnicity/ culture influence my positioning in relation to this topic?
• Do I share any attributes with my participants? Are we part of a s hared community? How might this have influenced our relationship and my role in interviews/observations?
• Am I invested in the outcomes on a personal level? Who is this research for and who will feel the benefits?

One option for qualitative projects is to write an extended literature review. This type of project does not require you to collect any new data. Instead, you should focus on synthesising a broad range of literature to offer a new perspective on a research problem or question.  

The main difference between an extended literature review and a dissertation where primary data is collected, is in the presentation of the methodology, results and discussion sections. This is because extended literature reviews do not actively involve participants or primary data collection, so there is no need to outline a procedure for data collection (the methodology) or to present and interpret ‘data’ (in the form of interview transcripts, numerical data, observations etc.) You will have much more freedom to decide which sections of the dissertation should be combined, and whether new chapters or sections should be added.

Here is an overview of a common structure for an extended literature review:

Introduction

• Provide background information and context to set the ‘backdrop’ for your project.
• Explain the value and relevance of your research in this context. Outline what do you hope to contribute with your dissertation.
• Clarify a specific area of focus.
• Introduce your research aims (or problem) and objectives.

Literature review

You will need to write a short, overview literature review to introduce the main theories, concepts and key research areas that you will explore in your dissertation. This set of texts – which may be theoretical, research-based, practice-based or policies – form your theoretical framework. In other words, by bringing these texts together in the literature review, you are creating a lens that you can then apply to more focused examples or scenarios in your discussion chapters.

Methodology

As you will not be collecting primary data, your methodology will be quite different from a typical dissertation. You will need to set out the process and procedure you used to find and narrow down your literature. This is also known as a search strategy.

Including your search strategy

A search strategy explains how you have narrowed down your literature to identify key studies and areas of focus. This often takes the form of a search strategy table, included as an appendix at the end of the dissertation. If included, this section takes the place of the traditional 'methodology' section.

If you choose to include a search strategy table, you should also give an overview of your reading process in the main body of the dissertation.  Think of this as a chronology of the practical steps you took and your justification for doing so at each stage, such as:

• Your key terms, alternatives and synonyms, and any terms that you chose to exclude.
• Your choice and combination of databases;
• Your inclusion/exclusion criteria, when they were applied and why. This includes filters such as language of publication, date, and country of origin;
• You should also explain which terms you combined to form search phrases and your use of Boolean searching (AND, OR, NOT);
• Your use of citation searching (selecting articles from the bibliography of a chosen journal article to further your search).
• Your use of any search models, such as PICO and SPIDER to help shape your approach.
• Search strategy template A simple template for recording your literature searching. This can be included as an appendix to show your search strategy.

The discussion section of an extended literature review is the most flexible in terms of structure. Think of this section as a series of short case studies or ‘windows’ on your research. In this section you will apply the theoretical framework you formed in the literature review – a combination of theories, models and ideas that explain your approach to the topic – to a series of different examples and scenarios. These are usually presented as separate discussion ‘chapters’ in the dissertation, in an order that you feel best fits your argument.

Think about an order for these discussion sections or chapters that helps to tell the story of your research. One common approach is to structure these sections by common themes or concepts that help to draw your sources together. You might also opt for a chronological structure if your dissertation aims to show change or development over time. Another option is to deliberately show where there is a lack of chronology or narrative across your case studies, by ordering them in a fragmentary order! You will be able to reflect upon the structure of these chapters elsewhere in the dissertation, explaining and defending your decision in the methodology and conclusion.

A summary of your key findings – what you have concluded from your research, and how far you have been able to successfully answer your research questions.

• Recommendations – for improvements to your own study, for future research in the area, and for your field more widely.
• Emphasise your contributions to knowledge and what you have achieved.

Alternative structure

Depending on your research aims, and whether you are working with a case-study type approach (where each section of the dissertation considers a different example or concept through the lens established in your literature review), you might opt for one of the following structures:

Splitting the literature review across different chapters:

This structure allows you to pull apart the traditional literature review, introducing it little by little with each of your themed chapters. This approach works well for dissertations that attempt to show change or difference over time, as the relevant literature for that section or period can be introduced gradually to the reader.

Whichever structure you opt for, remember to explain and justify your approach. A marker will be interested in why you decided on your chosen structure, what it allows you to achieve/brings to the project and what alternatives you considered and rejected in the planning process. Here are some example sentence starters:

In qualitative studies, your results are often presented alongside the discussion, as it is difficult to include this data in a meaningful way without explanation and interpretation. In the dsicussion section, aim to structure your work thematically, moving through the key concepts or ideas that have emerged from your qualitative data. Use extracts from your data collection - interviews, focus groups, observations - to illustrate where these themes are most prominent, and refer back to the sources from your literature review to help draw conclusions. 

Here's an example of how your data could be presented in paragraph format in this section:

Example from  'Reporting and discussing your findings ', Monash University .

• << Previous: Planning your research
• Next: Quantitative research >>
• Last Updated: Apr 17, 2024 1:52 PM
• URL: https://libguides.shu.ac.uk/researchprojects

• Open access
• Published: 08 July 2023

Understanding geriatric models of care for older adults living with HIV: a scoping review and qualitative analysis

• Kristina Marie Kokorelias 1 , 2 , 3 ,
• Anna Grosse 1 , 4 ,
• Alice Zhabokritsky 5 , 6 , 7 &
• Luxey Sirisegaram 1 , 4  

BMC Geriatrics volume  23 , Article number:  417 ( 2023 ) Cite this article

1419 Accesses

1 Citations

7 Altmetric

Metrics details

Advances in Human Immunodeficiency Virus (HIV) treatment have reduced mortality rates and consequently increased the number of individuals with HIV living into older age. Despite this, people aged 50 years and older have been left behind in recent HIV treatment and prevention campaigns, and a gold-standard model of care for this population has not yet been defined. Developing evidence-based geriatric HIV models of care can support an accessible, equitable, and sustainable HIV health care system that ensures older adults have access to care that meets their needs now and in the future.

Guided by Arksey & O’Malley (2005)’s methodological framework, a scoping review was conducted to determine the key components of, identify gaps in the literature about, and provide recommendations for future research into geriatric models of care for individuals with HIV. Five databases and the grey literature were systematically searched. The titles, abstracts and full texts of the search results were screened independently in duplicate. Data were analyzed using a qualitative case study and key component analysis approach to identify necessary model components.

5702 studies underwent title and abstract screening, with 154 entering full-text review. 13 peer-reviewed and 0 grey literature sources were included. Most articles were from North America. We identified three primary model of care components that may improve the successful delivery of geriatric care to people living with HIV: Collaboration and Integration; Organization of Geriatric Care; and Support for Holistic Care. Most articles included some aspects of all three components.

To provide effective geriatric care to older persons living with HIV, health services and systems are encouraged to use an evidence-based framework and should consider incorporating the distinct model of care characteristics that we have identified in the literature. However, there is limited data about models in developing countries and long-term care settings, and limited knowledge of the role of family, friends and peers in supporting the geriatric care of individuals living with HIV. Future evaluative research is encouraged to determine the impact of optimal components of geriatric models of care on patient outcomes.

Peer Review reports

Human immunodeficiency virus (HIV) continues to be characterized as one of the most prominent public health threats [ 1 ], although advances in antiretroviral therapy (ART) have reduced mortality rates and transformed HIV into a manageable, chronic disease [ 2 ]. The life expectancy for people living with HIV who have had early and sustained access to ART is now similar to that of HIV-negative populations [ 3 , 4 , 5 ]. Thus, there is now an increase in the number of individuals living with HIV into older age [ 6 ] and the number of older adults (aged ≥ 50 years [ 7 ]) living with HIV is expected to increase even further in the coming years [ 8 ]. The proportion of older adults living with HIV has nearly tripled since 2000 [ 9 ].

Older adults with HIV have an increased risk of dementia, diabetes, frailty, depression, osteoporosis, and some cancers, compared to those who are HIV negative [ 10 , 11 , 12 ]. Comorbidities commonly associated with ageing (e.g., diabetes) have been found to increase the risk of opportunistic infections (e.g., HIV-related concerns) in older adults with HIV [ 13 , 14 , 15 , 16 ]. Moreover, stigma is associated with higher rates of loneliness, social isolation and depression in the HIV population [ 17 ]. Despite their increased risk of poor health and social outcomes, older adults living with HIV face many challenges accessing appropriate health and social care, further exacerbating their poor health outcomes [ 18 ]. The stigma associated with HIV may result in a fear of disclosure that delays treatment [ 19 ], and individuals with HIV can feel discriminated against by healthcare providers, resulting in hesitation about or refusal to seek medical care [ 20 , 21 ]. Older adults also tend to not access social services designed for the HIV-infected population because of their own assumption that these programs are created only for younger individuals [ 22 ]. Consequently, HIV scholars have urged for a health and social care system where knowledge and communication about geriatric HIV care are encouraged amongst advocates who work directly with this population, such as geriatric healthcare workers [ 23 ].

Geriatric specialists have expertise in managing many comorbidities that share associations with both ageing and HIV, despite geriatricians being hesitant to take a prominent role in the care of HIV in older adults [ 24 ] due to a lack of experience and training [ 25 ]. While health policy reports a preference for general practice-based HIV care over specialist care [ 26 , 27 ], general practitioners may have a less nuanced understanding about the holistic care of an older adult with complex comorbidities, geriatric syndromes, and metabolic complications when compared with geriatricians [ 28 ]. The use of the Comprehensive Geriatric Assessment (CGA) has been explored, and may lead to improved health and social outcomes in the older adult-HIV population [ 6 , 7 , 8 , 9 , 10 , 11 , 12 , 13 , 14 , 15 , 16 , 17 , 18 , 19 , 20 , 21 , 22 , 23 , 24 , 25 , 26 , 27 , 28 , 29 , 30 , 31 , 32 , 33 , 34 , 35 ], and may be used to measure outcomes in clinical trials that aim to improve the delivery of HIV care for the older adult-HIV population [ 36 ]. However, in the absence of specialized geriatric models of HIV care, many older adults with HIV fail to receive a CGA [ 37 , 38 ] and the recommendations from CGAs are rarely implemented due to a lack of feasibility following a geriatric consult for older adults with HIV [ 39 ].

Numerous models of care, defined as “the way health services are delivered” [ 40 ] (pg., 3), have been developed for older adults with HIV. Many involve geriatric specialists in HIV care, with geriatricians taking on various responsibilities ranging from consultation to leadership roles [ 36 , 41 ]. However, the gold-standard model of care for older adults living with HIV have not yet been defined [ 34 , 35 ], and geriatric care is often delivered by non-geriatric specialists [ 16 ]. Instead of examining models of care, recent literature reviews have tended to focus on the prevalence and experiences of older adults in HIV care [7, NaN], or the experiences of geriatricians [ 24 ]. As implementing geriatric models of HIV care into healthcare settings requires unique considerations [ 28 ], an improved understanding of existing models of care may inform best-practices. This approach has been done to inform the design and delivery of other models of healthcare [ 42 , 43 , 44 , 45 ]. Therefore, we conducted a scoping review of the existing evidence about geriatric models of care for older adults within the context of HIV. To our knowledge, this is the first review to systematically identify the core operational components of existing models of care specific to older adults living with HIV.

A scoping review was selected to map the available literature on geriatric models of care for older adults within the context HIV [ 46 ]. The protocol for our scoping review followed the well-established framework outlined by Arksey and O’Malley [ 46 ] and later refined by Levac et al. [ 47 ] and Colquhoun et al. [ 48 ]. The framework was selected as it provides guidance to ensure a rigorous scoping review approach utilizing a comprehensive search strategy [ 46 ]. Our protocol has been published elsewhere (blinded for review #1) but is briefly described within this section of the manuscript. There were no deviations from our protocol. The framework includes five steps: 1) identifying the research questions; 2) identifying relevant literature; 3) study selection; 4) charting the data; 5) collating, summarizing and reporting the results [ 46 ]. The optional sixth step of consulting with key stakeholders was not followed due to financial resource constraints. We briefly summarize each step and report our findings in accordance with The Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA) Extension for Scoping Reviews (PRISMA-Scr) [ 49 ] (see Supplemental Material A).

Step 1: Identifying the research questions

Our questions were developed to support a knowledge synthesis that could mobilize the current evidence into practice. Our study aimed to answer: What are the key components of the existing models of HIV care for older adults (aged ≥ 50 years [ 7 , 29 ])?

Step 2: Searching for relevant studies

To identify studies, we developed a comprehensive search strategy with an experienced medical information specialist (CDC) who first conducted the search in MEDLINE(R) ALL (in Ovid, including Epub Ahead of Print, In-Process & Other Non-Indexed Citations, Ovid MEDLINE(R) Daily) and then translated it into NLM’s PubMed OVID Embase + Embase Classic, EBSCO’s CINAHL Complete, Clarivate’s Web of Science Core Collection, and Elsevier’s Scopus from the earliest record to 2022 (see Supplemental Material B for the full strategies ) . The search strategy was peer-reviewed according to the peer-review of electronic search strategy guidelines (the PRESS strategy) [ 50 ]. MeSH terms were used. All searches were limited to English language. The final searches were completed on Friday, October 21, 2022. Duplicates were removed using the Bramer method in EndNote [ 51 ]. Covidence was used to manage the review process, including the deduplication of database results [ 52 ].

Gray literature and non-indexed articles were searched for using Google Scholar, Open Grey, open Google searches and relevant websites, including the World Health Organization, UK National Research Register, CADTH’s “Grey Matters”, New York Academy of Medicine's Grey Literature Report, the Canadian Medical Association InfoBase and the National Institute for Heath and Care Excellence – Guidance. Similar search terms used in the scientific search were used. We also consulted with stakeholders of our research (i.e. geriatricians, infectious disease specialists) for any gray literature missed.

Step 3: Selecting studies

Three reviewers (LS, KMK and AG) independently screened article titles and abstracts (level 1-screening) and then full articles (level 2-screening) were screened in duplicate to identify potentially relevant studies. In both levels of screening, any disagreements were resolved through team-based discussion. Articles were included if they described an implemented model or models of care to treat older adults living with HIV exclusively (i.e., not as part of the treatment for multi-morbidity including HIV) and included a registered healthcare provider that specialized in geriatric care (e.g., gerontology social worker, geriatric clinical nurse specialist, geriatrician). Perspective (viewpoint) papers that describe implemented models of HIV care were also included. Book sections, theses, film broadcasts, abstracts without adequate data, and literature reviews were excluded. Articles were also excluded if they: (1) did not propose an original model of HIV care specifically for older adults (i.e., models of care for all adults or models that may include older adults), (2) focused on ethical issues or the theoretical understandings of HIV care or geriatric care, (3) focused on training healthcare providers on how to deliver HIV and/or geriatric care; and (4) described social support, rather than care in a clinical, health-care context. Forward and backward searching were conducted on the final full-text articles to ensure a broad search using EndNote and Citationchaser [ 53 , 54 ].

Step 4: Charting the data

The same three reviewers independently extracted data from the included studies using a data abstraction form that was developed and pilot tested by two researchers (LS and KMK). The data form was tested on five articles for consistency in understanding and ensuring that all relevant data was captured. No changes were made after comparing the pilot test results. The fields for abstraction included author last name, year, study type, setting, geographic location (country), methodology, characteristics of intervention (model of care) and delivery method, participant and provider characteristics, patient inclusion and exclusion criteria, desired outcomes (primary and secondary), results and key conclusions.

Step 5: Collating, summarizing and reporting the results

Data were analyzed using a systematic qualitative case study analytic approach [ 55 ]. First, each author reviewed the abstracted data and independently noted the core operational components (i.e., model structure and process for delivery) described in the models of care. Then the authors came together to list all the identified model components across the included articles, by exploring the similar and different terms to describe the same model components. Each model component was given a label and a definition. These components became the basis of codes that were then appropriately applied by one author (KMK) to each article using NVivo 12 software [ 56 ]. Next the coded data was reviewed by all authors to determine how each model of care described in the articles adhered or did not adhere to each of the particular model components (codes). The authors met weekly to discuss the process of adherence. This discussion process was informed by adherence analyses [ 57 ]. During this process, authors were encouraged to identify any components that were potentially originally overlooked. No additional suggestions were made on key model components. The model components adhered to across the articles and models of care formed the basis of the results.

After a comprehensive list of the identified model components had been determined, two authors (KMK and AG) went through each article and identified them as either adhering or not adhering to each particular characteristic component, as determined by written evidence within the articles. This was done by having the two authors each providing their vote (i.e., adhering or not) and then comparing the two scoring. Any uncertainty in adherence assignment or discrepancies in voting was resolved through discussion amongst all the investigators as done in other reviews with similar methodologies [ 42 ].

Step 6: Consultation

To further contribute to our component adherence, we shared our model components with the senior investigators of our peer-reviewed articles for feedback. We also asked the investigators to assess their level of agreement with our interpretations of their study's component adherence. Lastly, we asked authors to send along any studies that they believed would be relevant to our review. This was done via email by the first (KMK) and senior author (LS) in December 2022. After two months, we only received five replies from 13 potential authors (n = 5/13, 38%) and all five authors agreed with the adherence we provided their article with, suggesting an accurate adherence analysis. No investigators provided us with additional materials or feedback on the model components, rather just commenting on their article specifically.

The databases search yielded a total of 5699 unique citations, from which 151 articles were selected for full text review. Of these 151 articles, 12 peer-reviewed articles were included. An additional peer-reviewed article was obtained from hand searching. No grey literature was included. Thirteen articles were included in the final analysis (see Fig.  1 PRISMA flow chart).

PRISMA flow chat diagram

Most ( n  = 10/13, 77%) of the publication activity occurred in the United States (USA) [ 28 , 32 , 33 , 34 , 35 , 36 , 37 , 38 , 39 , 40 , 41 , 42 , 43 , 44 , 45 , 46 , 47 , 48 , 49 , 50 , 51 , 52 , 53 , 54 , 55 , 56 , 57 , 58 , 59 , 60 , 61 , 62 , 63 , 64 , 65 ]. The remaining three articles ( n  = 3/13,23%) were from the United Kingdom (UK)[ 66 , 67 , 68 ]. Over half ( n  = 9/13,69%) of the articles were published in the last 5 years (2018–2023) [ 28 , 32 , 33 , 34 , 35 , 36 , 37 , 38 , 39 , 40 , 41 , 42 , 43 , 44 , 45 , 46 , 47 , 48 , 49 , 50 , 51 , 52 , 53 , 54 , 55 , 56 , 57 , 58 , 59 , 60 , 61 , 62 ]. In published papers, the most common research methods were qualitative. The key description from these studies were abstracted and are summarized in Table 1 .

Patient population

Patients in the included models of care ranged from 48 [ 60 ]–87 years of age [ 67 ]. The number of patients served ranged from 76 [ 39 ] over 4 years to a maximum of 4000 at the time of data collection (period unspecified) [ 66 ]. Of those articles that reported sex ( n  = 9/13,69%), the majority described primarily male samples [ 39 , 60 , 61 , 62 , 63 , 64 , 65 , 68 ]. Articles that reported race/ethnicity ( n  = 7/13, 54%), described including participants who were mostly White [ 60 , 61 , 67 ] or African American [ 39 , 62 , 63 , 65 , 68 ]. These articles all included White individuals. Of the two ( n  = 2/13, 15%) studies that reported the median time since HIV diagnosis [ 39 ], the average was 12.5 [ 63 ]- 21.5 [ 39 ] years. Medicaid was used as the patients’ primary health insurance in the USA [ 39 , 61 , 62 ].

Key operational components of geriatric models of HIV care

The qualitative analysis identified three distinct model of care components, each with one or more sub-components. These components are listed and described in Table 2 . Table 3 also lists the articles adherent to each component. These model components entail: Collaboration and Integration; Organization of Geriatric Care; and Support for Holistic Care. These three components are described and are illustrated in Fig.  2 .

 Main Model Components

Model Component 1: Collaboration and integration

Eleven ( n  = 11/13, 85%) [ 28 , 39 , 41 , 59 , 60 , 61 , 64 , 65 , 66 , 67 , 68 ] articles described the importance of collaboration and integration for providers caring for older adults with HIV. Models of care frequently incorporated a team of multidisciplinary professionals from the health and social care sectors that were linked in with community supports to improve healthcare delivery for older adults with HIV.

i) Multidisciplinary care roles

Multidisciplinary teams supported the care of older adults living with HIV in all eleven articles that adhered to the Collaboration and Integration model component ( n  = 11/13, 85%). These articles described several provider roles, including designated HIV specialists (infectious diseases or internal medicine physicians) [ 39 , 41 , 60 , 61 , 65 , 66 , 67 , 68 ], geriatricians [ 39 , 41 , 60 , 61 , 64 , 65 , 67 , 68 ] and/or dual-trained HIV and geriatric physicians. Other physician roles included psychiatrists [ 39 ], endocrinologists [ 65 ], cardiologists [ 41 , 60 , 61 , 68 ] and medicine fellows [ 64 ]. Numerous nursing roles [ 41 , 59 , 60 , 61 , 64 , 65 ] were involved, such as HIV clinical nurse specialists [ 41 , 66 , 67 ] and nurse practioners [ 41 , 64 , 65 ]. Allied health professionals included dieticians [ 39 , 65 , 66 ]/ nutritionists[ 41 ], social workers[ 39 , 41 , 59 , 61 , 65 , 66 , 68 ], phsysiotherapists [ 41 , 59 , 66 ], occupational therapists [ 41 , 59 , 66 ], speech-language pathologists[ 59 ], counselors/therapists [ 59 ], homecare aides [ 59 ], clinical psychologists [ 65 , 66 ] and specialist pharmacists [ 41 , 42 , 43 , 44 , 45 , 46 , 47 , 48 , 49 , 50 , 51 , 52 , 53 , 54 , 55 , 56 , 57 , 58 , 59 , 60 , 61 , 62 , 63 , 64 , 65 , 66 , 67 ].

In addition to healthcare providers, several models of care also included research team members (i.e. research coordinators [ 39 ], research assistants [ 39 ], graduate students in gerontology and epidemiology [ 41 ]), medical directors and administrative staff [ 59 , 61 ] (e.g., program coordinator[ 60 ], a gerontologist [i.e., non-clinician] [ 41 ]), chaplains [ 59 ] and volunteers [ 59 ]. Peer navigator roles were also described [ 28 , 41 , 65 , 68 ].

The key responsibilities of these providers differed between models of care and many had overlapping functions. Physicians [ 39 , 41 , 60 , 61 , 64 , 65 , 66 , 67 , 68 ] and nurses [ 41 , 59 , 60 , 61 , 64 , 65 ] were often responsible for overseeing and ensuring appropriate medical care, such as disease and symptom management. Other healthcare professional roles and designated navigation-specific roles [ 28 , 65 , 68 ], provided medication, rehabilitation [ 41 , 59 , 66 ], dietary [ 39 , 59 , 65 , 66 ], or emotional counseling to patients and caregivers [ 59 ]. Geriatricians, in particular, provided evidence-based, best-practice advice that was shared with patients’ primary care providers [ 39 , 41 , 60 , 61 , 64 , 65 , 67 , 68 ]. HIV specialists generally oversaw HIV-related treatments and community services [ 39 , 41 , 60 , 61 , 65 , 66 , 67 , 68 ]. Pharmacists often provided medication instructions and explained care protocols [ 41 , 60 , 65 , 66 , 67 ]. All care providers were described as providing informational and tangible (i.e., hands-on care) support. Administrative and research staff were responsible for documenting relevant information accurately [ 39 , 41 , 59 , 61 ]. Only one article mentioned the role of non-professional caregivers (i.e., spouse, partner, or friend) as part of the care team [ 59 ], in which they were described as providing much of the personal care involved in the home management of HIV [ 59 ].

Administrative team members and researchers support the collection of client information to systematically standardize clinical and research operations [ 39 , 41 , 59 , 60 , 61 ].

ii) Team-Based care

Ten articles ( n  = 10/13, 77%) described the team-based delivery of multidisciplinary care, which was facilitated by several different mechanisms. Informational continuity was identified as being vital in ensuring a consistent and coherent approach to the management of older adults’ evolving needs [ 67 ]. A shared electronic health record was found to enable team-based care, including the ability for multiple providers to chat in real-time [ 28 , 41 , 60 , 61 , 68 ]. Moreover, the multidisciplinary team would often meet to discuss each patient’s background, their outcome measures, current clinical problems, and anticipated needs [ 28 ]. Consequently, the team would facilitate the appropriate screenings through access to different providers, services, and resources [ 28 , 39 , 41 , 60 , 61 , 65 , 68 ]. Following a referral and initial clinical visit, the HIV-geriatric specialists would maintain communication with the primary care team [ 28 ], make recommendations based on the identified age-related needs for care [ 28 ], initiate referrals to other specialist care providers and communicate with community stakeholders to meet other needs [ 59 ]. Team-based care allowed for all members of the circle of care to have a comprehensive knowledge of patients’ health and social care needs (e.g., functional, cognitive) [ 28 ]. Results from retrospective medical and pharmacy chart reviews helped inform all team decisions [ 65 ]. When deemed necessary, the team would be able to create a new action plan [ 39 ] and determine follow-up [ 64 ]. Nurses who worked in case manager roles helped to facilitate this care by coordinating a comprehensive, holistic care plan in collaboration with the patient, caregiver(s), physician(s), and other members of the care team [ 59 ]. Team-based models of care were felt to improve the coordination of care [ 41 ].

iii) Community linkages

Nine articles ( n  = 9/13, 69%) described how the management of HIV in older adults involved active, collaborative partnerships between multidisciplinary healthcare providers and the various community resources available to individuals living with HIV. Models of care were often delivered in linkage with community resources (e.g., social groups) [ 41 ] and through community partners (e.g., volunteer organizations) [ 41 ]. Social workers often helped to facilitate community linkages [ 59 ], and grant-funding helped to pay for community services [ 65 ]. By working with community partners [ 41 ], models of care were able to deliver both nonclinical care [ 39 ] (e.g., peer support to decrease isolation and depression [ 41 ]), as well as clinical care [ 28 ] (e.g., care facilitated by a community nurse [ 39 ]). Community outreach also helped to foster friendships amongst older adults living with HIV through social and community-building activities including dinners, speeches, dances, and trips [ 59 ]. Local partner agencies assisted with meeting the housing needs for patients with marginal housing [ 61 ], and with the provision of legal services [ 61 ]. Partnering medical HIV-geriatric services with community services was thought to result in improved access to services [ 28 ], reduced social isolation [ 60 ], improved home safety management [ 59 ] and the provision of spiritual care such as priests, rabbis, or pastoral personnel [ 59 ].

Model Component 2: Organization of geriatric care

The specific organizational structure of each model of care varied, particularly as it related to staffing models, processes for access and referrals, and the implementation of evidence-based, best-practice care and follow-up. All articles adhered and contributed to this model component. Models of care were often delivered through clinics that were predominantly hospital-based (i.e., operating within a hospital) [ 39 , 60 , 61 , 65 , 66 , 67 ]. Additionally, geriatric clinics were outpatient clinics housed within existing HIV clinics [ 41 ] or community-based services providing home care [ 59 ]. Some models of care were able to be delivered virtually, either solely via phone [ 62 ] or in addition to in-person delivery [ 65 , 66 ]. Some clinics ran weekly [ 66 ], bi-weekly [ 65 ] or monthly [ 41 , 42 , 43 , 44 , 45 , 46 , 47 , 48 , 49 , 50 , 51 , 52 , 53 , 54 , 55 , 56 , 57 , 58 , 59 , 60 , 61 , 62 , 63 , 64 , 65 , 66 , 67 ], whereas others were full-time [ 39 , 65 ].

i) Staffing models

Within the identified models of care, various staffing models were described. All articles contributed to this sub-component. The Geriatrician-Referral model included a geriatrician who consulted on patients [ 39 , 41 , 60 , 61 , 64 , 65 ] based on a referral from the primary care team (often an HIV provider [ 41 ]), according to the perceived need (e.g., cognitive concerns). Six articles ( n  = 6/13, 46%) adhered to this. The Joint-Clinic model involved a geriatrician and HIV physician who were present in a single, combined clinic [ 41 , 66 , 67 , 68 ]. Four articles ( n  = 4/13, 31%) adhered to this model. The HIV-Physician-led model involved staffing clinics with a HIV physician and clinical nurse specialist trained in geriatrics, without geriatrician involvement [ 65 , 66 ]. Two articles ( n  = 2/13, 15%) adhered to this model. A further staffing model, the Dual-Trained Provider model, involved a dually-trained HIV and geriatrics provider, as either a physician [ 41 , 68 ] or psychotherapist [ 62 , 63 ]. Four articles ( n  = 4/13, 31%) adhered to this model. The Nurse-led model, involved nurse-lead teams of allied health professionals [ 59 ]. Only one article ( n  = 1/13, 8%) adhered to this model [ 59 ].

i) Access and referrals

All articles described processes to ensure appropriate access to care, and thus contributed to this sub-component. Referrals and on-call services [ 59 ] were used to facilitate access to care [ 59 ]. In some models of care, older adults were only able to access geriatric services via a referral from their HIV primary care team [ 39 , 41 , 60 , 61 , 67 ], while in other models, referrals were triggered by a combination of age (i.e., 50 years of age or older) and need (e.g., complexity) [ 28 , 66 , 67 , 68 ]. The process of receiving geriatric care often began with an assessment of patients’ needs and functional status (e.g., cognition) [ 39 ] and the collection of demographic information (e.g., age, sex, race/ethnicity, HIV risk factors, marital status, insurance status [ 39 ])[ 28 , 61 , 65 ]. Provider referrals were often documented through tracking scheduled appointments [ 60 , 61 , 68 ], however, limitations of this method included HIV providers not remembering to refer [ 41 ] and patient barriers such as confusion over the need for the referral which may result in skipping geriatric appointments [ 41 ]. One model of care implemented patient reminders to help ensure appointments were attended [ 64 ]. Two articles ( n  = 2/13, 15%) relied on referrals through an AIDS service organization [ 62 , 63 ]Moreover, across the models, patients could choose to be referred to one service (e.g. cardiology clinic) or multiple (e.g., geriatrics clinic) [ 60 , 68 ]. Patients could choose to have follow up with the geriatrician[ 28 ] and/or be connected with a primary care provider [ 41 ]. Clinics have developed guidelines and policies to guide the operation of services [ 28 ].

ii) Implementation of evidence-based screening

All articles described the incorporation of gold-standard, evidence-based screening practices into their geriatric care. Mood symptoms were assessed using the Hospital Anxiety and Depression Scale [ 60 , 62 , 63 , 67 ], the Geriatric Depression Scale [ 62 , 63 ], the Older Peoples’ Quality of Life Questionnaire [ 67 ] and/or the Patient Health Questionnaire [ 39 ], while cognition was assessed using tools such as the Montreal Cognitive Assessment [ 60 ]. CGAs were followed up with direct actions such as counseling (e.g., about ageing) [ 28 , 39 , 60 ], assessments of comorbidities, age-appropriate preventative health screening[ 41 , 60 , 61 ], and pharmacist reviews targeting polypharmacy and drug safety [4, NaN]. In addition to the CGA, clinics offered British HIV Association (BHIVA)-recommended screening (i.e., guidelines for the management of HIV), an antiretroviral review, a functional review and full medication review [ 28 , 66 ]. Emotional support was monitored using the ‘Therapy Content Checklist’ [ 62 , 63 ]. The goal of using valid measurements was to promote best practice [ 59 ].

Model Component 3: Support for holistic care

As older persons are more likely to experience cumulative health challenges that affect their quality of life, models of care for people ageing with HIV have incorporated a comprehensive holistic management approach. All included articles adhered and contributed to this model component. Clinics provided care for patients with multimorbidity [ 60 , 61 , 66 , 67 ] and helped them to overcome socioeconomic challenges [ 41 ], substance use disorders [ 60 , 65 ] and social isolation [ 60 , 62 , 63 ] by understanding their backgrounds[ 41 ]. Physical health consultations considered cardiovascular disease, dental health, eye health and bone health[ 28 , 41 , 60 , 61 , 64 , 68 ] to address HIV and metabolic-related complications [ 41 ]. Care plans incorporated medication prescriptions [ 28 , 39 , 60 , 61 , 66 , 67 , 68 ], preventative screening [ 28 , 39 , 60 , 61 , 64 , 65 , 66 , 67 , 68 ], age-related disease processes (e.g., cognitive-testing) [ 28 , 39 , 41 , 59 , 60 , 61 , 64 , 65 , 66 , 67 , 68 ], psychosocial interventions to improve social networks and mental health [ 28 , 39 , 59 , 60 , 62 , 63 , 64 , 65 ], exercise and nutrition regimens [ 39 ] and behavioural health supports (e.g., smoking cessation, therapy) [ 28 , 39 , 59 , 60 , 61 , 62 , 63 , 64 , 67 ] to meet the holistic needs of each patient. Spiritual support delivered through religious leaders, mental health counselors/therapists, and emotional support volunteers was also offered [ 59 , 64 ].

i)Comprehensive geriatric assessment

Most models of care ( n  = 8/13,61.5%) involved a CGA [ 28 , 39 , 41 , 60 , 61 , 66 , 68 ] or utilized geriatric screening tools [ 65 ] to guide holistic care plans. Most CGAs were delivered by geriatricians who would write full consultation notes [ 39 , 60 , 61 ], although non-geriatrician health care providers were often trained to administer geriatric screening tests [ 41 , 64 ]. The CGA provided an overview of physical and mental health, as well as social support systems [ 39 ], using validated scales [ 39 ].

ii)Supporting self-management

The models of care in six articles ( n  = 6/13, 46%) aimed to support the self-management of older adults living with HIV. The goal of self-management was to enable patients to better manage their health outside of the clinic setting by involving older adults in medical decision-making [ 60 , 68 ] and managing their chronic illnesses [ 59 , 60 , 61 ]. Self-management involved education [ 39 , 59 , 60 , 65 ] and coaching [ 28 ] about health behaviours, guidance for choosing appropriate interventions [ 39 , 59 , 65 ] to improve a patient’s health status [ 28 , 65 ], and increased health care utilization to improve patient involvement in care [ 60 , 65 ]. Some models involved classes where older adults could learn about various health conditions [ 60 , 61 , 62 , 63 ]. Where self-management was not possible due to cognitive or functional impairments, healthcare professionals provided education to individuals’ social support networks such as to encourage their inclusion in care [ 39 , 59 ]. To evaluate self-management, some studies included surveys about knowledge in the evaluations of the clinic models [ 60 , 61 ].

Our scoping review of the literature identified thirteen articles describing geriatric models of care for older adults living with HIV. The identified models came from two countries, the USA and the United Kingdom, and incorporated screening for geriatric syndromes [ 28 , 39 , 41 , 60 , 61 , 65 , 66 , 68 ]. From these articles, we identified three overarching key model components: Collaboration and Integration; Organization of Geriatric Care; and Support for Holistic Care. The models of care were largely delivered by a consulting geriatrician [ 39 , 41 , 60 , 61 , 64 , 65 ] via a referral from an HIV provider [ 41 ], from a joint clinic model involving a geriatrician and HIV physician[ 41 , 42 , 43 , 44 , 45 , 46 , 47 , 48 , 49 , 50 , 51 , 52 , 53 , 54 , 55 , 56 , 57 , 58 , 59 , 60 , 61 , 62 , 63 , 64 , 65 , 66 , 67 , 68 ], or through a dually-trained HIV-geriatrics provider [ 41 , 62 , 63 , 68 ]. However, some models did not involve a geriatrician [59, NaN]. Table 4 summarizes the future recommendations from the included articles.

Our review identified that most models of geriatric-HIV care are delivered by multidisciplinary teams that facilitate integrated health and social care. Multidisciplinary providers who work in team-based care models have been shown to improve clinical outcomes among HIV patients [ 70 , 71 , 72 , 73 ]. This study provided examples of collaborations in which practitioners worked together to meet the diverse needs of patients. Our data expand this finding by suggesting that multidisciplinary care providers help to facilitate referrals to even more providers, particularly those working in community settings, to ensure care continuity and care coordination to meet holistic needs for support. However, it is important for future research to further understand what staffing model of multidisciplinary team care contributes best to the quadruple aim of optimizing health system performance (i.e., improving the individual experience of care; improving the health of populations; reducing the per capita cost of healthcare and creating better provider experiences [ 74 ]) and the limitations of the existing approaches. Moreover, given the shortage of geriatricians [ 45 ] to meet patient needs, it is important to consider the transferability of models that involve a geriatrician [ 39 , 41 , 60 , 61 , 64 , 65 ][ 66 , 67 , 68 ], or dually-trained HIV-geriatrics provider [ 41 , 62 , 63 , 68 ].

The increasing proportion of older adults living with multimorbidity, including HIV, has evoked calls for tailored geriatric services that respond to their evolving needs. Our results suggest that care delivery should address multiple complex and multidimensional aspects of health and wellness, including psychosocial needs such as strategies to reduce social isolation. However, none of the articles discussed the provision of palliative or hospice care. Palliative care has been posited to augment HIV patients’ health and social care outcomes [ 75 ]. Implementation science may help researchers identify how to implement novel palliative care interventions into exiting practices and support uptake and sustainability by considering why, how and in what circumstances barriers and facilitators may be present [ 76 ]. In addition, older adults were described as being decision makers in their care such as being able to choose the follow up services they receive [ 60 , 68 ]. While some programs sought the input of older adults (e.g., through focus groups, none explicitly mentioned partnering with older adults to co-design their models of HIV care. Other HIV interventions have included individuals living with HIV on their steering committees and in development teams, such that care meaningfully reflects their wishes and preferences [ 77 , 78 , 79 ]. These interventions do not include older adults. Future models of care may wish to engage older adults in co-design to conceptualize and brainstorm program delivery [ 80 , 81 ].

Our review identified several areas of research with limited information. Most literature was published in the USA. Only one article mentioned the role of family caregivers in the care of HIV [ 59 ]. However, individuals living with HIV may receive support from non-kin family caregivers, such as friends [ 82 ]. Research is needed to better understand how broader conceptualizations of family can be embedded into the multidisciplinary care teams to help facilitate family-centered care [ 43 , 83 ]. Moreover, none of the articles mentioned care being delivered in the context of nursing or long-term care homes, nor did they mention offered referrals to long-term care facilities or services. Research is needed to determine the optimal approach for delivering geriatric services in long-term care settings to older adults living with HIV. Strategies are also needed to effectively embed HIV care into the already overburdened and under-resourced long-term care sector. While telehealth has proven to be an effective strategy for delivering HIV care [ 84 , 85 ], particularly in rural and remote communities where specialists may not be readily available [ 86 ], additional research is needed to identify the best practices and limitations for delivering geriatric-focused models of care virtually. Lastly, no studies have evaluated how to best incorporate culturally-sensitive geriatric care across racial and ethnic groups [ 87 , 88 ]. Thus, more data are needed to develop culturally-informed models of care to better engage and care for diverse populations of older adults living with HIV, particularly for adults with certain racial and ethnic backgrounds who may face pervasive stigma for accessing HIV care [ 89 , 90 ].

Limitations

As with any review, our findings must be considered within the context of the limitations. Despite our best efforts (i.e., multiple databases, peer-reviewed strategy, screening in duplicate, bibliographic searches, contacting authors of the reviewed articles), we may have inadvertently missed potentially relevant articles. Moreover, we may have missed papers of programs not yet described in the literature, such as those recently funded or piloted. Similarly, we limited the inclusion criteria to studies available in English due to resource constraints (i.e., lack of funding to support translation) and, consequently, may have biased our included studies to those published in English-speaking countries [ 91 ]. However, the intention of scoping reviews is to provide an overview or “map” of the breadth of existing literature, and thus, future exploration is warranted that builds upon our search strategy. Studies focused on individuals with HIV, but did not include description of older adults living with co-morbidities that impair healthcare decision-making, such as dementia, making it difficult to comment about models of care for individuals who require decision-making support. Lastly, stakeholders in implementing, delivering and receiving models of care (e.g., individuals with HIV, policy-makers, healthcare professionals) were not involved in the study design nor analysis.

Conclusions

Our review suggests that novel models of geriatric care for older adults living with HIV should include collaboration and integration, an organization of care that considers appropriate and timely referrals, communication of medical information and the implementation of evidence-based recommendations, as well as a holistic understanding of the dimensions of care, such that they support self-management. This proposed geriatric-based model can provide the framework to inform future implementation science and evaluative research to support further refining and developing this model. However, further research is needed to inform models of geriatric-HIV care in long-term care settings. Given the increasing number of older adults living with HIV, the development of best-practice models of integrated care can hopefully guide healthcare professionals to provide optimal care in the context of the complexities of care for older adults with HIV.

Availability of data and materials

The analysis files and data used and/or analyzed during the current study are available from the corresponding author on reasonable request.

Abbreviations

Comprehensive Geriatric Assessment

Human Immunodeficiency Virus

Organization WH. Consolidated guidelines on HIV prevention, testing, treatment, service delivery and monitoring: recommendations for a public health approach: World Health Organization 2021.

Gardner EM, McLees MP, Steiner JF, et al. The spectrum of engagement in HIV care and its relevance to test-and-treat strategies for prevention of HIV infection. Clin Infect Dis. 2011;52(6):793–800.

Article   PubMed   PubMed Central   Google Scholar  

Higgins JA, Hoffman S, Dworkin SL. Rethinking gender, heterosexual men, and women’s vulnerability to HIV/AIDS. Am J Public Health. 2010;100(3):435–45.

Marcus JL, Chao CR, Leyden WA, et al. Narrowing the gap in life expectancy between HIV-infected and HIV-uninfected individuals with access to care. Journal of acquired immune deficiency syndromes (1999) 2016;73(1):39.

Nakagawa F, May M, Phillips A. Life expectancy living with HIV: recent estimates and future implications. Curr Opin Infect Dis. 2013;26(1):17–25.

Article   PubMed   Google Scholar  

Guaraldi G, Milic J, Mussini C. Aging with HIV. Curr HIV/AIDS Rep. 2019;16(6):475–81.

Sankar A, Nevedal A, Neufeld S, et al. What do we know about older adults and HIV? A review of social and behavioral literature. AIDS Care. 2011;23(10):1187–207.

Flaer PJ, Benjamin PL, Malow RM, et al. The growing cohort of seniors with HIV/AIDS: changing the scope of Medicare Part D. AIDS Care. 2010;22(7):903–8.

Autenrieth CS, Beck EJ, Stelzle D, et al. Global and regional trends of people living with HIV aged 50 and over: Estimates and projections for 2000–2020. PLoS ONE. 2018;13(11): e0207005.

Yendewa GA, Poveda E, Yendewa SA, et al. HIV/AIDS in Sierra Leone: Characterizing the hidden epidemic. AIDS Reviews 2018;20(2):104–13. doi: https://dx.doi.org/ https://doi.org/10.24875/AIDSRev.M18000022

Desmarais P, Gao AF, Lanctôt K, et al. White matter hyperintensities in autopsy-confirmed frontotemporal lobar degeneration and Alzheimer’s disease. Alzheimer’s research & therapy. 2021;13(1):129. https://doi.org/10.1186/s13195-021-00869-6[publishedOnlineFirst:2021/07/15] .

Article   Google Scholar  

Buchacz K, Baker RK, Palella FJ Jr, et al. Disparities in prevalence of key chronic diseases by gender and race/ethnicity among antiretroviral-treated HIV-infected adults in the US. Antivir Ther. 2013;18(1):65–75.

Mateen FJ, Mills EJ. Aging and HIV-Related Cognitive Loss. JAMA, J Am Med Assoc. 2012;308(4):349–50. https://doi.org/10.1001/jama.2012.8538 .

Article   CAS   Google Scholar  

Kong AM, Pozen A, Anastos K, et al. Non-HIV Comorbid Conditions and Polypharmacy Among People Living with HIV Age 65 or Older Compared with HIV-Negative Individuals Age 65 or Older in the United States: A Retrospective Claims-Based Analysis. AIDS Patient Care STDS. 2019;33(3):93–103. https://doi.org/10.1089/apc.2018.0190 .

McMillan JM, Gill MJ, Power C, et al. Comorbidities in Older Persons with Controlled HIV Infection: Correlations with Frailty Index Subtypes. AIDS Patient Care STDS. 2020;34(7):284–94. https://doi.org/10.1089/apc.2020.0051 .

Erlandson KM, Karris MY. HIV and aging: reconsidering the approach to management of comorbidities. Infect Dis Clin. 2019;33(3):769–86.

Emlet CA, Brennan DJ, Brennenstuhl S, et al. The impact of HIV-related stigma on older and younger adults living with HIV disease: does age matter? AIDS Care. 2015;27(4):520–8.

Emlet CA. Social, economic, and health disparities among LGBT older adults. Generations. 2016;40(2):16–22.

PubMed   PubMed Central   Google Scholar  

Alexandra Marshall S, Brewington KM, Kathryn Allison M, et al. Measuring HIV-related stigma among healthcare providers: a systematic review. AIDS Care. 2017;29(11):1337–45.

Article   CAS   PubMed   Google Scholar  

Hibbert M, Wolton A, Crenna-Jennings W, et al. Experiences of stigma and discrimination in social and healthcare settings among trans people living with HIV in the UK. AIDS Care. 2018;30(7):836–43.

Emlet CA, Brennan DJ, Brennenstuhl S, et al. Protective and risk factors associated with stigma in a population of older adults living with HIV in Ontario. Canada AIDS care. 2013;25(10):1330–9.

Fritsch T. HIV/AIDS and the older adult: An exploratory study of the age-related differences in access to medical and social services. J Appl Gerontol. 2005;24(1):35–54.

Wallach IS, Brotman SH. Gaps in health and social care services to older adults living with HIV: a qualitative study on the perspectives of older adults and service providers. NursCare Open Access J. 2019;6(1):28–33.

Google Scholar  

Jones HT, Barber TJ. How do geriatricians feel about managing older people living with HIV? A scoping review European geriatric medicine. 2022;13(4):987–97. https://doi.org/10.1007/s41999-022-00642-4 .

Chambers LA, Wilson MG, Rueda S, et al. Evidence Informing the Intersection of HIV, Aging and Health: A Scoping Review. AIDS Behav. 2014;18(4):661. https://doi.org/10.1007/s10461-013-0627-5 .

Liddy C, Shoemaker ES, Crowe L, et al. How the delivery of HIV care in Canada aligns with the Chronic care model: A qualitative study. PLoS ONE. 2019;14(7):e0220516-e220616. https://doi.org/10.1371/journal.pone.0220516 .

Article   CAS   PubMed   PubMed Central   Google Scholar  

Mapp F, Hutchinson J, Estcourt C. A systematic review of contemporary models of shared HIV care and HIV in primary care in high-income settings. Int J STD AIDS. 2015;26(14):991–7. https://doi.org/10.1177/0956462415577496 .

Siegler EL, Burchett CO, Glesby MJ. Older people with HIV are an essential part of the continuum of HIV care. Journal of the International AIDS Society 2018;21(10):e25188-n/a. doi: https://doi.org/10.1002/jia2.25188

Sánchez-Conde M, Díaz-Alvarez J, Dronda F, et al. Why are people with HIV considered “older adults” in their fifties? European Geriatric Medicine. 2019;10(2):183–8.

Grov C, Golub SA, Parsons JT, et al. Loneliness and HIV-related stigma explain depression among older HIV-positive adults. AIDS Care. 2010;22(5):630–9.

Greene M, Shi Y, Boscardin J, Sudore R, Gandhi M, Covinsky K. Geriatric conditions and healthcare utilisation in older adults living with HIV. Age and Ageing. 2022 May;51(5):afac093.

Sangarlangkarn A, Appelbaum JS. Comprehensive Geriatric Assessment in Older Persons With HIV. Open forum infectious diseases 2020;7(11):ofaa485-ofaa85. doi: https://doi.org/10.1093/ofid/ofaa485

Yip KF, Wong TH, Alhamid SM, et al. Integrating advance care planning as part of comprehensive geriatric assessment for hospitalised frail elderly patients: findings of a cross-sectional study. Singapore Med J. 2020;61(5):254–9. https://doi.org/10.11622/smedj.2019098 .

Guaraldi G. Rockwood K. Geriatric-HIV medicine is born: Oxford University Press US; 2017. p. 507–9.

Guaraldi G, Palella FJ Jr. Clinical implications of aging with HIV infection: perspectives and the future medical care agenda. AIDS (London, England). 2017;31:S129–35.

Brañas F, Ryan P, Troya J, et al. Geriatric-HIV Medicine: the geriatrician’s role. European geriatric medicine. 2019;10(2):259–65. https://doi.org/10.1007/s41999-018-0144-1 .

Sangarlangkarn A, Apornpong T, Justice AC, et al. Screening tools for targeted comprehensive geriatric assessment in HIV-infected patients 50 years and older. Int J STD AIDS. 2019;30(10):1009–17. https://doi.org/10.1177/0956462419841478 .

Morrow H, Horner M, Thomson-Glover R. 992 RESULTS OF A PILOT HIV/FRAILTY CLINIC - CAN COMPREHENSIVE GERIATRIC ASSESSMENT BENEFIT FRAIL PEOPLE LIVING WITH HIV? Age and ageing 2022;51(Supplement_2) doi: https://doi.org/10.1093/ageing/afac126.043

Bitas C, Jones S, Singh HK, et al. Adherence to Recommendations from Comprehensive Geriatric Assessment of Older Individuals with HIV. Journal of the International Association of Providers of AIDS Care. 2019;18:2325958218821656–56. https://doi.org/10.1177/2325958218821656 .

Innovation AfC. Understanding the Process to Develop a Model of Care: An ACI Framework: Agency for Clinical Innovation Chatswood NSW, 2013.

Davis AJ, Greene M, Siegler E, et al. Strengths and Challenges of Various Models of Geriatric Consultation for Older Adults Living With Human Immunodeficiency Virus. Clin Infect Dis. 2022;74(6):1101–6. https://doi.org/10.1093/cid/ciab682 .

Sinha SK, Bessman ES, Flomenbaum N, et al. A systematic review and qualitative analysis to inform the development of a new emergency department-based geriatric case management model. Ann Emerg Med. 2011;57(6):672–82.

Kokorelias KM, Gignac MA, Naglie G, et al. Towards a universal model of family centered care: a scoping review. BMC Health Serv Res. 2019;19(1):1–11.

Korthuis PT, McCarty D, Weimer M, et al. Primary care–based models for the treatment of opioid use disorder: A scoping review. Ann Intern Med. 2017;166(4):268–78.

Krause KE, Kokorelias KM, Sinha SK. A systematic review and qualitative analysis of geriatric models of care for rural and remote populations. Rural Remote Health. 2022;22(3):7486–586.

PubMed   Google Scholar  

Arksey H, O’Malley L. Scoping studies: towards a methodological framework. Int J Soc Res Methodol. 2005;8(1):19–32.

Levac D, Colquhoun H, O’Brien KK. Scoping studies: advancing the methodology. Implement Sci. 2010;5(1):1–9.

Colquhoun HL, Levac D, O’Brien KK, et al. Scoping reviews: time for clarity in definition, methods, and reporting. J Clin Epidemiol. 2014;67(12):1291–4.

Tricco AC, Lillie E, Zarin W, et al. PRISMA extension for scoping reviews (PRISMA-ScR): checklist and explanation. Ann Intern Med. 2018;169(7):467–73.

McGowan J, Sampson M, Salzwedel DM, et al. PRESS peer review of electronic search strategies: 2015 guideline statement. J Clin Epidemiol. 2016;75:40–6.

Bramer WM, Giustini D, de Jonge GB, et al. De-duplication of database search results for systematic reviews in EndNote. Journal of the Medical Library Association: JMLA. 2016;104(3):240.

Babineau J. Product review: covidence (systematic review software). Journal of the Canadian Health Libraries Association/Journal de l’Association des bibliothèques de la santé du Canada. 2014;35(2):68–71.

Bramer WM, Milic J, Mast F. Reviewing retrieved references for inclusion in systematic reviews using EndNote. Journal of the Medical Library Association: JMLA. 2017;105(1):84.

Haddaway NR, Grainger MJ, Gray CT. Citationchaser: A tool for transparent and efficient forward and backward citation chasing in systematic searching. Research Synthesis Methods 2022

Miles MB, Huberman AM, Saldaña J. Qualitative data analysis: A methods sourcebook: Sage publications 2018.

Beekhuyzen J. Putting the pieces of the puzzle together: Using Nvivo for a literature review. Proceedings of QualIT2007: Qualitative Research, From the Margins to the Mainstream, Wellington, New Zealand, Victoria University of Wellington 2007:18–20.

Bissonnette JM. Adherence: a concept analysis. J Adv Nurs. 2008;63(6):634–43.

Bhatta M, Nandi S, Dutta N, et al. HIV care among elderly population: Systematic review and meta-analysis. AIDS research and human retroviruses 2020;36(ja):475–89. doi: https://doi.org/10.1089/AID.2019.0098

Garvey C. AIDS care for the elderly: A community-based approach. AIDS Patient Care. 1994;8(3):118–20. https://doi.org/10.1089/apc.1994.8.118 .

Greene M, Myers J, Tan JY, et al. The Golden Compass Program: Overview of the Initial Implementation of a Comprehensive Program for Older Adults Living with HIV. Journal of the International Association of Providers of AIDS Care. 2020;19:2325958220935267–67. https://doi.org/10.1177/2325958220935267 .

Greene ML, Tan JY, Weiser SD, et al. Patient and provider perceptions of a comprehensive care program for HIV-positive adults over 50 years of age: The formation of the Golden Compass HIV and aging care program in San Francisco. PLoS ONE. 2018;13(12):e0208486-e208586. https://doi.org/10.1371/journal.pone.0208486 .

Heckman TG, Heckman BD, Anderson T, et al. Common Factors and Depressive Symptom Relief Trajectories in Group Teletherapy for Persons Ageing with HIV: Common Factors and Depression in HIV-infected Older Adults. Clin Psychol Psychother. 2017;24(1):139–48. https://doi.org/10.1002/cpp.1989 .

Heckman TG, Sikkema KJ, Hansen N, et al. A randomized clinical trial of a coping improvement group intervention for HIV-infected older adults. J Behav Med. 2010;34(2):102–11. https://doi.org/10.1007/s10865-010-9292-6 .

Ruiz M, Cefalu C, Ogbuokiri J. A Dedicated Screening Program for Geriatric HIV-Infected Patients Integrating HIV and Geriatric Care. Journal of the International Association of Physicians in AIDS Care (Chicago, Ill : 2002) 2010;9(3):157–61. doi: https://doi.org/10.1177/1545109710367519

Schmalzle SA, Viviano NA, Mohanty K, et al. People aging with HIV - protecting a population vulnerable to effects of COVID-19 and its control measures. AIDS Care. 2022;34(11):1355–63. https://doi.org/10.1080/09540121.2021.2020208 .

Cresswell FV, Levett T. Specialist care of older adults with HIV infection in the UK: a service evaluation. HIV Med. 2017;18(7):519–24. https://doi.org/10.1111/hiv.12481 .

Levett T, Alford K, Roberts J, et al. Evaluation of a combined hiv and geriatrics clinic for older people living with hiv: The silver clinic in brighton, uk. Geriatrics (Basel, Switzerland). 2020;5(4):1–12. https://doi.org/10.3390/geriatrics5040081 .

Tan JY, Greene M, Blat C, et al. Examining the Impact of the Golden Compass Clinical Care Program for Older People with HIV: A Qualitative Study. AIDS Behav. 2022;26(5):1562–71. https://doi.org/10.1007/s10461-021-03509-0 .

Siegler, E. L., Burchett, C. O., & Glesby, M. J. (2018). Older people with HIV are an essential part of the continuum of HIV care.  Journal of the International AIDS Society ,  21 (10).

Elgalib A, Al-Sawafi H, Kamble B, et al. Multidisciplinary care model for HIV improves treatment outcome: a single-centre experience from the Middle East. AIDS Care. 2018;30(9):1114–9.

Handford CD, Tynan A-M, Agha A, et al. Organization of care for persons with HIV-infection: a systematic review. AIDS Care. 2017;29(7):807–16.

Sherer R, Stieglitz K, Narra J, et al. HIV multidisciplinary teams work: support services improve access to and retention in HIV primary care. AIDS Care. 2002;14(sup1):31–44.

Soto TA, Bell J, Pillen M, et al. Literature on integrated HIV care: a review. AIDS Care. 2004;16(sup1):43–55.

Bodenheimer T, Sinsky C. From triple to quadruple aim: care of the patient requires care of the provider. The Annals of Family Medicine. 2014;12(6):573–6.

Simms V, Higginson IJ, Harding R. Integration of palliative care throughout HIV disease. Lancet Infect Dis. 2012;12(7):571–5.

Demiris G, Parker Oliver D, Capurro D, et al. Implementation science: implications for intervention research in hospice and palliative care. Gerontologist. 2014;54(2):163–71.

Mackworth-Young C, Dringus S, Dauya E, et al. Putting youth at the centre: co-design of a community-based intervention to improve HIV outcomes among youth in Zimbabwe. Wellcome open research. 2022;7:53.

Marent B, Henwood F, Darking M, et al. Development of an mHealth platform for HIV care: gathering user perspectives through co-design workshops and interviews. JMIR Mhealth Uhealth. 2018;6(10): e9856.

Lee MJ, Onyango D, Hamza H, et al. Surveying testing preferences in Black, Latin American, and other minorities for the co-design of digital vending machines for HIV self-testing. Int J STD AIDS. 2020;31(2):158–65.

Tong C, Kernoghan A, Lemmon K, et al. Lessons and Reflections From an Extended Co-design Process Developing an mHealth App With and for Older Adults: Multiphase, Mixed Methods Study. JMIR aging. 2022;5(4): e39189.

Long-term co-design guidelines: Empowering older adults as co-designers of social robots. 2021 30th IEEE International Conference on Robot & Human Interactive Communication (RO-MAN); 2021. IEEE.

Prachakul W, Grant JS. Informal caregivers of persons with HIV/AIDS: A review and analysis. J Assoc Nurses AIDS Care. 2003;14(3):55–71.

Nelson MK. Fictive kin, families we choose, and voluntary kin: What does the discourse tell us? J Fam Theory Rev. 2013;5(4):259–81.

Dandachi D, Dang BN, Lucari B, et al. Exploring the attitude of patients with HIV about using telehealth for HIV care. AIDS Patient Care STDS. 2020;34(4):166–72.

Dandachi D, Lee C, Morgan RO, et al. Integration of telehealth services in the healthcare system: with emphasis on the experience of patients living with HIV. J Investig Med. 2019;67(5):815–20.

Ohl M, Dillon D, Moeckli J, et al. Mixed-methods evaluation of a telehealth collaborative care program for persons with HIV infection in a rural setting. J Gen Intern Med. 2013;28(9):1165–73.

Bucharski D, Reutter LI, Ogilvie LD. “You need to know where we’re coming from”: Canadian aboriginal women’s perspectives on culturally appropriate HIV counseling and testing. Health Care Women Int. 2006;27(8):723–47.

Sauceda JA, Brooks RA, Xavier J, et al. From theory to application: a description of transnationalism in culturally-appropriate HIV interventions of outreach, access, and retention among Latino/a populations. J Immigr Minor Health. 2019;21(2):332–45.

Chakrapani V, Gulfam FR, Arumugam V, et al. Intersectional stigma and gender non-affirmation hinder HIV care engagement among transgender women living with HIV in India. AIDS care 2022:1–9.

Ziersch A, Walsh M, Baak M, et al. “It is not an acceptable disease”: A qualitative study of HIV-related stigma and discrimination and impacts on health and wellbeing for people from ethnically diverse backgrounds in Australia. BMC Public Health. 2021;21(1):1–15.

Neimann Rasmussen L, Montgomery P. The prevalence of and factors associated with inclusion of non-English language studies in Campbell systematic reviews: A survey and meta-epidemiological study. Syst Rev. 2018;7(1):129–229. https://doi.org/10.1186/s13643-018-0786-6 .

Download references

Acknowledgements

We would like to thank and acknowledge the contributions of Charmaine De Castro, Information Specialist at the Mount Sinai Hospital– Sinai Health System, for providing guidance on the search strategy development, and conducting the literature search. We would like to thank and acknowledge the contributions of the authors who replied to our emails for contributing to our analysis.

This work was supported by Sinai Health’s Healthy Ageing and Geriatrics Program Research Fund.

Author information

Authors and affiliations.

Division of Geriatric Medicine, Department of Medicine, Sinai Health System and University Health Network, Suite 475 - 600 University Avenue, Toronto, ON, M5G 1X5, Canada

Kristina Marie Kokorelias, Anna Grosse & Luxey Sirisegaram

Department of Occupational Science & Occupational Therapy, Temerty Faculty of Medicine, University of Toronto, 160 - 500 University Ave, Toronto, ON, M5G 1V7, Canada

Kristina Marie Kokorelias

Rehabilitation Sciences Institute, University of Toronto, Toronto, Canada

Division of Geriatric Medicine, Department of Medicine, Medical Sciences Building, University of Toronto, 1 King’s College Cir, Toronto, ON, M5S 1A8, Canada

Anna Grosse & Luxey Sirisegaram

Department of Medicine, Medical Sciences Building, The University of Toronto, King’s College Cir, Toronto, ON, M5S 1A8, Canada

Alice Zhabokritsky

Infectious Diseases, Department of Medicine, University Health Network, 610 University Ave, Toronto, Toronto, ON, M5G 2M9, Canada

CIHR Canadian HIV Trails Network, 570-1081 Burrard Street, Vancouver, BC, V6Z 1Y6, Canada

You can also search for this author in PubMed   Google Scholar

Contributions

All authors contributed to the project idea and initiated the project. KMK and LS conceptualized the study design. KMK wrote the first draft of this manuscript and revised the article during the review process. KMK and LS provided guidance to the Information Specialist with respect to the design of the search strategy. All authors finalized the literature search strategy. KMK piloted the search strategy. AG and LS were involved in editing and revising the manuscript. All authors approved the final version of the protocol and are accountable for all aspects of the work.

Corresponding author

Correspondence to Luxey Sirisegaram .

Ethics declarations

Ethics approval and consent to participate.

Not Required.

Consent for publication

Competing interests.

The authors declare that they have no competing interests.

Additional information

Publisher’s note.

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1., rights and permissions.

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ . The Creative Commons Public Domain Dedication waiver ( http://creativecommons.org/publicdomain/zero/1.0/ ) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Cite this article.

Kokorelias, K.M., Grosse, A., Zhabokritsky, A. et al. Understanding geriatric models of care for older adults living with HIV: a scoping review and qualitative analysis. BMC Geriatr 23 , 417 (2023). https://doi.org/10.1186/s12877-023-04114-7

Download citation

Received : 18 January 2023

Accepted : 16 June 2023

Published : 08 July 2023

DOI : https://doi.org/10.1186/s12877-023-04114-7

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

• Models of care
• Older adults
• Qualitative
• Scoping review

BMC Geriatrics

ISSN: 1471-2318

• Submission enquiries: [email protected]
• General enquiries: [email protected]

• Open access
• Published: 23 April 2024

Designing feedback processes in the workplace-based learning of undergraduate health professions education: a scoping review

• Javiera Fuentes-Cimma 1 , 2 ,
• Dominique Sluijsmans 3 ,
• Arnoldo Riquelme 4 ,
• Ignacio Villagran   ORCID: orcid.org/0000-0003-3130-8326 1 ,
• Lorena Isbej   ORCID: orcid.org/0000-0002-4272-8484 2 , 5 ,
• María Teresa Olivares-Labbe 6 &
• Sylvia Heeneman 7  

BMC Medical Education volume  24 , Article number:  440 ( 2024 ) Cite this article

Metrics details

Feedback processes are crucial for learning, guiding improvement, and enhancing performance. In workplace-based learning settings, diverse teaching and assessment activities are advocated to be designed and implemented, generating feedback that students use, with proper guidance, to close the gap between current and desired performance levels. Since productive feedback processes rely on observed information regarding a student's performance, it is imperative to establish structured feedback activities within undergraduate workplace-based learning settings. However, these settings are characterized by their unpredictable nature, which can either promote learning or present challenges in offering structured learning opportunities for students. This scoping review maps literature on how feedback processes are organised in undergraduate clinical workplace-based learning settings, providing insight into the design and use of feedback.

A scoping review was conducted. Studies were identified from seven databases and ten relevant journals in medical education. The screening process was performed independently in duplicate with the support of the StArt program. Data were organized in a data chart and analyzed using thematic analysis. The feedback loop with a sociocultural perspective was used as a theoretical framework.

The search yielded 4,877 papers, and 61 were included in the review. Two themes were identified in the qualitative analysis: (1) The organization of the feedback processes in workplace-based learning settings, and (2) Sociocultural factors influencing the organization of feedback processes. The literature describes multiple teaching and assessment activities that generate feedback information. Most papers described experiences and perceptions of diverse teaching and assessment feedback activities. Few studies described how feedback processes improve performance. Sociocultural factors such as establishing a feedback culture, enabling stable and trustworthy relationships, and enhancing student feedback agency are crucial for productive feedback processes.

Conclusions

This review identified concrete ideas regarding how feedback could be organized within the clinical workplace to promote feedback processes. The feedback encounter should be organized to allow follow-up of the feedback, i.e., working on required learning and performance goals at the next occasion. The educational programs should design feedback processes by appropriately planning subsequent tasks and activities. More insight is needed in designing a full-loop feedback process, in which specific attention is needed in effective feedforward practices.

Peer Review reports

The design of effective feedback processes in higher education has been important for educators and researchers and has prompted numerous publications discussing potential mechanisms, theoretical frameworks, and best practice examples over the past few decades. Initially, research on feedback primarily focused more on teachers and feedback delivery, and students were depicted as passive feedback recipients [ 1 , 2 , 3 ]. The feedback conversation has recently evolved to a more dynamic emphasis on interaction, sense-making, outcomes in actions, and engagement with learners [ 2 ]. This shift aligns with utilizing the feedback process as a form of social interaction or dialogue to enhance performance [ 4 ]. Henderson et al. (2019) defined feedback processes as "where the learner makes sense of performance-relevant information to promote their learning." (p. 17). When a student grasps the information concerning their performance in connection to the desired learning outcome and subsequently takes suitable action, a feedback loop is closed so the process can be regarded as successful [ 5 , 6 ].

Hattie and Timperley (2007) proposed a comprehensive perspective on feedback, the so-called feedback loop, to answer three key questions: “Where am I going? “How am I going?” and “Where to next?” [ 7 ]. Each question represents a key dimension of the feedback loop. The first is the feed-up, which consists of setting learning goals and sharing clear objectives of learners' performance expectations. While the concept of the feed-up might not be consistently included in the literature, it is considered to be related to principles of effective feedback and goal setting within educational contexts [ 7 , 8 ]. Goal setting allows students to focus on tasks and learning, and teachers to have clear intended learning outcomes to enable the design of aligned activities and tasks in which feedback processes can be embedded [ 9 ]. Teachers can improve the feed-up dimension by proposing clear, challenging, but achievable goals [ 7 ]. The second dimension of the feedback loop focuses on feedback and aims to answer the second question by obtaining information about students' current performance. Different teaching and assessment activities can be used to obtain feedback information, and it can be provided by a teacher or tutor, a peer, oneself, a patient, or another coworker. The last dimension of the feedback loop is the feedforward, which is specifically associated with using feedback to improve performance or change behaviors [ 10 ]. Feedforward is crucial in closing the loop because it refers to those specific actions students must take to reduce the gap between current and desired performance [ 7 ].

From a sociocultural perspective, feedback processes involve a social practice consisting of intricate relationships within a learning context [ 11 ]. The main feature of this approach is that students learn from feedback only when the feedback encounter includes generating, making sense of, and acting upon the information given [ 11 ]. In the context of workplace-based learning (WBL), actionable feedback plays a crucial role in enabling learners to leverage specific feedback to enhance their performance, skills, and conceptual understandings. The WBL environment provides students with a valuable opportunity to gain hands-on experience in authentic clinical settings, in which students work more independently on real-world tasks, allowing them to develop and exhibit their competencies [ 3 ]. However, WBL settings are characterized by their unpredictable nature, which can either promote self-directed learning or present challenges in offering structured learning opportunities for students [ 12 ]. Consequently, designing purposive feedback opportunities within WBL settings is a significant challenge for clinical teachers and faculty.

In undergraduate clinical education, feedback opportunities are often constrained due to the emphasis on clinical work and the absence of dedicated time for teaching [ 13 ]. Students are expected to perform autonomously under supervision, ideally achieved by giving them space to practice progressively and providing continuous instances of constructive feedback [ 14 ]. However, the hierarchy often present in clinical settings places undergraduate students in a dependent position, below residents and specialists [ 15 ]. Undergraduate or junior students may have different approaches to receiving and using feedback. If their priority is meeting the minimum standards given pass-fail consequences and acting merely as feedback recipients, other incentives may be needed to engage with the feedback processes because they will need more learning support [ 16 , 17 ]. Adequate supervision and feedback have been recognized as vital educational support in encouraging students to adopt a constructive learning approach [ 18 ]. Given that productive feedback processes rely on observed information regarding a student's performance, it is imperative to establish structured teaching and learning feedback activities within undergraduate WBL settings.

Despite the extensive research on feedback, a significant proportion of published studies involve residents or postgraduate students [ 19 , 20 ]. Recent reviews focusing on feedback interventions within medical education have clearly distinguished between undergraduate medical students and residents or fellows [ 21 ]. To gain a comprehensive understanding of initiatives related to actionable feedback in the WBL environment for undergraduate health professions, a scoping review of the existing literature could provide insight into how feedback processes are designed in that context. Accordingly, the present scoping review aims to answer the following research question: How are the feedback processes designed in the undergraduate health professions' workplace-based learning environments?

A scoping review was conducted using the five-step methodological framework proposed by Arksey and O'Malley (2005) [ 22 ], intertwined with the PRISMA checklist extension for scoping reviews to provide reporting guidance for this specific type of knowledge synthesis [ 23 ]. Scoping reviews allow us to study the literature without restricting the methodological quality of the studies found, systematically and comprehensively map the literature, and identify gaps [ 24 ]. Furthermore, a scoping review was used because this topic is not suitable for a systematic review due to the varied approaches described and the large difference in the methodologies used [ 21 ].

Search strategy

With the collaboration of a medical librarian, the authors used the research question to guide the search strategy. An initial meeting was held to define keywords and search resources. The proposed search strategy was reviewed by the research team, and then the study selection was conducted in two steps:

An online database search included Medline/PubMed, Web of Science, CINAHL, Cochrane Library, Embase, ERIC, and PsycINFO.

A directed search of ten relevant journals in the health sciences education field (Academic Medicine, Medical Education, Advances in Health Sciences Education, Medical Teacher, Teaching and Learning in Medicine, Journal of Surgical Education, BMC Medical Education, Medical Education Online, Perspectives on Medical Education and The Clinical Teacher) was performed.

The research team conducted a pilot or initial search before the full search to identify if the topic was susceptible to a scoping review. The full search was conducted in November 2022. One team member (MO) identified the papers in the databases. JF searched in the selected journals. Authors included studies written in English due to feasibility issues, with no time span limitation. After eliminating duplicates, two research team members (JF and IV) independently reviewed all the titles and abstracts using the exclusion and inclusion criteria described in Table  2 and with the support of the screening application StArT [ 25 ]. A third team member (AR) reviewed the titles and abstracts when the first two disagreed. The reviewer team met again at a midpoint and final stage to discuss the challenges related to study selection. Articles included for full-text review were exported to Mendeley. JF independently screened all full-text papers, and AR verified 10% for inclusion. The authors did not analyze study quality or risk of bias during study selection, which is consistent with conducting a scoping review.

The analysis of the results incorporated a descriptive summary and a thematic analysis, which was carried out to clarify and give consistency to the results' reporting [ 22 , 24 , 26 ]. Quantitative data were analyzed to report the characteristics of the studies, populations, settings, methods, and outcomes. Qualitative data were labeled, coded, and categorized into themes by three team members (JF, SH, and DS). The feedback loop framework with a sociocultural perspective was used as the theoretical framework to analyze the results.

The keywords used for the search strategies were as follows:

Clinical clerkship; feedback; formative feedback; health professions; undergraduate medical education; workplace.

Definitions of the keywords used for the present review are available in Appendix 1 .

As an example, we included the search strategy that we used in the Medline/PubMed database when conducting the full search:

("Formative Feedback"[Mesh] OR feedback) AND ("Workplace"[Mesh] OR workplace OR "Clinical Clerkship"[Mesh] OR clerkship) AND (("Education, Medical, Undergraduate"[Mesh] OR undergraduate health profession*) OR (learner* medical education)).

Inclusion and exclusion criteria

The following inclusion and exclusion criteria were used (Table  1 ):

Data extraction

The research group developed a data-charting form to organize the information obtained from the studies. The process was iterative, as the data chart was continuously reviewed and improved as necessary. In addition, following Levac et al.'s recommendation (2010), the three members involved in the charting process (JF, LI, and IV) independently reviewed the first five selected studies to determine whether the data extraction was consistent with the objectives of this scoping review and to ensure consistency. Then, the team met using web-conferencing software (Zoom; CA, USA) to review the results and adjust any details in the chart. The same three members extracted data independently from all the selected studies, considering two members reviewing each paper [ 26 ]. A third team member was consulted if any conflict occurred when extracting data. The data chart identified demographic patterns and facilitated the data synthesis. To organize data, we used a shared Excel spreadsheet, considering the following headings: title, author(s), year of publication, journal/source, country/origin, aim of the study, research question (if any), population/sample size, participants, discipline, setting, methodology, study design, data collection, data analysis, intervention, outcomes, outcomes measure, key findings, and relation of findings to research question.

Additionally, all the included papers were uploaded to AtlasTi v19 to facilitate the qualitative analysis. Three team members (JF, SH, and DS) independently coded the first six papers to create a list of codes to ensure consistency and rigor. The group met several times to discuss and refine the list of codes. Then, one member of the team (JF) used the code list to code all the rest of the papers. Once all papers were coded, the team organized codes into descriptive themes aligned with the research question.

Preliminary results were shared with a number of stakeholders (six clinical teachers, ten students, six medical educators) to elicit their opinions as an opportunity to build on the evidence and offer a greater level of meaning, content expertise, and perspective to the preliminary findings [ 26 ]. No quality appraisal of the studies is considered for this scoping review, which aligns with the frameworks for guiding scoping reviews [ 27 ].

The datasets analyzed during the current study are available from the corresponding author upon request.

A database search resulted in 3,597 papers, and the directed search of the most relevant journals in the health sciences education field yielded 2,096 titles. An example of the results of one database is available in Appendix 2 . Of the titles obtained, 816 duplicates were eliminated, and the team reviewed the titles and abstracts of 4,877 papers. Of these, 120 were selected for full-text review. Finally, 61 papers were included in this scoping review (Fig.  1 ), as listed in Table  2 .

PRISMA flow diagram for included studies, incorporating records identified through the database and direct searching

The selected studies were published between 1986 and 2022, and seventy-five percent (46) were published during the last decade. Of all the articles included in this review, 13% (8) were literature reviews: one integrative review [ 28 ] and four scoping reviews [ 29 , 30 , 31 , 32 ]. Finally, fifty-three (87%) original or empirical papers were included (i.e., studies that answered a research question or achieved a research purpose through qualitative or quantitative methodologies) [ 15 , 33 , 34 , 35 , 36 , 37 , 38 , 39 , 40 , 41 , 42 , 43 , 44 , 45 , 46 , 47 , 48 , 49 , 50 , 51 , 52 , 53 , 54 , 55 , 56 , 57 , 58 , 59 , 60 , 61 , 62 , 63 , 64 , 65 , 66 , 67 , 68 , 69 , 70 , 71 , 72 , 73 , 74 , 75 , 76 , 77 , 78 , 79 , 80 , 81 , 82 , 83 , 84 , 85 ].

Table 2 summarizes the papers included in the present scoping review, and Table  3 describes the characteristics of the included studies.

The thematic analysis resulted in two themes: (1) the organization of feedback processes in WBL settings, and (2) sociocultural factors influencing the organization of feedback processes. Table 4 gives a summary of the themes and subthemes.

Organization of feedback processes in WBL settings.

Setting learning goals (i.e., feed-up dimension).

Feedback that focuses on students' learning needs and is based on known performance standards enhances student response and setting learning goals [ 30 ]. Discussing goals and agreements before starting clinical practice enhances students' feedback-seeking behavior [ 39 ] and responsiveness to feedback [ 83 ]. Farrell et al. (2017) found that teacher-learner co-constructed learning goals enhance feedback interactions and help establish educational alliances, improving the learning experience [ 50 ]. However, Kiger (2020) found that sharing individualized learning plans with teachers aligned feedback with learning goals but did not improve students' perceived use of feedback [ 64 ]

Two papers of this set pointed out the importance of goal-oriented feedback, a dynamic process that depends on discussion of goal setting between teachers and students [ 50 ] and influences how individuals experience, approach, and respond to upcoming learning activities [ 34 ]. Goal-oriented feedback should be embedded in the learning experience of the clinical workplace, as it can enhance students' engagement in safe feedback dialogues [ 50 ]. Ideally, each feedback encounter in the WBL context should conclude, in addition to setting a plan of action to achieve the desired goal, with a reflection on the next goal [ 50 ].

Feedback strategies within the WBL environment. (i.e., feedback dimension)

In undergraduate WBL environments, there are several tasks and feedback opportunities organized in the undergraduate clinical workplace that can enable feedback processes:

Questions from clinical teachers to students are a feedback strategy [ 74 ]. There are different types of questions that the teacher can use, either to clarify concepts, to reach the correct answer, or to facilitate self-correction [ 74 ]. Usually, questions can be used in conjunction with other communication strategies, such as pauses, which enable self-correction by the student [ 74 ]. Students can also ask questions to obtain feedback on their performance [ 54 ]. However, question-and-answer as a feedback strategy usually provides information on either correct or incorrect answers and fewer suggestions for improvement, rendering it less constructive as a feedback strategy [ 82 ].

Direct observation of performance by default is needed to be able to provide information to be used as input in the feedback process [ 33 , 46 , 49 , 86 ]. In the process of observation, teachers can include clarification of objectives (i.e., feed-up dimension) and suggestions for an action plan (i.e., feedforward) [ 50 ]. Accordingly, Schopper et al. (2016) showed that students valued being observed while interviewing patients, as they received feedback that helped them become more efficient and effective as interviewers and communicators [ 33 ]. Moreover, it is widely described that direct observation improves feedback credibility [ 33 , 40 , 84 ]. Ideally, observation should be deliberate [ 33 , 83 ], informal or spontaneous [ 33 ], conducted by a (clinical) expert [ 46 , 86 ], provided immediately after the observation, and clinical teacher if possible, should schedule or be alert on follow-up observations to promote closing the gap between current and desired performance [ 46 ].

Workplace-based assessments (WBAs), by definition, entail direct observation of performance during authentic task demonstration [ 39 , 46 , 56 , 87 ]. WBAs can significantly impact behavioral change in medical students [ 55 ]. Organizing and designing formative WBAs and embedding these in a feedback dialogue is essential for effective learning [ 31 ].

Summative organization of WBAs is a well described barrier for feedback uptake in the clinical workplace [ 35 , 46 ]. If feedback is perceived as summative, or organized as a pass-fail decision, students may be less inclined to use the feedback for future learning [ 52 ]. According to Schopper et al. (2016), using a scale within a WBA makes students shift their focus during the clinical interaction and see it as an assessment with consequences [ 33 ]. Harrison et al. (2016) pointed out that an environment that only contains assessments with a summative purpose will not lead to a culture of learning and improving performance [ 56 ]. The recommendation is to separate the formative and summative WBAs, as feedback in summative instances is often not recognized as a learning opportunity or an instance to seek feedback [ 54 ]. In terms of the design, an organizational format is needed to clarify to students how formative assessments can promote learning from feedback [ 56 ]. Harrison et al. (2016) identified that enabling students to have more control over their assessments, designing authentic assessments, and facilitating long-term mentoring could improve receptivity to formative assessment feedback [ 56 ].

Multiple WBA instruments and systems are reported in the literature. Sox et al. (2014) used a detailed evaluation form to help students improve their clinical case presentation skills. They found that feedback on oral presentations provided by supervisors using a detailed evaluation form improved clerkship students’ oral presentation skills [ 78 ]. Daelmans et al. (2006) suggested that a formal in-training assessment programme composed by 19 assessments that provided structured feedback, could promote observation and verbal feedback opportunities through frequent assessments [ 43 ]. However, in this setting, limited student-staff interactions still hindered feedback follow-up [ 43 ]. Designing frequent WBA improves feedback credibility [ 28 ]. Long et al. (2021) emphasized that students' responsiveness to assessment feedback hinges on its perceived credibility, underlining the importance of credibility for students to effectively engage and improve their performance [ 31 ].

The mini-CEX is one of the most widely described WBA instruments in the literature. Students perceive that the mini-CEX allows them to be observed and encourages the development of interviewing skills [ 33 ]. The mini-CEX can provide feedback that improves students' clinical skills [ 58 , 60 ], as it incorporates a structure for discussing the student's strengths and weaknesses and the design of a written action plan [ 39 , 80 ]. When mini-CEXs are incorporated as part of a system of WBA, such as programmatic assessment, students feel confident in seeking feedback after observation, and being systematic allows for follow-up [ 39 ]. Students suggested separating grading from observation and using the mini-CEX in more informal situations [ 33 ].

Clinical encounter cards allow students to receive weekly feedback and make them request more feedback as the clerkship progresses [ 65 ]. Moreover, encounter cards stimulate that feedback is given by supervisors, and students are more satisfied with the feedback process [ 72 ]. With encounter card feedback, students are responsible for asking a supervisor for feedback before a clinical encounter, and supervisors give students written and verbal comments about their performance after the encounter [ 42 , 72 ]. Encounter cards enhance the use of feedback and add approximately one minute to the length of the clinical encounter, so they are well accepted by students and supervisors [ 72 ]. Bennett (2006) identified that Instant Feedback Cards (IFC) facilitated mid-rotation feedback [ 38 ]. Feedback encounter card comments must be discussed between students and supervisors; otherwise, students may perceive it as impersonal, static, formulaic, and incomplete [ 59 ].

Self-assessments can change students' feedback orientation, transforming them into coproducers of learning [ 68 ]. Self-assessments promote the feedback process [ 68 ]. Some articles emphasize the importance of organizing self-assessments before receiving feedback from supervisors, for example, discussing their appraisal with the supervisor [ 46 , 52 ]. In designing a feedback encounter, starting with a self-assessment as feed-up, discussing with the supervisor, and identifying areas for improvement is recommended, as part of the feedback dialogue [ 68 ].

Peer feedback as an organized activity allows students to develop strategies to observe and give feedback to other peers [ 61 ]. Students can act as the feedback provider or receiver, fostering understanding of critical comments and promoting evaluative judgment for their clinical practice [ 61 ]. Within clerkships, enabling the sharing of feedback information among peers allows for a better understanding and acceptance of feedback [ 52 ]. However, students can find it challenging to take on the peer assessor/feedback provider role, as they prefer to avoid social conflicts [ 28 , 61 ]. Moreover, it has been described that they do not trust the judgment of their peers because they are not experts, although they know the procedures, tasks, and steps well and empathize with their peer status in the learning process [ 61 ].

Bedside-teaching encounters (BTEs) provide timely feedback and are an opportunity for verbal feedback during performance [ 74 ]. Rizan et al. (2014) explored timely feedback delivered within BTEs and determined that it promotes interaction that constructively enhances learner development through various corrective strategies (e.g., question and answers, pauses, etc.). However, if the feedback given during the BTEs was general, unspecific, or open-ended, it could go unnoticed [ 74 ]. Torre et al. (2005) investigated which integrated feedback activities and clinical tasks occurred on clerkship rotations and assessed students' perceived quality in each teaching encounter [ 81 ]. The feedback activities reported were feedback on written clinical history, physical examination, differential diagnosis, oral case presentation, a daily progress note, and bedside feedback. Students considered all these feedback activities high-quality learning opportunities, but they were more likely to receive feedback when teaching was at the bedside than at other teaching locations [ 81 ].

Case presentations are an opportunity for feedback within WBL contexts [ 67 , 73 ]. However, both students and supervisors struggled to identify them as feedback moments, and they often dismissed questions and clarifications around case presentations as feedback [ 73 ]. Joshi (2017) identified case presentations as a way for students to ask for informal or spontaneous supervisor feedback [ 63 ].

Organization of follow-up feedback and action plans (i.e., feedforward dimension).

Feedback that generates use and response from students is characterized by two-way communication and embedded in a dialogue [ 30 ]. Feedback must be future-focused [ 29 ], and a feedback encounter should be followed by planning the next observation [ 46 , 87 ]. Follow-up feedback could be organized as a future self-assessment, reflective practice by the student, and/or a discussion with the supervisor or coach [ 68 ]. The literature describes that a lack of student interaction with teachers makes follow-up difficult [ 43 ]. According to Haffling et al. (2011), follow-up feedback sessions improve students' satisfaction with feedback compared to students who do not have follow-up sessions. In addition, these same authors reported that a second follow-up session allows verification of improved performances or confirmation that the skill was acquired [ 55 ].

Although feedback encounter forms are a recognized way of obtaining information about performance (i.e., feedback dimension), the literature does not provide many clear examples of how they may impact the feedforward phase. For example, Joshi et al. (2016) consider a feedback form with four fields (i.e., what did you do well, advise the student on what could be done to improve performance, indicate the level of proficiency, and personal details of the tutor). In this case, the supervisor highlighted what the student could improve but not how, which is the missing phase of the co-constructed action plan [ 63 ]. Whichever WBA instrument is used in clerkships to provide feedback, it should include a "next steps" box [ 44 ], and it is recommended to organize a long-term use of the WBA instrument so that those involved get used to it and improve interaction and feedback uptake [ 55 ]. RIME-based feedback (Reporting, Interpreting, Managing, Educating) is considered an interesting example, as it is perceived as helpful to students in knowing what they need to improve in their performance [ 44 ]. Hochberg (2017) implemented formative mid-clerkship assessments to enhance face-to-face feedback conversations and co-create an improvement plan [ 59 ]. Apps for structuring and storing feedback improve the amount of verbal and written feedback. In the study of Joshi et al. (2016), a reasonable proportion of students (64%) perceived that these app tools help them improve their performance during rotations [ 63 ].

Several studies indicate that an action plan as part of the follow-up feedback is essential for performance improvement and learning [ 46 , 55 , 60 ]. An action plan corresponds to an agreed-upon strategy for improving, confirming, or correcting performance. Bing-You et al. (2017) determined that only 12% of the articles included in their scoping review incorporated an action plan for learners [ 32 ]. Holmboe et al. (2004) reported that only 11% of the feedback sessions following a mini-CEX included an action plan [ 60 ]. Suhoyo et al. (2017) also reported that only 55% of mini-CEX encounters contained an action plan [ 80 ]. Other authors reported that action plans are not commonly offered during feedback encounters [ 77 ]. Sokol-Hessner et al. (2010) implemented feedback card comments with a space to provide written feedback and a specific action plan. In their results, 96% contained positive comments, and only 5% contained constructive comments [ 77 ]. In summary, although the recommendation is to include a “next step” box in the feedback instruments, evidence shows these items are not often used for constructive comments or action plans.

Sociocultural factors influencing the organization of feedback processes.

Multiple sociocultural factors influence interaction in feedback encounters, promoting or hampering the productivity of the feedback processes.

Clinical learning culture

Context impacts feedback processes [ 30 , 82 ], and there are barriers to incorporating actionable feedback in the clinical learning context. The clinical learning culture is partly determined by the clinical context, which can be unpredictable [ 29 , 46 , 68 ], as the available patients determine learning opportunities. Supervisors are occupied by a high workload, which results in limited time or priority for teaching [ 35 , 46 , 48 , 55 , 68 , 83 ], hindering students’ feedback-seeking behavior [ 54 ], and creating a challenge for the balance between patient care and student mentoring [ 35 ].

Clinical workplace culture does not always purposefully prioritize instances for feedback processes [ 83 , 84 ]. This often leads to limited direct observation [ 55 , 68 ] and the provision of poorly informed feedback. It is also evident that this affects trust between clinical teachers and students [ 52 ]. Supervisors consider feedback a low priority in clinical contexts [ 35 ] due to low compensation and lack of protected time [ 83 ]. In particular, lack of time appears to be the most significant and well-known barrier to frequent observation and workplace feedback [ 35 , 43 , 48 , 62 , 67 , 83 ].

The clinical environment is hierarchical [ 68 , 80 ] and can make students not consider themselves part of the team and feel like a burden to their supervisor [ 68 ]. This hierarchical learning environment can lead to unidirectional feedback, limit dialogue during feedback processes, and hinder the seeking, uptake, and use of feedback [ 67 , 68 ]. In a learning culture where feedback is not supported, learners are less likely to want to seek it and feel motivated and engaged in their learning [ 83 ]. Furthermore, it has been identified that clinical supervisors lack the motivation to teach [ 48 ] and the intention to observe or reobserve performance [ 86 ].

In summary, the clinical context and WBL culture do not fully use the potential of a feedback process aimed at closing learning gaps. However, concrete actions shown in the literature can be taken to improve the effectiveness of feedback by organizing the learning context. For example, McGinness et al. (2022) identified that students felt more receptive to feedback when working in a safe, nonjudgmental environment [ 67 ]. Moreover, supervisors and trainees identified the learning culture as key to establishing an open feedback dialogue [ 73 ]. Students who perceive culture as supportive and formative can feel more comfortable performing tasks and more willing to receive feedback [ 73 ].

Relationships

There is a consensus in the literature that trusting and long-term relationships improve the chances of actionable feedback. However, relationships between supervisors and students in the clinical workplace are often brief and not organized as more longitudinally [ 68 , 83 ], leaving little time to establish a trustful relationship [ 68 ]. Supervisors change continuously, resulting in short interactions that limit the creation of lasting relationships over time [ 50 , 68 , 83 ]. In some contexts, it is common for a student to have several supervisors who have their own standards in the observation of performance [ 46 , 56 , 68 , 83 ]. A lack of stable relationships results in students having little engagement in feedback [ 68 ]. Furthermore, in case of summative assessment programmes, the dual role of supervisors (i.e., assessing and giving feedback) makes feedback interactions perceived as summative and can complicate the relationship [ 83 ].

Repeatedly, the articles considered in this review describe that long-term and stable relationships enable the development of trust and respect [ 35 , 62 ] and foster feedback-seeking behavior [ 35 , 67 ] and feedback-giver behavior [ 39 ]. Moreover, constructive and positive relationships enhance students´ use of and response to feedback [ 30 ]. For example, Longitudinal Integrated Clerkships (LICs) promote stable relationships, thus enhancing the impact of feedback [ 83 ]. In a long-term trusting relationship, feedback can be straightforward and credible [ 87 ], there are more opportunities for student observation, and the likelihood of follow-up and actionable feedback improves [ 83 ]. Johnson et al. (2020) pointed out that within a clinical teacher-student relationship, the focus must be on establishing psychological safety; thus, the feedback conversations might be transformed [ 62 ].

Stable relationships enhance feedback dialogues, which offer an opportunity to co-construct learning and propose and negotiate aspects of the design of learning strategies [ 62 ].

Students as active agents in the feedback processes

The feedback response learners generate depends on the type of feedback information they receive, how credible the source of feedback information is, the relationship between the receiver and the giver, and the relevance of the information delivered [ 49 ]. Garino (2020) noted that students who are most successful in using feedback are those who do not take criticism personally, who understand what they need to improve and know they can do so, who value and feel meaning in criticism, are not surprised to receive it, and who are motivated to seek new feedback and use effective learning strategies [ 52 ]. Successful users of feedback ask others for help, are intentional about their learning, know what resources to use and when to use them, listen to and understand a message, value advice, and use effective learning strategies. They regulate their emotions, find meaning in the message, and are willing to change [ 52 ].

Student self-efficacy influences the understanding and use of feedback in the clinical workplace. McGinness et al. (2022) described various positive examples of self-efficacy regarding feedback processes: planning feedback meetings with teachers, fostering good relationships with the clinical team, demonstrating interest in assigned tasks, persisting in seeking feedback despite the patient workload, and taking advantage of opportunities for feedback, e.g., case presentations [ 67 ].

When students are encouraged to seek feedback aligned with their own learning objectives, they promote feedback information specific to what they want to learn and improve and enhance the use of feedback [ 53 ]. McGinness et al. (2022) identified that the perceived relevance of feedback information influenced the use of feedback because students were more likely to ask for feedback if they perceived that the information was useful to them. For example, if students feel part of the clinical team and participate in patient care, they are more likely to seek feedback [ 17 ].

Learning-oriented students aim to seek feedback to achieve clinical competence at the expected level [ 75 ]; they focus on improving their knowledge and skills and on professional development [ 17 ]. Performance-oriented students aim not to fail and to avoid negative feedback [ 17 , 75 ].

For effective feedback processes, including feed-up, feedback, and feedforward, the student must be feedback-oriented, i.e., active, seeking, listening to, interpreting, and acting on feedback [ 68 ]. The literature shows that feedback-oriented students are coproducers of learning [ 68 ] and are more involved in the feedback process [ 51 ]. Additionally, students who are metacognitively aware of their learning process are more likely to use feedback to reduce gaps in learning and performance [ 52 ]. For this, students must recognize feedback when it occurs and understand it when they receive it. Thus, it is important to organize training and promote feedback literacy so that students understand what feedback is, act on it, and improve the quality of feedback and their learning plans [ 68 ].

Table 5 summarizes those feedback tasks, activities, and key features of organizational aspects that enable each phase of the feedback loop based on the literature review.

The present scoping review identified 61 papers that mapped the literature on feedback processes in the WBL environments of undergraduate health professions. This review explored how feedback processes are organized in these learning contexts using the feedback loop framework. Given the specific characteristics of feedback processes in undergraduate clinical learning, three main findings were identified on how feedback processes are being conducted in the clinical environment and how these processes could be organized to support feedback processes.

First, the literature lacks a balance between the three dimensions of the feedback loop. In this regard, most of the articles in this review focused on reporting experiences or strategies for delivering feedback information (i.e., feedback dimension). Credible and objective feedback information is based on direct observation [ 46 ] and occurs within an interaction or a dialogue [ 62 , 88 ]. However, only having credible and objective information does not ensure that it will be considered, understood, used, and put into practice by the student [ 89 ].

Feedback-supporting actions aligned with goals and priorities facilitate effective feedback processes [ 89 ] because goal-oriented feedback focuses on students' learning needs [ 7 ]. In contrast, this review showed that only a minority of the studies highlighted the importance of aligning learning objectives and feedback (i.e., the feed-up dimension). To overcome this, supervisors and students must establish goals and agreements before starting clinical practice, as it allows students to measure themselves on a defined basis [ 90 , 91 ] and enhances students' feedback-seeking behavior [ 39 , 92 ] and responsiveness to feedback [ 83 ]. In addition, learning goals should be shared, and co-constructed, through a dialogue [ 50 , 88 , 90 , 92 ]. In fact, relationship-based feedback models emphasize setting shared goals and plans as part of the feedback process [ 68 ].

Many of the studies acknowledge the importance of establishing an action plan and promoting the use of feedback (i.e., feedforward). However, there is yet limited insight on how to best implement strategies that support the use of action plans, improve performance and close learning gaps. In this regard, it is described that delivering feedback without perceiving changes, results in no effect or impact on learning [ 88 ]. To determine if a feedback loop is closed, observing a change in the student's response is necessary. In other words, feedback does not work without repeating the same task [ 68 ], so teachers need to observe subsequent tasks to notice changes [ 88 ]. While feedforward is fundamental to long-term performance, it is shown that more research is needed to determine effective actions to be implemented in the WBL environment to close feedback loops.

Second, there is a need for more knowledge about designing feedback activities in the WBL environment that will generate constructive feedback for learning. WBA is the most frequently reported feedback activity in clinical workplace contexts [ 39 , 46 , 56 , 87 ]. Despite the efforts of some authors to use WBAs as a formative assessment and feedback opportunity, in several studies, a summative component of the WBA was presented as a barrier to actionable feedback [ 33 , 56 ]. Students suggest separating grading from observation and using, for example, the mini-CEX in informal situations [ 33 ]. Several authors also recommend disconnecting the summative components of WBAs to avoid generating emotions that can limit the uptake and use of feedback [ 28 , 93 ]. Other literature recommends purposefully designing a system of assessment using low-stakes data points for feedback and learning. Accordingly, programmatic assessment is a framework that combines both the learning and the decision-making function of assessment [ 94 , 95 ]. Programmatic assessment is a practical approach for implementing low-stakes as a continuum, giving opportunities to close the gap between current and desired performance and having the student as an active agent [ 96 ]. This approach enables the incorporation of low-stakes data points that target student learning [ 93 ] and provide performance-relevant information (i.e., meaningful feedback) based on direct observations during authentic professional activities [ 46 ]. Using low-stakes data points, learners make sense of information about their performance and use it to enhance the quality of their work or performance [ 96 , 97 , 98 ]. Implementing multiple instances of feedback is more effective than providing it once because it promotes closing feedback loops by giving the student opportunities to understand the feedback, make changes, and see if those changes were effective [ 89 ].

Third, the support provided by the teacher is fundamental and should be built into a reliable and long-term relationship, where the teacher must take the role of coach rather than assessor, and students should develop feedback agency and be active in seeking and using feedback to improve performance. Although it is recognized that institutional efforts over the past decades have focused on training teachers to deliver feedback, clinical supervisors' lack of teaching skills is still identified as a barrier to workplace feedback [ 99 ]. In particular, research indicates that clinical teachers lack the skills to transform the information obtained from an observation into constructive feedback [ 100 ]. Students are more likely to use feedback if they consider it credible and constructive [ 93 ] and based on stable relationships [ 93 , 99 , 101 ]. In trusting relationships, feedback can be straightforward and credible, and the likelihood of follow-up and actionable feedback improves [ 83 , 88 ]. Coaching strategies can be enhanced by teachers building an educational alliance that allows for trustworthy relationships or having supervisors with an exclusive coaching role [ 14 , 93 , 102 ].

Last, from a sociocultural perspective, individuals are the main actors in the learning process. Therefore, feedback impacts learning only if students engage and interact with it [ 11 ]. Thus, feedback design and student agency appear to be the main features of effective feedback processes. Accordingly, the present review identified that feedback design is a key feature for effective learning in complex environments such as WBL. Feedback in the workplace must ideally be organized and implemented to align learning outcomes, learning activities, and assessments, allowing learners to learn, practice, and close feedback loops [ 88 ]. To guide students toward performances that reflect long-term learning, an intensive formative learning phase is needed, in which multiple feedback processes are included that shape students´ further learning [ 103 ]. This design would promote student uptake of feedback for subsequent performance [ 1 ].

Strengths and limitations

The strengths of this study are (1) the use of an established framework, the Arksey and O'Malley's framework [ 22 ]. We included the step of socializing the results with stakeholders, which allowed the team to better understand the results from another perspective and offer a realistic look. (2) Using the feedback loop as a theoretical framework strengthened the results and gave a more thorough explanation of the literature regarding feedback processes in the WBL context. (3) our team was diverse and included researchers from different disciplines as well as a librarian.

The present scoping review has several limitations. Although we adhered to the recommended protocols and methodologies, some relevant papers may have been omitted. The research team decided to select original studies and reviews of the literature for the present scoping review. This caused some articles, such as guidelines, perspectives, and narrative papers, to be excluded from the current study.

One of the inclusion criteria was a focus on undergraduate students. However, some papers that incorporated undergraduate and postgraduate participants were included, as these supported the results of this review. Most articles involved medical students. Although the authors did not limit the search to medicine, maybe some articles involving students from other health disciplines needed to be included, considering the search in other databases or journals.

The results give insight in how feedback could be organized within the clinical workplace to promote feedback processes. On a small scale, i.e., in the feedback encounter between a supervisor and a learner, feedback should be organized to allow for follow-up feedback, thus working on required learning and performance goals. On a larger level, i.e., in the clerkship programme or a placement rotation, feedback should be organized through appropriate planning of subsequent tasks and activities.

More insight is needed in designing a closed loop feedback process, in which specific attention is needed in effective feedforward practices. The feedback that stimulates further action and learning requires a safe and trustful work and learning environment. Understanding the relationship between an individual and his or her environment is a challenge for determining the impact of feedback and must be further investigated within clinical WBL environments. Aligning the dimensions of feed-up, feedback and feedforward includes careful attention to teachers’ and students’ feedback literacy to assure that students can act on feedback in a constructive way. In this line, how to develop students' feedback agency within these learning environments needs further research.

Boud D, Molloy E. Rethinking models of feedback for learning: The challenge of design. Assess Eval High Educ. 2013;38:698–712.

Article   Google Scholar  

Henderson M, Ajjawi R, Boud D, Molloy E. Identifying feedback that has impact. In: The Impact of Feedback in Higher Education. Springer International Publishing: Cham; 2019. p. 15–34.

Chapter   Google Scholar  

Winstone N, Carless D. Designing effective feedback processes in higher education: A learning-focused approach. 1st ed. New York: Routledge; 2020.

Google Scholar  

Ajjawi R, Boud D. Assessment & Evaluation in Higher Education Researching feedback dialogue: an interactional analysis approach. 2015. https://doi.org/10.1080/02602938.2015.1102863 .

Carless D. Feedback loops and the longer-term: towards feedback spirals. Assess Eval High Educ. 2019;44:705–14.

Sadler DR. Formative assessment and the design of instructional systems. Instr Sci. 1989;18:119–44.

Hattie J, Timperley H. The Power of Feedback The Meaning of Feedback. Rev Educ Res. 2007;77:81–112.

Zarrinabadi N, Rezazadeh M. Why only feedback? Including feed up and feed forward improves nonlinguistic aspects of L2 writing. Language Teaching Research. 2023;27(3):575–92.

Fisher D, Frey N. Feed up, back, forward. Educ Leadersh. 2009;67:20–5.

Reimann A, Sadler I, Sambell K. What’s in a word? Practices associated with ‘feedforward’ in higher education. Assessment evaluation in higher education. 2019;44:1279–90.

Esterhazy R. Re-conceptualizing Feedback Through a Sociocultural Lens. In: Henderson M, Ajjawi R, Boud D, Molloy E, editors. The Impact of Feedback in Higher Education. Cham: Palgrave Macmillan; 2019. https://doi.org/10.1007/978-3-030-25112-3_5 .

Bransen D, Govaerts MJB, Sluijsmans DMA, Driessen EW. Beyond the self: The role of co-regulation in medical students’ self-regulated learning. Med Educ. 2020;54:234–41.

Ramani S, Könings KD, Ginsburg S, Van Der Vleuten CP. Feedback Redefined: Principles and Practice. J Gen Intern Med. 2019;34:744–53.

Atkinson A, Watling CJ, Brand PL. Feedback and coaching. Eur J Pediatr. 2022;181(2):441–6.

Suhoyo Y, Schonrock-Adema J, Emilia O, Kuks JBM, Cohen-Schotanus JA. Clinical workplace learning: perceived learning value of individual and group feedback in a collectivistic culture. BMC Med Educ. 2018;18:79.

Bowen L, Marshall M, Murdoch-Eaton D. Medical Student Perceptions of Feedback and Feedback Behaviors Within the Context of the “Educational Alliance.” Acad Med. 2017;92:1303–12.

Bok HGJ, Teunissen PW, Spruijt A, Fokkema JPI, van Beukelen P, Jaarsma DADC, et al. Clarifying students’ feedback-seeking behaviour in clinical clerkships. Med Educ. 2013;47:282–91.

Al-Kadri HM, Al-Kadi MT, Van Der Vleuten CPM. Workplace-based assessment and students’ approaches to learning: A qualitative inquiry. Med Teach. 2013;35(SUPPL):1.

Dennis AA, Foy MJ, Monrouxe LV, Rees CE. Exploring trainer and trainee emotional talk in narratives about workplace-based feedback processes. Adv Health Sci Educ. 2018;23:75–93.

Watling C, LaDonna KA, Lingard L, Voyer S, Hatala R. ‘Sometimes the work just needs to be done’: socio-cultural influences on direct observation in medical training. Med Educ. 2016;50:1054–64.

Bing-You R, Hayes V, Varaklis K, Trowbridge R, Kemp H, McKelvy D. Feedback for Learners in Medical Education: What is Known? A Scoping Review Academic Medicine. 2017;92:1346–54.

Arksey H, O’Malley L. Scoping studies: towards a methodological framework. Int J Soc Res Methodol. 2005;8:19–32.

Tricco AC, Lillie E, Zarin W, O’Brien KK, Colquhoun H, Levac D, et al. PRISMA extension for scoping reviews (PRISMA-ScR): Checklist and explanation. Ann Intern Med. 2018;169:467–73.

Colquhoun HL, Levac D, O’brien KK, Straus S, Tricco AC, Perrier L, et al. Scoping reviews: time for clarity in definition methods and reporting. J Clin Epidemiol. 2014;67:1291–4.

StArt - State of Art through Systematic Review. 2013.

Levac D, Colquhoun H, O’Brien KK. Scoping studies: Advancing the methodology. Implementation Science. 2010;5:1–9.

Peters MDJ, BPharm CMGHK, Parker PMD, Soares CB. Guidance for conducting systematic scoping reviews. Int J Evid Based Healthc. 2015;13:141–6.

Bing-You R, Varaklis K, Hayes V, Trowbridge R, Kemp H, McKelvy D, et al. The Feedback Tango: An Integrative Review and Analysis of the Content of the Teacher-Learner Feedback Exchange. Acad Med. 2018;93:657–63.

Ossenberg C, Henderson A, Mitchell M. What attributes guide best practice for effective feedback? A scoping review. Adv Health Sci Educ. 2019;24:383–401.

Spooner M, Duane C, Uygur J, Smyth E, Marron B, Murphy PJ, et al. Self -regulatory learning theory as a lens on how undergraduate and postgraduate learners respond to feedback: A BEME scoping review: BEME Guide No. 66. Med Teach. 2022;44:3–18.

Long S, Rodriguez C, St-Onge C, Tellier PP, Torabi N, Young M. Factors affecting perceived credibility of assessment in medical education: A scoping review. Adv Health Sci Educ. 2022;27:229–62.

Bing-You R, Hayes V, Varaklis K, Trowbridge R, Kemp H, McKelvy D. Feedback for Learners in Medical Education: What is Known? A Scoping Review: Lippincott Williams and Wilkins; 2017.

Schopper H, Rosenbaum M, Axelson R. “I wish someone watched me interview:” medical student insight into observation and feedback as a method for teaching communication skills during the clinical years. BMC Med Educ. 2016;16:286.

Crommelinck M, Anseel F. Understanding and encouraging feedback-seeking behaviour: a literature review. Med Educ. 2013;47:232–41.

Adamson E, Kinga L, Foy L, McLeodb M, Traynor J, Watson W, et al. Feedback in clinical practice: Enhancing the students’ experience through action research. Nurse Educ Pract. 2018;31:48–53.

Al-Mously N, Nabil NM, Al-Babtain SA, et al. Undergraduate medical students’ perceptions on the quality of feedback received during clinical rotations. Med Teach. 2014;36(Supplement 1):S17-23.

Bates J, Konkin J, Suddards C, Dobson S, Pratt D. Student perceptions of assessment and feedback in longitudinal integrated clerkships. Med Educ. 2013;47:362–74.

Bennett AJ, Goldenhar LM, Stanford K. Utilization of a Formative Evaluation Card in a Psychiatry Clerkship. Acad Psychiatry. 2006;30:319–24.

Bok HG, Jaarsma DA, Spruijt A, Van Beukelen P, Van Der Vleuten CP, Teunissen PW, et al. Feedback-giving behaviour in performance evaluations during clinical clerkships. Med Teach. 2016;38:88–95.

Bok HG, Teunissen PW, Spruijt A, Fokkema JP, van Beukelen P, Jaarsma DA, et al. Clarifying students’ feedback-seeking behaviour in clinical clerkships. Med Educ. 2013;47:282–91.

Calleja P, Harvey T, Fox A, Carmichael M, et al. Feedback and clinical practice improvement: A tool to assist workplace supervisors and students. Nurse Educ Pract. 2016;17:167–73.

Carey EG, Wu C, Hur ES, Hasday SJ, Rosculet NP, Kemp MT, et al. Evaluation of Feedback Systems for the Third-Year Surgical Clerkship. J Surg Educ. 2017;74:787–93.

Daelmans HE, Overmeer RM, Van der Hem-Stokroos HH, Scherpbier AJ, Stehouwer CD, van der Vleuten CP. In-training assessment: qualitative study of effects on supervision and feedback in an undergraduate clinical rotation. Medical education. 2006;40(1):51–8.

DeWitt D, Carline J, Paauw D, Pangaro L. Pilot study of a ’RIME’-based tool for giving feedback in a multi-specialty longitudinal clerkship. Med Educ. 2008;42:1205–9.

Dolan BM, O’Brien CL, Green MM. Including Entrustment Language in an Assessment Form May Improve Constructive Feedback for Student Clinical Skills. Med Sci Educ. 2017;27:461–4.

Duijn CC, Welink LS, Mandoki M, Ten Cate OT, Kremer WD, Bok HG. Am I ready for it? Students’ perceptions of meaningful feedback on entrustable professional activities. Perspectives on medical education. 2017;6:256–64.

Elnicki DM, Zalenski D. Integrating medical students’ goals, self-assessment and preceptor feedback in an ambulatory clerkship. Teach Learn Med. 2013;25:285–91.

Embo MP, Driessen EW, Valcke M, Van der Vleuten CP. Assessment and feedback to facilitate self-directed learning in clinical practice of Midwifery students. Medical teacher. 2010;32(7):e263-9.

Eva KW, Armson H, Holmboe E, Lockyer J, Loney E, Mann K, et al. Factors influencing responsiveness to feedback: On the interplay between fear, confidence, and reasoning processes. Adv Health Sci Educ. 2012;17:15–26.

Farrell L, Bourgeois-Law G, Ajjawi R, Regehr G. An autoethnographic exploration of the use of goal oriented feedback to enhance brief clinical teaching encounters. Adv Health Sci Educ. 2017;22:91–104.

Fernando N, Cleland J, McKenzie H, Cassar K. Identifying the factors that determine feedback given to undergraduate medical students following formative mini-CEX assessments. Med Educ. 2008;42:89–95.

Garino A. Ready, willing and able: a model to explain successful use of feedback. Adv Health Sci Educ. 2020;25:337–61.

Garner MS, Gusberg RJ, Kim AW. The positive effect of immediate feedback on medical student education during the surgical clerkship. J Surg Educ. 2014;71:391–7.

Bing-You R, Hayes V, Palka T, Ford M, Trowbridge R. The Art (and Artifice) of Seeking Feedback: Clerkship Students’ Approaches to Asking for Feedback. Acad Med. 2018;93:1218–26.

Haffling AC, Beckman A, Edgren G. Structured feedback to undergraduate medical students: 3 years’ experience of an assessment tool. Medical teacher. 2011;33(7):e349-57.

Harrison CJ, Könings KD, Dannefer EF, Schuwirth LWTT, Wass V, van der Vleuten CPMM. Factors influencing students’ receptivity to formative feedback emerging from different assessment cultures. Perspect Med Educ. 2016;5:276–84.

Harrison CJ, Könings KD, Schuwirth LW, Wass V, Van der Vleuten CP, Konings KD, et al. Changing the culture of assessment: the dominance of the summative assessment paradigm. BMC medical education. 2017;17:1–4.

Harvey P, Radomski N, O’Connor D. Written feedback and continuity of learning in a geographically distributed medical education program. Medical teacher. 2013;35(12):1009–13.

Hochberg M, Berman R, Ogilvie J, Yingling S, Lee S, Pusic M, et al. Midclerkship feedback in the surgical clerkship: the “Professionalism, Reporting, Interpreting, Managing, Educating, and Procedural Skills” application utilizing learner self-assessment. Am J Surg. 2017;213:212–6.

Holmboe ES, Yepes M, Williams F, Huot SJ. Feedback and the mini clinical evaluation exercise. Journal of general internal medicine. 2004;19(5):558–61.

Tai JHM, Canny BJ, Haines TP, Molloy EK. The role of peer-assisted learning in building evaluative judgement: opportunities in clinical medical education. Adv Health Sci Educ. 2016;21:659–76.

Johnson CE, Keating JL, Molloy EK. Psychological safety in feedback: What does it look like and how can educators work with learners to foster it? Med Educ. 2020;54:559–70.

Joshi A, Generalla J, Thompson B, Haidet P. Facilitating the Feedback Process on a Clinical Clerkship Using a Smartphone Application. Acad Psychiatry. 2017;41:651–5.

Kiger ME, Riley C, Stolfi A, Morrison S, Burke A, Lockspeiser T. Use of Individualized Learning Plans to Facilitate Feedback Among Medical Students. Teach Learn Med. 2020;32:399–409.

Kogan J, Shea J. Implementing feedback cards in core clerkships. Med Educ. 2008;42:1071–9.

Lefroy J, Walters B, Molyneux A, Smithson S. Can learning from workplace feedback be enhanced by reflective writing? A realist evaluation in UK undergraduate medical education. Educ Prim Care. 2021;32:326–35.

McGinness HT, Caldwell PHY, Gunasekera H, Scott KM. ‘Every Human Interaction Requires a Bit of Give and Take’: Medical Students’ Approaches to Pursuing Feedback in the Clinical Setting. Teach Learn Med. 2022. https://doi.org/10.1080/10401334.2022.2084401 .

Noble C, Billett S, Armit L, Collier L, Hilder J, Sly C, et al. ``It’s yours to take{’’}: generating learner feedback literacy in the workplace. Adv Health Sci Educ. 2020;25:55–74.

Ogburn T, Espey E. The R-I-M-E method for evaluation of medical students on an obstetrics and gynecology clerkship. Am J Obstet Gynecol. 2003;189:666–9.

Po O, Reznik M, Greenberg L. Improving a medical student feedback with a clinical encounter card. Ambul Pediatr. 2007;7:449–52.

Parkes J, Abercrombie S, McCarty T, Parkes J, Abercrombie S, McCarty T. Feedback sandwiches affect perceptions but not performance. Adv Health Sci Educ. 2013;18:397–407.

Paukert JL, Richards ML, Olney C. An encounter card system for increasing feedback to students. Am J Surg. 2002;183:300–4.

Rassos J, Melvin LJ, Panisko D, Kulasegaram K, Kuper A. Unearthing Faculty and Trainee Perspectives of Feedback in Internal Medicine: the Oral Case Presentation as a Model. J Gen Intern Med. 2019;34:2107–13.

Rizan C, Elsey C, Lemon T, Grant A, Monrouxe L. Feedback in action within bedside teaching encounters: a video ethnographic study. Med Educ. 2014;48:902–20.

Robertson AC, Fowler LC. Medical student perceptions of learner-initiated feedback using a mobile web application. Journal of medical education and curricular development. 2017;4:2382120517746384.

Scheidt PC, Lazoritz S, Ebbeling WL, Figelman AR, Moessner HF, Singer JE. Evaluation of system providing feedback to students on videotaped patient encounters. J Med Educ. 1986;61(7):585–90.

Sokol-Hessner L, Shea J, Kogan J. The open-ended comment space for action plans on core clerkship students’ encounter cards: what gets written? Acad Med. 2010;85:S110–4.

Sox CM, Dell M, Phillipi CA, Cabral HJ, Vargas G, Lewin LO. Feedback on oral presentations during pediatric clerkships: a randomized controlled trial. Pediatrics. 2014;134:965–71.

Spickard A, Gigante J, Stein G, Denny JC. Automatic capture of student notes to augment mentor feedback and student performance on patient write-ups. J Gen Intern Med. 2008;23:979–84.

Suhoyo Y, Van Hell EA, Kerdijk W, Emilia O, Schönrock-Adema J, Kuks JB, et al. nfluence of feedback characteristics on perceived learning value of feedback in clerkships: does culture matter? BMC medical education. 2017;17:1–7.

Torre DM, Simpson D, Sebastian JL, Elnicki DM. Learning/feedback activities and high-quality teaching: perceptions of third-year medical students during an inpatient rotation. Acad Med. 2005;80:950–4.

Urquhart LM, Ker JS, Rees CE. Exploring the influence of context on feedback at medical school: a video-ethnography study. Adv Health Sci Educ. 2018;23:159–86.

Watling C, Driessen E, van der Vleuten C, Lingard L. Learning culture and feedback: an international study of medical athletes and musicians. Med Educ. 2014;48:713–23.

Watling C, Driessen E, van der Vleuten C, Vanstone M, Lingard L. Beyond individualism: Professional culture and its influence on feedback. Med Educ. 2013;47:585–94.

Soemantri D, Dodds A, Mccoll G. Examining the nature of feedback within the Mini Clinical Evaluation Exercise (Mini-CEX): an analysis of 1427 Mini-CEX assessment forms. GMS J Med Educ. 2018;35:Doc47.

Van De Ridder JMMM, Stokking KM, McGaghie WC, ten Cate OTJ, van der Ridder JM, Stokking KM, et al. What is feedback in clinical education? Med Educ. 2008;42:189–97.

van de Ridder JMMM, McGaghie WC, Stokking KM, ten Cate OTJJ. Variables that affect the process and outcome of feedback, relevant for medical training: a meta-review. Med Educ. 2015;49:658–73.

Boud D. Feedback: ensuring that it leads to enhanced learning. Clin Teach. 2015. https://doi.org/10.1111/tct.12345 .

Brehaut J, Colquhoun H, Eva K, Carrol K, Sales A, Michie S, et al. Practice feedback interventions: 15 suggestions for optimizing effectiveness. Ann Intern Med. 2016;164:435–41.

Ende J. Feedback in clinical medical education. J Am Med Assoc. 1983;250:777–81.

Cantillon P, Sargeant J. Giving feedback in clinical settings. Br Med J. 2008;337(7681):1292–4.

Norcini J, Burch V. Workplace-based assessment as an educational tool: AMEE Guide No. 31. Med Teach. 2007;29:855–71.

Watling CJ, Ginsburg S. Assessment, feedback and the alchemy of learning. Med Educ. 2019;53:76–85.

van der Vleuten CPM, Schuwirth LWT, Driessen EW, Dijkstra J, Tigelaar D, Baartman LKJ, et al. A model for programmatic assessment fit for purpose. Med Teach. 2012;34:205–14.

Schuwirth LWT, der Vleuten CPM. Programmatic assessment: from assessment of learning to assessment for learning. Med Teach. 2011;33:478–85.

Schut S, Driessen E, van Tartwijk J, van der Vleuten C, Heeneman S. Stakes in the eye of the beholder: an international study of learners’ perceptions within programmatic assessment. Med Educ. 2018;52:654–63.

Henderson M, Boud D, Molloy E, Dawson P, Phillips M, Ryan T, Mahoney MP. Feedback for learning. Closing the assessment loop. Framework for effective learning. Canberra, Australia: Australian Government, Department for Education and Training; 2018.

Heeneman S, Pool AO, Schuwirth LWT, van der Vleuten CPM, Driessen EW, Oudkerk A, et al. The impact of programmatic assessment on student learning: theory versus practice. Med Educ. 2015;49:487–98.

Lefroy J, Watling C, Teunissen P, Brand P, Watling C. Guidelines: the do’s, don’ts and don’t knows of feedback for clinical education. Perspect Med Educ. 2015;4:284–99.

Ramani S, Krackov SK. Twelve tips for giving feedback effectively in the clinical environment. Med Teach. 2012;34:787–91.

Telio S, Ajjawi R, Regehr G. The, “Educational Alliance” as a Framework for Reconceptualizing Feedback in Medical Education. Acad Med. 2015;90:609–14.

Lockyer J, Armson H, Könings KD, Lee-Krueger RC, des Ordons AR, Ramani S, et al. In-the-Moment Feedback and Coaching: Improving R2C2 for a New Context. J Grad Med Educ. 2020;12:27–35.

Black P, Wiliam D. Developing the theory of formative assessment. Educ Assess Eval Account. 2009;21:5–31.

Download references

Author information

Authors and affiliations.

Department of Health Sciences, Faculty of Medicine, Pontificia Universidad Católica de Chile, Avenida Vicuña Mackenna 4860, Macul, Santiago, Chile

Javiera Fuentes-Cimma & Ignacio Villagran

School of Health Professions Education, Maastricht University, Maastricht, Netherlands

Javiera Fuentes-Cimma & Lorena Isbej

Rotterdam University of Applied Sciences, Rotterdam, Netherlands

Dominique Sluijsmans

Centre for Medical and Health Profession Education, Department of Gastroenterology, Faculty of Medicine, Pontificia Universidad Católica de Chile, Santiago, Chile

Arnoldo Riquelme

School of Dentistry, Faculty of Medicine, Pontificia Universidad Católica de Chile, Santiago, Chile

Lorena Isbej

Sistema de Bibliotecas UC (SIBUC), Pontificia Universidad Católica de Chile, Santiago, Chile

María Teresa Olivares-Labbe

Department of Pathology, Faculty of Health, Medicine and Health Sciences, Maastricht University, Maastricht, Netherlands

Sylvia Heeneman

You can also search for this author in PubMed   Google Scholar

Contributions

J.F-C, D.S, and S.H. made substantial contributions to the conception and design of the work. M.O-L contributed to the identification of studies. J.F-C, I.V, A.R, and L.I. made substantial contributions to the screening, reliability, and data analysis. J.F-C. wrote th e main manuscript text. All authors reviewed the manuscript.

Corresponding author

Correspondence to Javiera Fuentes-Cimma .

Ethics declarations

Competing interests.

The authors declare no competing interests.

Additional information

Publisher’s note.

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Supplementary material 1, supplementary material 2., rights and permissions.

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ . The Creative Commons Public Domain Dedication waiver ( http://creativecommons.org/publicdomain/zero/1.0/ ) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Cite this article.

Fuentes-Cimma, J., Sluijsmans, D., Riquelme, A. et al. Designing feedback processes in the workplace-based learning of undergraduate health professions education: a scoping review. BMC Med Educ 24 , 440 (2024). https://doi.org/10.1186/s12909-024-05439-6

Download citation

Received : 25 September 2023

Accepted : 17 April 2024

Published : 23 April 2024

DOI : https://doi.org/10.1186/s12909-024-05439-6

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

• Clinical clerkship
• Feedback processes
• Feedforward
• Formative feedback
• Health professions
• Undergraduate medical education
• Undergraduate healthcare education
• Workplace learning

BMC Medical Education

ISSN: 1472-6920

• Submission enquiries: [email protected]
• General enquiries: [email protected]

Analysis of qualitative data on green infrastructure (GI) guideline uptake in metros

Focusing on the City of Tshwane, South Africa, a literature review, policy document review and semi-structured interviews were conducted to (1) identify the challenges faced by city officials and opportunities that exist to improve the decision-making process at the site level stage with the application of GI and (2) identify and collate GI planning principles for the City of Tshwane. The literature review focused mainly on SSA, and papers focused on GI guidelines. The researcher considered the alignment of the GI guidelines identified in the literature with a policy document review of spatial and environmental development principles in South African national, provincial and local spatial policy documents. In parallel with the literature and policy review process, 16 semi-structured interviews with 18 interviewees involved in GI planning at the City of Tshwane were conducted. The researcher further followed a co-development process through a participatory workshop with 23 participants, including a pre-workshop online survey and five post-workshop feedback and clarification discussions. Participants included city officials, property developers and built-environment practitioners, all with many years of experience in the land development application process in the city.

The findings illustrate that city officials face many complex challenges with the application of GI, such as poor intergovernmental collaboration; conflicting policies, regulations and frameworks; scarce resources ; urbanisation resulting in land invasions due to a housing shortage; and a lack of appreciation of the value and benefits that GI can provide. The findings further illustrate that local policy documents have many national, provincial and city planning principles but are not carried through to the site development planning stage. Many opportunities were identified for improved GI planning, such as: streamlining the land development application process; incentivising developers; enabling cross-sectoral partnerships to open up new resource pools to fund GI applications; and promoting the long-term benefits of GI. Based on the findings, 20 planning principles are proposed for the city's site development planning phase that overlaps with 18 principles in the literature but emphasises aspects of access, safety, quality and cross-sectoral partnerships to co-develop and co-manage green space, which are unique requirements in an SSA context. The study demonstrates the value of local cross-sectoral input in GI planning co-development to ascertain the contextual application of research outcomes.

Ministry of Foreign Affairs of Denmark (DANIDA Fellowship 2021-2023), Grant number: 20-M09AU

Department/unit, sustainable development goals.

• 11 Sustainable Cities and Communities

Usage metrics

• Sustainable design
• Regulatory planning and development assessment
• Land use and environmental planning
• Landscape architecture

SYSTEMATIC REVIEW article

Chronic tobacco smoking and neurocognitive impairments in adolescents and young adults: a systematic review and meta-analysis.

• 1 School of Biotechnology, Nile University, Sheikh Zayed City, Giza, Egypt
• 2 School of Medicine, Ninewells Hospital, University of Dundee, Dundee, United Kingdom
• 3 School of Medicine, Division of Population and Behavioural Science, University of St Andrews, St Andrews, United Kingdom
• 4 Department of Child & Adolescent Psychiatry, Institute of Psychiatry, Psychology and Neuroscience, King’s College London, London, United Kingdom

There is a lack of robust research investigating the association between neurocognitive impairments and chronic tobacco smoking in adolescents/young adults. Therefore, a systematic review and meta-analysis were conducted to examine this association by pooling cross-sectional studies published from 1980 to 2023. The systematic review assessed the neurocognitive performances between chronic tobacco smokers and non-smokers in each study. The meta-analysis included six studies that compared chronic tobacco smokers against non-smokers using neuropsychological tests covering three neurocognitive domains. The results showed a cross-sectional association between impairpments in motor impulsivity across two aspects: reaction delay and incongruent errors , with the effect size being (SDM = 0.615, p = 0.000) and (SDM = 0.593, p = 0.000) respectively. However, no significant associations were found for intelligence (SDM = 0.221, p = 0.425) or working memory (SDM = 0.150, p = 0.581). This study highlights the need for further research to explore a greater number of neurocognitive domains in the context of chronic smoking in adolescents/young adults, particularly motor impulsivity, intelligence and working memory, as well as the socioeconomic factors involved. There is also a need to further study the effects of emerging alternative nicotine administration methods in this age group.

1 Introduction

Chronic tobacco smoking, defined as daily cigarette smoking (>10 cigarettes per day) for 2 or more years, is considered by the World Health Organization (WHO) as significantly hampering effective global public health interventions ( 1 ). It is estimated that in 2019 there were 155 million individuals across the world aged 15-25 years who were smoking tobacco ( 2 ). Across all populations, smoking contributes to over 8 million deaths around the world each year, either directly or indirectly, and global tobacco consumption is a contributing factor to 7 million deaths per year, with around 1.2 million non-smokers dying from second-hand smoking each year ( 1 ).

In 2008, nicotine was identified as the most addictive substance across the world, with smoking tobacco a major cause of cardiac and respiratory disease ( 3 – 5 ). Data from the Health Survey for England show that in 2021, 13% of young people (16-24 years old) were current tobacco smokers, while the highest prevalence of smoking is between the ages of 25-34 years, at 18% ( 6 ). These rates can be compared to data from the Office for National Statistics (ONS), the UK’s national statistical institute, which show that in 2021, the overall rate of smoking is 13.3% in people over 18 years of age (this figure reaches 21.1% in Scotland) ( 7 , 8 ). However, the prevalence of chronic tobacco smokers in the UK has been decreasing since 1974, though over recent years this may be partially linked to the increasing popularity of electronic nicotine delivery systems (ENDS, also known as vapes or e-cigarettes) as an alternative source of nicotine, as well as variations in behaviour during the COVID-19 pandemic ( 8 ). Notably, the use of ENDS is most popular in the 16–24-year age group ( 8 ). Importantly, the number of deaths related to smoking remains high, with 74,600 recorded in England over 2019 – the most recent years for which data are currently published by National Health Service (NHS) Digital ( 9 ). Chronic tobacco smoking is still a significant behaviour among adolescents and young adults, demonstrating the importance of reducing the number of young people who smoke ( 10 ).

Chronic tobacco use often begins during the adolescent phase of life, with 90% of smokers beginning before the age of 18 years ( 11 , 12 ). Additionally, the younger an individual begins smoking the harder it is to quit ( 13 ). Numerous studies indicate that individuals who begin smoking tobacco in their early life (<16 years old) have a higher probability of becoming chronic tobacco smokers, and developing an addiction to nicotine, in comparison to individuals who have a later onset of smoking (>16 years old), again contributing to the difficulty in quitting smoking once in adulthood ( 14 – 18 ). As a result, reducing the number of adolescents and young adults who start smoking would likely impact the total number of chronic smokers over time.

The transitioning phase between childhood and adulthood, known as adolescence, is characterized as a learning phase that includes behavioural changes, such as elevated levels of risk-taking behaviour, seeking novel experiences, and independence ( 19 – 21 ). According to WHO, the period of adolescence ranges from 10 to 19 years old. However, other studies have proposed that adolescence lasts until 25 years of age which can also be called the young adulthood phase, based on the brain’s ongoing maturational processes ( 22 ). This ongoing maturation or “rewiring” of the brain is known to be governed by numerous specific stages of physical, emotional and cognitive maturation, and, as reported by Gavin et al. ( 23 )Arain et al. (, 24 ), and Sylwester ( 25 ), it is known to start from around puberty, at the age of 10 years, until the brain reaches the stage where it is most mature at the age of 24 years.

A key consideration in the context of tobacco smoking during adolescence is the association this may have on an individual’s neural development. Central nervous system (CNS) development begins in the third week of gestation and through to late adolescence, regulated and coordinated through complex cellular, genetic, and environmental factors ( 26 ). During the adolescent phase of life, the human brain is undergoing numerous neurodevelopmental transition and maturation processes ( 27 ). It is the phylogenetically more recent cortical regions of the CNS that demonstrate the ongoing and prolonged development through childhood and into adolescence ( 28 ). This is important to consider in the context of chronic tobacco smoking in this age range, as the development of these central neural regions underpins emotional, cognitive, and behavioural changes seen in adolescence ( 28 ).

Chronic exposure to nicotine during adolescence has also been shown to be associated with an increase in the probability of an individual developing major psychiatric disorders and neurocognitive impairments in later life. Most commonly, adolescent, and young adult chronic tobacco smokers experience a level of progressive attentional deficit ( 29 ). Specific neurocognitive disturbances seen in studies include changes to working memory and attention, with a notable reduction in the activation of the prefrontal cortex (PFC) ( 30 , 31 ). There are also specific psychiatric conditions that are associated with chronic nicotine exposure in adolescence, including major depressive disorder, schizophrenia, and addiction to other substances ( 32 – 38 ).

In summary, there is a need for clinical research to improve the understanding of the complex relationship between chronic tobacco smoking and neurocognitive impairments in individuals from younger age groups, as suggested in a previous systematic review and meta-analysis in adult populations ( 39 ). Using restricted inclusion criteria for the age groups (10-24 years old) of participants assessed ( 23 – 25 ), the following is a systematic review and meta-analysis of the existing studies on chronic tobacco smoking and neurocognitive impairments in adolescents and young adults.

This review was done in compliance with the Meta-analysis of Observational Studies in Epidemiology (MOOSE) guidelines ( 40 ) and the Preferred Reporting Items for Systematic review and Meta-Analysis (PRISMA) guidelines ( 41 ) ( Supplementary Table 5 ). The study protocol registration was made on the PROSPERO database (CRD42023428359).

2.1 Literature search

2.1.1 inclusion and exclusion criteria.

The PICO criteria utilised in this review were (1) studies including human participants (2) with ages ranging from 10 years to 24 years ( 23 – 25 ), (3) experiencing chronic tobacco use as defined by the WHO ( 1 ) and (4) including all types of studies. As for the comparison group, they were defined as healthy participants who do not smoke (nicotine naïve), of the same age group (10-24 years of age). Furthermore, these papers had to supply the name of the neurocognitive tests used and which neurocognitive domains (e.g., Impulsivity, Attention, Memory, etc.) were being assessed during each test ( 42 ). Chronic tobacco smoking was defined as daily cigarette smoking (>10 cigarettes per day) for 2 or more years.

The exclusion criteria used were as follows:

(A) Cohorts employing participants with illicit poly-drug use and/or dependence.

(B) Cohorts employing individuals with more than 14 units of alcohol per week as the alcohol cut-off.

(C) Cohorts employing individuals diagnosed with neurological illness and/or any Axis 1 Psychiatric Illness (DSM IV/V).

(D) Studies that had no healthy comparator group (non-smoker controls).

(E) Studies not utilising neurocognitive tests.

2.1.2 Search terms

The search terms utilised were: (Nicotine OR Cigarettes OR Tobacco OR ‘Chronic Smoking’) AND (‘Neuropsychological impairments’ OR ‘Cognitive impairments’ OR Neurocognition) AND (Adolescents OR Teens OR ‘Young Adults’).

Next, the search terms ‘neuropsychological impairments’, ‘cognitive impairments’, and ‘neurocognition’ were replaced by the names of the specific neurocognitive tests. These were: ‘Rapid Visual Information Processing’, ‘Wechsler Adult Intelligence Scale’, ‘Spatial Working Memory’, ‘Ray Auditory Verbal Learning Test’, ‘Two Back Test’, ‘Trail Making Test’, ‘Stroop Test’, ‘Wisconsin Card Sorting Test’, ‘Stroop Colour Word Task’, ‘Reaction Time’, ‘California Verbal Learning Test’, ‘Verbal Fluency’, and ‘Gambling Test’ ( 42 ).

2.1.3 Search engine

The literature search was conducted in May 2023 using the following databases: PubMed (1980-2023), APA PsycINFO (1980-2023), Cochrane Central (1980-2023), SciELO (1980-2023), and Scopus (1980-2023). Two further studies were located using Google Scholar. All the identified studies from the database search were reviewed and moderated by the authors for the selection of eligible and suitable papers to be used for this systematic review and the meta-analysis. Finally, to improve the comprehensiveness of the identified studies, the references of the accepted studies were reviewed, and a “snowballing” technique was employed.

Three authors (AE, SV, and AAC) screened the studies independently using the inclusion and exclusion criteria listed above. First, the title/abstract of the studies was screened. This utilised EndNote 20, from which search libraries were uploaded to Rayyan. Rayyan software was then used during the screening process. Subsequently, the full text of the articles that passed the title/abstract screening was inspected. Disagreements were resolved consensually.

2.2 Analysis

2.2.1 qualitative analysis.

Several papers were reviewed to further investigate the effect of chronic tobacco smoking and neurocognitive impairments in adolescents and young adults. Neurocognitive impairments were pooled from each paper. Then, these findings were compiled in a descriptive summary to be further investigated and used in a preliminary conclusion for the neurocognitive impairments that can be associated with chronic tobacco smoking in adolescence or young adulthood.

2.2.2 Quantitative analysis

2.2.2.1 data extraction.

This was followed by meta-analytic calculations to reach a quantitative estimate of the impact of chronic tobacco smoking on the neurocognitive functions of the identified cohort. Means (M) and Standard Deviations (SDs) of scores on neurocognitive tests/measures were extracted from six studies ( 5 , 18 , 21 , 30 , 43 , 44 ) and inserted into the Comprehensive Meta-Analysis (CMA) version III software package for analysis ( 45 ). It was only possible to extract data from six studies as the other research papers pooled for the systematic review did not provide relevant statistical data. Data were limited to three neurocognitive domains: Motor Impulsivity, Intelligence, and Working Memory. These domains were identified from the neurocognitive tests utilised by the studies included in the review following a previous meta-analysis by Conti et al. ( 39 ) and Figueiredo et al. ( 46 ), and the guidelines of Baldacchino et al. ( 42 ) ( Supplementary Tables 1 – 3 ). Regarding Motor Impulsivity, the data extracted included those pertaining to the Stroop Task ‘response delay’ outcome measure (measured by reaction time during the incongruent condition minus reaction time during the congruent condition) and Stroop Task incongruent errors.

2.2.2.2 Meta-analysis

A random effect model was selected to conduct meta-analytic calculations instead of a fixed effect model as it was assumed that the pooled studies were not ‘identical’ (i.e., not displaying the same true effect size) ( 47 , 48 ). The ‘Standard Mean Difference’ (SMD) was selected as a statistical summary measure. Effect sizes were computed utilising Cohen’s benchmark criteria; an effect size of 0.8 would have implied a ‘large’ effect size, an effect size of 0.5 would have implied a ‘medium’ effect size, and an effect size of 0.2 would have implied a ‘small effect size’ ( 49 ). Heterogeneity was assessed by using both Cochran’s Q and I2 tests ( 47 ). It was not possible to run a meta-regression by utilising relevant smoking characteristics of participants as moderators (e.g., number of cigarettes smoked x day, pack-years) due to the low number of studies (<10) pooled for each neurocognitive domain ( 47 ).

2.2.3 Publication bias

Publication bias refers to the tendency to publish studies reporting statistically significant results than studies reporting results that are not statistically significant ( 50 , 51 ). Therefore, there is a possibility that studies included in a meta-analysis would be biased and consequently reflected in the results of the quantitative synthesis ( 39 ). Publication bias for the studies included in the meta-analysis was assessed through the visual inspection of Funnel’s Plots ( 47 ).

2.2.4 Assessment of study quality

To evaluate the quality of papers that were included in the review, the National Institutes of Health (NIH) case-control quality assessment tool was utilised ( 52 ). Using the Study Quality Assessment Tools, the studies were either classified as ‘poor’ indicating that the study in question presents a high risk of bias, ‘fair’ indicating that the study in question presents a moderate but not to the extent to invalidate the results, or ‘good’ indicating that the study in question presents a low risk of bias ( 52 ).

3.1 Search results

Initially, a total of 359 papers were identified. Then filtering tools on these databases were utilised to filter for the following: ‘Clinical Trials’, ‘Human Trials’, ‘Adolescents’, and ‘Young Adults’. The citations were downloaded to EndNote20 and then uploaded together to Rayyan. Rayyan is an online software program designed specifically for researchers working on systematic literature reviews, which has tools that improve the organisation and efficiency of the screening and selection process of studies. Duplicate papers were removed manually by AE and SV, using Rayyan software to assist the process, excluding 63 duplicates and leaving 296 remaining unique studies. Titles and abstracts were then inspected to assess the studies for eligibility by AE, SV and AAC. This inspection process resulted in the exclusion of 272 papers; 251 papers were excluded by the title, and 21 were excluded after reading their abstracts. Next, using the inclusion and exclusion criteria, the remaining 24 papers were reviewed comprehensively for eligibility by AE, SV and AAC, which yielded the elimination of 12 more papers due to having non-matching age ranges and/or having the smoking group not meeting the criteria of inclusion. One paper was excluded due to concurrent marijuana use, one paper was excluded that had no control (non-smoker) comparison, and one paper was excluded that did not include neurocognitive tests. Eventually, this yielded 9 case-control studies that were selected to be included in the quantitative synthesis ( Figure 1 ).

Figure 1 Neurocognitive associations of chronic smoking on adolescents/young adults.

One study included in the quantitative synthesis reported data from an additional comparator group (‘Light Smokers’) ( 53 ). Therefore, to comply with the exclusion and inclusion criteria and the aim of this study, only the appropriate comparator groups were included in this meta-analysis.

The studies included in the analysis originated from four countries, including the one from United States of America ( 30 ), five from China ( 5 , 18 , 21 , 43 , 54 ), two from Saudi Arabia ( 44 , 55 ), and one from Belgium ( 53 ).

The quality of the studies was assessed consensually by AE and SV ( Supplementary Table 4 ). Out of the nine studies that were accepted for inclusion in this current meta-analysis, three were classified as ‘good’ and six were classified as ‘fair’ ( Table 1 ; Supplementary Table 4 ).

3.2 Sociodemographic

Demographic data were utilised from a total of (307) chronic tobacco smokers and (315) non-smoking controls, all free of any neuropsychiatric disorders. Since adolescents and young adults were the targets for this study, the mean age range of the adolescent and young adult tobacco smokers ranged from 17 years to 24.7 years, and for the control population their mean age ranged from 16.6 years to 23.3 years ( 30 , 44 , 55 ). Most of the studies were conducted on a predominantly male population except for two studies that had more females than males ( 30 , 53 ). The average amount of time in education ranged from 10.1 years to 13.8 years. However, of the included studies that were pooled, several did not include data for the years of education ( 44 , 53 – 55 ). Most of the papers included in this meta-analysis reported pack-years, years of smoking, and cigarettes per day, except for one study that did not report any of these data ( 55 ) and two studies not mentioning pack-years specifically ( 30 , 54 ). Pack-years ranged from 3.5 to 6.4 ( 18 , 43 , 44 ), years of smoking ranged from 2 years to 7.3 years ( 44 , 54 ), and cigarettes per day ranged from 11.7 Jacobsen et al. ( 30 ) cigarettes per day to 16.9 cigarettes per day ( 21 ) ( Table 1 ).

Table 1 Demographics and smoking characteristics ♦ .

3.3 Neurocognitive tests

In the papers that were pooled for this systematic review, researchers used specific neurocognitive tests to investigate the neurocognitive domains of adolescent and young adult chronic tobacco smokers ( Table 2 ). The Stroop colour-word task, used to test motor impulsivity and cognitive flexibility, was the most utilised neurocognitive test in the studies included in this review ( 5 , 18 , 21 , 43 ). The Wechsler Adult Intelligence Scale Third Edition (WAIS-III) was used by four of the included studies to specifically measure intelligence in chronic tobacco smoking adolescents and young adults ( 18 , 21 , 30 ). As well as using WAIS-III, the domain of attention was measured using several tests throughout the papers included. One of the studies, by Bashir et al. ( 55 ), assessed attention in chronic tobacco smoking adolescents and young adults using the Attention Switching Task (AST). This study included another neurocognitive domain, Pattern Recognition Memory Task (PRM), to measure learning and memory (both short- and long-term memory) in the chronic tobacco smoking group. Maurage et al. ( 53 ) assessed attention in chronic tobacco smoking cohort with the Attention Network Test (ANT). Li et al. ( 5 ) also explored how attention is affected by adolescent and young adulthood chronic tobacco smoking by measuring Reaction Time (RT). Al-Mshari et al. ( 44 ) used numerous tests to assess multiple neurocognitive domains. This included RT to test for attention, as well as the Spatial Working Memory Task (SWM) to investigate any association between impairments in spatial working memory and chronic tobacco smoking status in adolescents and young adults. The same study also used the Multitasking test (MTT) and Rapid Visual Information Processing Task (RVIP) to assess the participants’ attention and impulsivity. Zhao et al. ( 54 ) used the Go/No-Go Task to assess motor impulsivity in their assessments of chronic tobacco smokers. Finally, as well as exploring intelligence, Jacobsen et al. ( 30 ) included four different neurocognitive tests: the Hopkin’s Verbal Learning Test (HVLT) was used to assess verbal learning and memory; the Auditory n-Back Task was used to assess working memory; the Kauffman Brief Intelligence Test (KBIT) was used to assess intelligence; and the Continuous Performance Test (CPT) was used to assess selective, divided, and sustained attention in chronic tobacco smokers.

Table 2 Neurocognitive tests and domains.

3.4 Qualitative analysis

All 9 studies were included in this qualitative systematic review. The 9 selected papers assess neurocognitive functional impairments associated with chronic tobacco smoking in adolescence and young adulthood ( 5 , 18 , 21 , 30 , 43 , 44 , 53 – 55 ).

Maurage et al. ( 53 ) proposed that when looking into attention (alerting, orienting and executive control) using the Attention Network Test (ANT), adolescent chronic tobacco smokers face more impairments in executive control when compared to non-smokers of the same age range. Additionally, they reported adolescent and young adult chronic tobacco smokers show impairments in attention and reaction time compared to healthy non-smoking individuals of the same age group ( 53 ), having slower reaction times in incongruent stimuli and having difficulty ignoring the distractors used. They have also suggested that there is a significant association between the chronic smoking group and negative urgency (p<0.05), positive urgency (p=0.01) and lack of premeditation (p=0.02), where they had higher scores than the healthy control group.

Al-Mshari et al. ( 44 ) provided evidence that adolescent and young adult chronic tobacco smokers show higher levels of cognitive impairments in comparison to non-smokers of the same age group. These cognitive impairments were in sustained attention, as assessed by the Rapid Visual Information Processing task (RVIP), and attention and impulsivity, as assessed by the Multi-Tasking Tests (MTT). This study additionally showed that there is a significant difference in Rapid Visual Information Processing A (RVPA) (p=0.001), Rapid Visual Information Processing Probability of False Alarm (RVPPFA) (p=0.027), and Multi-Tasking Test Reaction Latency (Median) (MTTLMD) (p=0.007) in the performance of non-smokers when compared to smokers, with non-smokers performing much better in these domains. Insignificant differences (p>0.05) between young adult smokers and non-smokers were reported in relation to spatial working memory as assessed by the Spatial Working Memory Strategy (SWMS) test. Furthermore, the researchers propose that the occurrence of impairments in sustained attention and executive function in young smokers is supported by previous studies that provide the same results ( 56 – 58 ).

Bashir et al. ( 55 ) proposed that chronic tobacco smokers exhibited notable deficits in neurocognitive function, as demonstrated by the Attention-Switching Task (AST) and Pattern Recognition Memory (PRM) tests. The AST test revealed that chronic tobacco smokers had significantly higher values in the AST-latency (p=0.001), congruent (p=0.001) and incongruent (p=0.001) conditions compared to non-smokers, indicating impaired attention, memory, and reaction time tasks between the two groups. Although the PRM test was also utilised, no significant difference (p=0.101) was found between the two groups. This would suggest that adolescent or young adult chronic tobacco smokers have a significant difference in their performance when compared to non-smokers in reaction time and attention. They also suggest that the lack of difference in the performances of both groups in the PRM test can be due to memory function preservation in smokers.

According to Zhao et al. ( 54 ), the authors observed that in a specific stimulus in the go/no-go task (600 ms), there was no significant (p>0.05) difference between the chronic tobacco smoking group compared to the non-smoking controls. However, when changing the stimulus of the test (200 ms), the smoking group had more significant (p<0.001) on-the-go and no-go phases when compared to the non-smoking controls. Additionally, when using the short stimulus on the go task, the chronic smoker group had a much faster response to the stimulus (RT) when compared to the non-smoking control. This describes how chronic tobacco smoking may not only be associated with impairments in the go/no-go tasks, but that chronic smokers also tend to increase their reaction time in tasks that involve responding to a fast stimulus and, additionally, make more errors.

Feng et al. ( 18 ) used the colour-word Stroop Task to measure response errors, reaction times, and response delays of participants under congruent and incongruent conditions. The results showed that smokers made a significantly higher number of incongruent errors (p<0.05) and had significantly shorter reaction delay times (p<0.05) compared to non-smokers. The results also provided evidence of minor, but non-significant, differences in the other conditions including congruent errors, and incongruent and congruent reaction times. These findings were further supported by Bi et al. ( 43 ), who also used the colour-word Stroop Task and found that smokers had a longer reaction time during congruent conditions (p<0.001) compared to non-smokers. The smoking group also showed a significant difference in their scores in reaction delay (p<0.05), where they had shorter reaction delay scores when compared to the non-smoker group. Additionally, the smoker group made more errors during the incongruent condition (p<0.01) compared to the non-smoker group, which was also observed in the study by Yuan et al. ( 21 ) in the colour-word Stroop Task, where they also provided evidence that smokers had significantly more errors (p<0.05) and shorter reaction delay times (p=0.005) in the incongruent condition. Similarly, Li et al. ( 5 ), using the colour-word Stroop Task, found that both tobacco smokers and non-smokers made more errors (p<0.005) and had shorter reaction delay times (p<0.01) during the incongruent condition compared to the congruent condition. They all noted a trend of shorter response delay in adolescent and young adult smokers when compared to non-smokers ( 5 , 18 , 21 , 43 ). Additionally, it was reported by Li et al. ( 5 ), (p<0.001), Bi et al. ( 43 ) (p<0.001), and Yuan et al. ( 21 ) (p<0.005) that there was a significant Stroop effect noticed in both smoking and non-smoking groups, where they demonstrated longer reaction times when performing in the incongruent conditions compared to when performing in the congruent condition. Studies by Feng et al. ( 18 ), and Yuan et al. ( 21 ) also performed WAIS III on adolescent and young adult chronic tobacco smokers in order to measure their intelligence quotient (IQ), where they proposed that there were no significant differences between the adolescent or young adult smoking group and the non-smoking group.

Jacobsen et al. ( 30 ) reported adolescent smokers perform significantly (p<0.05) less accurately on the dichotic 1-back and 2-back conditions, and the binaural 1-back condition of an n-back task in comparison to non-smokers. It proposes that adolescent smokers have impairments in working memory in comparison to adolescent non-smokers. These impairments were found to be more severe during a nicotine withdrawal condition. No significant differences (p>0.05) were identified between the two groups in relation to verbal memory during a nicotine-satiated condition. However, verbal memory, as assessed by the Verbal Learning Test-Revised (HVLT-R), worsened during nicotine withdrawal for adolescent smokers. No significant differences (p>0.05) were detected in relation to sustained, selective, and divided attention task performance accuracy between adolescent smokers and non-smokers. Nonetheless, as stated by the same authors “across test sessions, smokers performed this attention task significantly more slowly than did non-smokers [smokers reaction time (RT) = 1056.7 ± 305.9 msec, non-smokers RT = 944.5 ± 262.5 msec; β = 144.0, t (65) = 2.1, p = .04]” ( 30 ). Group differences in reaction time did not vary between nicotine-satiated and withdrawal conditions.

There were variations in the nicotine administration state of chronic smokers between the studies. Two studies did not mention the duration since the last nicotine administration at all, reflecting a less detailed assessment of participants ( 44 , 55 ). Two studies assessed participants at 30 minutes post-administration ( 18 , 43 ). While this is soon after administration, the studies demonstrated statistically significant impairments in smokers versus non-smokers in multiple neurocognitive tests. Three studies assessed smokers at 1 hour after administration ( 5 , 21 , 54 ). Li et al. ( 5 ) elaborated on this, stating that no chronic smoking participants demonstrated an urge to smoke during the pre-testing questionnaire. Maurage et al. ( 53 ) alone measured smokers at 3 hours post-administration. This study found that the executive function of heavy smokers was independent of current tobacco craving, as measured in the pre-test questionnaires, and correlated more with the heaviness of smoking rather than the duration of smoking. Jacobsen et al. ( 30 ) most comprehensively assessed the effects of nicotine withdrawal on neurocognitive performance. Their chronic smoking participants were assessed twice: the first was following “ad libitum” smoking (smoking as one wishes – no clear definition), and then again two weeks later at 24 hours post-administration of nicotine. From this, Jacobsen et al. ( 30 ) suggested an association between nicotine withdrawal (at 24 hours) and the domains of working memory and short-term verbal memory, with no associations determined elsewhere.

3.5 Quantitative analysis

3.5.1 motor impulsivity.

For Motor-Impulsivity -Stroop Task-Reaction Delay, a significant and medium effect size was found in favour of the tobacco non-smoker group (z=5.317, p <0.0001), indicating that young non-smokers take more time/are less impulsive when reacting between congruent and incongruent conditions compared to young chronic tobacco smokers ( Figure 2 ). Results of Q and I 2 tests indicated the absence of heterogeneity between the pooled studies ( Q =0.471, p =0.925, I 2 = 0.000). Visual inspection of Funnel’s Plot revealed the absence of publication bias ( Supplementary Figure 1 ).

Figure 2 Motor impulsivity-Stroop Task-Reaction Delay-forest plot (std diff, standard difference; Z value, one sample z statistics; p value, probability that Z statistics is significantly different than 0; Lower limit, lower limit of the 95% confidence interval for the effect size; Upper limit, upper limit of the 95% confidence interval for the effect size; RD, Reaction delay).

For Motor-Impulsivity -Stroop Task-Incongruent Errors, a significant and medium effect size was found in favour of the young chronic smoker group (z=-5.130, p < 0.0001), indicating that young chronic tobacco smokers make more errors during cognitive conflict conditions compared to young non-smokers ( Figure 3 ). Results of Q and I 2 tests indicated the absence of heterogeneity between the pooled studies ( Q =1.705, p =0.636, I 2 = 0.000). Visual inspection of Funnel’s Plot revealed the absence of publication bias ( Supplementary Figure 2 ).

Figure 3 Motor impulsivity-Stroop Task-Incongruent Errors-forest plot (std diff, standard difference; Z value, one sample z statistics; p value, probability that Z statistics is significantly different than 0; Lower limit, lower limit of the 95% confidence interval for the effect size; Upper limit, upper limit of the 95% confidence interval for the effect size; InEr, Incongruent errors).

3.5.2 Intelligence

For Intelligence , a non-significant and small effect size was found in favour of the young non-smoker group (z=0.798, p =0.425) ( Figure 4 ). Results of Q and I 2 tests indicated heterogeneity between the pooled studies ( Q =8.496, p <0.05, I 2 = 76.459). Visual inspection of the Funnel’s Plot revealed moderate publication bias ( Supplementary Figure 3 ).

Figure 4 Intelligence forest plot (std diff, standard difference; Z value, one sample z statistics; p value, probability that Z statistics is significantly different than 0; Lower limit, lower limit of the 95% confidence interval for the effect size; Upper limit, upper limit of the 95% confidence interval for the effect size; WAIS, Wechsler Adult Intelligence Scale; KBIT, Kauffman Brief Intelligence test).

3.5.3 Working memory

For working memory , a non-significant and small effect size was found in favour of the young non-smoker group (z=0.150, p =0.581) ( Figure 5 ). Results of Q and I 2 tests indicated small heterogeneity between the pooled studies ( Q =2.599, p =0.107, I 2 = 61.517). It was not possible to compute a Funnel’s plot to assess publication bias as the number of included studies was too low.

Figure 5 Working Memory forest plot (std diff, standard difference; Z value, one sample z statistics; p value, probability that Z statistics is significantly different than 0; Lower limit, lower limit of the 95% confidence interval for the effect size; Upper limit, upper limit of the 95% confidence interval for the effect size; SWM, Spatial Working Memory).

4 Discussion

4.1 summary of results and key findings.

This systematic review and meta-analysis were conducted to provide a quantitative synthesis regarding the association between chronic tobacco smoking and neurocognitive impairments during adolescence and young adulthood ( Table 3 ). Both quantitative and qualitative analysis results showed an association between chronic tobacco smoking and impaired motor impulsivity in chronic tobacco smoking adolescents and young adults, while qualitative analysis of these nine studies demonstrated that smoking behaviours in younger age groups may be associated with impairments of various neurocognitive domains. Of the papers included in this study, Li et al. ( 5 ) Yuan et al. ( 21 ) Bi et al. ( 43 ), and Feng et al. ( 18 ) propose that early onset of tobacco smoking is associated with neurocognitive impairments in the domain of attention, specifically when performing incongruent error and reaction delay tasks. Jacobsen et al. ( 30 ) provided evidence that adolescent smoking may be associated with impairments in working memory. Al-Mshari et al. ( 44 ) Maurage et al. (, 53 ), and Bashir et al. ( 55 ) suggest that adolescent and young adulthood smoking can be associated with impairments in executive function and attentional domains. Finally, Zhao et al. ( 54 ) have provided evidence that there are associations between adolescent or young adulthood smoking and impairments in the domains of intelligence and impulsivity respectively.

Table 3 Compiled effect sizes for each neurocognitive domain.

The association between chronic tobacco smoking and these neurocognitive impairments support the findings of the literature review conducted by Campos et al. ( 59 ) and of the systematic review and meta-analysis conducted by Conti et al. ( 39 ). However, the findings of the systematic review and meta-analysis conducted by Conti et al. ( 39 ) are primarily related to middle-aged adult chronic tobacco smokers, unlike the population used in the current study. Therefore, the findings of this review and meta-analysis contribute to the body of literature by showing an association between chronic tobacco smoking and neurocognitive impairments in younger age groups with a shorter smoking history.

4.2 Mechanistic interpretations

In the context of neurocognition, exposure to nicotine, either directly or indirectly, has been associated with neurobiological changes ( 21 , 39 , 60 , 61 ). According to Conti et al. ( 39 ), exposure to nicotine is linked to complex cognitive modulation, where acute nicotine use may enhance cognitive functions, particularly in the domains of attention and memory ( 39 , 62 , 63 ). Aside from changes to working memory and attention, chronic nicotine exposure may be associated with neurocognitive impairments in impulse control, the speed of processing information, intellectual ability, auditory-verbal memory, and vocabulary (oral arithmetic, receptive and expressive) ( 4 , 30 , 64 – 66 ). In the qualitative analysis of Maurage et al. ( 53 ), their data suggests that young chronic tobacco smokers have more difficulty inhibiting or resisting irrelevant or distracting stimuli when focusing on relevant ones. Additionally, they indicate that chronic smokers have deficits in impulsivity and executive attentional control.

One mechanistic interpretation for the findings of this study could consist of the neurotoxic effect of nicotine on the developing adolescent brain as proposed by the Tobacco-Induced Neurotoxicity theory of Adolescent Cognitive Development (TINACD) ( 67 ). According to this paradigm, chronic tobacco smoking at younger ages may lead to structural and functional impairments in frontostriatal brain regions (e.g. PFC, ACC) modulating cognitive control, attention, and impulsivity. Alongside this, a neuroimaging study conducted by Conti and Baldacchino ( 68 ) reported a correlation between the age of regular smoking initiation during adolescence (16 years) and reduced Gray Matter (GM) volume in the VLPFC of chronic tobacco smokers ( 69 , 70 ). Nicotine exposure is also associated with accelerated brain ageing and brain structural damage through its neurotoxic properties, which in turn may be associated with the reinforcing and inducing of other forms of substance dependencies ( 70 ).

The results of this meta-analysis will need to consider likely confounders. One significant consideration is that these young individuals may demonstrate neurocognitive impairments, such as impulsivity, prior to initiating smoking, meaning that the neurocognitive phenotypes demonstrated an increase in the probability of an adolescent or a young adult picking up the tobacco smoking behaviour. This is likely to be attributable to complex socioeconomic factors involved, such as education, adverse childhood experiences and other social disadvantages ( 71 ). Subsequent negative effects or neurocognitive impairments caused by chronic tobacco smoking may then lead to further impulsive reactions to avoid the unwanted negative effects of tobacco smoking cessation, causing these adolescents and young adults to continue this smoking behaviour, establishing a positive feedback loop ( 72 ). Determining the relationship between socioeconomic factors and an individual’s neurocognitive outcome in chronic adolescent smokers is of high importance.

Impulsivity has been shown to be a primary reason for the initiation of tobacco smoking, as well as the sustainment of this habit to help avoid the aversive and negative consequences of abstinence from smoking ( 73 ). According to Balevich et al. ( 74 ), it is hypothesized that this impulsiveness to initiate smoking is related to sensation seeking (reward-seeking) and curiosity while the impulsiveness to sustain the smoking behaviour is related to disinhibitory impulsiveness. This disinhibitory impulsiveness is related to the aversion of the negative effects of cessation, which are associated with nicotine dependence. As chronic tobacco smokers are at risk of dependence, this is a form of impulsiveness that is of high importance ( 75 ). Young adults who are chronic smokers also show more risk-taking behaviours than their counterparts ( 4 , 76 ).

Intriguingly, when considering the younger ages of the individuals included in this meta-analysis, it is proposed that neurocognitive impairments are associated with a relatively short history of chronic tobacco smoking. This may suggest that smoking at an early stage of life predisposes the brain to progressive neurocognitive impairments, (e.g. heightened motor impulsivity). This may lead to the development of compulsive tobacco-seeking and smoking behaviour during adulthood, therefore negatively impacting quality of life and increasing the risk of adverse health outcomes ( 77 ). This proposed relationship between early onset tobacco smoking and compulsive tobacco smoking during adulthood, however, remains speculative at this stage due to the lack of robust longitudinal studies.

4.3 Strengths and limitations of the methods used and the results

To gather both qualitative and quantitative data, various online databases were used to identify the studies pooled for this systematic review and meta-analysis. The inclusion and exclusion criteria were stringent and allowed us to exclude participants with concurrent psychiatric illness, excessive alcohol intake, or polydrug use, as these were considered confounding variables.

The number of papers used in the current meta-analysis was low due to the lack of relevant research conducted on adolescents and young adults. This may have affected the results of the meta-analysis testing the association between chronic tobacco smoking and working memory impairments, as it was only possible to include three studies. There are discrepancies between the results of the quantitative and qualitative analyses for the domains assessed. This may have occurred due to the low number of studies that could be included in the meta-analysis and may also be the result of studies utilising different neurocognitive tests to assess the neurocognitive domains.

The reliability of results may be affected by including case-control studies, which are considered non-randomised studies (NRS). This may allow a larger or more unpredictable uncalculated bias to cause an underestimation or overestimation of the results ( 78 ). The inclusion of case-control NRSs is due to the lack of Randomized Controlled Trials (RCTs) carried out on chronic tobacco smoking.

The results of the meta-analysis identified an association between adolescent and young adult chronic tobacco smoking and neurocognitive impairments from cross-sectional data. Therefore, a direct causation cannot be inferred. Many other substances, such as alcohol, opioids, and stimulants, have been extensively explored in individuals, and subsequently have shown to affect neurocognitive functions ( 42 , 79 – 81 ). The results of this meta-analysis could be considered confounders for these individuals, as the users of these substances are likely to be concurrent chronic tobacco smokers, which may account for a degree of neurocognitive impairment identified in users of other substances ( 39 , 82 – 84 ). In the studies included in the current systematic review and meta-analysis, the number of pack years was not consistent and not reported in some studies. This may be also considered a confounding factor as research has shown a negative association between neurocognitive impairments and the number of pack-years ( 39 ).

The results of the study may have been influenced by confounding variables. This includes sociodemographic factors such as socioeconomic status, level of education, adverse childhood experiences, and parental difficulties. These variables have been shown to negatively affect the neurocognitive abilities of individuals ( 51 , 85 – 90 ).

Considering that the neurocognitive impairments identified by the current review may have been pre-morbid, longitudinal studies would be needed to investigate the directionality of the association between chronic tobacco smoking and neurocognitive impairments in adolescents and young adults. One such example has been demonstrated in a longitudinal study using Scottish data, where a lower childhood intelligence was found to be associated with a higher risk of becoming a smoker and continuing to smoke throughout life ( 91 ). Another confounding factor is the prevalence of concurrent undiagnosed neurodevelopmental disorders, such as attention deficit hyperactivity disorder (ADHD), in the assessed populations, which may influence the measured outcomes in neurocognitive testing.

A limitation of the studies being analysed during systematic review and meta-analysis is the lack of consistency in the nicotine withdrawal state of the tested chronic tobacco smoking participants. This is demonstrated through the insufficient descriptions of nicotine states and the variability in post-administration durations prior to assessment. Two studies did not include any information on this at all. This variability impacts the direct comparison of results between studies. It is important as the effects of nicotine withdrawal can begin after 4 hours, up until 3 days from the last administration of the nicotine ( 92 ). Using this cut-off, all the studies that declared the duration between the last administration of nicotine and neurocognitive assessments are within a defined and comparable period of nicotine administration that excludes states of nicotine withdrawal ( 5 , 18 , 21 , 30 , 43 , 53 , 54 ). Additionally, the statistically significant impairments in smokers versus non-smokers in multiple neurocognitive tests conducted shortly after nicotine administration suggest that any acute neurocognitive enhancing effects of nicotine administration were limited.

4.4 Clinical relevance

The neurocognitive impairments identified by the current review could be targeted by therapies such as Cognitive Rehabilitation Treatments (CRTs) and pre-treatment neuropsychological assessments, as aids for smoking cessation programs. CRTs are specialised procedures used to treat or improve neurocognitive functions, such as attention, problem-solving, learning and memory, and planning ( 39 ). Adolescents and young adults who are chronic smokers show more impulsivity in their decisions than their counterparts, therefore, some treatments that target this neurocognitive domain, such as Dialectical Behavioural Therapy (DBT) or Cognitive Behavioural Therapy (CBT), may be beneficial in smoking cessation programs ( 39 , 93 – 96 ).

Components of psychological therapy will benefit from improving the understanding of neurocognitive associations with chronic tobacco smoking, and other substance abuse disorders. Psychoeducation (PE) typically involves educating a patient about their condition to explore the emotional and motivational components they experience, which aims to improve the efficacy of treatment for that individual ( 97 ). This can be combined with education on related neuroscientific pathophysiology of a health condition, termed neuroscience-informed psychoeducation (NIPE). This could include any neurocognitive associations of chronic tobacco smoking, which the healthcare professional can employ to provide the patient with an enhanced understanding, and therefore improve their insight and decision-making, whilst also destigmatising the challenges of the conditions, leading to better compliance with treatment ( 97 ). An example of the application of neuroscientific understanding to PE is the program termed “Neurocognitive Empowerment for Addiction Treatment” (NEAT), which is planned to be implemented on patients with substance abuse disorders in an RCT undertaken by Ekhtiari et al. ( 98 ).

The socioeconomic associations with adverse long-term health and social outcomes have become well established, as described in the WHO Commission on Social Determinants of Health in 2008, as well as many other government-affiliated and independent institutions ( 99 – 101 ). By understanding the interactions between the determinants of health and the specific outcomes in adolescent chronic tobacco smokers, policymakers can target appropriate interventions. For example, recent data from the UK show that one in four unemployed adults are smokers, almost twice the probability of an employed person, and over 28% of people with no formal qualifications are smokers, compared to 12% of people who have obtained higher education ( 8 ). Using data from the English Index of Multiple Deprivation, the rate of smoking in the population (over the age of 16) is 19% for the most deprived quintile, in comparison to 6% for the least deprived quintile ( 6 ). Identifying adolescent smokers as a high-risk group thus allows policymakers to target the population group’s circumstances that contribute most to the increased risk of commencing smoking during adolescence, such as school attendance or adverse childhood experiences, as well as their carers’ social circumstances including education and social capital, to improve overall long-term health and social outcomes across the population ( 71 , 100 , 102 – 104 ). Additionally, the syndemic nature of poor socioeconomic factors compounded by cognitive impairments at an early stage of tobacco smoking will be associated with a reduced probability of quitting smoking as an adult ( 105 ).

The significant increase in the adoption of electronic nicotine delivery systems (ENDS, also known as vapes or e-cigarettes) will be an ongoing concern. Survey data from the Action on Smoking and Health (ASH), carried out on the UK population, show that in 2022 more young people (11-18 years old) had participated in the use of vaping products (8.6%) than tobacco smoking (6.0%), in comparison to previous years, in which tobacco smoking had been more prevalent ( 106 ). A recent paper investigating ENDS by Wade et al. ( 107 ) suggests that the use of ENDS in 16-22-year-old participants is not associated with any neurocognitive impairments, once controlled for alcohol use, substance use, and sociodemographic factors. It demonstrated that there were no significant differences in neurocognitive performance between nicotine users and nicotine-naïve users, whilst the comparison between the ENDS and the tobacco-smoking group is confounded by the concurrent use of ENDS by the tobacco-smoking group.

5 Conclusion

This systematic review and meta-analysis proposed a cross-sectional relationship between chronic tobacco smoking and neurocognitive impairments in adolescents and young adults. The number of studies pooled for both qualitative and quantitative analyses was, however, relatively low, suggesting that further research is needed to investigate the cross-sectional relationship between chronic smoking and neurocognitive impairments in young people. Furthermore, longitudinal studies are needed to investigate the temporal relationship between tobacco smoking uptake during adolescence or young adulthood and neurocognitive impairments. A comprehensive understanding of the relationship between young smokers and adverse neurocognitive outcomes may provide opportunities to optimise clinical and public health policymaking to improve outcomes in mortality, morbidity, and quality of life. This is especially important in the context of the increasing popularity of alternative methods of nicotine administration, such as e-cigarettes or vapes, which also need particular focus.

Data availability statement

The original contributions presented in the study are included in the article/ Supplementary Material . Further inquiries can be directed to the corresponding author.

Author contributions

AE: Data curation, Formal analysis, Investigation, Methodology, Software, Visualization, Writing – original draft, Writing – review & editing. SV: Data curation, Formal analysis, Investigation, Methodology, Software, Writing – original draft, Writing – review & editing. AC: Conceptualization, Data curation, Formal analysis, Methodology, Software, Supervision, Visualization, Writing – original draft, Writing – review & editing. AB: Conceptualization, Funding acquisition, Methodology, Project administration, Supervision, Writing – review & editing.

The author(s) declare that no financial support was received for the research, authorship, and/or publication of this article.

Acknowledgments

We thank the St Andrews University librarians for their support throughout the research project.

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Supplementary material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fpsyt.2024.1384408/full#supplementary-material

Supplementary Figure 1 | Funnel’s plot for Motor impulsivity-Stroop Task-Reaction Delay.

Supplementary Figure 2 | Funnel’s plot for Motor impulsivity-Stroop Task-Incongruent errors.

Supplementary Figure 3 | Funnel’s plot for Intelligence.

Supplementary Table 1 | Impulsivity.

Supplementary Table 2 | Cognitive Flexibility and Attention.

Supplementary Table 3 | Memory and learning.

Supplementary Table 4 | National Institutes of Health Study Quality Assessment Questionnaire.

Supplementary Table 5 | PRISMA Checklist.

1. WHO. Tobacco (2022). World Health Organisation. Available online at: https://www.who.int/news-room/fact-sheets/detail/tobacco (Accessed 24 July 2023).

Google Scholar

2. Reitsma MB, Flor LS, Mullany EC, Gupta V, Hay SI, Gakidou E. Spatial, temporal, and demographic patterns in prevalence of smoking tobacco use and initiation among young people in 204 countries and territories 1990-2019. Lancet Public Health . (2021) 6:e472–81. doi: 10.1016/S2468-2667(21)00102-X

PubMed Abstract | CrossRef Full Text | Google Scholar

3. Benowitz NL. Clinical pharmacology of nicotine: implications for understanding, preventing, and treating tobacco addiction. Clin Pharmacol Ther . (2008) 83:531–41. doi: 10.1038/clpt.2008.3

4. Durazzo TC, Meyerhoff DJ, Nixon SJ. Chronic cigarette smoking: implications for neurocognition and brain neurobiology. Int J Environ Res Public Health . (2010) 7:3760–91. doi: 10.3390/ijerph7103760

5. Li Y, Yuan K, Guan Y, Cheng J, Bi Y, Shi S, et al. The implication of salience network abnormalities in young male adult smokers. Brain Imaging Behav . (2017) 11:943–53. doi: 10.1007/s11682-016-9568-8

6. NHS England. Health Survey for England . NHS Digital (2021). Available at: https://digital.nhs.uk/data-and-information/publications/statistical/health-survey-for-england/2021/part-1-smoking .

7. The Scottish Government. (2018). Public Health Priorities for Scotland. The Scottish Government: The Scottish government.

8. ONS. Adult smoking habits in the UK: 2021 (2022). Office for National Statistics. Available online at: https://www.ons.gov.uk/peoplepopulationandcommunity/healthandsocialcare/healthandlifeexpectancies/bulletins/adultsmokinghabitsingreatbritain/2021 (Accessed 28 Aug 2022).

9. NHS Digital. Statistics on Smoking, England 2020 (2020). NHS Digital. Available online at: https://digital.nhs.uk/data-and-information/publications/statistical/statistics-on-smoking/statistics-on-smoking-england-2020 (Accessed 24 Aug 2023).

10. Morales AM, Ghahremani D, Kohno M, Hellemann GS, London ED. Cigarette exposure, dependence, and craving are related to insula thickness in young adult smokers. Neuropsychopharmacology . (2014) 39:1816–22. doi: 10.1038/npp.2014.48

11. Park SH. Smoking and adolescent health. Korean J Pediatr . (2011) 54:401–4. doi: 10.3345/kjp.2011.54.10.401

12. Le Foll B, Piper ME, Fowler CD, Tonstad S, Bierut L, Lu L, et al. Tobacco and nicotine use. Nat Rev Dis Primers . (2022) 8:19. doi: 10.1038/s41572-022-00346-w

13. Walker J, Loprinzi P. Longitudinal examination of predictors of smoking cessation in a national sample of U.S. Adolescent and young adult smokers. Nicotine Tobacco Res . (2014) 16:820–7. doi: 10.1093/ntr/ntu005

CrossRef Full Text | Google Scholar

14. Taioli E, Wynder EL. Effect of the age at which smoking begins on frequency of smoking in adulthood. N Engl J Med . (1991) 325:968–9. doi: 10.1056/NEJM199109263251318

15. O’loughlin J, Difranza J, Tyndale RF, Meshefedjian G, Mcmillan-Davey E, Clarke PB, et al. Nicotine-dependence symptoms are associated with smoking frequency in adolescents. Am J Prev Med . (2003) 25:219–25. doi: 10.1016/S0749-3797(03)00198-3

16. White HR, Bray BC, Fleming CB, Catalano RF. Transitions into and out of light and intermittent smoking during emerging adulthood. Nicotine Tob Res . (2009) 11:211–9. doi: 10.1093/ntr/ntn017

17. Chronic Disease Centre. Preventing Tobacco Use Among Youth and Young Adults: A Report of the Surgeon General . National Center for Chronic Disease Prevention and Health Promotion (NCCDPHP (2012). Available at: https://www.ncbi.nlm.nih.gov/books/NBK99242/ .

18. Feng D, Yuan K, Li Y, Cai C, Yin J, Bi Y, et al. Intra-regional and inter-regional abnormalities and cognitive control deficits in young adult smokers. Brain Imaging Behav . (2015) 10:506–16. doi: 10.1007/s11682-015-9427-z

19. Spear LP. The adolescent brain and age-related behavioral manifestations. Neurosci Biobehav Rev . (2000) 24:417–63. doi: 10.1016/S0149-7634(00)00014-2

20. Spear LP. Adolescent neurodevelopment. J Adolesc Health . (2013) 52:S7–13. doi: 10.1016/j.jadohealth.2012.05.006

21. Yuan M, Cross SJ, Loughlin SE, Leslie FM. Nicotine and the adolescent brain. J Physiol . (2016) 593:3397–412. doi: 10.1113/JP270492

22. Paus T. Mapping brain maturation and cognitive development during adolescence. Trends Cognit Sci . (2005) 9:60–8. doi: 10.1016/j.tics.2004.12.008

23. Gavin L, Mackay AP, Brown K, Harrier S, Ventura SJ, Kann L, et al. Sexual and reproductive health of persons aged 10–24 years—United States 2002–2007. MMWR surveill Summ . (2009) 58:1–58.

PubMed Abstract | Google Scholar

24. Arain M, Haque M, Johal L, Mathur P, Nel W, Rais A, et al. Maturation of the adolescent brain. Neuropsychiatr Dis Treat . (2013) 9:449–61. doi: 10.2147/NDT

25. Sylwester R. The Adolescent Brain: Reaching for Autonomy . Newbury Park (CA: Corwin Press (2007).

26. Accogli A, Addour-Boudrahem N, Srour M. Neurogenesis, neuronal migration, and axon guidance. Handb Clin Neurol . (2020) 173:25–42. doi: 10.1016/B978-0-444-64150-2.00004-6

27. Rakic P, Bourgeois JP, Goldman-Rakic PS. Synaptic development of the cerebral cortex: implications for learning, memory, and mental illness. Prog Brain Res . (1994) 102:227–43. doi: 10.1016/S0079-6123(08)60543-9

28. Sydnor VJ, Larsen B, Bassett DS, Alexander-Bloch A, Fair DA, Liston C, et al. Neurodevelopment of the association cortices: Patterns, mechanisms, and implications for psychopathology. Neuron . (2021) 109:2820–46. doi: 10.1016/j.neuron.2021.06.016

29. Goriounova NA, Mansvelder HD. Short- and long-term consequences of nicotine exposure during adolescence for prefrontal cortex neuronal network function. Cold Spring Harb Perspect Med . (2012) 2:a012120. doi: 10.1101/cshperspect.a012120

30. Jacobsen LK, Krystal JH, Mencl WE, Westerveld M, Frost SJ, Pugh KR. Effects of smoking and smoking abstinence on cognition in adolescent tobacco smokers. Biol Psychiatry . (2005) 57:56–66. doi: 10.1016/j.biopsych.2004.10.022

31. Musso F, Bettermann F, Vucurevic G, Stoeter P, Konrad A, Winterer G. Smoking impacts on prefrontal attentional network function in young adult brains. Psychopharmacol (Berl) . (2007) 191:159–69. doi: 10.1007/s00213-006-0499-8

32. Brown RA, Lewinsohn PM, Seeley JR, Wagner EF. Cigarette smoking, major depression, and other psychiatric disorders among adolescents. J Am Acad Child Adolesc Psychiatry . (1996) 35:1602–10. doi: 10.1097/00004583-199612000-00011

33. Brook JS, Cohen P, Brook DW. Longitudinal study of co-occurring psychiatric disorders and substance use. J Am Acad Child Adolesc Psychiatry . (1998) 37:322–30. doi: 10.1097/00004583-199803000-00018

34. Johnson JG, Cohen P, Pine DS, Klein DF, Kasen S, Brook JS. Association between cigarette smoking and anxiety disorders during adolescence and early adulthood. JAMA . (2000) 284:2348–51. doi: 10.1001/jama.284.18.2348

35. McGee R, Williams S, Poulton R, Moffitt T. A longitudinal study of cannabis use and mental health from adolescence to early adulthood. Addiction . (2000) 95:491–503. doi: 10.1046/j.1360-0443.2000.9544912.x

36. Ellickson PL, Tucker JS, Klein DJ. High-risk behaviors associated with early smoking: results from a 5-year follow-up. J Adolesc Health . (2001) 28:465–73. doi: 10.1016/S1054-139X(00)00202-0

37. Brook DW, Brook JS, Zhang C, Cohen P, Whiteman M. Drug use and the risk of major depressive disorder, alcohol dependence, and substance use disorders. Arch Gen Psychiatry . (2002) 59:1039–44. doi: 10.1001/archpsyc.59.11.1039

38. Terry AV Jr., Jones K, Bertrand D. Nicotinic acetylcholine receptors in neurological and psychiatric diseases. Pharmacol Res . (2023) 191:106764. doi: 10.1016/j.phrs.2023.106764

39. Conti AA, Mclean L, Tolomeo S, Steele JD, Baldacchino A. Chronic tobacco smoking and neuropsychological impairments: A systematic review and meta-analysis. Neurosci Biobehav Rev . (2019) 96:143–54. doi: 10.1016/j.neubiorev.2018.11.017

40. Stroup DF, Berlin JA, Morton SC, Olkin I, Williamson GD, Rennie D, et al. Meta-analysis of observational studies in epidemiology: a proposal for reporting. Meta-analysis Of Observational Studies in Epidemiology (MOOSE) group. JAMA . (2000) 283:2008–12. doi: 10.1001/jama.283.15.2008

41. Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JP, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. PloS Med . (2009) 6:e1000100. doi: 10.1371/journal.pmed.1000100

42. Baldacchino A, Balfour DJ, Passetti F, Humphris G, Matthews K. Neuropsychological consequences of chronic opioid use: a quantitative review and meta-analysis. Neurosci Biobehav Rev . (2012) 36:2056–68. doi: 10.1016/j.neubiorev.2012.06.006

43. Bi Y, Yuan K, Guan Y, Cheng J, Zhang Y, Li Y, et al. Altered resting state functional connectivity of anterior insula in young smokers. Brain Imaging Behav . (2017) 11:155–65. doi: 10.1007/s11682-016-9511-z

44. Al-Mshari AAS, Alsheikh MH, Latif R, Mumtaz S. The effect of smoking on cognition as measured by Cambridge Neuropsychological Test Automated Battery (CATNAB) and brain-derived neurotrophic factor plasma levels. Saudi Med J . (2020) 41:1308–14. doi: 10.15537/smj.2020.12.25513

45. Borenstein M, Higgins JP. Meta-analysis and subgroups. Prev Sci . (2013) 14:134–43. doi: 10.1007/s11121-013-0377-7

46. Figueiredo PR, Tolomeo S, Steele JD, Baldacchino A. Neurocognitive consequences of chronic cannabis use: a systematic review and meta-analysis. Neurosci Biobehav Rev . (2020) 108:358–69. doi: 10.1016/j.neubiorev.2019.10.014

47. Higgins JPT, Lopez-Lopez JA, Becker BJ, Davies SR, Dawson S, Grimshaw JM, et al. Synthesising quantitative evidence in systematic reviews of complex health interventions. BMJ Glob Health . (2019) 4:e000858. doi: 10.1136/bmjgh-2018-000858

48. Doggui R, Elsawy W, Conti AA, Baldacchino A. Association between chronic psychoactive substances use and systemic inflammation: A systematic review and meta-analysis. Neurosci Biobehav Rev . (2021) 125:208–20. doi: 10.1016/j.neubiorev.2021.02.031

49. Cohen J. Statistical Power Analysis for the Behavioral Sciences . New York: Routledge (1988).

50. Dickersin K. Publication Bias: Recognizing the Problem, Understanding Its Origins and Scope, and Preventing Harm . (2005) 9–33. doi: 10.1002/0470870168.ch2

51. Salthouse TA. When does age-related cognitive decline begin? Neurobiol Aging . (2009) 30:507–14. doi: 10.1016/j.neurobiolaging.2008.09.023

52. National Institutes of Health. Study Quality Assessment Tools (2021). Naitonal Heart Lung and Blood Institute. Available online at: https://www.nhlbi.nih.gov/health-topics/study-quality-assessment-tools (Accessed Feb 2024).

53. Maurage P, Heeren A, Lannoy S, Flaudias V. The role of attentional networks in smoking behavior among young adults: specific contribution of executive control. Nicotine Tob Res . (2022) 24:1906–13. doi: 10.1093/ntr/ntac124

54. Zhao X, Liu X, Zan X, Jin G, Maes JH. Male smokers’ and non-smokers’ Response inhibition in go/no-go tasks: effect of three task parameters. PloS One . (2016) 11:e0160595. doi: 10.1371/journal.pone.0160595

55. Bashir S, Alghamd F, Alhussien A, Alohali M, Alatawi A, Almusned T, et al. Effect of smoking on cognitive functioning in young saudi adults. Med Sci Monit Basic Res . (2017) 23:31–5. doi: 10.12659/MSMBR.902385

56. Heffernan TM, Carling A, O’neill TS, Hamilton C. Smoking impedes executive function and related prospective memory. Ir J Psychol Med . (2014) 31:159–65. doi: 10.1017/ipm.2014.17

57. Vajravelu HR, Gnanadurai TK, Krishnan P, Ayyavoo S. Impact of quantified smoking status on cognition in young adults. J Clin Diagn Res . (2015) 9:CC01–3. doi: 10.7860/JCDR/2015/16444.6867

58. McClernon FJ, Froeliger B, Rose JE, Kozink RV, Addicott MA, Sweitzer MM, et al. The effects of nicotine and non-nicotine smoking factors on working memory and associated brain function. Addict Biol . (2016) 21:954–61. doi: 10.1111/adb.2016.21.issue-4

59. Campos MW, Serebrisky D, Castaldelli-Maia JM. Smoking and cognition. Curr Drug Abuse Rev . (2016) 9:76–9. doi: 10.2174/1874473709666160803101633

60. Franklin TR, Wetherill RR, Jagannathan K, Johnson B, Mumma J, Hager N, et al. The effects of chronic cigarette smoking on gray matter volume: influence of sex. PloS One . (2014) 9:e104102. doi: 10.1371/journal.pone.0104102

61. Volkow ND, Koob GF, Mclellan AT. Neurobiologic advances from the brain disease model of addiction. N Engl J Med . (2016) 374:363–71. doi: 10.1056/NEJMra1511480

62. Potter AS, Newhouse PA. Acute nicotine improves cognitive deficits in young adults with attention-deficit/hyperactivity disorder. Pharmacol Biochem Behav . (2008) 88:407–17. doi: 10.1016/j.pbb.2007.09.014

63. Heishman SJ, Kleykamp BA, Singleton EG. Meta-analysis of the acute effects of nicotine and smoking on human performance. Psychopharmacol (Berl) . (2010) 210:453–69. doi: 10.1007/s00213-010-1848-1

64. Fried PA, Watkinson B, Gray R. Neurocognitive consequences of cigarette smoking in young adults–a comparison with pre-drug performance. Neurotoxicol Teratol . (2006) 28:517–25. doi: 10.1016/j.ntt.2006.06.003

65. Yakir A, Rigbi A, Kanyas K, Pollak Y, Kahana G, Karni O, et al. Why do young women smoke? III. Attention and impulsivity as neurocognitive predisposing factors. Eur Neuropsychopharmacol . (2007) 17:339–51. doi: 10.1016/j.euroneuro.2006.09.004

66. Weiser M, Zarka S, Werbeloff N, Kravitz E, Lubin G. Cognitive test scores in male adolescent cigarette smokers compared to non-smokers: a population-based study. Addiction . (2010) 105:358–63. doi: 10.1111/j.1360-0443.2009.02740.x

67. DeBry SC, Tiffany ST. Tobacco-induced neurotoxicity of adolescent cognitive development (TINACD): a proposed model for the development of impulsivity in nicotine dependence. Nicotine Tob Res . (2008) 10:11–25. doi: 10.1080/14622200701767811

68. Conti AA, Baldacchino AM. Neuroanatomical correlates of impulsive choices and risky decision making in young chronic tobacco smokers: A voxel-based morphometry study. Front Psychiatry . (2021) 12:708925. doi: 10.3389/fpsyt.2021.708925

69. Leslie FM. Unique, long-term effects of nicotine on adolescent brain. Pharmacol Biochem Behav . (2020) 197:173010. doi: 10.1016/j.pbb.2020.173010

70. Xiang S, Jia T, Xie C, Cheng W, Chaarani B, Banaschewski T, et al. Association between vmPFC gray matter volume and smoking initiation in adolescents. Nat Commun . (2023) 14:4684. doi: 10.1038/s41467-023-40079-2

71. Joannes C, Castagne R, Kelly-Irving M. Associations of adverse childhood experiences with smoking initiation in adolescence and persistence in adulthood, and the role of the childhood environment: Findings from the 1958 British birth cohort. Prev Med . (2022) 156:106995. doi: 10.1016/j.ypmed.2022.106995

72. Bloom EL, Matsko SV, Cimino CR. The relationship between cigarette smoking and impulsivity: A review of personality, behavioral, and neurobiological assessment. Addict Res Theory . (2013) 22:386–97. doi: 10.3109/16066359.2013.867432

73. Potvin S, Tikasz A, Dinh-Williams LL, Bourque J, Mendrek A. Cigarette cravings, impulsivity, and the brain. Front Psychiatry . (2015) 6:125. doi: 10.3389/fpsyt.2015.00125

74. Balevich EC, Wein ND, Flory JD. Cigarette smoking and measures of impulsivity in a college sample. Subst Abus . (2013) 34:256–62. doi: 10.1080/08897077.2012.763082

75. Flory JD, Manuck SB. Impulsiveness and cigarette smoking. Psychosom Med . (2009) 71:431–7. doi: 10.1097/PSY.0b013e3181988c2d

76. Wallsten TS, Pleskac TJ, Lejuez CW. Modeling behavior in a clinically diagnostic sequential risk-taking task. Psychol Rev . (2005) 112:862–80. doi: 10.1037/0033-295X.112.4.862

77. Conti AA, Baldacchino AM. Early-onset smoking theory of compulsivity development: a neurocognitive model for the development of compulsive tobacco smoking. Front Psychiatry . (2023) 14:1209277. doi: 10.3389/fpsyt.2023.1209277

78. Deeks JJ, Dinnes J, D’amico R, Sowden AJ, Sakarovitch C, Song F, et al. Evaluating non-randomised intervention studies. Health Technol Assess . (2003) 7:iii–x, 1-173. doi: 10.3310/hta7270

79. Mitchell JM, Fields HL, D’esposito M, Boettiger CA. Impulsive responding in alcoholics. Alcohol Clin Exp Res . (2005) 29:2158–69. doi: 10.1097/01.alc.0000191755.63639.4a

80. Verdejo-Garcia AJ, Perales JC, Perez-Garcia M. Cognitive impulsivity in cocaine and heroin polysubstance abusers. Addict Behav . (2007) 32:950–66. doi: 10.1016/j.addbeh.2006.06.032

81. Reed SC, Levin FR, Evans SM. Alcohol increases impulsivity and abuse liability in heavy drinking women. Exp Clin Psychopharmacol . (2012) 20:454–65. doi: 10.1037/a0029087

82. Lai S, Lai H, Page JB, Mccoy CB. The association between cigarette smoking and drug abuse in the United States. J Addict Dis . (2000) 19:11–24. doi: 10.1300/J069v19n04_02

83. Richter KP, Ahluwalia HK, Mosier MC, Nazir N, Ahluwalia JS. A population-based study of cigarette smoking among illicit drug users in the United States. Addiction . (2002) 97:861–9. doi: 10.1046/j.1360-0443.2002.00162.x

84. McCool RM, Paschall Richter K. Why do so many drug users smoke? J Subst Abuse Treat . (2003) 25:43–9. doi: 10.1016/S0740-5472(03)00065-5

85. Pauly JR. Gender differences in tobacco smoking dynamics and the neuropharmacological actions of nicotine. Front Biosci . (2008) 13:505–16. doi: 10.2741/2696

86. Mani A, Mullainathan S, Shafir E, Zhao J. Poverty impedes cognitive function. Science . (2013) 341:976–80. doi: 10.1126/science.1238041

87. Murman DL. The impact of age on cognition. Semin Hear . (2015) 36:111–21. doi: 10.1055/s-00000067

88. Pear VA, Petito LC, Abrams B. The role of maternal adverse childhood experiences and race in intergenerational high-risk smoking behaviors. Nicotine Tob Res . (2017) 19:623–30. doi: 10.1093/ntr/ntw295

89. Al’Absi M, Nakajima M, Lemieux A. Impact of early life adversity on the stress biobehavioral response during nicotine withdrawal. Psychoneuroendocrinology . (2018) 98:108–18. doi: 10.1016/j.psyneuen.2018.08.022

90. Piumatti G, Moore SC, Berridge DM, Sarkar C, Gallacher J. The relationship between alcohol use and long-term cognitive decline in middle and late life: a longitudinal analysis using UK Biobank. J Public Health (Oxf) . (2018) 40:304–11. doi: 10.1093/pubmed/fdx186

91. Corley J, Gow AJ, Starr JM, Deary IJ. Smoking, childhood IQ, and cognitive function in old age. J Psychosom Res . (2012) 73:132–8. doi: 10.1016/j.jpsychores.2012.03.006

92. McLaughlin I, Dani JA, De Biasi M. Nicotine Withdrawal. In: The Neuropharmacology of Nicotine Dependence (2015) 99–123. doi: 10.1007/978-3-319-13482-6_4

93. Chase HW, Hogarth L. Impulsivity and symptoms of nicotine dependence in a young adult population. Nicotine Tob Res . (2011) 13:1321–5. doi: 10.1093/ntr/ntr114

94. Kolokotroni KZ, Rodgers RJ, Harrison AA. Acute nicotine increases both impulsive choice and behavioural disinhibition in rats. Psychopharmacol (Berl) . (2011) 217:455–73. doi: 10.1007/s00213-011-2296-2

95. Neto VSC, De Freitas PSL, Rezende R, Doll MMR, Brandão D. RetenÇÃo da carga orgÂnica E de cations em filtros operando com águas residuÁrias da suinocultura. Irriga . (2011) 16. doi: 10.15809/irriga.2011v16n2

96. Kale D, Stautz K, Cooper A. Impulsivity related personality traits and cigarette smoking in adults: A meta-analysis using the UPPS-P model of impulsivity and reward sensitivity. Drug Alcohol Depend . (2018) 185:149–67. doi: 10.1016/j.drugalcdep.2018.01.003

97. Ekhtiari H, Rezapour T, Aupperle RL, Paulus MP. Neuroscience-informed psychoeducation for addiction medicine: A neurocognitive perspective. Prog Brain Res . (2017) 235:239–64. doi: 10.1016/bs.pbr.2017.08.013

98. Ekhtiari H, Rezapour T, Sawyer B, Yeh HW, Kuplicki R, Tarrasch M, et al. Neurocognitive Empowerment for Addiction Treatment (NEAT): study protocol for a randomized controlled trial. Trials . (2021) 22:330. doi: 10.1186/s13063-021-05268-8

99. WHO. Closing the gap in a generation: Health equity through action on the social determinants of health: final report of the commission on social determinants of health . World Health Organisation (2008). Available at: https://www.who.int/publications/i/item/9789241563703 .

100. Public Health England. Chapter 6: wider determinants of health (2018). Gov.uk: Public Health England. Available online at: https://www.gov.uk/government/publications/health-profile-for-england-2018/chapter-6-wider-determinants-of-health#social-capital (Accessed 28 Aug 2023).

101. The King’s Fund. What are health inequalities? (2022). The King’s Fund. Available online at: https://www.kingsfund.org.uk/publications/what-are-health-inequalities (Accessed 28 Aug 2023).

102. Casetta B, Videla AJ, Bardach A, Morello P, Soto N, Lee K, et al. Association between cigarette smoking prevalence and income level: A systematic review and meta-analysis. Nicotine Tob Res . (2017) 19:1401–7. doi: 10.1093/ntr/ntw266

103. Perelman J, Leao T, Kunst AE. Smoking and school absenteeism among 15- to 16-year-old adolescents: a cross-section analysis on 36 European countries. Eur J Public Health . (2019) 29:778–84. doi: 10.1093/eurpub/ckz110

104. NHS Digital. Smoking, Drinking and Drug Use among Young People in England (2022). NHS Digital. Available online at: https://digital.nhs.uk/data-and-information/publications/statistical/smoking-drinking-and-drug-use-among-young-people-in-england/2021 (Accessed 28 Aug 2023).

105. Hiscock R, Bauld L, Amos A, Fidler JA, Munafo M. Socioeconomic status and smoking: a review. Ann N Y Acad Sci . (2012) 1248:107–23. doi: 10.1111/j.1749-6632.2011.06202.x

106. Office For Health Improvement and Disparities. Nicotine vaping in England: an evidence update including health risks and perceptions 2022 . gov.uk: UK Government (2022). Available at: https://www.gov.uk/government/publications/nicotine-vaping-in-england-2022-evidence-update/nicotine-vaping-in-england-2022-evidence-update-main-findings .

107. Wade NE, Courtney KE, Doran N, Baca R, Aguinaldo LD, Thompson C, et al. Young adult E-cigarette and combustible tobacco users attitudes, substance use behaviors, mental health, and neurocognitive performance. Brain Sci . (2022) 12. doi: 10.3390/brainsci12070889

Keywords: nicotine, chronic smoking, tobacco, neuropsychology, neurocognitive impairment, adolescents, young adults, systematic review

Citation: Elatfy A, Vrahimis S, Conti A and Baldacchino A (2024) Chronic tobacco smoking and neurocognitive impairments in adolescents and young adults: a systematic review and meta-analysis. Front. Psychiatry 15:1384408. doi: 10.3389/fpsyt.2024.1384408

Received: 09 February 2024; Accepted: 02 April 2024; Published: 23 April 2024.

Reviewed by:

Copyright © 2024 Elatfy, Vrahimis, Conti and Baldacchino. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY) . The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Sebastian Vrahimis, [email protected]

† These authors have contributed equally to this work and share first authorship

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.

• Matters Arising
• Open access
• Published: 22 April 2024

Physical activity and psychological support can replace “another pill” to manage cancer-related symptoms in children and adolescents diagnosed with cancer

• Maxime Caru 1 , 2   na1 ,
• Ariane Levesque 3   na1 ,
• Smita Dandekar 1 &
• Kathryn H. Schmitz 4  

BMC Complementary Medicine and Therapies volume  24 , Article number:  170 ( 2024 ) Cite this article

Metrics details

Matters Arising to this article was published on 22 April 2024

The Original Article was published on 03 April 2023

The management of cancer-related symptoms with nonpharmacological treatment has been proven effective, but more studies are still required to strengthen the scientific evidence. Given the state of the evidence, one might wonder about the perceptions of pediatric oncology experts, healthcare providers and CAM providers regarding the use of supportive care in pediatric oncology. Related to this important question, Mora et al. recently published an exploratory qualitative study entitled “Supportive care for cancer-related symptoms in pediatric oncology: a qualitative study among healthcare providers” in the BMC Complementary Medicine and Therapies Journal. The data generated by the authors provided new insights and perspectives to the current literature. However, their findings must be put into perspective to increase the scope of the original article and to highlight that physical activity and psychosocial interventions are powerful nonpharmacological interventions to manage cancer-related symptoms.

Peer Review reports

We read with interest the exploratory qualitative study published in BMC Complementary Medicine and Therapies Journal by Dana C. Mora and colleagues [ 1 ] and wish to comment on some matters in this manuscript to provide additional insightful information about supportive care in pediatric oncology.

Children and adolescents diagnosed with cancer who have been treated with conventional medicines (chemotherapy, radiotherapy, surgery) have a 5-year overall survival rate greater than 85%. However, they often survive at the expense of several cancer therapy related adverse events affecting their health, and long-term morbidity and mortality. Late effects include a spectrum of health-related complications including fatigue, nausea, pain, depression symptoms, anxiety, sleep disturbance, and physical limitations [ 2 , 3 ]. The majority of children and adolescents diagnosed with cancer will have at least 1 late effect, which can be severe or even life threatening in about 25% of childhood cancer survivors [ 4 ]. Thus, the growing number of diagnoses and survivors, along with a better understanding of the long-term effects of cancer therapies, has led to new complementary and alternative medicine (CAM) modalities, such as physical activity, nutrition and psychosocial support. Although the management of cancer-related symptoms with nonpharmacological treatment has been proven effective, more studies are still required to strengthen the scientific evidence. Given the state of the evidence, one might wonder about the perceptions of pediatric oncology experts, healthcare providers and CAM providers regarding the use of supportive care in pediatric oncology.

Related to this important question, Mora et al., recently published an exploratory qualitative study [ 1 ]. The authors conducted 22 semi-structured individual interviews to better understand the philosophical and medical context of supportive care modalities, including complementary and alternative medicine modalities in children and adolescents diagnosed with cancer. Participants interviewed were pediatric oncologists ( N  = 6), nurses ( N  = 5), acupuncturists ( N  = 5), healers ( N  = 3), nutritionists ( N  = 2), physiotherapist ( N  = 1), play therapist ( N  = 1), massage therapist ( N  = 1), music therapist ( N  = 1), psychodrama therapist ( N  = 1), anthroposophic medicine ( N  = 1) and homeopath ( N  = 1) with clinical experience in pediatric supportive care from Canada, the Netherlands, Norway, Germany, and the United States. The authors recognized that all the participants interviewed were from high-income countries which could limit the generalizability of the results to low, lower-middle and upper-middle countries.

The data generated by the authors provided new insights and perspectives to the current literature [ 1 ]. However, their findings must be put into perspective since they might give a biased overview of the perceptions of experts and providers regarding the use of supportive care in pediatric oncology since some of the most empirically supported disciplines by the scientific literature in pediatric oncology were not included. Indeed, even though physical activity and psychological support emerge as core CAM interventions, no experts in these fields were included in the study by Mora et al. [ 1 , 5 , 6 ]. The lack of inclusion of these important disciplines therefore restricted their qualitative analysis which could have benefited from the inclusion of these perspectives to give a complete overview of supportive care in pediatric oncology. It was also surprising to read that two oncologists interviewed were skeptical about the use of CAM modalities due to the lack of evidence. This response is understandable considering that it appears that the authors did not thoroughly define what they meant by “CAM modalities” within the supportive care system in pediatric oncology. Hence, participants were only able to provide their general opinion on the matter, despite the fact that there is a variety of CAM modalities that have been explored in pediatric oncology [ 7 ].

A powerful statement from one of the oncologists was as follows: “There are symptoms like fatigue, anxiety, insomnia, that we just don’t have the interventions for. I am thinking there has got to be a better way to make people feel better as they’re going through their cancer treatments that doesn’t just involve asking, particularly children, to take more medicines” [ 1 ]. Fortunately for children and adolescents diagnosed with cancer, there are other interventions for them to feel better that do not require taking another pill. Indeed, evidence-based medicine has shown important improvements in the management of a myriad of cancer-related symptoms with physical activity, nutrition and psychosocial support in children and adolescents diagnosed with cancer [ 8 , 9 , 10 ]. The recent International Pediatric Oncology Exercise Guidelines highlighted that physical activity should be integrated within the standard care of pediatric oncology due to its several benefits on children and adolescents’ health to manage and improve their long-term symptoms [ 11 ]. These guidelines also align with the American College of Sports Medicine recommendations for cancer survivors highlighting that exercise is medicine in oncology [ 12 ]. It has also been argued that psychological support should emerge as standard care in pediatric oncology due to its effectiveness in reducing emotional distress in both children and adolescents, and their parents [ 13 ]. It is therefore disappointing to note that no exercise physiologists or psychologists were interviewed in Mora’s study and that the authors did not discuss physical activity or psychological support as a CAM modality in their paper, despite their high level of evidence in pediatric oncology.

We could not agree more with the authors, however, that it is important to provide accurate information regarding CAM modalities that come from reliable sources, such as pediatric oncology experts. Since physical activity and psychological support emerge as some of the CAM interventions with the most empirical support [ 5 , 6 ], experts in these fields need to be consulted for these supportive interventions to be systematically implemented in a rigorous manner. Indeed, despite strong evidence supporting their benefits, patients are not yet systematically referred to exercise physiologists and psychologists. To illustrate, only 1 out of 5 oncology experts refer their patients to physical activity programs [ 14 ], even though almost 4 out of 5 report being willing to recommend to their patients to be more active [ 15 ]. Nevertheless, oncology experts are often aware of the potential benefits of physical activity. Indeed, a study found that almost 90% of physicians recommend physical activity to their patients, while the other 10% recognize their lack of training in this area, which limits their expertise to recommend physical activity to their patients [ 16 ]. Regarding psychological support, in the early 2000s, one study found that only 32% of pediatric cancer patients were referred for psychological consultation [ 17 ]. Although this rate is likely higher today, referring families to psychologists with experience in pediatric oncology remains of utmost importance, especially considering the unique psychological issues that can be faced by children and adolescents diagnosed with cancer.

In conclusion, the study of Mora et al. provides insightful information on clinical care, clinical care guidelines, and policy-making decisions for cancer-related symptoms on the sole condition that all CAM modalities are taken into account. Doing so will contribute to improving supportive care in pediatric oncology and educate the key players in this field. It will also contribute to giving parents and patients valuable information to improve their general wellbeing and gain control over their cancer-related symptoms. Physical activity and psychosocial interventions are powerful nonpharmacological interventions to manage cancer-related symptoms that should be routinely offered to children and adolescents diagnosed with cancer.

Data availability

Data sharing not applicable to this article as no datasets were generated or analysed during the current study.

Code Availability

Not applicable.

Mora DC, Jong MC, Quandt SA, Arcury TA, Kristoffersen AE, Stub T. Supportive care for cancer-related symptoms in pediatric oncology: a qualitative study among healthcare providers. BMC Complement Med Ther. 2023;23(1):104.

Article   PubMed   PubMed Central   Google Scholar  

Bitsko MJ, Cohen D, Dillon R, Harvey J, Krull K, Klosky JL. Psychosocial Late effects in Pediatric Cancer survivors: a Report from the children’s Oncology Group. Pediatr Blood Cancer. 2016;63(2):337–43.

Article   PubMed   Google Scholar  

Limitations on Physical. Performance and daily activities among long-term survivors of Childhood Cancer. Ann Intern Med. 2005;143(9):639–47.

Article   Google Scholar  

Oeffinger KC, Eshelman DA, Tomlinson GE, Buchanan GR, Foster BM. Grading of late effects in young adult survivors of childhood cancer followed in an ambulatory adult setting. Cancer. 2000;88(7):1687–95.

Article   CAS   PubMed   Google Scholar  

Kwak HB. Core concept of integrative medicine: physical activity. Integr Med Res. 2016;5(3):169–70.

National Center for Complementary and Integrative Health. Complementary, Alternative, or Integrative Health: What’s In a Name? NIH, NCCIH. 2021 [Available from: https://www.nccih.nih.gov/health/complementary-alternative-or-integrative-health-whats-in-a-name .

Diorio C, Lam CG, Ladas EJ, Njuguna F, Afungchwi GM, Taromina K, et al. Global use of traditional and complementary medicine in childhood cancer: a systematic review. J Global Oncol. 2017;3(6):791–800.

Levesque A, Caru M, Duval M, Laverdière C, Marjerrison S, Sultan S. Cancer-related fatigue in childhood cancer survivors: a systematic scoping review on contributors of fatigue and how they are targeted by non-pharmacological interventions. Crit Rev Oncol Hematol. 2022;179:103804.

Rogers PC, Barr RD. The relevance of nutrition to pediatric oncology: a cancer control perspective. Pediatr Blood Cancer. 2020;67(Suppl 3):e28213.

Melesse TG, Chau JPC, Nan MA. Effectiveness of psychosocial interventions on health outcomes of children with cancer: a systematic review of randomised controlled trials. Eur J Cancer Care (Engl). 2022;31(6):e13695.

Wurz A, McLaughlin E, Lategan C, Ellis K, Culos-Reed SN. Synthesizing the literature on physical activity among children and adolescents affected by cancer: evidence for the international Pediatric Oncology Exercise guidelines (iPOEG). Transl Behav Med. 2021;11(3):699–708.

Campbell KL, Winters-Stone KM, Wiskemann J, May AM, Schwartz AL, Courneya KS, et al. Exercise guidelines for Cancer survivors: Consensus Statement from International Multidisciplinary Roundtable. Med Sci Sports Exerc. 2019;51(11):2375–90.

Steele AC, Mullins LL, Mullins AJ, Muriel AC. Psychosocial interventions and therapeutic support as a Standard of Care in Pediatric Oncology. Pediatr Blood Cancer. 2015;62(Suppl 5):S585–618.

PubMed   Google Scholar  

Schmitz KH, Campbell AM, Stuiver MM, Pinto BM, Schwartz AL, Morris GS, et al. Exercise is medicine in oncology: engaging clinicians to help patients move through cancer. CA Cancer J Clin. 2019;69(6):468–84.

Ligibel JA, Jones LW, Brewster AM, Clinton SK, Korde LA, Oeffinger KC, et al. Oncologists’ attitudes and practice of addressing Diet, Physical Activity, and Weight Management with patients with Cancer: findings of an ASCO Survey of the Oncology workforce. J Oncol Pract. 2019;15(6):e520–8.

Ünsal Delialioğlu S, Mandıroğlu S, Göksel F. Awareness and attitudes of oncology physicians recommending exercise to patients with cancer. Turk J Phys Med Rehabil. 2022;68(1):70–5.

Clerici CA, Massimino M, Casanova M, Cefalo G, Terenziani M, Vasquez R, et al. Psychological referral and consultation for adolescents and young adults with cancer treated at pediatric oncology unit. Pediatr Blood Cancer. 2008;51(1):105–9.

Download references

Acknowledgements

Maxime Caru is supported by the Four Diamonds Research Funds, Department of Pediatrics, Division of Hematology and Oncology, Penn State University College of Medicine. Ariane Levesque is recipient of a Doctoral Research Award from the Canadian Institutes of Health Research (CIHR).

Author information

Maxime Caru and Ariane Levesque contributed equally to this paper and share first authorship.

Authors and Affiliations

Department of Pediatrics, Division of Hematology and Oncology, Penn State College of Medicine, 500 University Drive, Hershey, PA, USA

Maxime Caru & Smita Dandekar

Department of Public Health Sciences, Penn State College of Medicine, Hershey, PA, USA

Maxime Caru

Department of Psychology, University of Montreal, Montreal, QC, Canada

Ariane Levesque

Division of Hematology and Oncology, University of Pittsburgh, Pittsburgh, PA, USA

Kathryn H. Schmitz

You can also search for this author in PubMed   Google Scholar

Contributions

All authors made substantial contributions to the interpretation of the data; AND wrote or revised the manuscript for important intellectual content; AND provided final approval of the version to be published.

Corresponding author

Correspondence to Maxime Caru .

Ethics declarations

Ethics approval, consent to participate, consent for publication, competing interests.

The authors declare no competing interests.

Additional information

Publisher’s note.

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ . The Creative Commons Public Domain Dedication waiver ( http://creativecommons.org/publicdomain/zero/1.0/ ) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Cite this article.

Caru, M., Levesque, A., Dandekar, S. et al. Physical activity and psychological support can replace “another pill” to manage cancer-related symptoms in children and adolescents diagnosed with cancer. BMC Complement Med Ther 24 , 170 (2024). https://doi.org/10.1186/s12906-024-04446-w

Download citation

Received : 13 April 2023

Accepted : 19 March 2024

Published : 22 April 2024

DOI : https://doi.org/10.1186/s12906-024-04446-w

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

BMC Complementary Medicine and Therapies

ISSN: 2662-7671

• Submission enquiries: [email protected]
• General enquiries: [email protected]

An official website of the United States government

The .gov means it's official. Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you're on a federal government site.

The site is secure. The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

• Publications
• Account settings
• Browse Titles

NCBI Bookshelf. A service of the National Library of Medicine, National Institutes of Health.

Galdas P, Darwin Z, Fell J, et al. A systematic review and metaethnography to identify how effective, cost-effective, accessible and acceptable self-management support interventions are for men with long-term conditions (SELF-MAN). Southampton (UK): NIHR Journals Library; 2015 Aug. (Health Services and Delivery Research, No. 3.34.)

A systematic review and metaethnography to identify how effective, cost-effective, accessible and acceptable self-management support interventions are for men with long-term conditions (SELF-MAN).

Chapter 3 qualitative review methods.

The objective of the qualitative metaethnography was to systematically identify experiences of, and perceptions of, interventions or specific activities aimed at supporting or promoting self-management of LTCs among men of differing age, ethnicity and socioeconomic background.

A summary of the methods used in the metaethnography is provided in Appendix 3 , using the enhancing transparency in reporting the synthesis of qualitative research (ENTREQ) reporting standards for qualitative evidence synthesis, developed by Tong et al. 93

The evidence synthesis was conducted using a metaethnography approach originally described by Noblit and Hare. 94 This approach was chosen because of its emphasis on conceptual development and generating new insights (i.e. being interpretive rather than integrative 94 ) and because it is compatible with synthesising all types of qualitative research. 95

Metaethnography involves seven stages: getting started, deciding what is relevant, reading the studies, determining how studies are related to each other, translating studies into each other, synthesising translations and expressing the synthesis; 94 these seven, often overlapping, stages are depicted in Figure 7 .

Seven steps of metaethnography.

• Step 1: getting started

The first stage involved identifying a ‘worthy’ research question and one that could be addressed through qualitative evidence synthesis. 94 This stage took place in developing the original funding application for the current review and its justification is presented in Chapter 1 .

• Step 2: deciding what is relevant

The second stage, ‘deciding what is relevant’, was viewed as comprising the search strategy, inclusion criteria and quality appraisal, consistent with the experiences of Atkins et al. 96 These are presented next, before steps 3–7 are described in the section Data extraction strategy and data analysis .

• Search methods

Search strategy

A comprehensive electronic search strategy ( Appendix 4 ) was developed in liaison with information specialists. It sought to identify all available studies, rather than using purposive sampling to identify all available concepts. Five electronic databases were searched in July 2013 [Cumulative Index to Nursing and Allied Health Literature (CINAHL), EMBASE, MEDLINE, PsycINFO and Social Science Citation Index].

Because of challenges with methodological indexing of qualitative research, 97 the electronic search was complemented by checking reference lists, and using an adapted strategy published elsewhere 98 that includes ‘thesaurus terms’ (keywords indexed in electronic databases, e.g. ‘Qualitative Research’), ‘free text terms’ (commonly used research methodology terms searched for in the titles, abstracts and keywords) and ‘broad-based terms’ (i.e. the broad free-text terms ‘qualitative’, ‘findings’ and ‘interview$’ and the thesaurus term ‘Interviews’). Terms relating to gender were combined with other terms to narrow the search and increase the precision of the strategy (e.g. ‘men’, ‘male’, ‘masculine$’, ‘gender’, ‘sex difference$’, ‘sex factors’).

Study selection: study screening methods and inclusion criteria

Records were initially screened by one reviewer (ZD) on the basis of the title and abstract. Decisions were recorded in EndNote X7.0.2 (Thomson Reuters, CA, USA), a reference management database. All articles identified as potentially eligible for inclusion were obtained in full. Attempts were made to identify and obtain published findings for unpublished literature that was otherwise eligible, for example doctoral theses or conference proceedings.

The full-text literature was screened independently by two reviewers (ZD and PG) using the inclusion criteria listed in Table 5 . Studies that explored the experiences of men alone, or included a clear and explicit comparison between men and women, were included. Studies which focused on self-management experiences of people with LTCs more generally (i.e. did not consider experiences of, or perceptions of, a self-management support intervention or activity) were excluded. The approach to screening was inclusive; for example, studies where the qualitative findings were limited (e.g. Iredale et al. , 99 Ramachandra et al. , 100 Smith et al. 101 ) and mixed-sex studies with limited findings on gender comparisons (e.g. Barlow et al. 102 , 103 ) were retained in case they contributed to the synthesis.

Screening criteria: qualitative

• Classification of self-management interventions and support activities in the qualitative evidence synthesis

The original study protocol sought to code self-management interventions and support activities using the most up-to-date version of the taxonomy of BCT. 104 – 106 As in the quantitative review (see Chapter 2 , Coding interventions for analysis ), we found that the level of detail reported on self-management interventions or activities in the qualitative literature was limited in detail, precision and consistency, making coding with the BCT taxonomy unfeasible.

Most of the qualitative literature did not focus on behaviour change per se or seek to address men’s views and experiences of behaviour change techniques; for example, some papers were concerned with the dynamics of social support groups, or the use of other self-management support and information. The BCT taxonomy is applicable to only studies that are judged as targeting behaviour change; we were therefore limited to ‘lifestyle’ and ‘psychological’ studies. Only a minority of the studies ( n  = 13) provided sufficient information on interventions to allow even rudimentary coding with the BCT taxonomy, and these are presented in Appendix 5 . Issues around application of the BCT taxonomy are returned to in the discussion chapter (see Chapter 6 ).

The lack of detail reported in the qualitative literature also made it unfeasible to classify interventions using the system developed for the quantitative review. Whereas the quantitative review concerned trials of specific interventions, approximately half of the studies in the qualitative review 99 , 101 , 107 – 130 included more than one intervention or activity (e.g. ‘any cancer support group’).

We therefore developed a broad system for classifying interventions and support activities that offered a pragmatic way to group studies and make the analysis process more manageable. The categories are shown in Table 6 .

Categories and descriptions of self-management interventions and support activities in the qualitative evidence synthesis

• Quality assessment strategy

The purpose of quality appraisal in the review was to provide descriptive information on the quality of the included studies rather than as a basis for inclusion. We considered that studies of weaker quality either would not contribute or would contribute only minimally to the final synthesis. 94 , 131 We therefore chose not to use design-specific appraisal tools (which the original protocol stated we would) because we placed emphasis on conceptual contribution, which did not require a detailed design-specific appraisal of methodological quality. With that in mind, we used the Critical Appraisal Skills Programme (CASP) tool. 132

The CASP tool comprises 10 checklist-style questions (see Appendix 6 ) for assessing the quality of various domains (including aims, design, methods, data analysis, interpretation, findings and value of the research). Because of the checklist nature of the CASP tool, we developed some additional questions informed by other metaethnography studies 96 , 131 that enabled us to extract and record more detailed narrative summaries of the main strengths, limitations and concerns of each study (see Appendix 7 ).

The CASP tool was used in the light of the experiences reported by other researchers who recommended that, despite rather low inter-rater agreement, such an approach ‘encourag[es] the reviewers to read the papers carefully and systematically, and serves as a reminder to treat the papers as data for the synthesis’ (p. 44). 131

Its focus is on procedural aspects of the conduct of the research rather than the insights offered. 133 The quality appraisal (which focused on methodological quality) did not form part of the inclusion criteria because, as recognised by Campbell et al. , 131 it is conceptual quality that is most important for evidence synthesis and it is the process of synthesis that judges the ‘worth’ of studies, with conceptually limited studies making a limited contribution. 94 Additionally, it is acknowledged that agreement is often slight, with low reproducibility. 131 , 133 Appraisal was conducted by two reviewers independently (ZD and PG), with discrepancies resolved through discussion.

Search outcome

The electronic search strategy identified 6330 unique references. Screening based on title and abstract identified 149 papers for full-text screening. Dual screening of these full-text articles identified 34 studies (reported in 38 papers) to be included in the review. Reasons for excluding the remaining 111 articles are shown in Table 7 .

Reasons for exclusion of full-text articles

Inter-rater agreement on the decision to include was 88.6%. The majority of disagreements ( n  = 17) concerned the definition of self-management intervention or activity. Having discussed the 17 disagreements, we agreed that five studies on which there was disagreement would be included. 100 , 103 , 110 , 116 , 134

An additional four studies were identified through reference checks and efforts to locate published literature linked to unpublished work identified through the electronic search. 111 , 112 , 135 , 136 An additional two papers (women only), although individually ineligible, were located as ‘linked papers’ for two of the original 34 studies, 114 , 120 giving a total of 38 studies (reported in 44 papers), as shown in Figure 8 .

Preferred Reporting Items for Systematic Reviews and Meta-Analyses flow diagram for the qualitative review.

• Data extraction strategy and data analysis

The lead reviewer (ZD) extracted all papers using data extraction forms previously tested and refined through a pilot study of four papers. All study details (including aim, participant details, methodology, method of data collection and analysis) were extracted into Microsoft Excel ® version 14 (Microsoft Corporation, Redmond, WA, USA) and checked by a second reviewer (PG). Extraction and analysis of study findings was undertaken by a group of coreviewers within the research team (ZD, PG, LK, CB, KM, KH) and followed steps 3–7 of the metaethnography process described by Noblit and Hare. 94 Despite being numbered sequentially, these phases do not occur in a linear process. 94

Step 3: reading the studies

The metaethnography process involved three levels of constructs, as described by Schutz 137 and operationalised by Atkins et al. : 96

• first-order: participant quotes and participant observations, while recognising that in secondary analysis these represent the participants’ views as selected by the study authors in evidencing their second-order constructs
• second-order: study authors’ themes/concepts and interpretations, also described by Noblit and Hare 94 as ‘metaphors’
• third-order: our ‘interpretations of interpretations of interpretations’ (p. 35), 94 based on our analysis of the first-order and second-order constructs extracted from the studies.

Each paper was read in full and copied verbatim into NVivo version 10 (QSR International, Warrington, UK) for line-by-line coding by the lead reviewer. Coding involved repeated reading and line-by-line categorising of first-order and second-order constructs, using participants’ and authors’ words wherever possible, and reading for possible third-order constructs.

Third-order constructs were developed by building second-order constructs into broader categories and themes in a framework which was revised iteratively using the hierarchical functions of the NVivo software (i.e. using ‘parent’ and ‘child’ nodes).

Rather than simply being a synthesis of the second-order constructs, third-order-constructs were derived inductively from the extracted data; this was an interpretive process that was not limited to interpretations offered by the original authors of included studies.

Coding by coreviewers (i.e. other members of the research team) was idiosyncratic but commonly involved working with printed papers, noting key ‘metaphors’ (themes, concepts and ideas) in the margins and highlighting first-order and second-order evidence that supported the coreviewers’ interpretations. The lead reviewer, ZD, met with each coreviewer to discuss/debrief coding decisions and ensure the credibility (i.e. the congruence of coding decisions with the original author interpretations) of the overall analytical process.

Step 4: determining how the studies are related

To offer a ‘way in’ to the synthesis, we adopted a similar approach to that of Campbell et al. : 131 initially grouping studies by the broad categories of self-management intervention and support activity shown in Table 6 . Each coreviewer was allocated one or more category of studies to analyse. The lead reviewer then read each category of studies in the following order: face-to-face group support, online support, online information, information, psychological, lifestyle and ‘various’; within this, she read the studies in alphabetical order of first author rather than nominating ‘key’ papers. All included papers were analysed, rather than reading until saturation of concepts.

The lead reviewer and coreviewer independently completed matrices to report the second-order constructs and emerging third-order constructs for each paper (which for the lead reviewer were based on a more comprehensive line-by-line coding using NVivo). This facilitated the juxtaposing of metaphors and/or constructs alongside each other, leading to initial assumptions about relationships between studies.

Step 5: translating studies into one another

A defining element of metaethnography is the ‘translation’ of studies into each other, whereby metaphors, together with their inter-relationships, are compared across studies. Facilitated by discussions using the matrices of second- and third-order constructs, we translated studies firstly within types of support activity and then, secondly, across types.

The lead reviewer initially developed the constructs in relation to face-to-face support (the largest category of studies) and read other categories of studies with reference to this, using a constant comparison approach to identify and refine concepts. The ‘models’ function in NVivo was used to depict relationships between third-order constructs; this helped to develop the line-of-argument synthesis, which is discussed next.

Step 6: synthesising translations

Studies can be synthesised in three ways: 94

• reciprocal translation, where the findings are directly comparable
• refutational translation, where the findings are in opposition
• a line-of-argument synthesis, where both similarities and contradictions are found and translations are encompassed in one overarching interpretation that aims to discover a whole among the set of parts, uncovering aspects that may be hidden in individual studies.

Because we found similarities and contradictions, we developed a line-of-argument synthesis (rather than reciprocal or refutational translation) that encompassed four key concepts, each of which was based around a set of third-order constructs.

Step 7: expressing the synthesis

The output of the synthesis, that is communicating our third-order concepts and overarching line-of-argument synthesis, is described by Noblit and Hare 94 as ‘expressing the synthesis’ (p. 29). They state that ‘the worth of any synthesis is in its comprehensibility to some audience’ (p. 82), 94 emphasising the importance of communicating the synthesis effectively, being mindful of the intended audience and using concepts and language that are meaningful (and understandable). We worked to make the synthesis comprehensible by discussion with coreviewers and, critically, through involvement of the patient and public involvement (PPI) group. The synthesis is presented in Chapter 5 and will also be expressed through other dissemination activities, for example the SELF-MAN symposium ( www.self-man.com ), mini-manuals and journal publications.

We undertook several steps to enhance the rigour of our analysis. Authors’ themes and interpretations (second-order constructs) were independently extracted by two reviewers, each of whom additionally suggested their own interpretations of the study findings (third-order constructs).

We were influenced by a recent Health Technology Assessment metaethnography which found multiple reviewers offered ‘broad similarities in interpretation, but differences of detail’ (p. x). 131 We therefore treated the lead reviewer’s analyses as the ‘master copy’ and compared these with the coreviewers’ extractions and interpretations. Peer debriefing meetings were held between the lead reviewer and each coreviewer to discuss matrices of second-order and third-order constructs which facilitated the consideration of alternative interpretations.

The third-order constructs and line-of-argument synthesis were further refined at a full-day meeting (January 2014) attended by the lead qualitative reviewer and wider team of five coreviewers involved in coding, extraction, analysis and interpretation (PG, KH, LK, KM, CB).

We identified the need to be reflexive about our interpretations and recognised potential sources of influence on our interpretations; for example, two reviewers (PG, KH) identified having a ‘constructions of masculinity’ lens, and we agreed to focus the line-of-argument synthesis on interpretations offered by authors of studies being synthesised, rather than framing our interpretations around constructions of masculinity. We considered it a strength that the six reviewers involved reflected a wide range of backgrounds and perspectives. Although PPI colleagues were not involved in the coding process, the line-of-argument synthesis and four key concepts were discussed with the PPI group to ensure credibility.

• Public and patient involvement

The SELF-MAN research team worked with a specially constituted public and patient advisory group comprising men living with one or more LTCs who were involved in either running or attending a LTC support group in the north of England. Members were recruited via the research team’s existing networks. Stakeholders’ support groups were all condition-specific – arthritis ( n  = 1), diabetes ( n  = 1), heart failure ( n  = 2) and Parkinson’s disease ( n  = 1) – although some men lived with multiple LTCs. All stakeholders attended a welcome meeting prior to the commencement of the study to prepare them for the involvement in the research, and were provided with ongoing support and guidance by the chief investigator throughout the research process. Members were reimbursed for travel, expenses and time throughout the duration of the project (in line with current INVOLVE recommendations 138 ).

The overarching aims of PPI in the project were, first, to help ensure that the review findings spoke to the self-management needs and priorities of men with LTCs, and, second, to ensure the development of appropriate outputs that would have benefit and relevance for service users. A recognised limitation of our group was that stakeholder representation was drawn from face-to-face group-based support interventions.

The stakeholder group met on three half-days over the course of the 12-month project. On each occasion, the group provided positive affirmation that the project was being conducted in accordance with its stated objectives. In the first two meetings, the group offered feedback and advice to the investigative team on preliminary and emerging analysis of the qualitative data throughout the research process: specifically, the development of third-order constructs and the line-of-argument synthesis. Responding to their input, we made revisions to some of our interpretations, particularly in relation to the importance of physical aspects of environments in which interventions took place. The group’s input also highlighted the need for future research to address depression as a common and often overlooked comorbidity in men (see Chapter 7 , Recommendations for future research ), and that they welcomed recommendations for sustainability of support groups and improving communication within groups. When considering the key outcomes to be assessed in the quantitative review, stakeholders also recommended that emphasis should be placed on quality-of-life outcome measures when considering whether or not a self-management support intervention is effective.

In the final meeting, the stakeholder group provided detailed recommendations for the content of the Self-Manual: Man’s Guide to Better Self-Management of Long Term Conditions (not yet available). It advised that the guide should be rephrased from ‘how to’ self-manage to ‘how to better ’ self-manage because men may view themselves as already self-managing and therefore not identify with the former.

Six or seven stakeholders attended each meeting. The female partner of one of the men attended and contributed to discussions at each meeting. Members of the group each received reimbursement of travel expenses and a £150 honorarium for each meeting they attended. In the final meeting, the stakeholders provided feedback on their involvement in the research process overall, focusing on what was done well and what could be improved. Feedback indicated that most stakeholders had a positive experience, particularly valuing the opportunity to have their ‘voices heard’ and make a potential impact on future service delivery. Recommendations for improvements mostly centred on ensuring prompt reimbursement of expenses incurred in attending the meetings.

Included under terms of UK Non-commercial Government License .

• Cite this Page Galdas P, Darwin Z, Fell J, et al. A systematic review and metaethnography to identify how effective, cost-effective, accessible and acceptable self-management support interventions are for men with long-term conditions (SELF-MAN). Southampton (UK): NIHR Journals Library; 2015 Aug. (Health Services and Delivery Research, No. 3.34.) Chapter 3, Qualitative review methods.
• PDF version of this title (3.9M)

In this Page

Other titles in this collection.

• Health Services and Delivery Research

Recent Activity

• Qualitative review methods - A systematic review and metaethnography to identify... Qualitative review methods - A systematic review and metaethnography to identify how effective, cost-effective, accessible and acceptable self-management support interventions are for men with long-term conditions (SELF-MAN)

Your browsing activity is empty.

Activity recording is turned off.

Turn recording back on

Connect with NLM

National Library of Medicine 8600 Rockville Pike Bethesda, MD 20894

Web Policies FOIA HHS Vulnerability Disclosure

Help Accessibility Careers