methodology example in literature review

How To Write An A-Grade Literature Review

3 straightforward steps (with examples) + free template.

By: Derek Jansen (MBA) | Expert Reviewed By: Dr. Eunice Rautenbach | October 2019

Quality research is about building onto the existing work of others , “standing on the shoulders of giants”, as Newton put it. The literature review chapter of your dissertation, thesis or research project is where you synthesise this prior work and lay the theoretical foundation for your own research.

Long story short, this chapter is a pretty big deal, which is why you want to make sure you get it right . In this post, I’ll show you exactly how to write a literature review in three straightforward steps, so you can conquer this vital chapter (the smart way).

Overview: The Literature Review Process

• Understanding the “ why “
• Finding the relevant literature
• Cataloguing and synthesising the information
• Outlining & writing up your literature review
• Example of a literature review

But first, the “why”…

Before we unpack how to write the literature review chapter, we’ve got to look at the why . To put it bluntly, if you don’t understand the function and purpose of the literature review process, there’s no way you can pull it off well. So, what exactly is the purpose of the literature review?

Well, there are (at least) four core functions:

• For you to gain an understanding (and demonstrate this understanding) of where the research is at currently, what the key arguments and disagreements are.
• For you to identify the gap(s) in the literature and then use this as justification for your own research topic.
• To help you build a conceptual framework for empirical testing (if applicable to your research topic).
• To inform your methodological choices and help you source tried and tested questionnaires (for interviews ) and measurement instruments (for surveys ).

Most students understand the first point but don’t give any thought to the rest. To get the most from the literature review process, you must keep all four points front of mind as you review the literature (more on this shortly), or you’ll land up with a wonky foundation.

Okay – with the why out the way, let’s move on to the how . As mentioned above, writing your literature review is a process, which I’ll break down into three steps:

• Finding the most suitable literature
• Understanding , distilling and organising the literature
• Planning and writing up your literature review chapter

Importantly, you must complete steps one and two before you start writing up your chapter. I know it’s very tempting, but don’t try to kill two birds with one stone and write as you read. You’ll invariably end up wasting huge amounts of time re-writing and re-shaping, or you’ll just land up with a disjointed, hard-to-digest mess . Instead, you need to read first and distil the information, then plan and execute the writing.

Step 1: Find the relevant literature

Naturally, the first step in the literature review journey is to hunt down the existing research that’s relevant to your topic. While you probably already have a decent base of this from your research proposal , you need to expand on this substantially in the dissertation or thesis itself.

Essentially, you need to be looking for any existing literature that potentially helps you answer your research question (or develop it, if that’s not yet pinned down). There are numerous ways to find relevant literature, but I’ll cover my top four tactics here. I’d suggest combining all four methods to ensure that nothing slips past you:

Method 1 – Google Scholar Scrubbing

Google’s academic search engine, Google Scholar , is a great starting point as it provides a good high-level view of the relevant journal articles for whatever keyword you throw at it. Most valuably, it tells you how many times each article has been cited, which gives you an idea of how credible (or at least, popular) it is. Some articles will be free to access, while others will require an account, which brings us to the next method.

Method 2 – University Database Scrounging

Generally, universities provide students with access to an online library, which provides access to many (but not all) of the major journals.

So, if you find an article using Google Scholar that requires paid access (which is quite likely), search for that article in your university’s database – if it’s listed there, you’ll have access. Note that, generally, the search engine capabilities of these databases are poor, so make sure you search for the exact article name, or you might not find it.

Method 3 – Journal Article Snowballing

At the end of every academic journal article, you’ll find a list of references. As with any academic writing, these references are the building blocks of the article, so if the article is relevant to your topic, there’s a good chance a portion of the referenced works will be too. Do a quick scan of the titles and see what seems relevant, then search for the relevant ones in your university’s database.

Method 4 – Dissertation Scavenging

Similar to Method 3 above, you can leverage other students’ dissertations. All you have to do is skim through literature review chapters of existing dissertations related to your topic and you’ll find a gold mine of potential literature. Usually, your university will provide you with access to previous students’ dissertations, but you can also find a much larger selection in the following databases:

• Open Access Theses & Dissertations
• Stanford SearchWorks

Keep in mind that dissertations and theses are not as academically sound as published, peer-reviewed journal articles (because they’re written by students, not professionals), so be sure to check the credibility of any sources you find using this method. You can do this by assessing the citation count of any given article in Google Scholar. If you need help with assessing the credibility of any article, or with finding relevant research in general, you can chat with one of our Research Specialists .

Alright – with a good base of literature firmly under your belt, it’s time to move onto the next step.

Need a helping hand?

Step 2: Log, catalogue and synthesise

Once you’ve built a little treasure trove of articles, it’s time to get reading and start digesting the information – what does it all mean?

While I present steps one and two (hunting and digesting) as sequential, in reality, it’s more of a back-and-forth tango – you’ll read a little , then have an idea, spot a new citation, or a new potential variable, and then go back to searching for articles. This is perfectly natural – through the reading process, your thoughts will develop , new avenues might crop up, and directional adjustments might arise. This is, after all, one of the main purposes of the literature review process (i.e. to familiarise yourself with the current state of research in your field).

As you’re working through your treasure chest, it’s essential that you simultaneously start organising the information. There are three aspects to this:

• Logging reference information
• Building an organised catalogue
• Distilling and synthesising the information

I’ll discuss each of these below:

2.1 – Log the reference information

As you read each article, you should add it to your reference management software. I usually recommend Mendeley for this purpose (see the Mendeley 101 video below), but you can use whichever software you’re comfortable with. Most importantly, make sure you load EVERY article you read into your reference manager, even if it doesn’t seem very relevant at the time.

2.2 – Build an organised catalogue

In the beginning, you might feel confident that you can remember who said what, where, and what their main arguments were. Trust me, you won’t. If you do a thorough review of the relevant literature (as you must!), you’re going to read many, many articles, and it’s simply impossible to remember who said what, when, and in what context . Also, without the bird’s eye view that a catalogue provides, you’ll miss connections between various articles, and have no view of how the research developed over time. Simply put, it’s essential to build your own catalogue of the literature.

I would suggest using Excel to build your catalogue, as it allows you to run filters, colour code and sort – all very useful when your list grows large (which it will). How you lay your spreadsheet out is up to you, but I’d suggest you have the following columns (at minimum):

• Author, date, title – Start with three columns containing this core information. This will make it easy for you to search for titles with certain words, order research by date, or group by author.
• Categories or keywords – You can either create multiple columns, one for each category/theme and then tick the relevant categories, or you can have one column with keywords.
• Key arguments/points – Use this column to succinctly convey the essence of the article, the key arguments and implications thereof for your research.
• Context – Note the socioeconomic context in which the research was undertaken. For example, US-based, respondents aged 25-35, lower- income, etc. This will be useful for making an argument about gaps in the research.
• Methodology – Note which methodology was used and why. Also, note any issues you feel arise due to the methodology. Again, you can use this to make an argument about gaps in the research.
• Quotations – Note down any quoteworthy lines you feel might be useful later.
• Notes – Make notes about anything not already covered. For example, linkages to or disagreements with other theories, questions raised but unanswered, shortcomings or limitations, and so forth.

If you’d like, you can try out our free catalog template here (see screenshot below).

2.3 – Digest and synthesise

Most importantly, as you work through the literature and build your catalogue, you need to synthesise all the information in your own mind – how does it all fit together? Look for links between the various articles and try to develop a bigger picture view of the state of the research. Some important questions to ask yourself are:

• What answers does the existing research provide to my own research questions ?
• Which points do the researchers agree (and disagree) on?
• How has the research developed over time?
• Where do the gaps in the current research lie?

To help you develop a big-picture view and synthesise all the information, you might find mind mapping software such as Freemind useful. Alternatively, if you’re a fan of physical note-taking, investing in a large whiteboard might work for you.

Step 3: Outline and write it up!

Once you’re satisfied that you have digested and distilled all the relevant literature in your mind, it’s time to put pen to paper (or rather, fingers to keyboard). There are two steps here – outlining and writing:

3.1 – Draw up your outline

Having spent so much time reading, it might be tempting to just start writing up without a clear structure in mind. However, it’s critically important to decide on your structure and develop a detailed outline before you write anything. Your literature review chapter needs to present a clear, logical and an easy to follow narrative – and that requires some planning. Don’t try to wing it!

Naturally, you won’t always follow the plan to the letter, but without a detailed outline, you’re more than likely going to end up with a disjointed pile of waffle , and then you’re going to spend a far greater amount of time re-writing, hacking and patching. The adage, “measure twice, cut once” is very suitable here.

In terms of structure, the first decision you’ll have to make is whether you’ll lay out your review thematically (into themes) or chronologically (by date/period). The right choice depends on your topic, research objectives and research questions, which we discuss in this article .

Once that’s decided, you need to draw up an outline of your entire chapter in bullet point format. Try to get as detailed as possible, so that you know exactly what you’ll cover where, how each section will connect to the next, and how your entire argument will develop throughout the chapter. Also, at this stage, it’s a good idea to allocate rough word count limits for each section, so that you can identify word count problems before you’ve spent weeks or months writing!

PS – check out our free literature review chapter template…

3.2 – Get writing

With a detailed outline at your side, it’s time to start writing up (finally!). At this stage, it’s common to feel a bit of writer’s block and find yourself procrastinating under the pressure of finally having to put something on paper. To help with this, remember that the objective of the first draft is not perfection – it’s simply to get your thoughts out of your head and onto paper, after which you can refine them. The structure might change a little, the word count allocations might shift and shuffle, and you might add or remove a section – that’s all okay. Don’t worry about all this on your first draft – just get your thoughts down on paper.

Once you’ve got a full first draft (however rough it may be), step away from it for a day or two (longer if you can) and then come back at it with fresh eyes. Pay particular attention to the flow and narrative – does it fall fit together and flow from one section to another smoothly? Now’s the time to try to improve the linkage from each section to the next, tighten up the writing to be more concise, trim down word count and sand it down into a more digestible read.

Once you’ve done that, give your writing to a friend or colleague who is not a subject matter expert and ask them if they understand the overall discussion. The best way to assess this is to ask them to explain the chapter back to you. This technique will give you a strong indication of which points were clearly communicated and which weren’t. If you’re working with Grad Coach, this is a good time to have your Research Specialist review your chapter.

Finally, tighten it up and send it off to your supervisor for comment. Some might argue that you should be sending your work to your supervisor sooner than this (indeed your university might formally require this), but in my experience, supervisors are extremely short on time (and often patience), so, the more refined your chapter is, the less time they’ll waste on addressing basic issues (which you know about already) and the more time they’ll spend on valuable feedback that will increase your mark-earning potential.

Literature Review Example

In the video below, we unpack an actual literature review so that you can see how all the core components come together in reality.

Let’s Recap

In this post, we’ve covered how to research and write up a high-quality literature review chapter. Let’s do a quick recap of the key takeaways:

• It is essential to understand the WHY of the literature review before you read or write anything. Make sure you understand the 4 core functions of the process.
• The first step is to hunt down the relevant literature . You can do this using Google Scholar, your university database, the snowballing technique and by reviewing other dissertations and theses.
• Next, you need to log all the articles in your reference manager , build your own catalogue of literature and synthesise all the research.
• Following that, you need to develop a detailed outline of your entire chapter – the more detail the better. Don’t start writing without a clear outline (on paper, not in your head!)
• Write up your first draft in rough form – don’t aim for perfection. Remember, done beats perfect.
• Refine your second draft and get a layman’s perspective on it . Then tighten it up and submit it to your supervisor.

Psst… there’s more!

This post is an extract from our bestselling Udemy Course, Literature Review Bootcamp . If you want to work smart, you don't want to miss this .

You Might Also Like:

38 Comments

Thank you very much. This page is an eye opener and easy to comprehend.

This is awesome!

I wish I come across GradCoach earlier enough.

But all the same I’ll make use of this opportunity to the fullest.

Thank you for this good job.

Keep it up!

You’re welcome, Yinka. Thank you for the kind words. All the best writing your literature review.

Thank you for a very useful literature review session. Although I am doing most of the steps…it being my first masters an Mphil is a self study and one not sure you are on the right track. I have an amazing supervisor but one also knows they are super busy. So not wanting to bother on the minutae. Thank you.

You’re most welcome, Renee. Good luck with your literature review 🙂

This has been really helpful. Will make full use of it. 🙂

Thank you Gradcoach.

Really agreed. Admirable effort

thank you for this beautiful well explained recap.

Thank you so much for your guide of video and other instructions for the dissertation writing.

It is instrumental. It encouraged me to write a dissertation now.

Thank you the video was great – from someone that knows nothing thankyou

an amazing and very constructive way of presetting a topic, very useful, thanks for the effort,

It is timely

It is very good video of guidance for writing a research proposal and a dissertation. Since I have been watching and reading instructions, I have started my research proposal to write. I appreciate to Mr Jansen hugely.

I learn a lot from your videos. Very comprehensive and detailed.

Thank you for sharing your knowledge. As a research student, you learn better with your learning tips in research

I was really stuck in reading and gathering information but after watching these things are cleared thanks, it is so helpful.

Really helpful, Thank you for the effort in showing such information

This is super helpful thank you very much.

Thank you for this whole literature writing review.You have simplified the process.

I’m so glad I found GradCoach. Excellent information, Clear explanation, and Easy to follow, Many thanks Derek!

You’re welcome, Maithe. Good luck writing your literature review 🙂

Thank you Coach, you have greatly enriched and improved my knowledge

Great piece, so enriching and it is going to help me a great lot in my project and thesis, thanks so much

This is THE BEST site for ANYONE doing a masters or doctorate! Thank you for the sound advice and templates. You rock!

Thanks, Stephanie 🙂

This is mind blowing, the detailed explanation and simplicity is perfect.

I am doing two papers on my final year thesis, and I must stay I feel very confident to face both headlong after reading this article.

thank you so much.

if anyone is to get a paper done on time and in the best way possible, GRADCOACH is certainly the go to area!

This is very good video which is well explained with detailed explanation

Thank you excellent piece of work and great mentoring

Thanks, it was useful

Thank you very much. the video and the information were very helpful.

Good morning scholar. I’m delighted coming to know you even before the commencement of my dissertation which hopefully is expected in not more than six months from now. I would love to engage my study under your guidance from the beginning to the end. I love to know how to do good job

Thank you so much Derek for such useful information on writing up a good literature review. I am at a stage where I need to start writing my one. My proposal was accepted late last year but I honestly did not know where to start

Like the name of your YouTube implies you are GRAD (great,resource person, about dissertation). In short you are smart enough in coaching research work.

This is a very well thought out webpage. Very informative and a great read.

Very timely.

I appreciate.

Very comprehensive and eye opener for me as beginner in postgraduate study. Well explained and easy to understand. Appreciate and good reference in guiding me in my research journey. Thank you

Thank you. I requested to download the free literature review template, however, your website wouldn’t allow me to complete the request or complete a download. May I request that you email me the free template? Thank you.

Submit a Comment Cancel reply

Your email address will not be published. Required fields are marked *

Save my name, email, and website in this browser for the next time I comment.

• Print Friendly

What is a Literature Review? How to Write It (with Examples)

A literature review is a critical analysis and synthesis of existing research on a particular topic. It provides an overview of the current state of knowledge, identifies gaps, and highlights key findings in the literature. 1 The purpose of a literature review is to situate your own research within the context of existing scholarship, demonstrating your understanding of the topic and showing how your work contributes to the ongoing conversation in the field. Learning how to write a literature review is a critical tool for successful research. Your ability to summarize and synthesize prior research pertaining to a certain topic demonstrates your grasp on the topic of study, and assists in the learning process. 

Table of Contents

• What is the purpose of literature review? 
• a. Habitat Loss and Species Extinction: 
• b. Range Shifts and Phenological Changes: 
• c. Ocean Acidification and Coral Reefs: 
• d. Adaptive Strategies and Conservation Efforts: 
• How to write a good literature review 
• Choose a Topic and Define the Research Question: 
• Decide on the Scope of Your Review: 
• Select Databases for Searches: 
• Conduct Searches and Keep Track: 
• Review the Literature: 
• Organize and Write Your Literature Review: 
• Frequently asked questions 

What is a literature review?

A well-conducted literature review demonstrates the researcher’s familiarity with the existing literature, establishes the context for their own research, and contributes to scholarly conversations on the topic. One of the purposes of a literature review is also to help researchers avoid duplicating previous work and ensure that their research is informed by and builds upon the existing body of knowledge.

What is the purpose of literature review?

A literature review serves several important purposes within academic and research contexts. Here are some key objectives and functions of a literature review: 2  

• Contextualizing the Research Problem: The literature review provides a background and context for the research problem under investigation. It helps to situate the study within the existing body of knowledge. 
• Identifying Gaps in Knowledge: By identifying gaps, contradictions, or areas requiring further research, the researcher can shape the research question and justify the significance of the study. This is crucial for ensuring that the new research contributes something novel to the field. 
• Understanding Theoretical and Conceptual Frameworks: Literature reviews help researchers gain an understanding of the theoretical and conceptual frameworks used in previous studies. This aids in the development of a theoretical framework for the current research. 
• Providing Methodological Insights: Another purpose of literature reviews is that it allows researchers to learn about the methodologies employed in previous studies. This can help in choosing appropriate research methods for the current study and avoiding pitfalls that others may have encountered. 
• Establishing Credibility: A well-conducted literature review demonstrates the researcher’s familiarity with existing scholarship, establishing their credibility and expertise in the field. It also helps in building a solid foundation for the new research. 
• Informing Hypotheses or Research Questions: The literature review guides the formulation of hypotheses or research questions by highlighting relevant findings and areas of uncertainty in existing literature. 

Literature review example

Let’s delve deeper with a literature review example: Let’s say your literature review is about the impact of climate change on biodiversity. You might format your literature review into sections such as the effects of climate change on habitat loss and species extinction, phenological changes, and marine biodiversity. Each section would then summarize and analyze relevant studies in those areas, highlighting key findings and identifying gaps in the research. The review would conclude by emphasizing the need for further research on specific aspects of the relationship between climate change and biodiversity. The following literature review template provides a glimpse into the recommended literature review structure and content, demonstrating how research findings are organized around specific themes within a broader topic. 

Literature Review on Climate Change Impacts on Biodiversity:

Climate change is a global phenomenon with far-reaching consequences, including significant impacts on biodiversity. This literature review synthesizes key findings from various studies: 

a. Habitat Loss and Species Extinction:

Climate change-induced alterations in temperature and precipitation patterns contribute to habitat loss, affecting numerous species (Thomas et al., 2004). The review discusses how these changes increase the risk of extinction, particularly for species with specific habitat requirements. 

b. Range Shifts and Phenological Changes:

Observations of range shifts and changes in the timing of biological events (phenology) are documented in response to changing climatic conditions (Parmesan & Yohe, 2003). These shifts affect ecosystems and may lead to mismatches between species and their resources. 

c. Ocean Acidification and Coral Reefs:

The review explores the impact of climate change on marine biodiversity, emphasizing ocean acidification’s threat to coral reefs (Hoegh-Guldberg et al., 2007). Changes in pH levels negatively affect coral calcification, disrupting the delicate balance of marine ecosystems. 

d. Adaptive Strategies and Conservation Efforts:

Recognizing the urgency of the situation, the literature review discusses various adaptive strategies adopted by species and conservation efforts aimed at mitigating the impacts of climate change on biodiversity (Hannah et al., 2007). It emphasizes the importance of interdisciplinary approaches for effective conservation planning. 

How to write a good literature review

Writing a literature review involves summarizing and synthesizing existing research on a particular topic. A good literature review format should include the following elements. 

Introduction: The introduction sets the stage for your literature review, providing context and introducing the main focus of your review. 

• Opening Statement: Begin with a general statement about the broader topic and its significance in the field. 
• Scope and Purpose: Clearly define the scope of your literature review. Explain the specific research question or objective you aim to address. 
• Organizational Framework: Briefly outline the structure of your literature review, indicating how you will categorize and discuss the existing research. 
• Significance of the Study: Highlight why your literature review is important and how it contributes to the understanding of the chosen topic. 
• Thesis Statement: Conclude the introduction with a concise thesis statement that outlines the main argument or perspective you will develop in the body of the literature review. 

Body: The body of the literature review is where you provide a comprehensive analysis of existing literature, grouping studies based on themes, methodologies, or other relevant criteria. 

• Organize by Theme or Concept: Group studies that share common themes, concepts, or methodologies. Discuss each theme or concept in detail, summarizing key findings and identifying gaps or areas of disagreement. 
• Critical Analysis: Evaluate the strengths and weaknesses of each study. Discuss the methodologies used, the quality of evidence, and the overall contribution of each work to the understanding of the topic. 
• Synthesis of Findings: Synthesize the information from different studies to highlight trends, patterns, or areas of consensus in the literature. 
• Identification of Gaps: Discuss any gaps or limitations in the existing research and explain how your review contributes to filling these gaps. 
• Transition between Sections: Provide smooth transitions between different themes or concepts to maintain the flow of your literature review. 

Conclusion: The conclusion of your literature review should summarize the main findings, highlight the contributions of the review, and suggest avenues for future research. 

• Summary of Key Findings: Recap the main findings from the literature and restate how they contribute to your research question or objective. 
• Contributions to the Field: Discuss the overall contribution of your literature review to the existing knowledge in the field. 
• Implications and Applications: Explore the practical implications of the findings and suggest how they might impact future research or practice. 
• Recommendations for Future Research: Identify areas that require further investigation and propose potential directions for future research in the field. 
• Final Thoughts: Conclude with a final reflection on the importance of your literature review and its relevance to the broader academic community. 

Conducting a literature review

Conducting a literature review is an essential step in research that involves reviewing and analyzing existing literature on a specific topic. It’s important to know how to do a literature review effectively, so here are the steps to follow: 1  

Choose a Topic and Define the Research Question:

• Select a topic that is relevant to your field of study. 
• Clearly define your research question or objective. Determine what specific aspect of the topic do you want to explore? 

Decide on the Scope of Your Review:

• Determine the timeframe for your literature review. Are you focusing on recent developments, or do you want a historical overview? 
• Consider the geographical scope. Is your review global, or are you focusing on a specific region? 
• Define the inclusion and exclusion criteria. What types of sources will you include? Are there specific types of studies or publications you will exclude? 

Select Databases for Searches:

• Identify relevant databases for your field. Examples include PubMed, IEEE Xplore, Scopus, Web of Science, and Google Scholar. 
• Consider searching in library catalogs, institutional repositories, and specialized databases related to your topic. 

Conduct Searches and Keep Track:

• Develop a systematic search strategy using keywords, Boolean operators (AND, OR, NOT), and other search techniques. 
• Record and document your search strategy for transparency and replicability. 
• Keep track of the articles, including publication details, abstracts, and links. Use citation management tools like EndNote, Zotero, or Mendeley to organize your references. 

Review the Literature:

• Evaluate the relevance and quality of each source. Consider the methodology, sample size, and results of studies. 
• Organize the literature by themes or key concepts. Identify patterns, trends, and gaps in the existing research. 
• Summarize key findings and arguments from each source. Compare and contrast different perspectives. 
• Identify areas where there is a consensus in the literature and where there are conflicting opinions. 
• Provide critical analysis and synthesis of the literature. What are the strengths and weaknesses of existing research? 

Organize and Write Your Literature Review:

• Literature review outline should be based on themes, chronological order, or methodological approaches. 
• Write a clear and coherent narrative that synthesizes the information gathered. 
• Use proper citations for each source and ensure consistency in your citation style (APA, MLA, Chicago, etc.). 
• Conclude your literature review by summarizing key findings, identifying gaps, and suggesting areas for future research. 

The literature review sample and detailed advice on writing and conducting a review will help you produce a well-structured report. But remember that a literature review is an ongoing process, and it may be necessary to revisit and update it as your research progresses. 

Frequently asked questions

A literature review is a critical and comprehensive analysis of existing literature (published and unpublished works) on a specific topic or research question and provides a synthesis of the current state of knowledge in a particular field. A well-conducted literature review is crucial for researchers to build upon existing knowledge, avoid duplication of efforts, and contribute to the advancement of their field. It also helps researchers situate their work within a broader context and facilitates the development of a sound theoretical and conceptual framework for their studies.

Literature review is a crucial component of research writing, providing a solid background for a research paper’s investigation. The aim is to keep professionals up to date by providing an understanding of ongoing developments within a specific field, including research methods, and experimental techniques used in that field, and present that knowledge in the form of a written report. Also, the depth and breadth of the literature review emphasizes the credibility of the scholar in his or her field.  

Before writing a literature review, it’s essential to undertake several preparatory steps to ensure that your review is well-researched, organized, and focused. This includes choosing a topic of general interest to you and doing exploratory research on that topic, writing an annotated bibliography, and noting major points, especially those that relate to the position you have taken on the topic. 

Literature reviews and academic research papers are essential components of scholarly work but serve different purposes within the academic realm. 3 A literature review aims to provide a foundation for understanding the current state of research on a particular topic, identify gaps or controversies, and lay the groundwork for future research. Therefore, it draws heavily from existing academic sources, including books, journal articles, and other scholarly publications. In contrast, an academic research paper aims to present new knowledge, contribute to the academic discourse, and advance the understanding of a specific research question. Therefore, it involves a mix of existing literature (in the introduction and literature review sections) and original data or findings obtained through research methods. 

Literature reviews are essential components of academic and research papers, and various strategies can be employed to conduct them effectively. If you want to know how to write a literature review for a research paper, here are four common approaches that are often used by researchers.  Chronological Review: This strategy involves organizing the literature based on the chronological order of publication. It helps to trace the development of a topic over time, showing how ideas, theories, and research have evolved.  Thematic Review: Thematic reviews focus on identifying and analyzing themes or topics that cut across different studies. Instead of organizing the literature chronologically, it is grouped by key themes or concepts, allowing for a comprehensive exploration of various aspects of the topic.  Methodological Review: This strategy involves organizing the literature based on the research methods employed in different studies. It helps to highlight the strengths and weaknesses of various methodologies and allows the reader to evaluate the reliability and validity of the research findings.  Theoretical Review: A theoretical review examines the literature based on the theoretical frameworks used in different studies. This approach helps to identify the key theories that have been applied to the topic and assess their contributions to the understanding of the subject.  It’s important to note that these strategies are not mutually exclusive, and a literature review may combine elements of more than one approach. The choice of strategy depends on the research question, the nature of the literature available, and the goals of the review. Additionally, other strategies, such as integrative reviews or systematic reviews, may be employed depending on the specific requirements of the research.

The literature review format can vary depending on the specific publication guidelines. However, there are some common elements and structures that are often followed. Here is a general guideline for the format of a literature review:  Introduction:   Provide an overview of the topic.  Define the scope and purpose of the literature review.  State the research question or objective.  Body:   Organize the literature by themes, concepts, or chronology.  Critically analyze and evaluate each source.  Discuss the strengths and weaknesses of the studies.  Highlight any methodological limitations or biases.  Identify patterns, connections, or contradictions in the existing research.  Conclusion:   Summarize the key points discussed in the literature review.  Highlight the research gap.  Address the research question or objective stated in the introduction.  Highlight the contributions of the review and suggest directions for future research.

Both annotated bibliographies and literature reviews involve the examination of scholarly sources. While annotated bibliographies focus on individual sources with brief annotations, literature reviews provide a more in-depth, integrated, and comprehensive analysis of existing literature on a specific topic. The key differences are as follows: 

References 

• Denney, A. S., & Tewksbury, R. (2013). How to write a literature review.  Journal of criminal justice education ,  24 (2), 218-234. 
• Pan, M. L. (2016).  Preparing literature reviews: Qualitative and quantitative approaches . Taylor & Francis. 
• Cantero, C. (2019). How to write a literature review.  San José State University Writing Center . 

Paperpal is an AI writing assistant that help academics write better, faster with real-time suggestions for in-depth language and grammar correction. Trained on millions of research manuscripts enhanced by professional academic editors, Paperpal delivers human precision at machine speed.  

Try it for free or upgrade to  Paperpal Prime , which unlocks unlimited access to premium features like academic translation, paraphrasing, contextual synonyms, consistency checks and more. It’s like always having a professional academic editor by your side! Go beyond limitations and experience the future of academic writing.  Get Paperpal Prime now at just US$19 a month!

Related Reads:

• Empirical Research: A Comprehensive Guide for Academics 
• How to Write a Scientific Paper in 10 Steps 
• Life Sciences Papers: 9 Tips for Authors Writing in Biological Sciences
• What is an Argumentative Essay? How to Write It (With Examples)

6 Tips for Post-Doc Researchers to Take Their Career to the Next Level

Self-plagiarism in research: what it is and how to avoid it, you may also like, what are journal guidelines on using generative ai..., types of plagiarism and 6 tips to avoid..., how to write an essay introduction (with examples)..., similarity checks: the author’s guide to plagiarism and..., what is a master’s thesis: a guide for..., authorship in academia: ghost, guest, and gift authorship, should you use ai tools like chatgpt for..., what are the benefits of generative ai for..., how to avoid plagiarism tips and advice for..., plagiarism checkers vs. ai content detection: navigating the....

Purdue Online Writing Lab Purdue OWL® College of Liberal Arts

Writing a Literature Review

Welcome to the Purdue OWL

This page is brought to you by the OWL at Purdue University. When printing this page, you must include the entire legal notice.

Copyright ©1995-2018 by The Writing Lab & The OWL at Purdue and Purdue University. All rights reserved. This material may not be published, reproduced, broadcast, rewritten, or redistributed without permission. Use of this site constitutes acceptance of our terms and conditions of fair use.

A literature review is a document or section of a document that collects key sources on a topic and discusses those sources in conversation with each other (also called synthesis ). The lit review is an important genre in many disciplines, not just literature (i.e., the study of works of literature such as novels and plays). When we say “literature review” or refer to “the literature,” we are talking about the research ( scholarship ) in a given field. You will often see the terms “the research,” “the scholarship,” and “the literature” used mostly interchangeably.

Where, when, and why would I write a lit review?

There are a number of different situations where you might write a literature review, each with slightly different expectations; different disciplines, too, have field-specific expectations for what a literature review is and does. For instance, in the humanities, authors might include more overt argumentation and interpretation of source material in their literature reviews, whereas in the sciences, authors are more likely to report study designs and results in their literature reviews; these differences reflect these disciplines’ purposes and conventions in scholarship. You should always look at examples from your own discipline and talk to professors or mentors in your field to be sure you understand your discipline’s conventions, for literature reviews as well as for any other genre.

A literature review can be a part of a research paper or scholarly article, usually falling after the introduction and before the research methods sections. In these cases, the lit review just needs to cover scholarship that is important to the issue you are writing about; sometimes it will also cover key sources that informed your research methodology.

Lit reviews can also be standalone pieces, either as assignments in a class or as publications. In a class, a lit review may be assigned to help students familiarize themselves with a topic and with scholarship in their field, get an idea of the other researchers working on the topic they’re interested in, find gaps in existing research in order to propose new projects, and/or develop a theoretical framework and methodology for later research. As a publication, a lit review usually is meant to help make other scholars’ lives easier by collecting and summarizing, synthesizing, and analyzing existing research on a topic. This can be especially helpful for students or scholars getting into a new research area, or for directing an entire community of scholars toward questions that have not yet been answered.

What are the parts of a lit review?

Most lit reviews use a basic introduction-body-conclusion structure; if your lit review is part of a larger paper, the introduction and conclusion pieces may be just a few sentences while you focus most of your attention on the body. If your lit review is a standalone piece, the introduction and conclusion take up more space and give you a place to discuss your goals, research methods, and conclusions separately from where you discuss the literature itself.

Introduction:

• An introductory paragraph that explains what your working topic and thesis is
• A forecast of key topics or texts that will appear in the review
• Potentially, a description of how you found sources and how you analyzed them for inclusion and discussion in the review (more often found in published, standalone literature reviews than in lit review sections in an article or research paper)
• Summarize and synthesize: Give an overview of the main points of each source and combine them into a coherent whole
• Analyze and interpret: Don’t just paraphrase other researchers – add your own interpretations where possible, discussing the significance of findings in relation to the literature as a whole
• Critically Evaluate: Mention the strengths and weaknesses of your sources
• Write in well-structured paragraphs: Use transition words and topic sentence to draw connections, comparisons, and contrasts.

Conclusion:

• Summarize the key findings you have taken from the literature and emphasize their significance
• Connect it back to your primary research question

How should I organize my lit review?

Lit reviews can take many different organizational patterns depending on what you are trying to accomplish with the review. Here are some examples:

• Chronological : The simplest approach is to trace the development of the topic over time, which helps familiarize the audience with the topic (for instance if you are introducing something that is not commonly known in your field). If you choose this strategy, be careful to avoid simply listing and summarizing sources in order. Try to analyze the patterns, turning points, and key debates that have shaped the direction of the field. Give your interpretation of how and why certain developments occurred (as mentioned previously, this may not be appropriate in your discipline — check with a teacher or mentor if you’re unsure).
• Thematic : If you have found some recurring central themes that you will continue working with throughout your piece, you can organize your literature review into subsections that address different aspects of the topic. For example, if you are reviewing literature about women and religion, key themes can include the role of women in churches and the religious attitude towards women.
• Qualitative versus quantitative research
• Empirical versus theoretical scholarship
• Divide the research by sociological, historical, or cultural sources
• Theoretical : In many humanities articles, the literature review is the foundation for the theoretical framework. You can use it to discuss various theories, models, and definitions of key concepts. You can argue for the relevance of a specific theoretical approach or combine various theorical concepts to create a framework for your research.

What are some strategies or tips I can use while writing my lit review?

Any lit review is only as good as the research it discusses; make sure your sources are well-chosen and your research is thorough. Don’t be afraid to do more research if you discover a new thread as you’re writing. More info on the research process is available in our "Conducting Research" resources .

As you’re doing your research, create an annotated bibliography ( see our page on the this type of document ). Much of the information used in an annotated bibliography can be used also in a literature review, so you’ll be not only partially drafting your lit review as you research, but also developing your sense of the larger conversation going on among scholars, professionals, and any other stakeholders in your topic.

Usually you will need to synthesize research rather than just summarizing it. This means drawing connections between sources to create a picture of the scholarly conversation on a topic over time. Many student writers struggle to synthesize because they feel they don’t have anything to add to the scholars they are citing; here are some strategies to help you:

• It often helps to remember that the point of these kinds of syntheses is to show your readers how you understand your research, to help them read the rest of your paper.
• Writing teachers often say synthesis is like hosting a dinner party: imagine all your sources are together in a room, discussing your topic. What are they saying to each other?
• Look at the in-text citations in each paragraph. Are you citing just one source for each paragraph? This usually indicates summary only. When you have multiple sources cited in a paragraph, you are more likely to be synthesizing them (not always, but often
• Read more about synthesis here.

The most interesting literature reviews are often written as arguments (again, as mentioned at the beginning of the page, this is discipline-specific and doesn’t work for all situations). Often, the literature review is where you can establish your research as filling a particular gap or as relevant in a particular way. You have some chance to do this in your introduction in an article, but the literature review section gives a more extended opportunity to establish the conversation in the way you would like your readers to see it. You can choose the intellectual lineage you would like to be part of and whose definitions matter most to your thinking (mostly humanities-specific, but this goes for sciences as well). In addressing these points, you argue for your place in the conversation, which tends to make the lit review more compelling than a simple reporting of other sources.

• UWF Libraries

Literature Review: Conducting & Writing

• Sample Literature Reviews
• Steps for Conducting a Lit Review
• Finding "The Literature"
• Organizing/Writing
• APA Style This link opens in a new window
• Chicago: Notes Bibliography This link opens in a new window
• MLA Style This link opens in a new window

Sample Lit Reviews from Communication Arts

Have an exemplary literature review.

• Literature Review Sample 1
• Literature Review Sample 2
• Literature Review Sample 3

Have you written a stellar literature review you care to share for teaching purposes?

Are you an instructor who has received an exemplary literature review and have permission from the student to post?

Please contact Britt McGowan at [email protected] for inclusion in this guide. All disciplines welcome and encouraged.

• << Previous: MLA Style
• Next: Get Help! >>
• Last Updated: Mar 22, 2024 9:37 AM
• URL: https://libguides.uwf.edu/litreview

Research Methods: Literature Reviews

• Annotated Bibliographies
• Literature Reviews
• Scoping Reviews
• Systematic Reviews
• Scholarship of Teaching and Learning
• Persuasive Arguments
• Subject Specific Methodology

A literature review involves researching, reading, analyzing, evaluating, and summarizing scholarly literature (typically journals and articles) about a specific topic. The results of a literature review may be an entire report or article OR may be part of a article, thesis, dissertation, or grant proposal. A literature review helps the author learn about the history and nature of their topic, and identify research gaps and problems.

Steps & Elements

Problem formulation

• Determine your topic and its components by asking a question
• Research: locate literature related to your topic to identify the gap(s) that can be addressed
• Read: read the articles or other sources of information
• Analyze: assess the findings for relevancy
• Evaluating: determine how the article are relevant to your research and what are the key findings
• Synthesis: write about the key findings and how it is relevant to your research

Elements of a Literature Review

• Summarize subject, issue or theory under consideration, along with objectives of the review
• Divide works under review into categories (e.g. those in support of a particular position, those against, those offering alternative theories entirely)
• Explain how each work is similar to and how it varies from the others
• Conclude which pieces are best considered in their argument, are most convincing of their opinions, and make the greatest contribution to the understanding and development of an area of research

Writing a Literature Review Resources

• How to Write a Literature Review From the Wesleyan University Library
• Write a Literature Review From the University of California Santa Cruz Library. A Brief overview of a literature review, includes a list of stages for writing a lit review.
• Literature Reviews From the University of North Carolina Writing Center. Detailed information about writing a literature review.
• Undertaking a literature review: a step-by-step approach Cronin, P., Ryan, F., & Coughan, M. (2008). Undertaking a literature review: A step-by-step approach. British Journal of Nursing, 17(1), p.38-43

Literature Review Tutorial

• << Previous: Annotated Bibliographies
• Next: Scoping Reviews >>
• Last Updated: Feb 29, 2024 12:00 PM
• URL: https://guides.auraria.edu/researchmethods

1100 Lawrence Street Denver, CO 80204 303-315-7700 Ask Us Directions

An official website of the United States government

The .gov means it’s official. Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

The site is secure. The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

• Publications
• Account settings

Preview improvements coming to the PMC website in October 2024. Learn More or Try it out now .

• Advanced Search
• Journal List
• Wiley-Blackwell Online Open

An overview of methodological approaches in systematic reviews

Prabhakar veginadu.

1 Department of Rural Clinical Sciences, La Trobe Rural Health School, La Trobe University, Bendigo Victoria, Australia

Hanny Calache

2 Lincoln International Institute for Rural Health, University of Lincoln, Brayford Pool, Lincoln UK

Akshaya Pandian

3 Department of Orthodontics, Saveetha Dental College, Chennai Tamil Nadu, India

Mohd Masood

Associated data.

APPENDIX B: List of excluded studies with detailed reasons for exclusion

APPENDIX C: Quality assessment of included reviews using AMSTAR 2

The aim of this overview is to identify and collate evidence from existing published systematic review (SR) articles evaluating various methodological approaches used at each stage of an SR.

The search was conducted in five electronic databases from inception to November 2020 and updated in February 2022: MEDLINE, Embase, Web of Science Core Collection, Cochrane Database of Systematic Reviews, and APA PsycINFO. Title and abstract screening were performed in two stages by one reviewer, supported by a second reviewer. Full‐text screening, data extraction, and quality appraisal were performed by two reviewers independently. The quality of the included SRs was assessed using the AMSTAR 2 checklist.

The search retrieved 41,556 unique citations, of which 9 SRs were deemed eligible for inclusion in final synthesis. Included SRs evaluated 24 unique methodological approaches used for defining the review scope and eligibility, literature search, screening, data extraction, and quality appraisal in the SR process. Limited evidence supports the following (a) searching multiple resources (electronic databases, handsearching, and reference lists) to identify relevant literature; (b) excluding non‐English, gray, and unpublished literature, and (c) use of text‐mining approaches during title and abstract screening.

The overview identified limited SR‐level evidence on various methodological approaches currently employed during five of the seven fundamental steps in the SR process, as well as some methodological modifications currently used in expedited SRs. Overall, findings of this overview highlight the dearth of published SRs focused on SR methodologies and this warrants future work in this area.

1. INTRODUCTION

Evidence synthesis is a prerequisite for knowledge translation. 1 A well conducted systematic review (SR), often in conjunction with meta‐analyses (MA) when appropriate, is considered the “gold standard” of methods for synthesizing evidence related to a topic of interest. 2 The central strength of an SR is the transparency of the methods used to systematically search, appraise, and synthesize the available evidence. 3 Several guidelines, developed by various organizations, are available for the conduct of an SR; 4 , 5 , 6 , 7 among these, Cochrane is considered a pioneer in developing rigorous and highly structured methodology for the conduct of SRs. 8 The guidelines developed by these organizations outline seven fundamental steps required in SR process: defining the scope of the review and eligibility criteria, literature searching and retrieval, selecting eligible studies, extracting relevant data, assessing risk of bias (RoB) in included studies, synthesizing results, and assessing certainty of evidence (CoE) and presenting findings. 4 , 5 , 6 , 7

The methodological rigor involved in an SR can require a significant amount of time and resource, which may not always be available. 9 As a result, there has been a proliferation of modifications made to the traditional SR process, such as refining, shortening, bypassing, or omitting one or more steps, 10 , 11 for example, limits on the number and type of databases searched, limits on publication date, language, and types of studies included, and limiting to one reviewer for screening and selection of studies, as opposed to two or more reviewers. 10 , 11 These methodological modifications are made to accommodate the needs of and resource constraints of the reviewers and stakeholders (e.g., organizations, policymakers, health care professionals, and other knowledge users). While such modifications are considered time and resource efficient, they may introduce bias in the review process reducing their usefulness. 5

Substantial research has been conducted examining various approaches used in the standardized SR methodology and their impact on the validity of SR results. There are a number of published reviews examining the approaches or modifications corresponding to single 12 , 13 or multiple steps 14 involved in an SR. However, there is yet to be a comprehensive summary of the SR‐level evidence for all the seven fundamental steps in an SR. Such a holistic evidence synthesis will provide an empirical basis to confirm the validity of current accepted practices in the conduct of SRs. Furthermore, sometimes there is a balance that needs to be achieved between the resource availability and the need to synthesize the evidence in the best way possible, given the constraints. This evidence base will also inform the choice of modifications to be made to the SR methods, as well as the potential impact of these modifications on the SR results. An overview is considered the choice of approach for summarizing existing evidence on a broad topic, directing the reader to evidence, or highlighting the gaps in evidence, where the evidence is derived exclusively from SRs. 15 Therefore, for this review, an overview approach was used to (a) identify and collate evidence from existing published SR articles evaluating various methodological approaches employed in each of the seven fundamental steps of an SR and (b) highlight both the gaps in the current research and the potential areas for future research on the methods employed in SRs.

An a priori protocol was developed for this overview but was not registered with the International Prospective Register of Systematic Reviews (PROSPERO), as the review was primarily methodological in nature and did not meet PROSPERO eligibility criteria for registration. The protocol is available from the corresponding author upon reasonable request. This overview was conducted based on the guidelines for the conduct of overviews as outlined in The Cochrane Handbook. 15 Reporting followed the Preferred Reporting Items for Systematic reviews and Meta‐analyses (PRISMA) statement. 3

2.1. Eligibility criteria

Only published SRs, with or without associated MA, were included in this overview. We adopted the defining characteristics of SRs from The Cochrane Handbook. 5 According to The Cochrane Handbook, a review was considered systematic if it satisfied the following criteria: (a) clearly states the objectives and eligibility criteria for study inclusion; (b) provides reproducible methodology; (c) includes a systematic search to identify all eligible studies; (d) reports assessment of validity of findings of included studies (e.g., RoB assessment of the included studies); (e) systematically presents all the characteristics or findings of the included studies. 5 Reviews that did not meet all of the above criteria were not considered a SR for this study and were excluded. MA‐only articles were included if it was mentioned that the MA was based on an SR.

SRs and/or MA of primary studies evaluating methodological approaches used in defining review scope and study eligibility, literature search, study selection, data extraction, RoB assessment, data synthesis, and CoE assessment and reporting were included. The methodological approaches examined in these SRs and/or MA can also be related to the substeps or elements of these steps; for example, applying limits on date or type of publication are the elements of literature search. Included SRs examined or compared various aspects of a method or methods, and the associated factors, including but not limited to: precision or effectiveness; accuracy or reliability; impact on the SR and/or MA results; reproducibility of an SR steps or bias occurred; time and/or resource efficiency. SRs assessing the methodological quality of SRs (e.g., adherence to reporting guidelines), evaluating techniques for building search strategies or the use of specific database filters (e.g., use of Boolean operators or search filters for randomized controlled trials), examining various tools used for RoB or CoE assessment (e.g., ROBINS vs. Cochrane RoB tool), or evaluating statistical techniques used in meta‐analyses were excluded. 14

2.2. Search

The search for published SRs was performed on the following scientific databases initially from inception to third week of November 2020 and updated in the last week of February 2022: MEDLINE (via Ovid), Embase (via Ovid), Web of Science Core Collection, Cochrane Database of Systematic Reviews, and American Psychological Association (APA) PsycINFO. Search was restricted to English language publications. Following the objectives of this study, study design filters within databases were used to restrict the search to SRs and MA, where available. The reference lists of included SRs were also searched for potentially relevant publications.

The search terms included keywords, truncations, and subject headings for the key concepts in the review question: SRs and/or MA, methods, and evaluation. Some of the terms were adopted from the search strategy used in a previous review by Robson et al., which reviewed primary studies on methodological approaches used in study selection, data extraction, and quality appraisal steps of SR process. 14 Individual search strategies were developed for respective databases by combining the search terms using appropriate proximity and Boolean operators, along with the related subject headings in order to identify SRs and/or MA. 16 , 17 A senior librarian was consulted in the design of the search terms and strategy. Appendix A presents the detailed search strategies for all five databases.

2.3. Study selection and data extraction

Title and abstract screening of references were performed in three steps. First, one reviewer (PV) screened all the titles and excluded obviously irrelevant citations, for example, articles on topics not related to SRs, non‐SR publications (such as randomized controlled trials, observational studies, scoping reviews, etc.). Next, from the remaining citations, a random sample of 200 titles and abstracts were screened against the predefined eligibility criteria by two reviewers (PV and MM), independently, in duplicate. Discrepancies were discussed and resolved by consensus. This step ensured that the responses of the two reviewers were calibrated for consistency in the application of the eligibility criteria in the screening process. Finally, all the remaining titles and abstracts were reviewed by a single “calibrated” reviewer (PV) to identify potential full‐text records. Full‐text screening was performed by at least two authors independently (PV screened all the records, and duplicate assessment was conducted by MM, HC, or MG), with discrepancies resolved via discussions or by consulting a third reviewer.

Data related to review characteristics, results, key findings, and conclusions were extracted by at least two reviewers independently (PV performed data extraction for all the reviews and duplicate extraction was performed by AP, HC, or MG).

2.4. Quality assessment of included reviews

The quality assessment of the included SRs was performed using the AMSTAR 2 (A MeaSurement Tool to Assess systematic Reviews). The tool consists of a 16‐item checklist addressing critical and noncritical domains. 18 For the purpose of this study, the domain related to MA was reclassified from critical to noncritical, as SRs with and without MA were included. The other six critical domains were used according to the tool guidelines. 18 Two reviewers (PV and AP) independently responded to each of the 16 items in the checklist with either “yes,” “partial yes,” or “no.” Based on the interpretations of the critical and noncritical domains, the overall quality of the review was rated as high, moderate, low, or critically low. 18 Disagreements were resolved through discussion or by consulting a third reviewer.

2.5. Data synthesis

To provide an understandable summary of existing evidence syntheses, characteristics of the methods evaluated in the included SRs were examined and key findings were categorized and presented based on the corresponding step in the SR process. The categories of key elements within each step were discussed and agreed by the authors. Results of the included reviews were tabulated and summarized descriptively, along with a discussion on any overlap in the primary studies. 15 No quantitative analyses of the data were performed.

From 41,556 unique citations identified through literature search, 50 full‐text records were reviewed, and nine systematic reviews 14 , 19 , 20 , 21 , 22 , 23 , 24 , 25 , 26 were deemed eligible for inclusion. The flow of studies through the screening process is presented in Figure  1 . A list of excluded studies with reasons can be found in Appendix B .

Study selection flowchart

3.1. Characteristics of included reviews

Table  1 summarizes the characteristics of included SRs. The majority of the included reviews (six of nine) were published after 2010. 14 , 22 , 23 , 24 , 25 , 26 Four of the nine included SRs were Cochrane reviews. 20 , 21 , 22 , 23 The number of databases searched in the reviews ranged from 2 to 14, 2 reviews searched gray literature sources, 24 , 25 and 7 reviews included a supplementary search strategy to identify relevant literature. 14 , 19 , 20 , 21 , 22 , 23 , 26 Three of the included SRs (all Cochrane reviews) included an integrated MA. 20 , 21 , 23

Characteristics of included studies

SR = systematic review; MA = meta‐analysis; RCT = randomized controlled trial; CCT = controlled clinical trial; N/R = not reported.

The included SRs evaluated 24 unique methodological approaches (26 in total) used across five steps in the SR process; 8 SRs evaluated 6 approaches, 19 , 20 , 21 , 22 , 23 , 24 , 25 , 26 while 1 review evaluated 18 approaches. 14 Exclusion of gray or unpublished literature 21 , 26 and blinding of reviewers for RoB assessment 14 , 23 were evaluated in two reviews each. Included SRs evaluated methods used in five different steps in the SR process, including methods used in defining the scope of review ( n  = 3), literature search ( n  = 3), study selection ( n  = 2), data extraction ( n  = 1), and RoB assessment ( n  = 2) (Table  2 ).

Summary of findings from review evaluating systematic review methods

There was some overlap in the primary studies evaluated in the included SRs on the same topics: Schmucker et al. 26 and Hopewell et al. 21 ( n  = 4), Hopewell et al. 20 and Crumley et al. 19 ( n  = 30), and Robson et al. 14 and Morissette et al. 23 ( n  = 4). There were no conflicting results between any of the identified SRs on the same topic.

3.2. Methodological quality of included reviews

Overall, the quality of the included reviews was assessed as moderate at best (Table  2 ). The most common critical weakness in the reviews was failure to provide justification for excluding individual studies (four reviews). Detailed quality assessment is provided in Appendix C .

3.3. Evidence on systematic review methods

3.3.1. methods for defining review scope and eligibility.

Two SRs investigated the effect of excluding data obtained from gray or unpublished sources on the pooled effect estimates of MA. 21 , 26 Hopewell et al. 21 reviewed five studies that compared the impact of gray literature on the results of a cohort of MA of RCTs in health care interventions. Gray literature was defined as information published in “print or electronic sources not controlled by commercial or academic publishers.” Findings showed an overall greater treatment effect for published trials than trials reported in gray literature. In a more recent review, Schmucker et al. 26 addressed similar objectives, by investigating gray and unpublished data in medicine. In addition to gray literature, defined similar to the previous review by Hopewell et al., the authors also evaluated unpublished data—defined as “supplemental unpublished data related to published trials, data obtained from the Food and Drug Administration  or other regulatory websites or postmarketing analyses hidden from the public.” The review found that in majority of the MA, excluding gray literature had little or no effect on the pooled effect estimates. The evidence was limited to conclude if the data from gray and unpublished literature had an impact on the conclusions of MA. 26

Morrison et al. 24 examined five studies measuring the effect of excluding non‐English language RCTs on the summary treatment effects of SR‐based MA in various fields of conventional medicine. Although none of the included studies reported major difference in the treatment effect estimates between English only and non‐English inclusive MA, the review found inconsistent evidence regarding the methodological and reporting quality of English and non‐English trials. 24 As such, there might be a risk of introducing “language bias” when excluding non‐English language RCTs. The authors also noted that the numbers of non‐English trials vary across medical specialties, as does the impact of these trials on MA results. Based on these findings, Morrison et al. 24 conclude that literature searches must include non‐English studies when resources and time are available to minimize the risk of introducing “language bias.”

3.3.2. Methods for searching studies

Crumley et al. 19 analyzed recall (also referred to as “sensitivity” by some researchers; defined as “percentage of relevant studies identified by the search”) and precision (defined as “percentage of studies identified by the search that were relevant”) when searching a single resource to identify randomized controlled trials and controlled clinical trials, as opposed to searching multiple resources. The studies included in their review frequently compared a MEDLINE only search with the search involving a combination of other resources. The review found low median recall estimates (median values between 24% and 92%) and very low median precisions (median values between 0% and 49%) for most of the electronic databases when searched singularly. 19 A between‐database comparison, based on the type of search strategy used, showed better recall and precision for complex and Cochrane Highly Sensitive search strategies (CHSSS). In conclusion, the authors emphasize that literature searches for trials in SRs must include multiple sources. 19

In an SR comparing handsearching and electronic database searching, Hopewell et al. 20 found that handsearching retrieved more relevant RCTs (retrieval rate of 92%−100%) than searching in a single electronic database (retrieval rates of 67% for PsycINFO/PsycLIT, 55% for MEDLINE, and 49% for Embase). The retrieval rates varied depending on the quality of handsearching, type of electronic search strategy used (e.g., simple, complex or CHSSS), and type of trial reports searched (e.g., full reports, conference abstracts, etc.). The authors concluded that handsearching was particularly important in identifying full trials published in nonindexed journals and in languages other than English, as well as those published as abstracts and letters. 20

The effectiveness of checking reference lists to retrieve additional relevant studies for an SR was investigated by Horsley et al. 22 The review reported that checking reference lists yielded 2.5%–40% more studies depending on the quality and comprehensiveness of the electronic search used. The authors conclude that there is some evidence, although from poor quality studies, to support use of checking reference lists to supplement database searching. 22

3.3.3. Methods for selecting studies

Three approaches relevant to reviewer characteristics, including number, experience, and blinding of reviewers involved in the screening process were highlighted in an SR by Robson et al. 14 Based on the retrieved evidence, the authors recommended that two independent, experienced, and unblinded reviewers be involved in study selection. 14 A modified approach has also been suggested by the review authors, where one reviewer screens and the other reviewer verifies the list of excluded studies, when the resources are limited. It should be noted however this suggestion is likely based on the authors’ opinion, as there was no evidence related to this from the studies included in the review.

Robson et al. 14 also reported two methods describing the use of technology for screening studies: use of Google Translate for translating languages (for example, German language articles to English) to facilitate screening was considered a viable method, while using two computer monitors for screening did not increase the screening efficiency in SR. Title‐first screening was found to be more efficient than simultaneous screening of titles and abstracts, although the gain in time with the former method was lesser than the latter. Therefore, considering that the search results are routinely exported as titles and abstracts, Robson et al. 14 recommend screening titles and abstracts simultaneously. However, the authors note that these conclusions were based on very limited number (in most instances one study per method) of low‐quality studies. 14

3.3.4. Methods for data extraction

Robson et al. 14 examined three approaches for data extraction relevant to reviewer characteristics, including number, experience, and blinding of reviewers (similar to the study selection step). Although based on limited evidence from a small number of studies, the authors recommended use of two experienced and unblinded reviewers for data extraction. The experience of the reviewers was suggested to be especially important when extracting continuous outcomes (or quantitative) data. However, when the resources are limited, data extraction by one reviewer and a verification of the outcomes data by a second reviewer was recommended.

As for the methods involving use of technology, Robson et al. 14 identified limited evidence on the use of two monitors to improve the data extraction efficiency and computer‐assisted programs for graphical data extraction. However, use of Google Translate for data extraction in non‐English articles was not considered to be viable. 14 In the same review, Robson et al. 14 identified evidence supporting contacting authors for obtaining additional relevant data.

3.3.5. Methods for RoB assessment

Two SRs examined the impact of blinding of reviewers for RoB assessments. 14 , 23 Morissette et al. 23 investigated the mean differences between the blinded and unblinded RoB assessment scores and found inconsistent differences among the included studies providing no definitive conclusions. Similar conclusions were drawn in a more recent review by Robson et al., 14 which included four studies on reviewer blinding for RoB assessment that completely overlapped with Morissette et al. 23

Use of experienced reviewers and provision of additional guidance for RoB assessment were examined by Robson et al. 14 The review concluded that providing intensive training and guidance on assessing studies reporting insufficient data to the reviewers improves RoB assessments. 14 Obtaining additional data related to quality assessment by contacting study authors was also found to help the RoB assessments, although based on limited evidence. When assessing the qualitative or mixed method reviews, Robson et al. 14 recommends the use of a structured RoB tool as opposed to an unstructured tool. No SRs were identified on data synthesis and CoE assessment and reporting steps.

4. DISCUSSION

4.1. summary of findings.

Nine SRs examining 24 unique methods used across five steps in the SR process were identified in this overview. The collective evidence supports some current traditional and modified SR practices, while challenging other approaches. However, the quality of the included reviews was assessed to be moderate at best and in the majority of the included SRs, evidence related to the evaluated methods was obtained from very limited numbers of primary studies. As such, the interpretations from these SRs should be made cautiously.

The evidence gathered from the included SRs corroborate a few current SR approaches. 5 For example, it is important to search multiple resources for identifying relevant trials (RCTs and/or CCTs). The resources must include a combination of electronic database searching, handsearching, and reference lists of retrieved articles. 5 However, no SRs have been identified that evaluated the impact of the number of electronic databases searched. A recent study by Halladay et al. 27 found that articles on therapeutic intervention, retrieved by searching databases other than PubMed (including Embase), contributed only a small amount of information to the MA and also had a minimal impact on the MA results. The authors concluded that when the resources are limited and when large number of studies are expected to be retrieved for the SR or MA, PubMed‐only search can yield reliable results. 27

Findings from the included SRs also reiterate some methodological modifications currently employed to “expedite” the SR process. 10 , 11 For example, excluding non‐English language trials and gray/unpublished trials from MA have been shown to have minimal or no impact on the results of MA. 24 , 26 However, the efficiency of these SR methods, in terms of time and the resources used, have not been evaluated in the included SRs. 24 , 26 Of the SRs included, only two have focused on the aspect of efficiency 14 , 25 ; O'Mara‐Eves et al. 25 report some evidence to support the use of text‐mining approaches for title and abstract screening in order to increase the rate of screening. Moreover, only one included SR 14 considered primary studies that evaluated reliability (inter‐ or intra‐reviewer consistency) and accuracy (validity when compared against a “gold standard” method) of the SR methods. This can be attributed to the limited number of primary studies that evaluated these outcomes when evaluating the SR methods. 14 Lack of outcome measures related to reliability, accuracy, and efficiency precludes making definitive recommendations on the use of these methods/modifications. Future research studies must focus on these outcomes.

Some evaluated methods may be relevant to multiple steps; for example, exclusions based on publication status (gray/unpublished literature) and language of publication (non‐English language studies) can be outlined in the a priori eligibility criteria or can be incorporated as search limits in the search strategy. SRs included in this overview focused on the effect of study exclusions on pooled treatment effect estimates or MA conclusions. Excluding studies from the search results, after conducting a comprehensive search, based on different eligibility criteria may yield different results when compared to the results obtained when limiting the search itself. 28 Further studies are required to examine this aspect.

Although we acknowledge the lack of standardized quality assessment tools for methodological study designs, we adhered to the Cochrane criteria for identifying SRs in this overview. This was done to ensure consistency in the quality of the included evidence. As a result, we excluded three reviews that did not provide any form of discussion on the quality of the included studies. The methods investigated in these reviews concern supplementary search, 29 data extraction, 12 and screening. 13 However, methods reported in two of these three reviews, by Mathes et al. 12 and Waffenschmidt et al., 13 have also been examined in the SR by Robson et al., 14 which was included in this overview; in most instances (with the exception of one study included in Mathes et al. 12 and Waffenschmidt et al. 13 each), the studies examined in these excluded reviews overlapped with those in the SR by Robson et al. 14

One of the key gaps in the knowledge observed in this overview was the dearth of SRs on the methods used in the data synthesis component of SR. Narrative and quantitative syntheses are the two most commonly used approaches for synthesizing data in evidence synthesis. 5 There are some published studies on the proposed indications and implications of these two approaches. 30 , 31 These studies found that both data synthesis methods produced comparable results and have their own advantages, suggesting that the choice of the method must be based on the purpose of the review. 31 With increasing number of “expedited” SR approaches (so called “rapid reviews”) avoiding MA, 10 , 11 further research studies are warranted in this area to determine the impact of the type of data synthesis on the results of the SR.

4.2. Implications for future research

The findings of this overview highlight several areas of paucity in primary research and evidence synthesis on SR methods. First, no SRs were identified on methods used in two important components of the SR process, including data synthesis and CoE and reporting. As for the included SRs, a limited number of evaluation studies have been identified for several methods. This indicates that further research is required to corroborate many of the methods recommended in current SR guidelines. 4 , 5 , 6 , 7 Second, some SRs evaluated the impact of methods on the results of quantitative synthesis and MA conclusions. Future research studies must also focus on the interpretations of SR results. 28 , 32 Finally, most of the included SRs were conducted on specific topics related to the field of health care, limiting the generalizability of the findings to other areas. It is important that future research studies evaluating evidence syntheses broaden the objectives and include studies on different topics within the field of health care.

4.3. Strengths and limitations

To our knowledge, this is the first overview summarizing current evidence from SRs and MA on different methodological approaches used in several fundamental steps in SR conduct. The overview methodology followed well established guidelines and strict criteria defined for the inclusion of SRs.

There are several limitations related to the nature of the included reviews. Evidence for most of the methods investigated in the included reviews was derived from a limited number of primary studies. Also, the majority of the included SRs may be considered outdated as they were published (or last updated) more than 5 years ago 33 ; only three of the nine SRs have been published in the last 5 years. 14 , 25 , 26 Therefore, important and recent evidence related to these topics may not have been included. Substantial numbers of included SRs were conducted in the field of health, which may limit the generalizability of the findings. Some method evaluations in the included SRs focused on quantitative analyses components and MA conclusions only. As such, the applicability of these findings to SR more broadly is still unclear. 28 Considering the methodological nature of our overview, limiting the inclusion of SRs according to the Cochrane criteria might have resulted in missing some relevant evidence from those reviews without a quality assessment component. 12 , 13 , 29 Although the included SRs performed some form of quality appraisal of the included studies, most of them did not use a standardized RoB tool, which may impact the confidence in their conclusions. Due to the type of outcome measures used for the method evaluations in the primary studies and the included SRs, some of the identified methods have not been validated against a reference standard.

Some limitations in the overview process must be noted. While our literature search was exhaustive covering five bibliographic databases and supplementary search of reference lists, no gray sources or other evidence resources were searched. Also, the search was primarily conducted in health databases, which might have resulted in missing SRs published in other fields. Moreover, only English language SRs were included for feasibility. As the literature search retrieved large number of citations (i.e., 41,556), the title and abstract screening was performed by a single reviewer, calibrated for consistency in the screening process by another reviewer, owing to time and resource limitations. These might have potentially resulted in some errors when retrieving and selecting relevant SRs. The SR methods were grouped based on key elements of each recommended SR step, as agreed by the authors. This categorization pertains to the identified set of methods and should be considered subjective.

5. CONCLUSIONS

This overview identified limited SR‐level evidence on various methodological approaches currently employed during five of the seven fundamental steps in the SR process. Limited evidence was also identified on some methodological modifications currently used to expedite the SR process. Overall, findings highlight the dearth of SRs on SR methodologies, warranting further work to confirm several current recommendations on conventional and expedited SR processes.

CONFLICT OF INTEREST

The authors declare no conflicts of interest.

Supporting information

APPENDIX A: Detailed search strategies

ACKNOWLEDGMENTS

The first author is supported by a La Trobe University Full Fee Research Scholarship and a Graduate Research Scholarship.

Open Access Funding provided by La Trobe University.

Veginadu P, Calache H, Gussy M, Pandian A, Masood M. An overview of methodological approaches in systematic reviews . J Evid Based Med . 2022; 15 :39–54. 10.1111/jebm.12468 [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]

• Open access
• Published: 20 September 2023

Older adults’ experiences during the COVID-19 pandemic: a qualitative systematic literature review

• Elfriede Derrer-Merk   ORCID: orcid.org/0000-0001-7241-0808 1 ,
• Maria-Fernanda Reyes-Rodriguez   ORCID: orcid.org/0000-0002-2645-5092 2 ,
• Laura K. Soulsby   ORCID: orcid.org/0000-0001-9071-8654 1 ,
• Louise Roper   ORCID: orcid.org/0000-0002-2918-7628 3 &
• Kate M. Bennett   ORCID: orcid.org/0000-0003-3164-6894 1  

BMC Geriatrics volume  23 , Article number:  580 ( 2023 ) Cite this article

1523 Accesses

5 Citations

2 Altmetric

Metrics details

Relatively little is known about the lived experiences of older adults during the COVID-19 pandemic. We systematically review the international literature to understand the lived experiences of older adult’s experiences during the pandemic.

Design and methodology

This study uses a meta-ethnographical approach to investigate the included studies. The analyses were undertaken with constructivist grounded theory.

Thirty-two studies met the inclusion criteria and only five papers were of low quality. Most, but not all studies, were from the global north. We identified three themes: desired and challenged wellbeing; coping and adaptation; and discrimination and intersectionality.

Overall, the studies’ findings were varied and reflected different times during the pandemic. Studies reported the impact of mass media messaging and its mostly negative impact on older adults. Many studies highlighted the impact of the COVID-19 pandemic on participants' social connectivity and well-being including missing the proximity of loved ones and in consequence experienced an increase in anxiety, feeling of depression, or loneliness. However, many studies reported how participants adapted to the change of lifestyle including new ways of communication, and social distancing. Some studies focused on discrimination and the experiences of sexual and gender minority and ethnic minority participants. Studies found that the pandemic impacted the participants’ well-being including suicidal risk behaviour, friendship loss, and increased mental health issues.

The COVID-19 pandemic disrupted and impacted older adults’ well-being worldwide. Despite the cultural and socio-economic differences many commonalities were found. Studies described the impact of mass media reporting, social connectivity, impact of confinement on well-being, coping, and on discrimination. The authors suggest that these findings need to be acknowledged for future pandemic strategies. Additionally, policy-making processes need to include older adults to address their needs. PROSPERO record [CRD42022331714], (Derrer-Merk et al., Older adults’ lived experiences during the COVID-19 pandemic: a systematic review, 2022).

Peer Review reports

Introduction

In March 2020 the World Health Organisation declared a pandemic caused by the virus SARS-CoV2 (COVID-19) [ 1 ]. At this time 118,000 cases in 114 countries were identified and 4,291 people had already lost their lives [ 2 ]. By July 2022, there were over 5.7 million active cases and over 6.4 million deaths [ 2 ]. Despite the effort to combat and eliminate the virus globally, new variants of the virus are still a concern. At the start of the pandemic, little was known about who would be most at risk, but emerging data suggested that both people with underlying health conditions and older people had a higher risk of becoming seriously ill [ 3 ]. Thus, countries worldwide imposed health and safety measures aimed at reducing viral transmission and protecting people at higher risk of contracting the virus [ 4 ]. These measures included: national lockdowns with different lengths and frequencies; targeted shopping times for older people; hygiene procedures (wearing masks, washing hands regularly, disinfecting hands); restricting or prohibiting social gatherings; working from home, school closure, and home-schooling.

Research suggests that lockdowns and protective measures impacted on people’s lives, and had a particular impact on older people. They were at higher risk from COVID-19, with greater disease severity and higher mortality compared to younger people [ 5 ]. Older adults were identified as at higher risk as they are more likely to have pre-existing conditions including heart disease, diabetes, and severe respiratory conditions [ 5 ]. Additionally, recent research highlights that COVID-19 and its safety measures led to increased mental health problems, including increased feelings of depression, anxiety, social isolation, and loneliness, potentially cognitive decline [ 6 , 7 , 8 , 9 , 10 , 11 , 12 , 13 , 14 , 15 , 16 , 17 , 18 , 19 , 20 , 21 , 22 ]. Other studies reported the consequences of only age-based protective health measures including self-isolation for people older people (e.g. feeling old, losing out the time with family) [ 23 , 24 , 25 , 26 , 27 , 28 , 29 , 30 ].

Over the past decade, the World Health Organisation (WHO) has recognised the importance of risk communication within public health emergency preparedness and response, especially in the context of epidemics and pandemics. Risk communication is defined as “the real-time exchange of information, advice and opinions between experts or officials, and people who face a threat (hazard) to their survival, health or economic or social well-being” ([ 31 ], p5). This includes reporting the risk and health protection measurements through media and governmental bodies. Constructing awareness and building trust in society are essential components of risk communication [ 32 ]. In the context of the pandemic, the WHO noted that individual risk perception helped to prompt problem-solving activities (such as wearing face masks, social distancing, and self-isolation). However, the prolonged perception of pandemic-related uncertainty and risk could also lead to heightened feelings of distress and anxiety [ 31 , 33 ], see also [ 34 , 35 , 36 , 37 ].

This new and unprecedented disease provided the ground for researchers worldwide to investigate the COVID-19 pandemic. To date (August 2022), approximately 8072 studies have been recorded on the U.S. National Library of Medicine ClinicalTrials.gov [ 38 ] and 12002 systematic reviews have been registered at PROSPERO, concerning COVID-19. However, to our knowledge, there is little known about qualitative research as a response to the COVID-19 pandemic and how it impacted older adults’ well-being [ 39 ]. In particular, little is known about how older people experienced the pandemic. Thus, our research question considers: How did older adults experience the COVID-19 pandemic worldwide?

We use a qualitative evidence synthesis (QES) recommended by Cochrane Qualitative and Implementation Methods Group to identify peer-reviewed articles [ 40 ]. This provides an overview of existing research, identifies potential research gaps, and develops new cumulative knowledge concerning the COVID-19 pandemic and older adults’ experiences. QES is a valuable method for its potential to contribute to research and policy [ 41 ]. Flemming and Noyes [ 40 ] argue that the evidence synthesis from qualitative research provides a richer interpretation compared to single primary research. They identified an increasing demand for qualitative evidence synthesis from a wide range of “health and social professionals, policymakers, guideline developers and educationalists” (p.1).

Methodology

A systematic literature review requires a specific approach compared to other reviews. Although there is no consensus on how it is conducted, recent systematic literature reviews have agreed the following reporting criteria are addressed [ 42 , 43 ]: (a) a research question; (b) reporting database, and search strategy; (c) inclusion and exclusion criteria; (d) reporting selection methods; (e) critically appraisal tools; (f) data analysis and synthesis. We applied these criteria in our study and began by registering the research protocol with Prospero [ 44 ].

The study is registered at Prospero [ 44 ]. This systematic literature review incorporates qualitative studies concerning older adults’ experiences during the COVID-19 pandemic.

Search strategy

The primary qualitative articles were identified via a systematic search as per the qualitative-specific SPIDER approach [ 45 ]. The SPIDER tool is designed to structure qualitative research questions, focusing less on interventions and more on study design, and ‘samples’ rather than populations, encompassing:

S-Sample. This includes all articles concerning older adults aged 60 +  [ 1 ].

P-Phenomena of Interest. How did older adults experience the COVID-19 pandemic?

D-Design. We aim to investigate qualitative studies concerning the experiences of older adults during the COVID-19 pandemic.

E-Evaluation. The evaluation of studies will be evaluated with the amended Critical Appraisal Skills Programme CASP [ 46 ].

R-Research type Qualitative

Information source

The following databases were searched: PsychInfo, Medline, CINAHL, Web of Science, Annual Review, Annual Review of Gerontology, and Geriatrics. A hand search was conducted on Google Scholar and additional searches examined the reference lists of the included papers. The keyword search included the following terms: (older adults or elderly) AND (COVID-19 or SARS or pandemic) AND (experiences); (older adults) AND (experience) AND (covid-19) OR (coronavirus); (older adults) AND (experience) AND (covid-19 OR coronavirus) AND (Qualitative). Additional hand search terms included e.g. senior, senior citizen, or old age.

Inclusion and exclusion criteria

Articles were included when they met the following criteria: primary research using qualitative methods related to the lived experience of older adults aged 60 + (i.e. the experiences of individuals during the COVID-19 pandemic); peer-reviewed journal articles published in English; related to the COVID-19 pandemic; empirical research; published from 2020 till August 2022.

Articles were excluded when: papers discussed health professionals’ experiences; diagnostics; medical studies; interventions; day-care; home care; or carers; experiences with dementia; studies including hospitals; quantitative studies; mixed-method studies; single-case studies; people under the age of 60; grey literature; scoping reviews, and systematic reviews. We excluded clinical/care-related studies as we wanted to explore the everyday experiences of people aged 60 + . Mixed-method studies were excluded as we were interested in what was represented in solely qualitative studies. However, we acknowledge, that mixed-method studies are valuable for future systematic reviews.

Meta-ethnography

The qualitative synthesis was undertaken by using meta-ethnography. The authors have chosen meta-ethnography over other methodologies as it is an inductive and interpretive synthesis analysis and is uniquely “suited to developing new conceptual models and theories” ([ 47 ], p 2), see also [ 48 ]. Therefore, it combines well with constructivist grounded theory methodology. Meta-ethnography also examines and identifies areas of disagreements between studies [ 48 ].

This is of particular interest as the lived experiences of older adults during the COVID-19 pandemic were likely to be diverse. The method enables the researcher to synthesise the findings (e.g. themes, concepts) from primary studies, acknowledging primary data (quotes) by “using a unique translation synthesis method to transcend the findings of individual study accounts and create higher order” constructs ([ 47 ], p. 2). The following seven steps were applied:

Getting started (identify area of interest). We were interested in the lived experiences of older adults worldwide.

Deciding what was relevant to the initial interest (defining the focus, locating relevant studies, decision to include studies, quality appraisal). We decided on the inclusion and exclusion criteria and an appropriate quality appraisal.

Reading the studies. We used the screening process described below (title, abstract, full text)

Determining how the studies were related (extracting first-order constructs- participants’ quotes and second-order construct- primary author interpretation, clustering the themes from the studies into new categories (Table 3 ).

Translating the studies into one another (comparing and contrasting the studies, checking commonalities or differences of each article) to organise and develop higher-order constructs by using constant comparison (Table 3 ). Translating is the process of finding commonalities between studies [ 48 ].

Synthesising the translation (reciprocal and refutational synthesis, a lines of argument synthesis (interpretation of the relationship between the themes- leads to key themes and constructs of higher order; creating new meaning, Tables 2 , 3 ),

Expressing the synthesis (writing up the findings) [ 47 , 48 ].

Screening and Study Selection

A 4-stage screening protocol was followed (Fig.  1 Prisma). First, all selected studies were screened for duplicates, which were deleted. Second, all remaining studies were screened for eligibility, and non-relevant studies were excluded at the preliminary stage. These screening steps were as follows: 1. title screening; 2. abstract screening, by the first and senior authors independently; and 3. full-text screening which was undertaken for almost all papers by the first author. However, 2 papers [ 9 , 23 ] were assessed independently by LS, LR, and LMM to avoid a conflict of interest. The other co-authors also screened independently a portion of the papers each, to ensure that each paper had two independent screens to determine inclusion in the review [ 49 ]. This avoided bias and confirmed the eligibility of the included papers (Fig.  1 ). Endnote reference management was used to store the articles and aid the screening process.

Prisma flow diagram adapted from Page et al. [ 50 ]. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ, 372, n71. https://doi.org/10.1136/bmj.n71 )

Data extraction

After title and abstract screening, 39 papers were selected for reading the full article. 7 papers were excluded after the full-text assessment (1 study was conducted in 2017, but published in 2021; 2 papers were not fully available in English, 2 papers did not address the research question, 1 article was based on a conference abstract only, 1 article had only one participant age 65 +).

The full-text screening included 32 studies. All the included studies, alongside the CASP template, data extraction table, the draft of this article, and translation for synthesising the findings [ 47 , 48 ] were available and accessible on google drive for all co-authors. All authors discussed the findings in regular meetings.

Quality appraisal

A critical appraisal tool assesses a study for its trustworthiness, methodological rigor, and biases and ensures “transparency in the assessment of primary research” ([ 51 ], p. 5); see also [ 48 , 49 , 50 , 51 , 52 , 53 ]. There is currently no gold standard for assessing primary qualitative studies, but different authors agreed that the amended CASPS checklist was appropriate to assess qualitative studies [ 46 , 54 ]. Thus, we use the amended CASP appraisal tool [ 42 ]. The amended CASP appraisal tool aims to improve qualitative evidence synthesis by assessing ontology and epistemology (Table 1 CASP appraisal tool).

A numerical score was assigned to each question to indicate whether the criteria had been met (= 2), partially met (= 1), or not met (= 0) [ 54 ]; see also [ 55 ]. The score 16 – 22 are considered to be moderate and high-quality studies. The studies scored 15 and below were identified as low-quality papers. Although we focus on higher-quality papers, we did not exclude papers to avoid the exclusion of insightful and meaningful data [ 42 , 48 , 52 , 53 , 54 , 55 , 56 , 57 ]. The quality of the paper was considered in developing the evidence synthesis.

We followed the appraisal questions applied for each included study and answered the criteria either ‘Yes’, ‘Cannot tell’, or ‘No’. (Table 1 CASP appraisal criteria). The tenth question asking the value of the article was answered with ‘high’ of importance, ‘middle’, or low of importance. The new eleventh question in the CASP tool concerning ontology and epistemology was answered with yes, no, or partly (Table 1 ).

Data synthesis

The data synthesis followed the seven steps of Meta-Ethnography developed by Noblit & Hare [ 58 ], starting the data synthesis at step 3, described in detail by [ 47 ]. This encompasses: reading the studies; determining how the studies are related; translating the studies into one another; synthesis the translations; and expressing synthesis. This review provides a synthesis of the findings from studies related to the experiences of older adults during the COVID-19 pandemic. The qualitative analyses are based on constructivist grounded theory [ 59 ] to identify the experiences of older adults during the COVID-19 pandemic (non-clinical) populations. The analysis is inductive and iterative, uses constant comparison, and aims to develop a theory. The qualitative synthesis encompasses all text labelled as ‘results’ or ‘findings’ and uses this as raw data. The raw data includes participant’s quotes; thus, the synthesis is grounded in the participant's experience [ 47 , 48 , 60 , 61 ]. The initial coding was undertaken for each eligible article line by line. Please see Table 2 Themes per author and country. Focused coding was applied using constant comparison, which is a widely used approach in grounded theory [ 61 ]. In particular, common and recurring as well as contradicting concepts within the studies were identified, clustered into categories, and overarching higher order constructs were developed [ 47 , 48 , 60 ] (Tables 2 , 3 , 4 ).

We identified twenty-seven out of thirty-two studies as moderate-high quality; they met most of the criteria (scoring 16/22 or above on the CASP; [ 54 ]. Only five papers were identified as low qualitative papers scoring 15 and below [ 71 , 73 , 74 , 86 , 91 ]. Please see the scores provided for each paper in Table 4 . The low-quality papers did not provide sufficient details regarding the researcher’s relationship with the participants, sampling and recruitment, data collection, rigor in the analysis, or epistemological or ontological reasoning. For example, Yildirim [ 91 ] used verbatim notes as data without recording or transcribing them. This article described the analytical process briefly but was missing a discussion of the applied reflexivity of using verbatim notes and its limitations [ 92 ].

This systematic review found that many studies did not mention the relationship between the authors and the participant. The CASP critical appraisal tool asks: Has the relationship between the researcher and participants been adequately considered? (reflecting on own role, potential bias). Many studies reported that the recruitment was drawn from larger studies and that the qualitative study was a sub-study. Others reported that participants contacted the researcher after advertising the study. One study Goins et al., [ 72 ] reported that students recruited family members, but did not discuss how this potential bias impacted the results.

Our review brings new insights into older adults’ experiences during the pandemic worldwide. The studies were conducted on almost all continents. The majority of the articles were written in Europe followed by North America and Canada (4: USA; 3: Canada, UK; 2: Brazil, India, Netherlands, Sweden, Turkey 2; 1: Austria, China, Finland, India/Iran, Mauritius, New Zealand, Serbia, Spain, Switzerland, Uganda, UK/Ireland, UK/Colombia) (see Fig.  2 ). Note, as the review focuses on English language publications, we are unable to comment on qualitative research conducted in other languages see [ 72 ].

Numbers of publications by country

The characteristics of the included studies and the presence of analytical themes can be found in Table 4 . We used the following characteristics: Author and year of publication, research aims, the country conducted, Participant’s age, number of participants, analytical methodology, CASP score, and themes.

We identified three themes: desired and challenged wellbeing; coping and adaptation; discrimination and intersectionality. We will discuss the themes in turn.

Desired and challenged wellbeing

Most of the studies reported the impact of the COVID-19 pandemic on the well-being of older adults. Factors which influenced wellbeing included: risk communication and risk perception; social connectivity; confinement (at home); and means of coping and adapting. In this context, well-being refers to the evidence reported about participants' physical and mental health, and social connectivity.

Risk perception and risk communication

Politicians and media transmitted messages about the response to the pandemic to the public worldwide. These included mortality and morbidity reports, and details of health and safety regulations like social distancing, shielding- self-isolation, or wearing masks [ 34 , 35 , 36 , 37 ]. As this risk communication is crucial to combat the spread of the virus, it is also important to understand how people perceived the reporting during the pandemic.

Seven studies reported on how the mass media impacted participants' well-being [ 23 , 67 , 68 , 70 , 72 , 81 , 85 ]. Sangrar et al. [ 68 ] investigated how older adults responded to COVID-19 messaging: “My reaction was to try to make sure that I listen to everything and [I] made sure I was aware of all the suggestions and the precautions that were being expressed by various agencies …”. (p. 4). Other studies reported the negative impact on participants' well-being of constant messaging and as a consequence stopped watching the news to maintain emotional well-being [ 3 , 67 , 68 , 70 , 72 , 81 , 85 ]. Derrer-Merk et al. [ 23 ] reported one participant said that “At first, watching the news every day is depressing and getting more and more depressing by the day, so I’ve had to stop watching it for my own peace of mind” (p. 13). In addition, news reporting impacted participants’ risk perception. For example, “Sometimes we are scared to hear the huge coverage of COVID-19 news, in particular the repeated message ‘older is risky’, although the message is useful.” ([ 81 ], p5).

• Social connectivity

Social connectivity and support from family and community were found in fourteen of the studies as important themes [ 9 , 62 , 66 , 67 , 68 , 75 , 76 , 77 , 78 , 79 , 80 , 83 , 84 , 90 ].

The impact of COVID-19 on social networks highlighted the diverse experiences of participants. Some participants reported that the size of social contact was reduced: “We have been quite isolated during this corona time” ?([ 80 ], p. 3). Whilst other participants reported that the network was stable except that the method of contact was different: “These friends and relatives, they visited and called as often as before, but of course, we needed to use the telephone when it was not possible to meet” ([ 77 ], p. 5). Many participants in this study did not want to expand their social network see also [ 9 , 77 , 78 , 79 ]. Hafford-Letchfield et al. [ 76 ] reported that established social networks and relationships were beneficial for the participants: “Covid has affected our relationship (with partner), we spend some really positive close time together and support each other a lot” (p. 7).

On the other hand, other studies reported decreases of, and gaps in, social connectedness: “I couldn’t do a lot of things that I’ve been doing for years. That was playing competitive badminton three times a week, I couldn’t do that. I couldn’t get up early and go volunteer in Seattle” [ 9 , 67 , 75 ]. A loss of social connection with children and grandchildren was often mentioned: “We cannot see our grandchildren up close and personal because, well because they [the parents] don’t want us, they don’t want to risk our being with the kids … it’s been an emotional loss exacerbated by the COVID thing” ([ 68 ] p.10); see also [ 9 , 67 , 78 ]. On the contrary, Chemen & Gopalla [ 66 ] note that those older adults who were living with other family members reported that they were more valued: “Last night my daughter-in-law thanked me for helping with my granddaughter” (p.4).

Despite reports of social disconnectedness, some studies highlighted the importance of support from family members and how support changed during the COVID-19 pandemic [ 9 , 62 , 81 , 83 , 90 ]. Yang et al. [ 90 ] argued that social support was essential during the Lockdown in China: “N6 said: ‘I asked my son-in-law to take me to the hospital” (p. 4810). Mahapatra et al. [ 81 ] found, in an Indian study, that the complex interplay of support on different levels (individual, family, and community) helped participants to adapt to the new situation. For example, this participant reported that: “The local police are very helpful. When I rang them for something and asked them to find out about it, they responded immediately” (p. 5).

Impact of confinement on well being

Most articles highlighted the impact of confinement on older adults’ well-being [ 9 , 62 , 63 , 65 , 67 , 69 , 70 , 72 , 75 , 77 , 78 , 79 , 81 , 82 , 83 , 85 , 89 , 90 ].

Some studies found that participants maintained emotional well-being during the pandemic and it did not change their lifestyle [ 79 , 80 , 82 , 83 , 89 , 92 ]: “Actually, I used this crisis period to clean my house. Bookcases are completely cleaned and I discarded old books. Well, we have actually been very busy with those kind of jobs. So, we were not bored at all” ([ 79 ], p. 5). In McKinlay et al. [ 82 ]’s study, nearly half of the participants found that having a sense of purpose helped to maintain their well-being: “You have to have a purpose you see. I think mental resilience is all about having a sense of purpose” (p. 6).

However, at the same time, the majority of the articles (12 out of 18) highlighted the negative impact of confinement and social distancing. Participants talked of increased depressive feelings and anxiety. For example, one of Akkus et al.’s [ 62 ] participants said: “... I am depressed; people died. Terrible disease does not give up, it always kills, I am afraid of it …” (p. 549). Similarly, one of Falvo et al.’s [ 67 ] participants remarked: “I am locked inside my house and I am afraid to go out” (p. 7).

Many of the studies reported the negative impact of loneliness as a result of confinement on participants’ well-being including [ 69 , 70 , 72 , 78 , 79 , 90 , 93 ]. Falvo et al. [ 67 ] reported that many participants experienced loneliness: “What sense does it make when you are not even able to see a family member? I mean, it is the saddest thing not to have the comfort of having your family next to you, to be really alone” (p. 8).

Not all studies found a negative impact on loneliness. For example, a “loner advantage” was found by Xie et al. ([ 82 ], p. 386). In this study participants found benefits in already being alone “It’s just a part of who I am, and I think that helps—if you can be alone, it really is an asset when you have to be alone” ([ 82 ], p. 386).

Bundy et al. [ 80 ] investigated loneliness from already lonely older adults and found that many participants did not attribute the loneliness to the pandemic: “It’s not been a whole lot, because I was already sitting around the house a whole lot anyway ( …). It’s basically the same, pretty well … I’d pretty well be like this anyway with COVID or without COVID” (p. 873) (see also [ 83 ]).

A study from Serbia investigated how the curfew was perceived 15 months afterward. Some participants were calm: “I realized that … well … it was simply necessary. For that reason, we accepted it as a measure that is for the common good” ([ 70 ], p.634). Others were shocked: “Above all, it was a huge surprise and sort of a shock, a complete shock because I have never, ever seen it in my life and I felt horrible, because I thought that something even worse is coming, that I even could not fathom” ([ 70 ], p. 634).

The lockdowns brought not only mental health issues to the fore but impacted the physical health of participants. Some reported they were fearful of the COVID-19 pandemic: “... For a little while I was afraid to leave, to go outside. I didn’t know if you got it from the air” ([ 75 ]. p. 6). Another study reported: “It’s been important for me to walk heartily so that I get a bit sweaty and that I breathe properly so that I fill my lungs—so that I can be prepared—and be as strong as possible, in case I should catch that coronavirus” ([ 77 ], p. 9); see also [ 70 , 78 , 82 , 85 ].

Coping and adaptation

Many studies mentioned older adults’ processes of coping and adaptation during the pandemic [ 63 , 64 , 68 , 69 , 72 , 75 , 79 , 81 , 85 , 87 , 88 , 89 , 90 ].

A variety of coping processes were reported including: acceptance; behavioural adaptation; emotional regulation; creating new routines; or using new technology. Kremers et al. [ 79 ] reported: “We are very realistic about the situation and we all have to go through it. Better days will come” (p. e71). Behavioural adaptation was reported: “Because I’m asthmatic, I was wearing the disposable masks, I really had trouble breathing. But I was determined to find a mask I could wear” ([ 68 ], p. 14). New routines with protective hygiene helped some participants at the beginning of the pandemic to cope with the health threat: “I am washing my hands all the time, my hands are raw from washing them all the time, I don't think I need to wash them as much as I do but I do it just in case, I don’t have anybody coming in, so there is nobody contaminating me, but I keep washing” ([ 69 ], p. 4391); see also [ 72 ]. Verhage et al. [ 87 ] reported strategies of coping including self-enhancing comparisons, distraction, and temporary acceptance: “There are so many people in worse circumstances …” (p. e294). Other studies reported how participants used a new technology: “I have recently learned to use WhatsApp, where I can make video phone calls.” ([ 88 ], p. 163); see also [ 89 ].

Discrimination -intersectionality (age and race/gender identity)

Seven studies reported ageism, racism, and gender discrimination experienced by older adults during the pandemic [ 23 , 63 , 67 , 70 , 76 , 84 , 88 ].

Prigent et al. [ 84 ], conducted in a New Zealand study, found that ageism was reciprocal. Younger people spoke against older adults: “why don’t you do everyone a favour and drop dead you f******g b**** it’s all because of ones like you that people are losing jobs” (p. 11). On the other hand, older adults spoke against the younger generation: “Shame to see the much younger generations often flout the rules and generally risk the gains made by the team. Sheer arrogance on their part and no sanctions applied” (p.11). Although one study reported benevolent ageism [ 23 ] most studies found hostile ageism [ 23 , 63 , 67 , 70 , 76 , 84 ]. One study from Canada exploring 15 older adult’s Chinese immigrants’ experiences reported racism as people around them thought they would bring the virus into the country. The negative impact on existing friendships was told by a Chinese man aged 69 “I can tell some people are blatantly despising us. I can feel it. When I talked with my Caucasian friends verbally, they would indirectly blame us for the problem. Eventually, many of our friendships ended because of this issue” ([ 88 ], p161). In addition, this study reported ageism when participants in nursing homes felt neglected by the Canadian government.

Two papers reported experiences of sexual and gender minorities (SGM) (e.g. transgender, queer, lesbian or gay) and found additional burdens during the pandemic [ 63 , 76 ]. People experienced marginalisation, stereotypes, and discrimination, as well as financial crisis: “I have faced this throughout life. Now people look at me in a way as if I am responsible for the virus.” ([ 63 ], p. 6). The consequence of marginalisation and ignorance of people with different gender identities was also noted by Hafford- Letchfield et al. [ 76 ]: “People have been moved out of their accommodation into hotels with people they don't know …. a gay man committed suicide, community members know of several that have attempted suicide. They are feeling pretty marginalised and vulnerable and you see what people are writing on the chat pages” (p.4). The intersection of ageism, racism, and heterosexism and its negative impact on people’s well-being during the pandemic reflects additional burden and stressors for older adults.

This systematic literature review is important as it provides new insights into the lived experiences of older adults during the COVID-19 pandemic, worldwide. Our study highlights that the COVID-19 pandemic brought an increase in English-written qualitative articles to the fore. We found that 32 articles met the inclusion criteria but 5 were low quality. A lack of transparency reduces the trustworthiness of the study for the reader and the scientific community. This is particularly relevant as qualitative research is often criticised for its bias or lack of rigor [ 94 ]. However, their findings are additional evidence for our study.

Our aim was to explore, in a systematic literature review, the lived experiences of older adults during the COVID-19 pandemic worldwide. The evidence highlights the themes of desired and challenged wellbeing, coping and adaptation, and discrimination and intersectionality, on wellbeing.

Perceived risk communication was experienced by many participants as overwhelming and anxiety-provoking. This finding supports Anwar et al.’s [ 37 ] study from the beginning of the pandemic which found, in addition to circulating information, that mass media influenced the public's behaviour and in consequence the spread of disease. The impact can be positive but has also been revealed to be negative as well. They suggest evaluating the role of the mass media in relation to what and how it has been conveyed and perceived. The disrupted social connectivity found in our review supports earlier studies that reported the negative impact of people’s well-being [ 6 , 7 , 8 , 9 , 10 , 11 , 12 , 13 , 14 , 15 , 16 , 17 , 18 , 19 , 20 , 21 , 22 , 23 , 24 , 25 , 26 , 27 , 28 ] at the beginning of the pandemic. This finding is important for future health crisis management, as the protective health measures such as confinement or self-isolation had a negative impact on many of the participants’ emotional wellbeing including increased anxiety, feelings of depression, and loneliness during the lockdowns. As a result of our review, future protective health measures should support people’s desire to maintain proximity with their loved ones and friends. However, we want to stress that our findings are mixed.

The ability of older adults to adapt and cope with the health crisis is important: many of the reported studies noted the diverse strategies used by older people to adapt to new circumstances. These included learning new technologies or changing daily routines. Politicians and the media and politicians should recognise both older adults' risk of disease and its consequences, but also their adaptability in the face of fast-changing health measures. This analysis supports studies conducted over the past decades on lifespan development, which found that people learn and adapt livelong to changing circumstances [ 95 , 96 , 97 ].

We found that discrimination against age, race, and gender identity was reported in some studies, in particular exploring participants’ experiences with immigration backgrounds and sexual and gender minorities. These studies highlighted the intersection of age and gender or race and were additional stressors for older adults and support the findings from Ramirez et al. [ 98 ] This review suggests that more research should be conducted to investigate the experiences of minority groups to develop relevant policies for future health crises.

Our review was undertaken two years after the pandemic started. At the cut-off point of our search strategy, no longitudinal studies had been found. However, in December 2022 a longitudinal study conducted in the USA explored older adult’s advice given to others [ 99 ]. They found that fostering and maintaining well-being, having a positive life perspective, and being connected to others were coping strategies during the pandemic [ 100 ]. This study supports the results of the higher order constructs of coping and adaptation in this study. Thus, more longitudinal studies are needed to enhance our understanding of the long-term consequences of the COVID-19 pandemic. The impact of the COVID-19 restrictions on older adults’ lives is evident. We suggest that future strategies and policies, which aim to protect older adults, should not only focus on the physical health threat but also acknowledge older adults' needs including psychological support, social connectedness, and instrumental support. The policies regarding older adult’s protections changed quickly but little is known about older adults’ involvement in decision making [ 100 ]. We suggest including older adults as consultants in policymaking decisions to ensure that their own self-determinism and independence are taken into consideration.

There are some limitations to this study. It did not include the lived experiences of older adults in care facilities or hospitals. The studies were undertaken during the COVID-19 pandemic and therefore data collection was not generally undertaken face-to-face. Thus, many studies included participants who had access to a phone, internet, or email, others could not be contacted. Additionally, we did not include published papers after August 2022. Even after capturing the most commonly used terms and performing additional hand searches, the search terms used might not be comprehensive. The authors found the quality of the papers to be variable, and their credibility was in question. We acknowledge that more qualitative studies might have been published in other languages than English and were not considered in this analysis.

To conclude, this systematic literature review found many similarities in the experiences of older adults during the Covid-19 pandemic despite cultural and socio-economic differences. However, we stress to acknowledge the heterogeneity of the experiences. This study highlights that the interplay of mass media reports of the COVID-19 pandemic and the policies to protect older adults had a direct impact on older adults’ well-being. The intersection of ‘isms’ (ageism, racism, and heterosexism) brought an additional burden for some older adults [ 98 ]. These results and knowledge about the drawbacks of health-protecting measures need to be included in future policies to maintain older adults’ well-being during a health crisis.

Availability of data and materials

The systematic literature review is based on already published articles. And all data analysed during this study are included in this manuscript. No additional data was used.

World Health Organisation (WHO): WHO Director-General’s opening remarks at the media briefing on COVID-19 - 11 March 2020. 2020. Retrieved from https://www.who.int/director-general/speeches/detail/who-director-general-s-opening-remarks-at-the-media-briefing-on-covid-19---11-march-2020.

WorldOMeter: Coronavirus toll update: Cases & deaths by country. 2022. Worldometers. https://www.worldometers.info/coronavirus/ .

World Health Organisation (WHO): Coronavirus disease. 2022. https://www.who.int/health-topics/coronavirus#tab=tab . Aaccessed 5 Oct 2022.

Ayouni I, Maatoug J, Dhouib W, Zammit N, Fredj SB, Ghammam R, Ghannem H. Effective public health measures to mitigate the spread of COVID-19: a systematic review. BMC Public Health. 2021;21(1):1015.

PubMed   PubMed Central   CAS   Google Scholar  

Cerasoli B. The frail future of geriatrics. Lancet Healthy Longev. 2020;1(1):e11.

PubMed   PubMed Central   Google Scholar  

Allen K-A, Arslan G, Craig H, Arefi S, Yaghoobzadeh A, Sharif Nia H. The psychometric evaluation of the sense of belonging instrument (SOBI) with Iranian older adults. BMC Geriatr. 2021;21(1):211.

Bailey L, Ward M, DiCosimo A, Baunta S, Cunningham C, Romero-Ortuno R, Kenny RA, Purcell R, Lannon R, McCarroll K, et al. Physical and mental health of older people while cocooning during the COVID-19 pandemic. QJM. 2021;114(9):648–53.

Dahlberg L. Loneliness during the COVID-19 pandemic. Aging Ment Health. 2021;25(7):1161–4.

PubMed   Google Scholar  

Derrer-Merk E, Ferson S, Mannis A, Bentall R, Bennett KM. Older people's family relationships in disequilibrium during the COVID-19 pandemic. What really matters? Ageing Soc. 2022:1–18.

Derrer-Merk E, Ferson S, Mannis A, Bentall RP, Bennett KM. Belongingness challenged: Exploring the impact on older adults during the COVID-19 pandemic. PLoS ONE. 2022;17(10):e0276561.

Heidinger T, Richter L. The effect of COVID-19 on loneliness in the elderly. An empirical comparison of pre-and peri-pandemic loneliness in community-dwelling elderly. Front Psychol. 2020;11:(585308).

Richter L, Heidinger T. Hitting close to home: the effect of COVID-19 illness in the social environment on psychological burden in older adults. Front Psychol. 2021;12:(737787).

Krendl AC, Perry BL. The impact of sheltering in place during the COVID-19 pandemic on older adults’ social and mental well-being. J Gerontol B Psychol Sci Soc Sci. 2021;76(2):e53–8.

Litwin, H., & Levinsky, M. Social networks and mental health change in older adults after the Covid-19 outbreak. Aging Ment Health. 2021:1–6. https://doi.org/10.1080/13607863.2021.1902468 .

De Pue S, Gillebert C, Dierckx E, Vanderhasselt MA, De Raedt R, Van den Bussche E. The impact of the COVID-19 pandemic on wellbeing and cognitive functioning of older adults. Sci Rep. 2021;11(1):4636.

Shahid Z, Kalayanamitra R, McClafferty B, Kepko D, Ramgobin D, Patel R, Aggarwal CS, Vunnam R, Sahu N, Bhatt D, et al. COVID-19 and older adults: what we know. J Am Geriatr Soc. 2020;68(5):926–9.

Smith M, Steinman L, Casey E. Combatting social isolation among older adults in a time of physical distancing: the COVID-19 social connectivity paradox. Front Public Health. 2020;8:403.

Cohn-Schwartz E, Finlay JM, Kobayashi LC. Perceptions of societal ageism and declines in subjective memory during the COVID-19 pandemic: longitudinal evidence from US adults aged ≥55 years. J Soc Issues. 2022;78(4):924–38.

Tsoukalis-Chaikalis N, Demsia S, Stamatopoulou A, Chaniotis D, Tel Nu. Systematic Mapping Study of Covid-19 Psychological Impact. 2021;15(3):820.

van Gerwen M, Alsen M, Little C, Barlow J, Genden E, Naymagon L, Tremblay D. Risk factors and outcomes of COVID-19 in New York City; a retrospective cohort study. J Med Virol. 2021;93(2):907–15.

Victor CR, Rippon I, Barreto M, Hammond C, Qualter P. Older adults’ experiences of loneliness over the lifecourse: an exploratory study using the BBC loneliness experiment. Arch Gerontol Geriatr. 2022;102:104740.

Vrach IT, Tomar R. Mental health impacts of social isolation in older people during COVID pandemic. Prog Neurol Psychiatry. 2020;24(4):25–9.

Google Scholar  

Derrer-Merk E, Reyes-Rodriguez M-F, Salazar A-M, Guevara M, Rodríguez G, Fonseca A-M, Camacho N, Ferson S, Mannis A, Bentall RP, et al. Is protecting older adults from COVID-19 Ageism? A comparative cross-cultural constructive grounded theory from the United Kingdom and Colombia. J Soc Issues. 2022;78(4):900–23.

Lytle A, Levy SR. Reducing ageism toward older adults and highlighting older adults as contributors during the COVID-19 pandemic. J Soc Issues. 2022;78(4):1066–84.

McDarby M, Ju CH, Picchiello MC, Carpenter BD. Older adults’ perceptions and experiences of ageism during the COVID-19 pandemic. J Soc Issues. 2022;78(4):939–64.

Drury L, Abrams D, Swift HJ. Intergenerational contact during and beyond COVID-19. J Soc Issues. 2022;78(4):860–82.

Kanık B, Uluğ ÖM, Solak N, Chayinska M. “Let the strongest survive”: Ageism and social Darwinism as barriers to supporting policies to benefit older individuals. J Soc Issues. 2022;00:1–25.

Spaccatini F, Giovannelli I, Pacilli MG. “You are stealing our present”: Younger people's ageism towards older people predicts attitude towards age-based COVID-19 restriction measures. J Soc Issues. 2022;78(4):769–89.

Sutter A, Vaswani M, Denice P, Choi KH, Bouchard H, Esses VM. Ageism toward older adults during the COVID-19 pandemic: Intergenerational conflict and support. J Soc Issues. 2022;78(4):815–41.

Swift H, Chasteen A. Ageism in the time of COVID-19. Group Process Intergroup Relat. 2021;24:246–52.

World Health Organisation (WHO): Risk Communication in times of an epidemic or pandemic. Asset paper series Epidemics and Pandemics: 2017. https://www.who.int/emergencies/risk-communicationsWHORCaCERaoSAo .

Bailey A, Harris MA, Bogle D, Jama A, Muir SA, Miller S, Walters CA, Govia I. Coping with COVID-19: health risk communication and vulnerable groups. Disaster Med Public Health Prep. 2021;17:e22.

Li X, Lyu H. Epidemic risk perception PS, and mental health during COVID-19 pandemic: a moderated mediating model. Front Psychol. 2021;11:563741. https://doi.org/10.3389/fpsyg.2020.563741 .

Article   PubMed   PubMed Central   Google Scholar  

Sandman P M & American Industrial Hygiene Association: Responding to community outrage: strategies for effective risk communication. American Industrial Hygiene Association. 2003.

Sandman, P M. Introduction and orientation index.  https://www.psandman.com/index-intro.htm . Retrieved 13 October 2022.

Anderson M, Pitchforth E, Asaria M, Brayne C, Casadei B, Charlesworth A, Coulter A, Franklin BD, Donaldson C, Drummond M, et al. LSE-Lancet Commission on the future of the NHS: re-laying the foundations for an equitable and efficient health and care service after COVID-19. Lancet. 2021;397(10288):1915–78.

PubMed   CAS   Google Scholar  

Anwar A, Malik M, Raees V, Anwar A. Role of mass media and public health communications in the COVID-19 pandemic. Cureus. 2020;12(9):e10453.

U.S. National Library of Medicine: COVID-19 - Search Details - ClinicalTrials.gov: Clinicaltrials.gov 2022. Retrieved October 13, 2022, from https://clinicaltrials.gov/ct2/results/details?cond=COVID-19 .

Tremblay S, Castiglione S, Audet L-A, Desmarais M, Horace M, Peláez S. Conducting qualitative research to respond to COVID-19 challenges: reflections for the present and beyond. Int J Qual Methods. 2021;20:16094069211009680.

Flemming K, Noyes J. Qualitative evidence synthesis: where are we at? Int J Qual Methods. 2021;20:1609406921993276.

Booth A. Searching for qualitative research for inclusion in systematic reviews: a structured methodological review. Syst Rev. 2016;5(1):74.

Krnic Martinic M, Pieper D, Glatt A, Puljak L. Definition of a systematic review used in overviews of systematic reviews, meta-epidemiological studies and textbooks. BMC Med Res Methodol. 2019;19(1):203.

Phillips V, Barker E. Systematic reviews: structure, form and content. J Perioper Pract. 2021;31(9):349–53.

Derrer-Merk E, Soulsby L, Reyes Rodriguez M, Ferson S, Mannis A, Bennett KM. Older adults' lived experiences during the COVID-19 pandemic: a systematic review. 2022. PROSPERO 2022 CRD42022331714. Available from: https://www.crd.york.ac.uk/prospero/display_record.php?ID=CRD42022331714 .

Cooke A, Smith D, Booth A. Beyond PICO: the SPIDER tool for qualitative evidence synthesis. Qual Health Res. 2012;22:1435–43.

Long HA, French DP, Brooks JM. Optimising the value of the critical appraisal skills programme (CASP) tool for quality appraisal in qualitative evidence synthesis. Res Methods Med Health Sci. 2020;1(1):31–42.

Sattar R, Lawton R, Panagioti M, Johnson J. Meta-ethnography in healthcare research: a guide to using a meta-ethnographic approach for literature synthesis. BMC Health Serv Res. 2021;21(1):50.

Soundy A, Heneghan NR. Meta-ethnography. Int Rev Sport Exerc Psychol. 2022;15(1):266–86.

Fallon V, Groves R, Halford JCG, Bennett KM, Harrold JA. Postpartum anxiety and infant-feeding outcomes: a systematic review. J Hum Lact. 2016;32(4):740–58.

Page MJ, McKenzie JE, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, Shamseer L, Tetzlaff JM, Akl EA, Brennan SE, et al. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. PLoS Med. 2021;18(3):e1003583.

Tod D, Booth A, Smith B. Critical appraisal. Int Rev Sport Exerc Psychol. 2022;15(1):52–72.

Morse J. Why the Qualitative Health Research (QHR) review process does not use checklists. Qual Health Res. 2021;31(5):819–21.

Munthe-Kaas HM, Glenton C, Booth A, Noyes J, Lewin S. Systematic mapping of existing tools to appraise methodological strengths and limitations of qualitative research: first stage in the development of the CAMELOT tool. BMC Med Res Methodol. 2019;19(1):113.

Njau B, Covin C, Lisasi E, Damian D, Mushi D, Boulle A, Mathews C. A systematic review of qualitative evidence on factors enabling and deterring uptake of HIV self-testing in Africa. BMC Public Health. 2019;19(1):1289.

Butler A, Hall H, Copnell B. A guide to writing a qualitative systematic review protocol to enhance evidence-based practice in nursing and health care. Worldviews Evid Based Nurs. 2016;13(3):241–9.

Soilemezi D, Linceviciute S. Synthesizing qualitative research: reflections and lessons learnt by two new reviewers. Int J Qual Methods. 2018;17(1):1609406918768014.

Booth A. Harnessing energies, resolving tensions: acknowledging a dual heritage for qualitative evidence synthesis. Qual Health Res. 2019;29(1):18–31.

Carroll C, Booth A. Quality assessment of qualitative evidence for systematic review and synthesis: Is it meaningful, and if so, how should it be performed? Res Synth Methods. 2015;6(2):149–54.

Charmaz K. Constructing Grounded Theory. 2nd ed. London: Sage; 2014.

Toye F, Seers K, Allcock N, Briggs M, Carr E, Barker K. Meta-ethnography 25 years on: challenges and insights for synthesising a large number of qualitative studies. BMC Med Res Methodol. 2014;14(1):80.

Noblit GW, Hare RD. Meta-ethnography: synthesizing qualitative studies. California: Sage Publications Ltd; 1988.

Akkus Y, Parlak A, Karacan Y, Karatay G. Perceptions and experiences of older people regarding the COVID-19 pandemic process: a phenomenological study. Turk Geriatri Dergisi. 2021;24:546–56.

Banerjee D, Rao TSS. “The Graying Minority”: lived experiences and psychosocial challenges of older transgender adults during the COVID-19 pandemic in India, A qualitative exploration. Front Psychiatry. 2021;11:604472.

Brooke J, Jackson D. Older people and COVID-19: Isolation, risk and ageism. J Clin Nurs. 2020;29(13-14):2044–6.

Bundy H, Lee HM, Sturkey KN, Caprio AJ. The lived experience of already-lonely older adults during COVID-19. Gerontologist. 2021;61(6):870–7.

Chemen S, Gopalla YN. Lived experiences of older adults living in the community during the COVID-19 lockdown - The case of mauritius. J Aging Stud. 2021;57:100932.

Falvo I, Zufferey MC, Albanese E, Fadda M. Lived experiences of older adults during the first COVID-19 lockdown: a qualitative study. PLoS ONE. 2021;16(6):e0252101.

Fiocco AJ, Gryspeerdt C, Franco G. Stress and adjustment during the COVID-19 pandemic: a qualitative study on the lived experience of Canadian older adults. Int J Environ Res Public Health. 2021;18(24):12922.

Fristedt S, Carlsson G, Kylén M, Jonsson O, Granbom M. Changes in daily life and wellbeing in adults, 70 years and older, in the beginning of the COVID-19 pandemic. Scand J Occup Ther. 2022;29(6):511–21.

Gazibara T, Maksimovic N, Dotlic J, Jeremic Stojkovic V, Cvjetkovic S, Milic M. Experiences and aftermath of the COVID-19 lockdown among community-dwelling older people in Serbia: a qualitative study. J Eval Clin Pract. 2022;28(4):631–40.

Giebel C, Ivan B, Ddumba I. COVID-19 public health restrictions and older adults’ well-being in Uganda: psychological impacts and coping mechanisms. Clin Gerontol. 2022;45(1):97–105.

Goins RT, Anderson E, Minick H, Daniels H. Older adults in the United States and COVID-19: a qualitative study of perceptions, finances, coping, and emotions. Front Public Health. 2021;9:660536.

Gomes MACFC, Fontenele NAO, Galindo Neto NM, Barros LM, Frota NM. Elderly people’s experience facing social isolation in the COVID-19 pandemic. Rev Rene. 2021;22:e69236. https://doi.org/10.15253/2175-6783.20212269236 .

Article   Google Scholar  

Gonçalves AR, Barcelos JLM, Duarte AP, Lucchetti G, Gonçalves DR. Silva e Dutra FCM, Gonçalves JRL: Perceptions, feelings, and the routine of older adults during the isolation period caused by the COVID-19 pandemic: a qualitative study in four countries. Aging Ment Health. 2022;26(5):911–8.

Greenwood-Hickman MA, Dahlquist J, Cooper J, Holden E, McClure JB, Mettert KD, Perry SR, Rosenberg DE. “They’re Going to Zoom It”: a qualitative investigation of impacts and coping strategies during the COVID-19 pandemic among older adults. Front Public Health. 2021;9:679976.

Hafford-Letchfield T, Toze M, Westwood S. Unheard voices: a qualitative study of LGBT+ older people experiences during the first wave of the COVID-19 pandemic in the UK. Health Soc Care Community. 2022;30(4):e1233–43.

Huntley R, Bratt AS. An interpretative phenomenological analysis of the lived experiences of older adults during the covid-19 pandemic in sweden. Nordic Psychol. 2022;75(1)3–19.

Jiménez-Etxebarria E, Bernaras Iturrioz E, Jaureguizar J. Impact of the COVID-19 pandemic as perceived by older people in Northern Spain. Psychol Res Behav Manag. 2021;14:1789–803.

Kremers EM, Janssen JHM, Nieuwboer MS, Olde Rikkert MGM, Peeters GMEE. The psychosocial adaptability of independently living older adults to COVID-19 related social isolation in the Netherlands: a qualitative study. Health Soc Care Community. 2022;30(1):e67–74.

Kulmala J, Tiilikainen E, Lisko I, Ngandu T, Kivipelto M, Solomon A. Personal social networks of community-dwelling oldest old during the Covid-19 pandemic—A qualitative study. Front Public Health. 2021;9:1–10.

Mahapatra P, Sahoo KC, Desaraju S, Pati S. Coping with COVID-19 pandemic: reflections of older couples living alone in urban Odisha India. Prim Health Care Res Dev. 2021;22:e64.

McKinlay AR, Fancourt D, Burton A. A qualitative study about the mental health and wellbeing of older adults in the UK during the COVID-19 pandemic. BMC Geriatr. 2021;21(1):1–10.

Pfabigan J, Wosko P, Pichler B, Reitinger E, Pleschberger S. Under reconstruction: the impact of COVID-19 policies on the lives and support networks of older people living alone. Int J Care Caring. 2022;6(1-2):211–28.

Prigent C, Morgan T, Wiles J, Morgan K, Williams L, Gott M. Intergenerational tension or cohesion during the covid-19 pandemic?: A letter-writing study with older new zealanders. J Intergenerational Relationsh. 2022;20(4):386–405.

Sangrar R, Porter MM, Chesser S. Exploring the interpretation of COVID-19 messaging on older adults. Experiences of vulnerability. Can J Aging Rev Can Vieil. 2021;40(4):533–42.

Sattari S, Billore S. Bring it on Covid-19: being an older person in developing countries during a pandemic. Working Older People. 2020;24(4):281–91.

Verhage M, Thielman L, Kock L, Lindenberg J. Coping of older adults in times of COVID-19: considerations of temporality among dutch older adults. J Gerontol B. 2021;76(7):e290–9.

Wang Q, Liu JKK, Walsh CA. Identities: experiences and impacts of the COVID-19 pandemic from the perspectives of older Chinese immigrants in Canada. China J Soc Work. 2021;14(2):153–71.

Xie B, Shiroma K, De Main AS, Davis NW, Fingerman K, Danesh V. Living through the COVID-19 pandemic: community-dwelling older adults’ experiences. J Aging Soc Policy. 2021;33(4–5):380–97.

Yang Q, Wang Y, Tian C, Chen Y, Mao J. The Experiences of Community-dwelling older adults during the COVID-19 lockdown in Wuhan: a qualitative study. J Adv Nurs (John Wiley & Sons, Inc). 2021;77(12):4805–14.

Yıldırım H. Psychosocial status of older adults aged 65 years and over during lockdown in Turkey and their perspectives on the outbreak. Health Soc Care Community. 2022;30(3):899–907.

Hill Z, Tawiah-Agyemang C, Kirkwood B, Kendall C. Are verbatim transcripts necessary in applied qualitative research: experiences from two community-based intervention trials in Ghana. Emerg Themes Epidemiol. 2022;19(1):5.

Giles D. Performed across Europe and written up in English: the double challenge for qualitative psychologists. Qual Res Psychol. 2019;16(3):503–7.

Anderson C. Presenting and evaluating qualitative research. Am J Pharm Educ. 2010;74(8):141.

Nikitin J, Freund A. The Adaptation Process of Aging. The Cambridge Handbook of Successful Aging. Chapter: 17. Cambridge University Press. 2019. p. 281–98.

Deimling GT, Kahana B, Bowman KF, Schaefer ML. Cancer survivorship and psychological distress in later life. Psychooncology. 2002;11(6):479–94.

Baltes PB, Staudinger UM, Lindenberger U. Lifespan psychology: theory and application to intellectual functioning. Annu Rev Psychol. 1999;50:471–507.

Ramirez L, Monahan C, Palacios-Espinosa X, Levy SR. Intersections of ageism toward older adults and other isms during the COVID-19 pandemic. J Soc Issues. 2022;78(4):965–90.

Van Vleet B, Fuller HR, Hofmann B, Huseth-Zosel A. Untapped insight: a longitudinal qualitative analysis of older adults’ advice during the COVID-19 pandemic. Innov Aging. 2022;6(7):igac071.

Gietel-Basten S, Matus K, Mori R. COVID-19 as a trigger for innovation in policy action for older persons? Evid Asia Policy Soc. 2022;41(1):168–86.

Download references

Acknowledgements

Not applicable

Not applicable.

Author information

Authors and affiliations.

University of Liverpool, Eleanor Rathbone Building, Bedford Street South, Liverpool, L697ZA, UK

Elfriede Derrer-Merk, Laura K. Soulsby & Kate M. Bennett

Universidad de los Andes, Carrera 1 No. 18A-12, Bogotá, Colombia

Maria-Fernanda Reyes-Rodriguez

Principal Health Psychologist, Resilience Hub, Lancashire & South Cumbria Foundation Hospital, Chorley, UK

Louise Roper

You can also search for this author in PubMed   Google Scholar

Contributions

Elfriede Derrer-Merk contributed to the design, analysis, and writing the draft. Maria-Fernanda Rodriguez-Reyes contributed to the analysis, revised the draft, and approved the submission. Laura K. Soulsby contributed to the analysis, revised the draft, and approved the submission. Louise Roper contributed to the analysis, revised the draft, and approved the submission. Kate M. Bennett contributed to the design, analysis, writing the draft, and approved the submission.

Corresponding author

Correspondence to Elfriede Derrer-Merk .

Ethics declarations

Ethics approval and consent to participate, consent for publication, competing interests.

The authors declare no competing interests.

Additional information

Publisher’s note.

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ . The Creative Commons Public Domain Dedication waiver ( http://creativecommons.org/publicdomain/zero/1.0/ ) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Cite this article.

Derrer-Merk, E., Reyes-Rodriguez, MF., Soulsby, L.K. et al. Older adults’ experiences during the COVID-19 pandemic: a qualitative systematic literature review. BMC Geriatr 23 , 580 (2023). https://doi.org/10.1186/s12877-023-04282-6

Download citation

Received : 16 November 2022

Accepted : 05 September 2023

Published : 20 September 2023

DOI : https://doi.org/10.1186/s12877-023-04282-6

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

• Older adults
• Risk communication
• Discrimination

BMC Geriatrics

ISSN: 1471-2318

• Submission enquiries: [email protected]
• General enquiries: [email protected]

A systematic literature review of ICT integration in secondary education: what works, what does not, and what next?

• Open access
• Published: 16 November 2023
• Volume 2 , article number  44 , ( 2023 )

Cite this article

You have full access to this open access article

• Mgambi Msambwa Msafiri 1 ,
• Daniel Kangwa 1 &
• Lianyu Cai 1  

4352 Accesses

Explore all metrics

This study is rigorous of peer-reviewed literature on the integration of information and communication technology (ICT) tools in secondary schools. It analyzed the impact of ICT integration on the teaching and learning process based on 51 sampled studies. The findings are thematically presented under the benefits of improving teaching and learning processes regarding curriculum coverage, equitable access, shared learning resources, and personalized learning. Furthermore, challenges were found in professional development, pedagogical and technological knowledge, and resource maintenance. Among the best practices and strategies to resolve these challenges were regular supply and systems maintenance, curricula realignment, ICT policy formulation, and engaging all stakeholders in ICT integration. Recommendations: practitioners should adopt, adapt, and innovate pedagogical approaches, strategies, and methods to facilitate the use of ICT in teaching and learning and should align and integrate ICT tools with curriculum objectives, content, or standards by exploring and using diverse and dynamic ICT tools and methods in secondary schools.

Similar content being viewed by others

Impacts of digital technologies on education and factors influencing schools' digital capacity and transformation: A literature review

Stella Timotheou, Ourania Miliou, … Andri Ioannou

Assistive technology for the inclusion of students with disabilities: a systematic review

José María Fernández-Batanero, Marta Montenegro-Rueda, … Inmaculada García-Martínez

Learning and Teaching Online During Covid-19: Experiences of Student Teachers in an Early Childhood Education Practicum

Jinyoung Kim

Avoid common mistakes on your manuscript.

1 Introduction

Information and communication technology (ICT) is a powerful tool capable of transforming education and enhancing learning outcomes. As a result of this technology, students can access information, collaborate with peers and teachers, develop critical thinking skills and problem-solving abilities, and express their creativity and innovation. Additionally, it can assist teachers in designing and delivering more effective and personalized instruction, assessing and monitoring student progress, and engaging in continuous professional development [ 1 , 2 ]. Despite this, integrating ICT into education is not without challenges; each context and subject area has specific needs, challenges, and opportunities that must be considered during the planning, implementation, evaluation, and improvement process. This analysis, therefore, aims at identifying gaps and limitations in the literature and argues that it is essential to thoroughly review the current literature to synthesize the knowledge about what works, what does not, and the next steps to take to yield the best results out of the integration process.

Furthermore, education has become more integrated with ICT in the twenty-first century, thriving on advancements in computer technology; teaching and learning in secondary schools can be improved in various ways. There is a possibility to support, enhance, or alter the processes and outcomes of teaching and learning in secondary schools through the efficient and successful implementation of ICT [ 3 ]. As a result of the use of ICT in the classroom, particularly in secondary schools, students' learning outcomes, motivation, engagement, and skill development are improved, as well as teachers' attitudes, practices, and beliefs about teaching and learning [ 4 , 5 ]. It is, therefore, imperative that stakeholders work together to overcome the obstacles and problems that prevent secondary schools from fully integrating ICT by addressing challenges such as a lack of resources, training, time, support, curriculum alignment, and pedagogical change [ 6 , 7 ] that interfere with successful integration.

Hence, providing a comprehensive analysis of empirical studies relevant to ICT in secondary schools and learning, the purpose of this systematic literature review is to provide a comprehensive review of the empirical studies. This is because secondary education is integral in preparing young people for life, work, and higher education in the twenty-first century, making integrating ICT into various subjects to be indispensable for improved teaching and learning.

1.1 Research question

The systematic review will analyze the included studies to attain its objective by addressing the following questions:

RQ1: Which benefits of ICT integration exist in secondary schools for teaching and learning?

RQ2: What challenges and barriers hinder ICT’s practical and meaningful integration in teaching and learning?

RQ3: Which best practices and strategies have been implemented for effective ICT integration in secondary schools?

The study contributes to the existing knowledge base on ICT integration in secondary schools by providing a comprehensive overview of the current state of the art and highlighting the gaps and areas for further research. The study also offers practical implications and recommendations for policymakers, educators, researchers, and stakeholders interested in ICT integration in secondary schools. The study is particularly relevant for developing countries, where ICT integration in secondary school education is still in its early stages of implementation and faces many challenges [ 8 ]. Developing countries are home to many young people who need quality education to achieve their potential and contribute to their nation’s social and economic development. Hence, this exploration is timely and essential.

Therefore, to achieve this objective, a systematic literature review was conducted using a six-step process, including team selection, protocol creation, extensive search, screening and selection of studies, data extraction and analysis, and reporting and dissemination of findings. The recommendations from the Cochrane Handbook for Systematic Reviews served as the foundation for the procedure [ 9 ]. Both narrative and quantitative approaches were employed for the data synthesis. The PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) framework was used to prepare this study [ 10 ].

The structure of this article includes Sect.  1 , which is the background information on ICT integration in secondary education, and an overview of the systematic review methodology is provided in Sect.  2 , encompassing a search strategy, inclusion and exclusion criteria, quality assessment, extraction, and synthesis of data. The results are presented in Sect.  3 as descriptive statistics, thematic analysis, and synthesis. Section  4 discusses the main findings, the implications of this rigorous analysis, and its limitations and directions for possible future research. Finally, Sect.  5 presents the synthesized results and discussion.

This study applies a rigorous and transparent methodology based on the Cochrane Handbook for Systematic Reviews [ 11 ] and the PRISMA guidelines [ 10 ]. The study procedure progressed through six steps: selecting the team, developing the protocol, conducting a comprehensive literature search, screening and selecting studies, extracting and analyzing data, and reporting the results. The main objective was to investigate information and communication technology (ICT) use in secondary school education. Furthermore, the research aimed to understand better the impact and challenges of integrating ICT tools in secondary education. To sufficiently address the research problem and the stated objective, we selected a qualitative methodology based on a systematic literature review (SLR) guided by the PRISMA framework protocol [ 10 ] on integrating ICT in secondary school. The research questions were formulated to address the integration of ICT, the impact, and challenges faced in the process of integrating ICT in secondary schools, as shown in Table 1 .

2.1 Eligibility criteria

The sampled articles were considered eligible based on the document characteristics of being published:

in peer-reviewed journals,

in the English language,

between 2008 and July 11, 2023.

Additionally, content criteria and empirical studies with quantitative and qualitative methods were included, discarding theoretical studies dealing with ICT in settings other than secondary school.

2.2 Data sources and search strategy

The included studies were identified and retrieved from Scopus and Eric electronic databases. For the search and selection of articles, we used the search terms and their combinations as “integration”, “technology”, “secondary”, “school”, “ICT” “ICT in secondary education”, “ICT in secondary schools”, “implication of ICT in education”, “implication of ICT in secondary schools”, “benefits of ICT in secondary school”, “challenges in the implementation of ICT”, “challenges in the implementation of ICT in secondary school”, “impact of ICT in secondary school”, and “best practices in ICT implementation in secondary schools”.

2.3 Quality appraisal

The sample was selected using the JBI Checklist for Systematic Reviews and Research Syntheses. The checklist contains 11 questions, and the inclusion criteria were scored as "yes", "no", "unclear", or "not applicable" [ 12 ]. The automated inclusion and exclusion criteria were conducted by the three researchers who examined the search results by evaluating the abstracts to determine whether the study was suitable for the analysis of the benefits, challenges, and strategies employed to enhance ICT integration in secondary schools. In addition, studies were excluded if they did not meet the criteria after an objective comparison of the decisions of the independent researchers. The researchers' independent decisions had an interrater reliability of 94%, which was increased to 100% after the discussion among the three researchers to resolve and determine the suitability of the disputed studies.

2.4 Data analysis

The identified articles were 1363 from Scopus and Eric electronic databases, which were later cleaned up for duplicate records before screening. After the automated inclusion and exclusion process, 553 records were selected for further screening and eligibility assessment, which resulted in 51 sampled studies for this systematic analysis, as presented in Fig.  1 .

Flowchart for inclusion and exclusion process

The results section is a descriptive and thematic analysis and presentation of the 51 included studies.

3.1 Description of the articles under analysis

The systematic review included studies from 2008 to 2023 to establish the trends and gaps in the integration and impact of ICT in secondary schools. According to the article distribution in Fig.  3 , most of our sampled studies were published in 2020 and 2022, followed by 2023. However, 2023 will likely receive more publications since the literature search was conducted in June 2023. The findings indicate that most of the included studies were published in 2022 and were distributed as in Fig.  2 .

Publications by year (n = 51)

Furthermore, the studies were analyzed based on the methodology used. It was established that mainly quantitative methods were used in most of the sampled studies, and the least used method was the survey, as shown in Fig.  3 .

Sampled studies by methodology

The systematic review categorized the included studies according to the country in which they were published. The article distribution by country indicates that many studies were conducted in Malaysia, as shown in Fig.  4 .

Distribution by country

3.2 Thematic analysis

This section presents the findings according to the identified themes in relation to the research questions. The theme identification process involved the two authors independently analyzing the included studies with regard to the research questions and eligibility for the full-text screening. There was consultation with a third author in settling any disputes. This procedure of screening the full text and extracting the data was conducted thoroughly, as illustrated in the PRISMA flow diagram in Fig.  1 . Then, the initial coding for key terms was summarized into themes that emerged from the process, categorized according to the research questions as in Table 2 .

3.2.1 Themes in ICT integration

ICT integration in secondary education is characterized by some common themes, patterns, distinctions, and variations across subjects. The analyzed studies highlight that ICT integration is not only an essential tool to make teaching more interesting and sufficiently transmit twenty-first century skills to learners in current secondary schools but also plays a vital role in enhancing student’s learning outcomes, motivation, engagement, and critical and innovative thinking development [ 13 , 18 ]. Therefore, this study identified three themes surrounding the integration of ICT in secondary schools: the benefits, the challenges, and the best practices and strategies for making ICT an integral and beneficial tool for teaching and learning. Indeed, several factors have influenced and impacted the successful integration of ICT in various subject areas.

These factors can be loosely classified as student factors and teacher factors. Student factors can be termed those that affect students' learning processes, while teacher factors impede the teacher’s abilities to deliver the learning experiences in the teaching process. This analysis discovered that student factors can be minimized by integrating appropriate ICT tools, especially tools and methods that align with the subject's learning objectives, content, and pedagogy [ 4 , 31 ]. For ICT integration to be effective, a number of considerations need to be made, such as the quality of the ICT tools and methodologies, student involvement, learning interaction, and the assessment methods to be used [ 16 , 28 ].

On the other hand, teacher factors such as inadequate professional development, lack of sufficient school support, and pedagogical knowledge influence teachers' attitudes, beliefs, and behaviors, which determine their desire and actual ICT integration in various subjects. Based on the findings, instructors can use ICT tools in a variety of ways, and how they adapt and use them can affect how they view, adopt, and use these tools [ 27 , 29 ]. ICT integration skills can be developed through professional development [ 32 ], while school leadership and support can also assist teachers with ICT integration by providing them with resources, guidance, and motivation [ 21 , 33 ]. The teacher’s pedagogical expertise and views may also contribute to the tactics they use to integrate ICT into their classrooms, such as whether they prefer student- or teacher-centered approaches [ 25 ]. The integration of ICT tools may be affected not only by student and teacher factors but also by the nature of the subject area and its associated learning experiences. Therefore, the distribution of ICT integration of the sample by subject areas demonstrates that the highest integration level of ICT tools was recorded at 33% in ICT as a subject, followed by STEM subjects at 17%, as shown in Fig.  5 .

Distribution of ICT tools integration in subjects

4 Discussion

Based on this systematic literature review, we provide insights into how ICT is used in schools to improve teaching and learning. To comprehensively explain the findings, the research questions that guided this study have been categorized and discussed.

RQ1: What are the benefits of using ICT in secondary education?

RQ1 examined how ICT integration impacts secondary schools' learning outcomes, motivation, engagement, and skill development. About Eleven studies covering mathematics, science, language, and social studies addressed this question based on the rigorous inclusion criteria. The integration of ICT in secondary schools has been found to benefit the teaching and learning processes by improving the quality and pace of curriculum coverage. It is without doubt that integrating computers in the teaching and learning process, if well done, may translate into efficiency, but if not well done, it becomes disruptive. It may disorient both the teachers and learners from attaining their academic goals.

Therefore, this study aimed at synthesizing the benefits of effective ICT integration, which would foster impactful advances in secondary schools’ educational attainments. The twenty-first century has registered considerable advancements in computer technology, transforming various sectors of society and increasing demand for advanced computer skills. This requires that teaching and learning at all levels, particularly in secondary schools, be improved to support, enhance, and alter the processes and outcomes of teaching and learning through the efficient and successful implementation of ICT tools in schools [ 3 ]. As a result, using ICT in the classroom improves students' learning outcomes, motivation, engagement, skill development, and teachers' attitudes, practices, and beliefs about the teaching and learning process [ 4 , 31 ]. Therefore, stakeholders must work together to promote fully effective and practical integration of ICT tools by addressing issues such as a lack of resources, training, time, support, curriculum alignment, and pedagogical change [ 6 , 7 ] that interfere with successful integration. Apart from human resource skills development, other suitable resources and tools, such as software packages, should be made available to secure a meaningful integration.

According to Latifi [ 34 ], GeoGebra software, for instance, was used to teach geometry in Mathematics, improving students' geometry knowledge and performance. Furthermore, it showed that academic achievement, conceptual understanding, problem-solving skills, and creativity were all positively affected by the ICT integration on student learning outcomes. Indeed, Woodrich [ 13 ] confirmed that students' writing skills, creativity, motivation, and achievement in biology increased using Moodle LMS [ 6 ]. In a study conducted by Thibaut [ 20 ], students' inquiry skills and scientific literacy were also improved through WebQuest. It is clear that effective ICT integration in different subjects positively influences the motivation, engagement, and skill development of both the teacher and the learners, making their work more exciting and easier to understand. Therefore, when ICT tools are appropriately used, curriculum content and information are accurately and diversely presented, enhancing learners' ability to grasp concepts and ideas more efficiently and accurately, making the teaching and learning process easier and more interesting.

Another set of benefits can be presented under access to the learning process. Furthermore, the effective integration of ICT in the educative process gives learners better access to curriculum content and information; for example, a teacher can make the learning experiences available for learners at all times. That is, learners are made to conveniently access online learning experiences as they enjoy the freedom to continue learning at their convenience. In addition, effective ICT integration enables learners to collaborate with peers and teachers, develop critical thinking and problem-solving abilities, and express their creativity and innovation during their learning. Moreover, effective ICT integration can also enhance and make learning more personalized. In this regard, ICT tools can assist teachers in designing and delivering more effective and personalized instruction assessments, monitoring student progress, and engaging them in different learning activities.

Furthermore, personalized learning enables the equitable sharing of learning resources such as e-textbooks, course wares, computers, digital media, and other resources available to learners according to their learning needs. The equitable sharing of learning resources has been confirmed by different studies to positively affect students' interest, curiosity, confidence, and satisfaction in learning when ICT tools are effectively integrated into the teaching and learning processes. For example, learning resources shared through WebQuest promoted active participation, collaboration, communication, and self-regulation among students, while Lie [ 14 ] found that equitably shared digital libraries also increased student engagement and reading comprehension. In this case, digital storytelling increased students' motivation and collaboration, as supported by Smeda [ 4 ] and Karahan [ 15 ], who stated that the Autograph software stimulated students' curiosity and confidence in mathematics. These and many other benefits can be accrued from an effective ICT integration in secondary schools, as shown in Table 2 and further discussed under RQ3 below on the effectiveness of ICT tools and different strategies and practices that have been implemented in the school environment.

The results identified some limitations and challenges associated with using ICT in secondary schools. There were technical challenges, such as lack of access, reliability, compatibility, and security of ICT tools and resources. Some concerns were pedagogical issues related to curriculum alignment, assessment methods, and instructional strategies. Students and teachers were sometimes not motivated, interested, or ready to use ICT due to psychological problems.

Therefore, a total of 16 studies, among the included studies in this review, identified barriers and challenges to effective and meaningful integration of ICT in secondary schools. They identified factors that negatively affect ICT integration, such as lack of resources, training, time, support, curriculum alignment, and lack of pedagogical change. According to Chen [ 17 ], technical difficulties or insufficient guidance contributed to some students' frustrations with WebQuest, while Toma [ 18 ] discovered that teachers had negative attitudes toward digital storytelling because they had not been properly trained or supported. Further, Dockendorff [ 19 ] highlighted that some curricula did not adequately include or evaluate ICT integration and evaluation.

Inadequate ICT tools and resources: inadequate, inaccessible, unreliable, and insecure ICT tools pose challenges for teachers and students to use ICT effectively and efficiently. It was found by Planinc [ 7 ] that some preservice mathematics teachers lacked access to GeoGebra software and computers at school or home. According to Smeda [ 4 ], some language teachers face technical difficulties when using digital storytelling tools. At the same time, the Moodle Learning Management System (LMS) had compatibility issues and security concerns for some in-service science teachers [ 23 ].

Insufficient or inadequate training: Teachers lack access to adequate, relevant, high-quality, or frequent professional development opportunities to enhance their abilities to integrate ICT effectively. According to Mohd Ayub [ 28 ], some in-service mathematics teachers lacked the training and experience to use GeoGebra effectively, and in-service biology teachers were not given enough support or training when using Moodle LMS [ 6 ]. Similarly, preservice language teachers lacked training and feedback while using digital storytelling in their classrooms [ 24 ].

Insufficient Planning Time: There is a lack of time for teachers to plan, implement, evaluate, or improve their ICT integration practices because of insufficient allocation, management, or flexibility of time. Mostly, teachers face this challenge, as they are not always able to use ICT effectively or efficiently due to a lack of time. Lie [ 14 , 20 ] found a lack of time for designing and implementing WebQuest projects in the classroom among preservice science teachers. Some in-service language teachers did not have adequate time to explore digital libraries or use them to enhance their teaching; according to Lie [ 14 ] in their study, Bratland [ 25 ] reported that some in-service mathematics teachers did not have time to learn and use GeoGebra software.

Inadequate Technical Support: There is a lack of support for teachers on technical, pedagogical, and emotional levels in terms of provision, quality, relevance, or frequency to improve their ability and competence in integrating ICT. Usually, this is coupled with a lack of appropriate ICT support for teachers, resulting in their inability to use ICT effectively or efficiently. Karahan [ 15 ] found that in-service math teachers lacked technical support when using Autograph software. When using WebQuest for teaching social studies, some in-service teachers lacked sufficient pedagogical support [ 16 ].

Misaligned Curriculum: ICT tools and methods are not aligned, integrated, or coherent with curriculum objectives, content, or standards for teaching and learning when they are not aligned, integrated, or coherent. There may be an inconsistency between the use of ICT and curriculum goals or expectations, which affects both teachers and students. Chen [ 17 ] found that WebQuest was not aligned or integrated with curriculum standards and objectives among in-service language teachers. It has been reported by Toma [ 18 ] that some in-service language teachers lack coherence between digital storytelling and curriculum content. The use of ICT in teaching and learning is not adequately incorporated or evaluated in some curricula [ 19 ].

Inadequate ICT Pedagogic Skills: ICT may not be sufficient for supporting, enhancing, or transforming teaching and learning if pedagogical approaches, strategies, or methods are not adopted, adapted, or innovated. This challenge mainly affects teachers, who may not have enough pedagogical changes to use ICT effectively. Several preservice mathematics teachers were not sufficiently adopting GeoGebra software or adapting it to their existing pedagogical practices [ 7 ]. Digital storytelling did not lead to enough innovation in pedagogical practices for some in-service language teachers [ 4 ]. For some in-service teachers, ICT was ineffective in shifting science teachers from teacher-centered to student-centered learning [ 35 ].

According to the research conducted on RQ3, teachers' attitudes, beliefs, and practices regarding the integration of ICT are influenced by professional development, school support, leadership, pedagogical understanding, and technical knowledge. The review included 14 studies that addressed this question. These studies covered various aspects of teacher education, including preservice training, in-service training, mentoring, coaching, collaboration, reflection, feedback, evaluation, and certification. Most studies indicate that enhancing teachers' ICT integration skills and competencies requires professional development opportunities. Professional development significantly influenced teacher attitudes, beliefs, and practices related to ICT integration, as in the following examples:

Planinc and Kolnik [ 7 ] found that GeoGebra workshops improved preservice mathematics teachers' technological pedagogical content knowledge (TPACK) and confidence in using GeoGebra.

Ilona-Elefteryja [ 6 ] established that biology teachers who attended a Moodle LMS course were more self-efficacious and motivated to use Moodle LMS in the classroom.

Thibault [ 20 ] identified that preservice science teachers who worked on WebQuest designed projects improved their inquiry skills as well as their pedagogical reasoning and

Lie [ 14 ] reported that mentored in-service language teachers became more proficient in digital literacy and pedagogical strategies for utilizing digital libraries.

Furthermore, school support, leadership, and culture can facilitate or hinder ICT integration in secondary education. In addition to providing adequate resources, infrastructure, and technical assistance for ICT integration, school support includes creating a shared vision, mission, and goals for ICT integration; fostering a supportive, collaborative, and innovative school climate for ICT integration; and rewarding, and recognizing teachers and students for their efforts and achievements. School leadership modeled, promoted, and advocated ICT integration, empowering, encouraging, and inspiring teachers and students. It also involved monitoring, evaluating, and improving the effectiveness and quality of integrating ICTs in the teaching and learning process, as itemized in the following examples which;

teachers' attitudes and practices regarding using Autograph software in mathematics were positively correlated with school support and leadership, as Karahan [ 15 ] observed,

Ruggiero and Mong [ 16 ] stated that obtaining school support and leadership was one of the most critical factors in implementing WebQuests to teach social studies and finally,

strong school leadership and school support can foster a culture of innovation and collaboration among teachers and students in the use of ICT, as Ramos and de Andrade [ 21 ] suggested.

Therefore, there should be a holistic and systemic approach to incorporating ICT tools in secondary education to achieve effective ICT integration. This empirical review shows that ICT integration involves changing teachers' and students' beliefs, attitudes, and behaviors, not just pedagogical or technical issues. Hence, the sampled studies attempted to address this issue by investigating how ICT tools could be meaningfully integrated into the learning environment in a quest to integrate useful ICT tools to improve the learning process and the well-being of its users. Sampled studies investigated the integration of a variety of ICT tools and methods, such as digital storytelling, WebQuest, GeoGebra, Moodle LMS, Autograph, and digital libraries. The studies described ICT tools and methods in terms of their features, functions, advantages, and disadvantages and granting examples of the impacts of these ICT tools in the learning environment.

As an example, Multimedia stories can be created and shared using digital tools and platforms. Through the study of digital literacy, students can improve their writing skills, creativity, motivation, collaboration, and communication skills. Moreover, it allows students to express their opinions, emotions, and experiences meaningfully. Language, social studies, and the arts are all possible applications of this technique [ 4 , 13 , 18 , 29 ]. Online resources are used to create and complete WebQuests, which are inquiry-based tasks. Student learning can be enhanced by improving inquiry skills, scientific literacy, critical thinking, problem-solving, and self-regulation. It also allows students to explore everyday issues, questions, and problems in a structured environment. In addition to science, mathematics, and social studies, this approach benefits all subjects [ 16 , 17 ].

Furthermore, GeoGebra uses algebraic expressions to create geometric constructions that can be modified dynamically. Students will learn geometry concepts more deeply, become more curious, and gain greater self-confidence through the program. Besides, it may be used to visually represent, explore, or prove geometric relationships, properties, and theorems. This approach may teach mathematical subjects [ 7 , 25 , 28 ]. You can manage and deliver online courses with multiple modules and activities with the Moodle Learning Management System. When students are motivated, engaged, and collaborate during the learning process, they are more likely to achieve, be motivated, and be engaged. Teachers can also use this software for designing, delivering, assessing, and monitoring online courses. It can cover various topics [ 6 , 23 ].

In addition, Using an Autograph program, dynamic graphs can be manipulated using numerical data and functions. Exposure to graphing concepts results in students performing better, understanding more, feeling more confident, and being more curious. Also, students can interact with graphs by visualizing, exploring, and analyzing them. To practice mathematics, users can access digital resources such as books, articles, images, and videos through digital libraries [ 14 , 15 ] and students can become more engaged, read more, and understand digital literacy better. As a result of a digital resource management system [ 14 ] digital resources can also be provided, organized, and recommended for use in a wide variety of subjects. In secondary education, ICT tools and methods suggest that it is a dynamic phenomenon that requires an adaptable and flexible approach to address diverse topics and situations. ICT integration is used to develop, implement, evaluate, and improve ICT-based learning activities to support, enhance, and transform teaching and learning. Based on our systematic review, Table 3 summarizes our discussion of challenges and possible solutions associated with the integration of ICT in secondary schools.

4.1 Implications for policy and practice

The implications of this systematic literature review for policy and practice in secondary education are numerous. Policymakers should consider implementing ICT integration in secondary education with clear, coherent, comprehensive policies and guidelines addressing various dimensions and factors. These factors are associated with ICT integration, including resources, training, support, curriculum alignment, and pedagogical changes. In secondary education, providing adequate and appropriate resources, infrastructure, and technical assistance is essential to ensuring that ICT tools and resources are available, accessible, reliable, compatible, and secure. Improving teachers' attitudes, beliefs, and practices related to ICT integration should support and facilitate effective and meaningful professional development opportunities. In addition, a shared vision, mission, and goals for ICT integration in secondary education should be created by cultivating a supportive, collaborative, and innovative school culture and climate. A culture and climate that inspires teachers and students to use ICT in education and recognizes, rewards, and celebrates teachers and students' ICT integration achievements.

Practitioners should incorporate ICT tools in teaching and learning to enhance, support, and transform student learning outcomes, motivation, engagement, and skills development. This can be achieved by adopting and adapting strategies and pedagogical methods to integrate ICT tools into the secondary school learning environment efficiently. The integration should be aligned and well coordinated with the curriculum's objectives, content, and standards for teaching and learning purposes. Therefore, Table 3 outlines how the practitioners can address the different issues surrounding the ICT tools integration in the learning process. For example, various topics and situations in teaching and learning may require practitioners to explore, use, or suggest ICT tools and methods to address each context and subject area's specific needs, challenges, and opportunities. There should be effective mechanisms for monitoring, assessing, and improving the quality and effectiveness of ICT integration in teaching and learning by planning, implementing, evaluating, and improving ICT-based learning activities. It is evident from this systematic literature review that a framework is needed to promote better computer-aided learning in secondary schools and to integrate ICT effectively. Therefore, to ensure an effective and beneficial integration of ICT tools in schools, the researchers have proposed the ICT integration framework as in Fig.  6 , illustrating how different aspects of an effective integration interact within an integration system.

ICT integration framework

According to the sampled studies, effective integration of ICT depends on students' and teachers' motivation [ 13 , 18 , 19 , 28 ] Additionally, the authors recommend that secondary schools align ICT integration with their curricula [ 6 , 20 ] and learning objectives as well as maintaining ICT tools [ 4 , 14 ] and develop appropriate ICT skills for teachers as well as learners [ 15 , 16 , 17 ]. Therefore, ICT integration depends mainly on capacity development [ 6 , 7 ], which should be focused on harnessing technological knowledge with pedagogical understanding [ 16 , 21 ] in a conducive learning environment supported by all stakeholders [ 15 , 20 , 29 ]. Finally, capacity development should further enable students, teachers, and other experts to identify challenges and address them efficiently [ 23 , 25 , 26 ]. This framework is a cyclic model of effectively integrating ICT in a learning context.

4.2 Limitations and future research

A systematic literature review has several limitations, including that the scope of the review was limited to the use of information and communication technology in secondary schools for teaching and learning. Therefore, the study findings cannot be generalized or applied to any other level or setting of education, such as primary schools, higher education, or informal education. Studies that are included in a review determine its quality. Methodological aspects such as sample size, design, measurement, or analysis may affect the included studies' results. Thus, the strengths and weaknesses of the synthesis methods may affect the synthesis results.

ICT integration in secondary education should be explored in more diverse and dynamic ways to accommodate various topics and situations in secondary education. Every context and subject area may present different needs, challenges, and opportunities, which require tools that can be applied to them. Examine holistic and systemic approaches to integrating ICT into secondary school teaching and learning that address the resource, training, support, curriculum alignment, and pedagogical changes associated with ICT integration.

5 Conclusion

This study was conducted to comprehensively and rigorously review peer-reviewed studies on integrating information and communication technology in secondary schools. This study followed PRISMA guidelines and the Cochrane Handbook for Systematic Reviews [ 9 ] as the framework, assuring rigor and transparency. In this analysis, three research questions on ICT integration in secondary education were explored with regard to benefits, challenges, best practices, and barriers. As this systematic review highlights, several types and characteristics of ICT tools and methods can be utilized in teaching various secondary education topics. For adequate and appropriate ICT integration resources, infrastructure, and technical assistance, policymakers should develop and implement clear, coherent, and comprehensive policies and guidelines. To foster a supportive, collaborative, and innovative school climate, teachers must be able to participate in practical and meaningful professional development opportunities. For information and communication technology to be effectively utilized for teaching and learning, practitioners must adopt, adapt, or innovate pedagogical approaches, strategies, and methods that align and integrate ICT tools with curriculum objectives, content, or standards. They should explore, use, and propose diverse and dynamic ICT tools and methods for a wide range of topics to ensure that learners get the best out of the learning process.

Data availability

Not applicable. The data for this study originated from secondary desk research.

Oguguo B, Ezechukwu R, Nannim F, Offor K. “Analysis of teachers in the use of digital resources in online teaching and assessment in COVID times”, Innoeduca. Int J Technol Educ Innov. 2023;9(1):81–96. https://doi.org/10.24310/innoeduca .

Article   Google Scholar  

Şimşek AS, Ateş H. “The extended technology acceptance model for Web 2.0 technologies in teaching”, Innoeduca. Int J Technol Educ Innov. 2022;8(2):165–83. https://doi.org/10.24310/innoeduca.2022.v8i2.15413 .

Pareja Roblin N, Tondeur J, Voogt J, Bruggeman B, Mathieu G, van Braak J. Practical considerations informing teachers’ technology integration decisions: the case of tablet PCs. Technol Pedagog Educ. 2018;27(2):165–81. https://doi.org/10.1080/1475939X.2017.1414714 .

Smeda N, Dakich E, Sharda N. The effectiveness of digital storytelling in the classrooms: a comprehensive study. Smart Learn Environ. 2014. https://doi.org/10.1186/s40561-014-0006-3 .

Lee CAL. Channelling artscience through fan-fiction for diversifying STEM approaches in participatory learning in malaysia. Am Behav Sci. 2023;67(9):1122–38. https://doi.org/10.1177/00027642221078511 .

Ilona-Elefteryja L, Meletiou-Mavrotheris M, Katzis K. Augmented reality in lower secondary education: a teacher professional development program in Cyprus and Greece. Educ Sci (Basel). 2020. https://doi.org/10.3390/educsci10040121 .

Planinc TR, Kolnik K. Working with students with special educational needs: views and experiences of geography teachers. Dela. 2016;46:2016. https://doi.org/10.4312/dela.46.4.89-122 .

Mtebe J. Eliciting In-service teachers’ technological pedagogical content knowledge for 21st-century skills in Tanzania. Learn Dev. 2018. https://doi.org/10.56059/jl4d.v5i3.288 .

Sterne JAC, et al. RoB 2: a revised tool for assessing risk of bias in randomised trials. BMJ. 2019. https://doi.org/10.1136/bmj.l4898 .

Page MJ, et al. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews The Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA) statement”. Int J Surg. 2021;88:105906.

Stern E, Gibbs A, Willan S, Dunkle K, Jewkes R. ‘When you talk to someone in a bad way or always put her under pressure, it is actually worse than beating her’: conceptions and experiences of emotional intimate partner violence in Rwanda and South Africa. PLoS ONE. 2019;14(11):e0225121. https://doi.org/10.1371/journal.pone.0225121 .

“JBI Critical Appraisal Tools | JBI.” Accessed: Aug. 28, 2023. https://jbi.global/critical-appraisal-tools

Woodrich M, Fan Y. Google docs as a tool for collaborative writing in the middle school classroom. J Inf Technol Educ Res. 2017;16(1):391. https://doi.org/10.28945/3870 .

Lie A, Tamah SM, Gozali I, Triwidayati KR, Utami TSD, Jemadi F. Secondary school language teachers’ online learning engagement during the covid-19 pandemic in Indonesia. J Inf Technol Educ Res. 2020;19:803–32. https://doi.org/10.28945/4626 .

Karahan E, Canbazoglu Bilici S, Unal A. Integration of media design processes in science, technology, engineering, and mathematics (Stem) education | Fen, teknoloji, mühendislik ve matematik (FeTeMM) eğitimine medya tasarım süreçlerinin entegrasyonu. Eurasian J Educ Res. 2015;60:221–40. https://doi.org/10.14689/ejer.2015.60.15 .

Ruggiero D, Mong CJ. The teacher technology integration experience: Practice and reflection in the classroom. J Inf Technol Educ Res. 2015;14(2015):161–78. https://doi.org/10.28945/2227 .

Chen FS, Hsiao YW. Using WebQuest as a creative teaching tool at a science and technology university in Taiwan. World Trans Eng Technol Educ. 2010;8(2):203.

Google Scholar  

Toma F, Ardelean A, Grădinaru C, Nedelea A, Diaconu DC. Effects of ICT integration in teaching using learning activities. Sustainability. 2023;15(8):6885. https://doi.org/10.3390/su15086885 .

Dockendorff M, Solar H. ICT integration in mathematics initial teacher training and its impact on visualization: the case of GeoGebra. Int J Math Educ Sci Technol. 2018;49(1):66–84. https://doi.org/10.1080/0020739X.2017.1341060 .

Thibaut L, Knipprath H, Dehaene W, Depaepe F. Teachers’ attitudes toward teaching integrated STEM: the Impact of personal background characteristics and school context. Int J Sci Math Educ. 2019;17(5):987–1007. https://doi.org/10.1007/s10763-018-9898-7 .

Ramos SIM, de Andrade AMV. ICT in Portuguese reference schools for the education of blind and partially sighted students. Educ Inf Technol. 2016;21(3):625–41. https://doi.org/10.1007/s10639-014-9344-6 .

Yaccob NS, Yunus MM, John DS. Global education movement: English as a second language teachers’ perceptions of integrating volatility, uncertainty, complexity, and ambiguity elements in lessons. Front Psychol. 2023. https://doi.org/10.3389/fpsyg.2023.1007970 .

Teoh SC, Chng CK, Zaibidi NZ. Analysis of ICT implementation in teaching and learning using analytic hierarchy process (AHP): a comparison of rural and urban areas in Kedah. Cult Manag Sci Educ. 2022;6(1):55–69. https://doi.org/10.30819/cmse.6-1.04 .

Larose F, Grenon V, Morin MP, Hasni A. The impact of pre-service field training sessions on the probability of future teachers using ICT in school. Eur J Teach Educ. 2009;32(3):289. https://doi.org/10.1080/02619760903006144 .

Bratland E, Ghami ME, Mediå M. Technology and knowledge. In what way are knowledge and teachers’ knowledge practices in subject areas crucial for the integration of technology in education? Nordic J Digit Lit. 2022;17(3):155–69. https://doi.org/10.18261/njdl.17.3.2 .

Tang J, Rich CS. Automated writing evaluation in an EFL setting: lessons from China. JALT CALL Journal. 2017;13(2):117–46.

Schmitz ML, Antonietti C, Cattaneo A, Gonon P, Petko D. When barriers are not an issue: tracing the relationship between hindering factors and technology use in secondary schools across Europe. Comput Educ. 2022;179:104411. https://doi.org/10.1016/j.compedu.2021.104411 .

Mohd Ayub AF, Tarmizi RA, Abu Bakar K, Luan WS. Adoption of WxMaxima software in the classroom: effect on students’ motivation and learning of mathematics. Malays J Math Sci. 2014;8(2):311–23.

Yunus MM, Nordin N, Salehi H, Embi MA, Salehi Z. Future of ICT as a pedagogical tool in ESL teaching and learning. Res J Appl Sci Eng Technol. 2014;7(4):764–70. https://doi.org/10.19026/rjaset.7.314 .

Zeng Y. Analysing teacher knowledge for technology use among secondary teachers teaching Chinese as a Foreign Language (CFL) in Australia. J Curric Teach. 2022;11(2):15–28. https://doi.org/10.5430/jct.v11n2p15 .

Lees KE, et al. NUCare: advancing research on technological integration for self-management in the aging population. Nurs Outlook. 2018;66(2):121–9. https://doi.org/10.1016/j.outlook.2017.10.008 .

Kafyulilo AC. Learning technology by design: experiences from In-service science and mathematics teachers in Tanzania. J Educ Humanit Sci. 2019. http://jehs.bongotech.info/index.php/jehs/article/view/119

Omar MN, Ismail SN. Mobile Technology Integration in the 2020s: the impact of technology leadership in the Malaysian context. Univers J Educ Res. 2020;8(5):1874–84. https://doi.org/10.13189/ujer.2020.080524 .

Latifi M, Eseghir A, Elmaroufi A, Hattaf K, Achtaich N. Modeling with differential equations and geogebra in high school mathematics education. J Educ Soc Res. 2022;12(3):47–91. https://doi.org/10.36941/jesr-2022-0065 .

Tang Y. Does information and communication technology (ICT) empower teacher innovativeness: a multilevel, multisite analysis. Education Tech Research Dev. 2021;69(6):3009–28. https://doi.org/10.1007/s11423-021-10052-1 .

Beichumila F, Bahati B, Kafanabo E. Students’ perceptions toward the use of computer simulations and animations in chemistry teaching and learning in Tanzania Secondary Schools. Int J Sci Math Technol Learn. 2022;30(1):1–16. https://doi.org/10.18848/2327-7971/CGP/v30i01/1-16 .

Warioba MM, Machumu H, Kulunga K, Mtweve L. Adoption of ICT as a pedagogical tool in community secondary schools in Tanzania: possibilities and constraints. Educ Inf Technol. 2022;27(2):2835–58. https://doi.org/10.1007/s10639-021-10715-9 .

Domingo M, Marquès P. Classroom 2.0 experiences and building on the use of ICT in teaching. Comunicar. 2011;19(37):169. https://doi.org/10.3916/C37-2011-03-09 .

Hossein-Mohand H, Trujillo-Torres JM, Gómez-García M, Hossein-Mohand H, Campos-Soto A. Analysis of the use and integration of the flipped learning model, project-based learning, and gamification methodologies by secondary school mathematics teachers. Sustainability. 2021;13(5):1–18. https://doi.org/10.3390/su13052606 .

Rind AA, Asad MM, Marri SA, Sherwani F, Rehman FU. How integration of information and communication technologies impact academic achievement? An empirical study on Sindh education foundation. J Appl Res Higher Educ. 2022;14(4):1761–72. https://doi.org/10.1108/JARHE-05-2021-0177 .

Leng NW. Total quality management principles that influence the integration of information and communications technology into the classroom. Asia-Pac Educ Res. 2009. https://doi.org/10.3860/taper.v18i2.1332 .

Carbová A, Betáková L. Using tools for measuring technological pedagogical content knowledge of English language teachers. J Effic Responsib Educ Sci. 2013;6(4):203–17. https://doi.org/10.7160/eriesj.2013.060401 .

Dong Y, Xu C, Chai CS, Zhai X. Exploring the structural relationship among teachers’ technostress, technological pedagogical content knowledge (TPACK), computer self-efficacy and school support. Asia-Pac Educ Res. 2020;29(2):147–57. https://doi.org/10.1007/s40299-019-00461-5 .

Hadjilouca R, Papadouris N, Constantinou CP. Teaching aspects of the interrelationship between science and technology: explicit or implicit approach? Res Sci Technol Educ. 2023;41(2):482–504. https://doi.org/10.1080/02635143.2021.1912726 .

Trigueros M, Sacristán AI. Teachers’ practice and students’ learning in the Mexican programme for teaching mathematics with technology. Int J Contin Eng Educ Life Long Learn. 2008;18(5–6):678. https://doi.org/10.1504/IJCEELL.2008.022174 .

Makgato M. Challenges contributing to poor integration of educational technology at some schools in South Africa. Mediterr J Soc Sci. 2014;5(20):1285–92. https://doi.org/10.5901/mjss.2014.v5n20p1285 .

Gcabashe NB, Ndlovu NS. Exploring business studies teachers’ technology self-efficacy on their technology integration to create learner-centred teaching environment. Int J Learn Teach Educ Res. 2022;21(12):238–58. https://doi.org/10.26803/ijlter.21.12.13 .

Wilder H, Ferris SP, An H. Exploring international multicultural field experiences in educational technology. Multicult Educ Technol J. 2010;4(1):30. https://doi.org/10.1108/17504971011034719 .

Ghavifekr SW, Rosdy AW. Teaching and learning with technology: effectiveness of ICT integration in schools. Int J Res Educ Sci. 2015;1(2):175–91. https://doi.org/10.21890/ijres.23596 .

Pérez MA, Fandos M, and Aguaded JI. A proper policy in the permanent teacher’s training: Key impulse of the ICT centre in Andalusia (Spain). Asia-Pac Forum Sci Learn Teach. 2010;11(1)

Abrizah A, Zainab AN. Digital libraries in the classroom: secondary school teachers’ conception. J Librariansh Inf Sci. 2011;43(4):224. https://doi.org/10.1177/0961000611418811 .

Antonietti C, Schmitz ML, Consoli T, Cattaneo A, Gonon P, Petko D. ‘Development and validation of the ICAP Technology Scale to measure how teachers integrate technology into learning activities.’ Comput Educ. 2023;192:104648. https://doi.org/10.1016/j.compedu.2022.104648 .

Hsu S, Kuan PY. The impact of multilevel factors on technology integration: the case of Taiwanese grade 1–9 teachers and schools. Educ Tech Res Dev. 2013;61(1):25–50. https://doi.org/10.1007/s11423-012-9269-y .

Vincent J. Using models for understanding pedagogical change in a technology environment: R case study of IWB implementation in a secondary school. Aust Educ Comput. 2008;23(2):32.

Shaame AA, Osaki KM, Anatory JR, Mrutu SI. Exploring a learning management system as a way to improve students’ understanding of geometry in secondary schools. Afr Educ Rev. 2020;17(4):17–40. https://doi.org/10.1080/18146627.2020.1868070 .

Download references

This research received no external funding.

Author information

Authors and affiliations.

Institute of International and Comparative Education, College of Teacher Education, Zhejiang Normal University, 688 Yingbin Avenue, Jinhua, 321400, Zhejiang, People’s Republic of China

Mgambi Msambwa Msafiri, Daniel Kangwa & Lianyu Cai

You can also search for this author in PubMed   Google Scholar

Contributions

Conceptualization, MMM and DK; methodology, MMM; software, MMM and DK; format analysis, MMM and DK; investigation, MMM and DK; resources, MMM, LC and DK; data curation, MMM, LC and DK; writing original draft preparation, MMM, LC and DK; review and editing, MMM, LC and DK; supervision, LC funding acquisition, no funding received. All authors have read and agreed to the published version of the manuscript.

Corresponding author

Correspondence to Mgambi Msambwa Msafiri .

Ethics declarations

Institutional review board statement.

Not applicable, as no humans or animals were used in this study. The data for this study originated from secondary desk research.

Informed consent

Competing interests.

The authors declare no conflicts of interest.

Additional information

Publisher's note.

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

1.1 Appendix 1: Summary of included studies highlighting ict integration and impacts in secondary schools

1.2 appendix 2: highlights on the impact of ict in secondary schools, rights and permissions.

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ .

Reprints and permissions

About this article

Msafiri, M.M., Kangwa, D. & Cai, L. A systematic literature review of ICT integration in secondary education: what works, what does not, and what next?. Discov Educ 2 , 44 (2023). https://doi.org/10.1007/s44217-023-00070-x

Download citation

Received : 07 August 2023

Accepted : 13 November 2023

Published : 16 November 2023

DOI : https://doi.org/10.1007/s44217-023-00070-x

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

• Secondary education
• Curriculum coverage
• Innovative pedagogies
• ICT integration

Advertisement

• Find a journal
• Publish with us
• Track your research

Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

• View all journals
• My Account Login
• Explore content
• About the journal
• Publish with us
• Sign up for alerts
• Open access
• Published: 21 March 2024

Expert review of the science underlying nature-based climate solutions

• B. Buma   ORCID: orcid.org/0000-0003-2402-7737 1 , 2   na1 ,
• D. R. Gordon   ORCID: orcid.org/0000-0001-6398-2345 1 , 3   na1 ,
• K. M. Kleisner 1 ,
• A. Bartuska 1 , 4 ,
• A. Bidlack 5 ,
• R. DeFries   ORCID: orcid.org/0000-0002-3332-4621 6 ,
• P. Ellis   ORCID: orcid.org/0000-0001-7933-8298 7 ,
• P. Friedlingstein   ORCID: orcid.org/0000-0003-3309-4739 8 , 9 ,
• S. Metzger 10   nAff15   nAff16 ,
• G. Morgan 11 ,
• K. Novick   ORCID: orcid.org/0000-0002-8431-0879 12 ,
• J. N. Sanchirico 13 ,
• J. R. Collins   ORCID: orcid.org/0000-0002-5705-9682 1 , 14 ,
• A. J. Eagle   ORCID: orcid.org/0000-0003-0841-2379 1 ,
• R. Fujita 1 ,
• E. Holst 1 ,
• J. M. Lavallee   ORCID: orcid.org/0000-0002-3028-7087 1 ,
• R. N. Lubowski 1   nAff17 ,
• C. Melikov 1   nAff18 ,
• L. A. Moore   ORCID: orcid.org/0000-0003-0239-6080 1   nAff19 ,
• E. E. Oldfield   ORCID: orcid.org/0000-0002-6181-1267 1 ,
• J. Paltseva 1   nAff20 ,
• A. M. Raffeld   ORCID: orcid.org/0000-0002-5036-6460 1 ,
• N. A. Randazzo 1   nAff21   nAff22 ,
• C. Schneider 1 ,
• N. Uludere Aragon 1   nAff23 &
• S. P. Hamburg 1  

Nature Climate Change ( 2024 ) Cite this article

10k Accesses

43 Altmetric

Metrics details

• Climate-change ecology
• Climate-change mitigation
• Environmental impact

Viable nature-based climate solutions (NbCS) are needed to achieve climate goals expressed in international agreements like the Paris Accord. Many NbCS pathways have strong scientific foundations and can deliver meaningful climate benefits but effective mitigation is undermined by pathways with less scientific certainty. Here we couple an extensive literature review with an expert elicitation on 43 pathways and find that at present the most used pathways, such as tropical forest conservation, have a solid scientific basis for mitigation. However, the experts suggested that some pathways, many with carbon credit eligibility and market activity, remain uncertain in terms of their climate mitigation efficacy. Sources of uncertainty include incomplete GHG measurement and accounting. We recommend focusing on resolving those uncertainties before broadly scaling implementation of those pathways in quantitative emission or sequestration mitigation plans. If appropriate, those pathways should be supported for their cobenefits, such as biodiversity and food security.

Similar content being viewed by others

Australian human-induced native forest regeneration carbon offset projects have limited impact on changes in woody vegetation cover and carbon removals

Andrew Macintosh, Don Butler, … Paul Summerfield

Meta-analysis shows the impacts of ecological restoration on greenhouse gas emissions

Tiehu He, Weixin Ding, … Quanfa Zhang

Historical impacts of grazing on carbon stocks and climate mitigation opportunities

Shuai Ren, César Terrer, … Dan Liu

Nature-based climate solutions (NbCS) are conservation, restoration and improved management strategies (pathways) in natural and working ecosystems with the primary motivation to mitigate GHG emissions and remove CO 2 from the atmosphere 1 (similar to ecosystem-based mitigation 2 ). GHG mitigation through ecosystem stewardship is integral to meeting global climate goals, with the greatest benefit coming from near-term maximization of emission reductions, followed by CO 2 removal 3 . Many countries (for example, Indonesia, China and Colombia) use NbCS to demonstrate progress toward national climate commitments.

The scope of NbCS is narrower than that of nature-based solutions (NbS) which include interventions that prioritize non-climate benefits alongside climate (for example, biodiversity, food provisioning and water quality improvement) 4 . In many cases, GHG mitigation is considered a cobenefit that results from NbS actions focused on these other challenges 2 . In contrast, NbCS are broader than natural climate solutions, which are primarily focused on climate mitigation through conservation, restoration and improved land management, generally not moving ecosystems beyond their unmodified structure, function or composition 5 . NbCS may involve moving systems beyond their original function, for example by cultivating macroalgae in water deeper than their natural habitat.

The promise of NbCS has generated a proliferation of interest in using them in GHG mitigation plans 6 , 7 ; 104 of the 168 signatories to the Paris Accord included nature-based actions as part of their mitigation plans 8 . Success in long-term GHG management requires an accurate accounting of inputs and outputs to the atmosphere at scale, so NbCS credits must have robust, comprehensive and transparent scientific underpinnings 9 . Given the urgency of the climate problem, our goal is to identify NbCS pathways with a sufficient scientific foundation to provide broad confidence in their potential GHG mitigation impact, provide resources for confident implementation and identify priority research areas in more uncertain pathways. Evaluating implementation of mitigation projects is beyond our scope; this effort focuses on understanding the underlying science. The purpose is not evaluating any specific carbon crediting protocol or implementation framework but rather the current state of scientific understanding necessary to provide confidence in any NbCS.

In service of this goal, we first investigated nine biomes (boreal forests, coastal marine (salt marsh, mangrove, seagrass and coral reef), freshwater wetlands, grasslands, open ocean (large marine animal and mesopelagic zone biomass, seabed), peatlands, shrublands, temperate forests and tropical forests) and three cultivation types (agroforestry, croplands and macroalgae aquaculture); these were chosen because of their identified potential scale of global impact. In this context, impact is assessed as net GHG mitigation: the CO 2 sequestered or emissions reduced, for example, discounted by understood simultaneous emissions of other GHG (as when N 2 O is released simultaneously with carbon sequestration in cropland soils). From there, we identified 43 NbCS pathways which have been formally implemented (with or without market action) or informally proposed. We estimated the scale of mitigation impact for each pathway on the basis of this literature and, as a proxy measure of NbCS implementation, determined eligibility and activity under existing carbon crediting protocols. Eligibility means that the pathway is addressed by an existing GHG mitigation protocol; market activity means that credits are actively being bought under those eligibility requirements. We considered pathways across a spectrum from protection to improved management to restoration to manipulated systems, but some boundaries were necessary. We excluded primarily abiotically driven pathways (for example, ocean alkalinity enhancement) or where major land use or land-use trade-offs exist (for example, afforestation) 10 , 11 , 12 . Of the 43 pathways, 79% are at present eligible for carbon crediting (sometimes under several methodologies) and at least 65% of those have been implemented (Supplementary Table 1 ). This review was then appraised by 30 independent scholars (at least three per pathway; a complete review synthesis is given in the Supplementary Data ).

Consolidation of a broad body of scientific knowledge, with inherent variance, requires expert judgement. We used an expert elicitation process 13 , 14 , 15 with ten experts to place each proposed NbCS pathway into one of three readiness categories following their own assessment of the scientific literature, categorized by general sources of potential uncertainty: category 1, sufficient scientific basis to support a high-quality carbon accounting system or to support the development of such a system today; category 2, a >25% chance that focused research and reasonable funding would support development of high-quality carbon accounting (that is, move to category 1) within 5 years; or category 3, a <25% chance of development of high-quality carbon accounting within 5 years (for example, due to measurement challenges, unconstrained leakage, external factors which constrain viability).

If an expert ranked a pathway as category 2, they were also asked to rank general research needs to resolve: leakage/displacement (spillover to other areas), measuring, reporting and verification (the ability to quantify all salient stocks and fluxes), basic mechanisms of action (fundamental science), durability (ability to predict or compensate for uncertainty in timescale of effectiveness due to disturbances, climate change, human activity or other factors), geographic uncertainty (place-to-place variation), scaling potential (ability to estimate impact) and setting of a baseline (ability to estimate additionality over non-action; a counterfactual). To avoid biasing towards a particular a priori framework for evaluation of the scientific literature, reviewers could use their own framework for evaluating the NbCS literature about potential climate impact and so could choose to ignore or add relevant categorizations as well. Any pathway in category 1 would not need fundamental research for implementation; research gaps were considered too extensive for useful guidance on reducing uncertainty in category 3 pathways. Estimates of the global scale of likely potential impact (PgCO 2 e yr −1 ) and cobenefits were also collected from expert elicitors. See Methods and Supplementary Information for the survey instrument.

Four pathways with the highest current carbon market activity and high mitigation potential (tropical and temperate forest conservation and reforestation; Table 1 and Supplementary Data ), were consistently rated as high-confidence pathways in the expert elicitation survey. Other NbCS pathways, especially in the forestry sector, were rated relatively strongly by the experts for both confidence in scientific basis and scale of potential impact, with some spread across the experts (upper right quadrant, Fig. 1 ). Conversely, 13 pathways were consistently marked by experts as currently highly uncertain/low confidence (median score across experts: 2.5–3.0) and placed in category 3 (for example, cropland microbial amendments and coral reef restoration; Supplementary Tables 1 and 2 ). For the full review, including crediting protocols currently used, literature estimates of scale and details of sub-pathways, see Supplementary Data .

Pathways in the upper right quadrant have both high confidence in the scientific foundations and the largest potential scale of global impact; pathways in the lower left have the lowest confidence in our present scientific body of knowledge and an estimated smaller potential scale of impact. Designations of carbon credit eligibility under existing protocols and market activity at the present time are noted. Grassland enhanced mineral weathering (EMW) is not shown (mean category rating 2.9) as no scale of impact was estimated. See Supplementary Table 1 for specific pathway data. Bars represent 20th to 80th percentiles of individual estimates, if there was variability in estimates. A small amount of random noise was added to avoid overlap.

The experts assessed 26 pathways as having average confidence scores between 1.5 and 2.4, suggesting the potential for near-term resolution of uncertainties. This categorization arose from either consensus amongst experts on the uncertain potential (for example, boreal forest reforestation consistently rated category 2, with primary concerns about durability) or because experts disagreed, with some ranking category 1 and others category 3 (for example, pasture management). We note that where expert disagreement exists (seen as the spread of responses in Fig. 1 and Supplementary Table 1 ; also see Data availability for link to original data), this suggests caution against overconfidence in statements about these pathways. These results also suggest that confidence may be increased by targeted research on the identified sources of uncertainty (Supplementary Table 3 ).

Sources of uncertainty

Durability and baseline-setting were rated as high sources of uncertainty across all pathways ranked as category 2 by the experts (mean ratings of 3.6 and 3.4 out of 5, respectively; Supplementary Table 3 ). Understanding of mechanisms and geographic spread had the lowest uncertainty ratings (2.1 and 2.3, respectively), showing confidence in the basic science. Different subsets of pathways had different prioritizations, however, suggesting different research needs: forest-centric pathways were most uncertain in their durability and additionality (3.8 and 3.4, respectively), suggesting concerns about long-term climate and disturbance trajectories. Agricultural and grassland systems, however, had higher uncertainty in measurement methods and additionality (3.9 and 3.5 respectively). Although there were concerns about durability from some experts (for example, due to sea-level rise), some coastal blue carbon pathways such as mangrove restoration (mean category ranking: 1.7 (20th to 80th percentile 1.0–2.0)) have higher confidence than others (for example, seagrass restoration: mean category ranking 2.8, 20th to 80th percentile 2.6–3.0)), which are relatively poorly constrained in terms of net radiative forcing potential despite a potentially large carbon impact (seagrass median: 1.60 PgCO 2 e yr −1 ; see Supplementary Data for more scientific literature estimates).

Scale of impact

For those pathways with lower categorization by the expert elicitation (category 2 or 3) at the present time, scale of global impact is a potential heuristic for prioritizing further research. High variability, often two orders of magnitude, was evident in the mean estimated potential PgCO 2 e yr −1 impacts for the different pathways (Fig. 1 and Supplementary Table 2 ) and the review of the literature found even larger ranges produced by individual studies (Supplementary Data ). A probable cause of this wide range was different constraints on the estimated potential, with some studies focusing on potential maximum impact and others on more constrained realizable impacts. Only avoided loss of tropical forest and cropland biochar amendment were consistently estimated as having the likely potential to mitigate >2 PgCO 2 e yr −1 , although biochar was considered more uncertain by experts due to other factors germane to its overall viability as a climate solution, averaging a categorization of 2.2. The next four highest potential impact pathways, ranging from 1.6 to 1.7 PgCO 2 e yr −1 , spanned the spectrum from high readiness (temperate forest restoration) to moderate (cropland conversion from annual to perennial vegetation and grassland restoration) to low (seagrass restoration, with main uncertainties around scale of potential impact and durability).

There was high variability in the elicitors’ estimated potential scale of impact, even in pathways with strong support, such as tropical forest avoided loss (20th to 80th percentile confidence interval: 1–8 PgCO 2 e yr −1 ), again emphasizing the importance of consistent definitions and constraints on how NbCS are measured, evaluated and then used in broad-scale climate change mitigation planning and budgeting. Generally, as pathway readiness decreased (moving from category 1 to 3), the elicitor-estimated estimates of GHG mitigation potential decreased (Supplementary Fig. 1 ). Note that individual studies from the scientific literature may have higher or lower estimates (Supplementary Data ).

Expert elicitation meta-analyses suggest that 6–12 responses are sufficient for a robust and stable quantification of responses 15 . We tested that assumption via a Monte Carlo-based sensitivity assessment. Readiness categorizations by the ten experts were robust to a Monte Carlo simulation test, where further samples were randomly drawn from the observed distribution of responses: mean difference between the original and the boot-strapped data was 0.02 (s.d. = 0.05) with an absolute difference average of 0.06 (s.d. = 0.06). The maximum difference in readiness categorization means across all pathways was 0.20 (s.d. = 0.20) (Supplementary Table 2 ). The full dataset of responses is available online (see ʻData availabilityʼ).

These results highlight opportunities to accelerate implementation of NbCS in well-supported pathways and identify critical research needs in others (Fig. 1 ). We suggest focusing future efforts on resolving identified uncertainties for pathways at the intersection between moderate average readiness (for example, mean categorizations between ~1.5 and 2.0) and high potential impact (for example, median >0.5 PgCO 2 e yr −1 ; Supplementary Table 1 ): agroforestry, improved tropical and temperate forest management, tropical and boreal peatlands avoided loss and peatland restoration. Many, although not all, experts identified durability and baseline/additionality as key concerns to resolve in those systems; research explicitly targeted at those specific uncertainties (Supplementary Table 3 ) could rapidly improve confidence in those pathways.

We recommend a secondary research focus on the lower ranked (mean category 2.0 to 3.0) pathways with estimated potential impacts >1 PgCO 2 e yr −1 (Supplementary Fig. 2 ). For these pathways, explicit, quantitative incorporation into broad-scale GHG management plans will require further focus on systems-level carbon/GHG understandings to inspire confidence at all stages of action and/or identifying locations likely to support durable GHG mitigation, for example ref. 16 . Examples of this group include avoided loss and degradation of boreal forests (for example, fire, pests and pathogens and albedo 16 ) and effective mesopelagic fishery management, which some individual studies estimate would avoid future reductions of the currently sequestered 1.5–2.0 PgC yr −1 (refs. 17 , 18 ). These pathways may turn out to have higher or lower potential than the expert review suggests, on the basis of individual studies (Supplementary Data ) but strong support will require further, independent verification of that potential.

We note that category 3 rankings by expert elicitation do not necessarily imply non-viability but simply that much more research is needed to confidently incorporate actions into quantitative GHG mitigation plans. We found an unsurprising trend of lower readiness categorization with lower pathway familiarity (Supplementary Fig. 3 ). This correlation may result from two, non-exclusive potential causes: (1) lower elicitor expertise in some pathways (inevitable, although the panel was explicitly chosen for global perspectives, connections and diverse specialties) and (2) an actual lack of scientific evidence in the literature, which leads to that self-reported lack of familiarity, a common finding in the literature review (Supplementary Data ). Both explanations suggest a need to better consolidate, develop and disseminate the science in each pathway for global utility and recognition.

Our focus on GHG-related benefits in no way diminishes the substantial conservation, environmental and social cobenefits of these pathways (Supplementary Table 4 ), which often exceed their perceived climate benefits 1 , 19 , 20 , 21 . Where experts found climate impacts to remain highly uncertain but other NbS benefits are clear (for example, biodiversity and water quality; Supplementary Table 4 ), other incentives or financing mechanisms independent of carbon crediting should be pursued. While the goals here directly relate to using NbCS as a reliably quantifiable part of global climate action planning and thus strong GHG-related scientific foundations, non-climate NbS projects may provide climate benefits that are less well constrained (and thus less useful from a GHG budgeting standpoint) but also valuable. Potential trade-offs, if any, between ecosystem services and management actions, such as biodiversity and positive GHG outcomes, should be explored to ensure the best realization of desired goals 2 .

Finally, our focus in this study was on broad-scale NbCS potential in quantitative mitigation planning because of the principal and necessary role of NbCS in overall global warming targets. We recognize the range of project conditions that may increase, or decrease, the rigour of any pathway outside the global-scale focus here. We did not specifically evaluate the large and increasing number of crediting concepts (by pathway: Supplementary Data ), focusing rather on the underlying scientific body of knowledge within those pathways. Some broad pathways may have better defined sub-pathways within them, with a smaller potential scale of impact but potentially lower uncertainty (for example, macroalgae harvest cycling). Poorly enacted NbCS actions and/or crediting methodologies at project scales may result in loss of benefits even from high-ranking pathways 22 , 23 , 24 and attention to implementation should be paramount. Conversely, strong, careful project-scale methodologies may make lower readiness pathways beneficial for a given site.

Viable NbCS are vital to global climate change mitigation but NbCS pathways that lack strong scientific underpinnings threaten global accounting by potentially overestimating future climate benefits and eroding public trust in rigorous natural solutions. Both the review of the scientific literature and the expert elicitation survey identified high potential ready-to-implement pathways (for example, tropical reforestation), reinforcing present use of NbCS in planning.

However, uncertainty remains about the quantifiable GHG mitigation of some active and nascent NbCS pathways. On the basis of the expert elicitation survey and review of the scientific literature, we are concerned that large-scale implementation of less scientifically well-founded NbCS pathways in mitigation plans may undermine net GHG budget planning; those pathways require more study before they can be confidently promoted at broad scales and life-cycle analyses to integrate system-level emissions when calculating totals. The expert elicitation judgements suggest a precautionary approach to scaling lower confidence pathways until the scientific foundations are strengthened, especially for NbCS pathways with insufficient measurement and monitoring 10 , 24 , 25 or poorly understood or measured net GHG mitigation potentials 16 , 26 , 27 , 28 . While the need to implement more NbCS pathways for reducing GHG emissions and removing carbon from the atmosphere is urgent, advancing the implementation of poorly quantified pathways (in relation to their GHG mitigation efficacy) could give the false impression that they can balance ongoing, fossil emissions, thereby undermining overall support for more viable NbCS pathways. Explicitly targeting research to resolve these uncertainties in the baseline science could greatly bolster confidence in the less-established NbCS pathways, benefiting efforts to reduce GHG concentrations 29 .

The results of this study should inform both market-based mechanisms and non-market approaches to NbCS pathway management. Research and action that elucidates and advances pathways to ensure a solid scientific basis will provide confidence in the foundation for successfully implementing NbCS as a core component of global GHG management.

NbCS pathway selection

We synthesized scientific publications for nine biomes (boreal forests, coastal blue carbon, freshwater wetlands, grasslands, open ocean blue carbon, peatlands, shrublands, temperate forests and tropical forests) and three cultivation types (agroforestry, croplands and macroalgae aquaculture) (hereafter, systems) and the different pathways through which they may be able to remove carbon or reduce GHG emissions. Shrublands and grasslands were considered as independent ecosystems; nonetheless, we acknowledge that there is overlap in the numbers presented here because shrublands are often included with grasslands 5 , 30 , 31 , 32 , 33 .

The 12 systems were chosen because they have each been identified as having potential for emissions reductions or carbon removal at globally relevant scales. Within these systems, we identified 43 pathways which either have carbon credit protocols formally established or informally proposed for review (non-carbon associated credits were not evaluated). We obtained data on carbon crediting protocols from international, national and regional organizations and registries, such as Verra, American Carbon Registry, Climate Action Reserve, Gold Standard, Clean Development Mechanism, FAO and Nori. We also obtained data from the Voluntary Registry Offsets Database developed by the Berkeley Carbon Trading Project and Carbon Direct company 34 . While we found evidence of more Chinese carbon crediting protocols, we were not able to review these because of limited publicly available information. To maintain clarity and avoid misrepresentation, we used the language as written in each protocol. A full list of the organizations and registries for each system can be found in the Supplementary Data .

Literature searches and synthesis

We reviewed scientific literature and reviews (for example, IPCC special reports) to identify studies reporting data on carbon stocks, GHG dynamics and sequestration potential of each system. Peer-reviewed studies and meta-analyses were identified on Scopus, Web of Science and Google Scholar using simple queries combining the specific practice or pathway names or synonyms (for example, no-tillage, soil amendments, reduced stocking rates, improved forest management, avoided forest conversion and degradation, avoided mangrove conversion and degradation) and the following search terms: ‘carbon storage’, ‘carbon stocks’, ‘carbon sequestration’, ‘carbon sequestration potential’, ‘additional carbon storage’, ‘carbon dynamics’, ‘areal extent’ or ‘global’.

The full literature review was conducted between January and October 2021. We solicited an independent, external review of the syntheses (obtaining from at least three external reviewers per natural or working system; see p. 2 of the Supplementary Data ) as a second check against missing key papers or misinterpretation of data. The review was generally completed in March 2022. Data from additional relevant citations were added through October 2022 as they were discovered. For a complete list of all literature cited, see pp. 217–249 of the Supplementary Data .

From candidate papers, the papers were considered if their results/data could be applied to the following central questions:

How much carbon is stored (globally) at present in the system (total and on average per hectare) and what is the confidence?

At the global level, is the system a carbon source or sink at this time? What is the business-as-usual projection for its carbon dynamics?

Is it possible, through active management, to either increase net carbon sequestration in the system or prevent carbon emissions from that system? (Note that other GHG emissions and forcings were included here as well.)

What is the range of estimates for how much extra carbon could be sequestered globally?

How much confidence do we have in the present methods to detect any net increases in carbon sequestration in a system or net changes in areal extent of that?

From each paper, quantitative estimates for the above questions were extracted for each pathway, including any descriptive information/metadata necessary to understand the estimate. In addition, information on sample size, sampling scheme, geographic coverage, timeline of study, timeline of projections (if applicable) and specific study contexts (for example, wind-break agroforestry) were recorded.

We also tracked where the literature identified trade-offs between carbon sequestered or CO 2 emissions reduced and emissions of other GHG (for example, N 2 O or methane) for questions three and five above. For example, wetland restoration can result in increased CO 2 uptake from the atmosphere. However, it can also increase methane and N 2 O emissions to the atmosphere. Experts were asked to consider the uncertainty in assessing net GHG mitigation as they categorized the NbCS pathways.

Inclusion of each pathway in mitigation protocols and the specific carbon registries involved were also identified. These results are reported (grouped or individually as appropriate) in the Supplementary Data , organized by the central questions and including textual information for interpretation. The data and protocol summaries for each of the 12 systems were reviewed by at least three scientists each and accordingly revised.

These summaries were provided to the expert elicitation group as optional background information.

Unit conversions

Since this synthesis draws on literature from several sources that use different methods and units, all carbon measurements were standardized to the International System of Units (SI units). When referring to total stocks for each system, numbers are reported in SI units of elemental carbon (that is, PgC). When referring to mitigation potential, elemental carbon was converted to CO 2 by multiplying by 3.67. Differences in methodology, such as soil sampling depth, make it difficult to standardize across studies. Where applicable, the specific measurement used to develop each stock estimate is reported.

Expert elicitation process

To assess conclusions brought about by the initial review process described above, we conducted an expert elicitation survey to consolidate and add further, independent assessments to the original literature review. The expert elicitation survey design followed best practice recommendations 14 , with a focus on participant selection, explicitly defining uncertainty, minimizing cognitive and overconfidence biases and clarity of focus. Research on expert elicitation suggests that 6–12 responses are sufficient for a stable quantification of responses 15 . We identified >40 potential experts via a broad survey of leading academics, science-oriented NGO and government agency publications and products. These individuals have published on several NbCS pathways or could represent larger research efforts that spanned the NbCS under consideration. Careful attention was paid to the gender and sectoral breakdown of respondents to ensure equitable representation. Of the invitees, ten completed the full elicitation effort. Experts were offered compensation for their time.

Implementation of the expert elicitation process followed the IDEA protocol 15 . Briefly, after a short introductory interview, the survey was sent to the participants. Results were anonymized and standardized (methods below) and a meeting held with the entire group to discuss the initial results and calibrate understanding of questions. The purpose of this meeting was not to develop consensus on a singular answer but to discuss and ensure that all questions are being considered in the same way (for example, clarifying any potentially confusing language, discussing any questions that emerged as part of the process). The experts then revisited their initial rankings to provide final, anonymous rankings which were compiled in the same way. These final rankings are the results presented here and may be the same or different from the initial rankings, which were discarded.

Survey questions

The expert elicitation survey comprised five questions for each pathway. The data were collected via Google Forms and collated anonymously at the level of pathways, with each respondent contributing one datapoint for each pathway. The experts reported their familiarity (or the familiarity of the organization whose work they were representing) with the pathway and other cobenefits for the pathways.

The initial question ranked the NbCS pathway by category, from one to three.

Category 1 was defined as a pathway with sufficient scientific knowledge to support a high-quality carbon accounting system today (for example, meets the scientific criteria identified in the WWF-EDF-Oeko Institut and ICAO TAB) or to support the development of such a system today. The intended interpretation is that sufficient science is available for quantifying and verifying net GHG mitigation. Note that experts were not required to reference any given ‘high-quality’ crediting framework, which were provided only as examples. In other words, the evaluation was not intended to rank a given framework (for example, ref. 35 ) but rather expert confidence in the fundamental scientific understandings that underpin potential for carbon accounting overall. To this end, no categorization of uncertainty was required (reviewers could skip categorizations they felt were not necessary) and space was available to fill in new categories by individual reviewers (if they felt a category was missing or needed). Uncertainties at this category 1 level are deemed ‘acceptable’, for example, not precluding accounting now, although more research may further substantiate high-quality credits.

Category 2 pathways have a good chance (>25%) that with more research and within the next 5 years, the pathway could be developed into a high-quality pathway for carbon accounting and as a nature-based climate solution pathway. For these pathways, further understanding is needed for factors such as baseline processes, long-term stability, unconstrained fluxes, possible leakage or other before labelling as category 1 but the expert is confident that information can be developed, in 5 years or less, with more work. The >25% chance threshold and 5-year timeframe were determined a priori to reflect and identify pathways that experts identified as having the potential to meet the Paris Accord 2030 goal. Other thresholds (for example, longer timeframes) could have been chosen, which would impact the relative distribution of pathways in categories 2 and 3 (for example, a longer timeframe allowed could move some pathways from category 3 into category 2, for some reviewers). We emphasize that category 3 pathways do not necessarily mean non-valuable approaches but longer timeframes required for research than the one set here.

Category 3 responses denoted pathways that the expert thought had little chance (<25%) that with more research and within the next 5 years, this pathway could be developed into a suitable pathway for managing as a natural solutions pathway, either because present evidence already suggests GHG reduction is not likely to be viable, co-emissions or other biophysical feedbacks may offset those gains or because understanding of key factors is lacking and unlikely to be developed within the next 5 years. Notably, the last does not mean that the NbCS pathway is not valid or viable in the long-term, simply that physical and biological understandings are probably not established enough to enable scientific rigorous and valid NbCS activity in the near term.

The second question asked the experts to identify research gaps associated with those that they ranked as category 2 pathways to determine focal areas for further research. The experts were asked to rank concerns about durability (ability to predict or compensate for uncertainty in timescale of effectiveness due to disturbances, climate change, human activity or other factors), geographic uncertainty (place-to-place variation), leakage or displacement (spillover of activities to other areas), measuring, reporting and verification (MRV, referring to the ability to quantify all salient stocks and fluxes to fully assess climate impacts), basic mechanisms of action (fundamental science), scaling potential (ability to estimate potential growth) and setting of a baseline (ability to reasonably quantify additionality over non-action, a counterfactual). Respondents could also enter a different category if desired. For complete definitions of these categories, see the survey instrument ( Supplementary Information ). This question was not asked if the expert ranked the pathway as category 1, as those were deemed acceptable, or for category 3, respecting the substantial uncertainty in that rating. Note that responses were individual and so the same NbCS pathway could receive (for example) several individual category 1 rankings, which would indicate reasonable confidence from those experts, and several category 2 rankings from others, which would indicate that those reviewers have lingering concerns about the scientific basis, along with their rankings of the remaining key uncertainties in those pathways. These are important considerations, as they reflect the diversity of opinions and research priorities; individual responses are publicly available (anonymized: https://doi.org/10.5281/zenodo.7859146 ).

The third question involved quantification of the potential for moving from category 2 to 1 explicitly. Following ref. 14 , the respondents first reported the lowest plausible value for the potential likelihood of movement (representing the lower end of a 95% confidence interval), then the upper likelihood and then their best guess for the median/most likely probability. They were also asked for the odds that their chosen interval contained the true value, which was used to scale responses to standard 80% credible intervals and limit overconfidence bias 13 , 15 . This question was not asked if the expert ranked the pathway as category 3, respecting the substantial uncertainty in that rating.

The fourth question involved the scale of potential impact from the NbCS, given the range of uncertainties associated with effectiveness, area of applicability and other factors. The question followed the same pattern as the third, first asking about lowest, then highest, then best estimate for potential scale of impact (in PgCO 2 e yr −1 ). Experts were again asked to express their confidence in their own range, which was used to scale to a standard 80% credible interval. This estimate represents a consolidation of the best-available science by the reviewers. For a complete review including individual studies and their respective findings, see the Supplementary Data . This question was not asked if the expert ranked the pathway as category 3, respecting the substantial uncertainty in that rating.

Final results

After collection of the final survey responses, results were anonymized and compiled by pathway. For overall visualization and discussion purposes, responses were combined into a mean and 20th to 80th percentile range. The strength of the expert elicitation process lies in the collection of several independent assessments. Those different responses represent real differences in data interpretation and synthesis ascribed by experts. This can have meaningful impacts on decision-making by different individuals and organizations (for example, those that are more optimistic or pessimistic about any given pathway). Therefore, individual anonymous responses were retained by pathway to show the diversity of responses for any given pathway. The experts surveyed, despite their broad range of expertise, ranked themselves as less familiar with category 3 pathways than category 1 or 2 (linear regression, P  < 0.001, F  = 59.6 2, 394 ); this could be because of a lack of appropriate experts—although they represented all principal fields—or simply because the data are limited in those areas.

Sensitivity

To check for robustness against sample size variation, we conducted a Monte Carlo sensitivity analysis of the data on each pathway to generate responses of a further ten hypothetical experts. Briefly, the extra samples were randomly drawn from the observed category ranking mean and standard deviations for each individual pathway and appended to the original list; values <1 or >3 were truncated to those values. This analysis resulted in only minor differences in the mean categorization across all pathways: the mean difference between the original and the boot-strapped data was 0.02 (s.d. = 0.05) with an absolute difference average of 0.06 (s.d. = 0.06). The maximum difference in means across all pathways was 0.20 (s.d. = 0.20) (Supplementary Table 2 ). The results suggest that the response values are stable to additional responses.

All processing was done in R 36 , with packages including fmsb 37 and forcats 38 .

Data availability

Anonymized expert elicitation responses are available on Zenodo 39 : https://doi.org/10.5281/zenodo.7859146 .

Code availability

R code for analysis available on Zenodo 39 : https://doi.org/10.5281/zenodo.7859146 .

Novick, K. A. et al. Informing nature‐based climate solutions for the United States with the best‐available science. Glob. Change Biol. 28 , 3778–3794 (2022).

Article   Google Scholar  

Cohen-Shacham, E., Walters, G., Janzen, C. & Maginnis, S. (eds) Nature-based Solutions to Address Global Societal Challenges (IUCN, 2016).

IPCC Climate Change 2021: The Physical Science Basis (eds Masson-Delmotte, V. et al.) (Cambridge Univ. Press, 2021).

Seddon, N. et al. Understanding the value and limits of nature-based solutions to climate change and other global challenges. Philos. Trans. R. Soc. B 375 , 20190120 (2020).

Griscom, B. W. et al. Natural climate solutions. Proc. Natl Acad. Sci. USA 114 , 11645–11650 (2017).

Article   CAS   PubMed   PubMed Central   ADS   Google Scholar  

Blaufelder, C., Levy, C., Mannion, P. & Pinner, D. A. Blueprint for Scaling Voluntary Carbon Markets to Meet the Climate Challenge (McKinsey & Company, 2021).

Arcusa, S. & Sprenkle-Hyppolite, S. Snapshot of the carbon dioxide removal certification and standards ecosystem (2021–2022). Clim. Policy 22 , 1319–1332 (2022).

Seddon, N. et al. Global recognition of the importance of nature-based solutions to the impacts of climate change Glob. Sustain. 3 , pe15 (2020).

Anderegg, W. R. Gambling with the climate: how risky of a bet are natural climate solutions? AGU Adv. 2 , e2021AV000490 (2021).

Article   ADS   Google Scholar  

Gattuso, J. P. et al. Ocean solutions to address climate change and its effects on marine ecosystems. Front. Mar. Sci. 5 , p337 (2018).

Bach, L. T., Gill, S. J., Rickaby, R. E., Gore, S. & Renforth, P. CO 2 removal with enhanced weathering and ocean alkalinity enhancement: potential risks and co-benefits for marine pelagic ecosystems. Front. Clim. 1 , 7 (2019).

Doelman, J. C. et al. Afforestation for climate change mitigation: potentials, risks and trade‐offs. Glob. Change Biol. 26 , 1576–1591 (2019).

Speirs-Bridge, A. et al. Reducing overconfidence in the interval judgments of experts. Risk Anal. 30 , 512–523 (2010).

Article   PubMed   Google Scholar  

Morgan, M. G. Use (and abuse) of expert elicitation in support of decision making for public policy. Proc. Natl Acad. Sci. USA 111 , 7176–7184 (2014).

Hemming, V., Burgman, M. A., Hanea, A. M., McBride, M. F. & Wintle, B. C. A practical guide to structured expert elicitation using the IDEA protocol. Methods Ecol. Evol. 9 , 169–180 (2018).

Anderegg, W. R. et al. Climate-driven risks to the climate mitigation potential of forests. Science 368 , eaaz7005 (2020).

Article   CAS   PubMed   Google Scholar  

Boyd, P. W., Claustre, H., Levy, M., Siegel, D. A. & Weber, T. Multi-faceted particle pumps drive carbon sequestration in the ocean. Nature 568 , 327–335 (2019).

Article   CAS   PubMed   ADS   Google Scholar  

Saba, G. K. et al. Toward a better understanding of fish-based contribution to ocean carbon flux. Limnol. Oceanogr. 66 , 1639–1664 (2021).

Article   CAS   ADS   Google Scholar  

Seddon, N., Turner, B., Berry, P., Chausson, A. & Girardin, C. A. Grounding nature-based climate solutions in sound biodiversity science. Nat. Clim. Change 9 , 84–87 (2019).

Soto-Navarro, C. et al. Mapping co-benefits for carbon storage and biodiversity to inform conservation policy and action. Philos. Trans. R. Soc. B 375 , 20190128 (2020).

Article   CAS   Google Scholar  

Schulte, I., Eggers, J., Nielsen, J. Ø. & Fuss, S. What influences the implementation of natural climate solutions? A systematic map and review of the evidence. Environ. Res. Lett. 17 , p013002 (2022).

West, T. A., Börner, J., Sills, E. O. & Kontoleon, A. Overstated carbon emission reductions from voluntary REDD+ projects in the Brazilian Amazon. Proc. Natl Acad. Sci. USA 117 , 24188–24194 (2020).

Di Sacco, A. et al. Ten golden rules for reforestation to optimize carbon sequestration, biodiversity recovery and livelihood benefits. Glob. Change Biol. 27 , 1328–1348 (2021).

López-Vallejo, M. in Towards an Emissions Trading System in Mexico: Rationale, Design and Connections with the Global Climate Agenda (ed. Lucatello, S.) 191–221 (Springer, 2022)

Oldfield, E. E. et al. Realizing the potential of agricultural soil carbon sequestration requires more effective accounting. Science 375 , 1222–1225 (2022).

Burkholz, C., Garcias-Bonet, N. & Duarte, C. M. Warming enhances carbon dioxide and methane fluxes from Red Sea seagrass ( Halophila stipulacea ) sediments. Biogeosciences 17 , 1717–1730 (2020).

Guenet, B. et al. Can N 2 O emissions offset the benefits from soil organic carbon storage? Glob. Change Biol. 27 , 237–256 (2021).

Rosentreter, J. A., Al‐Haj, A. N., Fulweiler, R. W. & Williamson, P. Methane and nitrous oxide emissions complicate coastal blue carbon assessments. Glob. Biogeochem. Cycles 35 , pe2020GB006858 (2021).

Schwartzman, S. et al. Environmental integrity of emissions reductions depends on scale and systemic changes, not sector of origin. Environ. Res. Lett. 16 , p091001 (2021).

Crop and Livestock Products Database (FAO, 2022); https://www.fao.org/faostat/en/#data/QCL

Fargione, J. E. et al. Natural climate solutions for the United States. Sci. Adv. 4 , eaat1869 (2018).

Article   PubMed   PubMed Central   ADS   Google Scholar  

Meyer, S. E. Is climate change mitigation the best use of desert shrublands? Nat. Resour. Environ. Issues 17 , 2 (2011).

Google Scholar  

Lorenz, K. & Lal, R. Carbon Sequestration in Agricultural Ecosystems (Springer Cham, 2018).

Haya, B., So, I. & Elias, M. The Voluntary Registry Offsets Database (Univ. California, 2021); https://gspp.berkeley.edu/faculty-and-impact/centers/cepp/projects/berkeley-carbon-trading-project/offsets-database

Core Carbon Principles; CCP Attributes; Assessment Framework for Programs; and Assessment Procedure (ICVCM, 2023); https://icvcm.org/the-core-carbon-principles/

R Core Team. R: A Language and Environment for Statistical Computing (R Foundation for Statistical Computing, 2022).

Nakazawa, M. fmsb: Functions for medical statistics book with some demographic data. R package version 0.7.4 https://CRAN.R-project.org/package=fmsb (2022).

Wickham, H. forcats: Tools for working with categorical variables (factors). R package version 0.5.2 https://CRAN.R-project.org/package=forcats (2022)

Buma, B. Nature-based climate solutions: expert elicitation data and analysis code. Zenodo https://doi.org/10.5281/zenodo.7859146 (2023).

Download references

Acknowledgements

This research was supported through gifts to the Environmental Defense Fund from the Bezos Earth Fund, King Philanthropies and Arcadia, a charitable fund of L. Rausing and P. Baldwin. We thank J. Rudek for help assembling the review and 30 experts who reviewed some or all of those data and protocol summaries (Supplementary Data ). S.M. was supported by a cooperative agreement between the National Science Foundation and Battelle that sponsors the National Ecological Observatory Network programme.

Author information

Present address: Department of Atmospheric and Oceanic Sciences, University of Wisconsin-Madison, Madison, WI, USA

Present address: AtmoFacts, Longmont, CO, USA

R. N. Lubowski

Present address: Lombard Odier Investment Managers, New York, NY, USA

Present address: Ecological Carbon Offset Partners LLC, dba EP Carbon, Minneapolis, MN, USA

L. A. Moore

Present address: , San Francisco, CA, USA

J. Paltseva

Present address: ART, Arlington, VA, USA

N. A. Randazzo

Present address: NASA/GSFC, Greenbelt, MD, USA

Present address: University of Maryland, College Park, MD, USA

N. Uludere Aragon

Present address: Numerical Terradynamic Simulation Group, University of Montana, Missoula, MT, USA

These authors contributed equally: B. Buma, D. R. Gordon.

Authors and Affiliations

Environmental Defense Fund, New York, NY, USA

B. Buma, D. R. Gordon, K. M. Kleisner, A. Bartuska, J. R. Collins, A. J. Eagle, R. Fujita, E. Holst, J. M. Lavallee, R. N. Lubowski, C. Melikov, L. A. Moore, E. E. Oldfield, J. Paltseva, A. M. Raffeld, N. A. Randazzo, C. Schneider, N. Uludere Aragon & S. P. Hamburg

Department of Integrative Biology, University of Colorado, Denver, CO, USA

Department of Biology, University of Florida, Gainesville, FL, USA

D. R. Gordon

Resources for the Future, Washington, DC, USA

A. Bartuska

International Arctic Research Center, University of Alaska, Fairbanks, AK, USA

Department of Ecology Evolution and Environmental Biology and the Climate School, Columbia University, New York, NY, USA

The Nature Conservancy, Arlington, VA, USA

Faculty of Environment, Science and Economy, University of Exeter, Exeter, UK

P. Friedlingstein

Laboratoire de Météorologie Dynamique/Institut Pierre-Simon Laplace, CNRS, Ecole Normale Supérieure/Université PSL, Sorbonne Université, Ecole Polytechnique, Palaiseau, France

National Ecological Observatory Network, Battelle, Boulder, CO, USA

Department of Engineering and Public Policy, Carnegie Mellon University, Pittsburgh, PA, USA

O’Neill School of Public and Environmental Affairs, Indiana University, Bloomington, IN, USA

Department of Environmental Science and Policy, University of California, Davis, CA, USA

J. N. Sanchirico

Department of Marine Chemistry & Geochemistry, Woods Hole Oceanographic Institution, Woods Hole, MA, USA

J. R. Collins

You can also search for this author in PubMed   Google Scholar

Contributions

D.R.G. and B.B. conceived of and executed the study design. D.R.G., K.M.K., J.R.C., A.J.E., R.F., E.H., J.M.L., R.N.L., C.M., L.A.M., E.E.O., J.P., A.M.R., N.A.R., C.S. and N.U.A. coordinated and conducted the literature review. G.M. and B.B. primarily designed the survey. A. Bartuska, A. Bidlack, B.B., J.N.S., K.N., P.E., P.F., R.D. and S.M. contributed to the elicitation. B.B. conducted the analysis and coding. S.P.H. coordinated funding. B.B. and D.R.G. were primary writers; all authors were invited to contribute to the initial drafting.

Corresponding author

Correspondence to B. Buma .

Ethics declarations

Competing interests.

The authors declare no competing interests. In the interest of full transparency, we note that while B.B., D.R.G., K.M.K., A.B., J.R.C., A.J.E., R.F., E.H., J.M.L., R.N.L., C.M., L.A.M., E.E.O., J.P., A.M.R., N.A.R., C.S., N.U.A., S.P.H. and P.E. are employed by organizations that have taken positions on specific NbCS frameworks or carbon crediting pathways (not the focus of this work), none have financial or other competing interest in any of the pathways and all relied on independent science in their contributions to the work.

Peer review

Peer review information.

Nature Climate Change thanks Camila Donatti, Connor Nolan and the other, anonymous, reviewer(s) for their contribution to the peer review of this work.

Additional information

Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary information

Supplementary information.

Supplementary Tables 1–4, Figs. 1–3 and survey instrument.

Supplementary Data

Literature review and list of reviewers.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ .

Reprints and permissions

About this article

Cite this article.

Buma, B., Gordon, D.R., Kleisner, K.M. et al. Expert review of the science underlying nature-based climate solutions. Nat. Clim. Chang. (2024). https://doi.org/10.1038/s41558-024-01960-0

Download citation

Received : 24 April 2023

Accepted : 20 February 2024

Published : 21 March 2024

DOI : https://doi.org/10.1038/s41558-024-01960-0

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

Quick links

• Explore articles by subject
• Guide to authors
• Editorial policies

Sign up for the Nature Briefing newsletter — what matters in science, free to your inbox daily.