reflection on writing a literature review

Get science-backed answers as you write with Paperpal's Research feature

What is a Literature Review? How to Write It (with Examples)

A literature review is a critical analysis and synthesis of existing research on a particular topic. It provides an overview of the current state of knowledge, identifies gaps, and highlights key findings in the literature. 1 The purpose of a literature review is to situate your own research within the context of existing scholarship, demonstrating your understanding of the topic and showing how your work contributes to the ongoing conversation in the field. Learning how to write a literature review is a critical tool for successful research. Your ability to summarize and synthesize prior research pertaining to a certain topic demonstrates your grasp on the topic of study, and assists in the learning process. 

Table of Contents

• What is the purpose of literature review? 
• a. Habitat Loss and Species Extinction: 
• b. Range Shifts and Phenological Changes: 
• c. Ocean Acidification and Coral Reefs: 
• d. Adaptive Strategies and Conservation Efforts: 

How to write a good literature review 

• Choose a Topic and Define the Research Question: 
• Decide on the Scope of Your Review: 
• Select Databases for Searches: 
• Conduct Searches and Keep Track: 
• Review the Literature: 
• Organize and Write Your Literature Review: 
• How to write a literature review faster with Paperpal? 
• Frequently asked questions 

What is a literature review?

A well-conducted literature review demonstrates the researcher’s familiarity with the existing literature, establishes the context for their own research, and contributes to scholarly conversations on the topic. One of the purposes of a literature review is also to help researchers avoid duplicating previous work and ensure that their research is informed by and builds upon the existing body of knowledge.

What is the purpose of literature review?

A literature review serves several important purposes within academic and research contexts. Here are some key objectives and functions of a literature review: 2  

1. Contextualizing the Research Problem: The literature review provides a background and context for the research problem under investigation. It helps to situate the study within the existing body of knowledge. 

2. Identifying Gaps in Knowledge: By identifying gaps, contradictions, or areas requiring further research, the researcher can shape the research question and justify the significance of the study. This is crucial for ensuring that the new research contributes something novel to the field. 

Find academic papers related to your research topic faster. Try Research on Paperpal  

3. Understanding Theoretical and Conceptual Frameworks: Literature reviews help researchers gain an understanding of the theoretical and conceptual frameworks used in previous studies. This aids in the development of a theoretical framework for the current research. 

4. Providing Methodological Insights: Another purpose of literature reviews is that it allows researchers to learn about the methodologies employed in previous studies. This can help in choosing appropriate research methods for the current study and avoiding pitfalls that others may have encountered. 

5. Establishing Credibility: A well-conducted literature review demonstrates the researcher’s familiarity with existing scholarship, establishing their credibility and expertise in the field. It also helps in building a solid foundation for the new research. 

6. Informing Hypotheses or Research Questions: The literature review guides the formulation of hypotheses or research questions by highlighting relevant findings and areas of uncertainty in existing literature. 

Literature review example

Let’s delve deeper with a literature review example: Let’s say your literature review is about the impact of climate change on biodiversity. You might format your literature review into sections such as the effects of climate change on habitat loss and species extinction, phenological changes, and marine biodiversity. Each section would then summarize and analyze relevant studies in those areas, highlighting key findings and identifying gaps in the research. The review would conclude by emphasizing the need for further research on specific aspects of the relationship between climate change and biodiversity. The following literature review template provides a glimpse into the recommended literature review structure and content, demonstrating how research findings are organized around specific themes within a broader topic. 

Literature Review on Climate Change Impacts on Biodiversity:

Climate change is a global phenomenon with far-reaching consequences, including significant impacts on biodiversity. This literature review synthesizes key findings from various studies: 

a. Habitat Loss and Species Extinction:

Climate change-induced alterations in temperature and precipitation patterns contribute to habitat loss, affecting numerous species (Thomas et al., 2004). The review discusses how these changes increase the risk of extinction, particularly for species with specific habitat requirements. 

b. Range Shifts and Phenological Changes:

Observations of range shifts and changes in the timing of biological events (phenology) are documented in response to changing climatic conditions (Parmesan & Yohe, 2003). These shifts affect ecosystems and may lead to mismatches between species and their resources. 

c. Ocean Acidification and Coral Reefs:

The review explores the impact of climate change on marine biodiversity, emphasizing ocean acidification’s threat to coral reefs (Hoegh-Guldberg et al., 2007). Changes in pH levels negatively affect coral calcification, disrupting the delicate balance of marine ecosystems. 

d. Adaptive Strategies and Conservation Efforts:

Recognizing the urgency of the situation, the literature review discusses various adaptive strategies adopted by species and conservation efforts aimed at mitigating the impacts of climate change on biodiversity (Hannah et al., 2007). It emphasizes the importance of interdisciplinary approaches for effective conservation planning. 

Strengthen your literature review with factual insights. Try Research on Paperpal for free!    

Writing a literature review involves summarizing and synthesizing existing research on a particular topic. A good literature review format should include the following elements. 

Introduction: The introduction sets the stage for your literature review, providing context and introducing the main focus of your review. 

• Opening Statement: Begin with a general statement about the broader topic and its significance in the field. 
• Scope and Purpose: Clearly define the scope of your literature review. Explain the specific research question or objective you aim to address. 
• Organizational Framework: Briefly outline the structure of your literature review, indicating how you will categorize and discuss the existing research. 
• Significance of the Study: Highlight why your literature review is important and how it contributes to the understanding of the chosen topic. 
• Thesis Statement: Conclude the introduction with a concise thesis statement that outlines the main argument or perspective you will develop in the body of the literature review. 

Body: The body of the literature review is where you provide a comprehensive analysis of existing literature, grouping studies based on themes, methodologies, or other relevant criteria. 

• Organize by Theme or Concept: Group studies that share common themes, concepts, or methodologies. Discuss each theme or concept in detail, summarizing key findings and identifying gaps or areas of disagreement. 
• Critical Analysis: Evaluate the strengths and weaknesses of each study. Discuss the methodologies used, the quality of evidence, and the overall contribution of each work to the understanding of the topic. 
• Synthesis of Findings: Synthesize the information from different studies to highlight trends, patterns, or areas of consensus in the literature. 
• Identification of Gaps: Discuss any gaps or limitations in the existing research and explain how your review contributes to filling these gaps. 
• Transition between Sections: Provide smooth transitions between different themes or concepts to maintain the flow of your literature review. 

Write and Cite as you go with Paperpal Research. Start now for free.   

Conclusion: The conclusion of your literature review should summarize the main findings, highlight the contributions of the review, and suggest avenues for future research. 

• Summary of Key Findings: Recap the main findings from the literature and restate how they contribute to your research question or objective. 
• Contributions to the Field: Discuss the overall contribution of your literature review to the existing knowledge in the field. 
• Implications and Applications: Explore the practical implications of the findings and suggest how they might impact future research or practice. 
• Recommendations for Future Research: Identify areas that require further investigation and propose potential directions for future research in the field. 
• Final Thoughts: Conclude with a final reflection on the importance of your literature review and its relevance to the broader academic community. 

Conducting a literature review

Conducting a literature review is an essential step in research that involves reviewing and analyzing existing literature on a specific topic. It’s important to know how to do a literature review effectively, so here are the steps to follow: 1  

Choose a Topic and Define the Research Question:

• Select a topic that is relevant to your field of study. 
• Clearly define your research question or objective. Determine what specific aspect of the topic do you want to explore? 

Decide on the Scope of Your Review:

• Determine the timeframe for your literature review. Are you focusing on recent developments, or do you want a historical overview? 
• Consider the geographical scope. Is your review global, or are you focusing on a specific region? 
• Define the inclusion and exclusion criteria. What types of sources will you include? Are there specific types of studies or publications you will exclude? 

Select Databases for Searches:

• Identify relevant databases for your field. Examples include PubMed, IEEE Xplore, Scopus, Web of Science, and Google Scholar. 
• Consider searching in library catalogs, institutional repositories, and specialized databases related to your topic. 

Conduct Searches and Keep Track:

• Develop a systematic search strategy using keywords, Boolean operators (AND, OR, NOT), and other search techniques. 
• Record and document your search strategy for transparency and replicability. 
• Keep track of the articles, including publication details, abstracts, and links. Use citation management tools like EndNote, Zotero, or Mendeley to organize your references. 

Review the Literature:

• Evaluate the relevance and quality of each source. Consider the methodology, sample size, and results of studies. 
• Organize the literature by themes or key concepts. Identify patterns, trends, and gaps in the existing research. 
• Summarize key findings and arguments from each source. Compare and contrast different perspectives. 
• Identify areas where there is a consensus in the literature and where there are conflicting opinions. 
• Provide critical analysis and synthesis of the literature. What are the strengths and weaknesses of existing research? 

Organize and Write Your Literature Review:

• Literature review outline should be based on themes, chronological order, or methodological approaches. 
• Write a clear and coherent narrative that synthesizes the information gathered. 
• Use proper citations for each source and ensure consistency in your citation style (APA, MLA, Chicago, etc.). 
• Conclude your literature review by summarizing key findings, identifying gaps, and suggesting areas for future research. 

Whether you’re exploring a new research field or finding new angles to develop an existing topic, sifting through hundreds of papers can take more time than you have to spare. But what if you could find science-backed insights with verified citations in seconds? That’s the power of Paperpal’s new Research feature!  

How to write a literature review faster with Paperpal?

Paperpal, an AI writing assistant, integrates powerful academic search capabilities within its writing platform. With the Research feature, you get 100% factual insights, with citations backed by 250M+ verified research articles, directly within your writing interface with the option to save relevant references in your Citation Library. By eliminating the need to switch tabs to find answers to all your research questions, Paperpal saves time and helps you stay focused on your writing.   

Here’s how to use the Research feature:  

• Ask a question: Get started with a new document on paperpal.com. Click on the “Research” feature and type your question in plain English. Paperpal will scour over 250 million research articles, including conference papers and preprints, to provide you with accurate insights and citations. 
• Review and Save: Paperpal summarizes the information, while citing sources and listing relevant reads. You can quickly scan the results to identify relevant references and save these directly to your built-in citations library for later access. 
• Cite with Confidence: Paperpal makes it easy to incorporate relevant citations and references into your writing, ensuring your arguments are well-supported by credible sources. This translates to a polished, well-researched literature review. 

The literature review sample and detailed advice on writing and conducting a review will help you produce a well-structured report. But remember that a good literature review is an ongoing process, and it may be necessary to revisit and update it as your research progresses. By combining effortless research with an easy citation process, Paperpal Research streamlines the literature review process and empowers you to write faster and with more confidence. Try Paperpal Research now and see for yourself.  

Frequently asked questions

A literature review is a critical and comprehensive analysis of existing literature (published and unpublished works) on a specific topic or research question and provides a synthesis of the current state of knowledge in a particular field. A well-conducted literature review is crucial for researchers to build upon existing knowledge, avoid duplication of efforts, and contribute to the advancement of their field. It also helps researchers situate their work within a broader context and facilitates the development of a sound theoretical and conceptual framework for their studies.

Literature review is a crucial component of research writing, providing a solid background for a research paper’s investigation. The aim is to keep professionals up to date by providing an understanding of ongoing developments within a specific field, including research methods, and experimental techniques used in that field, and present that knowledge in the form of a written report. Also, the depth and breadth of the literature review emphasizes the credibility of the scholar in his or her field.  

Before writing a literature review, it’s essential to undertake several preparatory steps to ensure that your review is well-researched, organized, and focused. This includes choosing a topic of general interest to you and doing exploratory research on that topic, writing an annotated bibliography, and noting major points, especially those that relate to the position you have taken on the topic. 

Literature reviews and academic research papers are essential components of scholarly work but serve different purposes within the academic realm. 3 A literature review aims to provide a foundation for understanding the current state of research on a particular topic, identify gaps or controversies, and lay the groundwork for future research. Therefore, it draws heavily from existing academic sources, including books, journal articles, and other scholarly publications. In contrast, an academic research paper aims to present new knowledge, contribute to the academic discourse, and advance the understanding of a specific research question. Therefore, it involves a mix of existing literature (in the introduction and literature review sections) and original data or findings obtained through research methods. 

Literature reviews are essential components of academic and research papers, and various strategies can be employed to conduct them effectively. If you want to know how to write a literature review for a research paper, here are four common approaches that are often used by researchers.  Chronological Review: This strategy involves organizing the literature based on the chronological order of publication. It helps to trace the development of a topic over time, showing how ideas, theories, and research have evolved.  Thematic Review: Thematic reviews focus on identifying and analyzing themes or topics that cut across different studies. Instead of organizing the literature chronologically, it is grouped by key themes or concepts, allowing for a comprehensive exploration of various aspects of the topic.  Methodological Review: This strategy involves organizing the literature based on the research methods employed in different studies. It helps to highlight the strengths and weaknesses of various methodologies and allows the reader to evaluate the reliability and validity of the research findings.  Theoretical Review: A theoretical review examines the literature based on the theoretical frameworks used in different studies. This approach helps to identify the key theories that have been applied to the topic and assess their contributions to the understanding of the subject.  It’s important to note that these strategies are not mutually exclusive, and a literature review may combine elements of more than one approach. The choice of strategy depends on the research question, the nature of the literature available, and the goals of the review. Additionally, other strategies, such as integrative reviews or systematic reviews, may be employed depending on the specific requirements of the research.

The literature review format can vary depending on the specific publication guidelines. However, there are some common elements and structures that are often followed. Here is a general guideline for the format of a literature review:  Introduction:   Provide an overview of the topic.  Define the scope and purpose of the literature review.  State the research question or objective.  Body:   Organize the literature by themes, concepts, or chronology.  Critically analyze and evaluate each source.  Discuss the strengths and weaknesses of the studies.  Highlight any methodological limitations or biases.  Identify patterns, connections, or contradictions in the existing research.  Conclusion:   Summarize the key points discussed in the literature review.  Highlight the research gap.  Address the research question or objective stated in the introduction.  Highlight the contributions of the review and suggest directions for future research.

Both annotated bibliographies and literature reviews involve the examination of scholarly sources. While annotated bibliographies focus on individual sources with brief annotations, literature reviews provide a more in-depth, integrated, and comprehensive analysis of existing literature on a specific topic. The key differences are as follows: 

References 

• Denney, A. S., & Tewksbury, R. (2013). How to write a literature review.  Journal of criminal justice education ,  24 (2), 218-234. 
• Pan, M. L. (2016).  Preparing literature reviews: Qualitative and quantitative approaches . Taylor & Francis. 
• Cantero, C. (2019). How to write a literature review.  San José State University Writing Center . 

Paperpal is an AI writing assistant that help academics write better, faster with real-time suggestions for in-depth language and grammar correction. Trained on millions of research manuscripts enhanced by professional academic editors, Paperpal delivers human precision at machine speed.  

Try it for free or upgrade to  Paperpal Prime , which unlocks unlimited access to premium features like academic translation, paraphrasing, contextual synonyms, consistency checks and more. It’s like always having a professional academic editor by your side! Go beyond limitations and experience the future of academic writing.  Get Paperpal Prime now at just US$19 a month!

Related Reads:

• Empirical Research: A Comprehensive Guide for Academics 
• How to Write a Scientific Paper in 10 Steps 
• How Long Should a Chapter Be?
• How to Use Paperpal to Generate Emails & Cover Letters?

6 Tips for Post-Doc Researchers to Take Their Career to the Next Level

Self-plagiarism in research: what it is and how to avoid it, you may also like, mla works cited page: format, template & examples, how to ace grant writing for research funding..., powerful academic phrases to improve your essay writing , how to write a high-quality conference paper, how paperpal’s research feature helps you develop and..., how paperpal is enhancing academic productivity and accelerating..., how to write a successful book chapter for..., academic editing: how to self-edit academic text with..., 4 ways paperpal encourages responsible writing with ai, what are scholarly sources and where can you....

Purdue Online Writing Lab Purdue OWL® College of Liberal Arts

Writing a Literature Review

Welcome to the Purdue OWL

This page is brought to you by the OWL at Purdue University. When printing this page, you must include the entire legal notice.

Copyright ©1995-2018 by The Writing Lab & The OWL at Purdue and Purdue University. All rights reserved. This material may not be published, reproduced, broadcast, rewritten, or redistributed without permission. Use of this site constitutes acceptance of our terms and conditions of fair use.

A literature review is a document or section of a document that collects key sources on a topic and discusses those sources in conversation with each other (also called synthesis ). The lit review is an important genre in many disciplines, not just literature (i.e., the study of works of literature such as novels and plays). When we say “literature review” or refer to “the literature,” we are talking about the research ( scholarship ) in a given field. You will often see the terms “the research,” “the scholarship,” and “the literature” used mostly interchangeably.

Where, when, and why would I write a lit review?

There are a number of different situations where you might write a literature review, each with slightly different expectations; different disciplines, too, have field-specific expectations for what a literature review is and does. For instance, in the humanities, authors might include more overt argumentation and interpretation of source material in their literature reviews, whereas in the sciences, authors are more likely to report study designs and results in their literature reviews; these differences reflect these disciplines’ purposes and conventions in scholarship. You should always look at examples from your own discipline and talk to professors or mentors in your field to be sure you understand your discipline’s conventions, for literature reviews as well as for any other genre.

A literature review can be a part of a research paper or scholarly article, usually falling after the introduction and before the research methods sections. In these cases, the lit review just needs to cover scholarship that is important to the issue you are writing about; sometimes it will also cover key sources that informed your research methodology.

Lit reviews can also be standalone pieces, either as assignments in a class or as publications. In a class, a lit review may be assigned to help students familiarize themselves with a topic and with scholarship in their field, get an idea of the other researchers working on the topic they’re interested in, find gaps in existing research in order to propose new projects, and/or develop a theoretical framework and methodology for later research. As a publication, a lit review usually is meant to help make other scholars’ lives easier by collecting and summarizing, synthesizing, and analyzing existing research on a topic. This can be especially helpful for students or scholars getting into a new research area, or for directing an entire community of scholars toward questions that have not yet been answered.

What are the parts of a lit review?

Most lit reviews use a basic introduction-body-conclusion structure; if your lit review is part of a larger paper, the introduction and conclusion pieces may be just a few sentences while you focus most of your attention on the body. If your lit review is a standalone piece, the introduction and conclusion take up more space and give you a place to discuss your goals, research methods, and conclusions separately from where you discuss the literature itself.

Introduction:

• An introductory paragraph that explains what your working topic and thesis is
• A forecast of key topics or texts that will appear in the review
• Potentially, a description of how you found sources and how you analyzed them for inclusion and discussion in the review (more often found in published, standalone literature reviews than in lit review sections in an article or research paper)
• Summarize and synthesize: Give an overview of the main points of each source and combine them into a coherent whole
• Analyze and interpret: Don’t just paraphrase other researchers – add your own interpretations where possible, discussing the significance of findings in relation to the literature as a whole
• Critically Evaluate: Mention the strengths and weaknesses of your sources
• Write in well-structured paragraphs: Use transition words and topic sentence to draw connections, comparisons, and contrasts.

Conclusion:

• Summarize the key findings you have taken from the literature and emphasize their significance
• Connect it back to your primary research question

How should I organize my lit review?

Lit reviews can take many different organizational patterns depending on what you are trying to accomplish with the review. Here are some examples:

• Chronological : The simplest approach is to trace the development of the topic over time, which helps familiarize the audience with the topic (for instance if you are introducing something that is not commonly known in your field). If you choose this strategy, be careful to avoid simply listing and summarizing sources in order. Try to analyze the patterns, turning points, and key debates that have shaped the direction of the field. Give your interpretation of how and why certain developments occurred (as mentioned previously, this may not be appropriate in your discipline — check with a teacher or mentor if you’re unsure).
• Thematic : If you have found some recurring central themes that you will continue working with throughout your piece, you can organize your literature review into subsections that address different aspects of the topic. For example, if you are reviewing literature about women and religion, key themes can include the role of women in churches and the religious attitude towards women.
• Qualitative versus quantitative research
• Empirical versus theoretical scholarship
• Divide the research by sociological, historical, or cultural sources
• Theoretical : In many humanities articles, the literature review is the foundation for the theoretical framework. You can use it to discuss various theories, models, and definitions of key concepts. You can argue for the relevance of a specific theoretical approach or combine various theorical concepts to create a framework for your research.

What are some strategies or tips I can use while writing my lit review?

Any lit review is only as good as the research it discusses; make sure your sources are well-chosen and your research is thorough. Don’t be afraid to do more research if you discover a new thread as you’re writing. More info on the research process is available in our "Conducting Research" resources .

As you’re doing your research, create an annotated bibliography ( see our page on the this type of document ). Much of the information used in an annotated bibliography can be used also in a literature review, so you’ll be not only partially drafting your lit review as you research, but also developing your sense of the larger conversation going on among scholars, professionals, and any other stakeholders in your topic.

Usually you will need to synthesize research rather than just summarizing it. This means drawing connections between sources to create a picture of the scholarly conversation on a topic over time. Many student writers struggle to synthesize because they feel they don’t have anything to add to the scholars they are citing; here are some strategies to help you:

• It often helps to remember that the point of these kinds of syntheses is to show your readers how you understand your research, to help them read the rest of your paper.
• Writing teachers often say synthesis is like hosting a dinner party: imagine all your sources are together in a room, discussing your topic. What are they saying to each other?
• Look at the in-text citations in each paragraph. Are you citing just one source for each paragraph? This usually indicates summary only. When you have multiple sources cited in a paragraph, you are more likely to be synthesizing them (not always, but often
• Read more about synthesis here.

The most interesting literature reviews are often written as arguments (again, as mentioned at the beginning of the page, this is discipline-specific and doesn’t work for all situations). Often, the literature review is where you can establish your research as filling a particular gap or as relevant in a particular way. You have some chance to do this in your introduction in an article, but the literature review section gives a more extended opportunity to establish the conversation in the way you would like your readers to see it. You can choose the intellectual lineage you would like to be part of and whose definitions matter most to your thinking (mostly humanities-specific, but this goes for sciences as well). In addressing these points, you argue for your place in the conversation, which tends to make the lit review more compelling than a simple reporting of other sources.

Chaos to Clarity: Structuring Your Literature Review Format

Master literature review format! Learn key sections, effective citation & analysis tips to write a strong academic review.

Ever wondered how to dive into a mountain of books and articles and come up with something that not just makes sense but shines new light on a topic? What if there was a way to neatly tie together all that information, spot what’s missing, and maybe even pave the way for discoveries? 

That’s what you are going to learn in this article, literature reviews—a place where chaos meets order, and where your insights could set the stage for the next big thing. Let’s break down the literature review format , your essential guide to properly writing a literature review.

Dissecting Literature Review Format 

There are 6 main sections to make a note of while writing a literature review. Those are:

The Introduction Section

Topic background, conceptual framework.

• Synthesis and Evaluation in Literature Reviews
• Conclusion for Your Literature Review
• Reference List in Your Literature Review

Also Read: Essential Components of a Literature Review

The introduction of your literature review is where you set the stage for the entire document. It’s your first opportunity to engage your readers and provide a clear blueprint of what your review will cover and why it matters. This section does more than merely introduce the topic; it establishes the context, defines the scope, and outlines the purpose and objectives of your literature review.

Things to keep in mind while writing an introduction:

• Craft a compelling opening
• Establish the Context and Justification
• Define the Scope and Objectives
• Lay out the Structure
• Give an overview of the Structure

The “Topic Background” section of a literature review serves as the cornerstone for understanding the evolution and current state of the subject matter. It is divided into two crucial sub-sections: Historical Context and Current State of the Topic . 

Delving into these areas provides you with a comprehensive backdrop against which the literature review is framed, enriching the reader’s understanding of why the topic is of interest and what has influenced its development to the current state.

Historical Context

The Historical Context is fundamental in setting the stage for the entire literature review. This section is not just a chronology of events or developments; it’s a curated narrative that highlights the key milestones and turning points that have significantly impacted the topic. 

By examining the historical evolution, the review establishes a timeline of how understanding and perspectives have shifted over the years.

Summary Of Key Historical Developments

This involves identifying and summarizing the major breakthroughs, shifts in thinking, or seminal works that have shaped the topic. It’s important to focus on developments that have a direct relevance to the current understanding and state of the subject. For example, if the topic is about the evolution of renewable energy technologies, this part would outline the initial discovery and use of renewable sources, significant technological innovations, and pivotal policy decisions that have influenced the field.

Relevance Of Historical Context To The Topic

After outlining the key historical developments, it’s crucial to connect these events to the present topic. This means discussing how past events have laid the groundwork for current theories, practices, or debates within the field. It involves analyzing the impact of historical milestones on the subject matter, and explaining how they have contributed to current knowledge, challenges, and research questions. This section makes it clear why understanding history is essential for anyone researching or studying the topic today.

Current State Of The Topic

Moving from the historical context, the review transitions to the present with the Current State of the Topic. This part assesses the latest research, trends, debates, and technological advancements that define the subject area at the moment.

Current Trends Or Updates

Here, the focus shifts to what is happening in the field right now. This could include recent research findings, emerging theories, new methodologies, or the latest technological innovations. The aim is to provide a snapshot of the current research landscape, identifying what themes, questions, or problems are being actively explored. For instance, in the context of digital marketing, this might involve discussing the rise of artificial intelligence in customer relationship management or the impact of social media trends on marketing strategies.

Impact Of These Trends On The Subject Matter

The final step is to assess the implications of these current trends for the topic. This includes considering how recent developments have advanced the field, the challenges they present, and the opportunities they open up for future research. It’s about connecting the dots between what’s happening now and what it means for the subject area moving forward. This not only helps to frame the research questions that the literature review will address but also sets the stage for identifying gaps in the current knowledge, thereby guiding the direction of future studies.

Also Read: What is a literature review? Get the concept and start using it

When doing a literature review, it’s essential to lay a solid foundation for your exploration through a well-defined conceptual framework. This framework acts as a compass, guiding your review’s direction by establishing the key concepts, theories, and perspectives that underpin your topic. 

Definitions And Descriptions

Before diving into the depths of your literature review, it’s crucial to start with the basics. This means clearly identifying and defining the key concepts related to your topic. Think of this as setting the stage for your readers, ensuring they have a clear understanding of the fundamental terms and ideas you will be exploring.

Key Concepts Related To The Topic

Begin by listing the essential concepts central to your review. These are the building blocks of your topic, the terms that will repeatedly appear throughout your exploration. 

Detailed Definitions And Their Relevance

Once you’ve identified these concepts, provide precise and comprehensive definitions for each. Don’t hesitate to explore different dimensions or interpretations of these terms, as this can enrich your readers’ understanding. More importantly, discuss why these concepts are crucial to your review. How do they shape the scope of your exploration? How do they relate to each other and to the broader topic? This step ensures that your readers are not just familiar with the terms but also understand their significance within your review’s context.

Theoretical Perspectives

With the key concepts clearly defined, it’s time to frame your literature review within relevant theoretical perspectives. This is where you align your exploration with existing theories, models, or frameworks that provide insights into your topic.

Important Theories Related To The Topic

Identify the theories that are foundational to your topic. These could range from well-established theories that have long guided research in your field to more contemporary models that offer new insights. For example, a review of organizational behavior might draw on theories of motivation, leadership styles, and organizational culture.

Evaluation Of These Theories And Their Influence On The Topic

After pinpointing the relevant theories, critically assess their contributions to the topic. Consider questions like: How have these theories shaped understanding of the topic? What insights do they offer, and where do they fall short? Are there controversies or debates surrounding these theories? This evaluation not only deepens your review’s analytical depth but also positions your work within the larger academic conversation.

Synthesis And Evaluation In Literature Reviews

The “Synthesis and Evaluation” section is where your literature review truly comes to life. Here, you’re not just summarizing what others have said; you’re weaving together diverse strands of research to present a cohesive picture of the topic at hand.

Comparison And Contrast Of Sources

Synthesizing the literature involves more than listing findings from various studies; it’s about drawing connections between them, highlighting areas of agreement and dispute, and weaving these into a narrative that adds depth and breadth to your understanding of the topic.

Comparative Analysis

Start by grouping your sources based on similarities in their findings, methodologies, or theoretical approaches. This clustering will help you identify trends and common themes across the literature. For example, if several studies have found similar outcomes under comparable conditions, these findings can be grouped to strengthen a particular argument or observation about the topic.

Contrasts Or Conflicts Among Sources

Equally important is the identification of discrepancies in the literature. Do some studies present findings that directly contradict others? Are there differences in how researchers have interpreted similar data? Highlighting these conflicts is crucial, as it can indicate areas where the topic is still evolving or where further research is needed. It also shows your ability to critically engage with the material, a hallmark of scholarly rigor.

Analysis Of Gaps In Literature

One of your primary tasks in the synthesis and evaluation section is to identify what’s missing in the current body of research. This requires a critical eye and a deep understanding of both your topic and the broader field in which it resides.

Identification Of Research Gaps

As you comb through the literature, ask yourself: What questions remain unanswered? Are there underexplored areas or populations? Perhaps certain methodologies have been overlooked, or theoretical perspectives have not been considered. Pinpointing these gaps is not a mere exercise in academic critique; it’s a vital step in advancing knowledge within the field.

Implications Of These Gaps For Future Research

Highlighting gaps in the literature sets the stage for future studies. It’s where you, as the reviewer, can suggest new research directions that could fill these voids or further explore the topic. Discussing the implications of these gaps not only enriches your review but also contributes to the ongoing scholarly conversation. 

Conclusion For Your Literature Review

The conclusion of your literature review is where you bring together all the strands of your argument, synthesizing the insights gained and highlighting the significance of your findings. It’s not just a summary of what has been discussed; it’s an opportunity to underscore the relevance of the review, reflect on the broader implications of your synthesis and evaluation, and suggest directions for future research. 

Summary Of Key Points

Start your conclusion by succinctly summarizing the main points and findings of your review. This isn’t about rehashing every detail but rather about distilling the essence of your exploration. Highlight the critical trends, themes, and conflicts you’ve uncovered, and remind your readers of the significance of these discoveries.

Relevance And Implications Of The Literature For The Topic

Next, focus on the relevance and implications of your findings. This involves stepping back to consider the bigger picture—how does your literature review contribute to the understanding of your topic? Discuss the impact of the trends and gaps you’ve identified on the field, and elaborate on how your synthesis of the literature advances or enriches existing knowledge.

Reflection On The Research Process

Reflecting on the research process itself can provide valuable insights. Consider discussing the challenges you encountered in navigating the literature, such as dealing with conflicting findings or the scarcity of research on certain aspects of your topic. 

Directions For Future Research

One of the most critical aspects of your conclusion is to suggest directions for future research. Be as precise as possible, whether suggesting new methodologies, theoretical frameworks, or specific topics that warrant deeper investigation.

Final Thoughts

End your conclusion with a strong closing statement that reiterates the value of your literature review. Emphasize the importance of continued research on your topic and the potential it holds for advanced understanding within your field. A compelling conclusion reaffirms the significance of your work, leaving your readers with a clear sense of its contribution and the urgent need for further exploration.

Reference List In Your Literature Review

The Reference List is the backbone of your literature review, providing a comprehensive compilation of all the sources you’ve cited throughout your exploration. It’s not merely a formality but a crucial component that lends credibility and rigor to your work.

Importance Of Accuracy And Consistency

The cornerstone of a reliable Reference List is accuracy and consistency in citation style. Whether you’re adhering to APA , MLA , Chicago , or another academic citation format, it’s vital to apply the rules with precision. This includes correctly formatting author names, publication dates, titles, and publication details. 

Organizing Your References

While different citation styles have their own rules for listing references, organizing them in a way that enhances readability and accessibility is universally beneficial. Alphabetical order by the author’s last name is the most common method, as it allows readers to easily locate sources.

Comprehensive Coverage

Your Reference List should be exhaustive, including every work you’ve cited in your review. This extends beyond journal articles and books to encompass reports, conference papers, online resources, and any other materials that have informed your analysis.

The Value Of Annotations

While not always required, providing brief annotations for key sources can add tremendous value to your Reference List. An annotated bibliography offers a succinct summary of each source’s main arguments, methodologies, and findings, as well as its relevance to your literature review.

Digital Accessibility

In today’s digital age, considering the accessibility of your referenced works can greatly enhance the utility of your Reference List. Whenever possible, include Digital Object Identifiers (DOIs) or stable URLs for online sources, ensuring readers can directly access the materials. 

Also read: What Is A DOI? Exploring The Purpose And Importance

Reflecting On Ethical Scholarship

Finally, your Reference List is a reflection of ethical scholarship. By accurately citing all the sources that have informed your work, you’re honoring the intellectual property of other researchers and upholding the academic community’s standards of integrity and respect. 

Crafting a meticulous Reference List is an essential aspect of your literature review that underscores the credibility, depth, and ethical foundation of your research. By adhering to the principles of accuracy, comprehensiveness, and accessibility, you not only facilitate further inquiry but also pay homage to the collective endeavor of knowledge advancement in your field.

Related Article: Navigating the AMA Citation Format: Best Tips for Referencing

In conclusion, writing a literature review involves meticulous structuring, beginning with an engaging introduction that sets the stage, followed by a detailed exploration of the topic’s background, including its historical context and current state. 

A robust conceptual framework lays the groundwork for analysis, leading to a critical synthesis and evaluation of relevant literature. 

The conclusion ties together the review’s key findings and implications, while the reference list meticulously catalogs all cited works. Mastering each section ensures a comprehensive and insightful review, essential for advancing academic understanding and contributing to scholarly discussions.

Related Article: Preliminary Literature Review: A Guide for Effective Research

Science Figures, Graphical Abstracts, And Infographics For Your Research

Revolutionize your research with infographics from Mind the Graph . From science figures, graphical abstracts to infographics, you can unleash the power of creative visuals with this user-friendly platform and make your research captivating. 

Subscribe to our newsletter

Exclusive high quality content about effective visual communication in science.

Unlock Your Creativity

Create infographics, presentations and other scientifically-accurate designs without hassle — absolutely free for 7 days!

About Sowjanya Pedada

Sowjanya is a passionate writer and an avid reader. She holds MBA in Agribusiness Management and now is working as a content writer. She loves to play with words and hopes to make a difference in the world through her writings. Apart from writing, she is interested in reading fiction novels and doing craftwork. She also loves to travel and explore different cuisines and spend time with her family and friends.

Content tags

• USC Libraries
• Research Guides

Organizing Your Social Sciences Research Paper

• 5. The Literature Review
• Purpose of Guide
• Design Flaws to Avoid
• Independent and Dependent Variables
• Glossary of Research Terms
• Reading Research Effectively
• Narrowing a Topic Idea
• Broadening a Topic Idea
• Extending the Timeliness of a Topic Idea
• Academic Writing Style
• Applying Critical Thinking
• Choosing a Title
• Making an Outline
• Paragraph Development
• Research Process Video Series
• Executive Summary
• The C.A.R.S. Model
• Background Information
• The Research Problem/Question
• Theoretical Framework
• Citation Tracking
• Content Alert Services
• Evaluating Sources
• Primary Sources
• Secondary Sources
• Tiertiary Sources
• Scholarly vs. Popular Publications
• Qualitative Methods
• Quantitative Methods
• Insiderness
• Using Non-Textual Elements
• Limitations of the Study
• Common Grammar Mistakes
• Writing Concisely
• Avoiding Plagiarism
• Footnotes or Endnotes?
• Further Readings
• Generative AI and Writing
• USC Libraries Tutorials and Other Guides
• Bibliography

A literature review surveys prior research published in books, scholarly articles, and any other sources relevant to a particular issue, area of research, or theory, and by so doing, provides a description, summary, and critical evaluation of these works in relation to the research problem being investigated. Literature reviews are designed to provide an overview of sources you have used in researching a particular topic and to demonstrate to your readers how your research fits within existing scholarship about the topic.

Fink, Arlene. Conducting Research Literature Reviews: From the Internet to Paper . Fourth edition. Thousand Oaks, CA: SAGE, 2014.

Importance of a Good Literature Review

A literature review may consist of simply a summary of key sources, but in the social sciences, a literature review usually has an organizational pattern and combines both summary and synthesis, often within specific conceptual categories . A summary is a recap of the important information of the source, but a synthesis is a re-organization, or a reshuffling, of that information in a way that informs how you are planning to investigate a research problem. The analytical features of a literature review might:

• Give a new interpretation of old material or combine new with old interpretations,
• Trace the intellectual progression of the field, including major debates,
• Depending on the situation, evaluate the sources and advise the reader on the most pertinent or relevant research, or
• Usually in the conclusion of a literature review, identify where gaps exist in how a problem has been researched to date.

Given this, the purpose of a literature review is to:

• Place each work in the context of its contribution to understanding the research problem being studied.
• Describe the relationship of each work to the others under consideration.
• Identify new ways to interpret prior research.
• Reveal any gaps that exist in the literature.
• Resolve conflicts amongst seemingly contradictory previous studies.
• Identify areas of prior scholarship to prevent duplication of effort.
• Point the way in fulfilling a need for additional research.
• Locate your own research within the context of existing literature [very important].

Fink, Arlene. Conducting Research Literature Reviews: From the Internet to Paper. 2nd ed. Thousand Oaks, CA: Sage, 2005; Hart, Chris. Doing a Literature Review: Releasing the Social Science Research Imagination . Thousand Oaks, CA: Sage Publications, 1998; Jesson, Jill. Doing Your Literature Review: Traditional and Systematic Techniques . Los Angeles, CA: SAGE, 2011; Knopf, Jeffrey W. "Doing a Literature Review." PS: Political Science and Politics 39 (January 2006): 127-132; Ridley, Diana. The Literature Review: A Step-by-Step Guide for Students . 2nd ed. Los Angeles, CA: SAGE, 2012.

Types of Literature Reviews

It is important to think of knowledge in a given field as consisting of three layers. First, there are the primary studies that researchers conduct and publish. Second are the reviews of those studies that summarize and offer new interpretations built from and often extending beyond the primary studies. Third, there are the perceptions, conclusions, opinion, and interpretations that are shared informally among scholars that become part of the body of epistemological traditions within the field.

In composing a literature review, it is important to note that it is often this third layer of knowledge that is cited as "true" even though it often has only a loose relationship to the primary studies and secondary literature reviews. Given this, while literature reviews are designed to provide an overview and synthesis of pertinent sources you have explored, there are a number of approaches you could adopt depending upon the type of analysis underpinning your study.

Argumentative Review This form examines literature selectively in order to support or refute an argument, deeply embedded assumption, or philosophical problem already established in the literature. The purpose is to develop a body of literature that establishes a contrarian viewpoint. Given the value-laden nature of some social science research [e.g., educational reform; immigration control], argumentative approaches to analyzing the literature can be a legitimate and important form of discourse. However, note that they can also introduce problems of bias when they are used to make summary claims of the sort found in systematic reviews [see below].

Integrative Review Considered a form of research that reviews, critiques, and synthesizes representative literature on a topic in an integrated way such that new frameworks and perspectives on the topic are generated. The body of literature includes all studies that address related or identical hypotheses or research problems. A well-done integrative review meets the same standards as primary research in regard to clarity, rigor, and replication. This is the most common form of review in the social sciences.

Historical Review Few things rest in isolation from historical precedent. Historical literature reviews focus on examining research throughout a period of time, often starting with the first time an issue, concept, theory, phenomena emerged in the literature, then tracing its evolution within the scholarship of a discipline. The purpose is to place research in a historical context to show familiarity with state-of-the-art developments and to identify the likely directions for future research.

Methodological Review A review does not always focus on what someone said [findings], but how they came about saying what they say [method of analysis]. Reviewing methods of analysis provides a framework of understanding at different levels [i.e. those of theory, substantive fields, research approaches, and data collection and analysis techniques], how researchers draw upon a wide variety of knowledge ranging from the conceptual level to practical documents for use in fieldwork in the areas of ontological and epistemological consideration, quantitative and qualitative integration, sampling, interviewing, data collection, and data analysis. This approach helps highlight ethical issues which you should be aware of and consider as you go through your own study.

Systematic Review This form consists of an overview of existing evidence pertinent to a clearly formulated research question, which uses pre-specified and standardized methods to identify and critically appraise relevant research, and to collect, report, and analyze data from the studies that are included in the review. The goal is to deliberately document, critically evaluate, and summarize scientifically all of the research about a clearly defined research problem . Typically it focuses on a very specific empirical question, often posed in a cause-and-effect form, such as "To what extent does A contribute to B?" This type of literature review is primarily applied to examining prior research studies in clinical medicine and allied health fields, but it is increasingly being used in the social sciences.

Theoretical Review The purpose of this form is to examine the corpus of theory that has accumulated in regard to an issue, concept, theory, phenomena. The theoretical literature review helps to establish what theories already exist, the relationships between them, to what degree the existing theories have been investigated, and to develop new hypotheses to be tested. Often this form is used to help establish a lack of appropriate theories or reveal that current theories are inadequate for explaining new or emerging research problems. The unit of analysis can focus on a theoretical concept or a whole theory or framework.

NOTE: Most often the literature review will incorporate some combination of types. For example, a review that examines literature supporting or refuting an argument, assumption, or philosophical problem related to the research problem will also need to include writing supported by sources that establish the history of these arguments in the literature.

Baumeister, Roy F. and Mark R. Leary. "Writing Narrative Literature Reviews."  Review of General Psychology 1 (September 1997): 311-320; Mark R. Fink, Arlene. Conducting Research Literature Reviews: From the Internet to Paper . 2nd ed. Thousand Oaks, CA: Sage, 2005; Hart, Chris. Doing a Literature Review: Releasing the Social Science Research Imagination . Thousand Oaks, CA: Sage Publications, 1998; Kennedy, Mary M. "Defining a Literature." Educational Researcher 36 (April 2007): 139-147; Petticrew, Mark and Helen Roberts. Systematic Reviews in the Social Sciences: A Practical Guide . Malden, MA: Blackwell Publishers, 2006; Torracro, Richard. "Writing Integrative Literature Reviews: Guidelines and Examples." Human Resource Development Review 4 (September 2005): 356-367; Rocco, Tonette S. and Maria S. Plakhotnik. "Literature Reviews, Conceptual Frameworks, and Theoretical Frameworks: Terms, Functions, and Distinctions." Human Ressource Development Review 8 (March 2008): 120-130; Sutton, Anthea. Systematic Approaches to a Successful Literature Review . Los Angeles, CA: Sage Publications, 2016.

Structure and Writing Style

I.  Thinking About Your Literature Review

The structure of a literature review should include the following in support of understanding the research problem :

• An overview of the subject, issue, or theory under consideration, along with the objectives of the literature review,
• Division of works under review into themes or categories [e.g. works that support a particular position, those against, and those offering alternative approaches entirely],
• An explanation of how each work is similar to and how it varies from the others,
• Conclusions as to which pieces are best considered in their argument, are most convincing of their opinions, and make the greatest contribution to the understanding and development of their area of research.

The critical evaluation of each work should consider :

• Provenance -- what are the author's credentials? Are the author's arguments supported by evidence [e.g. primary historical material, case studies, narratives, statistics, recent scientific findings]?
• Methodology -- were the techniques used to identify, gather, and analyze the data appropriate to addressing the research problem? Was the sample size appropriate? Were the results effectively interpreted and reported?
• Objectivity -- is the author's perspective even-handed or prejudicial? Is contrary data considered or is certain pertinent information ignored to prove the author's point?
• Persuasiveness -- which of the author's theses are most convincing or least convincing?
• Validity -- are the author's arguments and conclusions convincing? Does the work ultimately contribute in any significant way to an understanding of the subject?

II.  Development of the Literature Review

Four Basic Stages of Writing 1.  Problem formulation -- which topic or field is being examined and what are its component issues? 2.  Literature search -- finding materials relevant to the subject being explored. 3.  Data evaluation -- determining which literature makes a significant contribution to the understanding of the topic. 4.  Analysis and interpretation -- discussing the findings and conclusions of pertinent literature.

Consider the following issues before writing the literature review: Clarify If your assignment is not specific about what form your literature review should take, seek clarification from your professor by asking these questions: 1.  Roughly how many sources would be appropriate to include? 2.  What types of sources should I review (books, journal articles, websites; scholarly versus popular sources)? 3.  Should I summarize, synthesize, or critique sources by discussing a common theme or issue? 4.  Should I evaluate the sources in any way beyond evaluating how they relate to understanding the research problem? 5.  Should I provide subheadings and other background information, such as definitions and/or a history? Find Models Use the exercise of reviewing the literature to examine how authors in your discipline or area of interest have composed their literature review sections. Read them to get a sense of the types of themes you might want to look for in your own research or to identify ways to organize your final review. The bibliography or reference section of sources you've already read, such as required readings in the course syllabus, are also excellent entry points into your own research. Narrow the Topic The narrower your topic, the easier it will be to limit the number of sources you need to read in order to obtain a good survey of relevant resources. Your professor will probably not expect you to read everything that's available about the topic, but you'll make the act of reviewing easier if you first limit scope of the research problem. A good strategy is to begin by searching the USC Libraries Catalog for recent books about the topic and review the table of contents for chapters that focuses on specific issues. You can also review the indexes of books to find references to specific issues that can serve as the focus of your research. For example, a book surveying the history of the Israeli-Palestinian conflict may include a chapter on the role Egypt has played in mediating the conflict, or look in the index for the pages where Egypt is mentioned in the text. Consider Whether Your Sources are Current Some disciplines require that you use information that is as current as possible. This is particularly true in disciplines in medicine and the sciences where research conducted becomes obsolete very quickly as new discoveries are made. However, when writing a review in the social sciences, a survey of the history of the literature may be required. In other words, a complete understanding the research problem requires you to deliberately examine how knowledge and perspectives have changed over time. Sort through other current bibliographies or literature reviews in the field to get a sense of what your discipline expects. You can also use this method to explore what is considered by scholars to be a "hot topic" and what is not.

III.  Ways to Organize Your Literature Review

Chronology of Events If your review follows the chronological method, you could write about the materials according to when they were published. This approach should only be followed if a clear path of research building on previous research can be identified and that these trends follow a clear chronological order of development. For example, a literature review that focuses on continuing research about the emergence of German economic power after the fall of the Soviet Union. By Publication Order your sources by publication chronology, then, only if the order demonstrates a more important trend. For instance, you could order a review of literature on environmental studies of brown fields if the progression revealed, for example, a change in the soil collection practices of the researchers who wrote and/or conducted the studies. Thematic [“conceptual categories”] A thematic literature review is the most common approach to summarizing prior research in the social and behavioral sciences. Thematic reviews are organized around a topic or issue, rather than the progression of time, although the progression of time may still be incorporated into a thematic review. For example, a review of the Internet’s impact on American presidential politics could focus on the development of online political satire. While the study focuses on one topic, the Internet’s impact on American presidential politics, it would still be organized chronologically reflecting technological developments in media. The difference in this example between a "chronological" and a "thematic" approach is what is emphasized the most: themes related to the role of the Internet in presidential politics. Note that more authentic thematic reviews tend to break away from chronological order. A review organized in this manner would shift between time periods within each section according to the point being made. Methodological A methodological approach focuses on the methods utilized by the researcher. For the Internet in American presidential politics project, one methodological approach would be to look at cultural differences between the portrayal of American presidents on American, British, and French websites. Or the review might focus on the fundraising impact of the Internet on a particular political party. A methodological scope will influence either the types of documents in the review or the way in which these documents are discussed.

Other Sections of Your Literature Review Once you've decided on the organizational method for your literature review, the sections you need to include in the paper should be easy to figure out because they arise from your organizational strategy. In other words, a chronological review would have subsections for each vital time period; a thematic review would have subtopics based upon factors that relate to the theme or issue. However, sometimes you may need to add additional sections that are necessary for your study, but do not fit in the organizational strategy of the body. What other sections you include in the body is up to you. However, only include what is necessary for the reader to locate your study within the larger scholarship about the research problem.

Here are examples of other sections, usually in the form of a single paragraph, you may need to include depending on the type of review you write:

• Current Situation : Information necessary to understand the current topic or focus of the literature review.
• Sources Used : Describes the methods and resources [e.g., databases] you used to identify the literature you reviewed.
• History : The chronological progression of the field, the research literature, or an idea that is necessary to understand the literature review, if the body of the literature review is not already a chronology.
• Selection Methods : Criteria you used to select (and perhaps exclude) sources in your literature review. For instance, you might explain that your review includes only peer-reviewed [i.e., scholarly] sources.
• Standards : Description of the way in which you present your information.
• Questions for Further Research : What questions about the field has the review sparked? How will you further your research as a result of the review?

IV.  Writing Your Literature Review

Once you've settled on how to organize your literature review, you're ready to write each section. When writing your review, keep in mind these issues.

Use Evidence A literature review section is, in this sense, just like any other academic research paper. Your interpretation of the available sources must be backed up with evidence [citations] that demonstrates that what you are saying is valid. Be Selective Select only the most important points in each source to highlight in the review. The type of information you choose to mention should relate directly to the research problem, whether it is thematic, methodological, or chronological. Related items that provide additional information, but that are not key to understanding the research problem, can be included in a list of further readings . Use Quotes Sparingly Some short quotes are appropriate if you want to emphasize a point, or if what an author stated cannot be easily paraphrased. Sometimes you may need to quote certain terminology that was coined by the author, is not common knowledge, or taken directly from the study. Do not use extensive quotes as a substitute for using your own words in reviewing the literature. Summarize and Synthesize Remember to summarize and synthesize your sources within each thematic paragraph as well as throughout the review. Recapitulate important features of a research study, but then synthesize it by rephrasing the study's significance and relating it to your own work and the work of others. Keep Your Own Voice While the literature review presents others' ideas, your voice [the writer's] should remain front and center. For example, weave references to other sources into what you are writing but maintain your own voice by starting and ending the paragraph with your own ideas and wording. Use Caution When Paraphrasing When paraphrasing a source that is not your own, be sure to represent the author's information or opinions accurately and in your own words. Even when paraphrasing an author’s work, you still must provide a citation to that work.

V.  Common Mistakes to Avoid

These are the most common mistakes made in reviewing social science research literature.

• Sources in your literature review do not clearly relate to the research problem;
• You do not take sufficient time to define and identify the most relevant sources to use in the literature review related to the research problem;
• Relies exclusively on secondary analytical sources rather than including relevant primary research studies or data;
• Uncritically accepts another researcher's findings and interpretations as valid, rather than examining critically all aspects of the research design and analysis;
• Does not describe the search procedures that were used in identifying the literature to review;
• Reports isolated statistical results rather than synthesizing them in chi-squared or meta-analytic methods; and,
• Only includes research that validates assumptions and does not consider contrary findings and alternative interpretations found in the literature.

Cook, Kathleen E. and Elise Murowchick. “Do Literature Review Skills Transfer from One Course to Another?” Psychology Learning and Teaching 13 (March 2014): 3-11; Fink, Arlene. Conducting Research Literature Reviews: From the Internet to Paper . 2nd ed. Thousand Oaks, CA: Sage, 2005; Hart, Chris. Doing a Literature Review: Releasing the Social Science Research Imagination . Thousand Oaks, CA: Sage Publications, 1998; Jesson, Jill. Doing Your Literature Review: Traditional and Systematic Techniques . London: SAGE, 2011; Literature Review Handout. Online Writing Center. Liberty University; Literature Reviews. The Writing Center. University of North Carolina; Onwuegbuzie, Anthony J. and Rebecca Frels. Seven Steps to a Comprehensive Literature Review: A Multimodal and Cultural Approach . Los Angeles, CA: SAGE, 2016; Ridley, Diana. The Literature Review: A Step-by-Step Guide for Students . 2nd ed. Los Angeles, CA: SAGE, 2012; Randolph, Justus J. “A Guide to Writing the Dissertation Literature Review." Practical Assessment, Research, and Evaluation. vol. 14, June 2009; Sutton, Anthea. Systematic Approaches to a Successful Literature Review . Los Angeles, CA: Sage Publications, 2016; Taylor, Dena. The Literature Review: A Few Tips On Conducting It. University College Writing Centre. University of Toronto; Writing a Literature Review. Academic Skills Centre. University of Canberra.

Writing Tip

Break Out of Your Disciplinary Box!

Thinking interdisciplinarily about a research problem can be a rewarding exercise in applying new ideas, theories, or concepts to an old problem. For example, what might cultural anthropologists say about the continuing conflict in the Middle East? In what ways might geographers view the need for better distribution of social service agencies in large cities than how social workers might study the issue? You don’t want to substitute a thorough review of core research literature in your discipline for studies conducted in other fields of study. However, particularly in the social sciences, thinking about research problems from multiple vectors is a key strategy for finding new solutions to a problem or gaining a new perspective. Consult with a librarian about identifying research databases in other disciplines; almost every field of study has at least one comprehensive database devoted to indexing its research literature.

Frodeman, Robert. The Oxford Handbook of Interdisciplinarity . New York: Oxford University Press, 2010.

Another Writing Tip

Don't Just Review for Content!

While conducting a review of the literature, maximize the time you devote to writing this part of your paper by thinking broadly about what you should be looking for and evaluating. Review not just what scholars are saying, but how are they saying it. Some questions to ask:

• How are they organizing their ideas?
• What methods have they used to study the problem?
• What theories have been used to explain, predict, or understand their research problem?
• What sources have they cited to support their conclusions?
• How have they used non-textual elements [e.g., charts, graphs, figures, etc.] to illustrate key points?

When you begin to write your literature review section, you'll be glad you dug deeper into how the research was designed and constructed because it establishes a means for developing more substantial analysis and interpretation of the research problem.

Hart, Chris. Doing a Literature Review: Releasing the Social Science Research Imagination . Thousand Oaks, CA: Sage Publications, 1 998.

Yet Another Writing Tip

When Do I Know I Can Stop Looking and Move On?

Here are several strategies you can utilize to assess whether you've thoroughly reviewed the literature:

• Look for repeating patterns in the research findings . If the same thing is being said, just by different people, then this likely demonstrates that the research problem has hit a conceptual dead end. At this point consider: Does your study extend current research?  Does it forge a new path? Or, does is merely add more of the same thing being said?
• Look at sources the authors cite to in their work . If you begin to see the same researchers cited again and again, then this is often an indication that no new ideas have been generated to address the research problem.
• Search Google Scholar to identify who has subsequently cited leading scholars already identified in your literature review [see next sub-tab]. This is called citation tracking and there are a number of sources that can help you identify who has cited whom, particularly scholars from outside of your discipline. Here again, if the same authors are being cited again and again, this may indicate no new literature has been written on the topic.

Onwuegbuzie, Anthony J. and Rebecca Frels. Seven Steps to a Comprehensive Literature Review: A Multimodal and Cultural Approach . Los Angeles, CA: Sage, 2016; Sutton, Anthea. Systematic Approaches to a Successful Literature Review . Los Angeles, CA: Sage Publications, 2016.

• << Previous: Theoretical Framework
• Next: Citation Tracking >>
• Last Updated: May 25, 2024 4:09 PM
• URL: https://libguides.usc.edu/writingguide

17 strong academic phrases to write your literature review (+ real examples)

A well-written academic literature review not only builds upon existing knowledge and publications but also involves critical reflection, comparison, contrast, and identifying research gaps. The following 17 strong academic key phrases can assist you in writing a critical and reflective literature review.

Disclosure: This post may contain affiliate links, which means I may earn a small commission if you make a purchase using the links below at no additional cost to you . I only recommend products or services that I truly believe can benefit my audience. As always, my opinions are my own.

Academic key phrases to present existing knowledge in a literature review

Academic key phrases to contrast and compare findings in a literature review, academic key phrases to highlight research gaps in a literature review, the topic has received significant interest within the wider literature..

Example: “ The topic of big data and its integration with AI has received significant interest within the wider literature .” ( Dwivedi et al. 2021, p. 4 )

The topic gained considerable attention in the academic literature in…

Example:  “ The relationship between BITs and FDI gained considerable attention in the academic literature in the last two decades .” ( Amendolagine and Prota, 2021, p. 173 )

Studies have identified…

Example: “ Studies have identified the complexities of implementing AI based systems within government and the public sector .” ( Dwivedi et al. 2021, p. 6 )

Researchers have discussed…

Example: “ Researchers have discussed the ethical dimensions of AI and implications for greater use of the technology. ” ( Dwivedi et al. 2021, p. 6)

Recent work demonstrated that…

Example: “Recent work demonstrated that dune grasses with similar morphological traits can build contrasting landscapes due to differences in their spatial shoot organization.” ( Van de Ven, 2022 et al., p. 1339 )

Existing research frequently attributes…

Example:  “Existing research frequently attributes these challenges to AI’s technical complexity, demand for data, and unpredictable interactions.” ( Yang et al., 2020, p. 174 )

Prior research has hypothesized that…

Example:  “Prior research has hypothesized that racial and ethnic disparities may be mitigated if the patient and provider share the same race due to improved communication and increased trust” ( Otte, 2022, p. 1 )

Prior studies have found that…

Example:  “ Prior studies have found that court-referred individuals are more likely to complete relationship violence intervention programs (RVIP) than self-referred individuals. ” ( Evans et al. 2022, p. 1 )

You may also like: 26 powerful academic phrases to write your introduction (+ real examples)

While some scholars…, others…

Example: “On the sustainable development of microcredit, some scholars emphasize the effect of its poverty alleviation, while some scholars emphasize the factors such as institutional innovation and government support.” ( Huang et al., 2021, p. 2117 )

The findings of Scholar A showcase that… . Scholar B , on the other hand, found…

Example: “ The findings of Arinto (2016) call for administrators concerning the design of faculty development programs, provision of faculty support, and strategic planning for online distance learning implementation across the institution. Francisco and Nuqui (2020) on the other hand found that the new normal leadership is an adaptive one while staying strong on their commitment. ” ( Asio and Bayucca, 2021, p. 20 )

Interestingly, all the arguments refer to…

Example:  “Interestingly, all the arguments above refer to daily role transitions—more specifically: role transitions on teleworking days—as an important explanatory mechanism for both the possible conflict-reducing effect and the potential conflict enhancing effects of telework.”  ( Delanoeije et al., 2019, p. 1845 )

This argument is similar to…

Example: “The third argument against physician involvement in lethal injection is that physicians are prohibited from deliberately harming patients or the argument from nonmaleficence. This argument is similar to the argument from healing but has different implications and must therefore be considered independently.” ( Sawicki, 2022, p. 22 )

If you are looking to elevate your writing and editing skills, I highly recommend enrolling in the course “ Good with Words: Writing and Editing Specialization “, which is a 4 course series offered by the University of Michigan. This comprehensive program is conveniently available as an online course on Coursera, allowing you to learn at your own pace. Plus, upon successful completion, you’ll have the opportunity to earn a valuable certificate to showcase your newfound expertise!

Yet, it remains unknown how…

Example: “Yet, it remains unknown how findings from aeolian landscapes translate to aquatic systems and how young clonally expanding plants in hydrodynamically exposed conditions overcome these establishment thresholds by optimizing shoot placement.” ( Van de Ven, 2022 et al., p. 1339 )

There is, however, still little research on…

Example:  “There is, however, still little research on what integrated STEM approaches require from schools and teachers, and on the potential obstacles that may prevent teachers from running this kind of teaching.”  ( Bungum and Mogstad, 2022, p. 2 )

Existing studies have failed to address…

Example: “ University–industry relations (UIR) are usually analysed by the knowledge transfer channels, but existing studies have failed to address what knowledge content is being transferred – impacting the technology output aimed by the partnership.”  (Dalmarco et al. 2019, p. 1314 )

Several scholars have recommended to move away…

Example: “Several scholars have recommended to move away from such a stable-level approach (i.e. using a global judgment of work-home conflict) to a dynamic episodes approach ” ( Delanoeije et al., 2019, p. 1847 )

New approaches are needed to address…

Example:  “ Accurate computational approaches are needed to address this gap and to enable large-scale structural bioinformatics. ” ( Jumper et al. 2021,p. 583 )

Master Academia

Get new content delivered directly to your inbox.

Subscribe and receive Master Academia's quarterly newsletter.

26 powerful academic phrases to write your introduction (+ real examples)

13 awesome academic phrases to write your methodology (+ real examples), related articles.

Juggling research and teaching obligations

Major revisions: Sample peer review comments and examples

How to paraphrase a quote: 4 simple strategies

Reject decisions: Sample peer review comments and examples

• Blog Profiles
• Why Leicester

Conducting a systematic literature review: reflections and resources

Posted by Kerry Dobbins in Learning Outcomes Project on April 10, 2014

For the past couple of months I have been undertaking a systematic review (of sorts) of the learning outcomes (LOs) literature.  I say ‘of sorts’ because I have followed all but the final few protocols of a systematic review – I have reviewed the extent of certain features within the LOs literature but have not quality assessed studies of LOs (I am being deliberately vague here as I am currently writing up my findings for publication).  I have, therefore, termed the process I’ve been engaged in as a ‘systematically-organised review’.

Falling in love?

My aim here is not to split hairs about terminology but to reflect briefly on the nature of what I’ve been doing.  Not long after I started my review, I came across this blog post titled ‘My first systematic review: How I fell in love’ .  I have to admit, at that point I was not sure whether I liked doing my review, let alone loved it.  But as time went on I got to understand more what Dr Sini Savilaakso was talking about – I had actually started to enjoy the process.  In her blog post Dr Savilaakso explains how she ‘fell in love’ with her first systematic review.  I’d like to add here a couple of points about why I’ve enjoyed the process so much too:

• To some extent there has felt less pressure within this whole process, but at the same time I have felt that I’ve been doing really important work.  Let me explain – I have felt less pressured because I am not trying to create new knowledge, arguments, theories, etc., around the issue of LOs.  I have instead been exploring what has already been ‘put out there’ to make some kind of assessment about the make-up of the LOs literature.  This is really important to do because so much that is incorporated into education does not often have its literature or research base scrutinised.  To understand if an educational approach or strategy has any kind of validity, we should be exploring (and assessing) the body of knowledge surrounding it.  This is why I feel that I have been doing important work, even though I’ve felt at the same time that it’s been a less pressurised process.
• It has helped me to feel more of an ‘expert’ in my chosen area (i.e. learning outcomes) and to talk about it with confidence due to my detailed and in-depth knowledge of the published literature.  Of course, all research should be grounded within thorough literature reviews, but undertaking a specific review in such a rigorous and robust manner (i.e. with specific and recorded search strategies, methodically searching databases etc) means there is less chance that I have gaps in my knowledge by missing important pieces of work.

Useful links

I’d like to add here some links to sites that I’ve found useful, particularly for developing my search parameters and protocols:

– Learning from research: systematic reviews for informing policy decisions: a quick guide

– Template for a Systematic Literature Review Protocol

– Sense about science: systematic reviews

– Social research update: systematic reviewing

– Systematic reviewing in the social sciences

Lessons learned

In her blog post, Dr Savilaakso also offers some useful lessons that she has learned from her experience of systematic reviewing.  I’d like to add a few of my own:

•  Dr Savilaakso says to work with team mates that you love.  I would reinforce this point, but also add the need to work with team mates who have sufficient time to give to the process too.  In my case, I was the lead researcher and conducted the whole review, but for reliability purposes I needed at certain points another particular project member to review samples of the literature retrieved so that we could compare our results.  This colleague was extremely busy with other research projects and found it hard to find the time to do these sample reviews.  Whilst for the most part it did not cause too much of a problem, I did get anxious at certain points that I could not progress with the review until we’d undertaken one of these reliability checks.  Of course, we are all very busy and to some extent this sort of situation might be unavoidable – but it is a point worth bearing in mind, particularly if you want to get your results published as soon as possible.
• Accept that at times it will feel a very tedious process.  As much as I enjoyed it overall, there were many times that all the database searching, reviewing piles of papers, etc, felt very tedious.  When you start feeling like this, my advice is to take some kind of break – go for lunch, get a cuppa, do some other work for a bit.  When I felt like this my mind would want to start rushing through everything to get it finished – but of course the danger then is that you rush by and overlook something important.  Accept that rigorous and robust results are achieved largely by work that often feels tedious and time-consuming.
• Allow time for hard to access papers to be found (either by yourself or by research/library support).  Don’t rush into writing up your results until you’re sure your literature searching is complete and you’ve retrieved all the papers you need.

As my own first review is coming to its end, I still wouldn’t say I’ve fallen in love with the process, but I have been surprised at how much I have enjoyed it – from the feelings of rigorous literature searching to the satisfaction of providing answers to my research questions.  I am currently writing up my review for publication and I hope I can share more information about it with you soon.

In the meantime, happy reviewing!

Posted in Researching LOs , UoL project | Tagged Research reflection | Leave a response

Share this page:

About Kerry Dobbins

Kerry Dobbins is a Professional Development Advisor at the LLI. She works with colleagues to support the development of their teaching and supporting learning activities.

View more posts by Kerry Dobbins

Leave a Reply Click here to cancel reply.

• Research at Leicester
• Jobs at Leicester
• Study with us Find out about our undergraduate and postgraduate courses
• Conferences
• Implementing LOs
• LO literature
• LOs in compulsory ed
• Researching LOs
• UoL project

Arguments against LOs Arguments for LOs Conferences Extending LO concept Government International level LO blogs Measuring LOs Neoliberalism Purposes of HE Reflections on LOs Research reflection Resources/links Scholars' views Student experience Tutor experience Writing LOs

• February 2015
• January 2015
• December 2014
• November 2014
• October 2014
• September 2014
• August 2014

Recent Comments

• Duncan Greenhill on The learning outcomes teachers should set for themselves
• Unravelling the assumptions in learning outcomes – University of Leicester on The ‘Learning Outcomes Project’: update on activities
• Students developing their own learning outcomes – University of Leicester on How do we frame the concept of ‘learning outcomes’ for students?
• Beyond content: learning outcomes and affective skills – University of Leicester. on Seven useful learning outcomes papers
• How do we frame the concept of ‘learning outcomes’ for students? – University of Leicester on The ‘Learning Outcomes Project’: update on activities

Copyright © 2024 Learning Outcomes Project .

Powered by WordPress and /local/www/htdocs/wp-content/themes/staff-blogs-responsive/style.css .

• Follow the University on
• Follow us on Facebook
• Follow us on Twitter
• Follow us on YouTube
• Follow us on Flickr
• Follow us on Linkedin
• Follow us on Google+
• Follow us on SoundCloud
• University Home
• University A-Z
• Contact the University
• Privacy & Cookies

Moderation & Community Guidelines | Give us feedback | Blogger login

Network-wide options by YD - Freelance Wordpress Developer

International Journal of Learning, Teaching and Educational Research

• Announcements
• Editorial Board
• Submit a Paper
• Publication Ethics
• ##PAPER TEMPLATE##
• ##Retraction Policy##

Harnessing the Power of Reflective Journal Writing in Global Contexts: A Systematic Literature Review

This research aimed to describe a critical framework of reflective journal writing that has significant impacts on student writers worldwide and identify the qualities of reflective journal writing that foster transformative practices involving personal, relational, and intellectual activities. This systematic literature review incorporated important theoretical frameworks into acceptable convictions. A thorough analysis of 20 recently published research articles (out of 450) from 2016 to 2021 aimed to present written arguments that support thesis positions and credible evidence, as well as determine the global contexts of writing practices. The findings showed that reflective journal writing reinforced a profound transformation to further explore self-discovery, self-inquiry, and critical ideas. It is also concerned with writing performance, as well as the advancement of cognitive and metacognitive writing skills. Reflective journal writers' voices empowered significant changes in a variety of writing aspects, including personal idea exploration, creativity, self-organization, and professional practice development. These findings have implications for encouraging critical reflection, self-expression, and critical thinking among students. They should write reflective journals that can have an impact on a global community and allow them to bring about transformations.

https://doi.org/10.26803/ijlter.20.12.11

Abednia, A., Hovassapian, A., Teimournezhad, S., & Ghanbari, N. (2013). Reflective journal writing: Exploring in-service EFL teachers’ perceptions. System, 41(3), 503–514. https://doi.org/10.1016/j.system.2013.05.003

Ahmed, A. M. (2019). Students’ reflective journaling: An impactful strategy that informs instructional practices in an EFL writing university context in Qatar. Reflective Practice, 20(4), 483–500. https://doi.org/10.1080/14623943.2019.1638246

Ahmed, A. M. (2020). From reluctance to addiction: The impact of reflective journals on Qatari undergraduate students’ learning. Reflective Practice, 21(2), 251–270. https://doi.org/10.1080/14623943.2020.1735328

Al-karasneh, S. M. (2014). Reflective journal writing as a tool to teach aspects of social studies. European Journal of Education, 49(3), 395–408. https://doi.org/10.1111/ejed.12084

Allan, E. G., & Driscoll, D. L. (2014). The three-fold benefit of reflective writing: Improving program assessment, student learning, and faculty professional development. Assessing Writing, 21, 37–55. https://doi.org/10.1016/j.asw.2014.03.001

Arikan, A. (2006). The value of reflection in writing courses in ELT preservice teacher education programs. Online Submission, 16, 1–16.

Arthur, C., & Arthur, T. S. (2021). Reflective journal writing: Attitudes of pre-service teachers. International Journal of Technology & Management Research, 6(2), 129–138. https://doi.org/https://doi.org/10.47127/ijtmr.v6i2.133

Bailes, C. N., Hulsebosch, P., & Martin, D. S. (2010). Reflective journal writing: Deaf pre-service teachers with hearing children. Teacher Education and Special Education: The Journal of the Teacher Education Division of the Council for Exceptional Children, 33(3), 234–247. https://doi.org/10.1177/0888406409356763

Bain, J. D., Ballantyne, R., Packer, J., & Mills, C. (1999). Using journal writing to enhance student teachers’ reflectivity during field experience placements. Teachers and Teaching, 5(1), 51–73. https://doi.org/10.1080/1354060990050104

Barham, A. I., Mohammad, E. G., & Miqdadi, R. (2019). Reflective journal writing and classroom performance: Improvement and correlation among pre-service mathematics and science teachers. International Journal of Learning, Teaching and Educational Research, 18(11), 348–369. https://doi.org/10.26803/ijlter.18.11.21

Barrot, J. S. (2020). Effects of Facebook-based e-portfolio on ESL learners’ writing performance. Language, Culture and Curriculum, 1–17. https://doi.org/10.1080/07908318.2020.1745822

Bashan, B., & Holsblat, R. (2017). Reflective journals as a research tool: The case of student teachers’ development of teamwork. Cogent Education, 4(1). https://doi.org/10.1080/2331186X.2017.1374234

Black, A. L. (2019). Digesting a life: Embodying transformation through creative writing. New Writing, 16(1), 50–58. https://doi.org/10.1080/14790726.2018.1490774

Boud, D. (2001). Using journal writing to enhance reflective practice. New Directions for Adult and Continuing Education, 2001(90), 9. https://doi.org/10.1002/ace.16

Brandenburg, R., & Jones, M. (2017). Toward transformative reflective practice in teacher education . https://doi.org/10.1007/978-981-10-3431-2_14

Brennan, C. (2018). Digital humanities, digital methods, digital history, and digital outputs: History writing and the digital revolution. History Compass, 16(10), e12492. https://doi.org/10.1111/hic3.12492

Bruno, A., & Dell’Aversana, G. (2017). Reflective practice for psychology students: The use of reflective journal feedback in higher education. Psychology Learning & Teaching, 16(2), 248–260. https://doi.org/10.1177/1475725716686288

Cameron, J., Nairn, K., & Higgins, J. (2009). Demystifying academic writing: Reflections on emotions, know-how and academic identity. Journal of Geography in Higher Education, 33(2), 269–284. https://doi.org/10.1080/03098260902734943

Carroll, J. A., & Wilson, E. E. (2014). The critical writer: Inquiry and the writing process. California: ABC-CLIO, LLC.

Cendon, E. (2020). From reflective practice to critical thinking . https://doi.org/10.4018/978-1-7998-1238-8.ch008

Christiansen, M. S. (2017). Language use in social network sites: The influence of orality in the digital writing of Mexican bilinguals. Writing & Pedagogy, 9(2), 369–392. https://doi.org/10.1558/wap.30281

Cisero, C. A. (2006). Does reflective journal writing improve course performance? College Teaching, 54(2), 231–236. https://doi.org/10.3200/CTCH.54.2.231-236

Coleman, L., & Tuck, J. (2020). Understanding student writing from lecturers’ perspectives: Acknowledging pedagogic complexity to support transformative practices in context. Studies in Higher Education, 1–13. https://doi.org/10.1080/03075079.2019.1711043

Corbett, J. (2014). Practising reflection: Empathy, emotion and intuition in political life writing. Life Writing, 11(3), 349–365. https://doi.org/10.1080/14484528.2013.822390

De Pew, K. E., & Miller, S. K. (2005). Studying L2 writers’ digital writing: An argument for post-critical methods. Computers and Composition, 22(3), 259–278. https://doi.org/10.1016/j.compcom.2005.05.001

Drucker, A. M., Fleming, P., & Chan, A.-W. (2016). Research techniques made simple: Assessing risk of bias in systematic reviews. Journal of Investigative Dermatology, 136(11), e109–e114. https://doi.org/10.1016/j.jid.2016.08.021

Efron, S. E., & Ravid, R. (2019). Writing the literature review: A practical guide. New York: The Guilford Press.

Fisher, M. H. (2011). Postcolonial travel writing: Critical explorations (review). Biography, 34(2), 355–357. https://doi.org/10.1353/bio.2011.0030

Goagoses, N., & Koglin, U. (2020). The role of social goals in academic success: Recounting the process of conducting a systematic review. In O. Zawacki-Richter, M. Kerres, S. Bedenlier, M. Bond & K. Buntins (Ed.), Systematic reviews in educational research methodology, perspectives and application (pp. 145–161). Wiesbaden: Springer Fachmedien Wiesbaden. https://doi.org/10.1007/978-3-658-27602-7_9

Harris, A. , & Jones, S. H. (2016). Writing for performance. Boston: SensePublishers.

Harris, D. (2020). Literature review and research design: A guide to effective research practice. New York: Routledge.

Hashemi, Z., & Mirzaei, T. (2015). Conversations of the mind: The impact of journal writing on enhancing EFL medical students’ reflections, attitudes, and sense of self. Procedia - Social and Behavioral Sciences, 199, 103–110. https://doi.org/10.1016/j.sbspro.2015.07.493

Hennessy, B. (1997). Writing an essay : How to improve your performance for coursework and examinations. Oxford: How To Books Ltd.

Hensley, L. C., & Munn, K. J. (2020). The power of writing about procrastination: Journaling as a tool for change. Journal of Further and Higher Education, 44(10), 1450–1465. https://doi.org/10.1080/0309877X.2019.1702154

Herder, A., Berenst, J., de Glopper, K., & Koole, T. (2018). Reflective practices in collaborative writing of primary school students. International Journal of Educational Research, 90, 160–174. https://doi.org/10.1016/j.ijer.2018.06.004

Herrero-Martín, R. (2021). The immanent presence of the home language in the foreign language classroom under the transformative-holistic pedagogical paradigm. https://doi.org/10.4018/978-1-7998-4075-6.ch002

Hwang, B., Choi, H., Kim, S., Kim, S., Ko, H., & Kim, J. (2018). Facilitating student learning with critical reflective journaling in psychiatric mental health nursing clinical education: A qualitative study. Nurse Education Today, 69, 159–164. https://doi.org/10.1016/j.nedt.2018.07.015

Jerome, L., & Kisby, B. (2019). The rise of character education in Britain. Cham: Springer International Publishing. https://doi.org/10.1007/978-3-030-27761-1

Jerome, L., & Kisby, B. (2020). Lessons in character education: Incorporating neoliberal learning in classroom resources. Critical Studies in Education, 1–16. https://doi.org/10.1080/17508487.2020.1733037

Jonnalagadda, S. R., Goyal, P., & Huffman, M. D. (2015). Automating data extraction in systematic reviews: A systematic review. Systematic Reviews, 4(1), 78. https://doi.org/10.1186/s13643-015-0066-7

King, A. E., Joseph, A. S., & Umland, E. M. (2017). Student perceptions of the impact and value of incorporation of reflective writing across a pharmacy curriculum. Currents in Pharmacy Teaching and Learning, 9(5), 770–778. https://doi.org/10.1016/j.cptl.2017.05.010

Klein, K. (2002). Stress, expressive writing, and working memory. In S. J. Lepore & J. M. Smyth (Eds.), The writing cure: How expressive writing promotes health and emotional well-being. (pp. 135–155). Washington: American Psychological Association. https://doi.org/10.1037/10451-007

Laqaei, N. (2015). The impact of reflective writing on writing achievement, vocabulary achievement and critical thinking of intermediate EFL learners. Journal of Studies in Education, 5(3), 174. https://doi.org/10.5296/jse.v5i3.7964

Lee, I., & Mak, P. (2018). Metacognition and metacognitive instruction in second language writing classrooms. TESOL Quarterly, 52(4), 1085–1097. https://doi.org/10.1002/tesq.436

Lengelle, R., Meijers, F., Poell, R., & Post, M. (2013). The effects of creative, expressive, and reflective writing on career learning: An explorative study. Journal of Vocational Behavior, 83(3), 419–427. https://doi.org/10.1016/j.jvb.2013.06.014

Liu, K. (2020). Critical reflection for transformative learning. Cham: Springer International Publishing. https://doi.org/10.1007/978-3-319-01955-0

Machi, L. A., & McEvoy, B. T. (2016). The literature review six steps to success (3rd ed.). California: SAGE Publications Ltd.

Mahlanze, H. T., & Sibiya, M. N. (2017a). Perceptions of student nurses on the writing of reflective journals as a means for personal, professional and clinical learning development. Health SA Gesondheid, 22, 79–86. https://doi.org/10.1016/j.hsag.2016.05.005

Mahlanze, H. T., & Sibiya, M. N. (2017b). Perceptions of student nurses on the writing of reflective journals as a means for personal, professional and clinical learning development. Health SA Gesondheid, 22, 79–86. https://doi.org/10.1016/j.hsag.2016.05.005

Marsh, C. (2014). ‘It’s quite weird to write … you feel like a nut job’: The practical and emotional consequences of writing personal reflections for assessment in psychology. Reflective Practice, 15(2), 190–202. https://doi.org/10.1080/14623943.2014.883310

Matousek, M. (2017). Writing to awaken: A journey of truth, transformation, and self-discovery. California: Reveal Press.

Michel, M., Kormos, J., Brunfaut, T., & Ratajczak, M. (2019). The role of working memory in young second language learners’ written performances. Journal of Second Language Writing, 45, 31–45. https://doi.org/10.1016/j.jslw.2019.03.002

Moon, J. A. (2006). Learning journals: A handbook for reflective practice and professional development (2nd ed.). London: Routledge Taylor & Francis Group.

Mujtaba, S. M., Parkash, R., & Nawaz, M. W. (2020). Do indirect coded corrective feedback and teachers short affective comments improve the writing performance and learners uptake? Reading & Writing Quarterly, 36(1), 34–47. https://doi.org/10.1080/10573569.2019.1616638

Murillo-Llorente, M. T., Navarro-Martínez, O., Valle, V. I., & Pérez-Bermejo, M. (2021). Using the reflective journal to improve practical skills integrating affective and self-critical aspects in impoverished international environments: A pilot test. International Journal of Environmental Research and Public Health, 18(16), 8876. https://doi.org/10.3390/ijerph18168876

Nagao, A. (2018). A genre-based approach to writing instruction in EFL classroom contexts. English Language Teaching, 11(5), 130. https://doi.org/10.5539/elt.v11n5p130

Nagao, A. (2019). The SFL genre-based approach to writing in EFL contexts. Asian-Pacific Journal of Second and Foreign Language Education, 4(1), 6. https://doi.org/10.1186/s40862-019-0069-3

Or, P. (2018). Reflective journal writing of undergraduate students enrolled in sex education in Hong Kong. Reflective Practice, 19(5), 599–608. https://doi.org/10.1080/14623943.2018.1538950

Park, J., Ayduk, Ö., & Kross, E. (2016). Stepping back to move forward: Expressive writing promotes self-distancing. Emotion, 16(3), 349–364. https://doi.org/10.1037/emo0000121

Phillips, S. R., & Archer-Lean, C. (2019). Decolonising the reading of Aboriginal and Torres Strait Islander writing: Reflection as transformative practice. Higher Education Research & Development, 38(1), 24–37. https://doi.org/10.1080/07294360.2018.1539956

Power, J. B. (2017). Not leaving the conversation behind: Approaching a decade of teaching reflective journal writing at a liberal arts college. Reflective Practice, 18(5), 713–724. https://doi.org/10.1080/14623943.2017.1324417

Qin, L., & Jun Zhang, L. (2019). English as a foreign language writers’ metacognitive strategy knowledge of writing and their writing performance in multimedia environments. Journal of Writing Research, 11( 2), 393–413. https://doi.org/10.17239/jowr-2019.11.02.06

Ramadhanti, D., Ghazali, A. S., Hasanah, M., Harsiati, T., & Yanda, D. P. (2020). The use of reflective journal as a tool for monitoring of metacognition growth in writing. International Journal of Emerging Technologies in Learning (IJET), 15(11), 162. https://doi.org/10.3991/ijet.v15i11.11939

Reinertsen, A. B., & Thomas, L. M. (2019). Stepping into the flow… lif/ve de-comforting academic writing: Smooth and striated spaces for being becoming performances. In L. Thomas & A. Reinertsen (Eds.), Academic writing and identity constructions (pp. 1–11). Cham: Springer International Publishing. https://doi.org/10.1007/978-3-030-01674-6_1

Riley?Douchet, C., & Wilson, S. (1997). A three?step method of self?reflection using reflective journal writing. Journal of Advanced Nursing, 25(5), 964–968. https://doi.org/10.1046/j.1365-2648.1997.1997025964.x

Rushton, D., & Duggan, C. (2013). Impact of culture on reflective writing in masters level students. Procedia - Social and Behavioral Sciences, 93, 956–963. https://doi.org/10.1016/j.sbspro.2013.09.310

Sangvanich, K., & Chinokul, S. (2018). Reflective sketchbook journals for art education students in Thailand. International Journal of Education Through Art, 14(3), 319–337. https://doi.org/10.1386/eta.14.3.319_1

?entürk, B. (2021). Writing in the digital age. https://doi.org/10.4018/978-1-7998-6508-7.ch007

Shang, H.-F. (2019). Exploring online peer feedback and automated corrective feedback on EFL writing performance. Interactive Learning Environments, 1–13. https://doi.org/10.1080/10494820.2019.1629601

Shaw, P., & Vassileva, I. (2009). Co-evolving academic rhetoric across culture; Britain, Bulgaria, Denmark, Germany in the 20th century. Journal of Pragmatics, 41(2), 290–305. https://doi.org/10.1016/j.pragma.2008.07.009

Snyder, H. (2019). Literature review as a research methodology: An overview and guidelines. Journal of Business Research, 104, 333–339. https://doi.org/10.1016/j.jbusres.2019.07.039

Stevens, D. D., Emil, S., & Yamashita, M. (2010). Mentoring through reflective journal writing: A qualitative study by a mentor/professor and two international graduate students. Reflective Practice, 11(3), 347–367. https://doi.org/10.1080/14623943.2010.490069

Suastra, I. M., & Menggo, S. (2020). Empowering students’ writing skill through performance assessment. International Journal of Language Education, 4(3). https://doi.org/10.26858/ijole.v4i3.15060

Sudirman, A., Gemilang, A. V., & Kristanto, T. M. A. (2021). The power of reflective journal writing for university students from the EFL perspective. Studies in English Language and Education, 8(3), 1061–1079. https://doi.org/10.24815/siele.v8i3.19105

Szenes, E., & Tilakaratna, N. (2021). Deconstructing critical reflection in social work and business: Negotiating emotions and opinions in reflective writing. Journal of English for Academic Purposes, 49, 100931. https://doi.org/10.1016/j.jeap.2020.100931

Tai, J., Ajjawi, R., Bearman, M., & Wiseman, P. (2020). Conceptualizations and measures of student engagement: A worked example of systematic review. In O. Zawacki-Richter, M. Kerres, S. Bedenlier, M. Bond & K. Buntins (Eds.), Systematic reviews in educational research methodology, perspectives and application (pp. 91–110). Wiesbaden: Springer Fachmedien Wiesbaden. https://doi.org/10.1007/978-3-658-27602-7_6

Teng, M. F. (2020a). Tertiary-level students’ English writing performance and metacognitive awareness: A group metacognitive support perspective. Scandinavian Journal of Educational Research, 64(4), 551–568. https://doi.org/10.1080/00313831.2019.1595712

Teng, M. F. (2020b). The role of metacognitive knowledge and regulation in mediating university EFL learners’ writing performance. Innovation in Language Learning and Teaching, 14(5), 436–450. https://doi.org/10.1080/17501229.2019.1615493

Vassilaki, E. (2017). Reflective writing, reflecting on identities: The construction of writer identity in student teachers’ reflections. Linguistics and Education, 42, 43–52. https://doi.org/10.1016/j.linged.2017.08.001

Williams, P. (2019). ‘How to do things with words’: Teaching creative writing as performance. New Writing, 1–13. https://doi.org/10.1080/14790726.2019.1629964

Woronchak, M., & Comeau, G. (2016). The value of reflective journaling with advanced piano students. Reflective Practice, 17(6), 792–805. https://doi.org/10.1080/14623943.2016.1220937

Yang, P.-L. (2020). English journal writing on moodle for EFL college learners. In I. Management Association (Eds.), Language learning and literacy (pp. 191–210). IGI Global. https://doi.org/10.4018/978-1-5225-9618-9.ch010

Yoshihara, R., Kurata, A., & Yamauchi, A. (2020). Reflective journals to explore struggles and difficulties of novice Japanese EFL university instructors. Reflective Practice, 21(1), 81–93. https://doi.org/10.1080/14623943.2019.1708714

Yu, W. M., & Chiu, M. M. (2019). Influences on the reflection quality of journal writing: An exploratory study. Reflective Practice, 20(5), 584–603. https://doi.org/10.1080/14623943.2019.1651712

Zabihi, R., Mehrani-Rad, M., & Khodi, A. (2019). Assessment of authorial voice strength in L2 argumentative written task performances: Contributions of voice components to text quality. Journal of Writing Research, 11( 2), 331–355. https://doi.org/10.17239/jowr-2019.11.02.04

Zarrabi, F., & Bozorgian, H. (2020). EFL students’ cognitive performance during argumentative essay writing: A log-file data analysis. Computers and Composition, 55, 102546. https://doi.org/10.1016/j.compcom.2020.102546

Zou, D., & Xie, H. (2019). Flipping an English writing class with technology-enhanced just-in-time teaching and peer instruction. Interactive Learning Environments, 27(8), 1127–1142. https://doi.org/10.1080/10494820.2018.1495654

• There are currently no refbacks.

e-ISSN: 1694-2116

p-ISSN: 1694-2493

• Schools & departments

Reflection literature

This section contains a review of literature on reflection and a list of helpful literature to explore the area further.

The Reflection Toolkit is intended to be used and to be easy to navigate.  Therefore, we have tried to streamline it by removing large theoretical discussions and constant references to literature.  However, these are important so from here you can access information on the historical development of the concept of reflection, the evidence behind whether it actually works, the literature used in developing the Reflection Toolkit and references to other relevant literature and materials.

Literature review

Below is a PDF that contains a review of literature on reflection.  The review explores the development of the theoretical concept of reflection, deals with associated challenges, and highlights the empirical evidence behind the benefits of reflection.  It also explains how we chose the definition of reflection that is used across the Reflection Toolkit.

Reflection bibliography

The page below contains the literature that contributed to the development of the Reflection Toolkit and other relevant literature in the area.  The literature is divided into broad topics to make it easy to find relevant content and to see how literature has informed the Reflection Toolkit.

Reflection: a review of the literature

Affiliation.

• 1 School of Health Care Studies, Oxford Brookes University, England.
• PMID: 8376656
• DOI: 10.1046/j.1365-2648.1993.18081188.x

This paper is a review of the literature on reflection. The purpose was to unravel and make sense of the complex literature, and to identify the skills required to engage in reflection. An analysis of the literature revealed that differences between authors' accounts of reflective processes are largely those of terminology, detail and the extent to which these processes are arranged in a hierarchy. Key stages of reflection are identified and represented by a model. Skills required to engage in reflection were found to be implicit in the literature and these are identified. Methodological issues related to empirical literature are discussed. It is suggested that reflection is an important learning tool in professional education and that the skills required for reflection need to be developed in professional courses.

Publication types

• Mental Processes*
• Models, Psychological
• Self Concept

An official website of the United States government

The .gov means it’s official. Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

The site is secure. The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

• Publications
• Account settings

Preview improvements coming to the PMC website in October 2024. Learn More or Try it out now .

• Advanced Search
• Journal List
• Perspect Med Educ
• v.12(1); 2023
• PMC10503530

Beyond the Written Reflection: A Systematic Review and Qualitative Synthesis of Creative Approaches to Reflective Learning Amongst Medical Students

William macaskill.

1 Griffith University, Rural Clinical School, Toowoomba, QLD 4350, AU

2 Rural Medical Education Australia, Toowoomba, QLD 4350, AU

Weng Joe Chua

Hannah woodall, janani pinidiyapathirage, introduction:.

In medical curricula, reflective learning (RL) mostly consists of writing and small-group discussion, yet accommodating diverse learning preferences is a key factor in developing lifelong reflective practitioners. Medical education uses a number of creative approaches to RL which cater to more diverse learning preferences; however, the overarching benefits of creative RL to students’ development is unknown. To understand how creative RL approaches contribute to students’ holistic development we performed a qualitative systematic review and synthesis.

Systematic searches of PubMed, PsycINFO, and EMBASE databases identified 4986 unique records, with 15 studies meeting inclusion criteria. Included studies specifically assessed the impact of RL on medical students and utilized creative approaches to RL. Creative approaches were defined as those not predominantly focused on reflective writing or group discussion. Studies were appraised using the Critical Appraisal Skills Programme and the Checklist for Quasi-Experimental Studies.

We identified five distinctive RL methods: viewing, performing, creating, imagining, and mind-body. Thematic analysis generated three themes: building and maintaining relationships, personal development, and sense of belonging. These themes incorporated eight sub-themes: recognizing multiple perspectives, empathizing with others, two-way communication skills, patient centered care, processing thoughts and emotions, self-care, interacting positively with peers, and developing trust and commonality.

Discussion:

Creative RL approaches may foster students’ sense of belonging and support interpersonal skills and personal development. In addition, creative RL activities may contribute to medical graduate’s holistic development, while providing opportunities to address diverse student needs using innovative, non-conventional methods.

Introduction

In medical education, reflective learning (RL) supports students to recall and re-evaluate their experiences and attend to their feelings [ 1 ]. The process is expected to create positive changes in future behaviors by reconstructing, reorganizing, and adding meaning to experiences [ 2 , 3 ]. RL links professional knowledge, practical competences, and professional activity [ 4 ], and supports deeper self-regulated learning, professional identity development [ 5 ], and therapeutic doctor-patient relationships [ 6 ]. RL is associated with increased medical student self-awareness, decreased bias, improved communication [ 7 ], empathy [ 8 ], professionalism, clinical reasoning and management of complex patients [ 6 , 9 ]. The methodological options for RL are broad and can be undertaken during (reflection-in-action) or after (reflection-on-action) practice [ 10 ]. RL can be structured or unstructured; regular or periodical; based upon writing or experiences; and can occur individually or in groups [ 11 ]. A career as a medical practitioner requires more than just clinical reasoning skills and consequently, professional bodies are increasingly emphasizing the importance of engaging in regular reflection, often termed simply as “reflective practice” [ 12 , 13 ]. In medical curricula the skill of reflection is mostly approached through writing or group discussion exercises [ 14 , 15 ]. These activities mostly utilize reflection-on-action through either solitary writing or group communication to improve participants’ understanding and future actions [ 16 ].

Reflective writing which is generally completed as a solitary task “shapes the physician’s belief system, guides their practice and nurtures their professional identity formation” [ 17 ]. It thereby supports the development of professional skills, standards and expectations, coping and resilience [ 17 ], understanding of communication [ 18 ], and may improve empathy [ 8 ]. Group reflection approaches such as Balint groups and structured group supervision (also known as intervision meetings) also support professional skills and personal development, improve coping and resilience, and can support the modification of behavior. Group approaches can also create safe supportive spaces and grow peer-social cohesion [ 19 , 20 , 21 , 22 ]. Despite their potential benefits these two methods have significant limitations with regards to their implementation and alignment with students’ learning preferences. There are students who are comfortable to express their thoughts in writing but would remain silent in group discussions, and students who thrive in a discussion but struggle to express their thoughts in writing. Others will simply have non-linguistic learning preferences [ 23 , 24 ]. Some students will have cultural or linguistic backgrounds which may limit their engagement in written or spoken reflection. While the primacy of speaking and writing as communication methods in society may explain the dominance of written and group reflection as RL approaches, it does not guarantee student engagement. This is illustrated well in a study by Campbell et al. in which many students agreed that ‘writing, reflective, and narrative exercises were a waste of their time’ with the authors noting that these students were also ‘less likely to believe the [group reflective writing] session helped them reflect on clinical experiences’ [ 25 ]. Furthermore, there are impactful methodological limitations to written and group discussion approaches. When undertaking reflective writing some students experience anxiety with sharing their thoughts, engage in self-censoring, produce inauthentic reflections, and are disappointed in the lack of personalized feedback received [ 17 ]. The benefits of group reflection are also not guaranteed, with benefits to students limited when: trust is not established; facilitation is ineffective; the process, expectations, and outcomes are unclear; participants do not contribute or have negative attitudes or behaviors; or when groups lack sufficient experience or knowledge [ 20 , 21 , 22 ]. Though the benefits of these approaches are many, their barriers to participation cannot be ignored and alternative or complementary RL methods should be considered. If the reflective approaches offered in a curriculum are not varied then students may not effectively learn and develop a reflective practice, or they may fail to demonstrate that they have reflected.

To maximise engagement in reflection, students must be provided with greater diversity of reflective methods from beyond the ‘comfort zone’ of reflective writing and group discussions. Medical curricula should embrace diverse RL methods to enable learners to identify their own personal systems ‘for engaging in reflection’ [ 26 , 27 ], to enhance motivation to participate in reflection, and to support the transition from curriculum directed reflection to lifelong reflective practice [ 26 , 28 ]. Given the potential benefits to students’ wellbeing and burnout reduction from engaging in creative ventures [ 29 , 30 , 31 ], it is prudent to consider creative approaches to reflective learning. Students are also more likely to engage in tasks that they enjoy and in which they see value, thus providing a range of creative reflective activities to students may heighten their chance of finding a reflective approach that works best for them. Armed with a reflective approach, students could then enter the workforce ready to engage in, and reap the benefits of, reflective practice.

This study explores the literature using thematic analysis to better understand what creative methods of reflective learning have been reported. Reporting upon these creative methods and their learning outcomes will provide guidance for educators in the development of diverse reflective learning models. The research questions for this review were thus: Which types of creative RL methods are described in medical education and what learning outcomes were reported for these methods?

We systematically reviewed and thematically synthesized qualitative studies that focus on creative RL in medical education [ 32 ]. The Enhancing Transparency in Reporting the Synthesis of Qualitative Research guidelines were utilized to accurately report the methodology of the thematic synthesis [ 33 ]. The research was designed with an interpretivist approach to generating and analyzing data within a subjectivist research paradigm.

Selection criteria

Peer-reviewed papers published in English between 2006-2021 assessing the impact of creative RL approaches on medical students’ development using qualitative or mixed methods designs were included. Earlier publications were excluded as a previous review assessed literature published between 1995–2005 to investigate the utility of reflection and reflective practice in health students’ education [ 9 ]. Creative approaches were defined as those not predominantly focused on reflective writing or group discussion as the RL method. Papers were included if they specifically assessed the impact of RL on medical students. Papers focusing only on students’ clinical skills and curriculum knowledge were excluded. Studies without clearly defined RL activities were excluded, as were case-studies, non-primary research articles, meta-syntheses, literature reviews, and systematic reviews.

Search criteria

A systematic search of Pubmed, PsycINFO, and EMBASE databases was performed in September 2021. Search strategy and results were iteratively developed and reviewed (WM, JP). The search strategy utilized the following search terms in all databases: “reflecti*” and; “medical student*” or “medical edu*” and; “medical school*” or “clinical edu*”. Search syntax was modified for each database with title and abstract fields searched. WM, WC, TP independently screened titles and abstracts. Full-texts of potentially eligible papers were read in entirety to determine eligibility. Reference lists of included articles were hand-searched to identify additional relevant studies. Conflicts were resolved through discussion with another reviewer (JP). Screening results were presented using the Preferred Reporting Items for Systematic Reviews and Meta-Analyses Extension for Scoping Reviews (PRISMA-ScR) statement [ 34 ]. The approach to study identification from this systematic review is reported in Supplementary Materials S1.

Appraisal of included studies

Methodological limitations of included studies were assessed using the Critical Appraisal Skills Programme (CASP) Qualitative Studies Checklist [ 35 ]. The domains utilized included aims, methodology, design, recruitment, data collection and analysis, research reflexivity, ethical considerations, and findings. Mixed-methods studies were additionally assessed with the Checklist for Quasi-Experimental Studies [ 36 ]. All studies were critically appraised using these checklists (WM). Other reviewers (WC, TP) verified 50% of appraisals. No disagreements in ratings occurred. Appraisal informed judgements about evidence strength and confidence in review findings, but was not used to exclude articles.

Analysis and synthesis

Previously described methods of thematic analysis and synthesis were used to analyze the selected articles [ 32 , 37 ]. Quotations were extracted from studies’ results/findings sections using line-by-line coding in NVivo Pro software (QRS International, Denver, Colorado). Multiple codes were applied to the same text when deemed appropriate. Discussion sections which included participant quotations were also coded. Initial codes were tested on half the identified literature (n = 7). Further refinements were made iteratively while coding the remaining articles. Sub-themes were derived from the data during an interpretive analysis of perceived benefits to students’ development. Taxonomic analysis identified relationships and similarities between sub-themes, resulting in the construction of themes. Themes from the data were first developed by WM, then validated for relevance and applicability by all authors. Final sub-themes and themes were agreed upon by all authors.

Authors considered the influence of their professional backgrounds, experiences, and prior assumptions during data extraction and analysis. WM has an education and physiology background; WC is a medical student in clinical training; and HW and JP are clinical researchers. WM approached data extraction and theme generation from a perspective free of expectations regarding what education in a clinical setting ‘should’ resemble. WC viewed student quotations from a near-peer perspective and experienced the data more viscerally. HW and JP facilitated discussion of emerging codes and categories with the broader medical education team enabling new insights from those with experience in medical education delivery.

The search process generated 8182 records, with 15 articles eligible for the final synthesis ( Figure 1 ).

PRISMA-ScR flowchart for the study.

Summary of articles

The included articles represented a geographically diverse range of contexts (Australia, n = 2; Ireland, n = 1; UK, n = 2; USA, n = 7; Lebanon, n = 1; Spain, n = 1, China, n = 1). One article was a pilot study [ 38 ] sharing a RL activity that was methodologically similar to another included article by the same first author [ 39 ]. Collectively, the studies drew upon over 893 medical students’ perspectives (one study did not provide participant numbers [ 40 ]). Study characteristics and appraisal decisions are summarized in Table 1 .

Summary of included articles in a review of Creative Approaches to Reflective Learning amongst Medical Students.

Abbreviations: CASP = Critical Appraisal Skills Programme; RL = Reflective Learning.

Reflective methods

Methods to stimulate RL were organized into five categories: viewing, performing, creating, imagining, and mind-body ( Table 1 ).

Viewing utilized visual stimulus items as reflective prompts. Some studies reflected-in-action utilizing learning activities [ 42 ] or facilitated discussions [ 52 ] to investigate artworks. Others reflected-on-action with informal or facilitated discussions after viewing photography [ 38 , 39 ] or artworks [ 41 ], or utilized private reading of graphic medicine texts [ 43 ].

Performing taught performance exercises to develop skills relevant to medical practice such as active listing and recognizing bias. One study taught pre-performative skills (e.g., voice skills) [ 40 ], two utilized improvisational theatre activities [ 45 , 46 ], and one culminated in a devised theatre performance to peers [ 44 ].

Creating emphasized reflection-on-action through creating either medical comics [ 43 ]; poetry, drawings or paintings [ 49 ], or using digital storytelling [ 50 ].

Imagining studies focused on role-playing medicine through the patient lens. One study utilized live-action role-play with students as older adults with physical limitations [ 48 ]. The other involved prioritizing 36 end-of-life choices to facilitate consideration of patient perspectives [ 47 ].

Mind-Body included one study teaching skills such as relaxation techniques and meditation [ 51 ].

Thematic synthesis

Coding generated rich data describing multi-faceted student development in response to creative RL. Generated themes describe personal development, building and maintaining relationships, and sense of belonging. Themes, sub-themes and methods are shown in Figure 2 .

A model of the effects of creative reflective learning on medical students’ development.

Personal development

Processing thoughts and emotions.

Creative RL provided opportunities for exploring thoughts and emotions. Students identified ‘disconnects’ between their ‘intentions, feelings, and actions’ [ 51 ]. Some formed ‘different connections’ with themselves [ 41 ] and better understood their emotional triggers or were able to realize that their experiences actually affected them [ 50 ]. Students’ sentiments towards emotions [ 44 , 47 ] and abilities to recognize their internalized biases also improved [ 39 , 40 , 42 , 43 , 47 , 48 ].

RL was a therapeutic curriculum break described as a: ‘sanctuary’ [ 42 ], ‘reset button’ [ 46 ], ‘chance to escape … and relax’ [ 49 ], and an activity you would ‘want to do’ [ 50 ]. Participation increased students’ attention to self-care activities and facilitated uptake of relaxing past-times [ 42 , 51 ]. RL also normalized self-care among students ‘It’s healthy to do that (self-care). It will make me a better doctor to do that’ [ 42 ]. Mind-body skills equipped students with a ‘new set of tools’ for managing life and medical school stresses: ‘I listen to my body more. I’m more attentive to my state of mind. I feel that I have more control over myself’ [ 51 ]. Similarly, performing arts activities helped students to identify and modify ‘the physical effects of stress’ [ 40 ] and normalized failure [ 46 ].

Building and maintaining relationships

Recognizing multiple perspectives.

Students identified areas where their perspectives differed from peers. For instance, their interpretations of portraiture [ 39 ] and emotions [ 42 ], and views on sexuality [ 40 ], art [ 42 , 52 ], and end-of-life priorities [ 47 ]. The encountered perspectives surprised some students [ 38 , 39 , 40 , 49 ]: ‘… there was so much room for imagination and creativity when thinking of a person, patient or illness’ [ 49 ]. Recognizing other perspectives engendered empathy towards patients in some students. ‘…[This game] has given me more empathy for my elderly patients’ [ 48 ].

Empathizing with others

Students had more empathy for patients following RL activities [ 38 , 48 , 52 ]. ‘… [I] think of my own back all hunched over and I felt like I was in pain … my immediate response was she’s probably in pain’ [ 38 ]. Students demonstrated empathic imagination by juxtaposing artistic pieces with real situations [ 40 , 41 , 49 ], imagining patients’ perspectives through role-play [ 48 ], discussion of photography [ 38 ], reading or creating comics [ 43 ], and prioritizing end-of-life decisions [ 47 ]. Students subsequently intended to: provide ‘sensitive’ care [ 41 ] and doctor-patient ‘partnerships’ [ 51 ], soften ‘hard edges for vulnerable patients’ [ 40 ], and be a support person to patients [ 41 , 49 ]. This shows students’ growing desires to embed empathy in their professional identities. ‘… you have to be very sensitive to what happens around you and that art helps to see and promote that sensitivity…’ [ 41 ].

Two-way communication skills

Students noted RL helped develop effective communication, increased awareness of ‘their own bodies and physical responses’ and the ‘physicality of others’ [ 40 ], and highlighted the value of non-verbal communication skills. ‘…often times they [non-verbal communication] can tell you more than verbal language would’ [ 46 ]. Students reading graphic medicine texts also noted improved awareness and understanding of non-verbal cues and communication [ 43 ].

Patient-centered care

Several studies showed students intended to incorporate patient-centered care practices into their professional identity by recognizing patients as individuals requiring individualized care. Students found ‘one-size fits all’ approaches inappropriate [ 39 ], as all patients have ‘other things in their life’ [ 41 ], ‘different priorities and values’ [ 47 ], and that doctors are not always the ‘center of care’ for their patients [ 43 ]. Awareness of influences on patients may thus engender patient-centered care intentions. ‘I should stop seeing patients like machines to [be] fix[ed] and start seeing patients like persons who deserve a better way of life’ [ 41 ].

A sense of belonging

Interacting positively with peers.

RL provided opportunities to interact with classmates in ‘positive, low-stress setting[s]’ [ 46 ]. Peer interactions outside the standard medical curriculum facilitated the formation of social connections and friendships [ 40 , 42 , 44 , 46 , 51 ].

Developing trust and commonality

Students built trust [ 40 ], improved teamwork skills [ 40 , 44 ], shared their thoughts, feelings and experiences with others [ 40 , 42 , 44 , 51 ], and identified that their ‘core worries and niggles’ about medical school were common [ 40 , 51 ]. ‘… I’m not alone in my fears to succeed in med school…’ [ 51 ].

This synthesis of qualitative and mixed methods studies analyzed literature reporting on studies using creatively focused RL. Our findings indicate that creative RL methods afford students the opportunity to experience and engage in diverse reflective practices whilst providing alternate learning approaches to those who do not benefit from conventional RL methods such as written and group approaches. With our findings, we aim to provide evidence-based recommendations for the development of meaningful and flexible reflective learning models.

Creative RL can embrace diversity in reflective practice and facilitate individual approaches for learners, thereby facilitating true reflection [ 28 ]. However, ensuring students complete reflective exercises is not a guarantee that they have reflected as reflective behaviors can be inauthentic [ 17 , 26 ]. RL activities should therefore be designed to make students want to participate in reflection. This may be accomplished by accepting and embracing diversity, encouraging universities to try different models of reflection, and by creating conditions which foster reflection [ 26 , 28 ]. The reflective approaches currently utilized in medical education tend to emphasize reflection based upon written and verbal approaches, perhaps reflecting a societal disposition towards written and spoken communication models. Creative RL methods are uniquely placed to boost student participation and interest in reflective learning as they offer diverse methods of engagement and (due to their interpretivist nature) opportunities to develop reflective capacity without ones’ views being deemed right or wrong.

This study offers practical information for those implementing RL programs in medical curricula by outlining what creative approaches to RL have been implemented and their outcomes. Based on benefits reported in the included studies three key themes were developed, personal development, building and maintaining relationships, and sense of belonging. The studies underpinning these themes were further organized by RL method into the categories viewing, performing, creating, imagining, and mind-body. The categories themselves speak to the breadth of approaches which could be taken beyond the common choices of reflective writing and group discussions. Though the reported benefits of RL varied there were several benefits which appeared across the majority of RL methods. Namely, improvements in empathizing with others, recognizing multiple perspectives, processing thoughts and emotions, and self-care. Other potential benefits present in some methods included improved two-way communication skills, patient centered care, positive interactions with others, and developing trust and commonality.

A comparison of the benefits of creative RL versus written and group RL indicates many similarities. Written and creative RL have evidence of improving patient care, self-monitoring, and self-improvement. Creative and group RL approaches report improved personal and professional development, sense of belonging or social-cohesion, trust and safety within the peer-group, understanding of self and others, self-confidence, improved communication, and modifications to participants behaviors and habits. Creative, written, and group approaches refer to improvements in recognizing and valuing other perspectives, developing empathy, and improving coping skills. Naturally, the limitations of implementing creative RL practices must be considered alongside the potential benefits. The studies included in this review mentioned few limitations beyond sparing references to the time pressures of including RL activities in the curriculum [ 41 ] and that some students may be initially skeptical of arts-based teaching [ 40 ]. Given the optional nature of most of the creative RL interventions, selection bias may partly explain the lack of detail on limitations. Drawing upon the literature for group and written RL provides some initial guidance on how to avoid potential barriers to learning when implementing creative RL approaches. For instance, the purpose of reflection should be clear; facilitators should be trained, confident, and committed; reflection must be role modelled; and the structure of reflection should be safe, flexible, and creative [ 28 ]. Discussions should be confidential; facilitators competent and willing to show vulnerability; and personalized student feedback should be provided [ 17 , 18 , 20 , 28 ].

The definition of “creative approaches” applied during the literature review is subjective. This may have resulted in the exclusion of some articles which others may have included, however researchers of diverse backgrounds contributed to literature screening and data analysis to limit the impact of researcher bias. Some studies were excluded as they did not articulate the benefits of their RL approaches to students, despite using creative RL approaches. We also did not contact medical schools about potentially novel unpublished RL practices. We believe that the addition of further articles and RL methods would not necessarily change synthesis findings, as high levels of repetition in some themes suggests that saturation was approached, if not reached. This study forwent the exploration of all potential creative RL approaches and instead provides an evidence-based approach to the benefits to students thereby providing a valuable resource which medical educators can refer to when reviewing RL practices and seeking evidence to justify change.

The findings of this study illustrate the types of creative RL approaches which could be used in medical curricula and highlight how they may benefit students. It was shown that creative RL approaches can foster medical students’ sense of belonging, interpersonal skills, and personal development and have considerable potential to holistically improve overall medical student development. The relationship between creative RL and students’ sense of belonging warrants further investigation as stronger support networks are known to assist in managing emotional stresses. When reviewing medical curricula, educators should pause to consider whether creative approaches to reflective learning could provide students with opportunities to develop their personal reflective style, develop as reflective practitioners, and support student needs such as sense of community or self-care behaviors. We believe our findings will embolden educators to utilize greater diversity of reflective learning approaches to support the needs of medical students whilst helping them develop their own unique approach to reflective practice.

Acknowledgements

The authors acknowledge Thedini Pinidiyapathirage’s (TP) contributions to reviewing and appraisal of papers. The authors acknowledge Sherrilyn Walters for her assistance in revising the manuscript.

Funding Statement

This work was supported by a Rural Health Multidisciplinary Training (RHMT) program grant issued to Griffith University by the Australian Federal Government’s Department of Health and Aged Care.

Funding Information

Competing interests.

The authors have no competing interests to declare.

• Yale University
• About Yale Insights
• Privacy Policy
• Accessibility

Reflective Practice Through Writing

Subscribe to Learning through Experience in Apple Podcasts , Spotify , Google Podcasts , or your favorite podcast player .

This podcast season is all about the HOW of learning through experience. We learn through experience using four core practices: challenging your perspective, stretching and building range, directing your learning, reflection and inquiry. The core practice that we are paying attention to in this episode of Learning Through Experience is reflection and inquiry .

In this episode, I spoke with reflective writing practitioner and teacher Stephanie Dunson about reflective practice through writing . We cover the practice of reflective writing, including the struggle of writing, and she offers some prompts for you to use in your own reflective writing practice.

Stephanie is a renowned facilitator who uses writing as a tool for problem-solving and collaboration in both the academic and corporate worlds.

Key Topics:

04:24 The challenge of writing : The limits of writing towards an outcome in contrast to writing for the reflection and exploration of our own thoughts and feelings;

08:33 The meander of writing : Writing doesn’t work in a straight line, rather it follows a natural sort of meander. By meandering through a piece, we get to know the writer’s mind;

15:18 Reflective writing: The concept of using writing as a tool for deep thinking and developing relationships with complex material;

21:15 Reflective writing in groups : Engaging in the moment of making new ideas as a group and combining the strengths of the individual with the power and diversity of the group;

23:03 The practice of writing : Developing the capacity to reflect, notice, and meander as a practice in life and writing;

30:48 Prompts for reflective writing : What have you considered writing about but abandoned? Explore the places of resistance and write into that space.

Additional Resources from Stephanie Dunson

Podcast: 100 Mistakes Academic Writers Make …and How to Fix Them

A systematic literature review of empirical research on ChatGPT in education

• Open access
• Published: 26 May 2024
• Volume 3 , article number  60 , ( 2024 )

Cite this article

You have full access to this open access article

• Yazid Albadarin   ORCID: orcid.org/0009-0005-8068-8902 1 ,
• Mohammed Saqr 1 ,
• Nicolas Pope 1 &
• Markku Tukiainen 1  

104 Accesses

Explore all metrics

Over the last four decades, studies have investigated the incorporation of Artificial Intelligence (AI) into education. A recent prominent AI-powered technology that has impacted the education sector is ChatGPT. This article provides a systematic review of 14 empirical studies incorporating ChatGPT into various educational settings, published in 2022 and before the 10th of April 2023—the date of conducting the search process. It carefully followed the essential steps outlined in the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA 2020) guidelines, as well as Okoli’s (Okoli in Commun Assoc Inf Syst, 2015) steps for conducting a rigorous and transparent systematic review. In this review, we aimed to explore how students and teachers have utilized ChatGPT in various educational settings, as well as the primary findings of those studies. By employing Creswell’s (Creswell in Educational research: planning, conducting, and evaluating quantitative and qualitative research [Ebook], Pearson Education, London, 2015) coding techniques for data extraction and interpretation, we sought to gain insight into their initial attempts at ChatGPT incorporation into education. This approach also enabled us to extract insights and considerations that can facilitate its effective and responsible use in future educational contexts. The results of this review show that learners have utilized ChatGPT as a virtual intelligent assistant, where it offered instant feedback, on-demand answers, and explanations of complex topics. Additionally, learners have used it to enhance their writing and language skills by generating ideas, composing essays, summarizing, translating, paraphrasing texts, or checking grammar. Moreover, learners turned to it as an aiding tool to facilitate their directed and personalized learning by assisting in understanding concepts and homework, providing structured learning plans, and clarifying assignments and tasks. However, the results of specific studies (n = 3, 21.4%) show that overuse of ChatGPT may negatively impact innovative capacities and collaborative learning competencies among learners. Educators, on the other hand, have utilized ChatGPT to create lesson plans, generate quizzes, and provide additional resources, which helped them enhance their productivity and efficiency and promote different teaching methodologies. Despite these benefits, the majority of the reviewed studies recommend the importance of conducting structured training, support, and clear guidelines for both learners and educators to mitigate the drawbacks. This includes developing critical evaluation skills to assess the accuracy and relevance of information provided by ChatGPT, as well as strategies for integrating human interaction and collaboration into learning activities that involve AI tools. Furthermore, they also recommend ongoing research and proactive dialogue with policymakers, stakeholders, and educational practitioners to refine and enhance the use of AI in learning environments. This review could serve as an insightful resource for practitioners who seek to integrate ChatGPT into education and stimulate further research in the field.

Similar content being viewed by others

Empowering learners with ChatGPT: insights from a systematic literature exploration

Incorporating AI in foreign language education: An investigation into ChatGPT’s effect on foreign language learners

Large language models in education: A focus on the complementary relationship between human teachers and ChatGPT

Avoid common mistakes on your manuscript.

1 Introduction

Educational technology, a rapidly evolving field, plays a crucial role in reshaping the landscape of teaching and learning [ 82 ]. One of the most transformative technological innovations of our era that has influenced the field of education is Artificial Intelligence (AI) [ 50 ]. Over the last four decades, AI in education (AIEd) has gained remarkable attention for its potential to make significant advancements in learning, instructional methods, and administrative tasks within educational settings [ 11 ]. In particular, a large language model (LLM), a type of AI algorithm that applies artificial neural networks (ANNs) and uses massively large data sets to understand, summarize, generate, and predict new content that is almost difficult to differentiate from human creations [ 79 ], has opened up novel possibilities for enhancing various aspects of education, from content creation to personalized instruction [ 35 ]. Chatbots that leverage the capabilities of LLMs to understand and generate human-like responses have also presented the capacity to enhance student learning and educational outcomes by engaging students, offering timely support, and fostering interactive learning experiences [ 46 ].

The ongoing and remarkable technological advancements in chatbots have made their use more convenient, increasingly natural and effortless, and have expanded their potential for deployment across various domains [ 70 ]. One prominent example of chatbot applications is the Chat Generative Pre-Trained Transformer, known as ChatGPT, which was introduced by OpenAI, a leading AI research lab, on November 30th, 2022. ChatGPT employs a variety of deep learning techniques to generate human-like text, with a particular focus on recurrent neural networks (RNNs). Long short-term memory (LSTM) allows it to grasp the context of the text being processed and retain information from previous inputs. Also, the transformer architecture, a neural network architecture based on the self-attention mechanism, allows it to analyze specific parts of the input, thereby enabling it to produce more natural-sounding and coherent output. Additionally, the unsupervised generative pre-training and the fine-tuning methods allow ChatGPT to generate more relevant and accurate text for specific tasks [ 31 , 62 ]. Furthermore, reinforcement learning from human feedback (RLHF), a machine learning approach that combines reinforcement learning techniques with human-provided feedback, has helped improve ChatGPT’s model by accelerating the learning process and making it significantly more efficient.

This cutting-edge natural language processing (NLP) tool is widely recognized as one of today's most advanced LLMs-based chatbots [ 70 ], allowing users to ask questions and receive detailed, coherent, systematic, personalized, convincing, and informative human-like responses [ 55 ], even within complex and ambiguous contexts [ 63 , 77 ]. ChatGPT is considered the fastest-growing technology in history: in just three months following its public launch, it amassed an estimated 120 million monthly active users [ 16 ] with an estimated 13 million daily queries [ 49 ], surpassing all other applications [ 64 ]. This remarkable growth can be attributed to the unique features and user-friendly interface that ChatGPT offers. Its intuitive design allows users to interact seamlessly with the technology, making it accessible to a diverse range of individuals, regardless of their technical expertise [ 78 ]. Additionally, its exceptional performance results from a combination of advanced algorithms, continuous enhancements, and extensive training on a diverse dataset that includes various text sources such as books, articles, websites, and online forums [ 63 ], have contributed to a more engaging and satisfying user experience [ 62 ]. These factors collectively explain its remarkable global growth and set it apart from predecessors like Bard, Bing Chat, ERNIE, and others.

In this context, several studies have explored the technological advancements of chatbots. One noteworthy recent research effort, conducted by Schöbel et al. [ 70 ], stands out for its comprehensive analysis of more than 5,000 studies on communication agents. This study offered a comprehensive overview of the historical progression and future prospects of communication agents, including ChatGPT. Moreover, other studies have focused on making comparisons, particularly between ChatGPT and alternative chatbots like Bard, Bing Chat, ERNIE, LaMDA, BlenderBot, and various others. For example, O’Leary [ 53 ] compared two chatbots, LaMDA and BlenderBot, with ChatGPT and revealed that ChatGPT outperformed both. This superiority arises from ChatGPT’s capacity to handle a wider range of questions and generate slightly varied perspectives within specific contexts. Similarly, ChatGPT exhibited an impressive ability to formulate interpretable responses that were easily understood when compared with Google's feature snippet [ 34 ]. Additionally, ChatGPT was compared to other LLMs-based chatbots, including Bard and BERT, as well as ERNIE. The findings indicated that ChatGPT exhibited strong performance in the given tasks, often outperforming the other models [ 59 ].

Furthermore, in the education context, a comprehensive study systematically compared a range of the most promising chatbots, including Bard, Bing Chat, ChatGPT, and Ernie across a multidisciplinary test that required higher-order thinking. The study revealed that ChatGPT achieved the highest score, surpassing Bing Chat and Bard [ 64 ]. Similarly, a comparative analysis was conducted to compare ChatGPT with Bard in answering a set of 30 mathematical questions and logic problems, grouped into two question sets. Set (A) is unavailable online, while Set (B) is available online. The results revealed ChatGPT's superiority in Set (A) over Bard. Nevertheless, Bard's advantage emerged in Set (B) due to its capacity to access the internet directly and retrieve answers, a capability that ChatGPT does not possess [ 57 ]. However, through these varied assessments, ChatGPT consistently highlights its exceptional prowess compared to various alternatives in the ever-evolving chatbot technology.

The widespread adoption of chatbots, especially ChatGPT, by millions of students and educators, has sparked extensive discussions regarding its incorporation into the education sector [ 64 ]. Accordingly, many scholars have contributed to the discourse, expressing both optimism and pessimism regarding the incorporation of ChatGPT into education. For example, ChatGPT has been highlighted for its capabilities in enriching the learning and teaching experience through its ability to support different learning approaches, including adaptive learning, personalized learning, and self-directed learning [ 58 , 60 , 91 ]), deliver summative and formative feedback to students and provide real-time responses to questions, increase the accessibility of information [ 22 , 40 , 43 ], foster students’ performance, engagement and motivation [ 14 , 44 , 58 ], and enhance teaching practices [ 17 , 18 , 64 , 74 ].

On the other hand, concerns have been also raised regarding its potential negative effects on learning and teaching. These include the dissemination of false information and references [ 12 , 23 , 61 , 85 ], biased reinforcement [ 47 , 50 ], compromised academic integrity [ 18 , 40 , 66 , 74 ], and the potential decline in students' skills [ 43 , 61 , 64 , 74 ]. As a result, ChatGPT has been banned in multiple countries, including Russia, China, Venezuela, Belarus, and Iran, as well as in various educational institutions in India, Italy, Western Australia, France, and the United States [ 52 , 90 ].

Clearly, the advent of chatbots, especially ChatGPT, has provoked significant controversy due to their potential impact on learning and teaching. This indicates the necessity for further exploration to gain a deeper understanding of this technology and carefully evaluate its potential benefits, limitations, challenges, and threats to education [ 79 ]. Therefore, conducting a systematic literature review will provide valuable insights into the potential prospects and obstacles linked to its incorporation into education. This systematic literature review will primarily focus on ChatGPT, driven by the aforementioned key factors outlined above.

However, the existing literature lacks a systematic literature review of empirical studies. Thus, this systematic literature review aims to address this gap by synthesizing the existing empirical studies conducted on chatbots, particularly ChatGPT, in the field of education, highlighting how ChatGPT has been utilized in educational settings, and identifying any existing gaps. This review may be particularly useful for researchers in the field and educators who are contemplating the integration of ChatGPT or any chatbot into education. The following research questions will guide this study:

What are students' and teachers' initial attempts at utilizing ChatGPT in education?

What are the main findings derived from empirical studies that have incorporated ChatGPT into learning and teaching?

2 Methodology

To conduct this study, the authors followed the essential steps of the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA 2020) and Okoli’s [ 54 ] steps for conducting a systematic review. These included identifying the study’s purpose, drafting a protocol, applying a practical screening process, searching the literature, extracting relevant data, evaluating the quality of the included studies, synthesizing the studies, and ultimately writing the review. The subsequent section provides an extensive explanation of how these steps were carried out in this study.

2.1 Identify the purpose

Given the widespread adoption of ChatGPT by students and teachers for various educational purposes, often without a thorough understanding of responsible and effective use or a clear recognition of its potential impact on learning and teaching, the authors recognized the need for further exploration of ChatGPT's impact on education in this early stage. Therefore, they have chosen to conduct a systematic literature review of existing empirical studies that incorporate ChatGPT into educational settings. Despite the limited number of empirical studies due to the novelty of the topic, their goal is to gain a deeper understanding of this technology and proactively evaluate its potential benefits, limitations, challenges, and threats to education. This effort could help to understand initial reactions and attempts at incorporating ChatGPT into education and bring out insights and considerations that can inform the future development of education.

2.2 Draft the protocol

The next step is formulating the protocol. This protocol serves to outline the study process in a rigorous and transparent manner, mitigating researcher bias in study selection and data extraction [ 88 ]. The protocol will include the following steps: generating the research question, predefining a literature search strategy, identifying search locations, establishing selection criteria, assessing the studies, developing a data extraction strategy, and creating a timeline.

2.3 Apply practical screen

The screening step aims to accurately filter the articles resulting from the searching step and select the empirical studies that have incorporated ChatGPT into educational contexts, which will guide us in answering the research questions and achieving the objectives of this study. To ensure the rigorous execution of this step, our inclusion and exclusion criteria were determined based on the authors' experience and informed by previous successful systematic reviews [ 21 ]. Table 1 summarizes the inclusion and exclusion criteria for study selection.

2.4 Literature search

We conducted a thorough literature search to identify articles that explored, examined, and addressed the use of ChatGPT in Educational contexts. We utilized two research databases: Dimensions.ai, which provides access to a large number of research publications, and lens.org, which offers access to over 300 million articles, patents, and other research outputs from diverse sources. Additionally, we included three databases, Scopus, Web of Knowledge, and ERIC, which contain relevant research on the topic that addresses our research questions. To browse and identify relevant articles, we used the following search formula: ("ChatGPT" AND "Education"), which included the Boolean operator "AND" to get more specific results. The subject area in the Scopus and ERIC databases were narrowed to "ChatGPT" and "Education" keywords, and in the WoS database was limited to the "Education" category. The search was conducted between the 3rd and 10th of April 2023, which resulted in 276 articles from all selected databases (111 articles from Dimensions.ai, 65 from Scopus, 28 from Web of Science, 14 from ERIC, and 58 from Lens.org). These articles were imported into the Rayyan web-based system for analysis. The duplicates were identified automatically by the system. Subsequently, the first author manually reviewed the duplicated articles ensured that they had the same content, and then removed them, leaving us with 135 unique articles. Afterward, the titles, abstracts, and keywords of the first 40 manuscripts were scanned and reviewed by the first author and were discussed with the second and third authors to resolve any disagreements. Subsequently, the first author proceeded with the filtering process for all articles and carefully applied the inclusion and exclusion criteria as presented in Table  1 . Articles that met any one of the exclusion criteria were eliminated, resulting in 26 articles. Afterward, the authors met to carefully scan and discuss them. The authors agreed to eliminate any empirical studies solely focused on checking ChatGPT capabilities, as these studies do not guide us in addressing the research questions and achieving the study's objectives. This resulted in 14 articles eligible for analysis.

2.5 Quality appraisal

The examination and evaluation of the quality of the extracted articles is a vital step [ 9 ]. Therefore, the extracted articles were carefully evaluated for quality using Fink’s [ 24 ] standards, which emphasize the necessity for detailed descriptions of methodology, results, conclusions, strengths, and limitations. The process began with a thorough assessment of each study's design, data collection, and analysis methods to ensure their appropriateness and comprehensive execution. The clarity, consistency, and logical progression from data to results and conclusions were also critically examined. Potential biases and recognized limitations within the studies were also scrutinized. Ultimately, two articles were excluded for failing to meet Fink’s criteria, particularly in providing sufficient detail on methodology, results, conclusions, strengths, or limitations. The review process is illustrated in Fig.  1 .

The study selection process

2.6 Data extraction

The next step is data extraction, the process of capturing the key information and categories from the included studies. To improve efficiency, reduce variation among authors, and minimize errors in data analysis, the coding categories were constructed using Creswell's [ 15 ] coding techniques for data extraction and interpretation. The coding process involves three sequential steps. The initial stage encompasses open coding , where the researcher examines the data, generates codes to describe and categorize it, and gains a deeper understanding without preconceived ideas. Following open coding is axial coding , where the interrelationships between codes from open coding are analyzed to establish more comprehensive categories or themes. The process concludes with selective coding , refining and integrating categories or themes to identify core concepts emerging from the data. The first coder performed the coding process, then engaged in discussions with the second and third authors to finalize the coding categories for the first five articles. The first coder then proceeded to code all studies and engaged again in discussions with the other authors to ensure the finalization of the coding process. After a comprehensive analysis and capturing of the key information from the included studies, the data extraction and interpretation process yielded several themes. These themes have been categorized and are presented in Table  2 . It is important to note that open coding results were removed from Table  2 for aesthetic reasons, as it included many generic aspects, such as words, short phrases, or sentences mentioned in the studies.

2.7 Synthesize studies

In this stage, we will gather, discuss, and analyze the key findings that emerged from the selected studies. The synthesis stage is considered a transition from an author-centric to a concept-centric focus, enabling us to map all the provided information to achieve the most effective evaluation of the data [ 87 ]. Initially, the authors extracted data that included general information about the selected studies, including the author(s)' names, study titles, years of publication, educational levels, research methodologies, sample sizes, participants, main aims or objectives, raw data sources, and analysis methods. Following that, all key information and significant results from the selected studies were compiled using Creswell’s [ 15 ] coding techniques for data extraction and interpretation to identify core concepts and themes emerging from the data, focusing on those that directly contributed to our research questions and objectives, such as the initial utilization of ChatGPT in learning and teaching, learners' and educators' familiarity with ChatGPT, and the main findings of each study. Finally, the data related to each selected study were extracted into an Excel spreadsheet for data processing. The Excel spreadsheet was reviewed by the authors, including a series of discussions to ensure the finalization of this process and prepare it for further analysis. Afterward, the final result being analyzed and presented in various types of charts and graphs. Table 4 presents the extracted data from the selected studies, with each study labeled with a capital 'S' followed by a number.

This section consists of two main parts. The first part provides a descriptive analysis of the data compiled from the reviewed studies. The second part presents the answers to the research questions and the main findings of these studies.

3.1 Part 1: descriptive analysis

This section will provide a descriptive analysis of the reviewed studies, including educational levels and fields, participants distribution, country contribution, research methodologies, study sample size, study population, publication year, list of journals, familiarity with ChatGPT, source of data, and the main aims and objectives of the studies. Table 4 presents a comprehensive overview of the extracted data from the selected studies.

3.1.1 The number of the reviewed studies and publication years

The total number of the reviewed studies was 14. All studies were empirical studies and published in different journals focusing on Education and Technology. One study was published in 2022 [S1], while the remaining were published in 2023 [S2]-[S14]. Table 3 illustrates the year of publication, the names of the journals, and the number of reviewed studies published in each journal for the studies reviewed.

3.1.2 Educational levels and fields

The majority of the reviewed studies, 11 studies, were conducted in higher education institutions [S1]-[S10] and [S13]. Two studies did not specify the educational level of the population [S12] and [S14], while one study focused on elementary education [S11]. However, the reviewed studies covered various fields of education. Three studies focused on Arts and Humanities Education [S8], [S11], and [S14], specifically English Education. Two studies focused on Engineering Education, with one in Computer Engineering [S2] and the other in Construction Education [S3]. Two studies focused on Mathematics Education [S5] and [S12]. One study focused on Social Science Education [S13]. One study focused on Early Education [S4]. One study focused on Journalism Education [S9]. Finally, three studies did not specify the field of education [S1], [S6], and [S7]. Figure  2 represents the educational levels in the reviewed studies, while Fig.  3 represents the context of the reviewed studies.

Educational levels in the reviewed studies

Context of the reviewed studies

3.1.3 Participants distribution and countries contribution

The reviewed studies have been conducted across different geographic regions, providing a diverse representation of the studies. The majority of the studies, 10 in total, [S1]-[S3], [S5]-[S9], [S11], and [S14], primarily focused on participants from single countries such as Pakistan, the United Arab Emirates, China, Indonesia, Poland, Saudi Arabia, South Korea, Spain, Tajikistan, and the United States. In contrast, four studies, [S4], [S10], [S12], and [S13], involved participants from multiple countries, including China and the United States [S4], China, the United Kingdom, and the United States [S10], the United Arab Emirates, Oman, Saudi Arabia, and Jordan [S12], Turkey, Sweden, Canada, and Australia [ 13 ]. Figures  4 and 5 illustrate the distribution of participants, whether from single or multiple countries, and the contribution of each country in the reviewed studies, respectively.

The reviewed studies conducted in single or multiple countries

The Contribution of each country in the studies

3.1.4 Study population and sample size

Four study populations were included: university students, university teachers, university teachers and students, and elementary school teachers. Six studies involved university students [S2], [S3], [S5] and [S6]-[S8]. Three studies focused on university teachers [S1], [S4], and [S6], while one study specifically targeted elementary school teachers [S11]. Additionally, four studies included both university teachers and students [S10] and [ 12 , 13 , 14 ], and among them, study [S13] specifically included postgraduate students. In terms of the sample size of the reviewed studies, nine studies included a small sample size of less than 50 participants [S1], [S3], [S6], [S8], and [S10]-[S13]. Three studies had 50–100 participants [S2], [S9], and [S14]. Only one study had more than 100 participants [S7]. It is worth mentioning that study [S4] adopted a mixed methods approach, including 10 participants for qualitative analysis and 110 participants for quantitative analysis.

3.1.5 Participants’ familiarity with using ChatGPT

The reviewed studies recruited a diverse range of participants with varying levels of familiarity with ChatGPT. Five studies [S2], [S4], [S6], [S8], and [S12] involved participants already familiar with ChatGPT, while eight studies [S1], [S3], [S5], [S7], [S9], [S10], [S13] and [S14] included individuals with differing levels of familiarity. Notably, one study [S11] had participants who were entirely unfamiliar with ChatGPT. It is important to note that four studies [S3], [S5], [S9], and [S11] provided training or guidance to their participants before conducting their studies, while ten studies [S1], [S2], [S4], [S6]-[S8], [S10], and [S12]-[S14] did not provide training due to the participants' existing familiarity with ChatGPT.

3.1.6 Research methodology approaches and source(S) of data

The reviewed studies adopted various research methodology approaches. Seven studies adopted qualitative research methodology [S1], [S4], [S6], [S8], [S10], [S11], and [S12], while three studies adopted quantitative research methodology [S3], [S7], and [S14], and four studies employed mixed-methods, which involved a combination of both the strengths of qualitative and quantitative methods [S2], [S5], [S9], and [S13].

In terms of the source(s) of data, the reviewed studies obtained their data from various sources, such as interviews, questionnaires, and pre-and post-tests. Six studies relied on interviews as their primary source of data collection [S1], [S4], [S6], [S10], [S11], and [S12], four studies relied on questionnaires [S2], [S7], [S13], and [S14], two studies combined the use of pre-and post-tests and questionnaires for data collection [S3] and [S9], while two studies combined the use of questionnaires and interviews to obtain the data [S5] and [S8]. It is important to note that six of the reviewed studies were quasi-experimental [S3], [S5], [S8], [S9], [S12], and [S14], while the remaining ones were experimental studies [S1], [S2], [S4], [S6], [S7], [S10], [S11], and [S13]. Figures  6 and 7 illustrate the research methodologies and the source (s) of data used in the reviewed studies, respectively.

Research methodologies in the reviewed studies

Source of data in the reviewed studies

3.1.7 The aim and objectives of the studies

The reviewed studies encompassed a diverse set of aims, with several of them incorporating multiple primary objectives. Six studies [S3], [S6], [S7], [S8], [S11], and [S12] examined the integration of ChatGPT in educational contexts, and four studies [S4], [S5], [S13], and [S14] investigated the various implications of its use in education, while three studies [S2], [S9], and [S10] aimed to explore both its integration and implications in education. Additionally, seven studies explicitly explored attitudes and perceptions of students [S2] and [S3], educators [S1] and [S6], or both [S10], [S12], and [S13] regarding the utilization of ChatGPT in educational settings.

3.2 Part 2: research questions and main findings of the reviewed studies

This part will present the answers to the research questions and the main findings of the reviewed studies, classified into two main categories (learning and teaching) according to AI Education classification by [ 36 ]. Figure  8 summarizes the main findings of the reviewed studies in a visually informative diagram. Table 4 provides a detailed list of the key information extracted from the selected studies that led to generating these themes.

The main findings in the reviewed studies

4 Students' initial attempts at utilizing ChatGPT in learning and main findings from students' perspective

4.1 virtual intelligent assistant.

Nine studies demonstrated that ChatGPT has been utilized by students as an intelligent assistant to enhance and support their learning. Students employed it for various purposes, such as answering on-demand questions [S2]-[S5], [S8], [S10], and [S12], providing valuable information and learning resources [S2]-[S5], [S6], and [S8], as well as receiving immediate feedback [S2], [S4], [S9], [S10], and [S12]. In this regard, students generally were confident in the accuracy of ChatGPT's responses, considering them relevant, reliable, and detailed [S3], [S4], [S5], and [S8]. However, some students indicated the need for improvement, as they found that answers are not always accurate [S2], and that misleading information may have been provided or that it may not always align with their expectations [S6] and [S10]. It was also observed by the students that the accuracy of ChatGPT is dependent on several factors, including the quality and specificity of the user's input, the complexity of the question or topic, and the scope and relevance of its training data [S12]. Many students felt that ChatGPT's answers were not always accurate and most of them believed that it requires good background knowledge to work with.

4.2 Writing and language proficiency assistant

Six of the reviewed studies highlighted that ChatGPT has been utilized by students as a valuable assistant tool to improve their academic writing skills and language proficiency. Among these studies, three mainly focused on English education, demonstrating that students showed sufficient mastery in using ChatGPT for generating ideas, summarizing, paraphrasing texts, and completing writing essays [S8], [S11], and [S14]. Furthermore, ChatGPT helped them in writing by making students active investigators rather than passive knowledge recipients and facilitated the development of their writing skills [S11] and [S14]. Similarly, ChatGPT allowed students to generate unique ideas and perspectives, leading to deeper analysis and reflection on their journalism writing [S9]. In terms of language proficiency, ChatGPT allowed participants to translate content into their home languages, making it more accessible and relevant to their context [S4]. It also enabled them to request changes in linguistic tones or flavors [S8]. Moreover, participants used it to check grammar or as a dictionary [S11].

4.3 Valuable resource for learning approaches

Five studies demonstrated that students used ChatGPT as a valuable complementary resource for self-directed learning. It provided learning resources and guidance on diverse educational topics and created a supportive home learning environment [S2] and [S4]. Moreover, it offered step-by-step guidance to grasp concepts at their own pace and enhance their understanding [S5], streamlined task and project completion carried out independently [S7], provided comprehensive and easy-to-understand explanations on various subjects [S10], and assisted in studying geometry operations, thereby empowering them to explore geometry operations at their own pace [S12]. Three studies showed that students used ChatGPT as a valuable learning resource for personalized learning. It delivered age-appropriate conversations and tailored teaching based on a child's interests [S4], acted as a personalized learning assistant, adapted to their needs and pace, which assisted them in understanding mathematical concepts [S12], and enabled personalized learning experiences in social sciences by adapting to students' needs and learning styles [S13]. On the other hand, it is important to note that, according to one study [S5], students suggested that using ChatGPT may negatively affect collaborative learning competencies between students.

4.4 Enhancing students' competencies

Six of the reviewed studies have shown that ChatGPT is a valuable tool for improving a wide range of skills among students. Two studies have provided evidence that ChatGPT led to improvements in students' critical thinking, reasoning skills, and hazard recognition competencies through engaging them in interactive conversations or activities and providing responses related to their disciplines in journalism [S5] and construction education [S9]. Furthermore, two studies focused on mathematical education have shown the positive impact of ChatGPT on students' problem-solving abilities in unraveling problem-solving questions [S12] and enhancing the students' understanding of the problem-solving process [S5]. Lastly, one study indicated that ChatGPT effectively contributed to the enhancement of conversational social skills [S4].

4.5 Supporting students' academic success

Seven of the reviewed studies highlighted that students found ChatGPT to be beneficial for learning as it enhanced learning efficiency and improved the learning experience. It has been observed to improve students' efficiency in computer engineering studies by providing well-structured responses and good explanations [S2]. Additionally, students found it extremely useful for hazard reporting [S3], and it also enhanced their efficiency in solving mathematics problems and capabilities [S5] and [S12]. Furthermore, by finding information, generating ideas, translating texts, and providing alternative questions, ChatGPT aided students in deepening their understanding of various subjects [S6]. It contributed to an increase in students' overall productivity [S7] and improved efficiency in composing written tasks [S8]. Regarding learning experiences, ChatGPT was instrumental in assisting students in identifying hazards that they might have otherwise overlooked [S3]. It also improved students' learning experiences in solving mathematics problems and developing abilities [S5] and [S12]. Moreover, it increased students' successful completion of important tasks in their studies [S7], particularly those involving average difficulty writing tasks [S8]. Additionally, ChatGPT increased the chances of educational success by providing students with baseline knowledge on various topics [S10].

5 Teachers' initial attempts at utilizing ChatGPT in teaching and main findings from teachers' perspective

5.1 valuable resource for teaching.

The reviewed studies showed that teachers have employed ChatGPT to recommend, modify, and generate diverse, creative, organized, and engaging educational contents, teaching materials, and testing resources more rapidly [S4], [S6], [S10] and [S11]. Additionally, teachers experienced increased productivity as ChatGPT facilitated quick and accurate responses to questions, fact-checking, and information searches [S1]. It also proved valuable in constructing new knowledge [S6] and providing timely answers to students' questions in classrooms [S11]. Moreover, ChatGPT enhanced teachers' efficiency by generating new ideas for activities and preplanning activities for their students [S4] and [S6], including interactive language game partners [S11].

5.2 Improving productivity and efficiency

The reviewed studies showed that participants' productivity and work efficiency have been significantly enhanced by using ChatGPT as it enabled them to allocate more time to other tasks and reduce their overall workloads [S6], [S10], [S11], [S13], and [S14]. However, three studies [S1], [S4], and [S11], indicated a negative perception and attitude among teachers toward using ChatGPT. This negativity stemmed from a lack of necessary skills to use it effectively [S1], a limited familiarity with it [S4], and occasional inaccuracies in the content provided by it [S10].

5.3 Catalyzing new teaching methodologies

Five of the reviewed studies highlighted that educators found the necessity of redefining their teaching profession with the assistance of ChatGPT [S11], developing new effective learning strategies [S4], and adapting teaching strategies and methodologies to ensure the development of essential skills for future engineers [S5]. They also emphasized the importance of adopting new educational philosophies and approaches that can evolve with the introduction of ChatGPT into the classroom [S12]. Furthermore, updating curricula to focus on improving human-specific features, such as emotional intelligence, creativity, and philosophical perspectives [S13], was found to be essential.

5.4 Effective utilization of CHATGPT in teaching

According to the reviewed studies, effective utilization of ChatGPT in education requires providing teachers with well-structured training, support, and adequate background on how to use ChatGPT responsibly [S1], [S3], [S11], and [S12]. Establishing clear rules and regulations regarding its usage is essential to ensure it positively impacts the teaching and learning processes, including students' skills [S1], [S4], [S5], [S8], [S9], and [S11]-[S14]. Moreover, conducting further research and engaging in discussions with policymakers and stakeholders is indeed crucial for the successful integration of ChatGPT in education and to maximize the benefits for both educators and students [S1], [S6]-[S10], and [S12]-[S14].

6 Discussion

The purpose of this review is to conduct a systematic review of empirical studies that have explored the utilization of ChatGPT, one of today’s most advanced LLM-based chatbots, in education. The findings of the reviewed studies showed several ways of ChatGPT utilization in different learning and teaching practices as well as it provided insights and considerations that can facilitate its effective and responsible use in future educational contexts. The results of the reviewed studies came from diverse fields of education, which helped us avoid a biased review that is limited to a specific field. Similarly, the reviewed studies have been conducted across different geographic regions. This kind of variety in geographic representation enriched the findings of this review.

In response to RQ1 , "What are students' and teachers' initial attempts at utilizing ChatGPT in education?", the findings from this review provide comprehensive insights. Chatbots, including ChatGPT, play a crucial role in supporting student learning, enhancing their learning experiences, and facilitating diverse learning approaches [ 42 , 43 ]. This review found that this tool, ChatGPT, has been instrumental in enhancing students' learning experiences by serving as a virtual intelligent assistant, providing immediate feedback, on-demand answers, and engaging in educational conversations. Additionally, students have benefited from ChatGPT’s ability to generate ideas, compose essays, and perform tasks like summarizing, translating, paraphrasing texts, or checking grammar, thereby enhancing their writing and language competencies. Furthermore, students have turned to ChatGPT for assistance in understanding concepts and homework, providing structured learning plans, and clarifying assignments and tasks, which fosters a supportive home learning environment, allowing them to take responsibility for their own learning and cultivate the skills and approaches essential for supportive home learning environment [ 26 , 27 , 28 ]. This finding aligns with the study of Saqr et al. [ 68 , 69 ] who highlighted that, when students actively engage in their own learning process, it yields additional advantages, such as heightened motivation, enhanced achievement, and the cultivation of enthusiasm, turning them into advocates for their own learning.

Moreover, students have utilized ChatGPT for tailored teaching and step-by-step guidance on diverse educational topics, streamlining task and project completion, and generating and recommending educational content. This personalization enhances the learning environment, leading to increased academic success. This finding aligns with other recent studies [ 26 , 27 , 28 , 60 , 66 ] which revealed that ChatGPT has the potential to offer personalized learning experiences and support an effective learning process by providing students with customized feedback and explanations tailored to their needs and abilities. Ultimately, fostering students' performance, engagement, and motivation, leading to increase students' academic success [ 14 , 44 , 58 ]. This ultimate outcome is in line with the findings of Saqr et al. [ 68 , 69 ], which emphasized that learning strategies are important catalysts of students' learning, as students who utilize effective learning strategies are more likely to have better academic achievement.

Teachers, too, have capitalized on ChatGPT's capabilities to enhance productivity and efficiency, using it for creating lesson plans, generating quizzes, providing additional resources, generating and preplanning new ideas for activities, and aiding in answering students’ questions. This adoption of technology introduces new opportunities to support teaching and learning practices, enhancing teacher productivity. This finding aligns with those of Day [ 17 ], De Castro [ 18 ], and Su and Yang [ 74 ] as well as with those of Valtonen et al. [ 82 ], who revealed that emerging technological advancements have opened up novel opportunities and means to support teaching and learning practices, and enhance teachers’ productivity.

In response to RQ2 , "What are the main findings derived from empirical studies that have incorporated ChatGPT into learning and teaching?", the findings from this review provide profound insights and raise significant concerns. Starting with the insights, chatbots, including ChatGPT, have demonstrated the potential to reshape and revolutionize education, creating new, novel opportunities for enhancing the learning process and outcomes [ 83 ], facilitating different learning approaches, and offering a range of pedagogical benefits [ 19 , 43 , 72 ]. In this context, this review found that ChatGPT could open avenues for educators to adopt or develop new effective learning and teaching strategies that can evolve with the introduction of ChatGPT into the classroom. Nonetheless, there is an evident lack of research understanding regarding the potential impact of generative machine learning models within diverse educational settings [ 83 ]. This necessitates teachers to attain a high level of proficiency in incorporating chatbots, such as ChatGPT, into their classrooms to create inventive, well-structured, and captivating learning strategies. In the same vein, the review also found that teachers without the requisite skills to utilize ChatGPT realized that it did not contribute positively to their work and could potentially have adverse effects [ 37 ]. This concern could lead to inequity of access to the benefits of chatbots, including ChatGPT, as individuals who lack the necessary expertise may not be able to harness their full potential, resulting in disparities in educational outcomes and opportunities. Therefore, immediate action is needed to address these potential issues. A potential solution is offering training, support, and competency development for teachers to ensure that all of them can leverage chatbots, including ChatGPT, effectively and equitably in their educational practices [ 5 , 28 , 80 ], which could enhance accessibility and inclusivity, and potentially result in innovative outcomes [ 82 , 83 ].

Additionally, chatbots, including ChatGPT, have the potential to significantly impact students' thinking abilities, including retention, reasoning, analysis skills [ 19 , 45 ], and foster innovation and creativity capabilities [ 83 ]. This review found that ChatGPT could contribute to improving a wide range of skills among students. However, it found that frequent use of ChatGPT may result in a decrease in innovative capacities, collaborative skills and cognitive capacities, and students' motivation to attend classes, as well as could lead to reduced higher-order thinking skills among students [ 22 , 29 ]. Therefore, immediate action is needed to carefully examine the long-term impact of chatbots such as ChatGPT, on learning outcomes as well as to explore its incorporation into educational settings as a supportive tool without compromising students' cognitive development and critical thinking abilities. In the same vein, the review also found that it is challenging to draw a consistent conclusion regarding the potential of ChatGPT to aid self-directed learning approach. This finding aligns with the recent study of Baskara [ 8 ]. Therefore, further research is needed to explore the potential of ChatGPT for self-directed learning. One potential solution involves utilizing learning analytics as a novel approach to examine various aspects of students' learning and support them in their individual endeavors [ 32 ]. This approach can bridge this gap by facilitating an in-depth analysis of how learners engage with ChatGPT, identifying trends in self-directed learning behavior, and assessing its influence on their outcomes.

Turning to the significant concerns, on the other hand, a fundamental challenge with LLM-based chatbots, including ChatGPT, is the accuracy and quality of the provided information and responses, as they provide false information as truth—a phenomenon often referred to as "hallucination" [ 3 , 49 ]. In this context, this review found that the provided information was not entirely satisfactory. Consequently, the utilization of chatbots presents potential concerns, such as generating and providing inaccurate or misleading information, especially for students who utilize it to support their learning. This finding aligns with other findings [ 6 , 30 , 35 , 40 ] which revealed that incorporating chatbots such as ChatGPT, into education presents challenges related to its accuracy and reliability due to its training on a large corpus of data, which may contain inaccuracies and the way users formulate or ask ChatGPT. Therefore, immediate action is needed to address these potential issues. One possible solution is to equip students with the necessary skills and competencies, which include a background understanding of how to use it effectively and the ability to assess and evaluate the information it generates, as the accuracy and the quality of the provided information depend on the input, its complexity, the topic, and the relevance of its training data [ 28 , 49 , 86 ]. However, it's also essential to examine how learners can be educated about how these models operate, the data used in their training, and how to recognize their limitations, challenges, and issues [ 79 ].

Furthermore, chatbots present a substantial challenge concerning maintaining academic integrity [ 20 , 56 ] and copyright violations [ 83 ], which are significant concerns in education. The review found that the potential misuse of ChatGPT might foster cheating, facilitate plagiarism, and threaten academic integrity. This issue is also affirmed by the research conducted by Basic et al. [ 7 ], who presented evidence that students who utilized ChatGPT in their writing assignments had more plagiarism cases than those who did not. These findings align with the conclusions drawn by Cotton et al. [ 13 ], Hisan and Amri [ 33 ] and Sullivan et al. [ 75 ], who revealed that the integration of chatbots such as ChatGPT into education poses a significant challenge to the preservation of academic integrity. Moreover, chatbots, including ChatGPT, have increased the difficulty in identifying plagiarism [ 47 , 67 , 76 ]. The findings from previous studies [ 1 , 84 ] indicate that AI-generated text often went undetected by plagiarism software, such as Turnitin. However, Turnitin and other similar plagiarism detection tools, such as ZeroGPT, GPTZero, and Copyleaks, have since evolved, incorporating enhanced techniques to detect AI-generated text, despite the possibility of false positives, as noted in different studies that have found these tools still not yet fully ready to accurately and reliably identify AI-generated text [ 10 , 51 ], and new novel detection methods may need to be created and implemented for AI-generated text detection [ 4 ]. This potential issue could lead to another concern, which is the difficulty of accurately evaluating student performance when they utilize chatbots such as ChatGPT assistance in their assignments. Consequently, the most LLM-driven chatbots present a substantial challenge to traditional assessments [ 64 ]. The findings from previous studies indicate the importance of rethinking, improving, and redesigning innovative assessment methods in the era of chatbots [ 14 , 20 , 64 , 75 ]. These methods should prioritize the process of evaluating students' ability to apply knowledge to complex cases and demonstrate comprehension, rather than solely focusing on the final product for assessment. Therefore, immediate action is needed to address these potential issues. One possible solution would be the development of clear guidelines, regulatory policies, and pedagogical guidance. These measures would help regulate the proper and ethical utilization of chatbots, such as ChatGPT, and must be established before their introduction to students [ 35 , 38 , 39 , 41 , 89 ].

In summary, our review has delved into the utilization of ChatGPT, a prominent example of chatbots, in education, addressing the question of how ChatGPT has been utilized in education. However, there remain significant gaps, which necessitate further research to shed light on this area.

7 Conclusions

This systematic review has shed light on the varied initial attempts at incorporating ChatGPT into education by both learners and educators, while also offering insights and considerations that can facilitate its effective and responsible use in future educational contexts. From the analysis of 14 selected studies, the review revealed the dual-edged impact of ChatGPT in educational settings. On the positive side, ChatGPT significantly aided the learning process in various ways. Learners have used it as a virtual intelligent assistant, benefiting from its ability to provide immediate feedback, on-demand answers, and easy access to educational resources. Additionally, it was clear that learners have used it to enhance their writing and language skills, engaging in practices such as generating ideas, composing essays, and performing tasks like summarizing, translating, paraphrasing texts, or checking grammar. Importantly, other learners have utilized it in supporting and facilitating their directed and personalized learning on a broad range of educational topics, assisting in understanding concepts and homework, providing structured learning plans, and clarifying assignments and tasks. Educators, on the other hand, found ChatGPT beneficial for enhancing productivity and efficiency. They used it for creating lesson plans, generating quizzes, providing additional resources, and answers learners' questions, which saved time and allowed for more dynamic and engaging teaching strategies and methodologies.

However, the review also pointed out negative impacts. The results revealed that overuse of ChatGPT could decrease innovative capacities and collaborative learning among learners. Specifically, relying too much on ChatGPT for quick answers can inhibit learners' critical thinking and problem-solving skills. Learners might not engage deeply with the material or consider multiple solutions to a problem. This tendency was particularly evident in group projects, where learners preferred consulting ChatGPT individually for solutions over brainstorming and collaborating with peers, which negatively affected their teamwork abilities. On a broader level, integrating ChatGPT into education has also raised several concerns, including the potential for providing inaccurate or misleading information, issues of inequity in access, challenges related to academic integrity, and the possibility of misusing the technology.

Accordingly, this review emphasizes the urgency of developing clear rules, policies, and regulations to ensure ChatGPT's effective and responsible use in educational settings, alongside other chatbots, by both learners and educators. This requires providing well-structured training to educate them on responsible usage and understanding its limitations, along with offering sufficient background information. Moreover, it highlights the importance of rethinking, improving, and redesigning innovative teaching and assessment methods in the era of ChatGPT. Furthermore, conducting further research and engaging in discussions with policymakers and stakeholders are essential steps to maximize the benefits for both educators and learners and ensure academic integrity.

It is important to acknowledge that this review has certain limitations. Firstly, the limited inclusion of reviewed studies can be attributed to several reasons, including the novelty of the technology, as new technologies often face initial skepticism and cautious adoption; the lack of clear guidelines or best practices for leveraging this technology for educational purposes; and institutional or governmental policies affecting the utilization of this technology in educational contexts. These factors, in turn, have affected the number of studies available for review. Secondly, the utilization of the original version of ChatGPT, based on GPT-3 or GPT-3.5, implies that new studies utilizing the updated version, GPT-4 may lead to different findings. Therefore, conducting follow-up systematic reviews is essential once more empirical studies on ChatGPT are published. Additionally, long-term studies are necessary to thoroughly examine and assess the impact of ChatGPT on various educational practices.

Despite these limitations, this systematic review has highlighted the transformative potential of ChatGPT in education, revealing its diverse utilization by learners and educators alike and summarized the benefits of incorporating it into education, as well as the forefront critical concerns and challenges that must be addressed to facilitate its effective and responsible use in future educational contexts. This review could serve as an insightful resource for practitioners who seek to integrate ChatGPT into education and stimulate further research in the field.

Data availability

The data supporting our findings are available upon request.

Abbreviations

• Artificial intelligence

AI in education

Large language model

Artificial neural networks

Chat Generative Pre-Trained Transformer

Recurrent neural networks

Long short-term memory

Reinforcement learning from human feedback

Natural language processing

Preferred Reporting Items for Systematic Reviews and Meta-Analyses

AlAfnan MA, Dishari S, Jovic M, Lomidze K. ChatGPT as an educational tool: opportunities, challenges, and recommendations for communication, business writing, and composition courses. J Artif Intell Technol. 2023. https://doi.org/10.37965/jait.2023.0184 .

Article   Google Scholar  

Ali JKM, Shamsan MAA, Hezam TA, Mohammed AAQ. Impact of ChatGPT on learning motivation. J Engl Stud Arabia Felix. 2023;2(1):41–9. https://doi.org/10.56540/jesaf.v2i1.51 .

Alkaissi H, McFarlane SI. Artificial hallucinations in ChatGPT: implications in scientific writing. Cureus. 2023. https://doi.org/10.7759/cureus.35179 .

Anderson N, Belavý DL, Perle SM, Hendricks S, Hespanhol L, Verhagen E, Memon AR. AI did not write this manuscript, or did it? Can we trick the AI text detector into generated texts? The potential future of ChatGPT and AI in sports & exercise medicine manuscript generation. BMJ Open Sport Exerc Med. 2023;9(1): e001568. https://doi.org/10.1136/bmjsem-2023-001568 .

Ausat AMA, Massang B, Efendi M, Nofirman N, Riady Y. Can chat GPT replace the role of the teacher in the classroom: a fundamental analysis. J Educ. 2023;5(4):16100–6.

Google Scholar  

Baidoo-Anu D, Ansah L. Education in the Era of generative artificial intelligence (AI): understanding the potential benefits of ChatGPT in promoting teaching and learning. Soc Sci Res Netw. 2023. https://doi.org/10.2139/ssrn.4337484 .

Basic Z, Banovac A, Kruzic I, Jerkovic I. Better by you, better than me, chatgpt3 as writing assistance in students essays. 2023. arXiv preprint arXiv:2302.04536 .‏

Baskara FR. The promises and pitfalls of using chat GPT for self-determined learning in higher education: an argumentative review. Prosiding Seminar Nasional Fakultas Tarbiyah dan Ilmu Keguruan IAIM Sinjai. 2023;2:95–101. https://doi.org/10.47435/sentikjar.v2i0.1825 .

Behera RK, Bala PK, Dhir A. The emerging role of cognitive computing in healthcare: a systematic literature review. Int J Med Inform. 2019;129:154–66. https://doi.org/10.1016/j.ijmedinf.2019.04.024 .

Chaka C. Detecting AI content in responses generated by ChatGPT, YouChat, and Chatsonic: the case of five AI content detection tools. J Appl Learn Teach. 2023. https://doi.org/10.37074/jalt.2023.6.2.12 .

Chiu TKF, Xia Q, Zhou X, Chai CS, Cheng M. Systematic literature review on opportunities, challenges, and future research recommendations of artificial intelligence in education. Comput Educ Artif Intell. 2023;4:100118. https://doi.org/10.1016/j.caeai.2022.100118 .

Choi EPH, Lee JJ, Ho M, Kwok JYY, Lok KYW. Chatting or cheating? The impacts of ChatGPT and other artificial intelligence language models on nurse education. Nurse Educ Today. 2023;125:105796. https://doi.org/10.1016/j.nedt.2023.105796 .

Cotton D, Cotton PA, Shipway JR. Chatting and cheating: ensuring academic integrity in the era of ChatGPT. Innov Educ Teach Int. 2023. https://doi.org/10.1080/14703297.2023.2190148 .

Crawford J, Cowling M, Allen K. Leadership is needed for ethical ChatGPT: Character, assessment, and learning using artificial intelligence (AI). J Univ Teach Learn Pract. 2023. https://doi.org/10.53761/1.20.3.02 .

Creswell JW. Educational research: planning, conducting, and evaluating quantitative and qualitative research [Ebook]. 4th ed. London: Pearson Education; 2015.

Curry D. ChatGPT Revenue and Usage Statistics (2023)—Business of Apps. 2023. https://www.businessofapps.com/data/chatgpt-statistics/

Day T. A preliminary investigation of fake peer-reviewed citations and references generated by ChatGPT. Prof Geogr. 2023. https://doi.org/10.1080/00330124.2023.2190373 .

De Castro CA. A Discussion about the Impact of ChatGPT in education: benefits and concerns. J Bus Theor Pract. 2023;11(2):p28. https://doi.org/10.22158/jbtp.v11n2p28 .

Deng X, Yu Z. A meta-analysis and systematic review of the effect of Chatbot technology use in sustainable education. Sustainability. 2023;15(4):2940. https://doi.org/10.3390/su15042940 .

Eke DO. ChatGPT and the rise of generative AI: threat to academic integrity? J Responsib Technol. 2023;13:100060. https://doi.org/10.1016/j.jrt.2023.100060 .

Elmoazen R, Saqr M, Tedre M, Hirsto L. A systematic literature review of empirical research on epistemic network analysis in education. IEEE Access. 2022;10:17330–48. https://doi.org/10.1109/access.2022.3149812 .

Farrokhnia M, Banihashem SK, Noroozi O, Wals AEJ. A SWOT analysis of ChatGPT: implications for educational practice and research. Innov Educ Teach Int. 2023. https://doi.org/10.1080/14703297.2023.2195846 .

Fergus S, Botha M, Ostovar M. Evaluating academic answers generated using ChatGPT. J Chem Educ. 2023;100(4):1672–5. https://doi.org/10.1021/acs.jchemed.3c00087 .

Fink A. Conducting research literature reviews: from the Internet to Paper. Incorporated: SAGE Publications; 2010.

Firaina R, Sulisworo D. Exploring the usage of ChatGPT in higher education: frequency and impact on productivity. Buletin Edukasi Indonesia (BEI). 2023;2(01):39–46. https://doi.org/10.56741/bei.v2i01.310 .

Firat, M. (2023). How chat GPT can transform autodidactic experiences and open education.  Department of Distance Education, Open Education Faculty, Anadolu Unive .‏ https://orcid.org/0000-0001-8707-5918

Firat M. What ChatGPT means for universities: perceptions of scholars and students. J Appl Learn Teach. 2023. https://doi.org/10.37074/jalt.2023.6.1.22 .

Fuchs K. Exploring the opportunities and challenges of NLP models in higher education: is Chat GPT a blessing or a curse? Front Educ. 2023. https://doi.org/10.3389/feduc.2023.1166682 .

García-Peñalvo FJ. La percepción de la inteligencia artificial en contextos educativos tras el lanzamiento de ChatGPT: disrupción o pánico. Educ Knowl Soc. 2023;24: e31279. https://doi.org/10.14201/eks.31279 .

Gilson A, Safranek CW, Huang T, Socrates V, Chi L, Taylor A, Chartash D. How does ChatGPT perform on the United States medical Licensing examination? The implications of large language models for medical education and knowledge assessment. JMIR Med Educ. 2023;9: e45312. https://doi.org/10.2196/45312 .

Hashana AJ, Brundha P, Ayoobkhan MUA, Fazila S. Deep Learning in ChatGPT—A Survey. In   2023 7th international conference on trends in electronics and informatics (ICOEI) . 2023. (pp. 1001–1005). IEEE. https://doi.org/10.1109/icoei56765.2023.10125852

Hirsto L, Saqr M, López-Pernas S, Valtonen T. (2022). A systematic narrative review of learning analytics research in K-12 and schools.  Proceedings . https://ceur-ws.org/Vol-3383/FLAIEC22_paper_9536.pdf

Hisan UK, Amri MM. ChatGPT and medical education: a double-edged sword. J Pedag Educ Sci. 2023;2(01):71–89. https://doi.org/10.13140/RG.2.2.31280.23043/1 .

Hopkins AM, Logan JM, Kichenadasse G, Sorich MJ. Artificial intelligence chatbots will revolutionize how cancer patients access information: ChatGPT represents a paradigm-shift. JNCI Cancer Spectr. 2023. https://doi.org/10.1093/jncics/pkad010 .

Househ M, AlSaad R, Alhuwail D, Ahmed A, Healy MG, Latifi S, Sheikh J. Large Language models in medical education: opportunities, challenges, and future directions. JMIR Med Educ. 2023;9: e48291. https://doi.org/10.2196/48291 .

Ilkka T. The impact of artificial intelligence on learning, teaching, and education. Minist de Educ. 2018. https://doi.org/10.2760/12297 .

Iqbal N, Ahmed H, Azhar KA. Exploring teachers’ attitudes towards using CHATGPT. Globa J Manag Adm Sci. 2022;3(4):97–111. https://doi.org/10.46568/gjmas.v3i4.163 .

Irfan M, Murray L, Ali S. Integration of Artificial intelligence in academia: a case study of critical teaching and learning in Higher education. Globa Soc Sci Rev. 2023;8(1):352–64. https://doi.org/10.31703/gssr.2023(viii-i).32 .

Jeon JH, Lee S. Large language models in education: a focus on the complementary relationship between human teachers and ChatGPT. Educ Inf Technol. 2023. https://doi.org/10.1007/s10639-023-11834-1 .

Khan RA, Jawaid M, Khan AR, Sajjad M. ChatGPT—Reshaping medical education and clinical management. Pak J Med Sci. 2023. https://doi.org/10.12669/pjms.39.2.7653 .

King MR. A conversation on artificial intelligence, Chatbots, and plagiarism in higher education. Cell Mol Bioeng. 2023;16(1):1–2. https://doi.org/10.1007/s12195-022-00754-8 .

Kooli C. Chatbots in education and research: a critical examination of ethical implications and solutions. Sustainability. 2023;15(7):5614. https://doi.org/10.3390/su15075614 .

Kuhail MA, Alturki N, Alramlawi S, Alhejori K. Interacting with educational chatbots: a systematic review. Educ Inf Technol. 2022;28(1):973–1018. https://doi.org/10.1007/s10639-022-11177-3 .

Lee H. The rise of ChatGPT: exploring its potential in medical education. Anat Sci Educ. 2023. https://doi.org/10.1002/ase.2270 .

Li L, Subbareddy R, Raghavendra CG. AI intelligence Chatbot to improve students learning in the higher education platform. J Interconnect Netw. 2022. https://doi.org/10.1142/s0219265921430325 .

Limna P. A Review of Artificial Intelligence (AI) in Education during the Digital Era. 2022. https://ssrn.com/abstract=4160798

Lo CK. What is the impact of ChatGPT on education? A rapid review of the literature. Educ Sci. 2023;13(4):410. https://doi.org/10.3390/educsci13040410 .

Luo W, He H, Liu J, Berson IR, Berson MJ, Zhou Y, Li H. Aladdin’s genie or pandora’s box For early childhood education? Experts chat on the roles, challenges, and developments of ChatGPT. Early Educ Dev. 2023. https://doi.org/10.1080/10409289.2023.2214181 .

Meyer JG, Urbanowicz RJ, Martin P, O’Connor K, Li R, Peng P, Moore JH. ChatGPT and large language models in academia: opportunities and challenges. Biodata Min. 2023. https://doi.org/10.1186/s13040-023-00339-9 .

Mhlanga D. Open AI in education, the responsible and ethical use of ChatGPT towards lifelong learning. Soc Sci Res Netw. 2023. https://doi.org/10.2139/ssrn.4354422 .

Neumann, M., Rauschenberger, M., & Schön, E. M. (2023). “We Need To Talk About ChatGPT”: The Future of AI and Higher Education.‏ https://doi.org/10.1109/seeng59157.2023.00010

Nolan B. Here are the schools and colleges that have banned the use of ChatGPT over plagiarism and misinformation fears. Business Insider . 2023. https://www.businessinsider.com

O’Leary DE. An analysis of three chatbots: BlenderBot, ChatGPT and LaMDA. Int J Intell Syst Account, Financ Manag. 2023;30(1):41–54. https://doi.org/10.1002/isaf.1531 .

Okoli C. A guide to conducting a standalone systematic literature review. Commun Assoc Inf Syst. 2015. https://doi.org/10.17705/1cais.03743 .

OpenAI. (2023). https://openai.com/blog/chatgpt

Perkins M. Academic integrity considerations of AI large language models in the post-pandemic era: ChatGPT and beyond. J Univ Teach Learn Pract. 2023. https://doi.org/10.53761/1.20.02.07 .

Plevris V, Papazafeiropoulos G, Rios AJ. Chatbots put to the test in math and logic problems: A preliminary comparison and assessment of ChatGPT-3.5, ChatGPT-4, and Google Bard. arXiv (Cornell University) . 2023. https://doi.org/10.48550/arxiv.2305.18618

Rahman MM, Watanobe Y (2023) ChatGPT for education and research: opportunities, threats, and strategies. Appl Sci 13(9):5783. https://doi.org/10.3390/app13095783

Ram B, Verma P. Artificial intelligence AI-based Chatbot study of ChatGPT, google AI bard and baidu AI. World J Adv Eng Technol Sci. 2023;8(1):258–61. https://doi.org/10.30574/wjaets.2023.8.1.0045 .

Rasul T, Nair S, Kalendra D, Robin M, de Oliveira Santini F, Ladeira WJ, Heathcote L. The role of ChatGPT in higher education: benefits, challenges, and future research directions. J Appl Learn Teach. 2023. https://doi.org/10.37074/jalt.2023.6.1.29 .

Ratnam M, Sharm B, Tomer A. ChatGPT: educational artificial intelligence. Int J Adv Trends Comput Sci Eng. 2023;12(2):84–91. https://doi.org/10.30534/ijatcse/2023/091222023 .

Ray PP. ChatGPT: a comprehensive review on background, applications, key challenges, bias, ethics, limitations and future scope. Internet Things Cyber-Phys Syst. 2023;3:121–54. https://doi.org/10.1016/j.iotcps.2023.04.003 .

Roumeliotis KI, Tselikas ND. ChatGPT and Open-AI models: a preliminary review. Future Internet. 2023;15(6):192. https://doi.org/10.3390/fi15060192 .

Rudolph J, Tan S, Tan S. War of the chatbots: Bard, Bing Chat, ChatGPT, Ernie and beyond. The new AI gold rush and its impact on higher education. J Appl Learn Teach. 2023. https://doi.org/10.37074/jalt.2023.6.1.23 .

Ruiz LMS, Moll-López S, Nuñez-Pérez A, Moraño J, Vega-Fleitas E. ChatGPT challenges blended learning methodologies in engineering education: a case study in mathematics. Appl Sci. 2023;13(10):6039. https://doi.org/10.3390/app13106039 .

Sallam M, Salim NA, Barakat M, Al-Tammemi AB. ChatGPT applications in medical, dental, pharmacy, and public health education: a descriptive study highlighting the advantages and limitations. Narra J. 2023;3(1): e103. https://doi.org/10.52225/narra.v3i1.103 .

Salvagno M, Taccone FS, Gerli AG. Can artificial intelligence help for scientific writing? Crit Care. 2023. https://doi.org/10.1186/s13054-023-04380-2 .

Saqr M, López-Pernas S, Helske S, Hrastinski S. The longitudinal association between engagement and achievement varies by time, students’ profiles, and achievement state: a full program study. Comput Educ. 2023;199:104787. https://doi.org/10.1016/j.compedu.2023.104787 .

Saqr M, Matcha W, Uzir N, Jovanović J, Gašević D, López-Pernas S. Transferring effective learning strategies across learning contexts matters: a study in problem-based learning. Australas J Educ Technol. 2023;39(3):9.

Schöbel S, Schmitt A, Benner D, Saqr M, Janson A, Leimeister JM. Charting the evolution and future of conversational agents: a research agenda along five waves and new frontiers. Inf Syst Front. 2023. https://doi.org/10.1007/s10796-023-10375-9 .

Shoufan A. Exploring students’ perceptions of CHATGPT: thematic analysis and follow-up survey. IEEE Access. 2023. https://doi.org/10.1109/access.2023.3268224 .

Sonderegger S, Seufert S. Chatbot-mediated learning: conceptual framework for the design of Chatbot use cases in education. Gallen: Institute for Educational Management and Technologies, University of St; 2022. https://doi.org/10.5220/0010999200003182 .

Book   Google Scholar  

Strzelecki A. To use or not to use ChatGPT in higher education? A study of students’ acceptance and use of technology. Interact Learn Environ. 2023. https://doi.org/10.1080/10494820.2023.2209881 .

Su J, Yang W. Unlocking the power of ChatGPT: a framework for applying generative AI in education. ECNU Rev Educ. 2023. https://doi.org/10.1177/20965311231168423 .

Sullivan M, Kelly A, McLaughlan P. ChatGPT in higher education: Considerations for academic integrity and student learning. J ApplLearn Teach. 2023;6(1):1–10. https://doi.org/10.37074/jalt.2023.6.1.17 .

Szabo A. ChatGPT is a breakthrough in science and education but fails a test in sports and exercise psychology. Balt J Sport Health Sci. 2023;1(128):25–40. https://doi.org/10.33607/bjshs.v127i4.1233 .

Taecharungroj V. “What can ChatGPT do?” analyzing early reactions to the innovative AI chatbot on Twitter. Big Data Cognit Comput. 2023;7(1):35. https://doi.org/10.3390/bdcc7010035 .

Tam S, Said RB. User preferences for ChatGPT-powered conversational interfaces versus traditional methods. Biomed Eng Soc. 2023. https://doi.org/10.58496/mjcsc/2023/004 .

Tedre M, Kahila J, Vartiainen H. (2023). Exploration on how co-designing with AI facilitates critical evaluation of ethics of AI in craft education. In: Langran E, Christensen P, Sanson J (Eds).  Proceedings of Society for Information Technology and Teacher Education International Conference . 2023. pp. 2289–2296.

Tlili A, Shehata B, Adarkwah MA, Bozkurt A, Hickey DT, Huang R, Agyemang B. What if the devil is my guardian angel: ChatGPT as a case study of using chatbots in education. Smart Learn Environ. 2023. https://doi.org/10.1186/s40561-023-00237-x .

Uddin SMJ, Albert A, Ovid A, Alsharef A. Leveraging CHATGPT to aid construction hazard recognition and support safety education and training. Sustainability. 2023;15(9):7121. https://doi.org/10.3390/su15097121 .

Valtonen T, López-Pernas S, Saqr M, Vartiainen H, Sointu E, Tedre M. The nature and building blocks of educational technology research. Comput Hum Behav. 2022;128:107123. https://doi.org/10.1016/j.chb.2021.107123 .

Vartiainen H, Tedre M. Using artificial intelligence in craft education: crafting with text-to-image generative models. Digit Creat. 2023;34(1):1–21. https://doi.org/10.1080/14626268.2023.2174557 .

Ventayen RJM. OpenAI ChatGPT generated results: similarity index of artificial intelligence-based contents. Soc Sci Res Netw. 2023. https://doi.org/10.2139/ssrn.4332664 .

Wagner MW, Ertl-Wagner BB. Accuracy of information and references using ChatGPT-3 for retrieval of clinical radiological information. Can Assoc Radiol J. 2023. https://doi.org/10.1177/08465371231171125 .

Wardat Y, Tashtoush MA, AlAli R, Jarrah AM. ChatGPT: a revolutionary tool for teaching and learning mathematics. Eurasia J Math, Sci Technol Educ. 2023;19(7):em2286. https://doi.org/10.29333/ejmste/13272 .

Webster J, Watson RT. Analyzing the past to prepare for the future: writing a literature review. Manag Inf Syst Quart. 2002;26(2):3.

Xiao Y, Watson ME. Guidance on conducting a systematic literature review. J Plan Educ Res. 2017;39(1):93–112. https://doi.org/10.1177/0739456x17723971 .

Yan D. Impact of ChatGPT on learners in a L2 writing practicum: an exploratory investigation. Educ Inf Technol. 2023. https://doi.org/10.1007/s10639-023-11742-4 .

Yu H. Reflection on whether Chat GPT should be banned by academia from the perspective of education and teaching. Front Psychol. 2023;14:1181712. https://doi.org/10.3389/fpsyg.2023.1181712 .

Zhu C, Sun M, Luo J, Li T, Wang M. How to harness the potential of ChatGPT in education? Knowl Manag ELearn. 2023;15(2):133–52. https://doi.org/10.34105/j.kmel.2023.15.008 .

Download references

The paper is co-funded by the Academy of Finland (Suomen Akatemia) Research Council for Natural Sciences and Engineering for the project Towards precision education: Idiographic learning analytics (TOPEILA), Decision Number 350560.

Author information

Authors and affiliations.

School of Computing, University of Eastern Finland, 80100, Joensuu, Finland

Yazid Albadarin, Mohammed Saqr, Nicolas Pope & Markku Tukiainen

You can also search for this author in PubMed   Google Scholar

Contributions

YA contributed to the literature search, data analysis, discussion, and conclusion. Additionally, YA contributed to the manuscript’s writing, editing, and finalization. MS contributed to the study’s design, conceptualization, acquisition of funding, project administration, allocation of resources, supervision, validation, literature search, and analysis of results. Furthermore, MS contributed to the manuscript's writing, revising, and approving it in its finalized state. NP contributed to the results, and discussions, and provided supervision. NP also contributed to the writing process, revisions, and the final approval of the manuscript in its finalized state. MT contributed to the study's conceptualization, resource management, supervision, writing, revising the manuscript, and approving it.

Corresponding author

Correspondence to Yazid Albadarin .

Ethics declarations

Competing interests.

The authors declare no competing interests.

Additional information

Publisher's note.

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

See Table  4

The process of synthesizing the data presented in Table  4 involved identifying the relevant studies through a search process of databases (ERIC, Scopus, Web of Knowledge, Dimensions.ai, and lens.org) using specific keywords "ChatGPT" and "education". Following this, inclusion/exclusion criteria were applied, and data extraction was performed using Creswell's [ 15 ] coding techniques to capture key information and identify common themes across the included studies.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ .

Reprints and permissions

About this article

Albadarin, Y., Saqr, M., Pope, N. et al. A systematic literature review of empirical research on ChatGPT in education. Discov Educ 3 , 60 (2024). https://doi.org/10.1007/s44217-024-00138-2

Download citation

Received : 22 October 2023

Accepted : 10 May 2024

Published : 26 May 2024

DOI : https://doi.org/10.1007/s44217-024-00138-2

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

• Large language models
• Educational technology
• Systematic review

Advertisement

• Find a journal
• Publish with us
• Track your research

• Subscribe Online Courses

Ideas Buddhism

The Buddhism of Schopenhauer

The famed German philosopher did not become acquainted with Eastern thought until after writing his magnum opus. Yet in Buddhism, he found reflection—and validation—of his own genius.

In a particularly harrowing passage from his 1819 discourse The World as Will and Representation , German philosopher Arthur Schopenhauer cites an account from one of botanist and geologist Franz Wilhelm Junghuhn’s expeditions to the Indonesian island of Java.

“Junghuhn,” Schopenhauer writes, “saw an immense field entirely covered with skeletons, and took it to be a battlefield. However, they were nothing but skeletons of large turtles, five feet long, three feet broad, and of equal height. These turtles come this way from the sea, in order to lay their eggs, and are then seized by wild dogs ( Canis rutilans ); with their united strength, these dogs lay them on their backs, tear open their lower armor, the small scales of the belly, and devour them alive. But then a tiger often pounces on the dogs. Now all this misery is repeated thousands and thousands of times, year in, year out. For this then, are these turtles born. For what offense must they suffer this agony? What is the point of the whole scene of horror?”

To readers familiar with Buddhist scriptures, this passage inevitably echoes the story of Siddhartha Gautama , whose shocking encounter with the overabundance of death and suffering outside his princely palace propelled him on his path to Buddhahood. This is not a coincidence, as Schopenhauer, who lived from 1788 to 1860, is widely recognized as one of the first Western philosophers to develop a serious interest in Eastern thought. Financed by an inheritance from his merchant father, he spent most of his adult life secluded at home, at his own princely palace of sorts, reading and rereading the Vedas and Upanishads, accompanied by a succession of white poodles all named Atman, after the Hindu and Buddhist concept of the true or eternal Self or witness-consciousness.

Many wrongly assume that Schopenhauer was aware of these ancient texts before writing World as Will . In truth, the philosopher completed his magnum opus well before ever diving into them. They did not serve as an inspiration so much as they seemed to confirm what he had already discovered through independent study. Ignored by the academic community of his time, Schopenhauer—who, like Franz Kafka or Vincent van Gogh, did not become a household name until after his death—found quiet comfort in the fact that his work seemed somehow connected to one of the oldest and greatest philosophical traditions on the planet.

In an article titled “Buddhism and Nineteenth-Century German Philosophy,” the German theologian Heinrich Dumoulin notes that, while scholars from Southeast Asian countries had readily consumed Western philosophy since the 1700s, “Asian ideas and cultural values were slower to gain entry into Europe.” Asian philosophy traveled westward not through professors but Jesuit missionaries who saw traces of their own Christian worldview reflected in Buddhism and Confucianism.

Germany’s first introduction to Indian thought came from Polish philosopher Johann Gottfried Herder (1744–1803), who—after translating the Bhagavad Gita from Sanskrit into German—went on to write that “in India, the human mind acquired its first form of wisdom and virtue, with a depth, strength, and sublimity which … has no equal in our cold, European, philosophical world.” Further steps were taken by August Wilhelm Schlegel (1767–1845), who occupied the first chair in Sanskrit at the University of Bonn, and his younger brother Friedrich (1772–1829), author of an influential essay titled “On the Language and Wisdom of the Indians.”

Aside from a small but steadily growing class of Buddhist scholars in the West, Buddhism also caught the attention of a handful of leading German philosophers who, though they did not understand its history to the extent of their specialized peers, found its teachings to be relevant to their own writing. 

Despite never leaving his hometown of Konigsberg, Immanuel Kant was fascinated with foreign cultures. For over forty years he taught a course on “Physical Geography,” one of the first in the country, compiling material from travel literature. He talked about Buddhism in lectures on Tibet, India, China, and Japan, and, according to Dumoulin, “was sympathetic to the Buddhist belief in [the] transmigration of souls.” Kant, whose concept of the categorical imperative outlines a series of ethical laws all people should follow regardless of their circumstances, was also impressed by what he perceived to be Buddhism’s distinct moral character, with karma promising to punish evil and reward good when earthly institutions failed. 

Kant’s contemporary Georg W. F. Hegel, Schopenhauer’s nemesis, also devoted space to Buddhism, albeit in a different context. Arguing that “world history moves from East to West,” the great dialectician concerned himself with the Far East only insofar as—in Dumoulin’s words—he “sought to integrate all the [world’s] religions into his own grandiose metaphysical system.”

Schopenhauer differed from Hegel in that he viewed Eastern thought as different from and arguably superior to its Western counterpart. Letters reveal that he first encountered Eastern spiritual wisdom in 1813, when his friend Friedrich Maier, an Indologist and author of a book titled Brahma, or the Religion of the Hindus , gifted him a Latin translation of the Upanishads.

Letters also reveal that Schopenhauer had already made significant progress on World as Will before he was able to sit down with this translation. “The agreement with my own teachings is especially wonderful,” he later told an acquaintance, “since I wrote the first volume [from] 1814 [to] 1818 and did not know anything about all that, not having been able to acquire all that knowledge.” Schopenhauer’s pursuit of the Upanishads really took off after he resigned from his post at the University of Berlin and devoted himself entirely to independent study.

The deeper he dove into Eastern thought, the more similarities he discovered between it and his own. This was especially true of Buddhist scriptures, which, like World as Will , proposed that what we commonly regard as “reality” is in fact an illusion, a pale imitation of a higher, invisible truth. Juxtaposed against this false reality—a duality Schopenhauer had originally inherited from Kant, who was in turn indebted to Plato and his allegory of the cave—was what Kant termed the “thing-in-itself” ( Ding an sich ) and what Schopenhauer came to refer to as the Will: an essential energy that animates and unites all living entities, the “this” in the “For this then, are these turtles born.” 

In a line of reasoning that closely follows the Buddha’s four noble truths, Schopenhauer argued that the Will—expressed in animals as the need to exist, grow, and reproduce, and in humans as desire in all its various, complicated forms—was the cause of all suffering, since desire can never be satiated. Because the Will is the essential energy of the universe, Schopenhauer also argued that suffering was an inseparable aspect of existence, escapable only through the renunciation of desire and, by extension, existence itself.

He supposed that the rejection of the Will—through the consumption of art or an ascetic lifestyle—would lead to a state of bliss not unlike what we conceive of when we hear the word nirvana :

“Then nothing can trouble a man more, nothing can move him, for he has cut all the thousand cords of will which hold us bound to the world and, as desire, fear, envy, anger, drag us hither and thither in constant pain, He now looks back smiling and at rest on the delusions of this world which once were able to move and agonize his spirit also, but which now stand before him as utterly indifferent to him as the chessman when the game is ended, or as in the morning the cast-off masquerading dress which worried and disquieted us in the night in carnival. Life and its forms now pass before him as a fleeting illusion, as a light morning dream before half waking eyes, the real world already shining through it so that it can no longer deceive, and like this morning dream they finally vanish altogether without any violent transition.”

In a preface added to a later edition of World as Will , a more educated Schopenhauer addressed the ancient sagacious wisdom he now perceived in his 1819 book:

“If he [the reader] is a partaker of the benefit conferred by the Vedas, the access to which, opened to us through the Upanishads, is in my eyes the greatest advantage which this still young century enjoys over previous ones, because I believe that the influence of the Sanskrit literature will penetrate not less deeply than did the revival of Greek literature in the fifteenth century: if, I say, the reader has also already received and assimilated the sacred… Indian wisdom, then is he best of all prepared to hear what I have to say to him…”

Like Siddhartha Gautama, Schopenhauer’s philosophy about suffering, desire, and renunciation was informed by an at times tragic, at other times unsatisfying life—a life the Indian scholar of Bengali and English literature Rabindra Kumar Das Gupta once summed up as a string of “failures and disappointments.” Born in Danzig, Schopenhauer was just 5 years old when the Polish city lost its status as a Polish exclave in the Polish–Lithuanian Commonwealth and was made a part of Prussia. At 17, his father was found dead in a canal. Those close to the family speculated that Heinrich, a shrewd but struggling businessman, must have slipped, but Schopenhauer was convinced that his father—his melancholic tendencies worsened by financial trouble—had actually committed suicide. 

Although the future philosopher had never been close to his father, he actively despised his mother. Johanna Schopenhauer, a successful writer and professional bohemian who kept an entourage of artists and intellectuals, including Johann Wolfgang von Goethe, felt the exact same way about her son, calling him “unbearable and burdensome” and “very hard to live with.” The lukewarm reception of World as Will , which Schopenhauer had secretly hoped would place him at the pinnacle of German academia, only worsened their relationship. Their quarrels became more and more frequent until, one day, Johanna pushed Arthur down the stairs, prompting the latter to declare—as Dumoulin put it—that “posterity would remember her only through his reputation.”

Schopenhauer argued that suffering was an inseparable aspect of existence, escapable only through the renunciation of desire and, by extension, existence itself

This declaration proved prophetic only in retrospect. With unsold copies of his manuscript collecting dust, Schopenhauer acknowledged and even embraced the then-likely possibility of his name fading into obscurity. As his personal life crumbled, so did his career. In less than a year after accepting his professorship at the University of Berlin, Schopenhauer resigned from the institution when his class—scheduled at the same time as Hegel’s—failed to attract a sufficient number of students.

In light of such biographical details, one cannot help but wonder whether Schopenhauer’s pessimism was logical or pathological in nature, whether the philosopher arrived at his bleak worldview through sincere, unbiased introspection, or whether he was pushed in this direction by the frustration of his many unfulfilled desires. 

Friedrich Nietzsche, an early admirer of Schopenhauer, supported the first of these two hypotheses, arguing the philosopher’s isolation from society offered the same clarity and insight that he himself enjoyed in chronic illness. He described Schopenhauer as “absolutely alone, with not a single friend,” arguing that “between one and none there lies an infinity.” 

Accepting his own mortality, Schopenhauer became willing to acknowledge uncomfortable yet obvious truths that others—shielded by a lover’s embrace or intoxicated by alcohol—ignored. Proof of the world’s inherent cruelty did not have to be uncovered or elucidated; it was evident in the most basic functions of nature, in which, Schopenhauer once wrote, “the agony of the devoured animal is always far greater than the pleasure of the devourer.” 

Just as his pessimism stemmed from rational observation rather than emotional trauma, so too was it motivated by compassion rather than disdain. As he wrote in World as Will : 

“If you led the most unrepentant optimist through the hospitals, military wards, and surgical theatres, through the prisons [and] torture chambers … through battlefields and places of judgment, and then open for him all the dark dwellings of misery that hide from cold curiosity, then he too would surely come to see the nature of this best of all possible worlds.”

Interpreting Schopenhauer as a 19th-century incel who blames his unhappiness on an indifferent universe not only misses the point of World as Will , but also of the Eastern thinkers he came to identify himself with. Dumoulin notes that, as a result of systemic misreading, both “Schopenhauerism” and Buddhism are viewed in the West as philosophies of death, of rejecting a painful, meaningless existence in favor of painless but equally meaningless nonexistence. In truth, Schopenhauer’s philosophy was fueled by a deep love and care for the world that had supposedly mistreated him, just as his conception of overcoming the Will—much like the nirvana that it evokes—was neither negative nor nihilistic. As with Sisyphus, or the Buddha, we must imagine Schopenhauer happy. 

Thank you for subscribing to Tricycle! As a nonprofit, we depend on readers like you to keep Buddhist teachings and practices widely available.

Subscribe now to read this article and get immediate access to everything else.

Already a subscriber? Log in .

Subscribe Today

Tricycle is more than a magazine.

Subscribe for access to video teachings, monthly films, e-books, and our 30-year archive.

Weekly Newsletter

The latest from tricycle to your inbox and more.

Please check your email to confirm your subscription.

Would you like to sign up for our other mailing lists?

• The Tricycle Newsletter A weekly update on everything you need to know on tricycle.org
• Three Teachings Buddhist teachings to your inbox every Thursday
• Daily Dharma Morning wisdom to wake you up
• Learn More Course announcements, offers, and events from our partners
• Meditation Month Weekly updates and guided meditations from a Buddhist teacher throughout the month of March

By continuing, you agree to Tricycle’s Privacy Policy and Terms of Service .

Help us share Buddhist teachings

Tricycle is a nonprofit that depends on reader support.

AI-assisted writing is quietly booming in academic journals. Here’s why that’s OK

Lecturer in Bioethics, Monash University & Honorary fellow, Melbourne Law School, Monash University

Disclosure statement

Julian Koplin does not work for, consult, own shares in or receive funding from any company or organisation that would benefit from this article, and has disclosed no relevant affiliations beyond their academic appointment.

Monash University provides funding as a founding partner of The Conversation AU.

View all partners

If you search Google Scholar for the phrase “ as an AI language model ”, you’ll find plenty of AI research literature and also some rather suspicious results. For example, one paper on agricultural technology says:

As an AI language model, I don’t have direct access to current research articles or studies. However, I can provide you with an overview of some recent trends and advancements …

Obvious gaffes like this aren’t the only signs that researchers are increasingly turning to generative AI tools when writing up their research. A recent study examined the frequency of certain words in academic writing (such as “commendable”, “meticulously” and “intricate”), and found they became far more common after the launch of ChatGPT – so much so that 1% of all journal articles published in 2023 may have contained AI-generated text.

(Why do AI models overuse these words? There is speculation it’s because they are more common in English as spoken in Nigeria, where key elements of model training often occur.)

The aforementioned study also looks at preliminary data from 2024, which indicates that AI writing assistance is only becoming more common. Is this a crisis for modern scholarship, or a boon for academic productivity?

Who should take credit for AI writing?

Many people are worried by the use of AI in academic papers. Indeed, the practice has been described as “ contaminating ” scholarly literature.

Some argue that using AI output amounts to plagiarism. If your ideas are copy-pasted from ChatGPT, it is questionable whether you really deserve credit for them.

But there are important differences between “plagiarising” text authored by humans and text authored by AI. Those who plagiarise humans’ work receive credit for ideas that ought to have gone to the original author.

By contrast, it is debatable whether AI systems like ChatGPT can have ideas, let alone deserve credit for them. An AI tool is more like your phone’s autocomplete function than a human researcher.

The question of bias

Another worry is that AI outputs might be biased in ways that could seep into the scholarly record. Infamously, older language models tended to portray people who are female, black and/or gay in distinctly unflattering ways, compared with people who are male, white and/or straight.

This kind of bias is less pronounced in the current version of ChatGPT.

However, other studies have found a different kind of bias in ChatGPT and other large language models : a tendency to reflect a left-liberal political ideology.

Any such bias could subtly distort scholarly writing produced using these tools.

The hallucination problem

The most serious worry relates to a well-known limitation of generative AI systems: that they often make serious mistakes.

For example, when I asked ChatGPT-4 to generate an ASCII image of a mushroom, it provided me with the following output.

It then confidently told me I could use this image of a “mushroom” for my own purposes.

These kinds of overconfident mistakes have been referred to as “ AI hallucinations ” and “ AI bullshit ”. While it is easy to spot that the above ASCII image looks nothing like a mushroom (and quite a bit like a snail), it may be much harder to identify any mistakes ChatGPT makes when surveying scientific literature or describing the state of a philosophical debate.

Unlike (most) humans, AI systems are fundamentally unconcerned with the truth of what they say. If used carelessly, their hallucinations could corrupt the scholarly record.

Should AI-produced text be banned?

One response to the rise of text generators has been to ban them outright. For example, Science – one of the world’s most influential academic journals – disallows any use of AI-generated text .

I see two problems with this approach.

The first problem is a practical one: current tools for detecting AI-generated text are highly unreliable. This includes the detector created by ChatGPT’s own developers, which was taken offline after it was found to have only a 26% accuracy rate (and a 9% false positive rate ). Humans also make mistakes when assessing whether something was written by AI.

It is also possible to circumvent AI text detectors. Online communities are actively exploring how to prompt ChatGPT in ways that allow the user to evade detection. Human users can also superficially rewrite AI outputs, effectively scrubbing away the traces of AI (like its overuse of the words “commendable”, “meticulously” and “intricate”).

The second problem is that banning generative AI outright prevents us from realising these technologies’ benefits. Used well, generative AI can boost academic productivity by streamlining the writing process. In this way, it could help further human knowledge. Ideally, we should try to reap these benefits while avoiding the problems.

The problem is poor quality control, not AI

The most serious problem with AI is the risk of introducing unnoticed errors, leading to sloppy scholarship. Instead of banning AI, we should try to ensure that mistaken, implausible or biased claims cannot make it onto the academic record.

After all, humans can also produce writing with serious errors, and mechanisms such as peer review often fail to prevent its publication.

We need to get better at ensuring academic papers are free from serious mistakes, regardless of whether these mistakes are caused by careless use of AI or sloppy human scholarship. Not only is this more achievable than policing AI usage, it will improve the standards of academic research as a whole.

This would be (as ChatGPT might say) a commendable and meticulously intricate solution.

• Artificial intelligence (AI)
• Academic journals
• Academic publishing
• Hallucinations
• Scholarly publishing
• Academic writing
• Large language models
• Generative AI

Lecturer / Senior Lecturer - Marketing

Head, School of Psychology

Lecturer In Arabic Studies - Teaching Specialist

Senior Research Fellow - Women's Health Services

Assistant Editor - 1 year cadetship