conducting a literature review in research

Harvey Cushing/John Hay Whitney Medical Library

• Collections
• Research Help

YSN Doctoral Programs: Steps in Conducting a Literature Review

• Biomedical Databases
• Global (Public Health) Databases
• Soc. Sci., History, and Law Databases
• Grey Literature
• Trials Registers
• Data and Statistics
• Public Policy
• Google Tips
• Recommended Books
• Steps in Conducting a Literature Review

What is a literature review?

A literature review is an integrated analysis -- not just a summary-- of scholarly writings and other relevant evidence related directly to your research question.  That is, it represents a synthesis of the evidence that provides background information on your topic and shows a association between the evidence and your research question.

A literature review may be a stand alone work or the introduction to a larger research paper, depending on the assignment.  Rely heavily on the guidelines your instructor has given you.

Why is it important?

A literature review is important because it:

• Explains the background of research on a topic.
• Demonstrates why a topic is significant to a subject area.
• Discovers relationships between research studies/ideas.
• Identifies major themes, concepts, and researchers on a topic.
• Identifies critical gaps and points of disagreement.
• Discusses further research questions that logically come out of the previous studies.

APA7 Style resources

APA Style Blog - for those harder to find answers

1. Choose a topic. Define your research question.

Your literature review should be guided by your central research question.  The literature represents background and research developments related to a specific research question, interpreted and analyzed by you in a synthesized way.

• Make sure your research question is not too broad or too narrow.  Is it manageable?
• Begin writing down terms that are related to your question. These will be useful for searches later.
• If you have the opportunity, discuss your topic with your professor and your class mates.

2. Decide on the scope of your review

How many studies do you need to look at? How comprehensive should it be? How many years should it cover? 

• This may depend on your assignment.  How many sources does the assignment require?

3. Select the databases you will use to conduct your searches.

Make a list of the databases you will search. 

Where to find databases:

• use the tabs on this guide
• Find other databases in the Nursing Information Resources web page
• More on the Medical Library web page
• ... and more on the Yale University Library web page

4. Conduct your searches to find the evidence. Keep track of your searches.

• Use the key words in your question, as well as synonyms for those words, as terms in your search. Use the database tutorials for help.
• Save the searches in the databases. This saves time when you want to redo, or modify, the searches. It is also helpful to use as a guide is the searches are not finding any useful results.
• Review the abstracts of research studies carefully. This will save you time.
• Use the bibliographies and references of research studies you find to locate others.
• Check with your professor, or a subject expert in the field, if you are missing any key works in the field.
• Ask your librarian for help at any time.
• Use a citation manager, such as EndNote as the repository for your citations. See the EndNote tutorials for help.

Review the literature

Some questions to help you analyze the research:

• What was the research question of the study you are reviewing? What were the authors trying to discover?
• Was the research funded by a source that could influence the findings?
• What were the research methodologies? Analyze its literature review, the samples and variables used, the results, and the conclusions.
• Does the research seem to be complete? Could it have been conducted more soundly? What further questions does it raise?
• If there are conflicting studies, why do you think that is?
• How are the authors viewed in the field? Has this study been cited? If so, how has it been analyzed?

Tips: 

• Review the abstracts carefully.  
• Keep careful notes so that you may track your thought processes during the research process.
• Create a matrix of the studies for easy analysis, and synthesis, across all of the studies.
• << Previous: Recommended Books
• Last Updated: Jan 4, 2024 10:52 AM
• URL: https://guides.library.yale.edu/YSNDoctoral

• University of Texas Libraries

Literature Reviews

Steps in the literature review process.

• What is a literature review?
• Define your research question
• Determine inclusion and exclusion criteria
• Choose databases and search
• Review Results
• Synthesize Results
• Analyze Results
• Librarian Support
• You may need to some exploratory searching of the literature to get a sense of scope, to determine whether you need to narrow or broaden your focus
• Identify databases that provide the most relevant sources, and identify relevant terms (controlled vocabularies) to add to your search strategy
• Finalize your research question
• Think about relevant dates, geographies (and languages), methods, and conflicting points of view
• Conduct searches in the published literature via the identified databases
• Check to see if this topic has been covered in other discipline's databases
• Examine the citations of on-point articles for keywords, authors, and previous research (via references) and cited reference searching.
• Save your search results in a citation management tool (such as Zotero, Mendeley or EndNote)
• De-duplicate your search results
• Make sure that you've found the seminal pieces -- they have been cited many times, and their work is considered foundational 
• Check with your professor or a librarian to make sure your search has been comprehensive
• Evaluate the strengths and weaknesses of individual sources and evaluate for bias, methodologies, and thoroughness
• Group your results in to an organizational structure that will support why your research needs to be done, or that provides the answer to your research question  
• Develop your conclusions
• Are there gaps in the literature?
• Where has significant research taken place, and who has done it?
• Is there consensus or debate on this topic?
• Which methodological approaches work best?
• For example: Background, Current Practices, Critics and Proponents, Where/How this study will fit in 
• Organize your citations and focus on your research question and pertinent studies
• Compile your bibliography

Note: The first four steps are the best points at which to contact a librarian. Your librarian can help you determine the best databases to use for your topic, assess scope, and formulate a search strategy.

Videos Tutorials about Literature Reviews

This 4.5 minute video from Academic Education Materials has a Creative Commons License and a British narrator.

Recommended Reading

• Last Updated: Oct 26, 2022 2:49 PM
• URL: https://guides.lib.utexas.edu/literaturereviews

Libraries | Research Guides

Literature reviews, what is a literature review, learning more about how to do a literature review.

• Planning the Review
• The Research Question
• Choosing Where to Search
• Organizing the Review
• Writing the Review

A literature review is a review and synthesis of existing research on a topic or research question. A literature review is meant to analyze the scholarly literature, make connections across writings and identify strengths, weaknesses, trends, and missing conversations. A literature review should address different aspects of a topic as it relates to your research question. A literature review goes beyond a description or summary of the literature you have read. 

• Sage Research Methods Core Collection This link opens in a new window SAGE Research Methods supports research at all levels by providing material to guide users through every step of the research process. SAGE Research Methods is the ultimate methods library with more than 1000 books, reference works, journal articles, and instructional videos by world-leading academics from across the social sciences, including the largest collection of qualitative methods books available online from any scholarly publisher. – Publisher

• Next: Planning the Review >>
• Last Updated: May 2, 2024 10:39 AM
• URL: https://libguides.northwestern.edu/literaturereviews

Literature Reviews

• 6. Write the review
• Getting started
• Types of reviews
• 1. Define your research question
• 2. Plan your search
• 3. Search the literature
• 4. Organize your results
• 5. Synthesize your findings
• Artificial intelligence (AI) tools
• Thompson Writing Studio This link opens in a new window
• Need to write a systematic review? This link opens in a new window

Contact a Librarian

Ask a Librarian

Organize your review according to the following structure:

• Provide a concise overview of your primary thesis and the studies you explore in your review.
• Present the subject of your review
• Outline the key points you will address in the review
• Use your thesis to frame your paper
• Explain the significance of reviewing the literature in your chosen topic area (e.g., to find research gaps? Or to update your field on the current literature?)
• Consider dividing it into sections, particularly if examining multiple methodologies
• Examine the literature thoroughly and systematically, maintaining organization — don't just paraphrase researchers, add your own interpretation and discuss the significance of the papers you found)
• Reiterate your thesis
• Summarize your key findings 
• Ensure proper formatting of your references (stick to a single citation style — be consistent!)
• Use a citation manager, such as Zotero or EndNote, for easy formatting!

Check out UNC's guide on literature reviews, especially the section " Organizing the Body ."

• << Previous: 5. Synthesize your findings
• Next: Artificial intelligence (AI) tools >>
• Last Updated: Jun 5, 2024 9:38 AM
• URL: https://guides.library.duke.edu/litreviews

Services for...

• Faculty & Instructors
• Graduate Students
• Undergraduate Students
• International Students
• Patrons with Disabilities

• Harmful Language Statement
• Re-use & Attribution / Privacy
• Support the Libraries

• Reserve a study room
• Library Account
• Undergraduate Students
• Graduate Students
• Faculty & Staff

How to Conduct a Literature Review (Health Sciences and Beyond)

What is a literature review, traditional (narrative) literature review, integrative literature review, systematic reviews, meta-analysis, scoping review.

• Developing a Research Question
• Selection Criteria
• Database Search
• Documenting Your Search
• Organize Key Findings
• Reference Management

Ask Us! Health Sciences Library

The health sciences library.

Call toll-free:  (844) 352-7399 E-mail:   Ask Us More contact information

Related Guides

• Systematic Reviews by Roy Brown Last Updated Oct 17, 2023 559 views this year
• Write a Literature Review by John Glover Last Updated Oct 16, 2023 2948 views this year

A literature review provides an overview of what's been written about a specific topic. There are many different types of literature reviews. They vary in terms of comprehensiveness, types of study included, and purpose. 

The other pages in this guide will cover some basic steps to consider when conducting a traditional health sciences literature review. See below for a quick look at some of the more popular types of literature reviews.

For additional information on a variety of review methods, the following article provides an excellent overview.

Grant MJ, Booth A. A typology of reviews: an analysis of 14 review types and associated methodologies. Health Info Libr J. 2009 Jun;26(2):91-108. doi: 10.1111/j.1471-1842.2009.00848.x. Review. PubMed PMID: 19490148.

• Next: Developing a Research Question >>
• Last Updated: Mar 15, 2024 12:22 PM
• URL: https://guides.library.vcu.edu/health-sciences-lit-review

Nursing: How to Write a Literature Review

• Traditional or Narrative Literature Review

Getting started

1. start with your research question, 2. search the literature, 3. read & evaluate, 4. finalize results, 5. write & revise, brainfuse online tutoring and writing review.

• RESEARCH HELP

The best way to approach your literature review is to break it down into steps.  Remember, research is an iterative process, not a linear one.  You will revisit steps and revise along the way.  Get started with the handout, information, and tips from various university Writing Centers below that provides an excellent overview.  Then move on to the specific steps recommended on this page.

• UNC- Chapel Hill Writing Center Literature Review Handout, from the University of North Carolina at Chapel Hill.
• University of Wisconsin-Madison Writing Center Learn how to write a review of literature, from the University of Wisconsin-Madison.
• University of Toronto-- Writing Advice The Literature Review: A few tips on conducting it, from the University of Toronto.
• Begin with a topic.
• Understand the topic. 
• Familiarize yourself with the terminology.  Note what words are being used and keep track of these for use as database search keywords. 
• See what research has been done on this topic before you commit to the topic.  Review articles can be helpful to understand what research has been done .
• Develop your research question.  (see handout below)
• How comprehensive should it be? 
• Is it for a course assignment or a dissertation? 
• How many years should it cover?
• Developing a good nursing research question Handout. Reviews PICO method and provides search tips.

Your next step is to construct a search strategy and then locate & retrieve articles.

•  There are often 2-4 key concepts in a research question.
• Search for primary sources (original research articles.)
• These are based on the key concepts in your research question.
• Remember to consider synonyms and related terms.
• Which databases to search?
• What limiters should be applied (peer-reviewed, publication date, geographic location, etc.)?

Review articles (secondary sources)

Use to identify literature on your topic, the way you would use a bibliography.  Then locate and retrieve the original studies discussed in the review article. Review articles are considered secondary sources.

• Once you have some relevant articles, review reference lists to see if there are any useful articles.
• Which articles were written later and have cited some of your useful articles?  Are these, in turn, articles that will be useful to you? 
• Keep track of what terms you used and what databases you searched. 
• Use database tools such as save search history in EBSCO to help.
• Keep track of the citations for the articles you will be using in your literature review. 
• Use RefWorks or another method of tracking this information. 
• Database Search Strategy Worksheet Handout. How to construct a search.
• TUTORIAL: How to do a search based on your research question This is a self-paced, interactive tutorial that reviews how to construct and perform a database search in CINAHL.

The next step is to read, review, and understand the articles.

• Start by reviewing abstracts. 
• Make sure you are selecting primary sources (original research articles).
• Note any keywords authors report using when searching for prior studies.
• You will need to evaluate and critique them and write a synthesis related to your research question.
• Consider using a matrix to organize and compare and contrast the articles . 
• Which authors are conducting research in this area?  Search by author.  
• Are there certain authors’ whose work is cited in many of your articles?  Did they write an early, seminal article that is often cited?
• Searching is a cyclical process where you will run searches, review results, modify searches, run again, review again, etc. 
• Critique articles.  Keep or exclude based on whether they are relevant to your research question.
• When you have done a thorough search using several databases plus Google Scholar, using appropriate keywords or subject terms, plus author’s names, and you begin to find the same articles over and over.
• Remember to consider the scope of your project and the length of your paper.  A dissertation will have a more exhaustive literature review than an 8 page paper, for example.
• What are common findings among each group or where do they disagree? 
• Identify common themes. Identify controversial or problematic areas in the research. 
• Use your matrix to organize this.
• Once you have read and re-read your articles and organized your findings, you are ready to begin the process of writing the literature review.

2. Synthesize.  (see handout below)

• Include a synthesis of the articles you have chosen for your literature review.
• A literature review is NOT a list or a summary of what has been written on a particular topic. 
• It analyzes the articles in terms of how they relate to your research question. 
• While reading, look for similarities and differences (compare and contrast) among the articles.  You will create your synthesis from this.
• Synthesis Examples Handout. Sample excerpts that illustrate synthesis.

Regis Online students have access to Brainfuse. Brainfuse is an online tutoring service available through a link in Moodle. Meet with a tutor in a live session or submit your paper for review.

• Brainfuse Tutoring and Writing Assistance for Regis Online Students by Tricia Reinhart Last Updated Oct 26, 2023 81 views this year
• << Previous: Traditional or Narrative Literature Review
• Next: eBooks >>
• Last Updated: Feb 21, 2024 12:05 PM
• URL: https://libguides.regiscollege.edu/nursing_litreview

New change to library operations

All Main Library and Weaver Library doors lock 15 minutes before closing.

Conduct a literature review

What is a literature review.

A literature review is a summary of the published work in a field of study. This can be a section of a larger paper or article, or can be the focus of an entire paper. Literature reviews show that you have examined the breadth of knowledge and can justify your thesis or research questions. They are also valuable tools for other researchers who need to find a summary of that field of knowledge.

Unlike an annotated bibliography, which is a list of sources with short descriptions, a literature review synthesizes sources into a summary that has a thesis or statement of purpose—stated or implied—at its core.

How do I write a literature review?

Step 1: define your research scope.

• What is the specific research question that your literature review helps to define?
• Are there a maximum or minimum number of sources that your review should include?

Ask us if you have questions about refining your topic, search methods, writing tips, or citation management.

Step 2: Identify the literature

Start by searching broadly. Literature for your review will typically be acquired through scholarly books, journal articles, and/or dissertations. Develop an understanding of what is out there, what terms are accurate and helpful, etc., and keep track of all of it with citation management tools . If you need help figuring out key terms and where to search, ask us .

Use citation searching to track how scholars interact with, and build upon, previous research:

• Mine the references cited section of each relevant source for additional key sources
• Use Google Scholar or Scopus to find other sources that have cited a particular work

Step 3: Critically analyze the literature

Key to your literature review is a critical analysis of the literature collected around your topic. The analysis will explore relationships, major themes, and any critical gaps in the research expressed in the work. Read and summarize each source with an eye toward analyzing authority, currency, coverage, methodology, and relationship to other works. The University of Toronto's Writing Center provides a comprehensive list of questions you can use to analyze your sources.

Step 4: Categorize your resources

Divide the available resources that pertain to your research into categories reflecting their roles in addressing your research question. Possible ways to categorize resources include organization by:

• methodology
• theoretical/philosophical approach

Regardless of the division, each category should be accompanied by thorough discussions and explanations of strengths and weaknesses, value to the overall survey, and comparisons with similar sources. You may have enough resources when:

• You've used multiple databases and other resources (web portals, repositories, etc.) to get a variety of perspectives on the research topic.
• The same citations are showing up in a variety of databases.

Additional resources

Undergraduate student resources.

• Literature Review Handout (University of North Carolina at Chapel Hill)
• Learn how to write a review of literature (University of Wisconsin-Madison)

Graduate student and faculty resources

• Information Research Strategies (University of Arizona)
• Literature Reviews: An Overview for Graduate Students (NC State University)
• Oliver, P. (2012). Succeeding with Your Literature Review: A Handbook for Students [ebook]
• Machi, L. A. & McEvoy, B. T. (2016). The Literature Review: Six Steps to Success [ebook]
• Graustein, J. S. (2012). How to Write an Exceptional Thesis or Dissertation: A Step-by-Step Guide from Proposal to Successful Defense [ebook]
• Thomas, R. M. & Brubaker, D. L. (2008). Theses and Dissertations: A Guide to Planning, Research, and Writing

• The Chicago School
• The Chicago School Library
• Research Guides

Conducting a Literature Review

• Introduction

What is a Literature Review?

Goals of the literature review, types of literature reviews.

• Recommended Reading
• Planning Your Literature Review
• Choose Keywords
• Decide where to search
• Formulate Your Search Strategy
• Utilize Citation Chaining
• When to Stop Searching
• Using Ai for Searching the Literature
• Evaluate, Synthesize & Analyze the Literature
• Write a Literature Review

A literature review surveys, summarizes, critically analyzes, compares, and synthesizes multiple scholarly works, or published knowledge on a particular topic or specific subject area.

Literature can include peer-reviewed or scholarly  articles, books/ ebooks, conference proceedings, theses/ dissertations, documents published by governmental agencies and non-profit organizations, and other forms of gray literature.

Conducting a literature review is part of the research process and serves to establish a base of knowledge and overview of the principal works on a specific area of research as well as identify important themes, discoveries, areas of consensus and debate, changes over time, and provide a foundation for further research.

A literature review may be written to:

•     Synthesize past and current literature on a topic
•     Identify a problem in a field of research  
•     Show how the literature relates to one another
•     Place your work in the the context of other related research

What kinds of sources require a Literature Review?

•     A thesis or dissertation
•     A grant proposal
•     A research paper assigned in a course 
•     An article intended for publication in a journal

All these instances require you to collect what has been written about your research topic so that you can demonstrate how your own research sheds new light on the topic.

The following are common types of literature reviews:

Narrative or Traditional Review

The purpose of this type of review is to describe the current state of the research on a specific topic/research and to offer a critical analysis of the literature reviewed. Studies are grouped by research/theoretical categories, and themes and trends, strengths and weakness, and gaps are identified. The review ends with a conclusion section which summarizes the findings regarding the state of the research of the specific study, the gaps identify and if applicable, explains how the author's research will address gaps identify in the review and expand the knowledge on the topic reviewed.

Systematic Review

The authors of a systematic review use a specific procedure to search the research literature, select the studies to include in their review, and critically evaluate the studies they find.

Meta-analysis

This type of review utilizes quantitative methods to combine the results of independent studies and synthesize summaries and conclusions which can be used to evaluate therapeutic effectiveness, plan new studies, etc.

Meta-synthesis

A meta-synthesis is a type of qualitative study that uses as data the findings from other qualitative studies linked by the same or related topic.

Further Reading on Different Types of Literature Reviews

Grant, M. J., & Booth, A. (2009). A typology of reviews: An analysis of 14 review types and associated methodologies . Health Information and Libraries Journal, 26(2), 91-108. doi:10.1111/j.1471-1842.2009.00848.x Gough, D., Thomas, J., & Oliver, S. (2012). Clarifying differences between review designs and methods . Systematic Reviews, 1, 28. doi:10.1186/2046-4053-1-28

eBooks in the Library

The library has a number of books on conducting and writing literature reviews:

eBooks on Conducting Systematic Literature Reviews:

• Next: Planning Your Literature Review >>
• Last Updated: May 22, 2024 4:46 PM
• URL: https://library.thechicagoschool.edu/litreview

• UWF Libraries

Literature Review: Conducting & Writing

• Steps for Conducting a Lit Review

1. Choose a topic. Define your research question.

2. decide on the scope of your review., 3. select the databases you will use to conduct your searches., 4. conduct your searches and find the literature. keep track of your searches, 5. review the literature..

• Finding "The Literature"
• Organizing/Writing
• APA Style This link opens in a new window
• Chicago: Notes Bibliography This link opens in a new window
• MLA Style This link opens in a new window
• Sample Literature Reviews

Disclaimer!!

Conducting a literature review is usually recursive, meaning that somewhere along the way, you'll find yourself repeating steps out-of-order.

That is actually a good sign.  

Reviewing the research should lead to more research questions and those questions will likely lead you to either revise your initial research question or go back and find more literature related to a more specific aspect of your research question.

Your literature review should be guided by a central research question.  Remember, it is not a collection of loosely related studies in a field but instead represents background and research developments related to a specific research question, interpreted and analyzed by you in a synthesized way.

• Make sure your research question is not too broad or too narrow.  Is it manageable?
• Begin writing down terms that are related to your question. These will be useful for searches later.
• If you have the opportunity, discuss your topic with your professor.

How many studies do you need to look at? How comprehensive should it be? How many years should it cover? 

Tip: This may depend on your assignment.  How many sources does the assignment require?

Make a list of the databases you will search.  Remember to include comprehensive databases such as WorldCat and Dissertations & Theses, if you need to.

Where to find databases:

• Find Databases by Subject UWF Databases categorized by discipline
• Find Databases via Research Guides Librarians create research guides for all of the disciplines on campus! Take advantage of their expertise and see what discipline-specific search strategies they recommend!
• Review the abstracts of research studies carefully. This will save you time.
• Write down the searches you conduct in each database so that you may duplicate them if you need to later (or avoid dead-end searches   that you'd forgotten you'd already tried).
• Use the bibliographies and references of research studies you find to locate others.
• Ask your professor or a scholar in the field if you are missing any key works in the field.
• Use RefWorks to keep track of your research citations. See the RefWorks Tutorial if you need help.

Some questions to help you analyze the research:

• What was the research question of the study you are reviewing? What were the authors trying to discover?
• Was the research funded by a source that could influence the findings?
• What were the research methodologies? Analyze its literature review, the samples and variables used, the results, and the conclusions. Does the research seem to be complete? Could it have been conducted more soundly? What further questions does it raise?
• If there are conflicting studies, why do you think that is?
• How are the authors viewed in the field? Has this study been cited?; if so, how has it been analyzed?

Tips: 

• Again, review the abstracts carefully.  
• Keep careful notes so that you may track your thought processes during the research process.
• << Previous: Home
• Next: Finding "The Literature" >>
• Last Updated: Mar 22, 2024 9:37 AM
• URL: https://libguides.uwf.edu/litreview

An official website of the United States government

The .gov means it’s official. Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

The site is secure. The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

• Publications
• Account settings

Preview improvements coming to the PMC website in October 2024. Learn More or Try it out now .

• Advanced Search
• Journal List
• J Grad Med Educ
• v.8(3); 2016 Jul

The Literature Review: A Foundation for High-Quality Medical Education Research

a  These are subscription resources. Researchers should check with their librarian to determine their access rights.

Despite a surge in published scholarship in medical education 1 and rapid growth in journals that publish educational research, manuscript acceptance rates continue to fall. 2 Failure to conduct a thorough, accurate, and up-to-date literature review identifying an important problem and placing the study in context is consistently identified as one of the top reasons for rejection. 3 , 4 The purpose of this editorial is to provide a road map and practical recommendations for planning a literature review. By understanding the goals of a literature review and following a few basic processes, authors can enhance both the quality of their educational research and the likelihood of publication in the Journal of Graduate Medical Education ( JGME ) and in other journals.

The Literature Review Defined

In medical education, no organization has articulated a formal definition of a literature review for a research paper; thus, a literature review can take a number of forms. Depending on the type of article, target journal, and specific topic, these forms will vary in methodology, rigor, and depth. Several organizations have published guidelines for conducting an intensive literature search intended for formal systematic reviews, both broadly (eg, PRISMA) 5 and within medical education, 6 and there are excellent commentaries to guide authors of systematic reviews. 7 , 8

• A literature review forms the basis for high-quality medical education research and helps maximize relevance, originality, generalizability, and impact.
• A literature review provides context, informs methodology, maximizes innovation, avoids duplicative research, and ensures that professional standards are met.
• Literature reviews take time, are iterative, and should continue throughout the research process.
• Researchers should maximize the use of human resources (librarians, colleagues), search tools (databases/search engines), and existing literature (related articles).
• Keeping organized is critical.

Such work is outside the scope of this article, which focuses on literature reviews to inform reports of original medical education research. We define such a literature review as a synthetic review and summary of what is known and unknown regarding the topic of a scholarly body of work, including the current work's place within the existing knowledge . While this type of literature review may not require the intensive search processes mandated by systematic reviews, it merits a thoughtful and rigorous approach.

Purpose and Importance of the Literature Review

An understanding of the current literature is critical for all phases of a research study. Lingard 9 recently invoked the “journal-as-conversation” metaphor as a way of understanding how one's research fits into the larger medical education conversation. As she described it: “Imagine yourself joining a conversation at a social event. After you hang about eavesdropping to get the drift of what's being said (the conversational equivalent of the literature review), you join the conversation with a contribution that signals your shared interest in the topic, your knowledge of what's already been said, and your intention.” 9

The literature review helps any researcher “join the conversation” by providing context, informing methodology, identifying innovation, minimizing duplicative research, and ensuring that professional standards are met. Understanding the current literature also promotes scholarship, as proposed by Boyer, 10 by contributing to 5 of the 6 standards by which scholarly work should be evaluated. 11 Specifically, the review helps the researcher (1) articulate clear goals, (2) show evidence of adequate preparation, (3) select appropriate methods, (4) communicate relevant results, and (5) engage in reflective critique.

Failure to conduct a high-quality literature review is associated with several problems identified in the medical education literature, including studies that are repetitive, not grounded in theory, methodologically weak, and fail to expand knowledge beyond a single setting. 12 Indeed, medical education scholars complain that many studies repeat work already published and contribute little new knowledge—a likely cause of which is failure to conduct a proper literature review. 3 , 4

Likewise, studies that lack theoretical grounding or a conceptual framework make study design and interpretation difficult. 13 When theory is used in medical education studies, it is often invoked at a superficial level. As Norman 14 noted, when theory is used appropriately, it helps articulate variables that might be linked together and why, and it allows the researcher to make hypotheses and define a study's context and scope. Ultimately, a proper literature review is a first critical step toward identifying relevant conceptual frameworks.

Another problem is that many medical education studies are methodologically weak. 12 Good research requires trained investigators who can articulate relevant research questions, operationally define variables of interest, and choose the best method for specific research questions. Conducting a proper literature review helps both novice and experienced researchers select rigorous research methodologies.

Finally, many studies in medical education are “one-offs,” that is, single studies undertaken because the opportunity presented itself locally. Such studies frequently are not oriented toward progressive knowledge building and generalization to other settings. A firm grasp of the literature can encourage a programmatic approach to research.

Approaching the Literature Review

Considering these issues, journals have a responsibility to demand from authors a thoughtful synthesis of their study's position within the field, and it is the authors' responsibility to provide such a synthesis, based on a literature review. The aforementioned purposes of the literature review mandate that the review occurs throughout all phases of a study, from conception and design, to implementation and analysis, to manuscript preparation and submission.

Planning the literature review requires understanding of journal requirements, which vary greatly by journal ( table 1 ). Authors are advised to take note of common problems with reporting results of the literature review. Table 2 lists the most common problems that we have encountered as authors, reviewers, and editors.

Sample of Journals' Author Instructions for Literature Reviews Conducted as Part of Original Research Article a

Common Problem Areas for Reporting Literature Reviews in the Context of Scholarly Articles

Locating and Organizing the Literature

Three resources may facilitate identifying relevant literature: human resources, search tools, and related literature. As the process requires time, it is important to begin searching for literature early in the process (ie, the study design phase). Identifying and understanding relevant studies will increase the likelihood of designing a relevant, adaptable, generalizable, and novel study that is based on educational or learning theory and can maximize impact.

Human Resources

A medical librarian can help translate research interests into an effective search strategy, familiarize researchers with available information resources, provide information on organizing information, and introduce strategies for keeping current with emerging research. Often, librarians are also aware of research across their institutions and may be able to connect researchers with similar interests. Reaching out to colleagues for suggestions may help researchers quickly locate resources that would not otherwise be on their radar.

During this process, researchers will likely identify other researchers writing on aspects of their topic. Researchers should consider searching for the publications of these relevant researchers (see table 3 for search strategies). Additionally, institutional websites may include curriculum vitae of such relevant faculty with access to their entire publication record, including difficult to locate publications, such as book chapters, dissertations, and technical reports.

Strategies for Finding Related Researcher Publications in Databases and Search Engines

Search Tools and Related Literature

Researchers will locate the majority of needed information using databases and search engines. Excellent resources are available to guide researchers in the mechanics of literature searches. 15 , 16

Because medical education research draws on a variety of disciplines, researchers should include search tools with coverage beyond medicine (eg, psychology, nursing, education, and anthropology) and that cover several publication types, such as reports, standards, conference abstracts, and book chapters (see the box for several information resources). Many search tools include options for viewing citations of selected articles. Examining cited references provides additional articles for review and a sense of the influence of the selected article on its field.

Box Information Resources

• Web of Science a
• Education Resource Information Center (ERIC)
• Cumulative Index of Nursing & Allied Health (CINAHL) a
• Google Scholar

Once relevant articles are located, it is useful to mine those articles for additional citations. One strategy is to examine references of key articles, especially review articles, for relevant citations.

Getting Organized

As the aforementioned resources will likely provide a tremendous amount of information, organization is crucial. Researchers should determine which details are most important to their study (eg, participants, setting, methods, and outcomes) and generate a strategy for keeping those details organized and accessible. Increasingly, researchers utilize digital tools, such as Evernote, to capture such information, which enables accessibility across digital workspaces and search capabilities. Use of citation managers can also be helpful as they store citations and, in some cases, can generate bibliographies ( table 4 ).

Citation Managers

Knowing When to Say When

Researchers often ask how to know when they have located enough citations. Unfortunately, there is no magic or ideal number of citations to collect. One strategy for checking coverage of the literature is to inspect references of relevant articles. As researchers review references they will start noticing a repetition of the same articles with few new articles appearing. This can indicate that the researcher has covered the literature base on a particular topic.

Putting It All Together

In preparing to write a research paper, it is important to consider which citations to include and how they will inform the introduction and discussion sections. The “Instructions to Authors” for the targeted journal will often provide guidance on structuring the literature review (or introduction) and the number of total citations permitted for each article category. Reviewing articles of similar type published in the targeted journal can also provide guidance regarding structure and average lengths of the introduction and discussion sections.

When selecting references for the introduction consider those that illustrate core background theoretical and methodological concepts, as well as recent relevant studies. The introduction should be brief and present references not as a laundry list or narrative of available literature, but rather as a synthesized summary to provide context for the current study and to identify the gap in the literature that the study intends to fill. For the discussion, citations should be thoughtfully selected to compare and contrast the present study's findings with the current literature and to indicate how the present study moves the field forward.

To facilitate writing a literature review, journals are increasingly providing helpful features to guide authors. For example, the resources available through JGME include several articles on writing. 17 The journal Perspectives on Medical Education recently launched “The Writer's Craft,” which is intended to help medical educators improve their writing. Additionally, many institutions have writing centers that provide web-based materials on writing a literature review, and some even have writing coaches.

The literature review is a vital part of medical education research and should occur throughout the research process to help researchers design a strong study and effectively communicate study results and importance. To achieve these goals, researchers are advised to plan and execute the literature review carefully. The guidance in this editorial provides considerations and recommendations that may improve the quality of literature reviews.

In order to help minimize spread of the coronavirus and protect our campus community, Cowles Library is adjusting our services, hours, and building access. Read more...

• Research, Study, Learning
• Archives & Special Collections

• Cowles Library
• Find Journal Articles
• Find Articles in Related Disciplines
• Find Streaming Video
• Conducting a Literature Review
• Organizations, Associations, Societies
• For Faculty

What is a Literature Review?

Description.

A literature review, also called a review article or review of literature, surveys the existing research on a topic. The term "literature" in this context refers to published research or scholarship in a particular discipline, rather than "fiction" (like American Literature) or an individual work of literature. In general, literature reviews are most common in the sciences and social sciences.

Literature reviews may be written as standalone works, or as part of a scholarly article or research paper. In either case, the purpose of the review is to summarize and synthesize the key scholarly work that has already been done on the topic at hand. The literature review may also include some analysis and interpretation. A literature review is  not  a summary of every piece of scholarly research on a topic.

Why are literature reviews useful?

Literature reviews can be very helpful for newer researchers or those unfamiliar with a field by synthesizing the existing research on a given topic, providing the reader with connections and relationships among previous scholarship. Reviews can also be useful to veteran researchers by identifying potentials gaps in the research or steering future research questions toward unexplored areas. If a literature review is part of a scholarly article, it should include an explanation of how the current article adds to the conversation. (From: https://researchguides.drake.edu/englit/criticism)

How is a literature review different from a research article?

Research articles: "are empirical articles that describe one or several related studies on a specific, quantitative, testable research question....they are typically organized into four text sections: Introduction, Methods, Results, Discussion." Source: https://psych.uw.edu/storage/writing_center/litrev.pdf)

Steps for Writing a Literature Review

1. Identify and define the topic that you will be reviewing.

The topic, which is commonly a research question (or problem) of some kind, needs to be identified and defined as clearly as possible.  You need to have an idea of what you will be reviewing in order to effectively search for references and to write a coherent summary of the research on it.  At this stage it can be helpful to write down a description of the research question, area, or topic that you will be reviewing, as well as to identify any keywords that you will be using to search for relevant research.

2. Conduct a Literature Search

Use a range of keywords to search databases such as PsycINFO and any others that may contain relevant articles.  You should focus on peer-reviewed, scholarly articles . In SuperSearch and most databases, you may find it helpful to select the Advanced Search mode and include "literature review" or "review of the literature" in addition to your other search terms.  Published books may also be helpful, but keep in mind that peer-reviewed articles are widely considered to be the “gold standard” of scientific research.  Read through titles and abstracts, select and obtain articles (that is, download, copy, or print them out), and save your searches as needed. Most of the databases you will need are linked to from the Cowles Library Psychology Research guide .

3. Read through the research that you have found and take notes.

Absorb as much information as you can.  Read through the articles and books that you have found, and as you do, take notes.  The notes should include anything that will be helpful in advancing your own thinking about the topic and in helping you write the literature review (such as key points, ideas, or even page numbers that index key information).  Some references may turn out to be more helpful than others; you may notice patterns or striking contrasts between different sources; and some sources may refer to yet other sources of potential interest.  This is often the most time-consuming part of the review process.  However, it is also where you get to learn about the topic in great detail. You may want to use a Citation Manager to help you keep track of the citations you have found. 

4. Organize your notes and thoughts; create an outline.

At this stage, you are close to writing the review itself.  However, it is often helpful to first reflect on all the reading that you have done.  What patterns stand out?  Do the different sources converge on a consensus?  Or not?  What unresolved questions still remain?  You should look over your notes (it may also be helpful to reorganize them), and as you do, to think about how you will present this research in your literature review.  Are you going to summarize or critically evaluate?  Are you going to use a chronological or other type of organizational structure?  It can also be helpful to create an outline of how your literature review will be structured.

5. Write the literature review itself and edit and revise as needed.

The final stage involves writing.  When writing, keep in mind that literature reviews are generally characterized by a  summary style  in which prior research is described sufficiently to explain critical findings but does not include a high level of detail (if readers want to learn about all the specific details of a study, then they can look up the references that you cite and read the original articles themselves).  However, the degree of emphasis that is given to individual studies may vary (more or less detail may be warranted depending on how critical or unique a given study was).   After you have written a first draft, you should read it carefully and then edit and revise as needed.  You may need to repeat this process more than once.  It may be helpful to have another person read through your draft(s) and provide feedback.

6. Incorporate the literature review into your research paper draft. (note: this step is only if you are using the literature review to write a research paper. Many times the literature review is an end unto itself).

After the literature review is complete, you should incorporate it into your research paper (if you are writing the review as one component of a larger paper).  Depending on the stage at which your paper is at, this may involve merging your literature review into a partially complete Introduction section, writing the rest of the paper around the literature review, or other processes.

These steps were taken from: https://psychology.ucsd.edu/undergraduate-program/undergraduate-resources/academic-writing-resources/writing-research-papers/writing-lit-review.html#6.-Incorporate-the-literature-r

• << Previous: Find Streaming Video
• Next: Organizations, Associations, Societies >>
• Last Updated: May 31, 2024 4:22 PM
• URL: https://researchguides.drake.edu/psychology

• 2507 University Avenue
• Des Moines, IA 50311
• (515) 271-2111

Trouble finding something? Try searching , or check out the Get Help page.

• CMU Libraries
• Research Guides
• How To Guides
• Conducting a Literature Review

What is a Literature Review?

Conducting a literature review: what is a literature review.

• Research Question
• Information Resources
• Search Strategy
• Cite Resources

Understanding the Literature Review

Before you begin your research, it is important to understand what a literature review is and is not. Take some time to review the purpose and elements of a literature review.

Websites & Guides

• The Literature Review: A Few Tips On Conducting It University of Toronto
• Literature Reviews University of North Carolina, Chapel Hill
• Literature Reviews: An Overview for Graduate Students North Carolina State University
• What is a Literature Review? From Grand Canyon University
• Writing a Literature Review Purdue University (OWL)

Defining the Literature Review

The Purpose of the Literature Review

• << Previous: Home
• Next: Research Question >>
• Last Updated: Dec 13, 2022 11:31 AM
• URL: https://libguides.cmich.edu/lit_review

Central Michigan University Libraries , 250 East Preston Street, Mount Pleasant, MI 48859 | (989) 774-1100 | Contact Us

CMU, an AA/EO institution, strongly and actively strives to increase diversity and provide equal opportunity within its community.

Copyright © Central Michigan University, Mount Pleasant, MI 48859 | (989) 774-4000 | Privacy Policy

Research Process Guide

• Step 1 - Identifying and Developing a Topic
• Step 2 - Narrowing Your Topic
• Step 3 - Developing Research Questions
• Step 4 - Conducting a Literature Review
• Step 5 - Choosing a Conceptual or Theoretical Framework
• Step 6 - Determining Research Methodology
• Step 6a - Determining Research Methodology - Quantitative Research Methods
• Step 6b - Determining Research Methodology - Qualitative Design
• Step 7 - Considering Ethical Issues in Research with Human Subjects - Institutional Review Board (IRB)
• Step 8 - Collecting Data
• Step 9 - Analyzing Data
• Step 10 - Interpreting Results
• Step 11 - Writing Up Results

Step 4: Conducting a Literature Review

In order to understand your topic, before you conduct your research, it is extremely important to immerse yourself in the research that has been done on your topic and the topics that might be adjacent to your particular research interest or questions. “a researcher cannot perform significant research without first understanding the literature in the field” (Boote & Beile, 2005, p. 3). Essentially, When writing a thesis or research proposal, the review of the literature would be your Chapter 2 .

Frankly, the literature review is often the first major challenge of the writing process. Sometimes, the task to review and synthesize all of the previous research on and around your topic can feel overwhelming. Although the literature review is foundational to situate your research within the body of literature on your topic, there is almost no literature on the challenges and pitfalls of writing a literature review (Randolph, 2009).

Boote and Beile (2005) reveal through their research on dissertation writing, that although a sophisticated literature review is essential for substantial research, they are often poorly written and lack organizational structure and conceptual relevance. So, the question is, how can you write a literature that is well-organized, comprehensive and situate your research within the literature?

Onweugbuzie et al. (2012) identify 23 core components of an effective literature review in their research and are referred to as the standard checklist for most empirical researchers. The list includes the following:

• What has been researched and what needs to be in the future.
• Identify variables within the literature that are relevant to your study.
• Identify the relationship between theory and practice within the literature.
• Discuss the quality of research with particular emphasis on the exemplary studies.
• Examine the methodologies and research design used throughout the literature, and evaluate the efficacy.
• Pay attention to any contradictions within the literature and
• Make sure to not replicate studies that have already been completed, however, if there are similarities, identify how your study and variables examined are important, different, and relevant.

How to complete a literature review

Fair Warning: The literature review is often time-consuming and can feel like an endless process.  Don’t Give Up! It is the first major hurdle of the research proposal process. Once you have completed the literature review, you will have a good idea of what is significant, relevant and novel about your research. The key is to spend time reading, recording important findings, and organizing the scholarly literature on (and around) your topic.

At this point, it is important to distinguish between scholarly literature and other sources. You need to keep in mind that you are only reviewing scholarly literature, which includes sources and studies that have a clear methodology, empirical evidence, results and conclusions. These studies are PEER-REVIEWED, meaning, contemporaries in the field have reviewed the research methods and findings of the literature, and found them relevant, significant, authentic and valid (Wakefield, 2015).

Where do you begin? Great question.

According to Randolph (2009), the goal of a literature review is to integrate and generalize findings across studies, debate findings within a field, resolve the debate, and discuss the language specific to the field. For a meta-analysis, which is a common strategy for a literature review, the goal is largely to integrate quantitative findings across the research on the topic. For other strategies to complete the literature review, the goals may be to critically analyze previous studies, identify central themes or issues within the existing literature or analyze an argument in the field (Randolph, 2009). In literature reviews for dissertation, the goal is to largely interrogate and analyze the current findings to find weaknesses or contradictions in order to place your study within the context of the current literature and to justify your study’s relevance.  So in essence, the goals of literature review, regardless of the strategy, are not only to deal with the central theme across the literature and to present a thematic analysis of that literature, but also, and perhaps more importantly, it is to focus on whether the body of knowledge is credible, reliable and valid based on the methodological approaches and outcomes of the literature in the field (Wakefield, 2015).

A few initial steps are:

• Develop a list of key words and phrases that relate to your topic and questions (Denney & Tewksbury, 2013).
• Search for relevant sources using useful databases found in Kean University’s Library :
• Kean University’s WorldCat Discovery single-search application
• ERIC (education)
• JSTOR (multidisciplinary)
• Project Muse (humanities and social science)
• Web of Science (citation searching)
• Google Scholar
• Set up an account with a bibliographic citation manager like EndNote Online (access provided by Kean University) or a freely available option such as Zotero. The EndNote Online Guide provides separate on-campus and off-campus account registration instructions. A bibliographic citation manager will not only help you manage and organize your sources, but it will also help you format your references in various citation styles.
• Take advantage of research support options provided by Kean’s librarians, including workshops , appointments with a librarian , and 24/7 Chat .

If you identify a source (article or book) that is not available through Kean University’s library collections, you may submit an Interlibrary Loan request. Book or article records found in the WorldCat Discovery database will feature an Interlibrary Loan request option. However, you may also utilize the Interlibrary Loan form .

You may also use the VALE Reciprocal Borrowing Program , which enables Kean University students and faculty to check out books from libraries at other New Jersey colleges and universities. To participate in this program, a researcher must first obtain a signed "VALE Reciprocal Borrowing Application Form" from the Nancy Thompson Learning Commons before they can borrow at one of the participating libraries .

What are the sources that are appropriate for a literature review? According to Garrard (2009) and others scientific or empirical research refers to the:

         …theoretical and research publications in scientific journals, reference books, government practice, policy statements, and other materials          about the theory, practice, and results of scientific inquiry. These materials and publications are produced by individuals or groups in          universities, foundations, government research laboratories, and other nonprofit or for-profit organizations (p.4). Onwuegbuzie et al. (2010; as cited in Onwuegbuzie et al., 2012) goes further and describes the literature that could be included in a literature review, “research articles,… essays, article reviews, monographs, dissertations, books, Internet websites, video, interview transcripts, encyclopedias, company reports, trade catalogues, government documents, congressional/parliamentary bills…” (p. 7). However, Onwuegbuzie et al. (2012) builds on this definition, by saying that a literature review is largely, “a systematic, explicit, and reproducible method for identifying, evaluating, and synthesizing the existing body of completed and recorded work produced by researchers, scholars and practitioners” (p.3).

So, what does this mean for you, the researcher and author of the literature review? You want to use multiple source types. Additionally, stick to the parameters laid out by Onwuegbuzie et al. (2012)  in that the literature reviewed should be an evaluation and synthesis of the existing work completed by “researchers, scholars and practitioners.” The list of sources should be semi-exhaustive and representative of the field.

Next, you should:

     3. Evaluate and select your sources. Read the abstract first to see if the source is relevant to your topic (Wakefield, 2015; Denney & Tewksbury, 2013; Randolph, 2009).

• Is this source peer-reviewed?
• Is this source presenting empirical evidence, meeting the threshold for scholarly research?
• Is this topic relevant to my research topic/questions?

Organizing your Literature Review:

Outline your literature review- how do you want it organized? You are “synthesizing” the literature as your purpose here. What structure works best for your topic and study? The most common formats are (Randolph, 2009; Onwuegbuzie et al., 2012):

• Historical format - literature is reviewed chronologically.This method is preferred when there is a goal of analyzing the progression of research methods, theories or practices over time.
• Conceptual format - centered arounds the propositions in research rationale or a theoretical- centered review which is organized according to the theories in the literature.
• Methodological format - this involves the discussion of methodology  as in an imperial paper including an introduction, method, results and discussion. This approach is most commonly used in meta- analytical reports.

Let’s talk about synthesis.

A literature review is not only a review of the empirical research, but it is also evaluation and synthesis of the research. Boote and Beile (2005) have created a five- category list for evaluating a literature review. The categories are coverage, synthesis, methodology, significance, and rhetoric .

• You need to create a justified criteria for including and excluding studies from your review
• You need to discuss what has been done in the field and what still needs to be done.
• Place the topic or problem within the greater context of scholarly literature.
• Place the topic or problem within the historical context.
• Discuss the subject vocabulary.
• Articulate the important variables and phenomena that are relevant to the topic.
• Synthesize and discuss a new perspective on the literature.
• Identify the main methods and research techniques that have been used in the field as well as their advantages/disadvantages.
• Relate ideas and theories to research methodologies.
• Rationalize the practical significance of the research problem.
• Rationalize the scholarly significance of the research problem.
• Write in coherent language and be sure the organization/ structure of the review makes sense.

Synthesis is difficult - you need to articulate what this literature means for your research and/or how does the literature inform the purpose, impact, methodology of your study? Rather than summarizing, the idea behind synthesis is taking the information you have discussed and drawing your own conclusions, making connections between the literature and your study.

Boote, D. N., & Beile, P. (2005). Scholars before researchers: On the centrality of the dissertation literature review in research preparation. Educational Researcher, 34 (6), 3-15. https://www.jstor.org/stable/3699805

Denney, A. S., & Tewksbury, R. (2013). How to write a literature review. Journal of Criminal Justice Education, 24 (2), 218-234. https://doi-org.kean.idm.oclc.org/10.1080/10511253.2012.730617

Garrard, J. (2009). Health sciences literature review made easy: The matrix method.  Jones and Bartlett.

Onwuegbuzie, A. J., Leech, N. L., & Collins, K. M. (2012). Qualitative analysis techniques for the review of the literature. Qualitative Report, 17( 28), 1-28.

Randolph, J. (2009). A guide to writing the dissertation literature review. Practical Assessment, Research, and Evaluation, 14 (1), 13.

Wakefield, A. (2015). Synthesising the literature as part of a literature review. Nursing Standard, 29 (29), 44-51. https://doi.org/10.7748/ns.29.29.44.e8957

• Last Updated: Jun 29, 2023 1:35 PM
• URL: https://libguides.kean.edu/ResearchProcessGuide

• Become Involved |
• Give to the Library |
• Staff Directory |
• UNF Library
• Thomas G. Carpenter Library

Conducting a Literature Review

Steps in conducting a literature review.

• Benefits of Conducting a Literature Review
• Summary of the Process
• Additional Resources
• Literature Review Tutorial by American University Library
• The Literature Review: A Few Tips On Conducting It by University of Toronto
• Write a Literature Review by UC Santa Cruz University Library

Conducting a literature review involves using research databases to identify materials that cover or are related in some sense to the research topic. In some cases the research topic may be so original in its scope that no one has done anything exactly like it, so research that is at least similar or related will provide source material for the literature review. The selection of databases will be driven by the subject matter and the scope of the project.

Selecting Databases -- Most academic libraries now provide access to a majority of their databases and their catalog via a so-called discovery tool. A discovery tool makes searching library systems more "Google-like" in that even the simplest of queries can be entered and results retrieved. However, many times the results are also "Google-like" in the sheer quantity of items retrieved. While a discovery tool can be invaluable for quickly finding a multitude of resources on nearly any topic, there are a number of considerations a researcher should keep in mind when using a discovery tool, especially for the researcher who is attempting a comprehensive literature review.

No discovery tool works with every database subscribed to by a library. Some libraries might subscribe to two or three hundred different research databases covering a large number of subject areas. Competing discovery systems might negotiate agreements with different database vendors in order to provide access to a large range of materials. There will be other vendors with whom agreements are not forthcoming, therefore their materials are not included in the discovery tool results. While this might be of only minor concern for a researcher looking to do a fairly limited research project, the researcher looking to do a comprehensive review of the literature in preparation for writing a master's thesis or a doctoral dissertation will run the risk of missing some materials by limiting the search just to a particular library's discovery system. If only one system covered everything that a researcher could possibly need, libraries would have no need to subscribe to hundreds of different databases. The reality is that no one tool does it all. Not even Google Scholar.

Book collections might be excluded from results delivered by a discovery tool. While many libraries are making results from their own catalogs available via their discovery tools, they might not cover books that are discoverable from other library collections, thus making a search of book collections incomplete. Most libraries subscribe to an international database of library catalogs known as WorldCat. This database will provide comprehensive coverage of books, media, and other physical library materials available in libraries worldwide.

Features available in a particular database might not be available in a discovery tool. Keep in mind that a discovery tool is a search system that enables searching across content from numerous individual databases. An individual database might have search features that cannot be provided through a discovery tool, since the discovery tool is designed to accommodate a large number of systems with a single search. For example, the nursing database  CINAHL  includes the ability to limit a search to specific practice areas, to limit to evidence-based practice, to limit to gender, and to search using medical subject headings, among other things, all specialized facets that are not available in a discovery tool. To have these advanced capabilities, a researcher would need to go directly to  CINAHL  and search it natively.

Some discovery tools are set, by default, to limit search results to those items directly available through a particular library's collections. While many researchers will be most concerned with what is immediately available to them at their own library, a researcher concerned with finding everything that has been done on a particular topic will need to go beyond what's available at his or her home library and include materials that are available elsewhere. Master's and doctoral candidates should take care to notice if their library's discovery tool automatically limits to available materials and broaden the scope to include ALL materials, not just those available.

With the foregoing in mind, a researcher might start a search by using the library's discovery tool and then follow up by reviewing which databases have been included in the search and, more importantly, which databases have not been included. Most libraries will facilitate locating its individual databases through a subject arrangement of some kind. Once those databases that are not discoverable have been identified, the researcher would do well to search them individually to find out if other materials can be identified outside of the discovery tool. One additional tool that a doctoral researcher should of necessity include in a search is ISI's  Web of Knowledge . The two major systems searchable within ISI's  Web  are the  Social Sciences Citation Index  and the  Science Citation Index . The purpose of these two systems is to enable a researcher to determine what research has been cited over the years by any number of researchers and how many times it has been cited.

Formulating an Effective Search Strategy -- Key to performing an effective literature review is selecting search terms that will effectively identify materials that are relevant to the research topic. An initial strategy for selecting search terminology might be to list all possible relevant terms and their synonyms in order to have a working vocabulary for use in the research databases. While an individual subject database will likely use a "controlled vocabulary" to index articles and other materials that are included in the database, the same vocabulary might not be as effective in a database that focuses on a different subject area. For example, terminology that is used frequently in psychological literature might not be as effective in searching a human resources management database. Brainstorming the topic before launching into a search will help a researcher arrive at a good working vocabulary to use when probing the databases for relevant literature.

As materials are identified with the initial search, the researcher will want to keep track of other terminology that could be of use in performing additional searches. Sometimes the most effective search terminology can be found by reading the abstracts of relevant materials located through a library's research databases. For example, an initial search on the concept of "mainstreaming" might lead the researcher to articles that discuss mainstreaming but which also look into the concept of "inclusion" in education. While the terms mainstreaming and inclusion are sometimes used synonymously, they really embody two different approaches to working with students having special needs. Abstracts of articles located in the initial search on mainstreaming will uncover related concepts such as inclusion and help a researcher develop a better, more effective vocabulary for fleshing out the literature review.

In addition to searching using key concepts aligned with the research topic, a researcher likely also will want to search for additional materials produced by key authors who are identified in the initial searches. As a researcher reviews items retrieved in the initial stages of the survey, he or she will begin to notice certain authors coming up over and over in relation to the topic. To make sure that no stone is left unturned, it would be advisable to search the available, relevant library databases for other materials by those key authors, just to make sure something of importance has not been missed. A review of the reference lists for each of the items identified in the search will also help to identify key literature that should be reviewed.

Locating the Materials and Composing the Review -- In many cases the items identified through the library's databases will also be available online through the same or related databases. This, however, is not always the case. When materials are not available online, the researcher should check the library's physical collections (print, media, etc.) to determine if the items are available in the library, itself. For those materials not physically available in the home library, the researcher will use interlibrary loan to procure copies from other libraries or services. While abstracts are extremely useful in identifying the right types of materials, they are no substitute for the actual items, themselves. The thorough researcher will make sure that all the key literature has been retrieved and read thoroughly before proceeding too far with the original research.

The end result of the literature review is a discussion of the central themes in the research and an overview of the significant studies located by the researcher. This discussion serves as the lead section of a paper or article that reports the findings of an original research study and sets the stage for presentation of the original study by providing a review of research that has been conducted prior to the current study. As the researcher conducts his or her own study, other relevant materials might enter into the professional literature. It is the researcher's responsibility to update the literature review with newly released information prior to completing his or her own study.

Updating the Initial Search -- Most research projects will take place over a period of time and are not completed in the short term. Especially in the case of master's and doctoral projects, the research process might take a year or several years to complete. During this time, it will be important for the researcher to periodically review the research that has been going on at the same time as his or her own research. Revisiting the search strategies employed in the initial pass of the ltierature will turn up any new studies that might have come to light since the initial search. Fortunately, most research databases and discovery systems provide researchers with the means for automatically notifying them when new materials matching the search strategy have entered the system. This requires that a researcher sign up for a personal "account" with the database in order to save his or her searches and set up "alerts" when new materials come online. Setting up an account does not involve charges to the researcher; this is all a part of the cost borne by the home library in providing access to the databases.

• << Previous: Benefits of Conducting a Literature Review
• Next: Summary of the Process >>
• Last Updated: Aug 29, 2022 8:54 AM
• URL: https://libguides.unf.edu/litreview

The Literature Review

• Publications: A World of Information
• Primary, Secondary and Tertiary Sources

Differences Among Reviews

Common types of reviews.

• Beginning Steps and Finishing a Review
• Information Sources: Where to Find Them
• Webinar Recording (20 Minutes, Slides and Quiz)
• Webinar Recording (50 Minutes, Slides and Quiz)

Image:  White puzzle.  Permission by Pixabay.com license .

There are many types of literature reviews.  The purposes of a literature review will vary, and the sources used in one will depend on the discipline and the review's topic.   

Literature reviews may have differences that include:

• Purpose:   The reason or objective of the review.  One review may be to see how much has been published on a topic (a scoping review) while another may to draw new conclusions by combining data from multiple yet similar studies (a meta-analysis).  A student may do a review for an assignment, while a researcher could include a literature review as support in their grant proposal.
• Rigor:   Some reviews may want to achieve a higher scholarly or objective standard, so they include pre-established or inclusion criteria for what publications can be included.  
• Discipline norms:  a literature review for one subject (e.g., history) would be different than another (e.g., medicine).
• Topical or narrative:  by subject or theme of documents included in the review.
• Chronological:  by when the included documents were published.
• Geographical:  by regions that study a concept.

See "Common Types of Reviews" for their definitions and characteristics.

The table below will provide summaries, definitions, and examples of common reviews.

• Types of Literature Reviews (PDF)
• << Previous: Primary, Secondary and Tertiary Sources
• Next: Beginning Steps and Finishing a Review >>
• Last Updated: May 29, 2024 11:22 AM
• URL: https://libguides.fau.edu/literature-review

Florida Atlantic University Libraries 777 Glades Road Boca Raton, FL 33431 (561) 297-6911

Purdue Online Writing Lab Purdue OWL® College of Liberal Arts

Welcome to the Purdue Online Writing Lab

Welcome to the Purdue OWL

This page is brought to you by the OWL at Purdue University. When printing this page, you must include the entire legal notice.

Copyright ©1995-2018 by The Writing Lab & The OWL at Purdue and Purdue University. All rights reserved. This material may not be published, reproduced, broadcast, rewritten, or redistributed without permission. Use of this site constitutes acceptance of our terms and conditions of fair use.

The Online Writing Lab at Purdue University houses writing resources and instructional material, and we provide these as a free service of the Writing Lab at Purdue. Students, members of the community, and users worldwide will find information to assist with many writing projects. Teachers and trainers may use this material for in-class and out-of-class instruction.

The Purdue On-Campus Writing Lab and Purdue Online Writing Lab assist clients in their development as writers—no matter what their skill level—with on-campus consultations, online participation, and community engagement. The Purdue Writing Lab serves the Purdue, West Lafayette, campus and coordinates with local literacy initiatives. The Purdue OWL offers global support through online reference materials and services.

A Message From the Assistant Director of Content Development 

The Purdue OWL® is committed to supporting  students, instructors, and writers by offering a wide range of resources that are developed and revised with them in mind. To do this, the OWL team is always exploring possibilties for a better design, allowing accessibility and user experience to guide our process. As the OWL undergoes some changes, we welcome your feedback and suggestions by email at any time.

Please don't hesitate to contact us via our contact page  if you have any questions or comments.

All the best,

Social Media

Facebook twitter.

A systematic literature review of empirical research on ChatGPT in education

• Open access
• Published: 26 May 2024
• Volume 3 , article number  60 , ( 2024 )

Cite this article

You have full access to this open access article

• Yazid Albadarin   ORCID: orcid.org/0009-0005-8068-8902 1 ,
• Mohammed Saqr 1 ,
• Nicolas Pope 1 &
• Markku Tukiainen 1  

555 Accesses

Explore all metrics

Over the last four decades, studies have investigated the incorporation of Artificial Intelligence (AI) into education. A recent prominent AI-powered technology that has impacted the education sector is ChatGPT. This article provides a systematic review of 14 empirical studies incorporating ChatGPT into various educational settings, published in 2022 and before the 10th of April 2023—the date of conducting the search process. It carefully followed the essential steps outlined in the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA 2020) guidelines, as well as Okoli’s (Okoli in Commun Assoc Inf Syst, 2015) steps for conducting a rigorous and transparent systematic review. In this review, we aimed to explore how students and teachers have utilized ChatGPT in various educational settings, as well as the primary findings of those studies. By employing Creswell’s (Creswell in Educational research: planning, conducting, and evaluating quantitative and qualitative research [Ebook], Pearson Education, London, 2015) coding techniques for data extraction and interpretation, we sought to gain insight into their initial attempts at ChatGPT incorporation into education. This approach also enabled us to extract insights and considerations that can facilitate its effective and responsible use in future educational contexts. The results of this review show that learners have utilized ChatGPT as a virtual intelligent assistant, where it offered instant feedback, on-demand answers, and explanations of complex topics. Additionally, learners have used it to enhance their writing and language skills by generating ideas, composing essays, summarizing, translating, paraphrasing texts, or checking grammar. Moreover, learners turned to it as an aiding tool to facilitate their directed and personalized learning by assisting in understanding concepts and homework, providing structured learning plans, and clarifying assignments and tasks. However, the results of specific studies (n = 3, 21.4%) show that overuse of ChatGPT may negatively impact innovative capacities and collaborative learning competencies among learners. Educators, on the other hand, have utilized ChatGPT to create lesson plans, generate quizzes, and provide additional resources, which helped them enhance their productivity and efficiency and promote different teaching methodologies. Despite these benefits, the majority of the reviewed studies recommend the importance of conducting structured training, support, and clear guidelines for both learners and educators to mitigate the drawbacks. This includes developing critical evaluation skills to assess the accuracy and relevance of information provided by ChatGPT, as well as strategies for integrating human interaction and collaboration into learning activities that involve AI tools. Furthermore, they also recommend ongoing research and proactive dialogue with policymakers, stakeholders, and educational practitioners to refine and enhance the use of AI in learning environments. This review could serve as an insightful resource for practitioners who seek to integrate ChatGPT into education and stimulate further research in the field.

Similar content being viewed by others

Empowering learners with ChatGPT: insights from a systematic literature exploration

Incorporating AI in foreign language education: An investigation into ChatGPT’s effect on foreign language learners

Large language models in education: A focus on the complementary relationship between human teachers and ChatGPT

Avoid common mistakes on your manuscript.

1 Introduction

Educational technology, a rapidly evolving field, plays a crucial role in reshaping the landscape of teaching and learning [ 82 ]. One of the most transformative technological innovations of our era that has influenced the field of education is Artificial Intelligence (AI) [ 50 ]. Over the last four decades, AI in education (AIEd) has gained remarkable attention for its potential to make significant advancements in learning, instructional methods, and administrative tasks within educational settings [ 11 ]. In particular, a large language model (LLM), a type of AI algorithm that applies artificial neural networks (ANNs) and uses massively large data sets to understand, summarize, generate, and predict new content that is almost difficult to differentiate from human creations [ 79 ], has opened up novel possibilities for enhancing various aspects of education, from content creation to personalized instruction [ 35 ]. Chatbots that leverage the capabilities of LLMs to understand and generate human-like responses have also presented the capacity to enhance student learning and educational outcomes by engaging students, offering timely support, and fostering interactive learning experiences [ 46 ].

The ongoing and remarkable technological advancements in chatbots have made their use more convenient, increasingly natural and effortless, and have expanded their potential for deployment across various domains [ 70 ]. One prominent example of chatbot applications is the Chat Generative Pre-Trained Transformer, known as ChatGPT, which was introduced by OpenAI, a leading AI research lab, on November 30th, 2022. ChatGPT employs a variety of deep learning techniques to generate human-like text, with a particular focus on recurrent neural networks (RNNs). Long short-term memory (LSTM) allows it to grasp the context of the text being processed and retain information from previous inputs. Also, the transformer architecture, a neural network architecture based on the self-attention mechanism, allows it to analyze specific parts of the input, thereby enabling it to produce more natural-sounding and coherent output. Additionally, the unsupervised generative pre-training and the fine-tuning methods allow ChatGPT to generate more relevant and accurate text for specific tasks [ 31 , 62 ]. Furthermore, reinforcement learning from human feedback (RLHF), a machine learning approach that combines reinforcement learning techniques with human-provided feedback, has helped improve ChatGPT’s model by accelerating the learning process and making it significantly more efficient.

This cutting-edge natural language processing (NLP) tool is widely recognized as one of today's most advanced LLMs-based chatbots [ 70 ], allowing users to ask questions and receive detailed, coherent, systematic, personalized, convincing, and informative human-like responses [ 55 ], even within complex and ambiguous contexts [ 63 , 77 ]. ChatGPT is considered the fastest-growing technology in history: in just three months following its public launch, it amassed an estimated 120 million monthly active users [ 16 ] with an estimated 13 million daily queries [ 49 ], surpassing all other applications [ 64 ]. This remarkable growth can be attributed to the unique features and user-friendly interface that ChatGPT offers. Its intuitive design allows users to interact seamlessly with the technology, making it accessible to a diverse range of individuals, regardless of their technical expertise [ 78 ]. Additionally, its exceptional performance results from a combination of advanced algorithms, continuous enhancements, and extensive training on a diverse dataset that includes various text sources such as books, articles, websites, and online forums [ 63 ], have contributed to a more engaging and satisfying user experience [ 62 ]. These factors collectively explain its remarkable global growth and set it apart from predecessors like Bard, Bing Chat, ERNIE, and others.

In this context, several studies have explored the technological advancements of chatbots. One noteworthy recent research effort, conducted by Schöbel et al. [ 70 ], stands out for its comprehensive analysis of more than 5,000 studies on communication agents. This study offered a comprehensive overview of the historical progression and future prospects of communication agents, including ChatGPT. Moreover, other studies have focused on making comparisons, particularly between ChatGPT and alternative chatbots like Bard, Bing Chat, ERNIE, LaMDA, BlenderBot, and various others. For example, O’Leary [ 53 ] compared two chatbots, LaMDA and BlenderBot, with ChatGPT and revealed that ChatGPT outperformed both. This superiority arises from ChatGPT’s capacity to handle a wider range of questions and generate slightly varied perspectives within specific contexts. Similarly, ChatGPT exhibited an impressive ability to formulate interpretable responses that were easily understood when compared with Google's feature snippet [ 34 ]. Additionally, ChatGPT was compared to other LLMs-based chatbots, including Bard and BERT, as well as ERNIE. The findings indicated that ChatGPT exhibited strong performance in the given tasks, often outperforming the other models [ 59 ].

Furthermore, in the education context, a comprehensive study systematically compared a range of the most promising chatbots, including Bard, Bing Chat, ChatGPT, and Ernie across a multidisciplinary test that required higher-order thinking. The study revealed that ChatGPT achieved the highest score, surpassing Bing Chat and Bard [ 64 ]. Similarly, a comparative analysis was conducted to compare ChatGPT with Bard in answering a set of 30 mathematical questions and logic problems, grouped into two question sets. Set (A) is unavailable online, while Set (B) is available online. The results revealed ChatGPT's superiority in Set (A) over Bard. Nevertheless, Bard's advantage emerged in Set (B) due to its capacity to access the internet directly and retrieve answers, a capability that ChatGPT does not possess [ 57 ]. However, through these varied assessments, ChatGPT consistently highlights its exceptional prowess compared to various alternatives in the ever-evolving chatbot technology.

The widespread adoption of chatbots, especially ChatGPT, by millions of students and educators, has sparked extensive discussions regarding its incorporation into the education sector [ 64 ]. Accordingly, many scholars have contributed to the discourse, expressing both optimism and pessimism regarding the incorporation of ChatGPT into education. For example, ChatGPT has been highlighted for its capabilities in enriching the learning and teaching experience through its ability to support different learning approaches, including adaptive learning, personalized learning, and self-directed learning [ 58 , 60 , 91 ]), deliver summative and formative feedback to students and provide real-time responses to questions, increase the accessibility of information [ 22 , 40 , 43 ], foster students’ performance, engagement and motivation [ 14 , 44 , 58 ], and enhance teaching practices [ 17 , 18 , 64 , 74 ].

On the other hand, concerns have been also raised regarding its potential negative effects on learning and teaching. These include the dissemination of false information and references [ 12 , 23 , 61 , 85 ], biased reinforcement [ 47 , 50 ], compromised academic integrity [ 18 , 40 , 66 , 74 ], and the potential decline in students' skills [ 43 , 61 , 64 , 74 ]. As a result, ChatGPT has been banned in multiple countries, including Russia, China, Venezuela, Belarus, and Iran, as well as in various educational institutions in India, Italy, Western Australia, France, and the United States [ 52 , 90 ].

Clearly, the advent of chatbots, especially ChatGPT, has provoked significant controversy due to their potential impact on learning and teaching. This indicates the necessity for further exploration to gain a deeper understanding of this technology and carefully evaluate its potential benefits, limitations, challenges, and threats to education [ 79 ]. Therefore, conducting a systematic literature review will provide valuable insights into the potential prospects and obstacles linked to its incorporation into education. This systematic literature review will primarily focus on ChatGPT, driven by the aforementioned key factors outlined above.

However, the existing literature lacks a systematic literature review of empirical studies. Thus, this systematic literature review aims to address this gap by synthesizing the existing empirical studies conducted on chatbots, particularly ChatGPT, in the field of education, highlighting how ChatGPT has been utilized in educational settings, and identifying any existing gaps. This review may be particularly useful for researchers in the field and educators who are contemplating the integration of ChatGPT or any chatbot into education. The following research questions will guide this study:

What are students' and teachers' initial attempts at utilizing ChatGPT in education?

What are the main findings derived from empirical studies that have incorporated ChatGPT into learning and teaching?

2 Methodology

To conduct this study, the authors followed the essential steps of the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA 2020) and Okoli’s [ 54 ] steps for conducting a systematic review. These included identifying the study’s purpose, drafting a protocol, applying a practical screening process, searching the literature, extracting relevant data, evaluating the quality of the included studies, synthesizing the studies, and ultimately writing the review. The subsequent section provides an extensive explanation of how these steps were carried out in this study.

2.1 Identify the purpose

Given the widespread adoption of ChatGPT by students and teachers for various educational purposes, often without a thorough understanding of responsible and effective use or a clear recognition of its potential impact on learning and teaching, the authors recognized the need for further exploration of ChatGPT's impact on education in this early stage. Therefore, they have chosen to conduct a systematic literature review of existing empirical studies that incorporate ChatGPT into educational settings. Despite the limited number of empirical studies due to the novelty of the topic, their goal is to gain a deeper understanding of this technology and proactively evaluate its potential benefits, limitations, challenges, and threats to education. This effort could help to understand initial reactions and attempts at incorporating ChatGPT into education and bring out insights and considerations that can inform the future development of education.

2.2 Draft the protocol

The next step is formulating the protocol. This protocol serves to outline the study process in a rigorous and transparent manner, mitigating researcher bias in study selection and data extraction [ 88 ]. The protocol will include the following steps: generating the research question, predefining a literature search strategy, identifying search locations, establishing selection criteria, assessing the studies, developing a data extraction strategy, and creating a timeline.

2.3 Apply practical screen

The screening step aims to accurately filter the articles resulting from the searching step and select the empirical studies that have incorporated ChatGPT into educational contexts, which will guide us in answering the research questions and achieving the objectives of this study. To ensure the rigorous execution of this step, our inclusion and exclusion criteria were determined based on the authors' experience and informed by previous successful systematic reviews [ 21 ]. Table 1 summarizes the inclusion and exclusion criteria for study selection.

2.4 Literature search

We conducted a thorough literature search to identify articles that explored, examined, and addressed the use of ChatGPT in Educational contexts. We utilized two research databases: Dimensions.ai, which provides access to a large number of research publications, and lens.org, which offers access to over 300 million articles, patents, and other research outputs from diverse sources. Additionally, we included three databases, Scopus, Web of Knowledge, and ERIC, which contain relevant research on the topic that addresses our research questions. To browse and identify relevant articles, we used the following search formula: ("ChatGPT" AND "Education"), which included the Boolean operator "AND" to get more specific results. The subject area in the Scopus and ERIC databases were narrowed to "ChatGPT" and "Education" keywords, and in the WoS database was limited to the "Education" category. The search was conducted between the 3rd and 10th of April 2023, which resulted in 276 articles from all selected databases (111 articles from Dimensions.ai, 65 from Scopus, 28 from Web of Science, 14 from ERIC, and 58 from Lens.org). These articles were imported into the Rayyan web-based system for analysis. The duplicates were identified automatically by the system. Subsequently, the first author manually reviewed the duplicated articles ensured that they had the same content, and then removed them, leaving us with 135 unique articles. Afterward, the titles, abstracts, and keywords of the first 40 manuscripts were scanned and reviewed by the first author and were discussed with the second and third authors to resolve any disagreements. Subsequently, the first author proceeded with the filtering process for all articles and carefully applied the inclusion and exclusion criteria as presented in Table  1 . Articles that met any one of the exclusion criteria were eliminated, resulting in 26 articles. Afterward, the authors met to carefully scan and discuss them. The authors agreed to eliminate any empirical studies solely focused on checking ChatGPT capabilities, as these studies do not guide us in addressing the research questions and achieving the study's objectives. This resulted in 14 articles eligible for analysis.

2.5 Quality appraisal

The examination and evaluation of the quality of the extracted articles is a vital step [ 9 ]. Therefore, the extracted articles were carefully evaluated for quality using Fink’s [ 24 ] standards, which emphasize the necessity for detailed descriptions of methodology, results, conclusions, strengths, and limitations. The process began with a thorough assessment of each study's design, data collection, and analysis methods to ensure their appropriateness and comprehensive execution. The clarity, consistency, and logical progression from data to results and conclusions were also critically examined. Potential biases and recognized limitations within the studies were also scrutinized. Ultimately, two articles were excluded for failing to meet Fink’s criteria, particularly in providing sufficient detail on methodology, results, conclusions, strengths, or limitations. The review process is illustrated in Fig.  1 .

The study selection process

2.6 Data extraction

The next step is data extraction, the process of capturing the key information and categories from the included studies. To improve efficiency, reduce variation among authors, and minimize errors in data analysis, the coding categories were constructed using Creswell's [ 15 ] coding techniques for data extraction and interpretation. The coding process involves three sequential steps. The initial stage encompasses open coding , where the researcher examines the data, generates codes to describe and categorize it, and gains a deeper understanding without preconceived ideas. Following open coding is axial coding , where the interrelationships between codes from open coding are analyzed to establish more comprehensive categories or themes. The process concludes with selective coding , refining and integrating categories or themes to identify core concepts emerging from the data. The first coder performed the coding process, then engaged in discussions with the second and third authors to finalize the coding categories for the first five articles. The first coder then proceeded to code all studies and engaged again in discussions with the other authors to ensure the finalization of the coding process. After a comprehensive analysis and capturing of the key information from the included studies, the data extraction and interpretation process yielded several themes. These themes have been categorized and are presented in Table  2 . It is important to note that open coding results were removed from Table  2 for aesthetic reasons, as it included many generic aspects, such as words, short phrases, or sentences mentioned in the studies.

2.7 Synthesize studies

In this stage, we will gather, discuss, and analyze the key findings that emerged from the selected studies. The synthesis stage is considered a transition from an author-centric to a concept-centric focus, enabling us to map all the provided information to achieve the most effective evaluation of the data [ 87 ]. Initially, the authors extracted data that included general information about the selected studies, including the author(s)' names, study titles, years of publication, educational levels, research methodologies, sample sizes, participants, main aims or objectives, raw data sources, and analysis methods. Following that, all key information and significant results from the selected studies were compiled using Creswell’s [ 15 ] coding techniques for data extraction and interpretation to identify core concepts and themes emerging from the data, focusing on those that directly contributed to our research questions and objectives, such as the initial utilization of ChatGPT in learning and teaching, learners' and educators' familiarity with ChatGPT, and the main findings of each study. Finally, the data related to each selected study were extracted into an Excel spreadsheet for data processing. The Excel spreadsheet was reviewed by the authors, including a series of discussions to ensure the finalization of this process and prepare it for further analysis. Afterward, the final result being analyzed and presented in various types of charts and graphs. Table 4 presents the extracted data from the selected studies, with each study labeled with a capital 'S' followed by a number.

This section consists of two main parts. The first part provides a descriptive analysis of the data compiled from the reviewed studies. The second part presents the answers to the research questions and the main findings of these studies.

3.1 Part 1: descriptive analysis

This section will provide a descriptive analysis of the reviewed studies, including educational levels and fields, participants distribution, country contribution, research methodologies, study sample size, study population, publication year, list of journals, familiarity with ChatGPT, source of data, and the main aims and objectives of the studies. Table 4 presents a comprehensive overview of the extracted data from the selected studies.

3.1.1 The number of the reviewed studies and publication years

The total number of the reviewed studies was 14. All studies were empirical studies and published in different journals focusing on Education and Technology. One study was published in 2022 [S1], while the remaining were published in 2023 [S2]-[S14]. Table 3 illustrates the year of publication, the names of the journals, and the number of reviewed studies published in each journal for the studies reviewed.

3.1.2 Educational levels and fields

The majority of the reviewed studies, 11 studies, were conducted in higher education institutions [S1]-[S10] and [S13]. Two studies did not specify the educational level of the population [S12] and [S14], while one study focused on elementary education [S11]. However, the reviewed studies covered various fields of education. Three studies focused on Arts and Humanities Education [S8], [S11], and [S14], specifically English Education. Two studies focused on Engineering Education, with one in Computer Engineering [S2] and the other in Construction Education [S3]. Two studies focused on Mathematics Education [S5] and [S12]. One study focused on Social Science Education [S13]. One study focused on Early Education [S4]. One study focused on Journalism Education [S9]. Finally, three studies did not specify the field of education [S1], [S6], and [S7]. Figure  2 represents the educational levels in the reviewed studies, while Fig.  3 represents the context of the reviewed studies.

Educational levels in the reviewed studies

Context of the reviewed studies

3.1.3 Participants distribution and countries contribution

The reviewed studies have been conducted across different geographic regions, providing a diverse representation of the studies. The majority of the studies, 10 in total, [S1]-[S3], [S5]-[S9], [S11], and [S14], primarily focused on participants from single countries such as Pakistan, the United Arab Emirates, China, Indonesia, Poland, Saudi Arabia, South Korea, Spain, Tajikistan, and the United States. In contrast, four studies, [S4], [S10], [S12], and [S13], involved participants from multiple countries, including China and the United States [S4], China, the United Kingdom, and the United States [S10], the United Arab Emirates, Oman, Saudi Arabia, and Jordan [S12], Turkey, Sweden, Canada, and Australia [ 13 ]. Figures  4 and 5 illustrate the distribution of participants, whether from single or multiple countries, and the contribution of each country in the reviewed studies, respectively.

The reviewed studies conducted in single or multiple countries

The Contribution of each country in the studies

3.1.4 Study population and sample size

Four study populations were included: university students, university teachers, university teachers and students, and elementary school teachers. Six studies involved university students [S2], [S3], [S5] and [S6]-[S8]. Three studies focused on university teachers [S1], [S4], and [S6], while one study specifically targeted elementary school teachers [S11]. Additionally, four studies included both university teachers and students [S10] and [ 12 , 13 , 14 ], and among them, study [S13] specifically included postgraduate students. In terms of the sample size of the reviewed studies, nine studies included a small sample size of less than 50 participants [S1], [S3], [S6], [S8], and [S10]-[S13]. Three studies had 50–100 participants [S2], [S9], and [S14]. Only one study had more than 100 participants [S7]. It is worth mentioning that study [S4] adopted a mixed methods approach, including 10 participants for qualitative analysis and 110 participants for quantitative analysis.

3.1.5 Participants’ familiarity with using ChatGPT

The reviewed studies recruited a diverse range of participants with varying levels of familiarity with ChatGPT. Five studies [S2], [S4], [S6], [S8], and [S12] involved participants already familiar with ChatGPT, while eight studies [S1], [S3], [S5], [S7], [S9], [S10], [S13] and [S14] included individuals with differing levels of familiarity. Notably, one study [S11] had participants who were entirely unfamiliar with ChatGPT. It is important to note that four studies [S3], [S5], [S9], and [S11] provided training or guidance to their participants before conducting their studies, while ten studies [S1], [S2], [S4], [S6]-[S8], [S10], and [S12]-[S14] did not provide training due to the participants' existing familiarity with ChatGPT.

3.1.6 Research methodology approaches and source(S) of data

The reviewed studies adopted various research methodology approaches. Seven studies adopted qualitative research methodology [S1], [S4], [S6], [S8], [S10], [S11], and [S12], while three studies adopted quantitative research methodology [S3], [S7], and [S14], and four studies employed mixed-methods, which involved a combination of both the strengths of qualitative and quantitative methods [S2], [S5], [S9], and [S13].

In terms of the source(s) of data, the reviewed studies obtained their data from various sources, such as interviews, questionnaires, and pre-and post-tests. Six studies relied on interviews as their primary source of data collection [S1], [S4], [S6], [S10], [S11], and [S12], four studies relied on questionnaires [S2], [S7], [S13], and [S14], two studies combined the use of pre-and post-tests and questionnaires for data collection [S3] and [S9], while two studies combined the use of questionnaires and interviews to obtain the data [S5] and [S8]. It is important to note that six of the reviewed studies were quasi-experimental [S3], [S5], [S8], [S9], [S12], and [S14], while the remaining ones were experimental studies [S1], [S2], [S4], [S6], [S7], [S10], [S11], and [S13]. Figures  6 and 7 illustrate the research methodologies and the source (s) of data used in the reviewed studies, respectively.

Research methodologies in the reviewed studies

Source of data in the reviewed studies

3.1.7 The aim and objectives of the studies

The reviewed studies encompassed a diverse set of aims, with several of them incorporating multiple primary objectives. Six studies [S3], [S6], [S7], [S8], [S11], and [S12] examined the integration of ChatGPT in educational contexts, and four studies [S4], [S5], [S13], and [S14] investigated the various implications of its use in education, while three studies [S2], [S9], and [S10] aimed to explore both its integration and implications in education. Additionally, seven studies explicitly explored attitudes and perceptions of students [S2] and [S3], educators [S1] and [S6], or both [S10], [S12], and [S13] regarding the utilization of ChatGPT in educational settings.

3.2 Part 2: research questions and main findings of the reviewed studies

This part will present the answers to the research questions and the main findings of the reviewed studies, classified into two main categories (learning and teaching) according to AI Education classification by [ 36 ]. Figure  8 summarizes the main findings of the reviewed studies in a visually informative diagram. Table 4 provides a detailed list of the key information extracted from the selected studies that led to generating these themes.

The main findings in the reviewed studies

4 Students' initial attempts at utilizing ChatGPT in learning and main findings from students' perspective

4.1 virtual intelligent assistant.

Nine studies demonstrated that ChatGPT has been utilized by students as an intelligent assistant to enhance and support their learning. Students employed it for various purposes, such as answering on-demand questions [S2]-[S5], [S8], [S10], and [S12], providing valuable information and learning resources [S2]-[S5], [S6], and [S8], as well as receiving immediate feedback [S2], [S4], [S9], [S10], and [S12]. In this regard, students generally were confident in the accuracy of ChatGPT's responses, considering them relevant, reliable, and detailed [S3], [S4], [S5], and [S8]. However, some students indicated the need for improvement, as they found that answers are not always accurate [S2], and that misleading information may have been provided or that it may not always align with their expectations [S6] and [S10]. It was also observed by the students that the accuracy of ChatGPT is dependent on several factors, including the quality and specificity of the user's input, the complexity of the question or topic, and the scope and relevance of its training data [S12]. Many students felt that ChatGPT's answers were not always accurate and most of them believed that it requires good background knowledge to work with.

4.2 Writing and language proficiency assistant

Six of the reviewed studies highlighted that ChatGPT has been utilized by students as a valuable assistant tool to improve their academic writing skills and language proficiency. Among these studies, three mainly focused on English education, demonstrating that students showed sufficient mastery in using ChatGPT for generating ideas, summarizing, paraphrasing texts, and completing writing essays [S8], [S11], and [S14]. Furthermore, ChatGPT helped them in writing by making students active investigators rather than passive knowledge recipients and facilitated the development of their writing skills [S11] and [S14]. Similarly, ChatGPT allowed students to generate unique ideas and perspectives, leading to deeper analysis and reflection on their journalism writing [S9]. In terms of language proficiency, ChatGPT allowed participants to translate content into their home languages, making it more accessible and relevant to their context [S4]. It also enabled them to request changes in linguistic tones or flavors [S8]. Moreover, participants used it to check grammar or as a dictionary [S11].

4.3 Valuable resource for learning approaches

Five studies demonstrated that students used ChatGPT as a valuable complementary resource for self-directed learning. It provided learning resources and guidance on diverse educational topics and created a supportive home learning environment [S2] and [S4]. Moreover, it offered step-by-step guidance to grasp concepts at their own pace and enhance their understanding [S5], streamlined task and project completion carried out independently [S7], provided comprehensive and easy-to-understand explanations on various subjects [S10], and assisted in studying geometry operations, thereby empowering them to explore geometry operations at their own pace [S12]. Three studies showed that students used ChatGPT as a valuable learning resource for personalized learning. It delivered age-appropriate conversations and tailored teaching based on a child's interests [S4], acted as a personalized learning assistant, adapted to their needs and pace, which assisted them in understanding mathematical concepts [S12], and enabled personalized learning experiences in social sciences by adapting to students' needs and learning styles [S13]. On the other hand, it is important to note that, according to one study [S5], students suggested that using ChatGPT may negatively affect collaborative learning competencies between students.

4.4 Enhancing students' competencies

Six of the reviewed studies have shown that ChatGPT is a valuable tool for improving a wide range of skills among students. Two studies have provided evidence that ChatGPT led to improvements in students' critical thinking, reasoning skills, and hazard recognition competencies through engaging them in interactive conversations or activities and providing responses related to their disciplines in journalism [S5] and construction education [S9]. Furthermore, two studies focused on mathematical education have shown the positive impact of ChatGPT on students' problem-solving abilities in unraveling problem-solving questions [S12] and enhancing the students' understanding of the problem-solving process [S5]. Lastly, one study indicated that ChatGPT effectively contributed to the enhancement of conversational social skills [S4].

4.5 Supporting students' academic success

Seven of the reviewed studies highlighted that students found ChatGPT to be beneficial for learning as it enhanced learning efficiency and improved the learning experience. It has been observed to improve students' efficiency in computer engineering studies by providing well-structured responses and good explanations [S2]. Additionally, students found it extremely useful for hazard reporting [S3], and it also enhanced their efficiency in solving mathematics problems and capabilities [S5] and [S12]. Furthermore, by finding information, generating ideas, translating texts, and providing alternative questions, ChatGPT aided students in deepening their understanding of various subjects [S6]. It contributed to an increase in students' overall productivity [S7] and improved efficiency in composing written tasks [S8]. Regarding learning experiences, ChatGPT was instrumental in assisting students in identifying hazards that they might have otherwise overlooked [S3]. It also improved students' learning experiences in solving mathematics problems and developing abilities [S5] and [S12]. Moreover, it increased students' successful completion of important tasks in their studies [S7], particularly those involving average difficulty writing tasks [S8]. Additionally, ChatGPT increased the chances of educational success by providing students with baseline knowledge on various topics [S10].

5 Teachers' initial attempts at utilizing ChatGPT in teaching and main findings from teachers' perspective

5.1 valuable resource for teaching.

The reviewed studies showed that teachers have employed ChatGPT to recommend, modify, and generate diverse, creative, organized, and engaging educational contents, teaching materials, and testing resources more rapidly [S4], [S6], [S10] and [S11]. Additionally, teachers experienced increased productivity as ChatGPT facilitated quick and accurate responses to questions, fact-checking, and information searches [S1]. It also proved valuable in constructing new knowledge [S6] and providing timely answers to students' questions in classrooms [S11]. Moreover, ChatGPT enhanced teachers' efficiency by generating new ideas for activities and preplanning activities for their students [S4] and [S6], including interactive language game partners [S11].

5.2 Improving productivity and efficiency

The reviewed studies showed that participants' productivity and work efficiency have been significantly enhanced by using ChatGPT as it enabled them to allocate more time to other tasks and reduce their overall workloads [S6], [S10], [S11], [S13], and [S14]. However, three studies [S1], [S4], and [S11], indicated a negative perception and attitude among teachers toward using ChatGPT. This negativity stemmed from a lack of necessary skills to use it effectively [S1], a limited familiarity with it [S4], and occasional inaccuracies in the content provided by it [S10].

5.3 Catalyzing new teaching methodologies

Five of the reviewed studies highlighted that educators found the necessity of redefining their teaching profession with the assistance of ChatGPT [S11], developing new effective learning strategies [S4], and adapting teaching strategies and methodologies to ensure the development of essential skills for future engineers [S5]. They also emphasized the importance of adopting new educational philosophies and approaches that can evolve with the introduction of ChatGPT into the classroom [S12]. Furthermore, updating curricula to focus on improving human-specific features, such as emotional intelligence, creativity, and philosophical perspectives [S13], was found to be essential.

5.4 Effective utilization of CHATGPT in teaching

According to the reviewed studies, effective utilization of ChatGPT in education requires providing teachers with well-structured training, support, and adequate background on how to use ChatGPT responsibly [S1], [S3], [S11], and [S12]. Establishing clear rules and regulations regarding its usage is essential to ensure it positively impacts the teaching and learning processes, including students' skills [S1], [S4], [S5], [S8], [S9], and [S11]-[S14]. Moreover, conducting further research and engaging in discussions with policymakers and stakeholders is indeed crucial for the successful integration of ChatGPT in education and to maximize the benefits for both educators and students [S1], [S6]-[S10], and [S12]-[S14].

6 Discussion

The purpose of this review is to conduct a systematic review of empirical studies that have explored the utilization of ChatGPT, one of today’s most advanced LLM-based chatbots, in education. The findings of the reviewed studies showed several ways of ChatGPT utilization in different learning and teaching practices as well as it provided insights and considerations that can facilitate its effective and responsible use in future educational contexts. The results of the reviewed studies came from diverse fields of education, which helped us avoid a biased review that is limited to a specific field. Similarly, the reviewed studies have been conducted across different geographic regions. This kind of variety in geographic representation enriched the findings of this review.

In response to RQ1 , "What are students' and teachers' initial attempts at utilizing ChatGPT in education?", the findings from this review provide comprehensive insights. Chatbots, including ChatGPT, play a crucial role in supporting student learning, enhancing their learning experiences, and facilitating diverse learning approaches [ 42 , 43 ]. This review found that this tool, ChatGPT, has been instrumental in enhancing students' learning experiences by serving as a virtual intelligent assistant, providing immediate feedback, on-demand answers, and engaging in educational conversations. Additionally, students have benefited from ChatGPT’s ability to generate ideas, compose essays, and perform tasks like summarizing, translating, paraphrasing texts, or checking grammar, thereby enhancing their writing and language competencies. Furthermore, students have turned to ChatGPT for assistance in understanding concepts and homework, providing structured learning plans, and clarifying assignments and tasks, which fosters a supportive home learning environment, allowing them to take responsibility for their own learning and cultivate the skills and approaches essential for supportive home learning environment [ 26 , 27 , 28 ]. This finding aligns with the study of Saqr et al. [ 68 , 69 ] who highlighted that, when students actively engage in their own learning process, it yields additional advantages, such as heightened motivation, enhanced achievement, and the cultivation of enthusiasm, turning them into advocates for their own learning.

Moreover, students have utilized ChatGPT for tailored teaching and step-by-step guidance on diverse educational topics, streamlining task and project completion, and generating and recommending educational content. This personalization enhances the learning environment, leading to increased academic success. This finding aligns with other recent studies [ 26 , 27 , 28 , 60 , 66 ] which revealed that ChatGPT has the potential to offer personalized learning experiences and support an effective learning process by providing students with customized feedback and explanations tailored to their needs and abilities. Ultimately, fostering students' performance, engagement, and motivation, leading to increase students' academic success [ 14 , 44 , 58 ]. This ultimate outcome is in line with the findings of Saqr et al. [ 68 , 69 ], which emphasized that learning strategies are important catalysts of students' learning, as students who utilize effective learning strategies are more likely to have better academic achievement.

Teachers, too, have capitalized on ChatGPT's capabilities to enhance productivity and efficiency, using it for creating lesson plans, generating quizzes, providing additional resources, generating and preplanning new ideas for activities, and aiding in answering students’ questions. This adoption of technology introduces new opportunities to support teaching and learning practices, enhancing teacher productivity. This finding aligns with those of Day [ 17 ], De Castro [ 18 ], and Su and Yang [ 74 ] as well as with those of Valtonen et al. [ 82 ], who revealed that emerging technological advancements have opened up novel opportunities and means to support teaching and learning practices, and enhance teachers’ productivity.

In response to RQ2 , "What are the main findings derived from empirical studies that have incorporated ChatGPT into learning and teaching?", the findings from this review provide profound insights and raise significant concerns. Starting with the insights, chatbots, including ChatGPT, have demonstrated the potential to reshape and revolutionize education, creating new, novel opportunities for enhancing the learning process and outcomes [ 83 ], facilitating different learning approaches, and offering a range of pedagogical benefits [ 19 , 43 , 72 ]. In this context, this review found that ChatGPT could open avenues for educators to adopt or develop new effective learning and teaching strategies that can evolve with the introduction of ChatGPT into the classroom. Nonetheless, there is an evident lack of research understanding regarding the potential impact of generative machine learning models within diverse educational settings [ 83 ]. This necessitates teachers to attain a high level of proficiency in incorporating chatbots, such as ChatGPT, into their classrooms to create inventive, well-structured, and captivating learning strategies. In the same vein, the review also found that teachers without the requisite skills to utilize ChatGPT realized that it did not contribute positively to their work and could potentially have adverse effects [ 37 ]. This concern could lead to inequity of access to the benefits of chatbots, including ChatGPT, as individuals who lack the necessary expertise may not be able to harness their full potential, resulting in disparities in educational outcomes and opportunities. Therefore, immediate action is needed to address these potential issues. A potential solution is offering training, support, and competency development for teachers to ensure that all of them can leverage chatbots, including ChatGPT, effectively and equitably in their educational practices [ 5 , 28 , 80 ], which could enhance accessibility and inclusivity, and potentially result in innovative outcomes [ 82 , 83 ].

Additionally, chatbots, including ChatGPT, have the potential to significantly impact students' thinking abilities, including retention, reasoning, analysis skills [ 19 , 45 ], and foster innovation and creativity capabilities [ 83 ]. This review found that ChatGPT could contribute to improving a wide range of skills among students. However, it found that frequent use of ChatGPT may result in a decrease in innovative capacities, collaborative skills and cognitive capacities, and students' motivation to attend classes, as well as could lead to reduced higher-order thinking skills among students [ 22 , 29 ]. Therefore, immediate action is needed to carefully examine the long-term impact of chatbots such as ChatGPT, on learning outcomes as well as to explore its incorporation into educational settings as a supportive tool without compromising students' cognitive development and critical thinking abilities. In the same vein, the review also found that it is challenging to draw a consistent conclusion regarding the potential of ChatGPT to aid self-directed learning approach. This finding aligns with the recent study of Baskara [ 8 ]. Therefore, further research is needed to explore the potential of ChatGPT for self-directed learning. One potential solution involves utilizing learning analytics as a novel approach to examine various aspects of students' learning and support them in their individual endeavors [ 32 ]. This approach can bridge this gap by facilitating an in-depth analysis of how learners engage with ChatGPT, identifying trends in self-directed learning behavior, and assessing its influence on their outcomes.

Turning to the significant concerns, on the other hand, a fundamental challenge with LLM-based chatbots, including ChatGPT, is the accuracy and quality of the provided information and responses, as they provide false information as truth—a phenomenon often referred to as "hallucination" [ 3 , 49 ]. In this context, this review found that the provided information was not entirely satisfactory. Consequently, the utilization of chatbots presents potential concerns, such as generating and providing inaccurate or misleading information, especially for students who utilize it to support their learning. This finding aligns with other findings [ 6 , 30 , 35 , 40 ] which revealed that incorporating chatbots such as ChatGPT, into education presents challenges related to its accuracy and reliability due to its training on a large corpus of data, which may contain inaccuracies and the way users formulate or ask ChatGPT. Therefore, immediate action is needed to address these potential issues. One possible solution is to equip students with the necessary skills and competencies, which include a background understanding of how to use it effectively and the ability to assess and evaluate the information it generates, as the accuracy and the quality of the provided information depend on the input, its complexity, the topic, and the relevance of its training data [ 28 , 49 , 86 ]. However, it's also essential to examine how learners can be educated about how these models operate, the data used in their training, and how to recognize their limitations, challenges, and issues [ 79 ].

Furthermore, chatbots present a substantial challenge concerning maintaining academic integrity [ 20 , 56 ] and copyright violations [ 83 ], which are significant concerns in education. The review found that the potential misuse of ChatGPT might foster cheating, facilitate plagiarism, and threaten academic integrity. This issue is also affirmed by the research conducted by Basic et al. [ 7 ], who presented evidence that students who utilized ChatGPT in their writing assignments had more plagiarism cases than those who did not. These findings align with the conclusions drawn by Cotton et al. [ 13 ], Hisan and Amri [ 33 ] and Sullivan et al. [ 75 ], who revealed that the integration of chatbots such as ChatGPT into education poses a significant challenge to the preservation of academic integrity. Moreover, chatbots, including ChatGPT, have increased the difficulty in identifying plagiarism [ 47 , 67 , 76 ]. The findings from previous studies [ 1 , 84 ] indicate that AI-generated text often went undetected by plagiarism software, such as Turnitin. However, Turnitin and other similar plagiarism detection tools, such as ZeroGPT, GPTZero, and Copyleaks, have since evolved, incorporating enhanced techniques to detect AI-generated text, despite the possibility of false positives, as noted in different studies that have found these tools still not yet fully ready to accurately and reliably identify AI-generated text [ 10 , 51 ], and new novel detection methods may need to be created and implemented for AI-generated text detection [ 4 ]. This potential issue could lead to another concern, which is the difficulty of accurately evaluating student performance when they utilize chatbots such as ChatGPT assistance in their assignments. Consequently, the most LLM-driven chatbots present a substantial challenge to traditional assessments [ 64 ]. The findings from previous studies indicate the importance of rethinking, improving, and redesigning innovative assessment methods in the era of chatbots [ 14 , 20 , 64 , 75 ]. These methods should prioritize the process of evaluating students' ability to apply knowledge to complex cases and demonstrate comprehension, rather than solely focusing on the final product for assessment. Therefore, immediate action is needed to address these potential issues. One possible solution would be the development of clear guidelines, regulatory policies, and pedagogical guidance. These measures would help regulate the proper and ethical utilization of chatbots, such as ChatGPT, and must be established before their introduction to students [ 35 , 38 , 39 , 41 , 89 ].

In summary, our review has delved into the utilization of ChatGPT, a prominent example of chatbots, in education, addressing the question of how ChatGPT has been utilized in education. However, there remain significant gaps, which necessitate further research to shed light on this area.

7 Conclusions

This systematic review has shed light on the varied initial attempts at incorporating ChatGPT into education by both learners and educators, while also offering insights and considerations that can facilitate its effective and responsible use in future educational contexts. From the analysis of 14 selected studies, the review revealed the dual-edged impact of ChatGPT in educational settings. On the positive side, ChatGPT significantly aided the learning process in various ways. Learners have used it as a virtual intelligent assistant, benefiting from its ability to provide immediate feedback, on-demand answers, and easy access to educational resources. Additionally, it was clear that learners have used it to enhance their writing and language skills, engaging in practices such as generating ideas, composing essays, and performing tasks like summarizing, translating, paraphrasing texts, or checking grammar. Importantly, other learners have utilized it in supporting and facilitating their directed and personalized learning on a broad range of educational topics, assisting in understanding concepts and homework, providing structured learning plans, and clarifying assignments and tasks. Educators, on the other hand, found ChatGPT beneficial for enhancing productivity and efficiency. They used it for creating lesson plans, generating quizzes, providing additional resources, and answers learners' questions, which saved time and allowed for more dynamic and engaging teaching strategies and methodologies.

However, the review also pointed out negative impacts. The results revealed that overuse of ChatGPT could decrease innovative capacities and collaborative learning among learners. Specifically, relying too much on ChatGPT for quick answers can inhibit learners' critical thinking and problem-solving skills. Learners might not engage deeply with the material or consider multiple solutions to a problem. This tendency was particularly evident in group projects, where learners preferred consulting ChatGPT individually for solutions over brainstorming and collaborating with peers, which negatively affected their teamwork abilities. On a broader level, integrating ChatGPT into education has also raised several concerns, including the potential for providing inaccurate or misleading information, issues of inequity in access, challenges related to academic integrity, and the possibility of misusing the technology.

Accordingly, this review emphasizes the urgency of developing clear rules, policies, and regulations to ensure ChatGPT's effective and responsible use in educational settings, alongside other chatbots, by both learners and educators. This requires providing well-structured training to educate them on responsible usage and understanding its limitations, along with offering sufficient background information. Moreover, it highlights the importance of rethinking, improving, and redesigning innovative teaching and assessment methods in the era of ChatGPT. Furthermore, conducting further research and engaging in discussions with policymakers and stakeholders are essential steps to maximize the benefits for both educators and learners and ensure academic integrity.

It is important to acknowledge that this review has certain limitations. Firstly, the limited inclusion of reviewed studies can be attributed to several reasons, including the novelty of the technology, as new technologies often face initial skepticism and cautious adoption; the lack of clear guidelines or best practices for leveraging this technology for educational purposes; and institutional or governmental policies affecting the utilization of this technology in educational contexts. These factors, in turn, have affected the number of studies available for review. Secondly, the utilization of the original version of ChatGPT, based on GPT-3 or GPT-3.5, implies that new studies utilizing the updated version, GPT-4 may lead to different findings. Therefore, conducting follow-up systematic reviews is essential once more empirical studies on ChatGPT are published. Additionally, long-term studies are necessary to thoroughly examine and assess the impact of ChatGPT on various educational practices.

Despite these limitations, this systematic review has highlighted the transformative potential of ChatGPT in education, revealing its diverse utilization by learners and educators alike and summarized the benefits of incorporating it into education, as well as the forefront critical concerns and challenges that must be addressed to facilitate its effective and responsible use in future educational contexts. This review could serve as an insightful resource for practitioners who seek to integrate ChatGPT into education and stimulate further research in the field.

Data availability

The data supporting our findings are available upon request.

Abbreviations

• Artificial intelligence

AI in education

Large language model

Artificial neural networks

Chat Generative Pre-Trained Transformer

Recurrent neural networks

Long short-term memory

Reinforcement learning from human feedback

Natural language processing

Preferred Reporting Items for Systematic Reviews and Meta-Analyses

AlAfnan MA, Dishari S, Jovic M, Lomidze K. ChatGPT as an educational tool: opportunities, challenges, and recommendations for communication, business writing, and composition courses. J Artif Intell Technol. 2023. https://doi.org/10.37965/jait.2023.0184 .

Article   Google Scholar  

Ali JKM, Shamsan MAA, Hezam TA, Mohammed AAQ. Impact of ChatGPT on learning motivation. J Engl Stud Arabia Felix. 2023;2(1):41–9. https://doi.org/10.56540/jesaf.v2i1.51 .

Alkaissi H, McFarlane SI. Artificial hallucinations in ChatGPT: implications in scientific writing. Cureus. 2023. https://doi.org/10.7759/cureus.35179 .

Anderson N, Belavý DL, Perle SM, Hendricks S, Hespanhol L, Verhagen E, Memon AR. AI did not write this manuscript, or did it? Can we trick the AI text detector into generated texts? The potential future of ChatGPT and AI in sports & exercise medicine manuscript generation. BMJ Open Sport Exerc Med. 2023;9(1): e001568. https://doi.org/10.1136/bmjsem-2023-001568 .

Ausat AMA, Massang B, Efendi M, Nofirman N, Riady Y. Can chat GPT replace the role of the teacher in the classroom: a fundamental analysis. J Educ. 2023;5(4):16100–6.

Google Scholar  

Baidoo-Anu D, Ansah L. Education in the Era of generative artificial intelligence (AI): understanding the potential benefits of ChatGPT in promoting teaching and learning. Soc Sci Res Netw. 2023. https://doi.org/10.2139/ssrn.4337484 .

Basic Z, Banovac A, Kruzic I, Jerkovic I. Better by you, better than me, chatgpt3 as writing assistance in students essays. 2023. arXiv preprint arXiv:2302.04536 .‏

Baskara FR. The promises and pitfalls of using chat GPT for self-determined learning in higher education: an argumentative review. Prosiding Seminar Nasional Fakultas Tarbiyah dan Ilmu Keguruan IAIM Sinjai. 2023;2:95–101. https://doi.org/10.47435/sentikjar.v2i0.1825 .

Behera RK, Bala PK, Dhir A. The emerging role of cognitive computing in healthcare: a systematic literature review. Int J Med Inform. 2019;129:154–66. https://doi.org/10.1016/j.ijmedinf.2019.04.024 .

Chaka C. Detecting AI content in responses generated by ChatGPT, YouChat, and Chatsonic: the case of five AI content detection tools. J Appl Learn Teach. 2023. https://doi.org/10.37074/jalt.2023.6.2.12 .

Chiu TKF, Xia Q, Zhou X, Chai CS, Cheng M. Systematic literature review on opportunities, challenges, and future research recommendations of artificial intelligence in education. Comput Educ Artif Intell. 2023;4:100118. https://doi.org/10.1016/j.caeai.2022.100118 .

Choi EPH, Lee JJ, Ho M, Kwok JYY, Lok KYW. Chatting or cheating? The impacts of ChatGPT and other artificial intelligence language models on nurse education. Nurse Educ Today. 2023;125:105796. https://doi.org/10.1016/j.nedt.2023.105796 .

Cotton D, Cotton PA, Shipway JR. Chatting and cheating: ensuring academic integrity in the era of ChatGPT. Innov Educ Teach Int. 2023. https://doi.org/10.1080/14703297.2023.2190148 .

Crawford J, Cowling M, Allen K. Leadership is needed for ethical ChatGPT: Character, assessment, and learning using artificial intelligence (AI). J Univ Teach Learn Pract. 2023. https://doi.org/10.53761/1.20.3.02 .

Creswell JW. Educational research: planning, conducting, and evaluating quantitative and qualitative research [Ebook]. 4th ed. London: Pearson Education; 2015.

Curry D. ChatGPT Revenue and Usage Statistics (2023)—Business of Apps. 2023. https://www.businessofapps.com/data/chatgpt-statistics/

Day T. A preliminary investigation of fake peer-reviewed citations and references generated by ChatGPT. Prof Geogr. 2023. https://doi.org/10.1080/00330124.2023.2190373 .

De Castro CA. A Discussion about the Impact of ChatGPT in education: benefits and concerns. J Bus Theor Pract. 2023;11(2):p28. https://doi.org/10.22158/jbtp.v11n2p28 .

Deng X, Yu Z. A meta-analysis and systematic review of the effect of Chatbot technology use in sustainable education. Sustainability. 2023;15(4):2940. https://doi.org/10.3390/su15042940 .

Eke DO. ChatGPT and the rise of generative AI: threat to academic integrity? J Responsib Technol. 2023;13:100060. https://doi.org/10.1016/j.jrt.2023.100060 .

Elmoazen R, Saqr M, Tedre M, Hirsto L. A systematic literature review of empirical research on epistemic network analysis in education. IEEE Access. 2022;10:17330–48. https://doi.org/10.1109/access.2022.3149812 .

Farrokhnia M, Banihashem SK, Noroozi O, Wals AEJ. A SWOT analysis of ChatGPT: implications for educational practice and research. Innov Educ Teach Int. 2023. https://doi.org/10.1080/14703297.2023.2195846 .

Fergus S, Botha M, Ostovar M. Evaluating academic answers generated using ChatGPT. J Chem Educ. 2023;100(4):1672–5. https://doi.org/10.1021/acs.jchemed.3c00087 .

Fink A. Conducting research literature reviews: from the Internet to Paper. Incorporated: SAGE Publications; 2010.

Firaina R, Sulisworo D. Exploring the usage of ChatGPT in higher education: frequency and impact on productivity. Buletin Edukasi Indonesia (BEI). 2023;2(01):39–46. https://doi.org/10.56741/bei.v2i01.310 .

Firat, M. (2023). How chat GPT can transform autodidactic experiences and open education.  Department of Distance Education, Open Education Faculty, Anadolu Unive .‏ https://orcid.org/0000-0001-8707-5918

Firat M. What ChatGPT means for universities: perceptions of scholars and students. J Appl Learn Teach. 2023. https://doi.org/10.37074/jalt.2023.6.1.22 .

Fuchs K. Exploring the opportunities and challenges of NLP models in higher education: is Chat GPT a blessing or a curse? Front Educ. 2023. https://doi.org/10.3389/feduc.2023.1166682 .

García-Peñalvo FJ. La percepción de la inteligencia artificial en contextos educativos tras el lanzamiento de ChatGPT: disrupción o pánico. Educ Knowl Soc. 2023;24: e31279. https://doi.org/10.14201/eks.31279 .

Gilson A, Safranek CW, Huang T, Socrates V, Chi L, Taylor A, Chartash D. How does ChatGPT perform on the United States medical Licensing examination? The implications of large language models for medical education and knowledge assessment. JMIR Med Educ. 2023;9: e45312. https://doi.org/10.2196/45312 .

Hashana AJ, Brundha P, Ayoobkhan MUA, Fazila S. Deep Learning in ChatGPT—A Survey. In   2023 7th international conference on trends in electronics and informatics (ICOEI) . 2023. (pp. 1001–1005). IEEE. https://doi.org/10.1109/icoei56765.2023.10125852

Hirsto L, Saqr M, López-Pernas S, Valtonen T. (2022). A systematic narrative review of learning analytics research in K-12 and schools.  Proceedings . https://ceur-ws.org/Vol-3383/FLAIEC22_paper_9536.pdf

Hisan UK, Amri MM. ChatGPT and medical education: a double-edged sword. J Pedag Educ Sci. 2023;2(01):71–89. https://doi.org/10.13140/RG.2.2.31280.23043/1 .

Hopkins AM, Logan JM, Kichenadasse G, Sorich MJ. Artificial intelligence chatbots will revolutionize how cancer patients access information: ChatGPT represents a paradigm-shift. JNCI Cancer Spectr. 2023. https://doi.org/10.1093/jncics/pkad010 .

Househ M, AlSaad R, Alhuwail D, Ahmed A, Healy MG, Latifi S, Sheikh J. Large Language models in medical education: opportunities, challenges, and future directions. JMIR Med Educ. 2023;9: e48291. https://doi.org/10.2196/48291 .

Ilkka T. The impact of artificial intelligence on learning, teaching, and education. Minist de Educ. 2018. https://doi.org/10.2760/12297 .

Iqbal N, Ahmed H, Azhar KA. Exploring teachers’ attitudes towards using CHATGPT. Globa J Manag Adm Sci. 2022;3(4):97–111. https://doi.org/10.46568/gjmas.v3i4.163 .

Irfan M, Murray L, Ali S. Integration of Artificial intelligence in academia: a case study of critical teaching and learning in Higher education. Globa Soc Sci Rev. 2023;8(1):352–64. https://doi.org/10.31703/gssr.2023(viii-i).32 .

Jeon JH, Lee S. Large language models in education: a focus on the complementary relationship between human teachers and ChatGPT. Educ Inf Technol. 2023. https://doi.org/10.1007/s10639-023-11834-1 .

Khan RA, Jawaid M, Khan AR, Sajjad M. ChatGPT—Reshaping medical education and clinical management. Pak J Med Sci. 2023. https://doi.org/10.12669/pjms.39.2.7653 .

King MR. A conversation on artificial intelligence, Chatbots, and plagiarism in higher education. Cell Mol Bioeng. 2023;16(1):1–2. https://doi.org/10.1007/s12195-022-00754-8 .

Kooli C. Chatbots in education and research: a critical examination of ethical implications and solutions. Sustainability. 2023;15(7):5614. https://doi.org/10.3390/su15075614 .

Kuhail MA, Alturki N, Alramlawi S, Alhejori K. Interacting with educational chatbots: a systematic review. Educ Inf Technol. 2022;28(1):973–1018. https://doi.org/10.1007/s10639-022-11177-3 .

Lee H. The rise of ChatGPT: exploring its potential in medical education. Anat Sci Educ. 2023. https://doi.org/10.1002/ase.2270 .

Li L, Subbareddy R, Raghavendra CG. AI intelligence Chatbot to improve students learning in the higher education platform. J Interconnect Netw. 2022. https://doi.org/10.1142/s0219265921430325 .

Limna P. A Review of Artificial Intelligence (AI) in Education during the Digital Era. 2022. https://ssrn.com/abstract=4160798

Lo CK. What is the impact of ChatGPT on education? A rapid review of the literature. Educ Sci. 2023;13(4):410. https://doi.org/10.3390/educsci13040410 .

Luo W, He H, Liu J, Berson IR, Berson MJ, Zhou Y, Li H. Aladdin’s genie or pandora’s box For early childhood education? Experts chat on the roles, challenges, and developments of ChatGPT. Early Educ Dev. 2023. https://doi.org/10.1080/10409289.2023.2214181 .

Meyer JG, Urbanowicz RJ, Martin P, O’Connor K, Li R, Peng P, Moore JH. ChatGPT and large language models in academia: opportunities and challenges. Biodata Min. 2023. https://doi.org/10.1186/s13040-023-00339-9 .

Mhlanga D. Open AI in education, the responsible and ethical use of ChatGPT towards lifelong learning. Soc Sci Res Netw. 2023. https://doi.org/10.2139/ssrn.4354422 .

Neumann, M., Rauschenberger, M., & Schön, E. M. (2023). “We Need To Talk About ChatGPT”: The Future of AI and Higher Education.‏ https://doi.org/10.1109/seeng59157.2023.00010

Nolan B. Here are the schools and colleges that have banned the use of ChatGPT over plagiarism and misinformation fears. Business Insider . 2023. https://www.businessinsider.com

O’Leary DE. An analysis of three chatbots: BlenderBot, ChatGPT and LaMDA. Int J Intell Syst Account, Financ Manag. 2023;30(1):41–54. https://doi.org/10.1002/isaf.1531 .

Okoli C. A guide to conducting a standalone systematic literature review. Commun Assoc Inf Syst. 2015. https://doi.org/10.17705/1cais.03743 .

OpenAI. (2023). https://openai.com/blog/chatgpt

Perkins M. Academic integrity considerations of AI large language models in the post-pandemic era: ChatGPT and beyond. J Univ Teach Learn Pract. 2023. https://doi.org/10.53761/1.20.02.07 .

Plevris V, Papazafeiropoulos G, Rios AJ. Chatbots put to the test in math and logic problems: A preliminary comparison and assessment of ChatGPT-3.5, ChatGPT-4, and Google Bard. arXiv (Cornell University) . 2023. https://doi.org/10.48550/arxiv.2305.18618

Rahman MM, Watanobe Y (2023) ChatGPT for education and research: opportunities, threats, and strategies. Appl Sci 13(9):5783. https://doi.org/10.3390/app13095783

Ram B, Verma P. Artificial intelligence AI-based Chatbot study of ChatGPT, google AI bard and baidu AI. World J Adv Eng Technol Sci. 2023;8(1):258–61. https://doi.org/10.30574/wjaets.2023.8.1.0045 .

Rasul T, Nair S, Kalendra D, Robin M, de Oliveira Santini F, Ladeira WJ, Heathcote L. The role of ChatGPT in higher education: benefits, challenges, and future research directions. J Appl Learn Teach. 2023. https://doi.org/10.37074/jalt.2023.6.1.29 .

Ratnam M, Sharm B, Tomer A. ChatGPT: educational artificial intelligence. Int J Adv Trends Comput Sci Eng. 2023;12(2):84–91. https://doi.org/10.30534/ijatcse/2023/091222023 .

Ray PP. ChatGPT: a comprehensive review on background, applications, key challenges, bias, ethics, limitations and future scope. Internet Things Cyber-Phys Syst. 2023;3:121–54. https://doi.org/10.1016/j.iotcps.2023.04.003 .

Roumeliotis KI, Tselikas ND. ChatGPT and Open-AI models: a preliminary review. Future Internet. 2023;15(6):192. https://doi.org/10.3390/fi15060192 .

Rudolph J, Tan S, Tan S. War of the chatbots: Bard, Bing Chat, ChatGPT, Ernie and beyond. The new AI gold rush and its impact on higher education. J Appl Learn Teach. 2023. https://doi.org/10.37074/jalt.2023.6.1.23 .

Ruiz LMS, Moll-López S, Nuñez-Pérez A, Moraño J, Vega-Fleitas E. ChatGPT challenges blended learning methodologies in engineering education: a case study in mathematics. Appl Sci. 2023;13(10):6039. https://doi.org/10.3390/app13106039 .

Sallam M, Salim NA, Barakat M, Al-Tammemi AB. ChatGPT applications in medical, dental, pharmacy, and public health education: a descriptive study highlighting the advantages and limitations. Narra J. 2023;3(1): e103. https://doi.org/10.52225/narra.v3i1.103 .

Salvagno M, Taccone FS, Gerli AG. Can artificial intelligence help for scientific writing? Crit Care. 2023. https://doi.org/10.1186/s13054-023-04380-2 .

Saqr M, López-Pernas S, Helske S, Hrastinski S. The longitudinal association between engagement and achievement varies by time, students’ profiles, and achievement state: a full program study. Comput Educ. 2023;199:104787. https://doi.org/10.1016/j.compedu.2023.104787 .

Saqr M, Matcha W, Uzir N, Jovanović J, Gašević D, López-Pernas S. Transferring effective learning strategies across learning contexts matters: a study in problem-based learning. Australas J Educ Technol. 2023;39(3):9.

Schöbel S, Schmitt A, Benner D, Saqr M, Janson A, Leimeister JM. Charting the evolution and future of conversational agents: a research agenda along five waves and new frontiers. Inf Syst Front. 2023. https://doi.org/10.1007/s10796-023-10375-9 .

Shoufan A. Exploring students’ perceptions of CHATGPT: thematic analysis and follow-up survey. IEEE Access. 2023. https://doi.org/10.1109/access.2023.3268224 .

Sonderegger S, Seufert S. Chatbot-mediated learning: conceptual framework for the design of Chatbot use cases in education. Gallen: Institute for Educational Management and Technologies, University of St; 2022. https://doi.org/10.5220/0010999200003182 .

Book   Google Scholar  

Strzelecki A. To use or not to use ChatGPT in higher education? A study of students’ acceptance and use of technology. Interact Learn Environ. 2023. https://doi.org/10.1080/10494820.2023.2209881 .

Su J, Yang W. Unlocking the power of ChatGPT: a framework for applying generative AI in education. ECNU Rev Educ. 2023. https://doi.org/10.1177/20965311231168423 .

Sullivan M, Kelly A, McLaughlan P. ChatGPT in higher education: Considerations for academic integrity and student learning. J ApplLearn Teach. 2023;6(1):1–10. https://doi.org/10.37074/jalt.2023.6.1.17 .

Szabo A. ChatGPT is a breakthrough in science and education but fails a test in sports and exercise psychology. Balt J Sport Health Sci. 2023;1(128):25–40. https://doi.org/10.33607/bjshs.v127i4.1233 .

Taecharungroj V. “What can ChatGPT do?” analyzing early reactions to the innovative AI chatbot on Twitter. Big Data Cognit Comput. 2023;7(1):35. https://doi.org/10.3390/bdcc7010035 .

Tam S, Said RB. User preferences for ChatGPT-powered conversational interfaces versus traditional methods. Biomed Eng Soc. 2023. https://doi.org/10.58496/mjcsc/2023/004 .

Tedre M, Kahila J, Vartiainen H. (2023). Exploration on how co-designing with AI facilitates critical evaluation of ethics of AI in craft education. In: Langran E, Christensen P, Sanson J (Eds).  Proceedings of Society for Information Technology and Teacher Education International Conference . 2023. pp. 2289–2296.

Tlili A, Shehata B, Adarkwah MA, Bozkurt A, Hickey DT, Huang R, Agyemang B. What if the devil is my guardian angel: ChatGPT as a case study of using chatbots in education. Smart Learn Environ. 2023. https://doi.org/10.1186/s40561-023-00237-x .

Uddin SMJ, Albert A, Ovid A, Alsharef A. Leveraging CHATGPT to aid construction hazard recognition and support safety education and training. Sustainability. 2023;15(9):7121. https://doi.org/10.3390/su15097121 .

Valtonen T, López-Pernas S, Saqr M, Vartiainen H, Sointu E, Tedre M. The nature and building blocks of educational technology research. Comput Hum Behav. 2022;128:107123. https://doi.org/10.1016/j.chb.2021.107123 .

Vartiainen H, Tedre M. Using artificial intelligence in craft education: crafting with text-to-image generative models. Digit Creat. 2023;34(1):1–21. https://doi.org/10.1080/14626268.2023.2174557 .

Ventayen RJM. OpenAI ChatGPT generated results: similarity index of artificial intelligence-based contents. Soc Sci Res Netw. 2023. https://doi.org/10.2139/ssrn.4332664 .

Wagner MW, Ertl-Wagner BB. Accuracy of information and references using ChatGPT-3 for retrieval of clinical radiological information. Can Assoc Radiol J. 2023. https://doi.org/10.1177/08465371231171125 .

Wardat Y, Tashtoush MA, AlAli R, Jarrah AM. ChatGPT: a revolutionary tool for teaching and learning mathematics. Eurasia J Math, Sci Technol Educ. 2023;19(7):em2286. https://doi.org/10.29333/ejmste/13272 .

Webster J, Watson RT. Analyzing the past to prepare for the future: writing a literature review. Manag Inf Syst Quart. 2002;26(2):3.

Xiao Y, Watson ME. Guidance on conducting a systematic literature review. J Plan Educ Res. 2017;39(1):93–112. https://doi.org/10.1177/0739456x17723971 .

Yan D. Impact of ChatGPT on learners in a L2 writing practicum: an exploratory investigation. Educ Inf Technol. 2023. https://doi.org/10.1007/s10639-023-11742-4 .

Yu H. Reflection on whether Chat GPT should be banned by academia from the perspective of education and teaching. Front Psychol. 2023;14:1181712. https://doi.org/10.3389/fpsyg.2023.1181712 .

Zhu C, Sun M, Luo J, Li T, Wang M. How to harness the potential of ChatGPT in education? Knowl Manag ELearn. 2023;15(2):133–52. https://doi.org/10.34105/j.kmel.2023.15.008 .

Download references

The paper is co-funded by the Academy of Finland (Suomen Akatemia) Research Council for Natural Sciences and Engineering for the project Towards precision education: Idiographic learning analytics (TOPEILA), Decision Number 350560.

Author information

Authors and affiliations.

School of Computing, University of Eastern Finland, 80100, Joensuu, Finland

Yazid Albadarin, Mohammed Saqr, Nicolas Pope & Markku Tukiainen

You can also search for this author in PubMed   Google Scholar

Contributions

YA contributed to the literature search, data analysis, discussion, and conclusion. Additionally, YA contributed to the manuscript’s writing, editing, and finalization. MS contributed to the study’s design, conceptualization, acquisition of funding, project administration, allocation of resources, supervision, validation, literature search, and analysis of results. Furthermore, MS contributed to the manuscript's writing, revising, and approving it in its finalized state. NP contributed to the results, and discussions, and provided supervision. NP also contributed to the writing process, revisions, and the final approval of the manuscript in its finalized state. MT contributed to the study's conceptualization, resource management, supervision, writing, revising the manuscript, and approving it.

Corresponding author

Correspondence to Yazid Albadarin .

Ethics declarations

Competing interests.

The authors declare no competing interests.

Additional information

Publisher's note.

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

See Table  4

The process of synthesizing the data presented in Table  4 involved identifying the relevant studies through a search process of databases (ERIC, Scopus, Web of Knowledge, Dimensions.ai, and lens.org) using specific keywords "ChatGPT" and "education". Following this, inclusion/exclusion criteria were applied, and data extraction was performed using Creswell's [ 15 ] coding techniques to capture key information and identify common themes across the included studies.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ .

Reprints and permissions

About this article

Albadarin, Y., Saqr, M., Pope, N. et al. A systematic literature review of empirical research on ChatGPT in education. Discov Educ 3 , 60 (2024). https://doi.org/10.1007/s44217-024-00138-2

Download citation

Received : 22 October 2023

Accepted : 10 May 2024

Published : 26 May 2024

DOI : https://doi.org/10.1007/s44217-024-00138-2

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

• Large language models
• Educational technology
• Systematic review

Advertisement

• Find a journal
• Publish with us
• Track your research

Loading metrics

Open Access

Peer-reviewed

Research Article

Coming in from the cold: Addressing the challenges experienced by women conducting remote polar fieldwork

Contributed equally to this work with: Maria Dance, Rebecca Julianne Duncan, Marjolein Gevers, Eleanor Maedhbh Honan, Elaine Runge, Florina Roana Schalamon, Daniela Marianne Regina Walch

Roles Conceptualization, Data curation, Formal analysis, Methodology, Software, Visualization, Writing – original draft, Writing – review & editing

Affiliations School of Geography and the Environment, University of Oxford, Oxford, United Kingdom, Department of Arctic Biology, University Centre in Svalbard, Longyearbyen, Norway

Affiliations Department of Arctic Biology, University Centre in Svalbard, Longyearbyen, Norway, School of Life Sciences, University Technology Sydney, Sydney, Australia

Roles Conceptualization, Data curation, Investigation, Project administration, Writing – original draft, Writing – review & editing

* E-mail: [email protected]

Affiliation Institute of Earth Surface Dynamics, University of Lausanne, Lausanne, Switzerland

Roles Conceptualization, Data curation, Investigation, Writing – original draft, Writing – review & editing

Affiliation Department of Geography, Durham University, Durham, United Kingdom

Affiliation DHI A/S- DHI Water Environment Health, Hørsholm, Denmark

Affiliation Department of Geography and Regional Sciences, University of Graz, Graz, Austria

Affiliation Département de Biologie, Chimie et Géographie, Université du Québec à Rimouski, Rimouski, Canada

• Maria Dance, 
• Rebecca Julianne Duncan, 
• Marjolein Gevers, 
• Eleanor Maedhbh Honan, 
• Elaine Runge, 
• Florina Roana Schalamon, 
• Daniela Marianne Regina Walch

• Published: June 5, 2024
• https://doi.org/10.1371/journal.pclm.0000393
• Peer Review
• Reader Comments

Remote fieldwork is an important component of polar research across both physical and social sciences. There is increasing recognition that the inherent logistical, physical, psychological, and interpersonal challenges of remote polar fieldwork are not felt equally across the polar research community, with minority groups often disproportionately affected. Although historically lacking diversity, the demographics of polar researchers have shifted, and the way polar research is conducted has been changing in response. However, there are still barriers to equal participation. Removing these barriers would attract scientists from more diverse backgrounds and improve scientific outcomes. We explored the lived experiences of those who identify as women in polar fieldwork through a review of current literature and an anonymous survey, using existing networks to connect with women working in polar research. We synthesised survey responses with regards to topics such as harassment, hygiene, inefficient communication, gendered work expectations and responsibilities to form a holistic understanding of the key fieldwork challenges faced by women. The majority of survey respondents (79%, n = 320) had encountered negative experiences during fieldwork, with the most common and impactful issues relating to field team dynamics and communication, sexism, rest, and weather. Many other issues including fieldwork preparation, work expectations, harassment, and personal space and privacy were also raised by respondents. We identify critical points of action from the survey results and in literature and propose strategies to remove barriers to participation and improve the experiences of women in polar fieldwork. These include individual- and organisational-level strategies for pre, during, and post fieldwork. A diverse polar research community is imperative in order to address the challenges presented by current unprecedented climate change. Though this study focussed on women’s experiences, we seek to advance the discourse on challenges faced by all minorities in polar research.

Citation: Dance M, Duncan RJ, Gevers M, Honan EM, Runge E, Schalamon FR, et al. (2024) Coming in from the cold: Addressing the challenges experienced by women conducting remote polar fieldwork. PLOS Clim 3(6): e0000393. https://doi.org/10.1371/journal.pclm.0000393

Editor: Noureddine Benkeblia, University of the West Indies, JAMAICA

Received: December 22, 2023; Accepted: April 20, 2024; Published: June 5, 2024

Copyright: © 2024 Dance et al. This is an open access article distributed under the terms of the Creative Commons Attribution License , which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.

Data Availability: The authors are unable to share this data; due to approved reasons, access restrictions apply to the data underlying the findings of this study. The data utilized in this research originates from a survey focused on respondents' experiences in polar fieldwork. The sensitive nature of this dataset, coupled with the small and closely-knit polar fieldwork community, raises concerns about the potential identifiability of individuals based on combinations of answers, including protected characteristics. The APECS International Directorate will serve as the primary contact for any future data requests. Requests should be directed to the APECS International Directorate at [email protected] .

Funding: The authors did not receive specific funding for this work. RJD was supported by an Australian Government Research Training Program Scholarship and an AINSE Ltd. Postgraduate Research Award (PGRA), MG was supported by SNF project no. PZ00P2_202024, FRS was supported by the Austrian Science Fund (FWF) [P35388], and DMRW was supported through the FRQNT PBEEE Merit Scholarship (grant number #321150). The authors did not receive specific funding for this project. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

Competing interests: The authors have declared that no competing interests exist.

1. Introduction

The polar regions—the Arctic, Antarctica, and the Qinghai-Tibet Plateau (often termed the Third Pole)—are currently experiencing some of the most pronounced and rapid environmental changes globally [ 1 ]. As a result, understanding the underlying processes and possible impacts of climate change in these regions is of utmost importance. A diverse and inclusive polar research community is imperative when aiming to solve complex global problems related to climate change [ 2 – 4 ].

Globally, women and other marginalised or minority groups encounter persistent challenges in receiving equal treatment and opportunities. In line with fostering sustainable development worldwide, the promotion of women’s empowerment and gender equality is a key focus of the internationally recognized Sustainable Development Goal (SDG) 5 for 2030 [ 5 ]. Women constitute only about 30% of the global scientific community [ 6 ], while in climate science, women constitute only 22% of authors of the 100 most highly cited climate science papers 2016–2020 [ 4 ], and only 122 of the ‘Reuters Hot List of the world’s 1000 top climate scientists’ were women [ 7 ]. In addition, 41% of the responding women authors for the Intergovernmental Panel on Climate Change (IPCC) landmark reports identified gender as a barrier to their success [ 8 , 9 ].

Barriers also persist for equitable participation of women in polar research [ 10 ]. Whilst the overall number of women in this field is not known, underrepresentation is evident in polar organisations; women make up 39% of the British Antarctic Survey [ 11 ], 40% of the Australian Antarctic Division [ 10 ] and 21% of investigators in ArcticNet Canada [ 2 ]. However, whilst the polar research community has historically lacked cultural and gender diversity, there has been a slow but steady growth in female participation, accompanied by a reduction in institutional barriers [ 12 – 14 ]. Currently 57% of the members of the Association of Polar Early Career Scientists (APECS) are women (personal communication with APECS International Directorate, November 2023), and the proportion of female-led Antarctic research has shown an upward trend since the 1980s [ 10 ].

The ubiquitous challenges of climate change and the urgency to act does not allow for the exclusion of skills or knowledge and underrepresentation of women in climate sciences [ 15 ]. In addition, the political and socioeconomic struggles associated with climate change are expected to disproportionately impact women and girls [ 16 ]. A more diverse scientific community is necessary to find comprehensive and inclusive solutions to global challenges. Diverse research groups have benefits such as producing research that is perceived to be of higher quality, as well as increased leadership quality [ 17 ]. Whereas lack of diversity is an impediment to a strong and sustainable climate research community and has substantial societal implications and economic consequences [ 18 ]. In addition, a greater number of female leaders may foster greater commitment to sustainable development and contributions to the achievement of global efforts such as the SDG 13 Climate Action goal [ 19 ].

Institutional changes are required to improve diversity in polar research [ 20 ]. Frameworks, policies, and entities dedicated to fostering equity, diversity, and inclusion (collectively known as ‘EDI’) have played a role in increasing the involvement of women and other minority groups in polar sciences. However, these initiatives have been critiqued for addressing minority categories in an undifferentiated manner, rather than a holistic and intersectional approach [ 21 , 22 ]. Moreover, there are concerns about the risk of inadvertently fostering an environment where distribution of support is imbalanced across minority groups [ 23 ], and that these measures may not be strong enough to bring about substantial and meaningful change [ 2 ].

EDI initiatives rarely extend to fieldwork settings, even though fieldwork is an integral part of polar research for many disciplines and comes with its own set of risks and issues. There is increasing recognition that the inherent challenges of fieldwork are not felt equally across the polar research community, with minority groups often being disproportionately negatively affected [ 10 , 24 , 25 ]. Fieldwork continues to present obstacles for women, potentially perpetuating the "leaky pipeline" phenomenon of an escalating underrepresentation of qualified women in higher career stages [ 2 , 10 , 18 , 25 – 27 ], although this framework has been critiqued for not incorporating intersectional disadvantage [ 10 , 26 ]. These barriers to equal participation in fieldwork may affect career progression, as fieldwork opportunities, participation, and leadership roles are prerequisites for many careers, particularly in field-based sciences such as geosciences [ 28 ]. Enhancing the quality of fieldwork operations and the overall experiences of underrepresented groups, particularly women, can advance diversity and sustainability in polar climate change research. Reflecting the relatively recent emergence of this discourse (acknowledging the longstanding nature of the issue itself), there is a scarcity of documented knowledge and reports on female experiences in polar fieldwork, as well as pathways/strategies towards fostering a more inclusive research practice.

1.1 Literature review

In a scoping literature review on available peer-reviewed and grey literature ( i . e ., news articles, blogs) on women conducting polar fieldwork, a total of only n = 31 records could be identified to address women or female experiences in polar fieldwork (see S1 Text ). Of these records, n = 29 (93.55%) are assumed to have a female first author. Until recently, issues faced by female researchers in isolating and confined environments of remote fieldwork [ 24 ] and polar fieldwork [ 29 ] remained disregarded in scientific publications. Contributions to this emerging discourse stem from anecdotal or biographical publications (e.g. [ 30 ]) as well as formalised studies and surveys [ 10 ] that aim to establish a baseline for women-specific experiences in the field.

The isolating nature of polar fieldwork [ 29 ] has the potential to leave minority and marginalised groups particularly vulnerable. For example, Nash et al. [ 10 ] identified physical barriers, unpaid work, gender bias, lack of opportunities, and sexual harassment as issues faced by women in Antarctic research. Sexual harassment has been at the forefront of a growing discourse surrounding women and fieldwork, propelled by the momentum of the global #MeToo movement [ 25 , 31 ]. In recent years, reports have emerged from several major national polar programmes documenting instances of extreme abuse of female scientists and fieldworkers [ 32 ]. In addition, in a landmark survey, Clancy et al. [ 33 ] found that 71% of female field scientists had experienced harassment while doing fieldwork, one in four had been assaulted, and 84% of those harassed women were ‘trainee-level’ (student and post-doctoral). Early career researchers (ECRs) are therefore often carrying the load of both experiencing a disproportionate level of harassment whilst having a key role to play in establishing an open dialogue on inclusivity and equity in polar research practices [ 25 , 34 ].

There has been a significant increase in publications on women involved in polar fieldwork over the past two years with three records in 2022 (9.4% of the total records found) and eight records in 2023 (25% of the total records found). The limited existing body of literature focuses predominantly on Antarctic fieldwork and its unique characteristics of remoteness and historically routed heteronormativity and masculinity [ 10 , 21 , 31 ]. Publications by Nash and colleagues on the matter have been pivotal to the awareness of specific challenges, such as issues of hygiene and sexual harassment [ 10 , 31 , 35 , 36 ]. Arctic field research (e.g. [ 2 , 12 , 30 ]) and global ship-based fieldwork [ 37 ] have equally gained attention and diversify the perspectives on these issues. The overall low number of publications does, however, not allow for an in-depth systematic review and statistical analysis.

1.2 Study aims

This study builds upon published work and focuses on collating the lived experiences of women conducting polar fieldwork through a survey published herein. The authors aim to add to the discourse surrounding the unique challenges faced by this minority. A holistic understanding of the challenges women face is needed in order to identify strategies to improve their participation and experiences. We propose strategies that address the specific needs articulated by survey respondents, which could aid in creating a more diverse and inclusive polar community overall.

2.1 Survey design & implementation

The target group of the survey encompassed people who identify as women and have conducted or are conducting fieldwork in the polar regions. Polar research was defined as research of all academic disciplines occurring in the Arctic, Antarctic, and the Third Pole, while fieldwork was defined as practical work conducted by a researcher in the natural environment, rather than in a laboratory or office.

This survey drew inspiration from Beniest et al. [ 38 ] and Cech et al. [ 39 ] and took into account guidelines provided by the National Science Foundation [ 40 ], the National Center for Women & Information Technology [ 41 ], and the United Nations [ 42 ]. Invitations for participation in the survey were shared over various institutional and international mailing lists and forums, as well as Facebook groups and personal contacts during September and October 2023. We aimed to reach as many people as possible, thus, reflecting a diverse community of respondents. We acknowledge that the authors’ backgrounds may have influenced the networks the survey reached and potentially reduced sample representativeness. The survey was only made available in English, which may have further reduced the pool of potential respondents.

The survey explored three main aspects: demographics of respondents, fieldwork characteristics, and fieldwork experiences. These aspects included the following topics: demographics, fieldwork type, fieldwork preparation, fieldwork practicalities (communication, physical aspects, rest breaks), working in a team, post-fieldwork debrief, negative experiences, and options for feedback. The survey consisted of a combination of multiple-choice questions (including open-ended options, hereafter “free text options”), rating scale questions, dichotomous questions, and open-ended questions (the results of which are hereafter “long-form responses”). There were no compulsory questions. For the complete list of questions see S2 Text .

2.2 Survey ethics statement

To ensure participant anonymity, the survey did not collect any individual identifiers such as names, IP addresses, or contact details. As survey responses would be anonymous and data would not be identifiable to individuals, institutional ethical approval was not sought. Before the start of the survey, potential participants were informed of the research aim, methods, and scope, as well as potential survey outputs, data anonymity and data protection policy, potential risks, and researcher background and contact details in writing (Information text, see S2 Text ). After reading this information, participation in the survey implied consent, with all questions optional. Since the researchers had no direct contact with participants and data were anonymised before access and analysis, a formal informed consent process was not used. To further ensure the anonymity of the participants, small subgroups were merged and identifying attributes, as well as an individual’s full set of responses, were not analysed or shared collectively. Only a smaller subgroup of the research team had access to the data for analysis, which was saved in a secure storage, and not permanently stored locally. Furthermore, any statements or wording in the long-form responses that could have led to the recognition of an individual’s institution, country of origin, or a certain expedition were removed from quotations used in this article.

2.3 Survey data analysis

Survey responses were downloaded in.csv format from Google forms on the 6th November 2023. Demographic data of all survey respondents was summarised using a circular packing algorithm [ 43 ] implemented in the R package ‘packcircles’ v 0.3.6 [ 44 ], where proportion of answers was denoted by circle size and the question was denoted by colour. After the demographic analysis we excluded respondents who did not respond “woman” when asked which gender they identified as in the survey, in order to conduct further analysis on the experiences of people who identify as women. The multiple-choice answers were transformed to numerical categories to simplify the data handling with python 3.7.10 [ 45 ] and R v 4.3.2 [ 46 ] to visualise results. The following python packages were used: pandas v 1.2.4 [ 47 ], numpy v 1.20.2 [ 48 ], and matplotlib 3.4.1 [ 49 ]. As all multiple-choice answers had a free text “other” option, resulting answers were manually categorised by the authors, sometimes leading to additional categories which were not part of the preset answers. Demographic questions, multiple choice questions, rating scale questions, and dichotomous questions were summarised numerically as the proportion of respondents per question. Analyses and plots conducted in R used the tidyverse packages [ 50 ].

The most commonly used words in long-form responses to the questions “Please feel free to elaborate on these [negative] experiences, if you would like’’ and “How do you feel about conducting fieldwork in the future?” were visualised using word clouds, in which the proportion of times a word was used by survey respondents was denoted by the size of the word within the word cloud. The word clouds were constrained to include words that were used by a minimum of four respondents and non-indicative words, such as prepositions, were excluded from the word cloud. Analyses were performed using R Studio v. 2023.09.0 [ 46 ] and the R packages ‘ggplot2’ version 3.3.6 [ 51 ], ‘wordcloud’ version 2.6 [ 52 ] and ‘stringr’, version 1.5.0 [ 53 ]. The long-form responses were also manually reviewed for quotations related to topics that had emerged as important themes within the numerical survey results. Additional themes that emerged as important in the long-form responses ( i . e ., topics or issues that were consistently raised by multiple respondents) were identified during this process and included in the results. In the results, quotations were reported as verbatim, with corrections for spelling and conciseness indicated by ‘[…]’.

3.1 Demographics of survey respondents

The survey was completed by 338 respondents between 26th September - 6th November 2023. Of these, 96% identified as woman (n = 324), 1.8% identified as man (n = 6), 1.5% identified as non-binary (n = 5), and the rest (n = 3) as others or no answer was given. The majority of respondents were between 26–40 years old (66%, n = 221) and described their race or ethnicity as Caucasian/White (86%, n = 299). Most respondents did not identify as someone who lives with a disability or chronic condition (87%, n = 295), or as having lived experience as a transgender person (95%, n = 324). Demographic information is summarised in Fig 1 . Respondents’ polar fieldwork was associated with 31 different countries, primarily within Europe (56%, n = 190), followed by the USA (21%, n = 70) and Canada (13%, n = 45). When undertaking fieldwork, 54% of respondents said their native language was the main language of communication (n = 180). For more detail on demographic results, see S3 Text .

• PPT PowerPoint slide
• PNG larger image
• TIFF original image

Age of respondents is reported in blue, identified gender is reported in pink, identified ethnicity is reported in yellow, lived experience as someone with a disability or chronic condition is reported in green, and lived experience as a transgender person is reported in orange. ‘A/AA’ represents Asian/Asian American, ‘B’ represents Black, African, African American, or Afro-Caribbean, ‘H/L’ represents Hispanic/Latinx, ‘FN’ represents First Nations, and ‘NA’ represents the proportion of respondents who chose not to answer.

https://doi.org/10.1371/journal.pclm.0000393.g001

3.2 Pre-fieldwork preparation

The quantity and quality of preparation experienced by the participants, both in regard to fieldwork skills training and space for questions, was shown to be variable. The majority of respondents ranked their feeling of fieldwork preparedness as 4 or 5 (1 = not prepared at all, 5 = very prepared) (n = 322). Only 0.6% (n = 2) stated that they did not feel (at all) prepared. At the same time, ‘not enough/poor preparation’ was one of the most common and impactful reasons for negative field experiences ( Fig 2 ). The respondents described preparation as “Chaotic [ … ] safety and personal needs were not discussed” and responded that “ We were mostly prepared for the science element of fieldwork by the science leads . Not much was said about the living element” . Multiple respondents highlighted the lack of preparation for topics such as menstruation, toileting, and hygiene: “ Never had any discussion on periods ” and “ We didn’t discuss toilet and hygiene arrangements” . On the other hand, some respondents were supported through a more carefully organised preparation process: “ We were prepared through peer discussions [ … ] and by the fieldwork manager , preparations took place over several months” and “We were given detailed written down information and [ … ] the possibility to ask anonymous question[s] ”. See S4 Text for additional responses.

Twenty-three reasons could be selected in the multiple response question. The result of this question is indicated by the number in parenthesis sorting the reasons from the most common one at the top to the least common one at the bottom. The last three reasons were not included in the multiple-choice question. The stacked bars next to each reason describe the impact of it, asked in the follow-up question on a 1–5 scale (1—not at all impactful and 5—a major impact).

https://doi.org/10.1371/journal.pclm.0000393.g002

3.3 Post-fieldwork debriefs and communication

As with pre-fieldwork preparation, the experience of respondents varied widely with regard to the use of post-fieldwork debriefs as a tool to reflect upon the work undertaken and learn from field experiences. Post-fieldwork debriefs were experienced by 48% of respondents (n = 320), while debriefs which included discussions on team dynamics were experienced by only 27% of respondents (n = 302), and the option for written feedback after fieldwork was experienced by 23% of respondents (n = 320). This is reflected in how respondents experienced field and post-fieldwork communication; only 55.6% of respondents chose 4 or 5 for post-fieldwork communication (1 = very poor, 5 = excellent). Participants who experienced debriefs mentioned a variety of aspects: “I felt it was managed very well , placed no blame , but considered whether we might collectively be able to improve a similar situation in the future . [ … ]so we had a really open meeting to address the types of support we needed from people in leadership roles , even when the tasks at hand weren’t necessarily ‘leader‘ tasks” . See S5 Text for additional responses.

Despite variable post-fieldwork communication and the substantial proportion of respondents conducting fieldwork in a non-native language, communication during fieldwork was generally reported to be good, with 71.8% of respondents choosing 4 or 5 in the 1–5 ranking for communication in the field (n = 323). Respondents reported that “ We , as a field team , generally let everyone provide ideas and communicate what they need done to get their research complete to make sure everyone succeeds” and “Personalities and communication skills play a big part in communication success . [ … ] There are always going to be some people who struggle to speak up , or who aren’t as good at articulating themselves , so there is some skill required from those leading to ensure people are consulted [ … ]” and “My voice was always important . I didn’t have concerns to tell if I had a worse day at the beginning of my period” .

3.4 Negative fieldwork experiences

The majority of respondents (79%) reported that they had a negative polar fieldwork experience (n = 320). The proportion of respondents with negative experiences and the reasons given for negative experiences were similar, regardless of age group membership ( S1 , S2 Figs). The five most common reasons for negative experiences were related to weather, field team members, amount of rest time, field team leaders, sexism, and menstruation or other health issues ( Fig 2 ). The reasons that were attributed to being most impactful were field team members, field team leaders, weather, team atmosphere, and fieldwork preparation ( Fig 2 ). With weather consistently shown to be a defining factor for a negative fieldwork experience, the free-text responses provide insight into its impact: "Weather in the [A]rctic [is] always an unknown and sometimes hinders sampling or forces to change plans—this is unavoidable and is planned for when organising the trips" and "We had big problems with weather conditions (flooding , wildfires) but both times I was lucky enough to have a team that made the best out of it” . The impact of bad weather was linked to team communication by some survey respondents: “ Severe cold injuries [were] the [ … ] consequence of the breakdown of team communication ” and “The group always made sure people were keeping [ … ] warm” . A lack of appropriate field clothing for women’s bodies introduced additional weather-related challenges: “Peeing in a bodysuit is colder for someone that [has] to sit” .

In the word count analysis of long-form responses, where survey respondents were asked to elaborate on their negative fieldwork experience, 22% of respondents mentioned sexual harassment, 18% mentioned psychological difficulties, 9% mentioned violence, 4% mentioned racism, and 4% mentioned homophobia. Additional reasons for negative fieldwork experiences that were not explicitly mentioned in survey questions but were raised by respondents in free-text options and long-form responses included:

• Problems in the local community or with the local military and navy
• Cultural differences (for example in the research station or the local community, and particularly relating to alcohol consumption)
• Money (for example, hidden costs for kit and in the field)
• Physical safety in the polar environment
• Family-related communication issues and emergencies
• Travel and logistics
• Lack of institutional and PI support at home and in the field
• Psychological and mental health issues

3.5 Team dynamics and communication

Internal team dynamics and communication were an important influence on how participants perceived their fieldwork. The majority of respondents had good experiences with field teams, with 79.1% agreeing (ranking 4 or 5) with the statement “I felt generally comfortable among the members of my field team” (n = 321), 86.7% agreeing with the statement “I felt like I could participate in casual conversations among my field team” (n = 321), and 83.5% agreeing with the statement “I was usually included in the invitation for socialising before, during, and after fieldwork.” (n = 318).

However, issues relating to field teams were among the most common and most impactful factors causing negative field experiences. The long-form responses show that power structures and hierarchical factors played a role in these issues: “PI got incredibly stressed at sea in a leadership role , and reported any sign of disagreement [ … ] , that person was targeted for the rest of the cruise as a problem member of staff . Constant volley of abuse , derision etc . ” and “The hierarchical structure was deliberate and explicitly stated . When [trying] to address safety and logistical concerns , we were told we were causing trouble by one of the people in charge” . Another respondent felt that there was “ No seeming ability to leave or address issues in the field , due to extreme remoteness and power dynamic ” with another found that “People who behaved very irresponsibly were let off the hook largely due to personal connections…I think that people without personal connections to program managers or people in power were discriminated against” . For some participants, issues that had taken place in the field continued afterwards: “After returning back home , the PI started excluding and ignoring members of the team whose performance in the field he wasn’t happy with . This included those that tried to communicate concerns and shortcomings while still in the field” . Other respondents highlighted the variability of teams between different trips: “Some trips had good internal communication with good team dynamics and overall positive team morale and healthy boundaries . Whilst others were the complete opposite” . Issues relating to team members other than leaders were also apparent in responses (see S6 Text ).

A lack of personal space and privacy were also raised as issues, with only 36% of respondents stating it was possible to create personal space from the rest of the team during fieldwork. This could impact mental health during fieldwork, with one respondent commenting that “Negative feelings arise when I don’t have access to my own space (shared tents for many , many weeks)” . A lack of privacy was also linked to difficulty finding a confidant or safe space, for example: “On board the research vessels or especially at the research stations , there is little privacy and I did feel that it was not possible to confide in many people without fear of the issue being disclosed to others” . Personal space and privacy extended to hygiene issues where respondents struggled with “Not enough privacy when menstruating in the field” . Other respondents were working in teams where “The group leaders [ … ] brought hygiene bags to the field with things like toilet paper , plastic bags for carryi[n]g the waste home , tampons ”.

3.6 Work expectations

Work expectations were also raised as a contributing factor to negative fieldwork experiences, with respondents stating that “There was a mismatch of what we discussed the workload and rest days would be like and what they ended up being like . It was made known that this is how it would be and if you can’t handle it then deep field work is not right for you” and “Decisions were sometimes made spontaneously in the field that introduced significant physical challenges . The culture has tended to demonstrate a willingness to push through physical challenges , sometimes at the detriment to health and wellbeing” . This attitude to polar fieldwork was summarised by another respondent as: “Largely speaking , the biggest problem is that we are usually rushing to get everything done . Personal wellbeing and sustainability take second priority” .

Many respondents directly linked differences in work expectations and task distribution with gender: “[ … ] women are often the ones that have the most laboratory tasks , while male colleagues are often the ones that get to go out on the boat all day and bring the women home the samples for processing late into the night , [ … ] the females are often the ones making sure that everyone is well fed [ … ] and also are noticeabl[y] more involved in tidying up , etc” . Another respondent reported that there was a “ Different perception of what women can handle , e . g . operating large machines” and “I [ … ] was proposed by my colle[a]gue to clean [the] laboratory inste[a]d of setting up equipment as it is a task more suited to a woman” and “I generally feel that sexism was always pervasive and affected my work” .

Additionally, several survey respondents expressed a feeling of needing to work harder to prove themselves because they are female: “[ … ] felt gender based . Male colleagues need less experience to be taken more seriously” . This was reflected to some degree in the numerical survey results: although 83.4% of respondents agreed with the statement “My fieldwork contributions were valued” (n = 320), and 77% of respondents agreed with the statement “My field team regarded me as a similarly qualified member” (n = 320), 30.7% of respondents agreed with the statement “In order to be recognised as a valuable member of the field team, I had to work harder than my coworkers.” (n = 320).

3.7 Sexual harassment

Sexual harassment was raised by numerous respondents as an issue that negatively impacted their fieldwork experiences. One respondent said: “[ … ] there were numerous cases of sexual harassment [ … ] , sexist comments and actions , etc . that made the working environment at times unwelcoming and impacted my work” . Sexual harassment occurred in various fieldwork locations and structures, from field stations to research vessels, and appeared to come from team members/scientists, crew, or locals (see S7 Text for more details).

Within the free-text responses, serious concerns were raised regarding the lack of adequate structures to report fieldwork harassment, and the lack of accountability when such reports were made. For example, “I talked to my supervisor and asked for them to act differently . They stopped talking to us , claimed me as being the problem [ … ] and there was also no room given to talk about the topic as a group” and “I have never felt that the designated person for reporting to/talking to ever took situations seriously” and “ The worst part is that we still don’t have briefings about harassment and there are no specially assigned people , who are assigned to deal with these sorts of problems” and “ When I did report events of sexual harassment/assault (multiples instances on every field campaign I have been a[] part of . [ … ] , there [were] no further discussions or changes implemented . The perpetrators were never held accountable and were able to continue in positions of responsibility [ … ]” . However, some respondents did feel like their concerns were heard in these situations: “The majority of our leadership is male identifying , and until they saw the treatment first[–]hand it was difficult to explain what was happening or why it was affecting some of the team members and their interest in working more directly with certain community members . [ … ] Though the leadership always respected our wishes and listened to our concerns” .

3.8 Perceptions of future fieldwork

Despite most respondents reporting negative experiences, 93% of respondents (n = 317) reported that they are planning to participate in or conduct polar fieldwork in the future. The most commonly used words (n > 20) to describe their thoughts on how they feel about conducting polar fieldwork in the future are summarised in Fig 3 . Several participants expressed their desire to be familiar with the team they will conduct fieldwork before going out together. The respondents’ views ranged from “Tentative . I think how it goes is completely down to the people you go with . I wouldn’t want to go with people I didn’t feel comfortable with beforehand if at all possible” to “I feel fine about it but I am more wary about interactions with men and the choice of field PIs” and “Always good . I am a career Antarctic field worker , I can’t imagine doing anything else” .

Word clouds of the most frequently occurring words in the long-form responses for (a) the long-form response on reasons for negative field experiences, and (b) the question “How do you feel about conducting fieldwork in the future?”. Larger words reflect a higher frequency of occurrence.

https://doi.org/10.1371/journal.pclm.0000393.g003

Other respondents were aware of the potential for change and responsibilities they hold as team leaders in enabling a safe and enriching environment for all participants: “My experience with an abusive leader was incredibly damaging to me in terms of confidence and overall happiness . In response , I have worked hard to support my own teams , and to stand up and speak when I observe bullying behaviour” and “I feel positive , as I am now in a more senior position and able [to] try and create better conditions for all involved in my field campaigns” . One respondent highlighted the career risks associated with fieldwork: “I have enjoyed doing fieldwork in the past , but I think it can hold back career development . It involves significant preparation time , with a high risk of weather or equipment failure leading to a lack of data collection . That is extremely risky while working on short , fixed-term contracts , when the next contract may rely on timely publications . I now choose to spend my effort on more reliably remote sensing and modelling projects with guaranteed outcomes” . See S8 Text for additional responses.

4. Discussion

4.1 insights from survey results.

This project used a survey to investigate polar fieldwork specific challenges for women-identifying researchers to propose pathways to more equal participation. The representativeness of our survey sample in relation to the wider polar research community is uncertain, although the proportion of respondents who identified as white (87% of n = 324) was similar to the proportion of people who identified as white (90% of n = 174) in the Diversity in UK Polar Science Initiative Race Impact Survey [ 11 ]. The top countries associated with respondents’ polar fieldwork (USA, Norway, Canada, UK, Germany) broadly reflect the countries with the highest Arctic [ 54 ] and polar scientific research output, although Russia and China were underrepresented in our survey respondents [ 54 , 55 ]. The survey was circulated through the authors’ networks and associated mailing lists, potentially limiting the representativeness of the survey respondents.

Fieldwork experience was not related to age or career stage, since the proportion of respondents with negative fieldwork experiences and their reasons were similar across age groups. Differing experiences between age groups were expected due to the recent increase in women’s participation in polar research [ 2 , 10 ] and changing research culture [ 56 ]. The similarity of experiences across age groups may reflect the fact that respondents could answer in relation to single or multiple field experiences and may have referred to field experiences that occurred at different periods in the past.

Survey respondents overwhelmingly encountered negative experiences during fieldwork. The most common and impactful issues were related to field team dynamics and communication, sexism, rest time, and weather. The majority of respondents had some good experiences with field teams but issues relating to field team members and team dynamics were pervasive. Communication issues were also raised, with disparity between respondents’ mostly positive experience of in-field communication and the lack of post-field communication. Less than half of respondents had post-fieldwork debriefs, and most debriefs which did occur did not cover non-technical aspects such as team dynamics. Without debriefs there is no formal way to ensure that issues arising in the field are corrected for the next field trip, nor a defined space for team members to seek clarifications or support they may need [ 56 ].

Many other issues were consistently raised by respondents, including: no fieldwork preparation for issues that specifically concern women, different work expectations, gender stereotypical task assignment for team wellbeing and daily chores, harassment, psychological issues, and lack of personal space and privacy. Another emerging theme was the role of power structures and hierarchies contributing to difficulties reporting harassment, and lack of accountability for problematic behaviour. Respondents (and authors) avoided naming specific expeditions or institutions, not only to protect anonymity, but to avoid putting careers at risk, with one respondent stating that “[ … ] a filtration of this information can jeopardize my opportunity to go in a next expedition , and to participate in national programs in my field" . Despite the negative experiences of most survey respondents, a culture of resilience and passion for research was evident. Most respondents enjoyed fieldwork overall, were planning to conduct remote fieldwork in the future, and expressed positivity regarding future plans.

The results of this survey highlight problems faced by women in the polar research community, independently of fieldwork characteristics to their work. On the other hand, it is not possible to infer that these issues are exclusive to women. In fact, some aspects identified here are likely relevant to all people involved in fieldwork and across minority groups. Other minorities and marginalised groups may experience structural barriers and issues which were beyond the scope of this study and were not explicitly included in the survey [ 11 , 26 ]. Intersectional identities in particular would result in unique sets of overlapping barriers in polar research [ 21 ]. These aspects, nonetheless, warrant further attention, and go beyond the scope of our dataset. Further survey limitations are discussed in S9 Text .

4.2 Strategies to improve polar field experiences for women

Several key areas for improving the experiences of women participating in polar fieldwork emerged from the issues raised in the survey and literature. At a fundamental level, a higher proportion of women in fieldwork leadership roles could reduce barriers for other women. Many of the strategies developed here may be transferable and so help reduce barriers across marginalised groups [ 11 , 20 , 21 , 26 ]. Fieldwork-specific extensions for institutional EDI policies [ 57 ] would provide an organisational baseline for home institutions and research stations. However, the effectiveness of institutional policies could be more limited in multi-institution or international collaborations without cross-institutional policy. One solution could be for funding agencies to require inclusive and equitable fieldwork policies from institutions.

The sexism, sexual harassment, violence, and psychological abuse raised by respondents highlights a need for broad cultural and institutional changes. The lack of accountability for these actions, exacerbated by the role of power structures and hierarchies, shows a need for improving institutional structures for reporting incidents and holding perpetrators to account. Such processes should be accessible, transparent, and fast, avoid retraumatizing the victim, and precipitate retribution. These institutional reporting structures should be available during (where possible) and after fieldwork and include independent, trained points of contact. Harassment should be treated similarly to research misconduct and safety policy infringements [ 37 ]. In addition, training should be provided on issues such as harassment, violence, and bullying: that is, ethical and respectful field conduct. All research team members should undergo the same training to tackle existing power dynamics and imbalances.

Institutional and team-based codes of conduct are another foundational step with impact through all stages of the fieldwork process. A code of conduct would remove ambiguity regarding acceptable behaviour in the field, build in accountability for misconduct, and reduce risks [ 58 ]. For example, APECS has specific templates for a Code of Conduct and Bill of Rights for polar fieldwork available [ 59 ]. The APECS code of conduct states mechanisms such as: identification and definition of appropriate and inappropriate behaviour, details on reporting and investigative procedures, inclusion of protection against retaliation, and built in mechanisms for evaluation and revision.

Women’s fieldwork experiences could be improved and barriers to participation could be reduced by focusing on the following actions during the fieldwork process (summarised in Fig 4 ):

1. Improve pre-fieldwork preparation and communication

Many of the issues raised could be addressed by improving pre-fieldwork preparation and communication. Although we acknowledge that the nature of fieldwork can preclude advanced planning, pre-fieldwork preparation and communication should begin at least six months in advance where feasible [ 37 ]. Preparation includes setting clear work expectations and assigning specific field roles, as well as preparation and communication of ‘non-scientific’ fieldwork aspects, such as those identified by survey respondents ( Table 1 ). For example, communicating the toileting situation ( i . e ., access to toilets, privacy, lack of toilets or sheltered areas, and waste management practices) can minimise pre-fieldwork concerns [ 60 ]. Best practices for dealing with menstruation, which has previously been identified as a barrier to participation in remote fieldwork, should be included in safety briefings. Open discussions with all participants can identify factors that may have otherwise gone unaddressed. Where possible, the ability to submit questions anonymously could be beneficial. Structured and informal discussions with all participants early on can then shape more formal pre-fieldwork checklists.

Pre-fieldwork checklists are a simple but effective approach to help create a safer fieldwork environment and should be standard practice. Checklists should be provided well in advance of fieldwork, and can be developed using existing frameworks as templates, such as those within Ackerman et al. [ 37 ] and INTERACT field guides [ 61 ]. Checklists should be particular to each unique field excursion and based on feedback from pre-fieldwork communications with participants and previous post-fieldwork evaluations.

In addition, codes of conduct and training on issues such as harassment should be included in fieldwork planning [ 62 ]. One example is the Code of Conduct of Toolik Field Station, Alaska [ 63 ]. Finally, specific deployment training ( i . e . simulation of the field environment to ensure that participants understand how to use scientific and field equipment prior to departure) should be standard practice.

https://doi.org/10.1371/journal.pclm.0000393.g004

https://doi.org/10.1371/journal.pclm.0000393.t001

2. Improve practices during fieldwork

Many of the issues leading to negative fieldwork experiences could be resolved by implementing standards antecedently. The field team leader should ensure personal space, toilet breaks, and sufficient rest periods are incorporated into fieldwork. The leadership style should be proactive and flexible, with the capacity to alter the field plan to suit the team and conditions. A strong team dynamic should be fostered in which participants are encouraged to check-in on each other (e.g. a buddy system) and advocate for each other. Team members should be encouraged to speak up when observing a practice or behaviour that is unsafe, inappropriate, or dangerous, both from a mental and physical health standpoint ( i . e ., speaking up about a team member having exposed skin and potentially getting frostbite, as readily as advocating for a team member being bullied) and/or go beyond physical capability ( i . e ., river crossings, steep and/or complex terrain).

Remote fieldwork, particularly in harsh conditions, can take a toll on mental and physical health [ 29 ]. During fieldwork it is important to promote and practise self-care for participants, including taking time off when resources and weather permit [ 77 ]. Involving local communities and developing local connections could reduce isolation, assist in maintaining mental wellbeing, whilst also increasing environmental safety through expertise of local conditions [ 62 ]. Sustainable local connections, in which the local community is involved in all fieldwork stages (planning, executing, and debriefing) also promotes decolonisation of the research enterprise and the promotion of CARE principles [ 78 ], equitable cross-cultural understanding, benefit sharing, and informed interpretation of findings [ 62 ].

3. Improve post-field communication

Poor post-field communication was consistently raised as an issue, particularly regarding a lack of de-briefing on non-technical issues such as team dynamics. Post-fieldwork debriefs should be standard practice and should be an open, safe environment for team members to discuss concerns. Debriefs can help prevent unsafe or exclusive spaces caused by inadequate communication and group awareness [ 56 ]. For multi-day fieldwork, daily debriefs are an important tool to ensure any issues do not escalate or continue, and that measures set up during fieldwork preparation are being followed. Depending on the team and the dynamic there is value in having group debriefs as well as one-on-one debriefs [ 56 ]. A group debrief in conjunction with standardised written evaluations that have the option of providing anonymous feedback is recommended.

5. Conclusion

This study presents the experiences of women taking part in polar fieldwork, spanning diverse backgrounds, ages, and research disciplines. By collating the lived experiences through an online survey, alongside a literature review, we aimed to develop a nuanced understanding of predominant factors influencing the physical and mental well-being of female researchers conducting remote fieldwork within the polar research community. We determined that the majority of survey respondents had encountered adverse fieldwork experiences attributable to various factors throughout their career. Our synthesis of dominant themes delivers focal points for targeted adaptation measures in fieldwork planning and execution. Some analysed issues, such as communication and debriefing, are not exclusive to one specific minority or group but reflect generic shortcomings in academia. Other barriers, such as harassment and power dynamics, are more likely to be experienced by minority and/or vulnerable groups and not the polar community as a whole. Nonetheless, following the steps/strategies suggested in this paper could improve the overall field experience of all polar researchers across the community.

Increasing participation and leadership of women in science will have positive effects for climate change research and subsequently global sustainable development. Through the framework delivered with this study, we also support further research and discussion in this field extending to other minority groups. A polar community equipped with multifaceted skills, knowledge, and passion will be able to address the urgent questions of today’s climate science and facilitate knowledge sharing and solutions through diverse and gender-equitable research.

Supporting information

S1 fig. negative fieldwork experiences per age group..

The relationship between age group and percentage of respondents who have had negative experiences during fieldwork (n = 319).

https://doi.org/10.1371/journal.pclm.0000393.s001

S2 Fig. Reasons for negative fieldwork experiences per age group.

The relationship between age group and type of reason for negative field experiences (n = 265). Twenty-three reasons could be selected in this multi-response answer (see S2 Text for the full list of reasons). Reasons were grouped into ten categories for plotting purposes, with percentages indicating the percentage of responses for each reason, per age group. Numbers above bars indicate the number of respondents per age group.

https://doi.org/10.1371/journal.pclm.0000393.s002

https://doi.org/10.1371/journal.pclm.0000393.s003

https://doi.org/10.1371/journal.pclm.0000393.s004

S1 Text. Methodology and records of the scoping literature review.

https://doi.org/10.1371/journal.pclm.0000393.s005

S2 Text. Survey details.

https://doi.org/10.1371/journal.pclm.0000393.s006

S3 Text. Demographics of survey respondents.

https://doi.org/10.1371/journal.pclm.0000393.s007

S4 Text. Additional survey responses: Pre-fieldwork preparation.

https://doi.org/10.1371/journal.pclm.0000393.s008

S5 Text. Additional survey responses: Post-fieldwork debrief and communication.

https://doi.org/10.1371/journal.pclm.0000393.s009

S6 Text. Additional survey responses: Internal team dynamics and communication.

https://doi.org/10.1371/journal.pclm.0000393.s010

S7 Text. Additional survey responses: Sexual harassment.

https://doi.org/10.1371/journal.pclm.0000393.s011

S8 Text. Additional survey responses: Perceptions of future fieldwork.

https://doi.org/10.1371/journal.pclm.0000393.s012

S9 Text. Survey Limitations and feedback from respondents.

https://doi.org/10.1371/journal.pclm.0000393.s013

Acknowledgments

We thank all survey disseminators and survey participants for their willingness and openness to share their experiences; we aimed to interpret and summarise answers with the best of intentions. We are grateful to APECS, the Association of Polar Early Career Scientists, for providing the opportunity for this study and supporting the communication of the survey. The authors would like to acknowledge the valuable contributions of Vanessa Pitusi, who made significant contributions to the survey design and implementation. Her additions to early discussions assisted in shaping the direction of the research. We thank Sonal Mobar Roy and an anonymous reviewer for providing constructive guidance which improved the quality of the manuscript.

• 1. IPCC. IPCC Special Report on the Ocean and Cryosphere in a Changing Climate. Pörtner HO, Roberts DC, Masson-Delmotte V, Zhai P, Tignor M, Poloczanska E, et al., editors. Cambridge, UK and New York, NY, USA: Cambridge University Press; 2022. 755 p. Available from: https://www.cambridge.org/core/books/ocean-and-cryosphere-in-a-changing-climate/A05E6C9F8638FA7CE1748DE2EB7B491B
• View Article
• Google Scholar
• PubMed/NCBI
• 19. OECD. Gender and the Environment: Building Evidence and Policies to Achieve the SDGs. OECD; 2021 [cited 2023 Dec 14]. Available from: https://www.oecd-ilibrary.org/environment/gender-and-the-environment_3d32ca39-en
• 29. Sandal GM, Leon GR, Palinkas L. Human challenges in polar and space environments. In: Amils R, Ellis-Evans C, Hinghofer-Szalkay H, editors. Life in Extreme Environments. Dordrecht: Springer Netherlands; 2006. p. 399–414. Available from: https://link.springer.com/10.1007/978-1-4020-6285-8_25
• 40. National Science Foundation, National Center for Science and, Engineering Statistics, National Science Foundation. Women, Minorities, and Persons with Disabilities in Science and Engineering. Alexandria, VA: National Science Foundation; 2019 [cited 2023 Dec 17]. (Special Report NSF 19–304). Available from: https://ncses.nsf.gov/pubs/nsf23315/
• 41. National Center for Women & Information Technology. NCWIT Guide to Demographic Survey Questions. National Center for Women & Information Technology; 2023 [cited 2023 Dec 17]. Available from: https://docs.google.com/document/d/1E_CSANwOqbKjEG27woNbGZ09JIXUfAf4Cp9j8g5DFak/edit?usp=sharing&usp=embed_facebook
• 42. United Nations. United Nations Fight Racism. [cited 2023 Dec 14]. Vulnerable Groups—who are they? Available from: https://www.un.org/en/fight-racism/vulnerable-groups
• 43. Wang W, Wang H, Dai G, Wang H. Visualization of large hierarchical data by circle packing. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. New York, NY, USA: Association for Computing Machinery; 2006. p. 517–20. (CHI ‘06). Available from: https://dl.acm.org/doi/10.1145/1124772.1124851
• 45. Van Rossum G, Drake FL. Python 3 Reference Manual. Scotts Valley, CA: CreateSpace; 2009.
• 46. Posit team. RStudio: Integrated Development Environment for R. Boston, MA: Posit Software, PBC; 2023. Available from: http://www.posit.co/
• 47. McKinney W. Data Structures for Statistical Computing in Python. In: Walt S van der, Millman J, editors. Proceedings of the 9th Python in Science Conference. 2010. p. 56–61. https://doi.org/10.25080/Majora-92bf1922-00a
• 51. Wickham H. ggplot2: Elegant Graphics for Data Analysis. Springer-Verlag New York; 2016. Available from: https://ggplot2.tidyverse.org
• 63. Toolik Field Station. University of Alaska Fairbanks. [cited 2023 Dec 16]. Code of Conduct & Title IX Policy. Available from: https://www.uaf.edu/toolik/handbook/title-ix.php

• Open access
• Published: 30 May 2024

Barriers and facilitators to mental health treatment access and engagement for LGBTQA+ people with psychosis: a scoping review protocol

• Cláudia C. Gonçalves   ORCID: orcid.org/0000-0001-6767-0920 1 ,
• Zoe Waters 2 ,
• Shae E. Quirk 1 ,
• Peter M. Haddad 1 , 3 ,
• Ashleigh Lin 4 ,
• Lana J. Williams 1 &
• Alison R. Yung 1 , 5  

Systematic Reviews volume  13 , Article number:  143 ( 2024 ) Cite this article

156 Accesses

Metrics details

The prevalence of psychosis has been shown to be disproportionately high amongst sexual and gender minority individuals. However, there is currently little consideration of the unique needs of this population in mental health treatment, with LGBTQA+ individuals facing barriers in accessing timely and non-stigmatising support for psychotic experiences. This issue deserves attention as delays to help-seeking and poor engagement with treatment predict worsened clinical and functional outcomes for people with psychosis. The present protocol describes the methodology for a scoping review which will aim to identify barriers and facilitators faced by LGBTQA+ individuals across the psychosis spectrum in help-seeking and accessing mental health support.

A comprehensive search strategy will be used to search Medline, PsycINFO, Embase, Scopus, LGBTQ+ Source, and grey literature. Original studies of any design, setting, and publication date will be included if they discuss barriers and facilitators to mental health treatment access and engagement for LGBTQA+ people with experiences of psychosis. Two reviewers will independently screen titles/abstracts and full-text articles for inclusion in the review. Both reviewers will then extract the relevant data according to pre-determined criteria, and study quality will be assessed using the Joanna Briggs Institute (JBI) critical appraisal checklists. Key data from included studies will be synthesised in narrative form according to the Guidance on the Conduct of Narrative Synthesis in Systematic Reviews.

The results of this review will provide a comprehensive account of the current and historical barriers and facilitators to mental healthcare faced by LGBTQA+ people with psychotic symptoms and experiences. It is anticipated that the findings from this review will be relevant to clinical and community services and inform future research. Findings will be disseminated through publication in a peer-reviewed journal and presented at conferences.

Scoping review registration

This protocol is registered in Open Science Framework Registries ( https://doi.org/10.17605/OSF.IO/AT6FC ).

Peer Review reports

The prevalence of psychotic disorders in the general population has been estimated to be around 0.27–0.75% [ 1 , 2 ], with the lifetime prevalence of ever having a psychotic experience being estimated at 5.8% [ 3 ]. However, rates of psychotic symptoms and experiences are disproportionately high amongst LGBTQA+ populations, with non-heterosexual individuals estimated to be 1.99–3.75 times more likely to experience psychosis than their heterosexual peers [ 4 , 5 , 6 , 7 ]. Additionally, it has been estimated that transgender or gender non-conforming (henceforth trans) individuals are 2.46–49.7 times more likely than their cisgender peers (i.e. individuals whose gender identity is the same as their birth registered sex) to receive a psychotic disorder diagnosis [ 8 , 9 ]. The increased rates of psychotic experiences noted amongst gender and sexual minorities may be explained by evidence indicating that LGBTQA+ people are also exposed to risk factors for psychosis at a far greater rate than members of the general population, such as childhood adversity [ 10 , 11 , 12 ], minority stress [ 13 ], discrimination [ 14 ], and stigma [ 15 , 16 ]. Furthermore, there is added potential for diagnostic biases leading to over-diagnosing psychosis in gender diverse individuals, whose gender expression and dysphoria may be pathologized by mental health service providers [ 8 ].

Despite these concerning statistics, there is very little research examining the experiences of LGBTQA+ people with psychosis, and limited consideration of the unique needs these individuals may have in accessing and engaging with mental health services. While timely access to treatment has consistently been associated with better symptomatic and functional outcomes for people with psychosis [ 17 , 18 ], there are often delays to treatment initiation which are worsened for LGBTQA+ individuals [ 19 , 20 ]. These individuals face additional barriers to accessing adequate mental health support compared to cisgender/heterosexual people [ 19 ] and may need to experiment with several mental health services before finding culturally competent care [ 20 ]. This in turn may lead to longer duration of untreated psychosis. Additionally, there seems to be a lack of targeted support for this population from healthcare providers, with LGBTQA+ individuals with serious mental health concerns reporting higher rates of dissatisfaction with psychiatric services than their cisgender and heterosexual counterparts [ 7 , 14 , 21 ]. However, the extent of these differences varies across contexts [ 22 ], potentially due to improved education around stigma and LGBTQA+ issues within a subset of mental health services.

Nonetheless, stigma remains one of the highest cited barriers to help-seeking for mental health problems, particularly with regard to concerns around disclosure [ 23 ], which can be particularly challenging for people experiencing psychosis [ 24 , 25 ]. Stigma stress in young people at risk for psychosis is associated with less positive attitudes towards help-seeking regarding both psychiatric medication and psychotherapy [ 26 ], potentially partly due to fears of judgement and being treated differently by service providers [ 27 ]. This issue may be compounded for people who also belong to minoritized groups [ 23 , 28 ], particularly as LGBTQA+ individuals have reported experiencing frequent stigma and encountering uninformed staff when accessing mental healthcare [ 7 , 29 ]. Furthermore, stigma-fuelled hesitance to access services may be heightened for trans people [ 30 ] whose identities have historically been pathologized and conflated with experiences of psychosis [ 31 ].

Even when individuals manage to overcome barriers to access support, there are added challenges to maintaining adequate treatment engagement. In a large online study, half of trans and nearly one third of LGB participants reported having stopped using mental health services in the past because of negative experiences related to their gender identity or sexuality [ 20 ]. This can be particularly problematic as experiences of stigma predict poorer medication adherence in psychosis [ 32 ] which subsequently multiplies the risk for relapse and suicide [ 33 ]. While no research to date has explored non-adherence rates in people with psychosis who are LGBTQA+, concerns around suicidality are heightened for individuals who are gender and sexuality diverse [ 34 , 35 , 36 ].

Generally, there is rising demand for mental healthcare that specifically addresses the needs of gender and sexual minority individuals and promotes respect for diversity, equity, and inclusion [ 29 , 37 ]. This is particularly salient as positive relationships with staff are associated with better medication adherence for people with psychosis [ 38 ] and healthcare providers with LGBTQA+-specific mandates have demonstrated higher satisfaction rates for LGBTQA+ individuals [ 20 ]. Mental health services need to adapt treatment options to acknowledge minority stress factors for those with stigmatised identities and, perhaps more importantly, how these intersect and interact to increase inequalities in people from minoritized groups accessing and benefiting from treatment [ 37 , 39 ].

Additionally, gender affirming care needs to be recognised as an important facet of mental health treatment for many trans individuals, as it is associated with positive outcomes such as improvements in quality of life and psychological functioning [ 40 , 41 , 42 ] and reductions in psychiatric symptom severity and need for subsequent mental health treatment [ 8 , 43 ]. While there are additional barriers in access to gender affirming care for individuals with psychosis, this treatment has shown success in parallel with treatment to address psychosis symptom stabilisation [ 19 , 44 ]. The importance of affirmation is echoed by the finding that many negative experiences of LGBTQA+ participants with mental health services could be avoided simply by respecting people’s pronouns and using gender-neutral language [ 20 ].

To ensure timely access to appropriate treatment for LGBTQA+ people with psychosis, there is a need for improved understanding of the factors which challenge and facilitate help-seeking and engagement with mental health support. A preliminary search of Google Scholar, Medline, the Cochrane Database of Systematic Reviews, and PROSPERO was conducted and revealed no existing or planned reviews exploring benefits and/or obstacles to mental health treatment specific to this population. Therefore, the proposed review seeks to comprehensively search and appraise the existing literature to identify and summarise a range of barriers and facilitators to adequate mental health support faced by LGBTQA+ people with experiences of psychosis. This will allow for the mapping of the types of evidence available and identification of any knowledge gaps. Moreover, we hope to guide future decision-making in mental healthcare to improve service accessibility for LGBTQA+ individuals with psychosis and to set the foundations for future research that centres this marginalised population. Based on published guidance [ 45 , 46 , 47 ], a scoping review methodology was identified as the most appropriate approach to address these aims.

Selection criteria

This scoping review protocol has been developed in compliance with the JBI Manual for Evidence Synthesis [ 48 ] and, where relevant, the Preferred Reporting Items for Systematic Review and Meta-Analysis Protocols (PRISMA-P) checklist [ 49 ] (see Additional file 1). In the event of protocol amendments, the date, justification, and description for each amendment will be provided.

Due to the limited literature around the topic of this review, any primary original study design, setting, and publication date will be considered for inclusion. Publications written in English will be included, and articles in other languages may be considered pending time and cost constraints around translation. Publications will be excluded if the full text is not available upon request from authors.

The PCC (Population, Concept, Context) framework was used to develop the inclusion criteria for this scoping review:

This review will include individuals of any age who are LGBTQA+ and have had experiences of psychosis. For the purposes of this review, ‘LGBTQA+ individuals’ will be broadly defined as any individual that is not heterosexual and/or cisgender or anyone who engages in same-gender sexual behaviour. Studies may include participants who are cisgender and heterosexual if they separately report outcomes for LGBTQA+ individuals. Within this review, the term ‘psychosis’ includes (i) any diagnosis of a psychotic disorder, such as schizophrenia spectrum disorders, mood disorders with psychotic features, delusional disorders, and drug-induced psychotic disorders, (ii) sub-threshold psychotic symptoms, such as those present in ultra-high risk (UHR), clinical high risk (CHR), or at risk mental state (ARMS) individuals, and (iii) any psychotic-like symptoms or experiences. Studies may include participants with multiple diagnoses if they separately report outcomes for individuals on the psychosis spectrum.

This review will include publications which discuss potential barriers and/or facilitators to mental health help-seeking and/or engagement with mental health treatment. ‘Barriers’ will be operationalised as any factors which may delay or prevent individuals from accessing and engaging with appropriate mental health support. These may include lack of mental health education, experienced or internalised stigma, experiences of discrimination from health services, and lack of inclusivity in health services. ‘Facilitators’ will be operationalised as any factors which may promote timely help-seeking and engagement with sources of support. These may include improved access to mental health education, positive sources of social support, and welcoming and inclusive services. Mental health help-seeking will be broadly defined as any attempt to seek and access formal or informal support to address a mental health concern related to experiences of psychosis (e.g. making an initial appointment with a service provider, seeking help from a friend). Mental health treatment engagement will be broadly defined as adherence and active participation in the treatment that is offered by a source of support (e.g. attending scheduled appointments, taking medication as prescribed, openly communicating with service providers).

This review may include research encompassing any setting in which mental healthcare is provided. This is likely to include formal healthcare settings such as community mental health teams or inpatient clinics as well as informal settings such as LGBTQA+ spaces or informal peer support. Studies will be excluded if they focus exclusively on physical health treatment.

Search strategy

Database searches will be conducted in Medline, PsycINFO, Embase, Scopus, and LGBTQ+ Source. The full search strategy for this protocol is available (see Additional file 2). This strategy has been collaboratively developed and evaluated by a scholarly services health librarian. Searches will include subject headings relevant to each database and title/abstract keywords relating to three main concepts: (i) LGBTQA+ identity, (ii) experiences of psychosis, and (iii) mental health treatment. Keywords for each concept will be combined using the Boolean operator ‘OR’, and the three concepts will be combined using ‘AND’. This search strategy was appropriately translated for each of the selected databases. There will be no limitations on language or publication date at this stage to maximise the breadth of the literature captured. Publications returned from these searches will be exported to EndNote. Searches will be re-run prior to the final analysis to capture any newly published studies.

The database searches will be supplemented by searching the grey literature as per the eligibility criteria detailed above. These may include theses and dissertations, conference proceedings, reports from mental health services, and policy documents from LGBTQA+ groups. Google and Google Scholar will be searched using a combination of clauses for psychosis (Psychosis OR psychotic OR schizophrenia OR schizoaffective), treatment (treatment or “help-seeking”), and queer identity. The latter concept will have three clauses for three separate searches, with one including broad queer identity (LGBT), one specific to non-heterosexual individuals (gay OR lesbian OR homosexual OR bisexual OR queer OR asexual), and one specific to trans individuals (transgender OR transsexual OR transexual OR “non-binary” OR “gender minority”). Additionally, reference lists and citing literature will be manually searched for each paper included in the review to capture any articles and policy documents not previously identified.

Data selection

Search results will be imported into Covidence using EndNote, and duplicates will be eliminated. Titles and abstracts will be screened by the first and second authors according to pre-defined screening criteria, which will be discussed by the authors and piloted prior to screening. These criteria will consider whether the articles included LGBTQA+ participants with experiences of psychosis (as operationalised above) in relation to mental health help-seeking and/or treatment. Full texts of relevant articles will then be obtained and screened by the first and second reviewer in accordance with the full inclusion and exclusion criteria after initial piloting to maximise inter-rater reliability. Decisions on inclusion and exclusion will be blinded and recorded on Covidence. Potential discrepancies will be resolved through discussion, and when consensus cannot be reached, these will be resolved by the supervising author. The process of study selection will be documented using the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) flow diagram [ 50 ].

Data extraction

Data extraction will be performed independently by two reviewers using Covidence. Prior to beginning final extraction, both reviewers will independently pilot the extraction tool using a sample of five included studies and discuss any necessary changes. Information extracted is planned to include the following: title, author name(s), year of publication, country in which the study was conducted, study design, sample size, population of focus (i.e. sexual minorities, gender minorities, or both), sample demographics (i.e. age, gender identity, and sexual orientation), setting (e.g. early intervention service, community mental health team, etc.), psychosis characteristics (e.g. diagnoses included, severity of symptoms, etc.), type of treatment (e.g. cognitive behavioural therapy, antipsychotic medication, etc.), and any barriers and/or facilitators identified according to the aforementioned operationalised definitions. Disagreements will be resolved through discussion between the two reviewers and, when necessary, final decisions will be made by a senior supervisor. Once extracted, information will be recorded in Excel. Lead authors of papers will be contacted by the primary review author in cases where there is missing or insufficient data.

Quality assessment

Due to the expected heterogeneity in the types of studies that may be included in this review (e.g. qualitative studies, randomised controlled trials, case control studies, case reports), the relevant revised Joanna Briggs Institute (JBI) critical appraisal checklists [ 51 ] will be used to assess risk of bias and study quality for each study design. Two reviewers will independently use these checklists to assess each paper that is included following the full-text screening. If there are discrepancies in article ratings, these will be resolved through discussion between the two authors. If no consensus is reached, discrepancies will be resolved by a senior supervisor. In line with the scoping nature of this review, low-quality studies will not be excluded from the synthesis.

Evidence synthesis

Data from included studies will be synthesised using a narrative synthesis approach in accordance with the Guidance on the Conduct of Narrative Synthesis in Systematic Reviews [ 52 ]. A preliminary descriptive synthesis will be conducted by tabulating the extracted data elements from each study alongside quality assessment results and developing an initial description of the barriers and facilitators to (1) accessing and (2) engaging with mental health support that are identified in the literature. This initial synthesis will then be interrogated and refined to contextualise these barriers and facilitators in the setting, population, and methodology of each study to form the basis for an interpretative synthesis.

This review will not use a pre-existing thematic framework to categorise barriers and facilitators as it is expected that the factors identified will not neatly fit into existing criteria. Instead, these will be conceptualised according to overarching themes as interrelated factors, so that potentially complex interactions between barriers and facilitators within and across relevant studies may be explored through concept mapping. If most of the studies included are qualitative, there may also be scope for a partial meta-synthesis. To avoid oversimplifying the concept of ‘barriers and facilitators’ (see criticism by Bach-Mortensen & Verboom [ 53 ]), this data synthesis will be followed by a critical reflection of the findings through the lens of the socio-political contexts which may give rise to the barriers and facilitators identified, exploring the complexities necessary for any changes to be implemented in mental health services.

If the extracted data indicate that gender minority and sexual minority individuals experience unique or different barriers and/or facilitators to each other, these population groups will be analysed separately as opposed to findings being generalised across the LGBTQA+ spectrum. Furthermore, if there is scope to do so, analyses may be conducted to investigate how perceived barriers and facilitators for this population may have changed over time (i.e. according to publication date) as definitions of psychosis evolve and LGBTQA+ individuals gain visibility in clinical services.

The proposed review will add to the literature around mental health treatment for LGBTQA+ people with psychosis. It will provide a thorough account of the barriers and facilitators to accessing and engaging with support faced by this population and may inform future research and clinical practice.

In terms of limitations, this review will be constrained by the existing literature and may therefore not be sufficiently comprehensive in reflecting the barriers and facilitators experienced by subgroups within the broader LGBTQA+ community. Additionally, although broad inclusion criteria are necessary to capture the full breadth of research conducted in this topic, included studies are likely to be heterogeneous and varied in terms of their methodology and population which may complicate data synthesis.

Nonetheless, it is anticipated that the findings from this review will provide the most comprehensive synthesis to date of the issues driving low help-seeking and treatment engagement in people across the psychosis spectrum who are LGBTQA+. This review will likely also identify gaps in the literature which may inform avenues for future research, and the factors identified in this review will be considered in subsequent research by the authors.

Additionally, findings will be relevant to healthcare providers that offer support to people with psychosis who may have intersecting LGBTQA+ identities as well as LGBTQA+ organisations which offer support to LGBTQA+ people who may be experiencing distressing psychotic experiences. These services are likely to benefit from an increased awareness of the factors which may improve or hinder accessibility for these subsets of their target populations. Therefore, results from this review may inform decision-making around the implementation of service-wide policy changes.

The findings of this review will be disseminated through the publication of an article in a peer-reviewed journal and presented at relevant conferences in Australia and/or internationally. Additionally, the completed review will form part of the lead author’s doctoral thesis.

Availability of data and materials

Not applicable for this protocol.

Abbreviations

• At risk mental state

Clinical high risk for psychosis

Joanna Briggs Institute

Lesbian, gay, and bisexual

Lesbian, gay, bisexual, transgender, queer or questioning, asexual or aromantic, and more

Population, Concept, Context

Preferred Reporting Items for Systematic Review and Meta-Analysis Protocols

Ultra-high risk for psychosis

Institute for Health Metrics and Evaluation (IHME). Global Burden of Disease Study (GBD) Results. Seattle, WA: IHME, University of Washington. 2020. https://vizhub.healthdata.org/gbd-results/ . Accessed 26 May 2023

Moreno-Kustner B, Martin C, Pastor L. Prevalence of psychotic disorders and its association with methodological issues. A systematic review and meta-analyses. PLoS One. 2018;13(4):e0195687. https://doi.org/10.1371/journal.pone.0195687 .

Article   CAS   PubMed   PubMed Central   Google Scholar  

McGrath JJ, Saha S, Al-Hamzawi A, Alonso J, Bromet EJ, Bruffaerts R, et al. Psychotic experiences in the general population: a cross-national analysis based on 31 261 respondents from 18 countries. JAMA Psychiatry. 2015;72(7):697–705. https://doi.org/10.1001/jamapsychiatry.2015.0575 .

Article   PubMed   PubMed Central   Google Scholar  

Chakraborty A, McManus S, Brugha TS, Bebbington P, King M. Mental health of the non-heterosexual population of England. Br J Psychiatry. 2011;198(2):143–8. https://doi.org/10.1192/bjp.bp.110.082271 .

Article   PubMed   Google Scholar  

Gevonden M, Selten J, Myin-Germeys I, De Graaf R, Ten Have M, Van Dorsselaer S, et al. Sexual minority status and psychotic symptoms: findings from the Netherlands Mental Health Survey and Incidence Studies (NEMESIS). Psychol Med. 2014;44(2):421–33. https://doi.org/10.1017/S0033291713000718 .

Article   CAS   PubMed   Google Scholar  

Jacob L, Smith L, McDermott D, Haro JM, Stickley A, Koyanagi A. Relationship between sexual orientation and psychotic experiences in the general population in England. Psychol Med. 2021;51(1):138–46. https://doi.org/10.1017/S003329171900309X .

Welch S, Collings SCD, Howden-Chapman P. Lesbians in New Zealand: their mental health and satisfaction with mental health services. Aust N Z J Psychiatry. 2000;34(2):256–63. https://doi.org/10.1080/j.1440-1614.2000.00710.x .

Barr SM, Roberts D, Thakkar KN. Psychosis in transgender and gender non-conforming individuals: a review of the literature and a call for more research. Psychiatry Res. 2021;306:114272. https://doi.org/10.1016/j.psychres.2021.114272 .

Hanna B, Desai R, Parekh T, Guirguis E, Kumar G, Sachdeva R. Psychiatric disorders in the U.S. transgender population. Ann Epidemiol. 2019;39:1–7. https://doi.org/10.1016/j.annepidem.2019.09.009 .

Schneeberger AR, Dietl MF, Muenzenmaier KH, Huber CG, Lang UE. Stressful childhood experiences and health outcomes in sexual minority populations: a systematic review. Soc Psychiatry Psychiatr Epidemiol. 2014;49:1427–45. https://doi.org/10.1007/s00127-014-0854-8 .

Stanton KJ, Denietolis B, Goodwin BJ, Dvir Y. Childhood trauma and psychosis: an updated review. Child Adolesc Psychiatr Clin N Am. 2020;29(1):115–29. https://doi.org/10.1016/j.chc.2019.08.004 .

Varese F, Smeets F, Drukker M, Lieverse R, Lataster T, Viechtbauer W, et al. Childhood adversities increase the risk of psychosis: a meta-analysis of patient-control, prospective- and cross-sectional cohort studies. Schizophr Bull. 2012;38(4):661–71. https://doi.org/10.1093/schbul/sbs050 .

Mongelli F, Perrone D, Balducci J, Saccheti A, Ferrari S, Mattei G, et al. Minority stress and mental health among LGBT populations: an update on the evidence. Minerva Psichiatr. 2019;60(1):27–50. https://doi.org/10.23736/S0391-1772.18.01995-7 .

Article   Google Scholar  

Kidd SA, Howison M, Pilling M, Ross LE, McKenzie K. Severe mental illness in LGBT populations: a scoping review. Psychiatr Serv. 2016;67(7):779–83. https://doi.org/10.1176/appi.ps.201500209 .

Hatzenbuehler ML, Pachankis JE. Stigma and minority stress as social determinants of health among lesbian, gay, bisexual, and transgender youth. Pediatr Clin North Am. 2016;63(6):985–97. https://doi.org/10.1016/j.pcl.2016.07.003 .

Rüsch N, Heekeren K, Theodoridou A, Müller M, Corrigan PW, Mayer B, et al. Stigma as a stressor and transition to schizophrenia after one year among young people at risk of psychosis. Schizophr Res. 2015;166(1–3):43–8. https://doi.org/10.1016/j.schres.2015.05.027 .

Howes OD, Whitehurst T, Shatalina E, Townsend L, Onwordi EC, Mak TLA, et al. The clinical significance of duration of untreated psychosis: an umbrella review and random-effects meta-analysis. World Psychiatry. 2021;20(1):75–95. https://doi.org/10.1002/wps.20822 .

McGorry PD. Early intervention in psychosis: obvious, effective, overdue. J Nerv Ment Dis. 2015;203(5):310–308. https://doi.org/10.1097/NMD.0000000000000284 .

Peta JL. The Oxford Handbook of Sexual and Gender Minority Mental Health. Oxford (GB): Oxford University Press; 2020. Chapter 11, Schizophrenia spectrum and other psychotic disorders among sexual and gender minority populations; 125-134. Available from: The Oxford Handbook of Sexual and Gender Minority Mental Health - Google Books. Accessed 01 Jun 2023

Simeonov D, Steele LS, Anderson S, Ross LE. Perceived satisfaction with mental health services in the lesbian, gay, bisexual, transgender, and transsexual communities in Ontario, Canada: an internet-based survey. Can J Commun Ment Health. 2015;34(1):31–44. https://doi.org/10.7870/cjcmh-2014-037 .

Avery AM, Hellman RE, Sudderth LK. Satisfaction with mental health services among sexual minorities with major mental illness. Am J Public Health. 2001;91(6):990–1. https://doi.org/10.2105/AJPH.91.6.990 .

Plöderl M, Mestel R, Fartacek C. Differences by sexual orientation in treatment outcome and satisfaction with treatment among inpatients of a German psychiatric clinic. PLoS ONE. 2022;17(1):e0262928. https://doi.org/10.1371/journal.pone.0262928 .

Clement S, Schauman O, Graham T, Maggioni F, Evans-Lacko S, Bezborodovs N, et al. What is the impact of mental health-related stigma on help-seeking? A systematic review of quantitative and qualitative studies. Psychol Med. 2015;45(1):11–27. https://doi.org/10.1017/S0033291714000129 .

Pyle M, Morrison AP. “It’s just a very taboo and secretive kind of thing”: making sense of living with stigma and discrimination from accounts of people with psychosis. Psychosis. 2014;6(3):195–205. https://doi.org/10.1080/17522439.2013.834458 .

Wood L, Burke E, Byrne R, Pyle M, Chapman N, Morrison AP. Stigma in psychosis: a thematic synthesis of current qualitative evidence. Psychosis. 2015;7(2):152–65. https://doi.org/10.1080/17522439.2014.926561 .

Rüsch N, Heekeren K, Theodoridou A, Dvorsky D, Müller M, Paust T, et al. Attitudes towards help-seeking and stigma among young people at risk for psychosis. Psychiatry Res. 2013;210(3):1313–5. https://doi.org/10.1016/j.psychres.2013.08.028 .

Gronholm PC, Thornicroft G, Laurens KR, Evans-Lacko S. Mental health-related stigma and pathways to care for people at risk of psychotic disorders or experiencing first-episode psychosis: a systematic review. Psychol Med. 2017;47(11):1867–79. https://doi.org/10.1017/S0033291717000344 .

Rossman K, Salamanca P, Macapagal K. A qualitative study examining young adults’ experiences of disclosure and nondisclosure of LGBTQ identity to health care providers. J Homosex. 2017;64(10):1390–410. https://doi.org/10.1080/00918369.2017.1321379 .

Rees SM, Crowe M, Harris S. The lesbian, gay, bisexual and transgender communities’ mental health care needs and experiences of mental health services: an integrative review of qualitative studies. J Psychiat Mental Health Nurs. 2020;28(4):578–89. https://doi.org/10.1111/jpm.12720 .

Shipherd JC, Green KE, Abramovitz A. Transgender clients: identifying and minimizing barriers to mental health treatment. J Gay Lesbian Ment Health. 2010;14(2):94–108. https://doi.org/10.1080/19359701003622875 .

Hoening J, Kenna JC. The nosological position of transsexualism. Arch Sex Behav. 1974;3:273–87. https://doi.org/10.1007/BF01541490 .

Eliasson ET, McNamee L, Swanson L, Lawrie SM, Schwannauer M. Unpacking stigma: meta-analyses of correlates and moderators of personal stigma in psychosis. Clin Psychol Rev. 2021;89:102077. https://doi.org/10.1016/j.cpr.2021.102077 .

Lally J, MacCabe JH. Antipsychotic medication in schizophrenia: a review. Br Med Bull. 2015;114(1):169–79. https://doi.org/10.1093/bmb/ldv017 .

De Lange J, Baams L, van Bergen D, Bos HMW, Bosker RJ. Minority stress and suicidal ideation and suicide attempts among LGBT adolescents and young adults: a meta-analysis. LGBT Health. 2022;9(4):222–37. https://doi.org/10.1089/lgbt.2021.0106 .

Skerrett DM, Kolves K, De Leo D. Are LGBT populations at higher risk for suicidal behaviours in Australia? Research findings and implications. J Homosex. 2015;62(7):883–901. https://doi.org/10.1080/00918369.2014.1003009 .

Strauss P, Cook A, Winter S, Watson V, Toussaint DW, Lin A. Trans Pathways: the mental health experiences and care pathways of trans young people: summary of results. Perth, Australia: Telethon Kids Institute. 2017. trans-pathways-report.pdf (telethonkids.org.au). Accessed 16 June 2023

DeLuca JS, Novacek DM, Adery LH, Herrera SN, Landa Y, Corcoran CM, et al. Equity in mental health services for youth at clinical high risk for psychosis: considering marginalized identities and stressors. Evid Based Pract Child Adolesc Ment Health. 2022;7(2):176–97. https://doi.org/10.1080/23794925.2022.2042874 .

Day JC, Bentall RP, Roberts C, Randall F, Rogers A, Cattell D, et al. Attitudes toward antipsychotic medication: the impact of clinical variables and relationships with health professionals. Arch Gen Psychiatry. 2005;62(7):717–24. https://doi.org/10.1001/archpsyc.62.7.717 .

Coyne CA, Poquiz JL, Janssen A, Chen D. Evidence-based psychological practice for transgender and non-binary youth: defining the need, framework for treatment adaptation, and future directions. Evid Based Pract Child Adolesc Ment Health. 2020;5(3):340–53. https://doi.org/10.1080/23794925.2020.1765433 .

Baker KE, Wilson LM, Sharma R, Dukhanin V, McArthur K, Robinson KA. Hormone therapy, mental health, and quality of life among transgender people: a systematic review. J Endocr Soc. 2021;5(4):bvab011. https://doi.org/10.1210/jendso/bvab011 .

Hughto JMW, Reisner SL. A systematic review of the effects of hormone therapy on psychological functioning and quality of life in transgender individuals. Transgend Health. 2016;1(1):21–31. https://doi.org/10.1089/trgh.2015.0008 .

Wernick JA, Busa S, Matouk K, Nicholson J, Janssen A. A systematic review of the psychological benefits of gender-affirming surgery. Urol Clin North Am. 2019;46(4):475–86. https://doi.org/10.1016/j.ucl.2019.07.002 .

Bränström R, Packanhkis JE. Reductions in mental health treatment utilization among transgender individuals after gender-affirming surgeries: a total population study. Am J Psychiatry. 2019;177(8):727–34. https://doi.org/10.1176/appi.ajp.2019.19010080 .

Meijer JH, Eeckhout GM, van Vlerken RHT, de Vries ALC. Gender dysphoria and co-existing psychosis: review and four case examples of successful gender affirmative treatment. LGBT Health. 2017;4(2):106–14. https://doi.org/10.1089/lgbt.2016.0133 .

Munn Z, Peters MDJ, Stern C, Tufanaru C, McArthur A, Aromataris E. Systematic review or scoping review? Guidance for authors when choosing between a systematic or scoping review approach. BMC Med Res Methodol. 2018;18(1):143. https://doi.org/10.1186/s12874-018-0611-x .

Munn Z, Pollock D, Khalil H, Alexander L, McInerney P, Godfrey CM, et al. What are scoping reviews? Providing a formal definition of scoping reviews as a type of evidence synthesis. JBI Evid Synth. 2022;20(4):950–2. https://doi.org/10.11124/JBIES-21-00483 .

Peters MDJ, Marnie C, Colquhoun H, Garritty CM, Hempel S, Horsley T, et al. Scoping reviews: reinforcing and advancing the methodology and application. Syst Rev. 2021;10(1):263. https://doi.org/10.1186/s13643-021-01821-3 .

Aromataris E, Lockwood C, Porritt K, Pilla B, Jordan Z, editors. JBI Manual for Evidence Synthesis. JBI; 2024. https://synthesismanual.jbi.global . https://doi.org/10.46658/JBIMES-24-01

Shamseer L, Moher D, Clarke M, Ghersi D, Liberati A, Petticrew M, et al. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015: elaboration and explanation. BMJ. 2015;350: g7647. https://doi.org/10.1136/bmj.g7647 .

Page MJ, McKenzie JE, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, et al. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. Syst Rev. 2021;372:n71. https://doi.org/10.1136/bmj.n71 .

Barker TH, Stone JC, Sears K, Klugar M, Leonardi-Bee J, Tufanaru C, et al. Revising the JBI quantitative critical appraisal tools to improve their applicability: an overview of methods and the development process. JBI Evid Synth. 2023;21(3):478–93. https://doi.org/10.11124/JBIES-22-00125 .

Popay J, Roberts H, Sowden A, Petticrew M, Arai L, Rodgers M, et al. Guidance on the conduct of narrative synthesis in systematic reviews: a product from the ESRC methods programme. Lancaster University; 2006. https://doi.org/10.13140/2.1.1018.4643

Bach-Mortensen AM, Verboom B. Barriers and facilitators systematic reviews in health: a methodological review and recommendations for reviewers. Res Synth Methods. 2020;11(6):743–59. https://doi.org/10.1002/jrsm.1447 .

Download references

Acknowledgements

The authors would like to acknowledge the support of Ms Olivia Larobina, Scholarly Services Librarian (STEMM) at Deakin University, in the development of the search strategy.

CCG is funded by a Deakin University Postgraduate Research (DUPR) Scholarship. ZW is funded by a University of Western Australia Research Training Program (RTP) Scholarship. AL is supported by a National Health and Medical Research Council (NHMRC) Emerging Leaders Fellowship (2010063). LJW is supported by a NHMRC Emerging Leaders Fellowship (1174060). ARY is supported by a NHMRC Principal Research Fellowship (1136829). The funding providers had no role in the design and conduct of the study, or in the preparation, review, or approval of this manuscript.

Author information

Authors and affiliations.

Institute for Mental and Physical Health and Clinical Translation, Deakin University, Geelong, VIC, 3220, Australia

Cláudia C. Gonçalves, Shae E. Quirk, Peter M. Haddad, Lana J. Williams & Alison R. Yung

Telethon Kids Institute, University of Western Australia, Perth, WA, 6009, Australia

University Hospital Geelong, Barwon Health, Geelong, VIC, 3220, Australia

Peter M. Haddad

School of Population and Global Health, University of Western Australia, Perth, WA, 6009, Australia

Ashleigh Lin

School of Health Sciences, University of Manchester, Manchester, M13 9PL, UK

Alison R. Yung

You can also search for this author in PubMed   Google Scholar

Contributions

CCG is the guarantor. CCG conceptualised the review, developed the study design, and drafted the manuscript. CCG, ZW, and SQ collaborated with OL (Scholarly Services Librarian) to develop the search strategy. All authors critically reviewed the manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Cláudia C. Gonçalves .

Ethics declarations

Ethics approval and consent to participate, consent for publication, competing interests.

In the last 3 years, PMH has received honoraria for lecturing from Janssen, NewBridge Pharmaceuticals, and Otsuka and royalties from edited textbooks (Cambridge University Press, Oxford University Press).

Additional information

Publisher’s note.

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1. prisma-p 2015 checklist. completed prisma-p checklist for this systematic review protocol., 13643_2024_2566_moesm2_esm.docx.

Additional file 2. Search Strategy. Detailed search strategy for this systematic review, including search terms and relevant controlled vocabulary terms for each included database.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ . The Creative Commons Public Domain Dedication waiver ( http://creativecommons.org/publicdomain/zero/1.0/ ) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Cite this article.

Gonçalves, C.C., Waters, Z., Quirk, S.E. et al. Barriers and facilitators to mental health treatment access and engagement for LGBTQA+ people with psychosis: a scoping review protocol. Syst Rev 13 , 143 (2024). https://doi.org/10.1186/s13643-024-02566-5

Download citation

Received : 04 July 2023

Accepted : 17 May 2024

Published : 30 May 2024

DOI : https://doi.org/10.1186/s13643-024-02566-5

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

• Treatment access
• Treatment engagement
• Facilitators
• Clinical high risk
• Ultra-high risk
• Psychotic experiences

Systematic Reviews

ISSN: 2046-4053

• Submission enquiries: Access here and click Contact Us
• General enquiries: [email protected]

Yale Economic Growth Center

Agte et al.: "Gender Gaps and Economic Growth: Why Haven't Women Won Globally (Yet)?"

EGC Discussion Paper No. 1105, May, 2024, by members of the Gender and Growth Gaps project team: Patrick Agte, Orazio Attanasio, Pinelopi K. Goldberg, Aishwarya Lakshmi Ratan, Rohini Pande, Michael Peters, Charity Troyer Moore, and Fabrizio Zilibotti.

Does economic growth close labor market-linked gender gaps that disadvantage women? Conversely, do gender inequalities in the labor market impede growth? To inform these questions, we conduct two analyses. First, we estimate regressions using data on gender gaps in a range of labor market outcomes from 153 countries spanning two decades (1998-2018). Second, we conduct a systematic review of the recent economics literature on gender gaps in labor markets, examining 16 journals over 21 years. Our empirical analysis demonstrates that growth is not a panacea. While economic gender gaps have narrowed and growth is associated with gender gap closures specifically in incidence of paid work, the relationship between growth and labor market gaps is otherwise mixed, and results vary by specification. This result reflects, in part, the gendered nature of structural transformation, in which growth leads men to transition from agriculture to industry and services while many women exit the labor force. Disparities in hours worked and wages persist despite growth, and heterogeneity in trends and levels between regions highlight the importance of local institutions. To better understand whether gender inequalities impeded growth, we explore a nascent literature that shows that reducing gender gaps in labor markets increases aggregate productivity. Our broader review highlights how traditional explanations for gender differences do not adequately explain existing gaps and how policy responses need to be sensitive to the changing nature of economic growth. We conclude by posing open questions for future research.

P. Agte, O. Attanasio, P. Goldberg, A. Lakshmi Ratan, R. Pande, M. Peters, C. Troyer Moore, and F. Zilibotti. "Gender Gaps and Economic Growth: Why Haven't Women Won Globally (Yet)?" EGC Discussion Paper No. 1105. 

View Publication

• EGC Discussion Papers on EliScholar