how to cite a research report

• Collections
• Research Help
• Teaching & Learning
• Library Home

APA 7th Edition Citation Style Guide

• Basics & Help
• Journal Articles
• Web Sources
• Magazine & News Articles
• Audiovisual Media

Technical & Research Reports

Tests, scales, & inventories.

• Legal Documents
• Dissertations & Theses
• References Page
• In-text Citations
• Author Variations (more than 1, or group)
• Citing Business Resources

General Rule:

Author. (Year). Title of report  (Report No. if given). Publisher. DOI or URL

• If the author and the publishing agency are the same omit the publisher from the citation. 

  Federal Interagency Forum on Child and Family Statistics. (2013). America’s children: key national indicators of well-being. http://childstats.gov/americaschildren/index2.asp.

Author or name of group. (Year). Title of data set [description of form]. Publisher Name or Source of

unpublished data. Retrieved month day, year, from DOI or URL

• Include a retrieval date only if the data set is designed to change over time. 
• If a version number and/or database number is available include it with the data set title. 
• No need to include a publisher name if it is the same as the author.
• If the data is unpublished provide the source (e.g. university) if known. 
• If the dataset is untitled, give a description of the data and publication status in square brackets.

Pew Internet & American Life Project. (2012). November 2012- library services [Data file and code book]. http://www.pewinternet.org/Shared-Content/Data-Sets/2012/November-2012--Library-Services.aspx

Jeffri, J., Schriel, A., & Throsby, D. (2003) The aDvANCE Project: A study of career transition for professional dancers (ICPSR 35598; Version V1)  [Data set].  IPCSR.  https://doi.org/10.3886/ICPSR35598.v1  

Whenever possible, give a citation for the measurements' supporting literature (e.g. manual, book, or journal article ). If the supporting literature is unavailable, cite the the test itself or database record using the following rule.

Author name. (year).  Title of the test. URL

Author name. (year).  Title of the test database record [Database record] . Test Database Name. URL

Hofstede , G &  Hofstede , G. J. (2013). Values Survey Module 2013 .  https://geerthofstede.com/research-and-vsm/vsm-2013/

Castellanos, I., Kronenberger, W.G., & Pisoni, D.B.   ( 2018 ). Learning, Executive, and Attention Function Scale

(LEAF) [Database record]. PsycTESTS.  https://doi.org/10.1037/t66008-000

• << Previous: Audiovisual Media
• Next: Legal Documents >>
• Last Updated: Feb 29, 2024 4:13 PM
• URL: https://libguides.wvu.edu/apa

APA Style 7th Edition: Citing Your Sources

Apa 7th edition, what is the purpose, quick links.

• In Text Quick View
• Block Quotes
• Books & eBooks
• Thesis/Dissertation
• Audiovisual
• Conference Presentations
• Social Media
• Legal References
• Reports and Gray Literature
• Academic Integrity and Plagiarism
• Additional Resources
• Reference Page

APA Publications in the Library

This guide pertains to the 7th edition of the APA Manual.

This guide is designed to support the citation and reference needs of USC students, staff, and faculty.  The 7th edition of the manual does make distinctions between formatting certain components for academic use over publication.  This guide will distinguish student/academic formatting where applicable. 

This guide is designed as a "quick" reference to common APA citation, reference and formatting criteria.  When in doubt, we encourage users to consult with the APA publication manual or APA website for further clarification as the authority on formatting.

Attribution for guide: Adapted from American Psychological Association. (2020). Publication manual of the American Psychological Association (7th ed).  https://doi.org/10.1037/0000165-000

What is the purpose of citations?

Citations help readers locate your sources. They help to continue the scholarly conversation. To learn more about how citations can help you avoid plagiarism, view this interactive tutorial: 

USC Library Lessons: Avoiding Plagiarism through Citations

When considering citations and references for your papers, you can ask yourself, "could someone find this information in the future?"

A client's personal file would not need a citation because your reader cannot go find that information again.  Census statistics would require a citation because your reader could go locate that information again.

APA requires FOUR ELEMENTS of every citation:

• Who- Author of content
• When- Date content was published
• What- Title of content
• Where- Publication information. This can be the website you got it from or the journal or book's publication information.

If any of the elements listed above are unavailable, check out "Missing Reference Information" from APA for more information.

• APA Style Website As part of our Style and Grammar Guidelines, we explain the basics of paper format, grammar, punctuation, in-text citations, references, bias-free language, and more. Much of what you used to find on the sixth edition blog, you can now find on the APA Style website.
• Organizing Your Social Sciences Research Paper by Robert V. Labaree Last Updated May 30, 2024 737874 views this year
• Owl Purdue 7th Edition Style Guide and Formatting Writing guide from Owl Purdue covering the 7th edition of the APA Manual
• Quick Reference Guide Quick guide on how to identify components to configure a reference for Journal article, book, and chapter from an edited book.
• Annotated Sample Student Paper Sample student paper with formatting annotations.
• Sample student paper
• Annotated Sample Professional Paper Sample professional paper with formatting annotations
• Sample professional paper
• USC Libraries APA Style Quick Guide
• Next: In Text Citations >>
• Last Updated: Jun 5, 2024 4:00 PM
• URL: https://libguides.usc.edu/APA7th

APA 7th Edition Citation Examples

• Volume and Issue Numbers
• Page Numbers
• Undated Sources
• Citing a Source Within a Source
• In-Text Citations
• Academic Journals
• Encyclopedia Articles
• Book, Film, and Product Reviews
• Online Classroom Materials
• Conference Papers

Format for technical and research reports

• Court Decisions
• Treaties and Other International Agreements
• Federal Regulations: I. The Code of Federal Regulations
• Federal Regulations: II. The Federal Register
• Executive Orders
• Charter of the United Nations
• Federal Statutes
• Dissertations and Theses
• Interviews, E-mail Messages + Other Personal Communications
• Social Media
• Business Sources
• PowerPoints
• AI: ChatGPT, etc.

Author last name, first initial. (Date).  Title of report  (Publication No.). Publisher. DOI or URL

• Author:  List the last name, followed by the first initial (and second initial). See  Authors  for more information.
• Date:  List the date between parentheses, followed by a period
• Title of report:  In italics. Capitalize the first word of the title, subtitle, and proper nouns.
• Publication number: Omit if unavailable for the source that you're citing
• Publisher:  List the report's publisher. If the publisher is the same as the author, do not list the name a second time.
• DOI or URL:  List DOI or URL if available

See specific examples below.

U.S. Government Accountability Office. (2010). Information security: Concerted effort needed to consolidate and secure Internet connections at federal agencies (Publication No. GAO-10-237). http://www.gao.gov/assets/310/301876.pdf

U.S. Government Accountability Office. (2010). Information security: Concerted effort needed to consolidate and secure Internet connections at federal agencies (Publication No. GAO-10-237).

See  Publication Manual , 10.4.

• << Previous: Conference Papers
• Next: Legal Materials >>
• Last Updated: Mar 18, 2024 12:55 PM
• URL: https://libguides.umgc.edu/apa-examples

Citing sources: Overview

• Citation style guides

Manage your references

Use these tools to help you organize and cite your references:

• Citation Management and Writing Tools

If you have questions after consulting this guide about how to cite, please contact your advisor/professor or the writing and communication center .

Why citing is important

It's important to cite sources you used in your research for several reasons:

• To show your reader you've done proper research by listing sources you used to get your information
• To be a responsible scholar by giving credit to other researchers and acknowledging their ideas
• To avoid plagiarism by quoting words and ideas used by other authors
• To allow your reader to track down the sources you used by citing them accurately in your paper by way of footnotes, a bibliography or reference list

About citations

Citing a source means that you show, within the body of your text, that you took words, ideas, figures, images, etc. from another place.

Citations are a short way to uniquely identify a published work (e.g. book, article, chapter, web site).  They are found in bibliographies and reference lists and are also collected in article and book databases.

Citations consist of standard elements, and contain all the information necessary to identify and track down publications, including:

• author name(s)
• titles of books, articles, and journals
• date of publication
• page numbers
• volume and issue numbers (for articles)

Citations may look different, depending on what is being cited and which style was used to create them. Choose an appropriate style guide for your needs.  Here is an example of an article citation using four different citation styles.  Notice the common elements as mentioned above:

Author - R. Langer

Article Title - New Methods of Drug Delivery

Source Title - Science

Volume and issue - Vol 249, issue 4976

Publication Date - 1990

Page numbers - 1527-1533

American Chemical Society (ACS) style:

Langer, R. New Methods of Drug Delivery. Science 1990 , 249 , 1527-1533.

IEEE Style:

R. Langer, " New Methods of Drug Delivery," Science , vol. 249 , pp. 1527-1533 , SEP 28, 1990 .

American Psychological Association   (APA) style:

Langer, R. (1990) . New methods of drug delivery. Science , 249 (4976), 1527-1533.

Modern Language Association (MLA) style:

Langer, R. " New Methods of Drug Delivery." Science 249.4976 (1990) : 1527-33.

What to cite

You must cite:

• Facts, figures, ideas, or other information that is not common knowledge

Publications that must be cited include:  books, book chapters, articles, web pages, theses, etc.

Another person's exact words should be quoted and cited to show proper credit 

When in doubt, be safe and cite your source!

Avoiding plagiarism

Plagiarism occurs when you borrow another's words (or ideas) and do not acknowledge that you have done so. In this culture, we consider our words and ideas intellectual property; like a car or any other possession, we believe our words belong to us and cannot be used without our permission.

Plagiarism is a very serious offense. If it is found that you have plagiarized -- deliberately or inadvertently -- you may face serious consequences. In some instances, plagiarism has meant that students have had to leave the institutions where they were studying.

The best way to avoid plagiarism is to cite your sources - both within the body of your paper and in a bibliography of sources you used at the end of your paper.

Some useful links about plagiarism:

• MIT Academic Integrity Overview on citing sources and avoiding plagiarism at MIT.
• Avoiding Plagiarism From the MIT Writing and Communication Center.
• Plagiarism: What It is and How to Recognize and Avoid It From Indiana University's Writing Tutorial Services.
• Plagiarism- Overview A resource from Purdue University.
• Next: Citation style guides >>
• Last Updated: Jan 16, 2024 7:02 AM
• URL: https://libguides.mit.edu/citing

• PRO Courses Guides New Tech Help Pro Expert Videos About wikiHow Pro Upgrade Sign In
• EDIT Edit this Article
• EXPLORE Tech Help Pro About Us Random Article Quizzes Request a New Article Community Dashboard This Or That Game Popular Categories Arts and Entertainment Artwork Books Movies Computers and Electronics Computers Phone Skills Technology Hacks Health Men's Health Mental Health Women's Health Relationships Dating Love Relationship Issues Hobbies and Crafts Crafts Drawing Games Education & Communication Communication Skills Personal Development Studying Personal Care and Style Fashion Hair Care Personal Hygiene Youth Personal Care School Stuff Dating All Categories Arts and Entertainment Finance and Business Home and Garden Relationship Quizzes Cars & Other Vehicles Food and Entertaining Personal Care and Style Sports and Fitness Computers and Electronics Health Pets and Animals Travel Education & Communication Hobbies and Crafts Philosophy and Religion Work World Family Life Holidays and Traditions Relationships Youth
• Browse Articles
• Learn Something New
• Quizzes Hot
• This Or That Game
• Train Your Brain
• Explore More
• Support wikiHow
• About wikiHow
• Log in / Sign up
• Education and Communications
• College University and Postgraduate
• Academic Writing
• Research Papers

How to Cite a Research Paper

Last Updated: March 29, 2024 Fact Checked

This article was reviewed by Gerald Posner and by wikiHow staff writer, Jennifer Mueller, JD . Gerald Posner is an Author & Journalist based in Miami, Florida. With over 35 years of experience, he specializes in investigative journalism, nonfiction books, and editorials. He holds a law degree from UC College of the Law, San Francisco, and a BA in Political Science from the University of California-Berkeley. He’s the author of thirteen books, including several New York Times bestsellers, the winner of the Florida Book Award for General Nonfiction, and has been a finalist for the Pulitzer Prize in History. He was also shortlisted for the Best Business Book of 2020 by the Society for Advancing Business Editing and Writing. There are 8 references cited in this article, which can be found at the bottom of the page. This article has been fact-checked, ensuring the accuracy of any cited facts and confirming the authority of its sources. This article has been viewed 416,165 times.

When writing a paper for a research project, you may need to cite a research paper you used as a reference. The basic information included in your citation will be the same across all styles. However, the format in which that information is presented is somewhat different depending on whether you're using American Psychological Association (APA), Modern Language Association (MLA), Chicago, or American Medical Association (AMA) style.

Referencing a Research Paper

• In APA style, cite the paper: Last Name, First Initial. (Year). Title. Publisher.
• In Chicago style, cite the paper: Last Name, First Name. “Title.” Publisher, Year.
• In MLA style, cite the paper: Last Name, First Name. “Title.” Publisher. Year.

Citation Help

• For example: "Kringle, K., & Frost, J."

• For example: "Kringle, K., & Frost, J. (2012)."
• If the date, or any other information, are not available, use the guide at https://blog.apastyle.org/apastyle/2012/05/missing-pieces.html .

• For example: "Kringle, K., & Frost, J. (2012). Red noses, warm hearts: The glowing phenomenon among North Pole reindeer."
• If you found the research paper in a database maintained by a university, corporation, or other organization, include any index number assigned to the paper in parentheses after the title. For example: "Kringle, K., & Frost, J. (2012). Red noses, warm hearts: The glowing phenomenon among North Pole reindeer. (Report No. 1234)."

• For example: "Kringle, K., & Frost, J. (2012). Red noses, warm hearts: The glowing phenomenon among North Pole reindeer. (Report No. 1234). Retrieved from Alaska University Library Archives, December 24, 2017."

• For example: "(Kringle & Frost, 2012)."
• If there was no date on the research paper, use the abbreviation n.d. : "(Kringle & Frost, n.d.)."

• For example: "Kringle, Kris, and Jack Frost."

• For example: "Kringle, Kris, and Jack Frost. "Red Noses, Warm Hearts: The Glowing Phenomenon among North Pole Reindeer." Master's thesis."

• For example: "Kringle, Kris, and Jack Frost. "Red Noses, Warm Hearts: The Glowing Phenomenon among North Pole Reindeer." Master's thesis, Alaska University, 2012."

• For example: "Kringle, Kris, and Jack Frost. "Red Noses, Warm Hearts: The Glowing Phenomenon among North Pole Reindeer." Master's thesis, Alaska University, 2012. Accessed at https://www.northpolemedical.com/raising_rudolf."

• Footnotes are essentially the same as the full citation, although the first and last names of the authors aren't inverted.
• For parenthetical citations, Chicago uses the Author-Date format. For example: "(Kringle and Frost 2012)."

• For example: "Kringle, Kris, and Frost, Jack."

• For example: "Kringle, Kris, and Frost, Jack. "Red Noses, Warm Hearts: The Glowing Phenomenon Among North Pole Reindeer.""

• For example, suppose you found the paper in a collection of paper housed in university archives. Your citation might be: "Kringle, Kris, and Frost, Jack. "Red Noses, Warm Hearts: The Glowing Phenomenon Among North Pole Reindeer." Master's Theses 2000-2010. University of Alaska Library Archives. Accessed December 24, 2017."

• For example: "(Kringle & Frost, p. 33)."

• For example: "Kringle K, Frost J."

• For example: "Kringle K, Frost J. Red noses, warm hearts: The glowing phenomenon among North Pole reindeer."

• For example: "Kringle K, Frost J. Red noses, warm hearts: The glowing phenomenon among North Pole reindeer. Nat Med. 2012; 18(9): 1429-1433."

• For example, if you're citing a paper presented at a conference, you'd write: "Kringle K, Frost J. Red noses, warm hearts: The glowing phenomenon among North Pole reindeer. Oral presentation at Arctic Health Association Annual Summit; December, 2017; Nome, Alaska."
• To cite a paper you read online, you'd write: "Kringle K, Frost J. Red noses, warm hearts: The glowing phenomenon among North Pole reindeer. https://www.northpolemedical.com/raising_rudolf"

• For example: "According to Kringle and Frost, these red noses indicate a subspecies of reindeer native to Alaska and Canada that have migrated to the North Pole and mingled with North Pole reindeer. 1 "

Community Q&A

• If you used a manual as a source in your research paper, you'll need to learn how to cite the manual also. Thanks Helpful 0 Not Helpful 0
• If you use any figures in your research paper, you'll also need to know the proper way to cite them in MLA, APA, AMA, or Chicago. Thanks Helpful 0 Not Helpful 0

You Might Also Like

• ↑ https://askus.library.wwu.edu/faq/116659
• ↑ https://guides.libraries.psu.edu/apaquickguide/intext
• ↑ https://owl.purdue.edu/owl/research_and_citation/chicago_manual_17th_edition/cmos_formatting_and_style_guide/general_format.html
• ↑ https://libanswers.snhu.edu/faq/48009
• ↑ https://www.chicagomanualofstyle.org/tools_citationguide/citation-guide-2.html
• ↑ https://owl.purdue.edu/owl/research_and_citation/mla_style/mla_formatting_and_style_guide/mla_in_text_citations_the_basics.html
• ↑ https://morningside.libguides.com/MLA8/location
• ↑ https://owl.purdue.edu/owl/research_and_citation/ama_style/index.html

About This Article

To cite a paper APA style, start with the author's last name and first initial, and the year of publication. Then, list the title of the paper, where you found it, and the date that you accessed it. In a paper, use a parenthetical reference with the last name of the author and the publication year. For an MLA citation, list the author's last name and then first name and the title of the paper in quotations. Include where you accessed the paper and the date you retrieved it. In your paper, use a parenthetical reference with the author's last name and the page number. Keep reading for tips on Chicago and AMA citations and exceptions to the citation rules! Did this summary help you? Yes No

• Send fan mail to authors

Did this article help you?

Featured Articles

Trending Articles

Watch Articles

• Terms of Use
• Privacy Policy
• Do Not Sell or Share My Info
• Not Selling Info

wikiHow Tech Help Pro:

Level up your tech skills and stay ahead of the curve

Citation guides

All you need to know about citations

How to cite a report in Harvard

To cite a report in a reference entry in Harvard style include the following elements:

• Author or organization: Give the last name and initials (e. g. Watson, J.) of up to three authors with the last name preceded by 'and'. For four authors or more include the first name followed by et al., unless your institution requires referencing of all named authors.
• Year of publication: Give the year in round brackets.
• Title of the report: Give the title as presented in the source. Only the first letter of the first word and proper nouns are capitalized.
• Place of publication: List the city and the US state using the two-letter abbreviation. Spell out country names if outside of the UK or the USA.
• Publisher: Give the name of the publisher.

Here is the basic format for a reference list entry of a report in Harvard style:

Author or organization . ( Year of publication ) Title of the report . Place of publication : Publisher .

Take a look at our reference list examples that demonstrate the Harvard style guidelines in action:

A report in print by one author

Loban, W . ( 1976 ) Language Development: Kindergarten through Grade Twelve . Washington, DC : Office of Education .

Langer, J. A . ( 1987 ) How Writing Shapes Thinking: A study of Teaching and Learning . Washington, DC : National Institute of Education .

This citation style guide is based on the Cite Them Right (10 th edition) Harvard referencing guide.

More useful guides

• UQ Harvard referencing style: Report
• Citing & Referencing: Harvard Style
• Harvard referencing tutorial

More great BibGuru guides

• Chicago: how to cite a master's thesis
• Chicago: how to cite a C-Span video
• Chicago: how to cite a PhD thesis

Automatic citations in seconds

Citation generators

Alternative to.

• NoodleTools
• Getting started

From our blog

• 📚 How to write a book report
• 📝 APA Running Head
• 📑 How to study for a test

Purdue Online Writing Lab Purdue OWL® College of Liberal Arts

Welcome to the Purdue Online Writing Lab

Welcome to the Purdue OWL

This page is brought to you by the OWL at Purdue University. When printing this page, you must include the entire legal notice.

Copyright ©1995-2018 by The Writing Lab & The OWL at Purdue and Purdue University. All rights reserved. This material may not be published, reproduced, broadcast, rewritten, or redistributed without permission. Use of this site constitutes acceptance of our terms and conditions of fair use.

The Online Writing Lab at Purdue University houses writing resources and instructional material, and we provide these as a free service of the Writing Lab at Purdue. Students, members of the community, and users worldwide will find information to assist with many writing projects. Teachers and trainers may use this material for in-class and out-of-class instruction.

The Purdue On-Campus Writing Lab and Purdue Online Writing Lab assist clients in their development as writers—no matter what their skill level—with on-campus consultations, online participation, and community engagement. The Purdue Writing Lab serves the Purdue, West Lafayette, campus and coordinates with local literacy initiatives. The Purdue OWL offers global support through online reference materials and services.

A Message From the Assistant Director of Content Development 

The Purdue OWL® is committed to supporting  students, instructors, and writers by offering a wide range of resources that are developed and revised with them in mind. To do this, the OWL team is always exploring possibilties for a better design, allowing accessibility and user experience to guide our process. As the OWL undergoes some changes, we welcome your feedback and suggestions by email at any time.

Please don't hesitate to contact us via our contact page  if you have any questions or comments.

All the best,

Social Media

Facebook twitter.

Home / Guides / Citation Guides / MLA Format / How to Cite a Report in MLA

How to Cite a Report in MLA

Citing a report.

Report – A document containing the findings of an individual or group. Can include a technical paper, publication, issue brief, or working paper.

Report Citation Structure

Last, First M. Report Title . Publisher, date published, URL (if applicable).

Note: If the author and publisher of the report are the same, start your citation with the title of the report instead. 

First Page of Report

Report Citation Example:

Gorbunova, Yulia and Konstantin Baranov. Laws of Attrition: Crackdown on Russia’s Civil Society After Putin’s Return to the Presidency . Human Rights Watch, 2013.

Report In-text Citation Structure:

(Author Last Name(s) Page #)

Report In-text Citation Example: 

(Gorbunova and Konstantin 4)

MLA Formatting Guide

MLA Formatting

• Annotated Bibliography
• Bibliography
• Block Quotes
• et al Usage
• In-text Citations
• Paraphrasing
• Page Numbers
• Sample Paper
• Works Cited
• MLA 8 Updates
• MLA 9 Updates
• View MLA Guide

Citation Examples

• Book Chapter
• Journal Article
• Magazine Article
• Newspaper Article
• Website (no author)
• View all MLA Examples

How useful was this post?

Click on a star to rate it!

We are sorry that this post was not useful for you!

Let us improve this post!

Tell us how we can improve this post?

To cite a report in MLA style, you need to have basic information including the author or the organization name, title of the report, and publication year. The templates for in-text citations and works-cited-list entries of a report, along with examples, are given below:

Report created and published by the same organization

In-text citation template and example:

Use the organization’s name in both prose and parenthetical citation.

Citation in prose: Pew Research Center

Parenthetical: (Pew Research Center)

Works-cited-list entry template and example:

Title of the Chapter . Organization Name, Publication Date.

Audio and Podcasting Fact Sheet . Pew Research Center, July 2018.

Different authors and publisher

Use the below template when the author and publisher are different. For citations in prose, use the first name and surname of the first author followed by “and others” or “and colleagues.” In subsequent citations, use only the surname of the first author followed by “and others” or “and colleagues.” In parenthetical citations, always use only the surname of the first author followed by “et al.”

Citation in prose:

First instance: Kim Parker and others . . . Or Kim Parker and colleagues

Subsequent occurrences: Parker and others . . . Or Parker and colleagues

Parenthetical:

. . . (Parker et al.)

Surname, First Name, et al. Title of the Report . Organization Name, Publication Date, URL.

Parker, Kim, et al. About Half of Lower-Income Americans Report Household Job or Wage Loss Due to COVID-19 . Pew Research Center, Apr. 2020, www.pewresearch.org/social-trends/2020/ 04 /21/about-half-of-lower-income-americans-report-household-job-or-wage-loss-due-to-covid-19/ .

To cite a government document in MLA style, you need to have basic information including the author or the organization name, title of the document, and publication year. The templates for in-text citations and works-cited-list entries of a government document, along with examples, are given below:

For citations in prose, use the first name and surname of the author in the first occurrence. In subsequent citations, use only the surname. In parenthetical citations, always use only the surname of the author.

First mention: Ferdinand Hayden . . .

Subsequent occurrences: Hayden . . .

. . . (Hayden)

Surname, First Name. Title of the Government Document . Organization Name, Publication Date.

Hayden, Ferdinand. Preliminary Report of the United States Geological Survey of Montana and Portions of Adjacent Territories . Government Printing Office, 1872.

MLA Citation Examples

Writing Tools

Citation Generators

Other Citation Styles

Plagiarism Checker

Upload a paper to check for plagiarism against billions of sources and get advanced writing suggestions for clarity and style.

Get Started

Help | Advanced Search

Computer Science > Computation and Language

Title: hallucination-free assessing the reliability of leading ai legal research tools.

Abstract: Legal practice has witnessed a sharp rise in products incorporating artificial intelligence (AI). Such tools are designed to assist with a wide range of core legal tasks, from search and summarization of caselaw to document drafting. But the large language models used in these tools are prone to "hallucinate," or make up false information, making their use risky in high-stakes domains. Recently, certain legal research providers have touted methods such as retrieval-augmented generation (RAG) as "eliminating" (Casetext, 2023) or "avoid[ing]" hallucinations (Thomson Reuters, 2023), or guaranteeing "hallucination-free" legal citations (LexisNexis, 2023). Because of the closed nature of these systems, systematically assessing these claims is challenging. In this article, we design and report on the first preregistered empirical evaluation of AI-driven legal research tools. We demonstrate that the providers' claims are overstated. While hallucinations are reduced relative to general-purpose chatbots (GPT-4), we find that the AI research tools made by LexisNexis (Lexis+ AI) and Thomson Reuters (Westlaw AI-Assisted Research and Ask Practical Law AI) each hallucinate between 17% and 33% of the time. We also document substantial differences between systems in responsiveness and accuracy. Our article makes four key contributions. It is the first to assess and report the performance of RAG-based proprietary legal AI tools. Second, it introduces a comprehensive, preregistered dataset for identifying and understanding vulnerabilities in these systems. Third, it proposes a clear typology for differentiating between hallucinations and accurate legal responses. Last, it provides evidence to inform the responsibilities of legal professionals in supervising and verifying AI outputs, which remains a central open question for the responsible integration of AI into law.

Submission history

Access paper:.

• HTML (experimental)
• Other Formats

References & Citations

• Google Scholar
• Semantic Scholar

BibTeX formatted citation

Bibliographic and Citation Tools

Code, data and media associated with this article, recommenders and search tools.

• Institution

arXivLabs: experimental projects with community collaborators

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs .

Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

• View all journals
• Explore content
• About the journal
• Publish with us
• Sign up for alerts
• 28 May 2024

Heed lessons from past studies involving transgender people: first, do no harm

• Mathilde Kennis 0 ,
• Robin Staicu 1 ,
• Marieke Dewitte 2 ,
• Guy T’Sjoen 3 ,
• Alexander T. Sack 4 &
• Felix Duecker 5

Mathilde Kennis is a researcher in cognitive neuroscience and clinical psychological science at Maastricht University, the Netherlands.

You can also search for this author in PubMed   Google Scholar

Robin Staicu is a neuroscientist and specialist in diversity, equity and inclusion at Maastricht University, the Netherlands.

Marieke Dewitte is a sexologist and assistant professor in clinical psychological science at Maastricht University, the Netherlands.

Guy T’Sjoen is a clinical endocrinologist and professor in endocrinology at Ghent University Hospital, Belgium, the medical coordinator of the Centre for Sexology and Gender at Ghent University Hospital, and one of the founders of the European Professional Association for Transgender Health.

Alexander T. Sack is a professor in cognitive neuroscience at Maastricht University, the Netherlands.

Felix Duecker is an assistant professor in cognitive neuroscience at Maastricht University, the Netherlands.

You have full access to this article via your institution.

Over the past few decades, neuroscientists, endocrinologists, geneticists and social scientists have conducted numerous studies involving transgender people, meaning those whose gender identity does not conform to that typically associated with the sex to which they were assigned at birth. Justifications for doing such research have shifted over the years and, today, investigators are increasingly focused on assessments of transgender people’s mental health or the impact of hormone therapies.

But such work raises challenges. Despite researchers’ best intentions, these studies can perpetuate stigmas and make it even harder for transgender people to access appropriate medical care.

Here we focus on neuroscientific approaches to the study of transgender identity to explore how investigators might navigate these concerns.

Brain scanning

In 1995, neuroscientists at the Netherlands Institute for Brain Research in Amsterdam published findings from a post-mortem study, which included six transgender individuals 1 . They found that the volume of part of the brain’s hypothalamus — called the bed nucleus of the stria terminalis, which tends to be larger in men than in women — corresponded to the gender identity of the transgender individuals, not to their sex assigned at birth. Although the data were only correlative, the researchers suggested that people identify as transgender because of changes in the brain that happen before birth — in other words, that someone can be born with a male-typical body and brain characteristics more typical of a female brain, and vice versa.

Sex and gender in science

Since it was published, the paper has been cited more than 1,000 times, and at least a dozen researchers have probed this theory and related ones using tools such as structural and functional magnetic resonance imaging (MRI).

Although the results of these analyses have been inconsistent, several ideas have nonetheless arisen about a neurobiological basis for gender dysphoria — the distress associated with a person’s gender identity not aligning with the sex they were assigned at birth. These include the ‘own-body perception’ theory 2 , which proposes that a reduced structural and functional connectivity between certain brain networks is responsible. (Previous work has associated these networks with brain regions thought to be involved in people’s ability to link their own body to their sense of self 3 .)

As analytical tools and methods advance, brain research is becoming more sophisticated. The number of neuroscientific studies that include transgender participants has increased considerably since 1991 (see ‘On the rise’).

Some neuroscientists are using functional MRI to study the effects of hormone therapy on brain structure 4 and to examine cognitive processes such as face perception 5 . Others are applying machine-learning techniques to establish whether features in brain scans of cis- and transgender people correlate with their gender identity 6 . Researchers are also trying to assess whether particular features identified in brain scans make it more likely that transgender individuals will benefit from gender-affirming hormone therapy 7 . And some are conducting ‘mega-analyses’ — pooling the brain scans of hundreds of participants — to identify brain characteristics that are specific to transgender people 8 .

Help or harm?

One concern arising from such studies is that neuroscientific findings related to transgender identity could make it even harder for some people to access medical treatment that could help them.

In countries or regions where gender-affirming medical treatment is available, individuals often need a diagnosis of ‘gender dysphoria’ or ‘gender incongruence’ to be eligible for hormone therapy or gender-affirming surgery, and to be reimbursed for such treatments. Results from brain scans could be included in the suite of measurements used to assess whether someone is experiencing gender dysphoria or incongruence.

Those in favour of such requirements argue that it is necessary to prevent people taking irreversible steps that they might regret. Hormonal therapy can have adverse effects on fertility, for instance 9 . However, many transgender people argue that whether someone can receive gender-affirming hormone therapy or other treatment shouldn’t depend on a health-care practitioner deciding that they experience ‘enough’ gender dysphoria to be eligible 10 . The current approach, combined with a shortage of specialists qualified to make such diagnoses, has been linked to long waiting lists. In the Netherlands, waiting times can be more than two years .

A second possibility is that neuroscientific findings related to transgender identity will fuel transphobic narratives 11 .

Take the debate on social media and other platforms about gendered public spaces in countries such as the United States , the United Kingdom and Brazil 12 . Some people argue that allowing transgender women to access infrastructure, such as public toilets or women’s prisons, threatens the safety of “real women” . Neuroscientific research is sometimes misused to bolster flawed claims about what ‘real’ means.

Moreover, such studies could exacerbate tensions between scientific and transgender communities.

Scientists are aiming to identify brain characteristics that are specific to transgender people. Credit: Alain Jocard/AFP/Getty

Although cis- and transgender researchers have taken steps to improve people’s understanding, there is a history of tension between the scientific and transgender communities 13 . In the late 1980s, for instance, a sexologist argued that trans women who are mainly attracted to women experience sexual arousal from their own expression of femininity. He described their feelings of gender dysphoria as resulting from paraphilia — a sexual interest in objects, situations or individuals that are atypical 14 . This theory has not held up under broader scientific scrutiny 15 , but it has become notorious in the transgender community and, from our discussions with transgender people and discussions by other groups 16 , it is clear that such studies have reduced transgender people’s trust in science.

How four transgender researchers are improving the health of their communities

In 2021, for example, a neuroimaging study with transgender participants was suspended in the United States after backlash from the transgender community. The study would have involved showing participants images of themselves wearing tight clothes, with the intention of triggering gender dysphoria — an experience that is associated with depression, anxiety, social isolation and an increased risk of suicide. The study’s researchers had acquired ethical approval from their research institute and obtained informed consent from the participants. Yet they had failed to anticipate how the transgender community would perceive their experimental procedure.

In 2022, to learn more about how transgender people view current neuroscientific approaches to the study of transgender identity, we conducted focus-group interviews that lasted for three hours with eight transgender participants — all of whom had differing levels of knowledge about the topic.

The group expressed concern that studies that look for a neurological basis to transgender identities could have a pathologizing effect. “I think questions of aetiology are just inherently wrong,” one participant said. “We don’t ask ‘Why is someone’s favourite colour blue?’. These are questions that come from wanting to pathologize.” Participants also agreed that a biological-determinist approach does not do justice to the complex and layered experience of identifying as transgender.

Decades of work aimed at establishing how science can benefit minority groups 17 suggest that neuroscientists and other scholars could take several steps to ensure they help rather than harm transgender, non-binary and intersex individuals and other people who don’t conform to narrow definitions around sex and gender. Indeed, the four actions that we lay out here are broadly applicable to any studies involving marginalized groups.

Establish an advisory board. Researchers who work with transgender participants should collaborate with an advisory board that ideally consists of transgender people and members of other groups with relevant perspectives, including those who have some understanding of the science in question. Funding agencies should support such initiatives, to help prevent further distrust being sown because of how studies are designed.

Set up multidisciplinary teams. Researchers trained in neuroscience will view phenomena such as transgender identity through a different lens from, say, those trained in psychology. To prevent the outcomes of neuroscientific and other studies being described and published in an overly deterministic and simplistic way 18 , research teams should include social scientists. Ideally, such collaborations would also include transgender researchers or others with diverse gender identities, because their input would help to prevent a cis-normative bias in study design and in the interpretation of results. Indeed, our own group has benefited from this diversity (one of us is transgender).

Prioritize research that is likely to improve people’s lives. Neuroscientists and others engaged in research involving transgender participants, non-binary people or individuals with diverse gender identities should prioritize research questions that are likely to enhance the health of these groups. Although the applications of basic research can be hard to predict, investigations into the neurobiological impacts of hormone treatment on the brain, for instance, could be more directly informative to health-care practitioners and transgender individuals than might investigations into the underlying bases of transgender identity.

Rethink how ethical approval is obtained. Ethical boards at universities typically consist of scientists with diverse backgrounds. But it is unrealistic to expect them to be educated on the sensitivities of every minority group, whether in relation to gender, religion, ethnicity or anything else. One way to address this problem is for ethical boards to require researchers to state what feedback and other information they have gathered through community engagement. A university’s ethical review committee could then evaluate whether the researchers have done enough to understand and address people’s concerns and sensitivities.

Our aim is not to halt scientific enquiry. But when it comes to transgender identity, knowledge cannot be pursued in isolation from the many societal factors that shape how that knowledge is received and acted on.

Nature 629 , 998-1000 (2024)

doi: https://doi.org/10.1038/d41586-024-01521-7

Zhou, J.-N., Hofman, M. A., Gooren, L. J. G. & Swaab, D. F. Nature 378 , 68–70 (1995).

Article   PubMed   Google Scholar  

Manzouri, A., Kosidou, K., & Savic, I. Cereb. Cortex 27 , 998–1010 (2017).

PubMed   Google Scholar  

Northoff, G. et al. NeuroImage 31 , 440–457 (2006).

Burke, S. M. et al. Cereb. Cortex 28 , 1582–1596 (2018).

Fisher, A. D. et al. J. Clin. Med. 9 , 1731 (2020).

Clemens, B. et al. Cereb. Cortex 30 , 2755–2765 (2020).

Moody, T. D. et al. NeuroImage Clin. 29 , 102517 (2021).

Mueller, S. C. et al. J. Sex. Med. 18 , 1122–1129 (2021).

Nota, N. M., den Heijer, M. & Gooren, L. J. In Endotext (eds Feingold, K. R. et al. ) (MDText, 2000).

Google Scholar  

Ashley, F. J. Med. Ethics 45 , 480–482 (2019).

Ching, B. H.-H. & Xu, J. T. Sex Roles 78 , 228–241 (2018).

Article   Google Scholar  

Pagliarini Bagagli, B., Veriato Chaves, T. & Zoppi Fontana, M. G. Front. Sociol. 6 , 652777 (2021).

Santora, T. Nature Med. 27 , 2074–2077 (2021).

Blanchard, R. J. Nerv . Ment. Dis. 177 , 616–623 (1989).

Serano, J. Sociol. Rev. 68 , 763–778 (2020).

Richards, C., Barker, M., Lenihan, P. & Iantaffi, A. Fem. Psychol. 24 , 248–258 (2014).

Menzies, C. R. Can . J. Native Educ. 25 , 19–36 (2001).

Caselles, E. L. Front. Sociol. 6 , 608328 (2021).

Download references

Reprints and permissions

Competing Interests

The authors declare no competing interests.

Related Articles

Envisioning trans-inclusive and trans-specific cancer care

Let’s talk about (biological) sex

• Neuroscience
• Health care

Structure and topography of the synaptic V-ATPase–synaptophysin complex

Article 05 JUN 24

Senescent glia link mitochondrial dysfunction and lipid accumulation

Meta AI system is a boost to endangered languages — as long as humans aren’t forgotten

Editorial 05 JUN 24

‘I saw that discrimination wasn’t hearsay or rumours — it really did exist’

Career Q&A 05 JUN 24

Is AI misinformation influencing elections in India?

Comment 05 JUN 24

What we do — and don’t — know about how misinformation spreads online

A dad’s diet affects his sperm — and his sons’ health

News 05 JUN 24

Huge amounts of bird-flu virus found in raw milk of infected cows

Underfunding cannabis research hampers sensible policymaking and boosts the black market

Correspondence 04 JUN 24

Sir Run Run Shaw Hospital, School of Medicine, Zhejiang University, Warmly Welcomes Talents Abroad

Qiushi Chair Professor; Qiushi Distinguished Scholar; ZJU 100 Young Researcher; Distinguished researcher

No. 3, Qingchun East Road, Hangzhou, Zhejiang (CN)

Sir Run Run Shaw Hospital Affiliated with Zhejiang University School of Medicine

Proteomics expert (postdoc or staff scientist)

We are looking for a (senior) postdoc or postdoc-level staff scientist from all areas of proteomics to become part of our Proteomics Center.

Frankfurt am Main, Hessen (DE)

Goethe University (GU) Frankfurt am Main - Institute of Molecular Systems Medicine

Tenured Position in Huzhou University School of Medicine (Professor/Associate Professor/Lecturer)

※Tenured Professor/Associate Professor/Lecturer Position in Huzhou University School of Medicine

Huzhou, Zhejiang (CN)

Huzhou University

Electron Microscopy (EM) Specialist

APPLICATION CLOSING DATE: July 5th, 2024 About the Institute Human Technopole (HT) is an interdisciplinary life science research institute, created...

Human Technopole

Post-Doctoral Fellow in Chemistry and Chemical Biology

We are seeking a highly motivated, interdisciplinary scientist to investigate the host-gut microbiota interactions that are associated with driving...

Cambridge, Massachusetts

Harvard University - Department of Chemistry and Chemical Biology

Sign up for the Nature Briefing newsletter — what matters in science, free to your inbox daily.

Quick links

• Explore articles by subject
• Guide to authors
• Editorial policies