what is a critical analysis in research

• Privacy Policy

Buy Me a Coffee

Home » Critical Analysis – Types, Examples and Writing Guide

Critical Analysis – Types, Examples and Writing Guide

Table of Contents

Critical Analysis

Definition:

Critical analysis is a process of examining a piece of work or an idea in a systematic, objective, and analytical way. It involves breaking down complex ideas, concepts, or arguments into smaller, more manageable parts to understand them better.

Types of Critical Analysis

Types of Critical Analysis are as follows:

Literary Analysis

This type of analysis focuses on analyzing and interpreting works of literature , such as novels, poetry, plays, etc. The analysis involves examining the literary devices used in the work, such as symbolism, imagery, and metaphor, and how they contribute to the overall meaning of the work.

Film Analysis

This type of analysis involves examining and interpreting films, including their themes, cinematography, editing, and sound. Film analysis can also include evaluating the director’s style and how it contributes to the overall message of the film.

Art Analysis

This type of analysis involves examining and interpreting works of art , such as paintings, sculptures, and installations. The analysis involves examining the elements of the artwork, such as color, composition, and technique, and how they contribute to the overall meaning of the work.

Cultural Analysis

This type of analysis involves examining and interpreting cultural artifacts , such as advertisements, popular music, and social media posts. The analysis involves examining the cultural context of the artifact and how it reflects and shapes cultural values, beliefs, and norms.

Historical Analysis

This type of analysis involves examining and interpreting historical documents , such as diaries, letters, and government records. The analysis involves examining the historical context of the document and how it reflects the social, political, and cultural attitudes of the time.

Philosophical Analysis

This type of analysis involves examining and interpreting philosophical texts and ideas, such as the works of philosophers and their arguments. The analysis involves evaluating the logical consistency of the arguments and assessing the validity and soundness of the conclusions.

Scientific Analysis

This type of analysis involves examining and interpreting scientific research studies and their findings. The analysis involves evaluating the methods used in the study, the data collected, and the conclusions drawn, and assessing their reliability and validity.

Critical Discourse Analysis

This type of analysis involves examining and interpreting language use in social and political contexts. The analysis involves evaluating the power dynamics and social relationships conveyed through language use and how they shape discourse and social reality.

Comparative Analysis

This type of analysis involves examining and interpreting multiple texts or works of art and comparing them to each other. The analysis involves evaluating the similarities and differences between the texts and how they contribute to understanding the themes and meanings conveyed.

Critical Analysis Format

Critical Analysis Format is as follows:

I. Introduction

• Provide a brief overview of the text, object, or event being analyzed
• Explain the purpose of the analysis and its significance
• Provide background information on the context and relevant historical or cultural factors

II. Description

• Provide a detailed description of the text, object, or event being analyzed
• Identify key themes, ideas, and arguments presented
• Describe the author or creator’s style, tone, and use of language or visual elements

III. Analysis

• Analyze the text, object, or event using critical thinking skills
• Identify the main strengths and weaknesses of the argument or presentation
• Evaluate the reliability and validity of the evidence presented
• Assess any assumptions or biases that may be present in the text, object, or event
• Consider the implications of the argument or presentation for different audiences and contexts

IV. Evaluation

• Provide an overall evaluation of the text, object, or event based on the analysis
• Assess the effectiveness of the argument or presentation in achieving its intended purpose
• Identify any limitations or gaps in the argument or presentation
• Consider any alternative viewpoints or interpretations that could be presented
• Summarize the main points of the analysis and evaluation
• Reiterate the significance of the text, object, or event and its relevance to broader issues or debates
• Provide any recommendations for further research or future developments in the field.

VI. Example

• Provide an example or two to support your analysis and evaluation
• Use quotes or specific details from the text, object, or event to support your claims
• Analyze the example(s) using critical thinking skills and explain how they relate to your overall argument

VII. Conclusion

• Reiterate your thesis statement and summarize your main points
• Provide a final evaluation of the text, object, or event based on your analysis
• Offer recommendations for future research or further developments in the field
• End with a thought-provoking statement or question that encourages the reader to think more deeply about the topic

How to Write Critical Analysis

Writing a critical analysis involves evaluating and interpreting a text, such as a book, article, or film, and expressing your opinion about its quality and significance. Here are some steps you can follow to write a critical analysis:

• Read and re-read the text: Before you begin writing, make sure you have a good understanding of the text. Read it several times and take notes on the key points, themes, and arguments.
• Identify the author’s purpose and audience: Consider why the author wrote the text and who the intended audience is. This can help you evaluate whether the author achieved their goals and whether the text is effective in reaching its audience.
• Analyze the structure and style: Look at the organization of the text and the author’s writing style. Consider how these elements contribute to the overall meaning of the text.
• Evaluate the content : Analyze the author’s arguments, evidence, and conclusions. Consider whether they are logical, convincing, and supported by the evidence presented in the text.
• Consider the context: Think about the historical, cultural, and social context in which the text was written. This can help you understand the author’s perspective and the significance of the text.
• Develop your thesis statement : Based on your analysis, develop a clear and concise thesis statement that summarizes your overall evaluation of the text.
• Support your thesis: Use evidence from the text to support your thesis statement. This can include direct quotes, paraphrases, and examples from the text.
• Write the introduction, body, and conclusion : Organize your analysis into an introduction that provides context and presents your thesis, a body that presents your evidence and analysis, and a conclusion that summarizes your main points and restates your thesis.
• Revise and edit: After you have written your analysis, revise and edit it to ensure that your writing is clear, concise, and well-organized. Check for spelling and grammar errors, and make sure that your analysis is logically sound and supported by evidence.

When to Write Critical Analysis

You may want to write a critical analysis in the following situations:

• Academic Assignments: If you are a student, you may be assigned to write a critical analysis as a part of your coursework. This could include analyzing a piece of literature, a historical event, or a scientific paper.
• Journalism and Media: As a journalist or media person, you may need to write a critical analysis of current events, political speeches, or media coverage.
• Personal Interest: If you are interested in a particular topic, you may want to write a critical analysis to gain a deeper understanding of it. For example, you may want to analyze the themes and motifs in a novel or film that you enjoyed.
• Professional Development : Professionals such as writers, scholars, and researchers often write critical analyses to gain insights into their field of study or work.

Critical Analysis Example

An Example of Critical Analysis Could be as follow:

Research Topic:

The Impact of Online Learning on Student Performance

Introduction:

The introduction of the research topic is clear and provides an overview of the issue. However, it could benefit from providing more background information on the prevalence of online learning and its potential impact on student performance.

Literature Review:

The literature review is comprehensive and well-structured. It covers a broad range of studies that have examined the relationship between online learning and student performance. However, it could benefit from including more recent studies and providing a more critical analysis of the existing literature.

Research Methods:

The research methods are clearly described and appropriate for the research question. The study uses a quasi-experimental design to compare the performance of students who took an online course with those who took the same course in a traditional classroom setting. However, the study may benefit from using a randomized controlled trial design to reduce potential confounding factors.

The results are presented in a clear and concise manner. The study finds that students who took the online course performed similarly to those who took the traditional course. However, the study only measures performance on one course and may not be generalizable to other courses or contexts.

Discussion :

The discussion section provides a thorough analysis of the study’s findings. The authors acknowledge the limitations of the study and provide suggestions for future research. However, they could benefit from discussing potential mechanisms underlying the relationship between online learning and student performance.

Conclusion :

The conclusion summarizes the main findings of the study and provides some implications for future research and practice. However, it could benefit from providing more specific recommendations for implementing online learning programs in educational settings.

Purpose of Critical Analysis

There are several purposes of critical analysis, including:

• To identify and evaluate arguments : Critical analysis helps to identify the main arguments in a piece of writing or speech and evaluate their strengths and weaknesses. This enables the reader to form their own opinion and make informed decisions.
• To assess evidence : Critical analysis involves examining the evidence presented in a text or speech and evaluating its quality and relevance to the argument. This helps to determine the credibility of the claims being made.
• To recognize biases and assumptions : Critical analysis helps to identify any biases or assumptions that may be present in the argument, and evaluate how these affect the credibility of the argument.
• To develop critical thinking skills: Critical analysis helps to develop the ability to think critically, evaluate information objectively, and make reasoned judgments based on evidence.
• To improve communication skills: Critical analysis involves carefully reading and listening to information, evaluating it, and expressing one’s own opinion in a clear and concise manner. This helps to improve communication skills and the ability to express ideas effectively.

Importance of Critical Analysis

Here are some specific reasons why critical analysis is important:

• Helps to identify biases: Critical analysis helps individuals to recognize their own biases and assumptions, as well as the biases of others. By being aware of biases, individuals can better evaluate the credibility and reliability of information.
• Enhances problem-solving skills : Critical analysis encourages individuals to question assumptions and consider multiple perspectives, which can lead to creative problem-solving and innovation.
• Promotes better decision-making: By carefully evaluating evidence and arguments, critical analysis can help individuals make more informed and effective decisions.
• Facilitates understanding: Critical analysis helps individuals to understand complex issues and ideas by breaking them down into smaller parts and evaluating them separately.
• Fosters intellectual growth : Engaging in critical analysis challenges individuals to think deeply and critically, which can lead to intellectual growth and development.

Advantages of Critical Analysis

Some advantages of critical analysis include:

• Improved decision-making: Critical analysis helps individuals make informed decisions by evaluating all available information and considering various perspectives.
• Enhanced problem-solving skills : Critical analysis requires individuals to identify and analyze the root cause of a problem, which can help develop effective solutions.
• Increased creativity : Critical analysis encourages individuals to think outside the box and consider alternative solutions to problems, which can lead to more creative and innovative ideas.
• Improved communication : Critical analysis helps individuals communicate their ideas and opinions more effectively by providing logical and coherent arguments.
• Reduced bias: Critical analysis requires individuals to evaluate information objectively, which can help reduce personal biases and subjective opinions.
• Better understanding of complex issues : Critical analysis helps individuals to understand complex issues by breaking them down into smaller parts, examining each part and understanding how they fit together.
• Greater self-awareness: Critical analysis helps individuals to recognize their own biases, assumptions, and limitations, which can lead to personal growth and development.

About the author

Muhammad Hassan

Researcher, Academic Writer, Web developer

You may also like

Cluster Analysis – Types, Methods and Examples

Data Collection – Methods Types and Examples

Delimitations in Research – Types, Examples and...

Discriminant Analysis – Methods, Types and...

Research Process – Steps, Examples and Tips

Research Design – Types, Methods and Examples

Critical Analysis in Composition

Glossary of Grammatical and Rhetorical Terms

• An Introduction to Punctuation
• Ph.D., Rhetoric and English, University of Georgia
• M.A., Modern English and American Literature, University of Leicester
• B.A., English, State University of New York

In composition , critical analysis is a careful examination and evaluation of a text , image, or other work or performance.

Performing a critical analysis does not necessarily involve finding fault with a work. On the contrary, a thoughtful critical analysis may help us understand the interaction of the particular elements that contribute to a work's power and effectiveness. For this reason, critical analysis is a central component of academic training; the skill of critical analysis is most often thought of in the context of analyzing a work of art or literature, but the same techniques are useful to build an understanding of texts and resources in any discipline.

In this context, the word "critical" carries a different connotation than in vernacular, everyday speech. "Critical" here does not simply mean pointing out a work's flaws or arguing why it is objectionable by some standard. Instead, it points towards a close reading of that work to gather meaning, as well as to evaluate its merits. The evaluation is not the sole point of critical analysis, which is where it differs from the colloquial meaning of "criticize."

Examples of Critical Essays

• "Jack and Gill: A Mock Criticism" by Joseph Dennie
• "Miss Brill's Fragile Fantasy": A Critical Essay About Katherine Mansfield's Short Story "Miss Brill" and "Poor, Pitiful Miss Brill"
• "On the Knocking at the Gate in Macbeth " by Thomas De Quincey
• A Rhetorical Analysis of Claude McKay's "Africa"
• A Rhetorical Analysis of E B. White's Essay "The Ring of Time"
• A Rhetorical Analysis of U2's "Sunday Bloody Sunday"
• "Saloonio: A Study in Shakespearean Criticism" by Stephen Leacock
• Writing About Fiction: A Critical Essay on Hemingway's Novel The Sun Also Rises

Quotes About Critical Analysis

• " [C]ritical analysis involves breaking down an idea or a statement, such as a claim , and subjecting it to critical thinking in order to test its validity." (Eric Henderson, The Active Reader: Strategies for Academic Reading and Writing . Oxford University Press, 2007)​
• "To write an effective critical analysis, you need to understand the difference between analysis and summary . . . . [A] critical analysis looks beyond the surface of a text—it does far more than summarize a work. A critical analysis isn't simply dashing off a few words about the work in general." ( Why Write?: A Guide to BYU Honors Intensive Writing . Brigham Young University, 2006)
• "Although the main purpose of a critical analysis is not to persuade , you do have the responsibility of organizing a discussion that convinces readers that your analysis is astute." (Robert Frew et al., Survival: A Sequential Program for College Writing . Peek, 1985)

Critical Thinking and Research

"[I]n response to the challenge that a lack of time precludes good, critical analysis , we say that good, critical analysis saves time. How? By helping you be more efficient in terms of the information you gather. Starting from the premise that no practitioner can claim to collect all the available information, there must always be a degree of selection that takes place. By thinking analytically from the outset, you will be in a better position to 'know' which information to collect, which information is likely to be more or less significant and to be clearer about what questions you are seeking to answer." (David Wilkins and Godfred Boahen, Critical Analysis Skills For Social Workers . McGraw-Hill, 2013)

How to Read Text Critically

 "Being critical in academic enquiry means: - adopting an attitude of skepticism or reasoned doubt towards your own and others' knowledge in the field of enquiry . . . - habitually questioning the quality of your own and others' specific claims to knowledge about the field and the means by which these claims were generated; - scrutinizing claims to see how far they are convincing . . .; - respecting others as people at all times. Challenging others' work is acceptable, but challenging their worth as people is not; - being open-minded , willing to be convinced if scrutiny removes your doubts, or to remain unconvinced if it does not; - being constructive by putting your attitude of skepticism and your open-mindedness to work in attempting to achieve a worthwhile goal." (Mike Wallace and Louise Poulson, "Becoming a Critical Consumer of the Literature." Learning to Read Critically in Teaching and Learning , ed. by Louise Poulson and Mike Wallace. SAGE, 2004)

Critically Analyzing Persuasive Ads

"[I]n my first-year composition class, I teach a four-week advertisement analysis project as a way to not only heighten students' awareness of the advertisements they encounter and create on a daily basis but also to encourage students to actively engage in a discussion about critical analysis by examining rhetorical appeals in persuasive contexts. In other words, I ask students to pay closer attention to a part of the pop culture in which they live. " . . . Taken as a whole, my ad analysis project calls for several writing opportunities in which students write essays , responses, reflections, and peer assessments . In the four weeks, we spend a great deal of time discussing the images and texts that make up advertisements, and through writing about them, students are able to heighten their awareness of the cultural 'norms' and stereotypes which are represented and reproduced in this type of communication ." (Allison Smith, Trixie Smith, and Rebecca Bobbitt, Teaching in the Pop Culture Zone: Using Popular Culture in the Composition Classroom . Wadsworth Cengage, 2009)

Critically Analyzing Video Games

 "When dealing with a game's significance, one could analyze the themes of the game be they social, cultural, or even political messages. Most current reviews seem to focus on a game's success: why it is successful, how successful it will be, etc. Although this is an important aspect of what defines the game, it is not critical analysis . Furthermore, the reviewer should dedicate some to time to speaking about what the game has to contribute to its genre (Is it doing something new? Does it present the player with unusual choices? Can it set a new standard for what games of this type should include?)." (Mark Mullen, "On Second Thought . . ." Rhetoric/Composition/Play Through Video Games: Reshaping Theory and Practice , ed. by Richard Colby, Matthew S.S. Johnson, and Rebekah Shultz Colby. Palgrave Macmillan, 2013)

Critical Thinking and Visuals

 "The current critical turn in rhetoric and composition studies underscores the role of the visual, especially the image artifact, in agency. For instance, in Just Advocacy? a collection of essays focusing on the representation of women and children in international advocacy efforts, coeditors Wendy S. Hesford and Wendy Kozol open their introduction with a critical analysis of a documentary based on a picture: the photograph of an unknown Afghan girl taken by Steve McCurry and gracing the cover of National Geographic in 1985. Through an examination of the ideology of the photo's appeal as well as the 'politics of pity' circulating through the documentary, Hesford and Kozol emphasize the power of individual images to shape perceptions, beliefs, actions, and agency." (Kristie S. Fleckenstein, Vision, Rhetoric, and Social Action in the Composition Classroom . Southern Illinois University Press, 2010)

Related Concepts

• Analysis  and  Critical Essay
• Book Report
• Close Reading
• Critical Thinking
• Discourse Analysis
• Evaluation Essay
• Explication
• Problem-Solution
• Rhetorical Analysis
• Definition and Examples of Explication (Analysis)
• Rhetorical Analysis Definition and Examples
• Quotes About Close Reading
• How to Write a Critical Essay
• What Is a Critique in Composition?
• Definition and Examples of Analysis in Composition
• Definition and Examples of Evaluation Essays
• Understanding the Use of Language Through Discourse Analysis
• The Definition of a Review in Composition
• Audience Analysis in Speech and Composition
• Argument (Rhetoric and Composition)
• Holistic Grading (Composition)
• Persuasion and Rhetorical Definition
• A Writing Portfolio Can Help You Perfect Your Writing Skills
• A Rhetorical Analysis of U2's 'Sunday Bloody Sunday'
• Rhetoric: Definitions and Observations

Writing a Critical Analysis

What is in this guide, definitions, putting it together, tips and examples of critques.

• Background Information
• Cite Sources

Library Links

• Ask a Librarian
• Library Tutorials
• The Research Process
• Library Hours
• Online Databases (A-Z)
• Interlibrary Loan (ILL)
• Reserve a Study Room
• Report a Problem

This guide is meant to help you understand the basics of writing a critical analysis. A critical analysis is an argument about a particular piece of media. There are typically two parts: (1) identify and explain the argument the author is making, and (2), provide your own argument about that argument. Your instructor may have very specific requirements on how you are to write your critical analysis, so make sure you read your assignment carefully.

Critical Analysis

A deep approach to your understanding of a piece of media by relating new knowledge to what you already know.

Part 1: Introduction

• Identify the work being criticized.
• Present thesis - argument about the work.
• Preview your argument - what are the steps you will take to prove your argument.

Part 2: Summarize

• Provide a short summary of the work.
• Present only what is needed to know to understand your argument.

Part 3: Your Argument

• This is the bulk of your paper.
• Provide "sub-arguments" to prove your main argument.
• Use scholarly articles to back up your argument(s).

Part 4: Conclusion

• Reflect on  how  you have proven your argument.
• Point out the  importance  of your argument.
• Comment on the potential for further research or analysis.
• Cornell University Library Tips for writing a critical appraisal and analysis of a scholarly article.
• Queen's University Library How to Critique an Article (Psychology)
• University of Illinois, Springfield An example of a summary and an evaluation of a research article. This extended example shows the different ways a student can critique and write about an article
• Next: Background Information >>
• Last Updated: Feb 14, 2024 4:33 PM
• URL: https://libguides.pittcc.edu/critical_analysis

• LEARNING SKILLS
• Study Skills

Critical Analysis

Search SkillsYouNeed:

Learning Skills:

• A - Z List of Learning Skills
• What is Learning?
• Learning Approaches
• Learning Styles
• 8 Types of Learning Styles
• Understanding Your Preferences to Aid Learning
• Lifelong Learning
• Decisions to Make Before Applying to University
• Top Tips for Surviving Student Life
• Living Online: Education and Learning
• 8 Ways to Embrace Technology-Based Learning Approaches
• Critical Thinking Skills
• Critical Thinking and Fake News
• Understanding and Addressing Conspiracy Theories
• Top Tips for Study
• Staying Motivated When Studying
• Student Budgeting and Economic Skills
• Getting Organised for Study
• Finding Time to Study
• Sources of Information
• Assessing Internet Information
• Using Apps to Support Study
• What is Theory?
• Styles of Writing
• Effective Reading
• Critical Reading
• Note-Taking from Reading
• Note-Taking for Verbal Exchanges
• Planning an Essay
• How to Write an Essay
• The Do’s and Don’ts of Essay Writing
• How to Write a Report
• Academic Referencing
• Assignment Finishing Touches
• Reflecting on Marked Work
• 6 Skills You Learn in School That You Use in Real Life
• Top 10 Tips on How to Study While Working
• Exam Skills
• Writing a Dissertation or Thesis
• Research Methods
• Teaching, Coaching, Mentoring and Counselling
• Employability Skills for Graduates

Subscribe to our FREE newsletter and start improving your life in just 5 minutes a day.

You'll get our 5 free 'One Minute Life Skills' and our weekly newsletter.

We'll never share your email address and you can unsubscribe at any time.

Critical analysis is a formal evaluation of someone else’s work. In academia, this work is most often a book, article, poem, play or piece of visual art. However, in business, you might need to carry out a critical analysis of a proposal for a project or grant, a policy or white paper, an industry handbook or even a research study. Broadly speaking, critical analysis involves examining the work to see how well the author has carried out their purpose, or how well the project or policy will or does carry out its purpose.

Critical analysis is therefore an extension of both critical thinking and critical reading . Critical thinking is the ability to engage in reflective and independent thinking about the information that you encounter. Critical reading is engaging with what you read by asking yourself questions about the author’s intention and your reaction to that. Critical analysis is the formalisation of both these processes, coupled with a written analysis for others.

There are therefore two elements to critical analysis. The first is carrying out the analysis itself: deciding what you think. The second is writing up your findings and judgement for others.

Steps in a Critical Analysis

There are several steps that you need to take to carry out a critical analysis. These include:

1. Critical reading of your text or examination of your piece.

This is a matter of carefully reading your text, possibly several times.

As you do so, consider (and note down) what you think is important and relevant. It will also be helpful to note any controversial points, or areas where you disagree.

There is more about this process in our page on Critical Reading .

During this process, you should aim to identify the main thesis, point or purpose, and then sub-themes or issues.

In a piece of business writing or an essay, the purpose or thesis is usually set out early on, often in the introduction. In a piece of fiction writing, it may be necessary to read the text fully to identify themes and then highlight the most important theme.>

It is also worth taking note of any evidence that supports the themes and purpose.

Finally, it is worth writing yourself a one-paragraph summary of the text. This is likely to be a good starting point for your analysis, because your readers may not have read the text themselves.

2. Analysing the text or piece

The purpose of your analysis is to make an overall judgement about how well the text has met its objectives, based on the evidence available to you.

There are five useful aspects to consider in analysing the text or piece:

Your reaction to the text . This has two purposes. First, it affects how you approach the analysis. For example, if the ideas in the text make you angry, you will find it harder to see their benefits. Second, writers often want to evoke certain emotions in their audience. This is part of the purpose of the piece—and therefore assessing this issue is an important part of judging whether it has met its objectives.

The background to the text . It is worth considering the backdrop against which the text was written. For a policy paper, for example, what has gone before? How urgent is the need to address the situation? For a piece of creative writing, when was it written and what was happening in the world at the time? How might this have affected the way that the author was writing, or what they wanted to achieve?

The author’s background and the possible implications of this . The author’s background is likely to have informed their opinions and views—and therefore what they have written. It is worth considering the text in this light. This is part of the background, but specific enough to consider as a separate category.

The definitions and concepts in the text . Consider how well the author has defined concepts and ideas. It is much easier to assess ideas if they are clearly defined and described in simple language. Similarly, poor definitions may mean that the author is not clear about their own meaning, or that your understanding is different from theirs.

The use of evidence . You should consider the evidence presented in the text in two senses. First, examine its general validity and reliability. For example, in a proposal or paper, are the ideas supported by peer reviewed studies published in reputable journals? Second, you should consider how well the evidence supports the author’s points. It is also worth considering what evidence is NOT cited, but which might support or undermine the author’s points. It follows that you should also have evidence to support your own arguments in your analysis.

3. Writing up your analysis

The final stage of a critical analysis is to write up your analysis to present it to others.

The precise form that you use is likely to depend both on your preferences, and on any guidelines provided by your organisation or institution (see box).

TOP TIP! Check your guidelines

Your organisation or institution may have guidelines for carrying out a critical analysis. Check them carefully for the structure that you are expected to use, or any essential sections that must be included. For example, some organisations require a summary paragraph upfront (like an executive summary).

You are likely to need to include:

A brief summary of the text or proposal.

A brief summary of your assessment of the text . This should usually be structured around a main point or thesis against which you will consider various aspects of the text.

• For example, if you are analysing a business proposal, you might be concerned that the concepts are not defined very clearly, and that this may demonstrate that the author has not clearly understood the issues. Your main thesis is therefore this lack of clarity.

A more expanded version of  your analysis, with the evidence for each of your points . Again, this should be structured around your main thesis. It should also set your analysis in the wider context, including what else is known about the subject.

• The example from the previous bullet described concerns about the lack of clarity of definitions and therefore ambiguity. In this example, your expanded analysis would focus on areas that are not clear, and the problems that might arise from the ambiguity.

A conclusion that sums up your argument and reiterates your judgement on the text.

TOP TIP! You don’t have to write it in order—just sort it afterwards

It is often easier to prepare your introduction and conclusion once you have finished your analysis, and you are absolutely clear on the points you want to highlight.

It is also a good idea to use headings to show divisions between sections.

Summing Up Critical Analysis

Ultimately, critical analysis is about asking questions—and then setting the answers into context.

The most important questions are What, How, Why and So what? The answers will provide a clear and succinct critique of a text, project or idea, and allow you to form a judgement about the text.

Continue to: Critical Thinking and Fake News Analytical Skills

See also: Assessing Internet Information Styles of Writing Understanding and Addressing Conspiracy Theories

Chapter 6: Thinking and Analyzing Rhetorically

6.8 What is Critical Analysis

Julie A. Townsend

What is critical analysis?

Critical analysis is a term that students may hear often, especially as they progress through university courses and move into the twenty-first century workforce. Teachers and future employers want to see critical analysis applied in a variety of ways. Every context will have different ways that are standard for critical analysis of situations, data, and problems. Broadly, critical thinking is a way of looking at a situation that goes beyond first impressions and cliches. This section will describe specific techniques for critical analysis that can be used across different situations, especially for discovering more about writing and topics relevant to writing studies.

How can I do critical analysis?

William Thelin in Writing Without Formulas offers eight concrete ways to perform critical analysis: “interrogating the obvious,” “seeing patterns,” “finding what’s not there,” looking at “race, class, and gender,” “twisting the cliché,” “unearthing agendas,” and asking, “who profits?” (28—47). The following sections are originally derived from Thelin’s categories but are modified to better study writing in context, since many first-year writing classes at CSU following the “writing-about-writing” theme (as described by Downs and Wardle in “Teaching about writing, righting misconceptions”).

This chapter will work from an example scenario in which the writer aims to detail and understand the reading, writing, communication, and education that is taking place in one online asynchronous course. The writer’s originating research question is: What kinds of reading, writing, communication, and education takes place in this one asynchronous course? After the writer has written down their initial thoughts on the course and how communication works in the specific situation, they can use the following guidelines to write more and dig deeper into the context they are studying.

Detailing the Basics

Before the writer can use critical analysis, they need to clearly identify and describe details in the context. Details can help the writer more clearly understand the situation they are studying. Details are also necessary for readers to follow along with the critical analysis that the writer is performing.

Questions to help the writer detail the basics for studying communication in one asynchronous online course

• What did the instructor write?
• What are the students expected to write?
• Where, how, and why are they expected to write?
• How does communication between students occur?
• What about communication with the teacher?
• How is the course organized?
• What kinds of resources are used in the course?
• Are students expected to read every word on the course page? What words are they required to read?
• What kinds of external documents does the teacher expect students to use?

When the writer begins critical analysis with details of the basic situation, nothing is too mundane or obvious to skip over in the writing process. Specific details help the context come to life for both the writer and the readers. Writers should aim to draw a living picture of the situation. Then, from that living picture, the writer can work to analyze the situation in a more complete manner using the following suggestions.

Look for clusters, patterns, and coordination

After the writer has a drawn a clear picture for themselves and for the reader of what kinds of reading, writing, and communication are going on in the context they are describing, they can look for connections and links among these texts, resources, and people.

• A cluster includes technologies, people, texts, or ideas that exist near one another in a situation.
• o Clusters and patterns can help writers see the relationships between different elements and can help the writer see and understand a situation differently.
• o Coordination can help the writer see how separate acts of reading, writing, and communication work together to complete larger tasks.

Questions to help the writer find clusters, patterns, and coordination while studying communication in one asynchronous online course

• How does the student in the course group together texts to perform a task?
• Has the instructor supplied readings that the students need to write about?
• How does the student use assigned texts (possibly with other texts or technologies) in their writing process?
• What about external texts that the student needs to gather? How do those texts work into their writing process?
• Are certain texts often grouped together in the instruction or writing process?
• What kinds of resources do students tie together to complete assignments?
•  How do technologies outside of the course (like using social media or messaging classmates) work in conjunction with other texts and resources when the student is completing course work?

A deeper look at coordination

In writing studies, researchers can look for how texts are used in coordination with one another to learn more about the writing process and to describe how exactly people write and get work done. The concept of textual coordination (Slattery, “Technical writing as textual coordination”; Pigg, “Coordinating constant invention”) helps researchers to better understand how writers use resources (from computer programs to emails to syllabi to dictionaries) to write.

For research writing especially, writers tend to have multiple tabs or windows open on their computers with articles, websites, and the word processor they are using. The tying together of these resources by the writer is textual coordination. According to Shaun Slattery in “Undistributing Work through Writing”, the study of textual coordination emerged from researchers looking into how distributed work takes place in environments that are often mediated by computers (313). Many twenty-first century knowledge-working careers use a model of distributed work and rely on “the ability to identify, rearrange, circulate, abstract, and broker information” (Johnson-Eilola qtd. on Slattery 312). While most first-year writers may not have much career experience in knowledge working, they do have experience tying together resources and technologies. For example: reading a homework assignment and taking notes in a separate document and then using those texts in an essay is an example of textual coordination.

Looking through the lens of intersectionality

This section is borrowed (using Creative Commons Licensing) from “Unit I: An Introduction to Women, Gender, and Sexuality Studies” in the open-education resource textbook An Introduction to Women, Gender, and Sexuality Studies . “Within intersectional frameworks, race, class, gender, sexuality, age, ability, and other aspects of identity are considered mutually constitutive; that is, people experience these multiple aspects of identity simultaneously and the meanings of different aspects of identity are shaped by one another. In other words, notions of gender and the way a person’s gender is interpreted by others are always impacted by notions of race and the way that person’s race is interpreted. For example, a person is never received as just a woman, but how that person is racialized impacts how the person is received as a woman. So, notions of blackness, brownness, and whiteness always influence gendered experience, and there is no experience of gender that is outside of an experience of race. In addition to race, gendered experience is also shaped by age, sexuality, class, and ability; likewise, the experience of race is impacted by gender, age, class, sexuality, and ability.” For more information on intersectionality, read more in their chapter and textbook .

By asking questions about race, class, gender, ability, sexuality, and the intersections between these categories, writers can perform more critical analysis.

Questions to help the writer perform analysis with intersectional lenses while studying communication in one asynchronous online course

• What is the race, class, gender, sexuality, and ability of the authors of the readings we are assigned? How do these categories intersect in the lives of the authors?
• Do the statistics of the authors assigned for students to read match with the demographics of experts in the field?
• How are race, class, gender, ability, and sexuality distributed in the field overall?
• If there are inequalities in the demographics of professionals in the field, are there initiatives that work towards inviting more diversity into the field?
• What kinds of reading, writing, and communication are missing or different from similar contexts?
• Could resources be added to enhance communication, representation, understanding, or ease of access? What would those resources be?

What could be added?

In this stage of analysis, the writer should take a few steps back from the details of the context they are studying so that they might be able to see what could be added to the environment they are studying . The writer could compare the context they are studying to other contexts to help see what might be missing.

Questions to help the writer perform analysis on what could be added?

If the writer is performing critical analysis in a context where the previously discussed categories might not apply, “What is Critical Analysis?” by The University of Bradford offers a broad framework for critical analysis that can be applied beyond topics relevant to writing, reading, and communication. The University of Bradford describes critical analysis as part of the process that includes: “description,” “analysis,” and “evaluation” (2). For description, it suggests that writers focus on answering questions starting with “what”, “where”, “who”, and “when” (2). For the analysis stage, it suggests answering “how”, “why”, and “what if?” (2). Evaluation includes “so what?” and “what next?” Writers can use the categories outlined here to perform critical analysis that adds depth, texture, and details to thoughts and observations.

Works Cited

Downs, Douglas, and Elizabeth Wardle. “Teaching about writing, righting misconceptions:(Re)envisioning” first-year composition” as” Introduction to Writing Studies”.”  College composition and communication  (2007): 552-584.

Kang, Miliann, Donovan Lessard, Laura Heston, and Sonny Nordmarken. Introduction to Women, Gender, and Sexuality Studies . UMassAmherst Libraries, Pressbooks.

Pigg, Stacey. “Coordinating constant invention: Social media’s role in distributed work.” Technical Communication Quarterly 23.2 (2014): 69-87.

Slattery, Shaun. “Technical writing as textual coordination: An argument for the value of writers’ skill with information technology.” Technical Communication 52.3 (2005): 353.

Slattery, Shaun. “Undistributing work through writing: How technical writers manage texts in complex information environments.” Technical Communication Quarterly 16.3 (2007):    311-325.

Thelin, William. Writing Without Formulas. Second edition. Cengage, 2009. “What is Critical Analysis?” Academic Skills Advice. The University of Bradford. Accessed 17 October 2019.

A Guide to Rhetoric, Genre, and Success in First-Year Writing by Julie A. Townsend is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License , except where otherwise noted.

Feedback/Errata

Comments are closed.

Critically Analyzing Information Sources: Critical Appraisal and Analysis

• Critical Appraisal and Analysis

Initial Appraisal : Reviewing the source

• What are the author's credentials--institutional affiliation (where he or she works), educational background, past writings, or experience? Is the book or article written on a topic in the author's area of expertise? You can use the various Who's Who publications for the U.S. and other countries and for specific subjects and the biographical information located in the publication itself to help determine the author's affiliation and credentials.
• Has your instructor mentioned this author? Have you seen the author's name cited in other sources or bibliographies? Respected authors are cited frequently by other scholars. For this reason, always note those names that appear in many different sources.
• Is the author associated with a reputable institution or organization? What are the basic values or goals of the organization or institution?

B. Date of Publication

• When was the source published? This date is often located on the face of the title page below the name of the publisher. If it is not there, look for the copyright date on the reverse of the title page. On Web pages, the date of the last revision is usually at the bottom of the home page, sometimes every page.
• Is the source current or out-of-date for your topic? Topic areas of continuing and rapid development, such as the sciences, demand more current information. On the other hand, topics in the humanities often require material that was written many years ago. At the other extreme, some news sources on the Web now note the hour and minute that articles are posted on their site.

C. Edition or Revision

Is this a first edition of this publication or not? Further editions indicate a source has been revised and updated to reflect changes in knowledge, include omissions, and harmonize with its intended reader's needs. Also, many printings or editions may indicate that the work has become a standard source in the area and is reliable. If you are using a Web source, do the pages indicate revision dates?

D. Publisher

Note the publisher. If the source is published by a university press, it is likely to be scholarly. Although the fact that the publisher is reputable does not necessarily guarantee quality, it does show that the publisher may have high regard for the source being published.

E. Title of Journal

Is this a scholarly or a popular journal? This distinction is important because it indicates different levels of complexity in conveying ideas. If you need help in determining the type of journal, see Distinguishing Scholarly from Non-Scholarly Periodicals . Or you may wish to check your journal title in the latest edition of Katz's Magazines for Libraries (Olin Reference Z 6941 .K21, shelved at the reference desk) for a brief evaluative description.

Critical Analysis of the Content

Having made an initial appraisal, you should now examine the body of the source. Read the preface to determine the author's intentions for the book. Scan the table of contents and the index to get a broad overview of the material it covers. Note whether bibliographies are included. Read the chapters that specifically address your topic. Reading the article abstract and scanning the table of contents of a journal or magazine issue is also useful. As with books, the presence and quality of a bibliography at the end of the article may reflect the care with which the authors have prepared their work.

A. Intended Audience

What type of audience is the author addressing? Is the publication aimed at a specialized or a general audience? Is this source too elementary, too technical, too advanced, or just right for your needs?

B. Objective Reasoning

• Is the information covered fact, opinion, or propaganda? It is not always easy to separate fact from opinion. Facts can usually be verified; opinions, though they may be based on factual information, evolve from the interpretation of facts. Skilled writers can make you think their interpretations are facts.
• Does the information appear to be valid and well-researched, or is it questionable and unsupported by evidence? Assumptions should be reasonable. Note errors or omissions.
• Are the ideas and arguments advanced more or less in line with other works you have read on the same topic? The more radically an author departs from the views of others in the same field, the more carefully and critically you should scrutinize his or her ideas.
• Is the author's point of view objective and impartial? Is the language free of emotion-arousing words and bias?

C. Coverage

• Does the work update other sources, substantiate other materials you have read, or add new information? Does it extensively or marginally cover your topic? You should explore enough sources to obtain a variety of viewpoints.
• Is the material primary or secondary in nature? Primary sources are the raw material of the research process. Secondary sources are based on primary sources. For example, if you were researching Konrad Adenauer's role in rebuilding West Germany after World War II, Adenauer's own writings would be one of many primary sources available on this topic. Others might include relevant government documents and contemporary German newspaper articles. Scholars use this primary material to help generate historical interpretations--a secondary source. Books, encyclopedia articles, and scholarly journal articles about Adenauer's role are considered secondary sources. In the sciences, journal articles and conference proceedings written by experimenters reporting the results of their research are primary documents. Choose both primary and secondary sources when you have the opportunity.

D. Writing Style

Is the publication organized logically? Are the main points clearly presented? Do you find the text easy to read, or is it stilted or choppy? Is the author's argument repetitive?

E. Evaluative Reviews

• Locate critical reviews of books in a reviewing source , such as the Articles & Full Text , Book Review Index , Book Review Digest, and ProQuest Research Library . Is the review positive? Is the book under review considered a valuable contribution to the field? Does the reviewer mention other books that might be better? If so, locate these sources for more information on your topic.
• Do the various reviewers agree on the value or attributes of the book or has it aroused controversy among the critics?
• For Web sites, consider consulting this evaluation source from UC Berkeley .

Permissions Information

If you wish to use or adapt any or all of the content of this Guide go to Cornell Library's Research Guides Use Conditions to review our use permissions and our Creative Commons license.

• Next: Tips >>
• Last Updated: Apr 18, 2022 1:43 PM
• URL: https://guides.library.cornell.edu/critically_analyzing

• Cambridge Libraries

Study Skills

Critical analysis: home.

• Reading Critically

What is Critical Analysis?

Analysis is a word that is also often used when taking a critical approach to something. It could be that you look at some evidence and if you think it is good quality, you may choose to include that in your essay or writing to help support your argument. When you have analysed different sets of evidence you may  synthesize all the ideas gathered from multiple sources bringing together the relevant information into a different argument or idea. 

To evaluate something or someone, you think and consider it or them in order to make a judgment about it/them; this could be as simple as how good or bad they are. When you critically evaluate something or someone you consider how judgments vary from different perspectives and how some judgments are stronger than others. This often means creating an objective, reasoned argument for your overall case, based on the evaluation from different perspectives.

Taking a critical approach when you are studying involves constantly asking questions and keeping an open mind.

• Next: Reading Critically >>
• Last Updated: Aug 9, 2023 11:57 AM
• URL: https://libguides.cam.ac.uk/criticalanalysis

© Cambridge University Libraries | Accessibility | Privacy policy | Log into LibApps

Writing Academically

Proofreading, other editing & coaching for highly successful academic writing

• Editing & coaching pricing
• Academic coaching
• How to conduct a targeted literature search

How to write a successful critical analysis

• How to write a strong literature review
• Cautious in tone
• Formal English
• Precise and concise English
• Impartial and objective English
• Substantiate your claims
• The academic team

For further queries or assistance in writing a critical analysis email Bill Wrigley .

What do you critically analyse?

In a critical analysis you do not express your own opinion or views on the topic. You need to develop your thesis, position or stance on the topic from the views and research of others . In academic writing you critically analyse other researchers’:

• concepts, terms
• viewpoints, arguments, positions
• methodologies, approaches
• research results and conclusions

This means weighing up the strength of the arguments or research support on the topic, and deciding who or what has the more or stronger weight of evidence or support.

Therefore, your thesis argues, with evidence, why a particular theory, concept, viewpoint, methodology, or research result(s) is/are stronger, more sound, or more advantageous than others.

What does ‘analysis’ mean?

A critical analysis means analysing or breaking down the parts of the literature and grouping these into themes, patterns or trends.

In an analysis you need to:

1. Identify and separate out the parts of the topic by grouping the various key theories, main concepts, the main arguments or ideas, and the key research results and conclusions on the topic into themes, patterns or trends of agreement , dispute and omission .

2. Discuss each of these parts by explaining:

i. the areas of agreement/consensus, or similarity

ii. the issues or controversies: in dispute or debate, areas of difference

ii. the omissions, gaps, or areas that are under-researched

3. Discuss the relationship between these parts

4. Examine how each contributes to the whole topic

5. Make conclusions about their significance or importance in the topic

What does ‘critical’ mean?

A critical analysis does not mean writing angry, rude or disrespectful comments, or  expressing your views in judgmental terms of black and white, good and bad, or right and wrong.

To be critical, or to critique, means to evaluate . Therefore, to write critically in an academic analysis means to:

• judge the quality, significance or worth of the theories, concepts, viewpoints, methodologies, and research results
• evaluate in a fair and balanced manner
• avoid extreme or emotional language

• strengths, advantages, benefits, gains, or improvements
• disadvantages, weaknesses, shortcomings, limitations, or drawbacks

How to critically analyse a theory, model or framework

The evaluative words used most often to refer to theory, model or framework are a sound theory or a strong theory.

The table below summarizes the criteria for judging the strengths and weaknesses of a theory:

• comprehensive
• empirically supported
• parsimonious

Evaluating a Theory, Model or Framework

The table below lists the criteria for the strengths and their corresponding weaknesses that are usually considered in a theory.

Critical analysis examples of theories

The following sentences are examples of the phrases used to explain strengths and weaknesses.

Smith’s (2005) theory appears up to date, practical and applicable across many divergent settings.

Brown’s (2010) theory, although parsimonious and logical, lacks a sufficient body of evidence to support its propositions and predictions

Little scientific evidence has been presented to support the premises of this theory.

One of the limitations with this theory is that it does not explain why…

A significant strength of this model is that it takes into account …

The propositions of this model appear unambiguous and logical.

A key problem with this framework is the conceptual inconsistency between ….

How to critically analyse a concept

The table below summarizes the criteria for judging the strengths and weaknesses of a concept:

• key variables identified
• clear and well-defined

Evaluating Concepts

Critical analysis examples of concepts

Many researchers have used the concept of control in different ways.

There is little consensus about what constitutes automaticity.

Putting forth a very general definition of motivation means that it is possible that any behaviour could be included.

The concept of global education lacks clarity, is imprecisely defined and is overly complex.

Some have questioned the usefulness of resilience as a concept because it has been used so often and in so many contexts.

Research suggests that the concept of preoperative fasting is an outdated clinical approach.

How to critically analyse arguments, viewpoints or ideas

The table below summarizes the criteria for judging the strengths and weaknesses of an argument, viewpoint or idea:

• reasons support the argument
• argument is substantiated by evidence
• evidence for the argument is relevant
• evidence for the argument is unbiased, sufficient and important
• evidence is reputable

Evaluating Arguments, Views or Ideas

Critical analysis examples of arguments, viewpoints or ideas

The validity of this argument is questionable as there is insufficient evidence to support it.

Many writers have challenged Jones’ claim on the grounds that …….

This argument fails to draw on the evidence of others in the field.

This explanation is incomplete because it does not explain why…

The key problem with this explanation is that ……


The existing accounts fail to resolve the contradiction between …

However, there is an inconsistency with this argument. The inconsistency lies in…

Although this argument has been proposed by some, it lacks justification.

However, the body of evidence showing that… contradicts this argument.

How to critically analyse a methodology

The table below provides the criteria for judging the strengths and weaknesses of methodology.

An evaluation of a methodology usually involves a critical analysis of its main sections:

design; sampling (participants); measurement tools and materials; procedure

• design tests the hypotheses or research questions
• method valid and reliable
• potential bias or measurement error, and confounding variables addressed
• method allows results to be generalized
• representative sampling of cohort and phenomena; sufficient response rate
• valid and reliable measurement tools
• valid and reliable procedure
• method clear and detailed to allow replication

Evaluating a Methodology

Critical analysis examples of a methodology

The unrepresentativeness of the sample makes these results misleading.

The presence of unmeasured variables in this study limits the interpretation of the results.

Other, unmeasured confounding variables may be influencing this association.

The interpretation of the data requires caution because the effect of confounding variables was not taken into account.

The insufficient control of several response biases in this study means the results are likely to be unreliable.

Although this correlational study shows association between the variables, it does not establish a causal relationship.

Taken together, the methodological shortcomings of this study suggest the need for serious caution in the meaningful interpretation of the study’s results.

How to critically analyse research results and conclusions

The table below provides the criteria for judging the strengths and weaknesses of research results and conclusions:

• appropriate choice and use of statistics
• correct interpretation of results
• all results explained
• alternative explanations considered
• significance of all results discussed
• consistency of results with previous research discussed
• results add to existing understanding or knowledge
• limitations discussed
• results clearly explained
• conclusions consistent with results

Evaluating the Results and Conclusions

Leave a Reply

Click here to cancel reply.

You must be logged in to post a comment.

WRITING FORMATS FOR EDITING OR COACHING

• Essay or assignment
• Thesis or dissertation
• Proposal for PhD or Masters research
• Literature review
• Journal article or book chapter
• IELTS writing tasks 1 & 2 for general and academic writing
• Resumes & cover letters
• Presentations
• Applications & submissions

Do you have a question?

• Academic writing skills
• Academic English skills
• The Academic team
• Privacy policy
• Terms and conditions
• ABN: 15796080518
• 66 Mungarie Street, Keperra, Qld 4054 Australia
• Email: [email protected]

Website design and development by Caboodle Web

Critical Analysis

A critical analysis involves analysis and judgment. like a film review, that both deconstructs a film and tells us whether we should see it., what is critical analysis.

Critical analysis is a type of analysis. An important distinction between a typical analysis and a critical analysis is that critical analysis requires you to take a stance on the thing you're analyzing—you present an argument, backed by the analysis you’ve done, to judge (or recommend, or critique) the work.

For example, if you're analyzing a film's theme, you might examine certain scenes and snippets of dialogue to explain how they further the film's message.

A critical analysis goes one step further—you'll also makes a judgement about that them, about whether it's "good" or "ethical," "well-developed" or "effective." You might say something about the impact it should have or whether audiences should see the film or skip it.

• Analysis = Examine a "thing" to understand how it functions.
• Critical Analysis = Examine a thing to understand how it functions and make a judgement about its impact or value.

So Where Do I Start?

One common place to start is to examine your subject closely—say, a book, an artwork, or a play—and decide what effect it has on you or on other people who experience it.

• Does it give you a certain feeling?
• Does it offer you information?
• Does it send a message?
• Does it try to persuade you to do something?
• Is it moral?
• Is it unethical?
• Is it beautiful and well-constructed?
• Is it worthwhile?
• What consequence might it have on its peers? On consumers? Is that a good thing or a bad thing?

Any one of these questions can help you formulate your critical claim, the thesis you'll ultimately try to argue.

• Example: "Schindler's List is a good film because it offers a profound and terrifying reminder of the dangers of complacency and racism."

Reminder: criticism can be subjective, especially when it involves your perception and interpretation. Not everyone agrees with every film critic, and that's okay. A critical analysis gives us a window into how you consume, experience, perceive, and value whatever it is you're analyzing, which then, hopefully, elevates our appreciation and understanding of the thing itself.

Reminder about Analysis

Since any critical analysis is an argument, it’s important to explain how and why you got to your conclusions. This is where analysis comes in.

Analysis is the process of breaking something into its parts and examining them to understand their function. For instance, for the thesis of a critical analysis on a film, you might say, “this film effectively portrayed the boredom of office life with its use of bleak gray colors, droning soundtrack, and dryly funny dialogue.”

Here, the colors, soundtrack, and dialogue are all parts of the film, and you’re making a claim about the effect they have. In the rest of the paper you’ll describe and explain this effect, using evidence from the film to make your connections. This requires you to clearly explain how and why bleak colors or a droning soundtrack actually do, in fact, portray the boredom of office life. If not, you're simply making claims and hoping your audience trusts you. Without analysis, you have no evidence.

To recap, critically analyzing something means identifying its value or impact, then breaking down its components to explain how and why those components contribute to value or impact you identified.

Doing so will allow you to better understand that specific thing, and allow you to contribute meaningfully to the conversation surrounding the thing itself.

Barbie: Critical Analysis

Click here for article!

Short Review on Analysis

Longer Dive into Analysis

Are you ready to chat with us about critical analysis? Consider these questions to help you in your consultation:

• Have I clearly identified a “whole”?
• Have I clearly outlined the “parts” that make up the whole?
• Have I clearly explained how each part “functions” in connection to the whole? Does my writing clearly show why that part matters, and

Check out these additional Resources!

• This YouTube video on critical analysis assignments

BibGuru Blog

Be more productive in school

• Citation Styles

How to write a critical analysis

Unlike the name implies a critical analysis does not necessarily mean that you are only exploring what is wrong with a piece of work. Instead, the purpose of this type of essay is to interact with and understand a text. Here’s what you need to know to create a well-written critical analysis essay.

What is a critical analysis?

A critical analysis examines and evaluates someone else’s work, such as a book, an essay, or an article. It requires two steps: a careful reading of the work and thoughtful analysis of the information presented in the work.

Although this may sound complicated, all you are doing in a critical essay is closely reading an author’s work and providing your opinion on how well the author accomplished their purpose.

Critical analyses are most frequently done in academic settings (such as a class assignment). Writing a critical analysis demonstrates that you are able to read a text and think deeply about it. However, critical thinking skills are vital outside of an educational context as well. You just don’t always have to demonstrate them in essay form.

How to outline and write a critical analysis essay

Writing a critical analysis essay involves two main chunks of work: reading the text you are going to write about and writing an analysis of that text. Both are equally important when writing a critical analysis essay.

Step one: Reading critically

The first step in writing a critical analysis is to carefully study the source you plan to analyze.

If you are writing for a class assignment, your professor may have already given you the topic to analyze in an article, short story, book, or other work. If so, you can focus your note-taking on that topic while reading.

Other times, you may have to develop your own topic to analyze within a piece of work. In this case, you should focus on a few key areas as you read:

• What is the author’s intended purpose for the work?
• What techniques and language does the author use to achieve this purpose?
• How does the author support the thesis?
• Who is the author writing for?
• Is the author effective at achieving the intended purpose?

Once you have carefully examined the source material, then you are ready to begin planning your critical analysis essay.

Step two: Writing the critical analysis essay

Taking time to organize your ideas before you begin writing can shorten the amount of time that you spend working on your critical analysis essay. As an added bonus, the quality of your essay will likely be higher if you have a plan before writing.

Here’s a rough outline of what should be in your essay. Of course, if your instructor gives you a sample essay or outline, refer to the sample first.

• Background Information

Critical Analysis

Here is some additional information on what needs to go into each section:

Background information

In the first paragraph of your essay, include background information on the material that you are critiquing. Include context that helps the reader understand the piece you are analyzing. Be sure to include the title of the piece, the author’s name, and information about when and where it was published.

“Success is counted sweetest” is a poem by Emily Dickinson published in 1864. Dickinson was not widely known as a poet during her lifetime, and this poem is one of the first published while she was alive.

After you have provided background information, state your thesis. The thesis should be your reaction to the work. It also lets your reader know what to expect from the rest of your essay. The points you make in the critical analysis should support the thesis.

Dickinson’s use of metaphor in the poem is unexpected but works well to convey the paradoxical theme that success is most valued by those who never experience success.

The next section should include a summary of the work that you are analyzing. Do not assume that the reader is familiar with the source material. Your summary should show that you understood the text, but it should not include the arguments that you will discuss later in the essay.

Dickinson introduces the theme of success in the first line of the poem. She begins by comparing success to nectar. Then, she uses the extended metaphor of a battle in order to demonstrate that the winner has less understanding of success than the loser.

The next paragraphs will contain your critical analysis. Use as many paragraphs as necessary to support your thesis.

Discuss the areas that you took notes on as you were reading. While a critical analysis should include your opinion, it needs to have evidence from the source material in order to be credible to readers. Be sure to use textual evidence to support your claims, and remember to explain your reasoning.

Dickinson’s comparison of success to nectar seems strange at first. However the first line “success is counted sweetest” brings to mind that this nectar could be bees searching for nectar to make honey. In this first stanza, Dickinson seems to imply that success requires work because bees are usually considered to be hard-working and industrious.

In the next two stanzas, Dickinson expands on the meaning of success. This time she uses the image of a victorious army and a dying man on the vanquished side. Now the idea of success is more than something you value because you have worked hard for it. Dickinson states that the dying man values success even more than the victors because he has given everything and still has not achieved success.

This last section is where you remind the readers of your thesis and make closing remarks to wrap up your essay. Avoid summarizing the main points of your critical analysis unless your essay is so long that readers might have forgotten parts of it.

In “Success is counted sweetest” Dickinson cleverly upends the reader’s usual thoughts about success through her unexpected use of metaphors. The poem may be short, but Dickinson conveys a serious theme in just a few carefully chosen words.

What type of language should be used in a critical analysis essay?

Because critical analysis papers are written in an academic setting, you should use formal language, which means:

• No contractions
• Avoid first-person pronouns (I, we, me)

Do not include phrases such as “in my opinion” or “I think”. In a critical analysis, the reader already assumes that the claims are your opinions.

Your instructor may have specific guidelines for the writing style to use. If the instructor assigns a style guide for the class, be sure to use the guidelines in the style manual in your writing.

Additional t ips for writing a critical analysis essay

To conclude this article, here are some additional tips for writing a critical analysis essay:

• Give yourself plenty of time to read the source material. If you have time, read through the text once to get the gist and a second time to take notes.
• Outlining your essay can help you save time. You don’t have to stick exactly to the outline though. You can change it as needed once you start writing.
• Spend the bulk of your writing time working on your thesis and critical analysis. The introduction and conclusion are important, but these sections cannot make up for a weak thesis or critical analysis.
• Give yourself time between your first draft and your second draft. A day or two away from your essay can make it easier to see what you need to improve.

Frequently Asked Questions about critical analyses

In the introduction of a critical analysis essay, you should give background information on the source that you are analyzing. Be sure to include the author’s name and the title of the work. Your thesis normally goes in the introduction as well.

A critical analysis has four main parts.

• Introduction

The focus of a critical analysis should be on the work being analyzed rather than on you. This means that you should avoid using first person unless your instructor tells you to do otherwise. Most formal academic writing is written in third person.

How many paragraphs your critical analysis should have depends on the assignment and will most likely be determined by your instructor. However, in general, your critical analysis paper should have three to six paragraphs, unless otherwise stated.

Your critical analysis ends with your conclusion. You should restate the thesis and make closing remarks, but avoid summarizing the main points of your critical analysis unless your essay is so long that readers might have forgotten parts of it.

Make your life easier with our productivity and writing resources.

For students and teachers.

An Introduction to Critical Approaches

• First Online: 29 September 2022

Cite this chapter

• Robert E. White   ORCID: orcid.org/0000-0002-8045-164X 3 &
• Karyn Cooper 4  

1259 Accesses

As can be understood from the previous chapter, in qualitative research, words are used as data rather than numerical representations (Miles & Huberman, 1994). All qualitative methods rely on linguistic information rather than on statistical evidence. As such, they tend to employ meaning-based (as opposed to numerical-based) data analysis (Polkinghorne, 1983). Thus, qualitative research utilizes data in the form of text, which, in turn, serves to furnish a detailed analysis of a situation, a case, a subject or an event through original analysis (Creswell, 2013). In qualitative research, data is usually collected and analyzed on fewer participants and situations (Patton, 2014) than is commonly found in quantitative research practices. The previous chapter introduced a short history of qualitative research as it relates to quantitative research endeavours. The current chapter devotes itself to a discussion of a number of approaches to qualitative research, specifically the critical approach.

The reliance on personal experience is the main building block, the main distinction of qualitative research. Not so much feelings, not so much how do we feel about things, but what is the experience as felt, as told, as manifest in the things that we do. Robert Stake, University of Illinois, Urbana-Champaign.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

• Available as PDF
• Read on any device
• Instant download
• Own it forever
• Available as EPUB and PDF
• Compact, lightweight edition
• Dispatched in 3 to 5 business days
• Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Blumer, H. (1969). Symbolic interactionism: Perspective and method . University of California Press.

Google Scholar  

Butler, T. (1998). Towards a hermeneutic method for interpretive research in information systems. Journal of Information Technology, 13 (4), 285–300.

Article   Google Scholar  

Collins, H. (2010). Creative research: The theory and practice of research for the creative industries . AVA Publications.

Comte, A. (1908). A general view of positivism (Trans. J. A. Bridges). Routledge.

Cooper, K., & White, R. E. (2012). Qualitative research in the post-modern era: Contexts of qualitative research . Springer.

Book   Google Scholar  

Creswell, J. W. (2013). Research design: Qualitative, quantitative, and mixed methods approaches (4th ed.). Sage.

Crossman, A. (2017). What is positivism in sociology? Background and theory of positivism . Retrieved October 25, 2017 from https://www.thoughtco.com/positivism-sociology-3026456

Fairclough, N. (2010). Critical discourse analysis: The critical study of language . Prentice Hall.

Feyerabend, P. (1975). Against method: Outline of an anarchistic theory of knowledge . New Left Books.

Goldkuhl, G. (2012). Pragmatism vs. interpretivism in qualitative information systems research. European Journal of Information Systems, 21 (2), 135–146.

Henning, E., Van Rensburg, W., & Smit, B. (2004). Finding your way in qualitative research . Van Schaik Publishers.

Horgan, J. (1993). Profile: Paul Karl Feyerabend—The worst enemy of science. Scientific American, 268 (5), 36–37.

Krippendorff, K. H. (2003). Content analysis: An introduction to its methodology . Sage.

Marx, K. (1867/2012). Das kapital: A critique of political economy . Regnery Publishing.

Miles, M. B., & Huberman, M. A. (1994). Qualitative data analysis: An expanded source book (2nd ed.). Sage.

Myers, M., & Avison, D. (2002). An introduction to qualitative research in information systems. In M. Myers & D. Avison (Eds.), Qualitative research in information systems: A reader . Sage.

Chapter   Google Scholar  

Ong, Y. S. (2016). Reexamining education research methodologies—Collaborative rather than competitive. Bulgarian Journal of Science & Education Policy, 10 (1), 124–141.

Orbe, M. P., & Kinefuchi, E. (2008). Crash under investigation: Engaging complications of complicity, coherence, and implicature through critical analysis. Critical Studies in Media Communication, 25 (2), 135–156. https://doi.org/10.1080/15295030802032275

Orlikowski, W. J., & Baroudi, J. J. (1991). Studying information technology in organizations: Research approaches and assumptions. Information Systems Research, 2 (1), 1–28.

Patton, M. Q. (2014). Qualitative research & evaluation methods: Integrating theory & practice (4th ed.). Sage.

Polkinghorne, D. (1983). Methodology for the human sciences . Human Sciences Press.

Popper, K. R. (1979). Objective knowledge: An evolutionary approach . Oxford University Press.

Shusterman, R. (2004). Pragmatism and East-Asian thought. Metaphilosophy, 35 (1/2), 13–43.

Thomas, V. G., & Madison, A. (2010). Integration of social justice into the teaching of evaluation. American Journal of Evaluation, 31 (4), 570–583. https://doi.org/10.1177/1098214010368426

Trauth, E. M. (Ed.). (2001). Qualitative research in IS: Issues and trends . Idea Group.

Willis, J. W. (2007). Foundations of qualitative research: Interpretive and critical approaches . Sage.

Wilson, W. J. (1987). The truly disadvantaged: The inner city, the underclass, and public policy . University of Chicago Press.

Download references

Author information

Authors and affiliations.

Faculty of Education, St. Francis Xavier University, Antigonish, NS, Canada

Robert E. White

OISE, University of Toronto, Toronto, ON, Canada

Karyn Cooper

You can also search for this author in PubMed   Google Scholar

Corresponding author

Correspondence to Robert E. White .

Transformative Potentials of Critical Educational Inquiry

Emma Simmons

The foundational questions to critical work are: Who/what is helped/privileged/legitimated? Who/what is harmed/oppressed/disqualified?

(Cannella & Lincoln, 2009, p. 54)

Critical inquiry has been criticized for creating illusions of justice and being unable to transform the situations of the oppressed. Critics have voiced concerns for the paradoxical nature of critical inquiry, arguing that by providing alternative understandings of social phenomena, critical inquirers send a message that the oppressed are partly responsible for their situations due to their lack of “ appropriate” knowledge. In this article, we discuss the transformative potentials of critical educational inquiry. We use five contexts of qualitative research, namely, autobiographical, historical, political, postmodern, and philosophical to explore the possibilities of critical inquiry in educational research. We also use an article by Deborah Hicks (2005) to exemplify how critical research may be transformative and empowering by involving the researched in a process of inquiry characterized by negotiation and reciprocity.

critical inquiry, educational research, contexts of qualitative research, empowerment

Introduction

Critical theory generally refers to the theoretical traditions developed by a number of scholars affiliated with the Institute of Social Research at the University of Frankfurt in the mid-twentieth century. This group of scholars, including Max Horkheimer, Theodor Adorno, and Herbert Marcuse, situated this inquiry within German philosophical, social, and political thoughts and traditions. Very soon, the life and work of these scholars were heavily influenced by the devastation of World War I, along with resulting economic crises and political instability. They believed that reinterpretations of society were necessary, during an infamous period in history, when various forms of injustice and subjugation were shaping their world. Unfortunately, only a decade after the establishment of the Frankfurt School, the Nazis overtook Germany in body and mind. The leading scholars of the Frankfurt School decided (or were forced) to move to the United States. However, they were shocked by many aspects of American culture, especially the unquestioned acceptance of empirical practices of American social science research. In 1953, Horkheimer and Adorno decided to return to Germany in order to revitalize the Institute of Social Research, but Marcuse chose to stay in the United States and continue his work in social science research and theorization (Kincheloe & McLaren, 2011).

All members of the Frankfurt School championed a vision of a more just society, in which people have not only an equal access to desirable things but also control over the economic, political and cultural aspects of their lives. They argued that the oppressed and exploited people would be emancipated only if they were empowered to transform their situations by themselves. This theoretical tradition is called “critical” because the promoters of this theory “saw the route to emancipation as being a kind of self-conscious critique which problematizes all social relations, in particular those of and within the discursive practices of power, especially technical rationalism” (Tripp, 1992, p. 13).

Although frequently referenced in social science literature, critical theory has also been misinterpreted, misunderstood and accused of being patriarchal and re-inscribing old power structures. For example, Elizabeth Ellsworth (1989) famously questioned the ability of critical theory to empower the oppressed and transform their situations. To avoid confusion in our discussion, we conceptualize critical theory as a framework to understand “issues of power and justice and the ways that the economy; matters of race, class, and gender; ideologies; discourses; education; religion and other social institutions; and cultural dynamics interact to construct a social system” (Kincheloe & McLaren, 2011, p. 288).

Because of its emancipatory nature, critical theory is different from traditional empiricist theories in three important ways (Schwandt, 2007). First, it is a self-reflective, democratic discourse in the sense that it relinquishes normative and accepted understandings of the social order and adopts a lens of critical reconsideration. Second, unlike the empiricist tradition in which the theorist is disinterested in and detached from the research subjects, critical inquiry is closely related to praxis [i.e., action + reflection = word = work = praxis] (for details, see Freire, 1970). Third, critical inquiry “employs the method of immanent critique, working from within categories of existing thought in order to radicalize those categories, reveal their internal contradictions and shortcomings, and demonstrate their unrecognized possibilities” (Schwandt, 2007, p. 55). Therefore, when research is carried out from the perspectives of critical theory, it aims to identify various forms of power and “seeks in its analyses to plumb the archaeology of taken-for-granted perspectives to understand how unjust and oppressive social conditions came to be reified as historical ‘givens’” (Cannella & Lincoln, 2009, p. 54).

The critical theory tradition has been taken into the field of education by a number of scholars, “but most notably by Paulo Freire in his work with oppressed minorities which gave rise to the term critical pedagogy , meaning teaching-learning from within the principles of critical theory” (Tripp, 1992, p. 13). Other scholars, such as Michael Apple, Henry Giroux, Joe Kincheloe and Peter McLaren have taken up critical theory to unpack politics of education, epistemological violence, control of teachers and learners, commodification of knowledge, and how schools reproduce social, economic, political, and cultural inequalities. In addition to identifying these oppressive roles of education, they have also provided the language of possibility .

In this article, we explore critical inquiry through five contexts, namely, autobiographical, historical, political, postmodern, and philosophical. Karyn Cooper and Robert White (2012) propose these five contexts as “a theoretical framework for conducting, understanding, and interpreting qualitative research” (p. 23). Throughout our exploration, we use Deborah Hicks’ (2005) article “Cultural hauntings: Girlhood fictions from working-poor America” as an example of reflexive, advocacy-centred critical inquiry. In this article, Hicks delineates links between third and fourth-grade girls’ fascination with horror fiction, layered dimensions of their voice and identity, and the complexities of growing up in a predominantly white working-poor community. Using the five contexts of qualitative research (Cooper & White, 2012) as a theoretical framework with reference to Hicks (2005), as an example of critical inquiry, we present our analysis of and insights into the possibilities for and realities for empowerment in critical education research.

Autobiographical Context

One of the over-arching aims of critical inquiry is to include various perspectives in academia and to acknowledge that the stories and voices of particular groups have long been underrepresented in conversation of research. Critical inquiry has paved the way for, and continues to incorporate, the lenses of feminist theory, critical race theory and class analyses, among others, and ultimately seeks to challenge the canonical frames of academia that have allowed for only one reality. The autobiographical context provides a step forward in that challenge, and many practitioners of critical inquiry have used the autobiographical context both to inform their larger critiques and also to situate themselves within the larger discourse. Race and gender theorists such as Gloria Anzaldua (1987), bell hooks (1994), and Beverly Daniel Tatum (1997) weave their autobiographies throughout their critical analyses in order to establish the inextricability between their lived experience and their perspective regarding the world around them.

As described in Cooper and White (2012), the autobiographical context is a way to highlight the researcher’s own perspective in order to better establish a connection between researcher, researched and reader, as well as to contextualize the research produced. Without an autobiographical context, the researcher and, in fact, the research itself would be disembodied and without a human source. As a reader, one would be unable to understand both the insights and the blind spots that the researcher brings to an investigation without an understanding of the author’s preconceived ideologies and experiences: “To use a metaphor, viewing a work of art without contextualizing it in terms of our knowledge about the artist tends to limit our understanding of the painting itself” (Cooper & White, 2012, p. 33). Before theorists in the latter half of the 20 th century began to call into question the positionalities within the academy, the autobiography of the researcher was hidden, leading to an inability to trust the work produced, and an “othering” of the subject.

Referencing William Pinar, Cooper and White (2012) highlight the use of autobiography in research, noting that it need not be a self-indulgent exercise. Pinar demonstrates, through his method of currere, that autobiography is a part of a larger context. His four steps allow researchers to incorporate their lived experiences into their larger research and, in fact, study themselves in order to ask and understand the question, “What do I make of what I have been made?” (Cooper & White, 2012, p. 34). As critical inquiry attempts to inspire new ways of thinking, it simultaneously follows the steps that Pinar lays out—regressive, progressive, analytical, and synthetical. These steps give us the opportunity first to look back on our formative experiences, then forward to where we desire to go. The third step looks at our present, while being informed by our past and future and, fourth, we bring all three pieces together in order to understand our ways of understanding (Pinar, 1975).

Hicks’ (2005) relies heavily on the autobiographical context to perform her critical inquiry. Within her analysis, she interweaves her own autobiography, as well as those of her students. Hicks’ voice as the researcher and author is never lost within her writing; her choices, observations and interactions are always deeply embedded within her work. In fact, the writing/research process and the choices she has made within that are all reflective of her positionality, and she makes no secret of that. In so doing, she avoids the problem of the researcher’s gaze which, gone unmentioned, can affect the ways in which the reader sees the subjects of the research, ultimately skewing the reader’s response and, perhaps in turn, any action taken as a result of her research. As Cooper and White (2012) discuss, by being autobiographically expository, one ensures that both researcher and reader are using the same tools to understand and view the subjects of the research. By revealing our subjectivity, we actually allow more space for our reader to be objective.

In addition to being honest about her own autobiography, we would also argue that Hicks presents what functions almost as an autobiography of the community where she conducted her research. More than simply contextualizing her students’ narratives, the way in which she describes the setting of the classroom leads the reader to feel as if the place is in and of itself. She describes its position on the economic margins of the city by stating that the middle-class “might drive through on the way to something else, noting in passing the ghostly frames of abandoned warehouses or the thick, gray smoke churned out from one of the few working factories” (p. 172).

While this contextualization also has its place in discussions of both the historical and political context, it is raised here as well. Hicks regards the space that her subjects live in with her particular eye and mindset, and gives a specific meaning to both their autobiographies and the very act of contextualization. In doing so, Hicks provides her individual subjects with more of a universality, a way to posit that narrative need not be insular and without academic merit. The research question, as stated by Hicks, is “what was it like to grow up as a girl in contemporary working-poor America?” (p. 172). Thus, her focus on the economic and structural context of her subjects is vital to the larger underpinnings of her research, for which horror novels become merely a vehicle and not the point, in themselves.

The third modality in which we see the autobiographical context at play is, of course, in the narratives of the girls themselves. Hicks uses bell hooks (1994), Myles Horton (1990) and Paulo Freire (1970) as a framework, all three of whom centered both their pedagogies and their scholarship within a context of dialogue so the human aspect of each of the girls’ experiences is vital to the analysis that Hicks is attempting to construct. We learn about these girls through our understanding of their community and through their understandings of and interactions with the books that Hicks posits as “subversive” texts (p. 174). As Hicks describes their reactions to the texts, their previous experience with different genres and the choices that they make, we are able to understand the girls both as individuals, and within their larger contexts.

In Inquiry and Reflection, Diane Dubose Brunner (1994) talks about representations of student experience in various forms of media (pp. 153-186), a topic that is also tackled quite often by both bell hooks and Henry Giroux. By investigating how these girls read different texts, Hicks provides us a new reading of the girls themselves. Brunner talks about the way in which language has been used to describe students, especially along class lines, in television, film and literature, as well as the ways in which students, themselves, have been depicted as using (or conversely, failing to use) language. Hicks’ framing of her larger point of inquiry, the ways in which language and linguistic practices are both reflective and constructive of their material and cultural lives is an investigation into the very way that fictional depictions of youth in educational spaces disembodies them from their contexts, a process described by Brunner (1994). By focusing on the autobiography and narrative experience of herself, her students, and their teacher, Hicks is able to re-contextualize these experiences.

Historical Context

Moving through the five contexts of critical inquiry, we arrive at the historical context. Cooper and White (2012) open their discussion of the historical context with the African proverb, “Until the lion has his own historian, the hunter will always be the hero” (p. 52). This proverb is central to the ideas of a critical, historical analysis. Without questioning, “Whose history is it?” we are unable to look critically at the stories that we have taken as truth (p. 52). Denzin and Lincoln (2005) do just this by going through what they depict as the eight moments of qualitative research. They move from the traditional, through modernist, blurred genres, crisis of representation, and finally, the triple crisis. As they move through these moments, we see the history of qualitative research in varying complexities itself, as it is opened to new voices, new ways of knowing, seeing and understanding.

There are, of course, numerous scholars who aim to illustrate both a critical and historical understanding of their subjects. One such scholar, whose work seems of particular relevance to Hicks’ content and analysis, is David Roediger (1993). By developing a history of American racial construction through the paradigm of whiteness, Roediger takes both a critical and historical look at the ways in which our understanding of self, power, poverty and privilege are informed by the history of racial construction, as well as the history of labour in the United States. As Hicks discusses the working poor character of the town that her work is centered in, Roediger’s (1993) analysis of how labour history and the history of slavery becomes particularly critical to our understandings of the intersections of whiteness and working class identities, as posited by Hicks (2005).

Gloria Ladson-Billings (1995, 1999) also captures a historical context in her analyses of education and race, uniting the contexts of critical race theory and critical pedagogy. By tracing notions of racial segregation and looking at cultural deprivation, Ladson-Billings is able to reclaim the ways that we look at modern schooling and the ways that we talk about racial disparities in education. In so doing, the historical perspective in critical inquiry acts as a counter-argument to sometimes dangerous modes of thinking, such as the “deficit” model of education. Hicks continues this tradition by highlighting the voices of subjects schooled within a working class context, as well as by demonstrating positive examples of engaged learning.

Many of Hicks’ methodological and writing strategies demonstrate a strong connection to the historical context. Firstly, she contextualizes the geographic location based on historical understanding. She discusses its physical make-up, position within the larger urban space and, also, demographic profiles within a historical context. The critical inquiry piece here is that neighborhoods do not simply arise, just as residents are not divorced from their space—neighborhoods themselves do not exist separately from the forces that construct them (Hicks, 2005). She specifically mentions factors such as factory closings that occurred long before her students were born, largely as a means to highlight the ways in which communities live under the economic shadows of what came before. It is clear within a historical context that events do not just happen and dissipate; they continue to have an effect on what comes after them.

Hicks is also able to engage with the historical context by extending her study over a year-long period (She even goes so far as to refer to her data as a “history” (p. 173)). By looking at the girls over a period of time, she engages with notions of change. The other way in which she engages with the historical context is by situating her methodology and theoretical framework within a trajectory of study, wherein she cites the work of Gee (2004) and other practitioners of new literacy studies. In so doing, she draws a historical lens over her specific research, as well as engaging in a larger theoretical conversation.

Political Context

Within critical theory, it is impossible to create barriers between the political, postmodern, and philosophical contexts. Like the postmodern world we live in, they are liquid, and flow into each other at different times of the research and inquiry process. First and foremost, we currently live in the postmodern era and, thus, all contemporary research is firmly rooted within that particular framework. Secondly, if, as Pinar (1978) claims, all intellectual acts are inherently political, then any act of research by an individual or institution is, of course, political as well. Finally, thoughtful considerations of philosophy hold these concepts together and, through the philosophical context, dialogue and discourse are created to enable change. Nonetheless, the political aspect of critical theory is interwoven into all four contexts and must always be present in any research that aims to be called “critical.”

The Frankfurt School, notably Max Horkheimer, is central in exploring the political context of critical theory. Horkheimer (1972) states in his pivotal work, Critical Theory , that there cannot be many defined criteria for critical theory, as it is a product of its political, social, cultural, and economic contexts and is, thus, continually changing; however, he argues that critical theory must always contain the unfaltering “concern for the abolition of social injustice” (p. 242), a sentiment echoed by scholars such as Giroux (2004) and Lather (1986).

Lather (1986), in particular, argues that researchers should employ critical theory in order to avoid the “rape model” of research—namely, objectifying and “othering” one’s research subject. Critical theory can help researchers and institutions build and maintain “a more collaborative approach...to empower the researched, to build emancipatory theory, and to move toward the establishment of data credibility within praxis-oriented, advocacy research” (Lather, 1986, p. 272). Essentially, the goal of critical theory should be to encourage and facilitate emancipatory change for the oppressed, marginalized and misunderstood. For example, in her article, Hicks investigates—and eventually advocates for—the typically “hidden face of poverty” or the hidden “white” face of poverty. Intrigued and surprised by the “predominant Whiteness of the neighbourhood” (p. 171), where she situates her research, Hicks draws attention to an often overlooked area in urban poverty research.

The change called for in critical inquiry can be demonstrated through the realization of agency, which is central to the political context, and to critical inquiry as well: “the political contexts at work within society impact upon one’s sense of agency” (Cooper & White, 2012, p. 72). In Hicks’ article, her goal (though flawed by her own middle-class biases and preconceptions of the working-poor) was to investigate the experience of girlhood in working-poor America, and how the school language practices—mainly reading novels—were “layered within their cultural and material lives” (p. 172). Though her research began with a more observational rather than advocacy focus, Hicks accomplished the praxis-oriented research that is often advocated by Lather (1986) and other critical researchers and theorists. When one student, Brandy, voiced her newfound confidence and proclaimed that “We can start to control this [their situation] by just sitting down and talking” (p. 184), she demonstrated that she had begun to realize her agency—the first step towards the change that critical theory champions.

The students in Hicks’ research also struggled with “juggling the tension and ambiguity of their class differences in a middle-class school culture” (p. 173). This is clearly evident in Hicks’ demonstration of her own middle-class cultural capital, when she attempts to begin the course with a text that the girls simply did not relate to, involving a cultural capital (Bourdieu, 1985) that rested outside of their realm of experience. Instead, the girls chose to focus on a type of text that was familiar to them: horror paperbacks. This shift in the types of literature that the students gravitated towards raises some critical questions: Are students in working-poor, urban neighbourhoods only capable of consuming simple, seemingly “low brow” texts? Should educators push those students beyond their comfortable reading environment into something more literary?

It is here that the true task of critical inquiry begins to take shape: “Literary” for whom, exactly? Why are these texts considered to be “low brow?” Why do we feel the need to teach certain accepted texts within the English classroom? While not specifically stating that these questions entered her research, Hicks displays in her article her engagement with these issues, as she questions her own cultural capital and decides to investigate, instead, the possibilities that lay within the horror paperbacks for unveiling the layered meanings of her students’ identities.

By taking this critical approach, Hicks’ grounds herself in the realm of critical pedagogy for political and social change—after reflecting on and altering her preconceptions of the cultural awareness and capital of her students, she provided them with a forum to be heard and to express their own cultural hauntings. Bauman (1997) claims that “the key to a problem as large as social justice lies in a problem as (ostensibly) small-scale as the primal moral act of taking up responsibility for the other nearby” (p. 70)—while Hicks may not have solved the issue of social justice, her research and willingness to speak and listen to these young girls illustrates her commitment to this group in working-poor America.

Postmodern Context

Critical theory argues that, in our postmodern society, normative assumptions and dominant perspectives of politics, culture and society often remain unquestioned. Horkheimer (1972) proposes that we re-evaluate our interactions and place within society a renewed consciousness that is “dominated at every turn by a concern for reasonable conditions of life” (pp. 198-199). Of course, the critical researcher must question and define what is meant by “reasonable conditions of life;” the researcher must also focus on how that is attainable for each individual. For many theorists, the key lies in the search for individual and collective agency. For example, once the young girls in Hicks’ class developed and discovered their personal stories and voices, they were able to create a larger, collaborative agency that, potentially, could be heard outside of their small, working-poor neighbourhood classroom.

Central to the postmodern context is the move from a producer to a consumer society, and the power dynamics that occur as a result—a concept encountered by many critical theorists and researchers. Foucault (1982) claims that, for society to progress to a more equitable and open society, we are in desperate need of a “new economy of power relations” (p. 779). However, as Giroux (2004) notes, it is important to remember that, within our capitalist, postmodern society, power does not disappear but, rather, becomes reworked, replayed and restaged; perhaps that reworking of power can result from the turn from consumer to producer.

Bauman also voices his concern for our movement from a producer society to a consumer society and notes that, “if unchecked, [it] will spell dire consequences for humanity” (quoted in Cooper & White, 2012, p. 86). He further explains that the concept of choice, and the deceptively simple ability to choose, is yet another crucial component of our postmodern condition, rooted in the dichotomy of producer and consumer. Surrounded by menial daily choices of what espresso drink to purchase, television program to fit into our schedule or Twitter account to follow, it is clear that our postmodern society values choice. Bauman would argue, however, that these are quick, meaningless choices that require little to no responsibility once the choice has been made, but it is these choices that create and shape our identities, only to be “adopted and discarded like a change of costume” (1997, p. 88).

In Hicks’ article, her students began as consumers. They were drawn to the paperback horrors because of their distribution and saturation within the media, from television programs such as Goosebumps , as well as other film interpretations of the genre. However, once they began creating the same horror texts that they originally consumed and became producers, they found their voices and became individuals with their own sense of agency and the awareness of their autobiographical situation within their postmodern, political world.

Even so, Hicks’ students do not have the same choices as many of their middle-class counterparts. Our consumer-driven society emphasizes the constant need for choice, yet so many fail to have the privilege of choice. Indeed, the word “fail” might seem insensitive and severe but, in a consumer-driven society, members of the working-poor have neither the ability nor the means to choose and participate in material culture. In her article, Hicks observes that her students fail to meet the material standards of the dominant, middle-class culture and, therefore, their ability to live within the consumer, postmodern world is gone; there are no jobs left in their area and, so, the “material possibilities” have disappeared for the youth in this working-poor neighbourhood (p. 170). In addition to their attempted participation in the middle-class consumer culture, the young girls also continuously struggle with “juggling the tension and ambiguity of their class differences in a middle-class school culture” (p. 173). If material possibilities are valued in identity construction in a postmodern consumer society, then the students’ inability to obtain them means a negation of individuality and agency and, thus, the potential for collective action and change.

Philosophical Context

The girls in Hicks’ summer school reading group may have juggled tensions and struggled with expression, but they certainly took matters into their own hands when they decided to circulate horror paperbacks amongst themselves. Hicks’ article illustrates a difference between education and schooling, and these young girls in working-poor America used the horror paperbacks as a means of creating their own form of education. Postmodern critical philosopher Maxine Greene (1988) notes the philosophical differences between schooling and education, and argues that “Education...encourages individuals to grow and to become, while schooling constrains students to become servants of a technocratic society” (Cooper & White, 2012, p. 106). This is particularly crucial to coming to an understanding of the dynamic nature of critical theory and, thus, critical pedagogy. Schooling, in Hicks’ situation, relied on a middle-class cultural capital that was not in the same sphere of experience as the education that the girls created for themselves, based on their interests and understandings. They began reading these texts as a self-created peer reading group and it was from this form of education, on the periphery of a middle-class school culture and environment, that the educator, Hicks, noticed the potential in exploring (and further complicating) the layered meanings of the girls’ identities.

Greene (1988) also states that imagination is central to developing one’s particular perspective and realizing one’s individual agency.

It takes imagination to become aware that a search is possible, and there are analogies here to the kind of learning we want to stimulate...it takes imagination on the part of the young people to perceive openings through which they can move. (Cooper & White, 2012, p. 110)

Greene’s (1988) emphasis on imagination paving the path to freedom is central to understanding the philosophical context of critical inquiry and also the philosophical context of Hick’s research. During a discussion of The Wizard of Oz, Hicks asked her students if, given the choice, they would choose to stay in Oz or go back to Kansas. One student, Shannon, imagines her escape from her current situation in a heartbreaking revelation:

I would choose Oz because it’s a beautiful land and up there you don’t hear no gunshots. And you don’t walk on glass and don’t hear people hollering and screaming at you like you do here. (Hicks, 2005, p. 183)

Shannon might not have made a plan of action for escaping her reality, but her imagination in this one instance displays her awareness of her political, social and economic situation, and her desire to escape. Picturing a better place—even one that is imaginary—could have been Shannon’s first step into plucking herself from her reality and escaping into a new one of change and autonomy (Greene, 1988).

Critics often blame critical inquiry for its emphasis on the language of critique, rather than the language of possibility. For example, Elizabeth Ellsworth (1989) expresses her doubt in critical inquiry’s empowering and transformative powers. She argues that “the discourse of critical pedagogy is based on rationalist assumptions that give rise to repressive myths,” and critical pedagogues “perpetuate relations of domination in their classrooms” (p. 297). Like Ellsworth, Viviane Robinson (1992) argues that there is a paradox at the heart of critical inquiry’s endeavours for emancipation. When critical researchers offer alternative understandings of subjects’ situations, their offer has two “arrogant” claims:

a) subjects’ (mis)understandings are at least in part responsible for the situation they find unacceptable; and (b) the alternative understandings offered by the critical social scientist, if acted on, would result in outcomes that are more effective and fulfilling than those currently experienced. (p. 346)

Nonetheless, critical inquiry is, by its nature, self-critical, and critical theorists assert that, while these may be potential issues, true critical inquiry inherently addresses these problems. Rather than criticizing the nature of critical inquiry, Canella and Lincoln (2009) identify three issues that may marginalize and disempower critical inquiry, thus impacting its reception amongst academic and general populations. First, a high level of abstraction and use of difficult language keep the work of critical inquiry away from broader audiences. Second, political forces often attack diversity and discredit critique. Finally, the rise of neoliberalism and hyper-capitalism suppress critical inquiry and privileges evidence-based, positivistic research.

In this article, we have used the five contexts for qualitative research (Cooper & White, 2012) to understand the possibilities for empowerment in critical educational research. In our analysis, Hicks’ (2005) article has provided examples of how teachers can adopt responsive and dialogic pedagogies that “start with close readings of students’ lives and voices” (p. 188). Through her constant reflective, self-critical, and participatory methodology, Hicks avoids the potential pitfalls of critical inquiry and, instead, epitomizes the language of possibility in critical inquiry. Thus, the five contexts of Cooper and White (2012) exemplified through Hicks (2005) illustrate the emancipatory potentials of critical educational research by engaging “the researched in a democratized process of inquiry characterized by negotiation, reciprocity, [and] empowerment” (Lather, 1986, p. 257).

Anzaldua, G. E. (1987). Borderlands/La Frontera: The new Mestiza  4th ed., San Francisco, CA: Aunt Lute Books .

Bauman, Z. (1997). Postmodernity and its discontents . Cambridge, UK: Polity Press.

Bauman, Z. (2005). Work, consumerism and the new poor . Maidenhead, England: Open University Press.

Bourdieu, P. (1985). The forms of capital. In J. G. Richardson (Ed.), Handbook of theory and research for the sociology of education (pp. 241-258). New York: Greenwood.

Brunner, D. D. (1994).  Inquiry and reflection: Framing narrative practice in education . Albany, NY: SUNY Press.

Cannella, G. S., & Lincoln, Y. S. (2009). Deploying qualitative methods for critical social purposes. In N. K. Denzin & M. D. Giardina (Eds.), Qualitative inquiry and social justice (pp. 53-72). Walnut Creek, CA: Left Coast Press.

Cooper, K. & White, R. E. (2012). Qualitative research in the post-modern era: Contexts of qualitative research . New York: Springer.

Denzin, N. K. & Lincoln, Y. S. (2005). Introduction: The discipline and practice of qualitative research. In N. K. Denzin & Y. S. Lincoln (Eds.), The Sage handbook of qualitative research, 3 rd Ed. (pp. 1-32). Thousand Oaks, CA: Sage.

Ellsworth, E. (1989). Why doesn’t this feel empowering? Working through the repressive myths of critical pedagogy. Harvard Educational Review, 59 (3), 297-324.

Foucault, M. (1982). The subject and power. Critical Inquiry, 8 (4), 777-795.

Freire, P. (1970). Pedagogy of the oppressed . New York: Seabury Press.

Gee. J. P. (2004).  Situated language and learning: A critique of traditional schooling . London: Routledge.

Giroux, H. (1988). Critical theory amid the politics of culture and voice: Rethinking the discourse of educational research. In R. Sherman & R. Webb (Eds.), Qualitative research in education: Focus and methods (pp. 190–210). New York: Palmer.

Giroux, H. A. (2000). Postmodern education and disposable youth. In P. P. Trifonas (Ed.), Revolutionary pedagogies: Cultural politics, instituting education, and the discourse of theory (pp. 174-195). New York: Routledge.

Giroux, H. A. (2004). Critical pedagogy and the postmodern/modern divide: Towards a pedagogy of democratization. Teacher Education Quarterly, 31 (1), 31-47.

Greene, M. (1988). The dialectic of freedom . New York: Teachers College Press.

Hicks, D. (2005). Cultural hauntings: Girlhood fictions from working-poor America. Qualitative Inquiry, 11 (2), 170-190.

hooks, b. (1994). Teaching to transgress: Education as the practice of freedom. New York: Routledge.

Horkheimer, M. (1972). Critical theory . Toronto: Herder and Herder.

Horton, M. & Freire, P. (1990). We Make the Road by Walking: Conversations on Education and Social Change. (Edited by B. Bell, J. Gaventa & J. Peters). Philadelphia, PA: Temple University Press.

Kincheloe, J. L., & McLaren, P. (2005). Rethinking critical theory and qualitative research. In N. Denzin and Y. Lincoln (Eds.), The handbook of qualitative research (pp. 279–313). Thousand Oaks, CA: Sage Publications.

Kincheloe, J. L., & McLaren, P. (2011). Rethinking critical theory and qualitative research. In K. Hayes et al., (Eds.), Key work in critical pedagogy: Joe L. Kincheloe (pp. 285-326). Rotterdam: Sense Publishers.

Ladson-Billings, G. J. (1995). But that’s just good teaching! The case for culturally relevant pedagogy. Theory into Practice, 34 (3), 159-165.

Ladson-Billings, G. J. (1999). Preparing teachers for diverse student populations: A critical race theory perspective. Review of Research in Education, 24 , 211-247.

Lather, P. (1986). Research as praxis. Harvard Educational Review, 56 (3), 257-277.

Pinar, W. F. (1975). Currere: toward reconceptualization. Curriculum theorizing: The reconceptualists , 396-414.

Pinar, W. F. (1978). The reconceptualization of curriculum studies. In D. J. Flinders and S. J. Thornton (Eds.), The curriculum studies reader (pp. 149-157). New York: Routledge Falmer.

Robinson, V. M. J. (1992). Doing critical social science: dilemmas of control. International Journal of Qualitative Studies in Education, 5 (4), 345-359.

Roediger, D. (1993). Race and the working-class past in the United States: Multiple identities and the future of labor history. International Review of Social History, 38 , 127-143.

Schwandt, T. A. (2007). The Sage dictionary of qualitative inquiry . Thousand Oaks, CA: Sage Publications.

Tatum, B. D. (1997). “Why are all the Black kids sitting together in the. cafeteria?” And other conversations about race. New York: Basic Books.

Tripp, D. (1992). Critical theory and educational research. Issues in Educational Research , 2(1), 13-23.

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this chapter

White, R.E., Cooper, K. (2022). An Introduction to Critical Approaches. In: Qualitative Research in the Post-Modern Era. Springer, Cham. https://doi.org/10.1007/978-3-030-85124-8_2

Download citation

DOI : https://doi.org/10.1007/978-3-030-85124-8_2

Published : 29 September 2022

Publisher Name : Springer, Cham

Print ISBN : 978-3-030-85126-2

Online ISBN : 978-3-030-85124-8

eBook Packages : Education Education (R0)

Share this chapter

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

• Publish with us

Policies and ethics

• Find a journal
• Track your research

IOE Writing Centre

Critical Analysis

What does the term 'critical analysis' mean in the context of academic writing?

Showing critical analysis in academic writing could mean:

• Demonstrating your understanding of reading / evidence (This appears to demonstrate that…This implies…This could result in…);
• Showing reasoning and conclusions from your reading / reflections (Therefore…As such…);
• Considering questions such as ‘why’, what if’, and ‘so what’;
• Showing you understand how  different ideas / evidence / perspectives relate to each other (This is linked to Smith's concept of X…Building on Jones (2012), Green (2016) suggests…);
• Demonstrating an understanding of how theories or research apply in your practice / context;
• Identifying possible limitations of research / theory and how these relate to your own arguments or own context (In the context of international development…In terms of learning in the Science classroom…);
• Identifying how something could be interpreted or done differently (in relation to your reading and / or practice).

IOE Writing Centre Online

Self-access resources from the Academic Writing Centre at the UCL Institute of Education.

Anonymous Suggestions Box

Information for Staff

Academic Writing Centre

Academic Writing Centre, UCL Institute of Education [email protected] Twitter:   @AWC_IOE Skype:   awc.ioe

GEOG 410 - Research Methodology

• Verifying If An Article Is Peer-Reviewed
• Should I Trust Internet Sources?
• Suggested Databases for Finding Sources
• Critical Analysis
• Creating an Annotated Bibliography
• Creating a Literature Review
• Resources for Writing Research Proposals
• Off-Campus Access

Introduction

Critical analysis may or may not be a component of this particular course's evaluation, but it is an important component of any research process. 

Inquiry-based learning

Critical thinking is at the heart of scientific inquiry. A good scientist is one who never stops asking why things happen, or how things happen. Science makes progress when we find data that contradicts our current scientific ideas.

Scientific inquiry includes three key areas:

         1.  Identifying a problem and asking questions about that problem          2.  Selecting information to respond to the problem and evaluating it          3.  Drawing conclusions from the evidence

Hart, T. (2018, 18 October) Teaching critical thinking in science - the key to students' future success.  Brighter Thinking Blog . https://www.cambridge.org/us/education/blog/2018/10/18/teaching-critical-thinking-science-key-students-future-success/

• Writing Critical Analysis Papers

Links and tips on how to conduct a critical analysis

• Critical Thinking & the Scientific Method "Critical thinking involves constantly asking questions, examining information and evidence, and figuring out conclusions. All of these actions are the basis for the scientific method, which then gives good evidence on which to base conclusions."
• How to Write a Critical Analysis (with examples and tips) "Critical analysis is the detailed examination and evaluation of another person's ideas or work. It is subjective writing as it expresses your interpretation and analysis of the work by breaking down and studying its parts... Good critical analysis evaluates the ideas or work in a balanced way that highlights its positive and negative qualities."
• CQ Researcher Online This link opens in a new window Addresses controversial topics in a balanced, unbiased manner, with regular reports on topics in health, international affairs, education, the environment, technology and the U.S. economy.

• << Previous: I Found All These Sources. Now What?!?
• Next: Creating an Annotated Bibliography >>
• Last Updated: Nov 6, 2023 1:03 PM
• URL: https://guides.library.unk.edu/geography_410
• University of Nebraska Kearney
• Library Policies
• Accessibility
• Research Guides
• Citation Guides
• A to Z Databases
• Open Nebraska
• Interlibrary Loan

2508 11th Avenue, Kearney, NE 68849-2240

Circulation Desk:  308-865-8599 Main Office:  308-865-8535

  Ask A Librarian

An official website of the United States government

The .gov means it’s official. Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

The site is secure. The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

• Publications
• Account settings

Preview improvements coming to the PMC website in October 2024. Learn More or Try it out now .

• Advanced Search
• Journal List
• J Clin Diagn Res
• v.11(5); 2017 May

Critical Appraisal of Clinical Research

Azzam al-jundi.

1 Professor, Department of Orthodontics, King Saud bin Abdul Aziz University for Health Sciences-College of Dentistry, Riyadh, Kingdom of Saudi Arabia.

Salah Sakka

2 Associate Professor, Department of Oral and Maxillofacial Surgery, Al Farabi Dental College, Riyadh, KSA.

Evidence-based practice is the integration of individual clinical expertise with the best available external clinical evidence from systematic research and patient’s values and expectations into the decision making process for patient care. It is a fundamental skill to be able to identify and appraise the best available evidence in order to integrate it with your own clinical experience and patients values. The aim of this article is to provide a robust and simple process for assessing the credibility of articles and their value to your clinical practice.

Introduction

Decisions related to patient value and care is carefully made following an essential process of integration of the best existing evidence, clinical experience and patient preference. Critical appraisal is the course of action for watchfully and systematically examining research to assess its reliability, value and relevance in order to direct professionals in their vital clinical decision making [ 1 ].

Critical appraisal is essential to:

• Combat information overload;
• Identify papers that are clinically relevant;
• Continuing Professional Development (CPD).

Carrying out Critical Appraisal:

Assessing the research methods used in the study is a prime step in its critical appraisal. This is done using checklists which are specific to the study design.

Standard Common Questions:

• What is the research question?
• What is the study type (design)?
• Selection issues.
• What are the outcome factors and how are they measured?
• What are the study factors and how are they measured?
• What important potential confounders are considered?
• What is the statistical method used in the study?
• Statistical results.
• What conclusions did the authors reach about the research question?
• Are ethical issues considered?

The Critical Appraisal starts by double checking the following main sections:

I. Overview of the paper:

• The publishing journal and the year
• The article title: Does it state key trial objectives?
• The author (s) and their institution (s)

The presence of a peer review process in journal acceptance protocols also adds robustness to the assessment criteria for research papers and hence would indicate a reduced likelihood of publication of poor quality research. Other areas to consider may include authors’ declarations of interest and potential market bias. Attention should be paid to any declared funding or the issue of a research grant, in order to check for a conflict of interest [ 2 ].

II. ABSTRACT: Reading the abstract is a quick way of getting to know the article and its purpose, major procedures and methods, main findings, and conclusions.

• Aim of the study: It should be well and clearly written.
• Materials and Methods: The study design and type of groups, type of randomization process, sample size, gender, age, and procedure rendered to each group and measuring tool(s) should be evidently mentioned.
• Results: The measured variables with their statistical analysis and significance.
• Conclusion: It must clearly answer the question of interest.

III. Introduction/Background section:

An excellent introduction will thoroughly include references to earlier work related to the area under discussion and express the importance and limitations of what is previously acknowledged [ 2 ].

-Why this study is considered necessary? What is the purpose of this study? Was the purpose identified before the study or a chance result revealed as part of ‘data searching?’

-What has been already achieved and how does this study be at variance?

-Does the scientific approach outline the advantages along with possible drawbacks associated with the intervention or observations?

IV. Methods and Materials section : Full details on how the study was actually carried out should be mentioned. Precise information is given on the study design, the population, the sample size and the interventions presented. All measurements approaches should be clearly stated [ 3 ].

V. Results section : This section should clearly reveal what actually occur to the subjects. The results might contain raw data and explain the statistical analysis. These can be shown in related tables, diagrams and graphs.

VI. Discussion section : This section should include an absolute comparison of what is already identified in the topic of interest and the clinical relevance of what has been newly established. A discussion on a possible related limitations and necessitation for further studies should also be indicated.

Does it summarize the main findings of the study and relate them to any deficiencies in the study design or problems in the conduct of the study? (This is called intention to treat analysis).

• Does it address any source of potential bias?
• Are interpretations consistent with the results?
• How are null findings interpreted?
• Does it mention how do the findings of this study relate to previous work in the area?
• Can they be generalized (external validity)?
• Does it mention their clinical implications/applicability?
• What are the results/outcomes/findings applicable to and will they affect a clinical practice?
• Does the conclusion answer the study question?
• -Is the conclusion convincing?
• -Does the paper indicate ethics approval?
• -Can you identify potential ethical issues?
• -Do the results apply to the population in which you are interested?
• -Will you use the results of the study?

Once you have answered the preliminary and key questions and identified the research method used, you can incorporate specific questions related to each method into your appraisal process or checklist.

1-What is the research question?

For a study to gain value, it should address a significant problem within the healthcare and provide new or meaningful results. Useful structure for assessing the problem addressed in the article is the Problem Intervention Comparison Outcome (PICO) method [ 3 ].

P = Patient or problem: Patient/Problem/Population:

It involves identifying if the research has a focused question. What is the chief complaint?

E.g.,: Disease status, previous ailments, current medications etc.,

I = Intervention: Appropriately and clearly stated management strategy e.g.,: new diagnostic test, treatment, adjunctive therapy etc.,

C= Comparison: A suitable control or alternative

E.g.,: specific and limited to one alternative choice.

O= Outcomes: The desired results or patient related consequences have to be identified. e.g.,: eliminating symptoms, improving function, esthetics etc.,

The clinical question determines which study designs are appropriate. There are five broad categories of clinical questions, as shown in [ Table/Fig-1 ].

[Table/Fig-1]:

Categories of clinical questions and the related study designs.

2- What is the study type (design)?

The study design of the research is fundamental to the usefulness of the study.

In a clinical paper the methodology employed to generate the results is fully explained. In general, all questions about the related clinical query, the study design, the subjects and the correlated measures to reduce bias and confounding should be adequately and thoroughly explored and answered.

Participants/Sample Population:

Researchers identify the target population they are interested in. A sample population is therefore taken and results from this sample are then generalized to the target population.

The sample should be representative of the target population from which it came. Knowing the baseline characteristics of the sample population is important because this allows researchers to see how closely the subjects match their own patients [ 4 ].

Sample size calculation (Power calculation): A trial should be large enough to have a high chance of detecting a worthwhile effect if it exists. Statisticians can work out before the trial begins how large the sample size should be in order to have a good chance of detecting a true difference between the intervention and control groups [ 5 ].

• Is the sample defined? Human, Animals (type); what population does it represent?
• Does it mention eligibility criteria with reasons?
• Does it mention where and how the sample were recruited, selected and assessed?
• Does it mention where was the study carried out?
• Is the sample size justified? Rightly calculated? Is it adequate to detect statistical and clinical significant results?
• Does it mention a suitable study design/type?
• Is the study type appropriate to the research question?
• Is the study adequately controlled? Does it mention type of randomization process? Does it mention the presence of control group or explain lack of it?
• Are the samples similar at baseline? Is sample attrition mentioned?
• All studies report the number of participants/specimens at the start of a study, together with details of how many of them completed the study and reasons for incomplete follow up if there is any.
• Does it mention who was blinded? Are the assessors and participants blind to the interventions received?
• Is it mentioned how was the data analysed?
• Are any measurements taken likely to be valid?

Researchers use measuring techniques and instruments that have been shown to be valid and reliable.

Validity refers to the extent to which a test measures what it is supposed to measure.

(the extent to which the value obtained represents the object of interest.)

• -Soundness, effectiveness of the measuring instrument;
• -What does the test measure?
• -Does it measure, what it is supposed to be measured?
• -How well, how accurately does it measure?

Reliability: In research, the term reliability means “repeatability” or “consistency”

Reliability refers to how consistent a test is on repeated measurements. It is important especially if assessments are made on different occasions and or by different examiners. Studies should state the method for assessing the reliability of any measurements taken and what the intra –examiner reliability was [ 6 ].

3-Selection issues:

The following questions should be raised:

• - How were subjects chosen or recruited? If not random, are they representative of the population?
• - Types of Blinding (Masking) Single, Double, Triple?
• - Is there a control group? How was it chosen?
• - How are patients followed up? Who are the dropouts? Why and how many are there?
• - Are the independent (predictor) and dependent (outcome) variables in the study clearly identified, defined, and measured?
• - Is there a statement about sample size issues or statistical power (especially important in negative studies)?
• - If a multicenter study, what quality assurance measures were employed to obtain consistency across sites?
• - Are there selection biases?
• • In a case-control study, if exercise habits to be compared:
• - Are the controls appropriate?
• - Were records of cases and controls reviewed blindly?
• - How were possible selection biases controlled (Prevalence bias, Admission Rate bias, Volunteer bias, Recall bias, Lead Time bias, Detection bias, etc.,)?
• • Cross Sectional Studies:
• - Was the sample selected in an appropriate manner (random, convenience, etc.,)?
• - Were efforts made to ensure a good response rate or to minimize the occurrence of missing data?
• - Were reliability (reproducibility) and validity reported?
• • In an intervention study, how were subjects recruited and assigned to groups?
• • In a cohort study, how many reached final follow-up?
• - Are the subject’s representatives of the population to which the findings are applied?
• - Is there evidence of volunteer bias? Was there adequate follow-up time?
• - What was the drop-out rate?
• - Any shortcoming in the methodology can lead to results that do not reflect the truth. If clinical practice is changed on the basis of these results, patients could be harmed.

Researchers employ a variety of techniques to make the methodology more robust, such as matching, restriction, randomization, and blinding [ 7 ].

Bias is the term used to describe an error at any stage of the study that was not due to chance. Bias leads to results in which there are a systematic deviation from the truth. As bias cannot be measured, researchers need to rely on good research design to minimize bias [ 8 ]. To minimize any bias within a study the sample population should be representative of the population. It is also imperative to consider the sample size in the study and identify if the study is adequately powered to produce statistically significant results, i.e., p-values quoted are <0.05 [ 9 ].

4-What are the outcome factors and how are they measured?

• -Are all relevant outcomes assessed?
• -Is measurement error an important source of bias?

5-What are the study factors and how are they measured?

• -Are all the relevant study factors included in the study?
• -Have the factors been measured using appropriate tools?

Data Analysis and Results:

- Were the tests appropriate for the data?

- Are confidence intervals or p-values given?

• How strong is the association between intervention and outcome?
• How precise is the estimate of the risk?
• Does it clearly mention the main finding(s) and does the data support them?
• Does it mention the clinical significance of the result?
• Is adverse event or lack of it mentioned?
• Are all relevant outcomes assessed?
• Was the sample size adequate to detect a clinically/socially significant result?
• Are the results presented in a way to help in health policy decisions?
• Is there measurement error?
• Is measurement error an important source of bias?

Confounding Factors:

A confounder has a triangular relationship with both the exposure and the outcome. However, it is not on the causal pathway. It makes it appear as if there is a direct relationship between the exposure and the outcome or it might even mask an association that would otherwise have been present [ 9 ].

6- What important potential confounders are considered?

• -Are potential confounders examined and controlled for?
• -Is confounding an important source of bias?

7- What is the statistical method in the study?

• -Are the statistical methods described appropriate to compare participants for primary and secondary outcomes?
• -Are statistical methods specified insufficient detail (If I had access to the raw data, could I reproduce the analysis)?
• -Were the tests appropriate for the data?
• -Are confidence intervals or p-values given?
• -Are results presented as absolute risk reduction as well as relative risk reduction?

Interpretation of p-value:

The p-value refers to the probability that any particular outcome would have arisen by chance. A p-value of less than 1 in 20 (p<0.05) is statistically significant.

• When p-value is less than significance level, which is usually 0.05, we often reject the null hypothesis and the result is considered to be statistically significant. Conversely, when p-value is greater than 0.05, we conclude that the result is not statistically significant and the null hypothesis is accepted.

Confidence interval:

Multiple repetition of the same trial would not yield the exact same results every time. However, on average the results would be within a certain range. A 95% confidence interval means that there is a 95% chance that the true size of effect will lie within this range.

8- Statistical results:

• -Do statistical tests answer the research question?

Are statistical tests performed and comparisons made (data searching)?

Correct statistical analysis of results is crucial to the reliability of the conclusions drawn from the research paper. Depending on the study design and sample selection method employed, observational or inferential statistical analysis may be carried out on the results of the study.

It is important to identify if this is appropriate for the study [ 9 ].

• -Was the sample size adequate to detect a clinically/socially significant result?
• -Are the results presented in a way to help in health policy decisions?

Clinical significance:

Statistical significance as shown by p-value is not the same as clinical significance. Statistical significance judges whether treatment effects are explicable as chance findings, whereas clinical significance assesses whether treatment effects are worthwhile in real life. Small improvements that are statistically significant might not result in any meaningful improvement clinically. The following questions should always be on mind:

• -If the results are statistically significant, do they also have clinical significance?
• -If the results are not statistically significant, was the sample size sufficiently large to detect a meaningful difference or effect?

9- What conclusions did the authors reach about the study question?

Conclusions should ensure that recommendations stated are suitable for the results attained within the capacity of the study. The authors should also concentrate on the limitations in the study and their effects on the outcomes and the proposed suggestions for future studies [ 10 ].

• -Are the questions posed in the study adequately addressed?
• -Are the conclusions justified by the data?
• -Do the authors extrapolate beyond the data?
• -Are shortcomings of the study addressed and constructive suggestions given for future research?
• -Bibliography/References:

Do the citations follow one of the Council of Biological Editors’ (CBE) standard formats?

10- Are ethical issues considered?

If a study involves human subjects, human tissues, or animals, was approval from appropriate institutional or governmental entities obtained? [ 10 , 11 ].

Critical appraisal of RCTs: Factors to look for:

• Allocation (randomization, stratification, confounders).
• Follow up of participants (intention to treat).
• Data collection (bias).
• Sample size (power calculation).
• Presentation of results (clear, precise).
• Applicability to local population.

[ Table/Fig-2 ] summarizes the guidelines for Consolidated Standards of Reporting Trials CONSORT [ 12 ].

[Table/Fig-2]:

Summary of the CONSORT guidelines.

Critical appraisal of systematic reviews: provide an overview of all primary studies on a topic and try to obtain an overall picture of the results.

In a systematic review, all the primary studies identified are critically appraised and only the best ones are selected. A meta-analysis (i.e., a statistical analysis) of the results from selected studies may be included. Factors to look for:

• Literature search (did it include published and unpublished materials as well as non-English language studies? Was personal contact with experts sought?).
• Quality-control of studies included (type of study; scoring system used to rate studies; analysis performed by at least two experts).
• Homogeneity of studies.

[ Table/Fig-3 ] summarizes the guidelines for Preferred Reporting Items for Systematic reviews and Meta-Analyses PRISMA [ 13 ].

[Table/Fig-3]:

Summary of PRISMA guidelines.

Critical appraisal is a fundamental skill in modern practice for assessing the value of clinical researches and providing an indication of their relevance to the profession. It is a skills-set developed throughout a professional career that facilitates this and, through integration with clinical experience and patient preference, permits the practice of evidence based medicine and dentistry. By following a systematic approach, such evidence can be considered and applied to clinical practice.

Financial or other Competing Interests

• Search Menu
• Browse content in Arts and Humanities
• Browse content in Archaeology
• Anglo-Saxon and Medieval Archaeology
• Archaeological Methodology and Techniques
• Archaeology by Region
• Archaeology of Religion
• Archaeology of Trade and Exchange
• Biblical Archaeology
• Contemporary and Public Archaeology
• Environmental Archaeology
• Historical Archaeology
• History and Theory of Archaeology
• Industrial Archaeology
• Landscape Archaeology
• Mortuary Archaeology
• Prehistoric Archaeology
• Underwater Archaeology
• Urban Archaeology
• Zooarchaeology
• Browse content in Architecture
• Architectural Structure and Design
• History of Architecture
• Residential and Domestic Buildings
• Theory of Architecture
• Browse content in Art
• Art Subjects and Themes
• History of Art
• Industrial and Commercial Art
• Theory of Art
• Biographical Studies
• Byzantine Studies
• Browse content in Classical Studies
• Classical History
• Classical Philosophy
• Classical Mythology
• Classical Literature
• Classical Reception
• Classical Art and Architecture
• Classical Oratory and Rhetoric
• Greek and Roman Epigraphy
• Greek and Roman Law
• Greek and Roman Papyrology
• Greek and Roman Archaeology
• Late Antiquity
• Religion in the Ancient World
• Digital Humanities
• Browse content in History
• Colonialism and Imperialism
• Diplomatic History
• Environmental History
• Genealogy, Heraldry, Names, and Honours
• Genocide and Ethnic Cleansing
• Historical Geography
• History by Period
• History of Emotions
• History of Agriculture
• History of Education
• History of Gender and Sexuality
• Industrial History
• Intellectual History
• International History
• Labour History
• Legal and Constitutional History
• Local and Family History
• Maritime History
• Military History
• National Liberation and Post-Colonialism
• Oral History
• Political History
• Public History
• Regional and National History
• Revolutions and Rebellions
• Slavery and Abolition of Slavery
• Social and Cultural History
• Theory, Methods, and Historiography
• Urban History
• World History
• Browse content in Language Teaching and Learning
• Language Learning (Specific Skills)
• Language Teaching Theory and Methods
• Browse content in Linguistics
• Applied Linguistics
• Cognitive Linguistics
• Computational Linguistics
• Forensic Linguistics
• Grammar, Syntax and Morphology
• Historical and Diachronic Linguistics
• History of English
• Language Acquisition
• Language Evolution
• Language Reference
• Language Variation
• Language Families
• Lexicography
• Linguistic Anthropology
• Linguistic Theories
• Linguistic Typology
• Phonetics and Phonology
• Psycholinguistics
• Sociolinguistics
• Translation and Interpretation
• Writing Systems
• Browse content in Literature
• Bibliography
• Children's Literature Studies
• Literary Studies (Asian)
• Literary Studies (European)
• Literary Studies (Eco-criticism)
• Literary Studies (Romanticism)
• Literary Studies (American)
• Literary Studies (Modernism)
• Literary Studies - World
• Literary Studies (1500 to 1800)
• Literary Studies (19th Century)
• Literary Studies (20th Century onwards)
• Literary Studies (African American Literature)
• Literary Studies (British and Irish)
• Literary Studies (Early and Medieval)
• Literary Studies (Fiction, Novelists, and Prose Writers)
• Literary Studies (Gender Studies)
• Literary Studies (Graphic Novels)
• Literary Studies (History of the Book)
• Literary Studies (Plays and Playwrights)
• Literary Studies (Poetry and Poets)
• Literary Studies (Postcolonial Literature)
• Literary Studies (Queer Studies)
• Literary Studies (Science Fiction)
• Literary Studies (Travel Literature)
• Literary Studies (War Literature)
• Literary Studies (Women's Writing)
• Literary Theory and Cultural Studies
• Mythology and Folklore
• Shakespeare Studies and Criticism
• Browse content in Media Studies
• Browse content in Music
• Applied Music
• Dance and Music
• Ethics in Music
• Ethnomusicology
• Gender and Sexuality in Music
• Medicine and Music
• Music Cultures
• Music and Religion
• Music and Media
• Music and Culture
• Music Education and Pedagogy
• Music Theory and Analysis
• Musical Scores, Lyrics, and Libretti
• Musical Structures, Styles, and Techniques
• Musicology and Music History
• Performance Practice and Studies
• Race and Ethnicity in Music
• Sound Studies
• Browse content in Performing Arts
• Browse content in Philosophy
• Aesthetics and Philosophy of Art
• Epistemology
• Feminist Philosophy
• History of Western Philosophy
• Metaphysics
• Moral Philosophy
• Non-Western Philosophy
• Philosophy of Science
• Philosophy of Language
• Philosophy of Mind
• Philosophy of Perception
• Philosophy of Action
• Philosophy of Law
• Philosophy of Religion
• Philosophy of Mathematics and Logic
• Practical Ethics
• Social and Political Philosophy
• Browse content in Religion
• Biblical Studies
• Christianity
• East Asian Religions
• History of Religion
• Judaism and Jewish Studies
• Qumran Studies
• Religion and Education
• Religion and Health
• Religion and Politics
• Religion and Science
• Religion and Law
• Religion and Art, Literature, and Music
• Religious Studies
• Browse content in Society and Culture
• Cookery, Food, and Drink
• Cultural Studies
• Customs and Traditions
• Ethical Issues and Debates
• Hobbies, Games, Arts and Crafts
• Lifestyle, Home, and Garden
• Natural world, Country Life, and Pets
• Popular Beliefs and Controversial Knowledge
• Sports and Outdoor Recreation
• Technology and Society
• Travel and Holiday
• Visual Culture
• Browse content in Law
• Arbitration
• Browse content in Company and Commercial Law
• Commercial Law
• Company Law
• Browse content in Comparative Law
• Systems of Law
• Competition Law
• Browse content in Constitutional and Administrative Law
• Government Powers
• Judicial Review
• Local Government Law
• Military and Defence Law
• Parliamentary and Legislative Practice
• Construction Law
• Contract Law
• Browse content in Criminal Law
• Criminal Procedure
• Criminal Evidence Law
• Sentencing and Punishment
• Employment and Labour Law
• Environment and Energy Law
• Browse content in Financial Law
• Banking Law
• Insolvency Law
• History of Law
• Human Rights and Immigration
• Intellectual Property Law
• Browse content in International Law
• Private International Law and Conflict of Laws
• Public International Law
• IT and Communications Law
• Jurisprudence and Philosophy of Law
• Law and Politics
• Law and Society
• Browse content in Legal System and Practice
• Courts and Procedure
• Legal Skills and Practice
• Primary Sources of Law
• Regulation of Legal Profession
• Medical and Healthcare Law
• Browse content in Policing
• Criminal Investigation and Detection
• Police and Security Services
• Police Procedure and Law
• Police Regional Planning
• Browse content in Property Law
• Personal Property Law
• Study and Revision
• Terrorism and National Security Law
• Browse content in Trusts Law
• Wills and Probate or Succession
• Browse content in Medicine and Health
• Browse content in Allied Health Professions
• Arts Therapies
• Clinical Science
• Dietetics and Nutrition
• Occupational Therapy
• Operating Department Practice
• Physiotherapy
• Radiography
• Speech and Language Therapy
• Browse content in Anaesthetics
• General Anaesthesia
• Neuroanaesthesia
• Browse content in Clinical Medicine
• Acute Medicine
• Cardiovascular Medicine
• Clinical Genetics
• Clinical Pharmacology and Therapeutics
• Dermatology
• Endocrinology and Diabetes
• Gastroenterology
• Genito-urinary Medicine
• Geriatric Medicine
• Infectious Diseases
• Medical Toxicology
• Medical Oncology
• Pain Medicine
• Palliative Medicine
• Rehabilitation Medicine
• Respiratory Medicine and Pulmonology
• Rheumatology
• Sleep Medicine
• Sports and Exercise Medicine
• Clinical Neuroscience
• Community Medical Services
• Critical Care
• Emergency Medicine
• Forensic Medicine
• Haematology
• History of Medicine
• Browse content in Medical Dentistry
• Oral and Maxillofacial Surgery
• Paediatric Dentistry
• Restorative Dentistry and Orthodontics
• Surgical Dentistry
• Browse content in Medical Skills
• Clinical Skills
• Communication Skills
• Nursing Skills
• Surgical Skills
• Medical Ethics
• Medical Statistics and Methodology
• Browse content in Neurology
• Clinical Neurophysiology
• Neuropathology
• Nursing Studies
• Browse content in Obstetrics and Gynaecology
• Gynaecology
• Occupational Medicine
• Ophthalmology
• Otolaryngology (ENT)
• Browse content in Paediatrics
• Neonatology
• Browse content in Pathology
• Chemical Pathology
• Clinical Cytogenetics and Molecular Genetics
• Histopathology
• Medical Microbiology and Virology
• Patient Education and Information
• Browse content in Pharmacology
• Psychopharmacology
• Browse content in Popular Health
• Caring for Others
• Complementary and Alternative Medicine
• Self-help and Personal Development
• Browse content in Preclinical Medicine
• Cell Biology
• Molecular Biology and Genetics
• Reproduction, Growth and Development
• Primary Care
• Professional Development in Medicine
• Browse content in Psychiatry
• Addiction Medicine
• Child and Adolescent Psychiatry
• Forensic Psychiatry
• Learning Disabilities
• Old Age Psychiatry
• Psychotherapy
• Browse content in Public Health and Epidemiology
• Epidemiology
• Public Health
• Browse content in Radiology
• Clinical Radiology
• Interventional Radiology
• Nuclear Medicine
• Radiation Oncology
• Reproductive Medicine
• Browse content in Surgery
• Cardiothoracic Surgery
• Gastro-intestinal and Colorectal Surgery
• General Surgery
• Neurosurgery
• Paediatric Surgery
• Peri-operative Care
• Plastic and Reconstructive Surgery
• Surgical Oncology
• Transplant Surgery
• Trauma and Orthopaedic Surgery
• Vascular Surgery
• Browse content in Science and Mathematics
• Browse content in Biological Sciences
• Aquatic Biology
• Biochemistry
• Bioinformatics and Computational Biology
• Developmental Biology
• Ecology and Conservation
• Evolutionary Biology
• Genetics and Genomics
• Microbiology
• Molecular and Cell Biology
• Natural History
• Plant Sciences and Forestry
• Research Methods in Life Sciences
• Structural Biology
• Systems Biology
• Zoology and Animal Sciences
• Browse content in Chemistry
• Analytical Chemistry
• Computational Chemistry
• Crystallography
• Environmental Chemistry
• Industrial Chemistry
• Inorganic Chemistry
• Materials Chemistry
• Medicinal Chemistry
• Mineralogy and Gems
• Organic Chemistry
• Physical Chemistry
• Polymer Chemistry
• Study and Communication Skills in Chemistry
• Theoretical Chemistry
• Browse content in Computer Science
• Artificial Intelligence
• Computer Architecture and Logic Design
• Game Studies
• Human-Computer Interaction
• Mathematical Theory of Computation
• Programming Languages
• Software Engineering
• Systems Analysis and Design
• Virtual Reality
• Browse content in Computing
• Business Applications
• Computer Security
• Computer Games
• Computer Networking and Communications
• Digital Lifestyle
• Graphical and Digital Media Applications
• Operating Systems
• Browse content in Earth Sciences and Geography
• Atmospheric Sciences
• Environmental Geography
• Geology and the Lithosphere
• Maps and Map-making
• Meteorology and Climatology
• Oceanography and Hydrology
• Palaeontology
• Physical Geography and Topography
• Regional Geography
• Soil Science
• Urban Geography
• Browse content in Engineering and Technology
• Agriculture and Farming
• Biological Engineering
• Civil Engineering, Surveying, and Building
• Electronics and Communications Engineering
• Energy Technology
• Engineering (General)
• Environmental Science, Engineering, and Technology
• History of Engineering and Technology
• Mechanical Engineering and Materials
• Technology of Industrial Chemistry
• Transport Technology and Trades
• Browse content in Environmental Science
• Applied Ecology (Environmental Science)
• Conservation of the Environment (Environmental Science)
• Environmental Sustainability
• Environmentalist Thought and Ideology (Environmental Science)
• Management of Land and Natural Resources (Environmental Science)
• Natural Disasters (Environmental Science)
• Nuclear Issues (Environmental Science)
• Pollution and Threats to the Environment (Environmental Science)
• Social Impact of Environmental Issues (Environmental Science)
• History of Science and Technology
• Browse content in Materials Science
• Ceramics and Glasses
• Composite Materials
• Metals, Alloying, and Corrosion
• Nanotechnology
• Browse content in Mathematics
• Applied Mathematics
• Biomathematics and Statistics
• History of Mathematics
• Mathematical Education
• Mathematical Finance
• Mathematical Analysis
• Numerical and Computational Mathematics
• Probability and Statistics
• Pure Mathematics
• Browse content in Neuroscience
• Cognition and Behavioural Neuroscience
• Development of the Nervous System
• Disorders of the Nervous System
• History of Neuroscience
• Invertebrate Neurobiology
• Molecular and Cellular Systems
• Neuroendocrinology and Autonomic Nervous System
• Neuroscientific Techniques
• Sensory and Motor Systems
• Browse content in Physics
• Astronomy and Astrophysics
• Atomic, Molecular, and Optical Physics
• Biological and Medical Physics
• Classical Mechanics
• Computational Physics
• Condensed Matter Physics
• Electromagnetism, Optics, and Acoustics
• History of Physics
• Mathematical and Statistical Physics
• Measurement Science
• Nuclear Physics
• Particles and Fields
• Plasma Physics
• Quantum Physics
• Relativity and Gravitation
• Semiconductor and Mesoscopic Physics
• Browse content in Psychology
• Affective Sciences
• Clinical Psychology
• Cognitive Psychology
• Cognitive Neuroscience
• Criminal and Forensic Psychology
• Developmental Psychology
• Educational Psychology
• Evolutionary Psychology
• Health Psychology
• History and Systems in Psychology
• Music Psychology
• Neuropsychology
• Organizational Psychology
• Psychological Assessment and Testing
• Psychology of Human-Technology Interaction
• Psychology Professional Development and Training
• Research Methods in Psychology
• Social Psychology
• Browse content in Social Sciences
• Browse content in Anthropology
• Anthropology of Religion
• Human Evolution
• Medical Anthropology
• Physical Anthropology
• Regional Anthropology
• Social and Cultural Anthropology
• Theory and Practice of Anthropology
• Browse content in Business and Management
• Business Strategy
• Business Ethics
• Business History
• Business and Government
• Business and Technology
• Business and the Environment
• Comparative Management
• Corporate Governance
• Corporate Social Responsibility
• Entrepreneurship
• Health Management
• Human Resource Management
• Industrial and Employment Relations
• Industry Studies
• Information and Communication Technologies
• International Business
• Knowledge Management
• Management and Management Techniques
• Operations Management
• Organizational Theory and Behaviour
• Pensions and Pension Management
• Public and Nonprofit Management
• Strategic Management
• Supply Chain Management
• Browse content in Criminology and Criminal Justice
• Criminal Justice
• Criminology
• Forms of Crime
• International and Comparative Criminology
• Youth Violence and Juvenile Justice
• Development Studies
• Browse content in Economics
• Agricultural, Environmental, and Natural Resource Economics
• Asian Economics
• Behavioural Finance
• Behavioural Economics and Neuroeconomics
• Econometrics and Mathematical Economics
• Economic Systems
• Economic History
• Economic Methodology
• Economic Development and Growth
• Financial Markets
• Financial Institutions and Services
• General Economics and Teaching
• Health, Education, and Welfare
• History of Economic Thought
• International Economics
• Labour and Demographic Economics
• Law and Economics
• Macroeconomics and Monetary Economics
• Microeconomics
• Public Economics
• Urban, Rural, and Regional Economics
• Welfare Economics
• Browse content in Education
• Adult Education and Continuous Learning
• Care and Counselling of Students
• Early Childhood and Elementary Education
• Educational Equipment and Technology
• Educational Strategies and Policy
• Higher and Further Education
• Organization and Management of Education
• Philosophy and Theory of Education
• Schools Studies
• Secondary Education
• Teaching of a Specific Subject
• Teaching of Specific Groups and Special Educational Needs
• Teaching Skills and Techniques
• Browse content in Environment
• Applied Ecology (Social Science)
• Climate Change
• Conservation of the Environment (Social Science)
• Environmentalist Thought and Ideology (Social Science)
• Natural Disasters (Environment)
• Social Impact of Environmental Issues (Social Science)
• Browse content in Human Geography
• Cultural Geography
• Economic Geography
• Political Geography
• Browse content in Interdisciplinary Studies
• Communication Studies
• Museums, Libraries, and Information Sciences
• Browse content in Politics
• African Politics
• Asian Politics
• Chinese Politics
• Comparative Politics
• Conflict Politics
• Elections and Electoral Studies
• Environmental Politics
• European Union
• Foreign Policy
• Gender and Politics
• Human Rights and Politics
• Indian Politics
• International Relations
• International Organization (Politics)
• International Political Economy
• Irish Politics
• Latin American Politics
• Middle Eastern Politics
• Political Methodology
• Political Communication
• Political Philosophy
• Political Sociology
• Political Behaviour
• Political Economy
• Political Institutions
• Political Theory
• Politics and Law
• Public Administration
• Public Policy
• Quantitative Political Methodology
• Regional Political Studies
• Russian Politics
• Security Studies
• State and Local Government
• UK Politics
• US Politics
• Browse content in Regional and Area Studies
• African Studies
• Asian Studies
• East Asian Studies
• Japanese Studies
• Latin American Studies
• Middle Eastern Studies
• Native American Studies
• Scottish Studies
• Browse content in Research and Information
• Research Methods
• Browse content in Social Work
• Addictions and Substance Misuse
• Adoption and Fostering
• Care of the Elderly
• Child and Adolescent Social Work
• Couple and Family Social Work
• Developmental and Physical Disabilities Social Work
• Direct Practice and Clinical Social Work
• Emergency Services
• Human Behaviour and the Social Environment
• International and Global Issues in Social Work
• Mental and Behavioural Health
• Social Justice and Human Rights
• Social Policy and Advocacy
• Social Work and Crime and Justice
• Social Work Macro Practice
• Social Work Practice Settings
• Social Work Research and Evidence-based Practice
• Welfare and Benefit Systems
• Browse content in Sociology
• Childhood Studies
• Community Development
• Comparative and Historical Sociology
• Economic Sociology
• Gender and Sexuality
• Gerontology and Ageing
• Health, Illness, and Medicine
• Marriage and the Family
• Migration Studies
• Occupations, Professions, and Work
• Organizations
• Population and Demography
• Race and Ethnicity
• Social Theory
• Social Movements and Social Change
• Social Research and Statistics
• Social Stratification, Inequality, and Mobility
• Sociology of Religion
• Sociology of Education
• Sport and Leisure
• Urban and Rural Studies
• Browse content in Warfare and Defence
• Defence Strategy, Planning, and Research
• Land Forces and Warfare
• Military Administration
• Military Life and Institutions
• Naval Forces and Warfare
• Other Warfare and Defence Issues
• Peace Studies and Conflict Resolution
• Weapons and Equipment

A newer edition of this book is available.

• < Previous chapter
• Next chapter >

9 Critical Approaches to Qualitative Research

Kum-Kum Bhavnani, Department of Sociology, University of California at Santa Barbara

Peter Chua, Department of Sociology, San José State University

Dana Collins, Department of Sociology, California State University, Fullerton

• Published: 04 August 2014
• Cite Icon Cite
• Permissions Icon Permissions

This chapter reflects on critical strategies in qualitative research. It examines the meanings and debates associated with the term “critical,” in particular, contrasting liberal and dialectical notions and practices in relation to social analysis and qualitative research. The chapter also explores how critical social research may be synonymous with critical ethnography in relation to issues of power, positionality, representation, and the production of situated knowledges. It uses Bhavnani’s framework to draw on Dana Collins’ research as a specific case to suggest how the notion of the “critical” relates to ethnographic research practices: ensuring feminist and queer accountability, resisting reinscription, and integrating lived experience.

Qualitative research is now ubiquitous and fairly well-respected throughout the human sciences. That Oxford University Press is producing this much-needed volume is further testament to that notion, and one which we applaud. However, although there are different approaches to conducting qualitative research, what is often not addressed are the philosophical notions underlying such research. And that is where the “critical” enters. Indeed, “critical,” used as an adjective and applied, within the academy, to methods of research is also a familiar phrase. The question is, therefore: what does “critical” mean, and how might it be translated such that present and future researchers could draw on some of its fundamentals as they plan their research studies in relation to progressive political activism?

The popularity of critical research is not predictable. Although the 1960s and early 1970s did offer a number of publications that engaged with critical research traditions (e.g., Gouldner, 1970 ), and the 1990s also led to a resurgence of interest in this area (e.g., Harvey, 1990 ; Thomas, 1993 ), it is now two decades since explicit discussions of critical research have been widely discussed within the social sciences (see Smith, 1999 ; Madison, 2012 , as exceptions).

In this chapter, we first outline meanings associated with “critical.” We then suggest that the narratives of critical ethnography are best suited for an overview chapter such as this. We consider critical ethnography to be virtually synonymous with critical social research as we discuss it in this chapter. In the final section of our chapter, we discuss Dana Collins’ specific research studies to suggest how her approach embraces the notion of “critical” ( Collins, 2005 ; 2007 ; 2009 ).

The “Critical” in Critical Approaches

“Critical” is used in many ways. In everyday use, the term can refer, among other definitions, to an assessment that points out flaws and mistakes (“a critical approach to the design”), or to being close to a crisis (“a critical illness”). On the positive side, it can refer to a close reading (“a critical assessment of Rosa Luxembourg’s writings”) or as being essential (“critical for effective educational strategies”). A final definition is that the word can be used to either denote considerable praise (“the playwright’s work was critically acclaimed”) or to indicate a particular turning point (“this is a critical time to vote”). It is this last definition that is closest to our approach as we reflect on “critical” in the context of qualitative research. That is, drawing from the writings of Marx, the Frankfurt School, and others (see Delanty, 2005 ; Marx, 1845/1976 ; Strydom, 2011 ), we suggest that critical approaches to qualitative methods do not signify only a particular way of thinking about the methods we use in our research studies, but that “critical approaches” also signify a turning point in how we think about the conduct of research across the human sciences, including its dialectical relations to the progressive and systematic transformation of social relations and social institutions.

The most straightforward notion of “critical” in this context is that it refers to (at the least) or insists (at its strongest) that research—and all ways by which knowledge is created—is firmly grounded within an understanding of social structures (social inequalities), power relationships (power inequalities), and the agency of human beings (an engagement with the fact that human beings actively think about their worlds). Critical approaches are most frequently associated with Marxist, feminist, and antiracist, indigenous, and Third World perspectives. At its most succinct, therefore, we argue that “critical” in this context refers to issues of epistemology, power, micropolitics, and resistance.

What does this mean, both theoretically and for how we conduct our research? Most would agree that whereas qualitative research does not, by definition, insist on a nonpositivist way of examining the social world, for critical approaches to be truly critical, an antipositivist approach is the sine qua non of critical research. Furthermore, it is evident as we survey critical empirical research that issues of reflexive and subjective techniques in data collection and the researcher’s relationship with research subjects also frame both the practices and the theories associated with research.

The following section begins by drawing attention to developments and debates involving the more restricted use the term critical as related to Marxism and then explores the ramifications for varying attempts to conduct critical qualitative research.

The Critical Debates

Karl Marx, Friedrich Engels, and their contemporaries (see Engels, 1877/1969 ; Harvey, 1996 ; Lenin, 1915/1977 ; Mao, 1990 ; Ollman, 2003 ) developed dialectical materialist notions of critique and “critical” that were substantively different from prior notions. They incorporated these dialectical materialist notions to develop Marxist theories and politics.

Dialectical materialism refers to an outlook on reality that emphasizes the importance of process and change that are inherent to things (such as objects, phenomena, and situations), as well as of the importance of human practices in making change. Significantly, human struggle over existing conditions and contradictions in things creates not only new conditions, but also new contradictions. This outlook serves as an analytical tool over idealist and old-fashioned materialist worldviews and as a source of strength for exploited peoples in their struggle against ruling elites and classes. It emphasizes that correct ideas, knowledge, and theoretical abstractions are established initially, and perhaps inevitably, through practice.

Dialectical materialism may be used to examine two aspects of the research process and the production of academic knowledge. The first aspect involves the writing process as it is carried out among multiple authors. At the drafting phase, the authors craft their distinct ideas into textual form. Contradictions in ideas are bound to exist in the draft. In doing revisions, some contradictions may become intensified and remain unresolved, yet, most frequently (and hopefully!), many are addressed in the form of clearer, more solid, and coherent arguments, thus resolving the earlier contradictions in the text. Yet, new struggles and contradictions emerge. The synthesis of ideas and argument in the final manuscript may again, however, engage in new struggles with the prevailing arguments being discussed.

The second aspect involves the relationship and interaction between the researcher and the interviewee. As their relationship begins, contradictions and differences usually exist between them, for instance, in terms of their prior experiences and knowledge, their material interests in the research project, and their communication skills in being persuasive and forging consent. The struggle of these initial contradictions could result in new conditions and contradictions. For example, this could lead to

the establishment of quality rapport between them, allowing the interview to be completed while the researcher maintains control over the situation;

the abrupt end of the interview due to the interviewee refusing and asserting her or his right to comply with the interview process; or

an explicit set of negotiations that address the unevenness in power relations between them, along with an invitation for both to be part of the research team and to collaborate in the collection and analysis of data and in the forging of new theories and knowledges.

In the first possibility, the prevailing power relations in interviews remain but shift to beneath the surface of the relationship, under the guise of “rapport.” In the second possibility, power relations in the interview process and initial contradictions are heightened, resulting in new conditions and contradictions that the researcher and research participant have to address, jointly and singly. In the third possibility, the research subject is transformed into a researcher as well, and the relationship between the two is transformed into a more active co-learning and co-teaching relationship. Still, new conflicts and contradictions may emerge as the research process continues to unfold. 1 In short, dialectical materialism stresses the analysis of change in the essence (1), practice (2), and struggle (3). Such analyses are at the root of how change may be imagined within the practices of social research.

Dialectical materialism, which forms the basis of the concept of “critical,” emphasizes the need to engage with power, inequality, and social relations in the arenas of the social, political, economic, cultural, and ideological. Based on this status, it is argued that an analysis of societies and ways of life demands a more comprehensive approach, one that does not view society and social institutions merely as a singular unit of analysis but rather as ones that are replete with history. Dialectical materialism directs its criticism against prevailing views or hegemonies, and, within the context of academic endeavors, engages in debates against positivism and neo-Kantian forms of social inquiry. It is this basis of “critical” that defines it in the context of research as a deep questioning of science, objectivity, and rationality. Thus, the meaning of the term “critical,” based on the idea of “critique,” emerges from the practice and application of dialectical materialism.

Historical materialism emerges from and is based on dialectical materialism. That is, any application of the dialectic to material realities is historical materialism. For example, any study of human society, its history, its development, and its process of change demands a dialectical approach rooted in historical materialism. This involves delving deeper into past and present social phenomena to thereby determine how people change the essence of social phenomena, and, simultaneously, transform their contradictions.

Dialectical materialism regards positivism as a crude and naïve endeavor to seek knowledge and explain phenomena and as one that assumes it is the task of social researchers to determine the laws of social relationships by relying solely on observations (i.e., by assuming there is a primacy of external conditions and actions). In addition, positivism separates the subject (the seemingly unbiased, detached observer) and object (the phenomenon/a under consideration) of study. Dialectical materialism overcomes the shortcomings of positivism by offering a holistic understanding of (a) the essence of phenomena; (b) the processes of internal changes, the handling of contradictions, and the development of knowledge; (c) the unity of the subject and object in the making of correct ideas; and (d) the role of practice and politics in knowledge creation.

Dialectical materialism directs its criticism against dominant standpoints. These standpoints can offer a simplistic form of idealism and philosophical materialism. Within the context of academic endeavors, the methods of dialectical materialism engage in debates against positivism and neo-Kantian forms of social inquiry. This approach challenges assertions that science, objectivity, and rationality are the sine qua non of research and that skepticism and liberalism are the only appropriate analytical positionings by which a research project can be defined as “critical.”

For instance, Auguste Comte and Emile Durkheim, in developing sociological positivism, argued for a new science to study society, one that adopted the methods of the natural sciences, such as skeptical empiricism and the practices of induction. In adopting these methods, approaches relying on early positivism sought to craft knowledge based on seemingly affirmative verification rather than being based on judgmental evaluation and transformative distinctions.

Positivism and dialectical materialism were both developed in response to Kantian and idealist philosophy. In the context of the European Enlightenment, in the late 1700s, Immanuel Kant inaugurated the philosophy of critique. Positivism challenged Kant’s philosophy of critique as the basis for the theory of knowledge.

Kant developed his notion of critique to highlight the workings of human reason and judgment, to illuminate its limitations, and to consolidate its application in order to secure a stable foundation for morality, religion, and metaphysical concerns. Politically, Kantian philosophy provided justification for both a traditionalism derived from earlier periods and a liberalism developed during the ascendance of the Enlightenment.

Kant sought to settle philosophical disputes between a narrow notion of empiricism (that relies on pure observation, perception, and experience as the basis for knowledge) and a narrow notion of rationalism (that relies on pure reason and concepts as the basis for knowledge). He argued that the essence (termed “thing-in-itself”) is unknowable, countering David Hume’s skeptical empiricism, and he was convinced that there is no knowledge outside of innate conceptual categories. For Kant, “concepts without perceptions are empty; perceptions without concepts are blind” (1781/1965, pp. A 51/B 75).

The method of dialectical materialism challenges Kant’s idealism for (what is claimed to be) its faulty assertion that correct ideas and knowing about the “thing-in-itself” can only emerge from innate conceptual categories, ones that are universal and transcendental. In Kantian philosophy, there is no reality (out there) to be known. Rather, it is the experience of reality itself that provides for human reason and consciousness.

Dialectical materialism overcomes Kant’s idealism with its recognition of the existence of concrete phenomena, outside and independent of human reason. Dialectical materialism stresses that social reality and concrete phenomena reflect on and determine the content of human consciousness (and also, we would argue, vice versa). Dialectical materialism also emphasizes the role of practice and politics in knowledge development, instead of merely centering the primacy of ideas and the meanings of objects.

In sum, the core debate against positivism centers on the practices of science. Dialectical materialism regards positivist approaches as crude and naïve endeavors that seek to determine unchangeable laws of nature, rely solely on observations and “sense experience” of phenomena as the basis for knowledge, highlight the primacy of external conditions and actions to explain phenomena, and separate the subject from the object of study. That is, dialectical materialism views positivism as a form of mechanical, as distinct from historical, materialism.

This abridged account of dialectical materialism and the critiques it offers of Kantian idealism and sociological positivism can allow for the formation of a preliminary set of criteria for what may constitute the “critical.” We argue that qualitative research may be critical if it makes clear conceptually and analytically:

The essence and root cause of any social phenomena (e.g., youth and politics);

The relationship between the essence of the social phenomena under consideration to the general social totality (such as how youth and their views of politics are related to wider systems within society, such as education, age, exploitation);

The contradictions within this social phenomenon (such as how young people are expressing their discontent),

and, therefore,

How to conduct more reflexive practices that interrelate data generation, data analysis, and political engagement that challenge existing relations of power.

Contemporary debates between neo-Kantian idealists and dialectical materialists have often been friendly regarding the direction for carving out what is meant by a critical project in qualitative social research. These debates bring to the fore issues of politics, ethics, research design, and the collection and analysis of data. They have also prompted a variety of ways in which “critical” may be used in relation to qualitative research. For the purposes of this chapter, we suggest four substantial ways in which “critical” is used in the context of qualitative research: (a) critical as a form of liberalism, (b) critical as a counterdisciplinary perspective, (c) critical as an expansion of politics, and (d) critical as a professionalized research endeavor and perspective.

Critical as a form of Kantian liberalism is one of the more conventional uses of the term in qualitative research. This use of critical is generally contrasted against the dogmatism of positivist approaches within social scientific research. Yet, to use critical in this way means that we embrace a liberalism that ends up promoting idealism in outlook and pluralism in practice. That is, Kantian liberalism presents itself as a “critical” and novel analysis by combining eclectic ideas and theories while not making known its political stand and its material interests. As a result, it supports prevailing modes of thinking that emphasize abstraction over concrete reality, and it succumbs to relativistist and pragmatist practices in research, such as “anything goes” in collecting data. In terms of methods, this use of “critical” promotes looseness and leniency in ethics and data collection and analysis, often without a structured accountability to the many constituencies that underlie all social research. Furthermore, the use of, for example, phrases such as “critical spaces,” when applied to social research, may be better understood as a celebration of method above theory and meta-theory and an engagement with some (of the often rather) excessive approaches to reflexivity and meta-reflexivity. In sum, this understanding of “critical” lacks appropriate structures of ethics and accountability and often tends to reject dialectic materialism.

The second use of “critical” in regards to qualitative research proposes a more analytical disagreement with conventional scholarly disciplines and, in so doing, seeks to take up counterdisciplinary positions ( Burawoy, 1998 ; 2003 ; Carroll, 2004 ; Smith, 2007 ). There are two main strands in this use of “critical.” One strand argues that “critical” is a means of exposing the weaknesses of conventional academic disciplines such as anthropology, political science, psychology, and sociology. At the same time, this strand maintains the viability of these core social science disciplines. For instance, academic feminists have continually highlighted the masculinist and heterosexist bias in what is considered top-tier scholarship and the need for these disciplines to be more inclusive in terms of perspectives and methodological techniques (e.g., Fonow & Cook, 1991 ; Harding, 1991 ; Ray, 2006 ). Yet such an approach may not inevitably focus on the fundamental problems, such as a neglect of the study of power inequalities (e.g., Boserup 1970 ; and see examples in Reinharz & Davidman, 1992 ). This second strand seeks to carve out interdisciplinary and multidisciplinary fields such as women studies, cultural studies, and area studies to overcome the paradigmatic and fundamental crises within core disciplines ( Bhavnani, Foran, & Kurian, 2003 ; March, 1995 ; Mohanty, 2003 ). Many of these interdisciplinary and multidisciplinary fields have often been more historical and qualitative in their approaches, seeking to go beyond positivist limitations and present a more nuanced and thorough analysis. However, even these multi-, inter-, and antidisciplinary fields have an uneven impact on dominant and conventional knowledge.

Moreover, both strands have not been able to overcome the increasing corporatization and neoliberalization of academic institutions. This issue addresses the increasing restructuring of public education into a private domain, one that relies on privatized practices and funding of both teaching and research. The neoliberalization of the academy is found in the ties of academic research to corporate grants, individualized career advancement, excessive publishing demands and citation indices, and the use of outsourcing for transcription, interviewing, online education, and private research spaces that are “rented” by public institutions, to name a few. These neoliberal conditions of research usually push out those critical researchers who attempt to avoid such exploitative avenues for research, writing, and collaboration. This use of “critical,” however, does expose that critical research is taking shape within contemporary processes of neoliberalism and the increasing privatization of the academy ( Giroux, 2009 ; Greenwood, 2012 ; Pavlidis, 2012 ).

The third and less familiar approach is to view “critical” as invigorating politics through the practices of feminist, antiracist, and participatory action research. This approach, for example, highlights the importance of analyzing power in research, as in terms of the conduct of inquiry, in political usefulness, and in affecting relations of power and material relations. Yet this view of “critical” is dogmatic because this approach demands that every research study meet all criteria of criticality comprehensively and perfectly.

A final use of “critical” emerges from the many scholarly and professionalized approaches that engage with the politics of academic knowledge construction while making visible the limits of positivism. “Critical” is used here as a means to focus primarily on revitalizing scholarship and research endeavors. However, we argue that even this use of “critical” ossifies the separation of the making of specialized knowledge from an active engagement to transform social life. Such a separation is antithetical to dialectical materialism. Often, this fourth form of the term “critical” is based on the logics of the Frankfurt School of critical theory (such as that of Adorno [1973] , Habermas [1985] , and Marcuse [1968] ) and other Western neo-Marxisms (from Lukacs [1971] and Gramsci [1971] to Negri [1999] ). Critical ethnographers and other critical social researchers, drawing from this tradition, often develop public intellectual persona by writing and talking about politics through scholarly and popular forms of publishing and speaking presentations and are even seen to take part in political mobilizations. Yet they can also shy away from infusing their research with a deep engagement in political processes outside the academy.

Later in this chapter, we discuss how to avoid some of the pitfalls of these four types of “critical,” but suffice it to say, in short, that it is the politics and the explicit situatedness of research projects that can permit research to remain “critical.”

Is Critical Ethnography the Same as Critical Research?

George Marcus (1998) argues that the ethnographer is a midwife who, through words, gives birth to what is happening in the lives of the oppressed. Beverley Skeggs (1994) has proposed that ethnography is, in itself, “a theory of the research process,” and Asad (1973) offered the now-classic critique of anthropology as the colonial encounter. However, although many approaches to and definitions of ethnography abound, it is the case that they all agree on one aspect: namely, that ethnographies offer an “insider’s” perspective on the social phenomena under consideration. It is often suggested that the best ethnographies, whether defined as critical or not, offer detailed descriptions of how people see, and inhabit, their social worlds and cultures (e.g., Behar, 1993 ; Ho, 2009 ; Kondo, 1990 ; Zinn, 1979 ).

It is evident from our argument so far that we do not think of ethnographic approaches to knowledge construction as being, in and of themselves, critical. This is because an ethnographic study, although not in opposition to critical ethnography or to critical research in general, has practices rooted in social anthropology. Therefore, its assumptions are often in line with anthropological assumptions (see Harvey [1990] for a recounting of some of these assumptions). Concepts such as “insider” versus “outsider,” “going native,” “gaining access,” and even conceptualizations of a homogenized and/or exoticized “field” that is out there ready to be examined by research remain as significant lenses of methodological conceptualization in much ethnographic research.

Despite, or perhaps because of, the move to reflexivity in ethnographic research, there remain enduring assumptions about best practices. As a result, a certain fetishization of research methods transpires, one that is often epitomized as reflexivity. In this instance, ethnographic and qualitative research become an ideal set of practices for extracting information. In sum, “best research practices,” as ways to extract information, reproduce core power dynamics of racism, gender, class, imperialism, and heteronormativity, which, in turn, reproduce the oppressive dynamics of noncritical qualitative research.

Furthermore, when presenting research merely as reflexive research, it is the case that the researcher can lose sight of the broader social structural and historical materialist context. In addition, a static notion of reflexivity can lead to the researcher not looking outward to assess the wider interconnections among the micropolitics of the research. That is, reflexivity is a dialectic among the researcher, the research process, and the analysis ( Jordan & Yeomans, 1995 ), but it is often presented simply as a series of apparently unchangeable/essential facets of the researcher. Our final point is that for theory to be critical in the development of research paradigms, it has to explicitly engage with lived experiences and cultures for, without that engagement, it remains as formalism (see, e.g., the work of Guenther [2009] and Kang [2010] as examples of critical qualitative research). We are very much in tune with Hesse-Biber and Leavy, who have suggested that (grounded) theory building is a “dynamic dance routine” in which “there is no one right dance, no set routine to follow. One must be open to discovery” (2006, p. 76).

An example of the limitation of conventionally reflexive research is in the area of lesbian and gay research methods that focus on the experiences of gay men and lesbians conducting qualitative research. It also offers a commentary on the role that non-normative sexuality plays in social research. By looking inward (see the earlier comment on “reflexivity”), these methodological frameworks focus on the researcher’s and participants’ lesbian/gay identifications. In so doing, this can fabricate a shared social structural positionality with research participants who have been labeled “gay” or “lesbian.” Such an approach to reflexivity overlooks the fabricated nature of positionalities and ignores the sometimes more significant divisions between researchers and participants that are expressed along the lines of race, class, gender, and nationality. Reflexivity is used only as a way to forge a connection for the exchange of information. A grave mistake is made in this rush to force similarity along the lines of how people practice non-normative sexualities ( Lewin & Leap, 1996 ; for a more successful engagement with queer intersectionality in research, see Browne & Nash, 2010 ).

The point to be made is that critical researchers should not merely ask “how does this knowledge engage with social structure?” Critical researchers, when contemplating the question “What is this?” as they set up and analyze their research, could also ask, “What could this be?” ( Carspecken, 1996 ; Degiuli, 2007 ; Denzin, 2001 ; Noblit, Flores, & Murillo, 2004 , all cited in Degiuli, 2007 ). Perhaps, borrowing from Karen O’Reilly’s thoughts on critical ethnography, one may think of critical research as “an approach that is overtly political and critical, exposing inequalities in an effort to effect change” ( Reilly, 2009 , p. 51). That is, in order for qualitative research to be critical, it must be grounded in the material relationships of history, as may be seen in the work of Carruyo (2011) , Chua (2001 ; 2006 ; 2007 ; 2012 ), Collins (2005 ; 2007 ; 2009 ), Lodhia (2010) , and Talcott (2010) .

Quantz (1992) , in his discussion of critical ethnography, suggests that five aspects are central to the discussion of critical research/ethnography: knowledge, values, society, history, and culture. So far in this chapter, we have discussed knowledge and its production, values/reflexivity and qualitative research/ethnography, society and unequal social relationships, and history as a method of historical and dialectical materialism in order to better understand social and institutional structures. What we have not discussed, however, is the notion of culture, nor, indeed, the predicament of culture ( Clifford, 1998 ): “Culture is an ongoing political struggle around the meaning given to actions of people located within unbounded asymmetrical power relations” ( Quantz, 1992 , p. 483).

Quantz elaborates by stating that culture develops as people struggle together to name their experiences (see Comaroff & Comaroff, 2012 , for a sophisticated and elegant discussion of this thinking). For example, one key task of critical research is to tease out how disempowerment is achieved, undermined, or resisted. That is, the job of the researcher is to see how the disempowerment—economic, political, cultural—of subordinated groups manifests itself within culture, and, indeed, whether the subordinated groups even recognize their disempowerment. For example, “the hand that rocks the cradle rules the world” is one example of how the material disempowerment of many groups of women is presented, in fact, as a strength of women, and yet it takes the gaze away from seeing the subordination of women by ostensibly emphasizing women’s hidden social power.

It is critical qualitative research that has to simultaneously analyze how our research can identify processes and expressions of disempowerment and can then lead to a restructuring of these relationships of disempowerment. At times, critical social researchers engage in long-term projects that involve policy advocacy and community solidarity to link community-driven research with social empowerment and community change (see Bonacich, 1998 ; Bonacich & Wilson, 2008 ; Hondagneu-Sotelo, 2007 ; Stoecker, 2012 ).

The key point is that critical qualitative research parts company with positivistic approaches because it is argued that positivism is only able to offer a superficial set of findings. Critical qualitative research hones research concepts, practices, and analyses into finer points of reference so that societal relationships may be not only understood, but also so that social power inequalities can be undermined. In short, critical social research has a Foucauldian notion of power at its very core and may thus be thought of as offering insights into people’s lived experiences ( Williams, 1976 ) as they negotiate asymmetrical societal power relations (see e.g., Novelli, 2006 ).

The Practices of Critical Qualitative Research

Within our current era of enduring global inequalities, what could constitute a truly critical approach to qualitative research? More than twenty years ago, in “Tracing the Contours” ( Bhavnani, 1993 ), it was argued that if all knowledge is historically contingent and, therefore, that the processes of knowledge production are situated, then this must apply to all research practices as well. 2 This argument was based on Haraway’s (1988) idea that the particularities of knowledge production do not lie in the characteristics of individuals. Rather, knowledge production is “about communities, not about isolated individuals” (p. 590). Building on this, Haraway discussed the significance of partiality and its relationship to objectivity. She suggested that it is the researcher’s knowledge of her own “limited location” that creates objectivity. In other words, knowing the limitations of one’s structural position as a researcher contributes to objective research because there is no objectivity that is omniscient, one from which all can be revealed (Haraway discusses this as the “god trick,” which is like “seeing everything from nowhere,” p. 582).

It is from Haraway’s insights that we develop our argument that situated knowledges are not synonymous with the static reflexivity we describe earlier. This is because, in this latter scenario, the researcher implies that all research knowledge is based on and derives from an individual’s personal historical and biographical perspectives. That is, researchers note their racial/ethnic identity, sex/gender, sexuality, age, class, and ability (i.e., biographical aspects of themselves), which are presented as essential and unchanging factors and that determine the knowledge created by the research. This has also been called “absolute relativism” ( Bhavnani, 1993 ) or “extreme relativism” ( Alcoff & Potter, 1993 ).

We suggest that the three elements central to research being “critical” are partiality, positionality, and accountability. Partiality leads to critical research interrogating prevailing representations as the research is conducted, and this builds on difference. Positionality is not about being reflexive, but about understanding the sociohistorical/political context from which research is created and thus engages with the micropolitics of a research endeavor. Accountability makes it evident that there are many constituencies to which all academic researchers are accountable—for example, their discipline, intellectual integrity, their institution and academic colleagues, the idea of rigorous scientific research, and academic freedom in research—as well as being accountable to the people with whom the research is being conducted. It is accountability that leads to a critical research project interrogating how the lived experiences and cultures of the research participants are inscribed within the research (see Stoecker, 2012 ).

What might the necessary elements be for ensuring that our research practices retain the criticality we have discussed earlier? We offer four possibilities that could form a filter through which one could decide if research is critical, using our definition of the term. First, all critical qualitative researchers should interrogate the history of ethnographic research that has led to the systematic domination of the poor; working classes; ethnic, racialized, sexual Others; women; and colonized peoples. That is, critical qualitative researchers must begin research with an understanding of how previous research, including their own, may continue to play a part in the subordination of peoples around the world, for example, by reinscribing them into predictable and stereotypical roles. Second, critical qualitative researchers should work to develop a consciousness of what might constitute critical research practices—without fetishizing methods—that challenge the system of domination often present in social research. Third, researchers who embrace critical qualitative approaches must develop comfort with the notion that they are conducting research with a purpose; that is, researchers grapple with and comprehend that critical research demands that they engage with the idea that they conduct research into research inequalities in order to undo these inequalities. Finally, critical qualitative researchers comprehend that their level of comfort can extend into the idea that research does not simply capture social realities; rather, the critical research approach is generative of narratives and knowledges. Once this last idea is accepted—namely, that knowledge is created in a research project and not merely captured—it is then a comparatively straightforward task to see the need for a researcher’s accountability for the narratives and knowledges he or she ultimately produces. In so doing, it is possible to recognize that all representations have a life of their own outside of any intentions and that representations can contribute to histories of oppression and subordination.

We propose that it is the actual practice of research, and, perhaps, even the idea of researcher as witness ( Fernandes, 2003 ), and not a notion of “best practices,” that keeps the politics of research at the center of the work we do. This includes insights into the redistribution of power, representation, and knowledge production. We suggest that critical research is work that shifts research away from the production of knowledge for knowledge’s sake and edges or nudges it toward a more transformative vision of social justice (see Burawoy, 1998 ; Choudry, 2011 ; D’Souza, 2009 ; Hussey, 2012 ; Hunter, Emerald, & Martin, 2013 ).

Thoughts from the Field

Here, based on Collins’s fieldwork, we highlight a set of critical methodological lessons that became prominent while she was conducting her field research in Malate, in the city of Manila, the Philippines, currently a tourist destination but once famous as a sex district. We define her work as a critical research practice.

Since 1999, Dana Collins has conducted urban ethnographic work in Malate, exploring gay men’s production of urban sexual place. She has been interested in the role of “desire” in urban renewal, and, in particular, how informal sexual laborers (whom she terms “gay hospitality workers,” a nomenclature drawn from their own understandings of their labor and lives) use “desire” to forge their place in a gentrifying district that is also displacing them. This displacement has involved analyzing urban tourism development, city-directed urban renewal, and gay-led gentrification, as well as informal sexual labor.

The research has involved her precarious immersion in an urban sexual field. She undertook participant observation of gay night life in the streets, as well as in private business establishments, and conducted in-depth and in-field interviews with gay business owners, city officials, conservationists, gay tourists, and gay-identified sexual laborers. In addition, she drew on insights from visual sociology and also completed extensive archival work and oral history interviewing. In all of this, she explored the collective memories of Malate as a freeing urban sexual space.

There exist multiple and shifting positionalities of power, knowledge, exchange, and resistance in her research. For one, she points out that she occupies multiple social locations as a white, lesbian-identified feminist ethnographer from a US university, one who forges complicated relationships with urban sexual space, sex workers, and both gay Filipino men and gay tourists.

A critical research practice at heart involves the shifting of epistemological foundations of social science research by addressing core questions of how we know what we know, how power shapes the practices of research, how we can better integrate research participants and communities as central producers of knowledge in our research, and how we can better conceptualize the relationship between the research we do and the social justice we are working toward in this world. 3 Such questions function as a call to action for critical researchers not only to examine the power relations present in research, but to generate new ways of researching that can confront the realities of racism, gender and class oppression, imperialism, and homophobia. This is about not only becoming better researchers, but also about seeking ways to shift the very paradigm of qualitative research and ensuring its service to social change. We have learned to use these questions as a central and ongoing part of the research we do.

Feminist and Queer Accountability to the Micropolitics of the Field

One of the primary tenets of critical qualitative research is that researchers must work with a wider understanding and application of the politics of research. For Kum-Kum Bhavnani (1993) , this means that one needs to be accountable to the micropolitics of research because such accountability destabilizes the tendency to conduct and present research from a transcendent position—the “all knowing” ethnographer, the “outsider” going in to understand the point of view of “insiders,” the attempt to (avoid) “go(ing) native,” and the researcher who aims to “gain access” at all costs and in the interests of furthering research. Micropolitics is not only the axis of inequality that shapes contemporary field relations; it is also the historical materialist relationship that constitutes the field and informs the basis of critical qualitative research. Micropolitics therefore is a critical framework that questions the essentializing and power-laden perceptions of research spaces and people because it encourages both a reflexive inquiry into the limited locations of research, and it involves the more critical practice of the researcher turning outward, to comprehend what Bhavnani calls the “interconnections” among researcher, research participants, and the social structural spaces of “the field.”

Micropolitics illuminates how all research is conducted from the limited locations of gender, race, class, sexual identification, and nationality, as well as illuminating the interconnections among all of these locations. This is not a simplistic reflexive practice of taking a moment in research to account for one’s positionality and then moving on to conduct normative field work; Bhavnani has been critical of such moments of inward inspection that lack substantial accountability to the wider micropolitics of the field. Rather, this move requires an ongoing interrogation of the limited locations of research that show how knowledge is not transcendent. Furthermore, when used reflexively, limited locations offer a more critical framework from which to practice research.

Micropolitics encouraged Collins’ attention to the limited location of a global feminist ethnographer doing research on gay male urban sexual space in Manila. For one, she moved among different positionalities throughout her research—of woman, queer-identified, white, US academic, tourist, ate (Tagalog term for older sister)—and none of these positions was either a transcendent or more authentic standpoint from which to conduct ethnographic work. So, for instance, as a white tourist, she moved easily among the gentrifying gay spaces because these spaces were increasingly designed to encourage her movement around Malate. This limited location showed the increasing establishment of white consumer space, which encouraged the movement of consumers like herself yet dissuaded the movement of the informal sexual laborers with whom she was also spending time—the gay hosts. Her limited location as a white woman researcher from a major US university meant that gay hosts sometimes shared their spaces and meanings of urban gay life with her, yet many times those particular spaces and dialogues were closed—she was not allowed into the many public sexual spaces (parks and avenues for cruising and sex late at night), yet gay hosts treated her as an audience for their many romantic stories about the boyfriends they met in the neighborhood.

Hosts emphasized that they gained much from hosting foreigners in terms of friendship, love, desire, and cultural capital. Yet they monitored the information they shared because she remained to them a US researcher who wielded the power of representation over their lives, despite her closeness with a group of five gay hosts. Hence, gay hosts often chose to remain silent about their difficult memories of sex work or any information that could frame them as one-dimensional “money boys,” as distinct from the “gay”-identified Filipino men who migrated to Malate to take part in a gay urban community.

Micropolitics challenges the authenticity of any one positionality over another; it was Collins’ movement among all of them, as well as her ongoing consideration of their social structural places, that provided her with a more critical orientation to the research. She suggests that she was not essentially a better “positioned” researcher to study “gay” life in Manila because she too is gay. Rather she found that differences of race, class, gender, and nationality tended to serve as more enduring, limited locations that influenced relationships within this research and that required ongoing critical reflexive engagement.

We want to add that a queer micropolitics of the field also offers critical insight into how identities are not stagnant but rather can be fabricated and performative during the research process. This moves researchers away from an essentialist take on their standpoint because an essentialist mind-set can lead to a search for the authentic insider and outsider. It can also lead to an essentialist social positionality that is more conducive for researching. Queer micropolitics show that research is made up of a collection of productive relations and identities. So, for example, her lesbian identification did not create a more authentic connection with gay hosts in Manila; rather, she often fabricated a shared “gay” positionality. This was a performance that served as a point of departure for her many conversations, from which she could proceed to share meanings of what it meant to be “gay” in the Manila and the United States.

Some of the productive relations that arise in research are the continuum of intimacies that develop while doing research. So, like feminists before her, she chose to develop close friendships with hosts where they genuinely loved (in a familial way) as they spoke of love. While learning about gay life in Malate, she stroked egos, offered advice, cried over broken hearts and life struggles, and built and maintained familial relations. Queer micropolitics shows, however, the limitations of such intimacies because intimacy does not equal similarity—the differing social locations of class, race, gender, and nationality meant that the experiences of urban gay life varied immensely. Thus, building such intimacies across these differences requires both the recognition and respect for boundaries that hosts constructed. She had to learn to see and know that when hosts became quiet and pulled away these were acts of self-preservation as well as acts of defiance against the many misrepresentations of their lives that had taken shape in academic research and journalistic renderings of their place in “exotic” sex districts.

A queer micropolitics also shows how research is an embodied practice: researchers are gendered, racialized, classed, and sexualized in the field. This became most apparent as she walked alone at night in the “field” and developed a keen awareness of the deeply gendered aspects of Malate’s urban spaces. For one, her embodiment was a peculiar presence because women in Manila do not walk alone at night. This includes women sex workers who publicly congregate in groups or with clients and escorts; otherwise, they are subject to police harassment. Hence, her very movement in the field as a sole woman felt like a transgression into masculine urban space because her feminine body was treated as “out-of-place” in the public spaces of the streets at night—she was flirted with, name called, followed, and sexually handled as she walked to gay bars for her research. As much as her queer location afforded her an understanding of how gender is a discursive production on the body, replete with the possibility of her being able to transcend and destabilize the gendered body as a biological “reality,” she confronted the discomfort of being read as a real woman in what became predominantly men’s spaces at night.

Yet this gendered embodiment, in part, shaped her knowledge of the district as she developed quick and knowledgeable movement through the streets, a queer micropolitical reading of urban space that arose out of this limited gender location. She was aware of the spacing of blocks, the alleys, the street lighting, and the time of night when crowds spilled out from the bars and onto the streets, allowing her to realize that a socially vibrant street life actually facilitated her movement. This queer micropolitical reading of urban space showed how both researchers and research participants do not simply exist in a neutral way in city space; rather, gender leads to our use and misuse of urban space. She has juxtaposed her experience with those of research participants in her study. The latter spoke at length about their exploratory and liberatory experiences of urban space, replete with their access to masculine sexual spaces—parks for cruising and sex, city blocks for meeting clients or picking up male sex workers, and alleys, movie theaters, and mall bathrooms for anonymous sex.

This queer micropolitical read of Malate’s gentrified space showed how very different was her access to the newly opening bars, restaurants, cafés, and lifestyle stores. Her whiteness signaled assumptions of her class location and positioned her as part of the international presence that this gentrifying space was targeting and whose movement among establishments was encouraged. She received free entry, free drinks, exceptional hospitality, and invitations to private parties, and her movements were closely monitored as she entered and exited establishments for the sake of “protecting a foreign tourist from street harassment” (interview with bar owner).

Overall, she experienced whiteness and class as equally embodied because these locations signaled her power as a “legitimate” consumer, allowing access to urban consumer sites and a privileged movement among gentrified spaces. This embodied experience of gentrified space differed from that of her gay hosts, who were often denied access to these establishments for being Filipino, young, working class, gay, and interested in foreigners. Contrarily, their bodies were constructed as a “threat” to urban renewal in the district.

Resisting Reinscription

Critical qualitative research is also concerned with the politics of representation in research. This requires a hard look at the implicit imperialisms of ethnographic work, including the tendency to go in and get out with abundant factual information, as well as the lasting impact of objectificatory research practices on fields of study. Such practices are evident in the now global rhetoric about the so-called Third World prostitute, who in both academic and journalistic renderings tends to be sensationalized and sexually Othered. This rendering is part of a long history of exoticization that has denied subjectivity and rendered invisible the lived experiences of sexual laborers around the world.

Such failed representations are part of what Kum-Kum Bhavnani (1993) has called “reinscription”—the tendency in research to freeze research participants and sites in time and space, thus rendering them both exotic and silenced. Reinscription denies agency to research participants and renders invisible the dynamic lived experiences of those same research participants. Doing research in both postcolonial and sexual spaces means that researchers must grapple with how our research participates in histories of reinscription—we both enter into and potentially contribute to a field that has been already “examined,” overstudied, and often exoticized. Thus, a critical qualitative approach is one that begins with a thorough understanding of these histories of representation so that we are not entering fields naïvely, as spaces only of exploration. Rather, we enter with knowledge of how the field has already been constituted for us through reinscription. A critical orientation has a core objective of understanding how our representations of research at all levels of the research process could contribute to exoticization by reinscribing participants and sites.

The issue of reinscription became particularly apparent when Dana Collins interviewed gay hosts and grappled with what appeared to be their elaboration of a contradictory picture of their sexual labor, as well as of their lives. In short, hosts tended to “lie,” remain silent, embellish “truths,” and articulate contradictory allusions to their life and labor in Malate. When Collins began her interviewing, she held the implicit objective of obtaining the “truth” about hosts’ lives, which she believed resided in “what they do” in the tourism industry. She was concerned with the “facts” about their lives, even though gay hosts were more likely to express their desire—desire for relations with foreigners, desire to migrate to a “gay” urban district, desire for rewarding work, and desire for community and social change. She struggled with many uncertainties about the discussions: how could they hold a range of “jobs” and attend school, yet spend most of their days and nights in Malate? How could they understand gay tourists as both boyfriends and clients? Why resist the label “sex worker” yet refer to themselves as “working boys” and claim to have “clients?” She struggled to make sense of the meanings that hosts offered even as she simultaneously felt misled concerning the “real” relations of hospitality.

Interviewing hosts about sexualized labor—as a way to produce a representation of sex work—did not facilitate the flow of candid information; hosts later expressed their view that sex work and their lives were already “overstudied.” Many researchers had previously descended on Malate to study sex work, and the district was a prime location for the outreach of HIV/AIDS organizations, some of which had breached the confidence of the gay host community. In short, Dana mistakenly started her research without the knowledge of Malate as a hyperrepresented field, and her research risked reinscribing gay hosts’ lives within that field as static and unchanging.

Importantly, those gay hosts who resisted becoming the “good research subjects” who give accurate and bountiful information, prompted a radical shift in her research framework. They told her stories about their imagined social lives, which encouraged her to rethink her commitment to researching sex work because the transformation of the discourses offered another view of the district, their work, and lives, one that offered a more visionary perspective. She began to focus less on “misinformation” and instead followed how hosts framed their lives. She treated these framings as social imaginings in which Malate features prominently in their understandings of gay identity, community, belonging, and change. In short, their social imaginings functioned as counternarratives to reinscription and offered their lived experience of urban gay place. Such imaginations expressed hope, fear, critique, and desire—in short, they present a utopic vision of identity, community, and urban change.

Integrating Lived Experience

Finally, critical qualitative research is a call to study lived experience, which is a messy, contradictory realm, but a deeply important one if we as critical researchers are truly interested in working against a history of research that has silenced those “under study” (see Weis & Fine, 2012 ). Paying attention to lived experience allows us to better engage with the contradictions mentioned earlier because lived experience is about understanding the meanings that research participants choose to share with researchers, and it is also about respecting their silences. As Kum-Kum Bhavnani (1993) has argued, silences can be as eloquent as words. Finally, integrating lived experience can take a critical qualitative project further because lived experience allows researchers to explore the epistemological relationship of the meanings and imaginings offered by research participants and to be explicit about the project of knowledge production. In other words, a central guiding question of critical qualitative research is how can research participants speak and shape epistemology, rather than solely being spoken about or being the subjects of epistemology?

Collins used hosts’ social imaginings as an epistemological contribution because their imaginings showed how hosts draw from experiences of urban gay community to articulate their desires for change, despite their simultaneous experiences of inequality and exclusion. We read social imaginings as a subjective rendering of urban place—the hosts’ social imaginings expressed their history, identity, subversive uses of urban space, and, ultimately, the symbolic reconstitution of that urban space. In this way, hosts were refiguring transnational urban space by writing themselves and their labor back into the district’s meaning, even as the global forces of tourism and urban renewal threatened to displace them.

In conclusion, we seek to highlight how critical research insists on the interplay of reflexivity, process, and practice. In particular, we encourage critical researchers to be mindful of the multiple meanings and usages of the term “critical” so that we can make more explicit our political interests and stand within our disciplines, the academy, our community, and the world. We offer dialectical materialism as a distinct mode of critical analysis that emphasizes an analysis of change in essence, practice, and struggle. We also suggest that, for researchers to be critical in their research, they should strive to take up research questions and projects that study change, contradictions, struggle, and practice in order to counter dominant interests and advance the well-being of the world’s majority. We should strive to build new research relationships—such as overcoming the faulty divides between researchers and research participants and by promoting systems of community accountability—that dialectically fuse research, political activism, and progressive social change.

Furthermore, we suggest that critical research can agitate against the homogeneity of ethnographic representation, allowing for the realities of people’s lives to come into view. Critical researchers recognize the contested fields of research; yet this requires our critical engagement with the research process, as a reflexive, empathetic, collective, self-altering, socially transformative, and embedded exercise in knowledge production. Therefore, critical research can resist imperialist research practices that are disembodied and that assume a singular social positioning. We use an imperative here to say that we must conduct research as embodied subjects who shift between multiple and limited locations. We also have to find more ways to remain accountable to our communities of research as a way to undo implicit imperialisms in social research. Critical research can work against the remnants of an objectivist and truth-seeking method that supports prevailing interests, classes, and groups while embracing research from social locations that offer situated knowledges and the possibility for greater shared understandings. Finally, critical research can engage the micropolitics of research and foreground the need for the accountability of researchers to resist reproducing epistemic violence.

This last is an idealist imagining of what should happen. However, a number of research projects have approximated closely to these goals.

Parts of our argument have appeared in some of our earlier work (e.g., Bhavnani & Talcott, 2011 ; Collins, 2009 ; 2002 ; Chua, 2001 ).

Although we, as the chapter’s three authors, do not usually use “we” in our writing as a general pronoun, it is the most direct way to offer our insights in this section.

Adorno, T. W. ( 1973 ). Negative dialectics . London: Routledge and Kegan Paul.

Google Scholar

Google Preview

Alcoff, L. , & Potter, E. (Eds.). ( 1993 ). Feminist epistemologies . New York: Routledge.

Asad, T. (Ed.). ( 1973 ). Anthropology and the colonial encounter . London: Ithaca Press.

Behar, R. ( 1993 ). Translated women: Crossing the border with Esperanza’s story . Boston: Beacon Press.

Bhavnani, K. -K. ( 1993 ). Tracing the contours: Feminist research and feminist Objectivity.   Women’s Studies International Forum , 16 (2), 95–104.

Bhavnani, K. -K. , Foran, J. , & Kurian, P. (Eds.). ( 2003 ). Feminist futures: Re-imagining women, culture, and development . London: Zed Books.

Bhavnani, K. -K. , & Talcott, M. ( 2011 ). Interconnections and configurations: Towards a global feminist ethnography. In S. N. Hesse-Biber (Ed.), Handbook of feminist research: Theory and praxis (pp. 176–186). Thousand Oaks, CA: Sage Publications.

Bonacich, E. ( 1998 ). Reflections on union activism.   Contemporary Sociology , 27 (2), 129–132.

Bonacich, E. , & Wilson, J. B. ( 2008 ). Getting the goods: Ports, labor, and logistics revolution . Cornell, NY: Cornell University Press.

Boserup, E.   1970 . Women’s Role in Economic Development . New York: St. Martin’s Press.

Browne, K. , & Nash, C. J. (Eds.). ( 2010 ). Queer methods and methodologies: Intersecting queer theories and social science research . Burlington, VA: Ashgate Publishing Company.

Burawoy, M. ( 1998 ). The extended case method.   Sociological Theory , 16 (1), 4–33.

Burawoy, M. ( 2003 ). Revisits: Outline of a theory of reflexive ethnography.   American Sociological Review , 68 , 645–679.

Carroll, W. (Ed.). ( 2004 ). Critical strategies for social research . Ontario: Canadian Scholars Press.

Carspecken, P. F. ( 1996 ). Critical Ethnography in Educational Research: A theoretical and practical guide . New York: Routledge.

Carruyo, L. ( 2011 ). Producing knowledge, protecting forests: Rural encounters with gender, ecotourism, and international aid in the Dominican Republic . Philadelphia: Penn State University Press.

Choudry, A. ( 2011 ). On knowledge, learning and research in struggle. In C. Fanelli & P. Lefebvre (Eds.), Uniting struggles: Critical social research in critical times (pp. 175– 194). Ontario: Red Quill Books.

Clifford, J. ( 1998 ). The predicament of culture: Twentieth-century ethnography, literature, and art . Cambridge, MA: Harvard University Press.

Chua, P. (2001). Condom matters and social inequalities: Inquiries into condom production, exchange, and advocacy practices . PhD. dissertation, Department of Sociology, University of California, Santa Barbara, CA.

Chua, P. ( 2006 ). Bloodshed and coercive communal peace negotiations. In R. Tolentino & S. Raymundo (Eds.), Kontra-gahum: Academics against political killings (pp. 42–57). Quezon City, Philippines: IBON Publishing.

Chua, P. ( 2007 ). Corporatizing public education in the Philippines: The case of USAID and the Ayala Foundation. In B. Lumbera , R. Guillermo , & A. Alamon (Eds.), Mula Tore Patungong Palengke: Neoliberal education in the Philippines (pp. 115–125). Quezon City, Philippines: IBON Publishing.

Chua, P. ( 2012 ). National schooling in crisis: Neoliberal policies and the 2011 justice campaign for the PGCPS Filipino overseas contract teachers.   Pingkian , 1 (1), 45–58.

Collins, D. M. (2002). Laboring districts, pleasuring sites: Hospitality, “gay” life, and the production of urban sexual space in Manila . Ph.D. dissertation, Department of Sociology, University of California, Santa Barbara, CA.

Collins, D. ( 2005 ). Identity, mobility, and urban placemaking: Exploring gay life in Manila.   Gender and Society , 19 (2), 180–198.

Collins, D. ( 2007 ). When sex work isn’t “work”: Hospitality, gay life, and the production of desiring labor.   Tourist Studies , 7 (2), 115–139.

Collins, D. ( 2009 ). “ We’re there and queer”: Homonormative mobility and lived experience among gay expatriates in Manila.   Gender and Society , 23 (4), 465–493.

Comaroff, J. , & Comaroff, J. L. ( 2012 ). Theory from the South: How Euro-America is evolving towards Africa . Boulder, CO: Paradigm Publishers.

D’Souza, R. ( 2009 ). The prison houses of knowledge: Activist scholarship and revolution in the era of globalization.   McGill Journal of Education , 44 (1), 19–38.

Degiuli, F. ( 2007 ). A job with no boundaries: Home eldercare work in Italy.   European Journal of Women’s Studies , 14 (3), 193–207.

Delanty, G. ( 2005 ). Social science: Philosophical and methodological foundations (2nd ed.). Berkshire, UK: Open University Press.

Denzin, N. K. ( 2001 ). Interpretive interactionism . Thousand Oaks, CA. Sage Publications.

Engels, F. (1877/ 1969 ). Anti-Dühring . London: Lawrence and Wishart.

Fernandes, L. ( 2003 ). Transforming feminist practice: Non-violence, social justice, and the possibilities of a spiritualized feminism . San Francisco: Aunt Lute Books.

Fonow, M. M. , & Cook, J. A. (Eds.). ( 1991 ). Beyond methodology: Feminist scholarship as lived research . Bloomington: Indiana University Press.

Giroux, H. A. ( 2009 ). Democracy’s nemesis. The rise of the corporate university.   Cultural Studies ↔ Critical Methodologies , 9 (5), 669–695.

Gouldner, A. ( 1970 ). The coming crisis of American sociology . New York: Basic Books.

Gramsci, A. ( 1971 ). Selections from the prison notebooks of Antonio Gramsci . ( Q. Hoare & G. N. Smith , Eds. & Trans.). New York: International Publishers.

Greenwood, D. J. ( 2012 ). Doing and learning action research in the neo-liberal world of contemporary higher education.   Action Research , 10 (2), 115–132.

Guenther, K. M. ( 2009 ). The impact of emotional opportunities on the emotion cultures of feminist organizations.   Gender and Society , 23 (3), 337–362.

Habermas, J. ( 1985 ). The theory of communicative action: vol. 2: Lifeword and system: A critique of functionalist reason . Boston: Beacon Press.

Haraway, D. ( 1988 ). Situated knowledges: The science question in feminism and the privilege of partial perspective.   Feminist Studies , 14 (3), 575–599.

Harding, S. ( 1991 ). Whose science? Whose knowledge? Ithaca: Cornell University Press.

Harvey, D. ( 1996 ). Justice, nature, and the geography of difference . Cambridge, MA: Blackwell Publisher.

Harvey, L. ( 1990 ). Critical social research . London: Routledge.

Hesse-Biber, S. N. , & Leavy, P. ( 2006 ). The practice of qualitative research . Thousand Oaks, CA: Sage Publications.

Ho, K. ( 2009 ). Liquidated: An Ethnography of Wall Street . Durham: Duke University Press.

Hondagneu-Sotelo, P. ( 2007 ). Domestica: Immigrant workers cleaning and caring in the shadows of affluence (2nd ed.). Berkeley: University of California Press.

Hunter, L. , Emerald, E. , & Martin, G. ( 2013 ). Participatory activist research in the globalised world . Düsseldorf: Springer.

Hussey, I. ( 2012 ). “Political activist as ethnographer” revisited.   Canadian Journal of Sociology , 37 (1), 1–23.

Jordan, S. , & Yeomans, D. ( 1995 ). Critical ethnography: Problems in contemporary theory and practice.   British Journal of Sociology of Education , 16 (3), 389–408.

Kant, I. (1781/ 1965 ). The critique of pure reason . New York: St. Martins Press.

Kang, M. ( 2010 ). The managed hand: Race, gender, and the body in beauty service work . Berkeley: University of California Press.

Kondo, D. K. ( 1990 ). Crafting selves: Power, gender, and discourses of identity in a Japanese workplace . Chicago: University of Chicago Press.

Lenin, V. I. (1915/ 1977 ). On the question of dialectics. In Collected works (vol. 38, pp. 357–361). Moscow: Progress Publishers.

Lewin, E. , & Leap, W. L. (Eds.). ( 1996 ). Out in the field: Reflections of lesbian and gay anthropologists . Champaign, IL: University of Illinois Press.

Lodhia, S. ( 2010 ). Constructing an imperfect citizen-subject: Globalization, national “security,” and violence against South Asian women.   Women’s Studies Quarterly , 38 (1), 161–177.

Lukacs, G. ( 1971 ). History and class consciousness . ( R. Livingstone ,)Trans.. Cambridge, MA: MIT Press.

Mao, Z. ( 1990 ). Lecture notes on dialectical materialism . In N. Knight (Ed.), Mao Zedong on dialectical materialism: Writings on philosophy, 1937 (pp. 84–131). Armonk, NY: M. E. Sharpe.

Madison, D. S. ( 2012 ). Critical ethnography: Method, ethics, and performance (2nd ed.). Thousand Oaks, CA: Sage Publications.

Marchand, M. H. ( 1995 ). Latin American women speak on development: Are we listening yet? In M. H. Marchand & J. L. Parpart (Eds.), Feminism/postmodernism/development (pp. 56–72). London: Routledge.

Marcus, G. E. ( 1998 ). Ethnography through thick and thin . Princeton, NJ: Princeton University Press.

Marcuse, H. ( 1968 ). Negations: Essays in critical theory . Boston: Beacon Press.

Marx, K. (1845/ 1976 ). Thesis on Feuerbach. In Marx and Engels collected works (vol. 5, pp. 3–9). New York: International Publishers.

Mohanty, C. T. ( 2003 ). Feminism without borders: Decolonizing theory, practicing solidarity . Durham, NC: Duke University Press.

Reinharz, S. , & Davidman, L. (Eds.). ( 1992 ). Feminist methods in social research . New York: Oxford University Press.

Negri, A. ( 1999 ). Insurgencies: Constituent power and the modern state . Minneapolis, MN: University of Minnesota Press.

Noblit, G. W. , Flores, S. Y. , & Murillo, E. G. ( 2004 ). Postcritical ethnography: Reinscribing critique . New York: Hampton Press.

Novelli, M. ( 2006 ). Imagining research as solidarity and grassroots globalisation: A response to Appadurai (2001).   Globalisation, Societies and Education , 4 (2), 275–286.

Ollman, B. ( 2003 ). Dance of the dialectic: Steps in Marx’s method . Champaign, IL: University of Illinois Press.

Pavlidis, P. ( 2012 ). The antinomic condition of the university: “Universal labour” beyond “academic capitalism.”   Journal for Critical Education Policy Studies , 10 (2), 139–159.

Ray, R. ( 2006 ). Is the revolution missing or are we looking in the wrong places?   Social Problems , 53 (4), 459–465.

Reilly, K. ( 2009 ). Key concepts in ethnography . London: Sage Publications.

Quantz, R. A. ( 1992 ). On critical ethnography (with some postmodern considerations). In M. S. Lecompte , W. L. Millroy , & J. Preissle (Eds.), Handbook of qualitative research in education (pp. 447–505). San Diego, CA: Academic Press.

Skeggs, B. ( 1994 ). Situating the production of feminist ethnography. In M. Maynard (Ed.), Researching women’s lives from a feminist perspective (pp. 72–81). London: Routledge.

Smith, D. ( 2007 ). Institutional ethnography: From a sociology for women to a sociology of the people. In S. N. Hesse-Biber (Ed.), Handbook of feminist research: Theory and praxis (pp. 409–416). Thousand Oaks, CA: Sage Publications.

Smith, L. T. ( 1999 ). Decolonizing methodologies . London: Zed Books.

Stoecker, R. ( 2012 ). Research methods for community change: A project based approach (2nd ed.). Thousand Oaks, CA: Sage Publications.

Strydom, P. ( 2011 ). Contemporary critical theory and methodology . London: Routledge.

Talcott, M. ( 2010 ). As neoliberal crises persist, indigenous-led movements resist: Examining the current social and political-economic conjuncture in southern Mexico. In R. A. Dello Buono & D. Fasenfest (Eds.), Social change, resistance and social practices (pp. 131–148). Boston: Brill Publishers.

Thomas, J. ( 1993 ). Doing critical ethnography . Thousand Oaks, CA: Sage Publications.

Weis, L. , & Fine, M. ( 2012 ). Critical bifocality and circuits of privilege: Expanding critical ethnographic theory and design.   Harvard Educational Review , 82 (2), 173–201.

Williams, R. ( 1976 ). Keywords: A vocabulary of culture and society . New York: Oxford University Press.

Zinn, M. B. ( 1979 ). Field research in minority communities: Ethical, methodological and political observations by an insider.   Social Problems , 27 (2), 209–219.

• About Oxford Academic
• Publish journals with us
• University press partners
• What we publish
• New features  
• Open access
• Institutional account management
• Rights and permissions
• Get help with access
• Accessibility
• Advertising
• Media enquiries
• Oxford University Press
• Oxford Languages
• University of Oxford

Oxford University Press is a department of the University of Oxford. It furthers the University's objective of excellence in research, scholarship, and education by publishing worldwide

• Copyright © 2024 Oxford University Press
• Cookie settings
• Cookie policy
• Privacy policy
• Legal notice

This Feature Is Available To Subscribers Only

Sign In or Create an Account

This PDF is available to Subscribers Only

For full access to this pdf, sign in to an existing account, or purchase an annual subscription.

Have a language expert improve your writing

Run a free plagiarism check in 10 minutes, generate accurate citations for free.

• Knowledge Base
• Working with sources
• What Is Critical Thinking? | Definition & Examples

What Is Critical Thinking? | Definition & Examples

Published on May 30, 2022 by Eoghan Ryan . Revised on May 31, 2023.

Critical thinking is the ability to effectively analyze information and form a judgment .

To think critically, you must be aware of your own biases and assumptions when encountering information, and apply consistent standards when evaluating sources .

Critical thinking skills help you to:

• Identify credible sources
• Evaluate and respond to arguments
• Assess alternative viewpoints
• Test hypotheses against relevant criteria

Table of contents

Why is critical thinking important, critical thinking examples, how to think critically, other interesting articles, frequently asked questions about critical thinking.

Critical thinking is important for making judgments about sources of information and forming your own arguments. It emphasizes a rational, objective, and self-aware approach that can help you to identify credible sources and strengthen your conclusions.

Critical thinking is important in all disciplines and throughout all stages of the research process . The types of evidence used in the sciences and in the humanities may differ, but critical thinking skills are relevant to both.

In academic writing , critical thinking can help you to determine whether a source:

• Is free from research bias
• Provides evidence to support its research findings
• Considers alternative viewpoints

Outside of academia, critical thinking goes hand in hand with information literacy to help you form opinions rationally and engage independently and critically with popular media.

Prevent plagiarism. Run a free check.

Critical thinking can help you to identify reliable sources of information that you can cite in your research paper . It can also guide your own research methods and inform your own arguments.

Outside of academia, critical thinking can help you to be aware of both your own and others’ biases and assumptions.

Academic examples

However, when you compare the findings of the study with other current research, you determine that the results seem improbable. You analyze the paper again, consulting the sources it cites.

You notice that the research was funded by the pharmaceutical company that created the treatment. Because of this, you view its results skeptically and determine that more independent research is necessary to confirm or refute them. Example: Poor critical thinking in an academic context You’re researching a paper on the impact wireless technology has had on developing countries that previously did not have large-scale communications infrastructure. You read an article that seems to confirm your hypothesis: the impact is mainly positive. Rather than evaluating the research methodology, you accept the findings uncritically.

Nonacademic examples

However, you decide to compare this review article with consumer reviews on a different site. You find that these reviews are not as positive. Some customers have had problems installing the alarm, and some have noted that it activates for no apparent reason.

You revisit the original review article. You notice that the words “sponsored content” appear in small print under the article title. Based on this, you conclude that the review is advertising and is therefore not an unbiased source. Example: Poor critical thinking in a nonacademic context You support a candidate in an upcoming election. You visit an online news site affiliated with their political party and read an article that criticizes their opponent. The article claims that the opponent is inexperienced in politics. You accept this without evidence, because it fits your preconceptions about the opponent.

There is no single way to think critically. How you engage with information will depend on the type of source you’re using and the information you need.

However, you can engage with sources in a systematic and critical way by asking certain questions when you encounter information. Like the CRAAP test , these questions focus on the currency , relevance , authority , accuracy , and purpose of a source of information.

When encountering information, ask:

• Who is the author? Are they an expert in their field?
• What do they say? Is their argument clear? Can you summarize it?
• When did they say this? Is the source current?
• Where is the information published? Is it an academic article? Is it peer-reviewed ?
• Why did the author publish it? What is their motivation?
• How do they make their argument? Is it backed up by evidence? Does it rely on opinion, speculation, or appeals to emotion ? Do they address alternative arguments?

Critical thinking also involves being aware of your own biases, not only those of others. When you make an argument or draw your own conclusions, you can ask similar questions about your own writing:

• Am I only considering evidence that supports my preconceptions?
• Is my argument expressed clearly and backed up with credible sources?
• Would I be convinced by this argument coming from someone else?

If you want to know more about ChatGPT, AI tools , citation , and plagiarism , make sure to check out some of our other articles with explanations and examples.

• ChatGPT vs human editor
• ChatGPT citations
• Is ChatGPT trustworthy?
• Using ChatGPT for your studies
• What is ChatGPT?
• Chicago style
• Paraphrasing

 Plagiarism

• Types of plagiarism
• Self-plagiarism
• Avoiding plagiarism
• Academic integrity
• Consequences of plagiarism
• Common knowledge

The only proofreading tool specialized in correcting academic writing - try for free!

The academic proofreading tool has been trained on 1000s of academic texts and by native English editors. Making it the most accurate and reliable proofreading tool for students.

Try for free

Critical thinking refers to the ability to evaluate information and to be aware of biases or assumptions, including your own.

Like information literacy , it involves evaluating arguments, identifying and solving problems in an objective and systematic way, and clearly communicating your ideas.

Critical thinking skills include the ability to:

You can assess information and arguments critically by asking certain questions about the source. You can use the CRAAP test , focusing on the currency , relevance , authority , accuracy , and purpose of a source of information.

Ask questions such as:

• Who is the author? Are they an expert?
• How do they make their argument? Is it backed up by evidence?

A credible source should pass the CRAAP test  and follow these guidelines:

• The information should be up to date and current.
• The author and publication should be a trusted authority on the subject you are researching.
• The sources the author cited should be easy to find, clear, and unbiased.
• For a web source, the URL and layout should signify that it is trustworthy.

Information literacy refers to a broad range of skills, including the ability to find, evaluate, and use sources of information effectively.

Being information literate means that you:

• Know how to find credible sources
• Use relevant sources to inform your research
• Understand what constitutes plagiarism
• Know how to cite your sources correctly

Confirmation bias is the tendency to search, interpret, and recall information in a way that aligns with our pre-existing values, opinions, or beliefs. It refers to the ability to recollect information best when it amplifies what we already believe. Relatedly, we tend to forget information that contradicts our opinions.

Although selective recall is a component of confirmation bias, it should not be confused with recall bias.

On the other hand, recall bias refers to the differences in the ability between study participants to recall past events when self-reporting is used. This difference in accuracy or completeness of recollection is not related to beliefs or opinions. Rather, recall bias relates to other factors, such as the length of the recall period, age, and the characteristics of the disease under investigation.

Cite this Scribbr article

If you want to cite this source, you can copy and paste the citation or click the “Cite this Scribbr article” button to automatically add the citation to our free Citation Generator.

Ryan, E. (2023, May 31). What Is Critical Thinking? | Definition & Examples. Scribbr. Retrieved April 12, 2024, from https://www.scribbr.com/working-with-sources/critical-thinking/

Is this article helpful?

Eoghan Ryan

Other students also liked, student guide: information literacy | meaning & examples, what are credible sources & how to spot them | examples, applying the craap test & evaluating sources, unlimited academic ai-proofreading.

✔ Document error-free in 5minutes ✔ Unlimited document corrections ✔ Specialized in correcting academic texts

Glasgow School  for Business and Society

The Glasgow School for Business and Society integrates the areas of business, law and social sciences to ensure that they are well placed to meet the needs of business and society. The School has an international outlook and is committed to developing partnerships across the world.

Critical analysis

Critical analysis essentially involves reading and thinking widely about an issue in order to develop a deep understanding and a point of view in relation to the issue. Students coming from school and college tend to see this in terms of pros and cons, or advantages and disadvantages and this is a useful starting point at Levels 1 and 2.

However, as you progress to Level 3 and beyond, you are expected to demonstrate a more sophisticated approach to critical analysis. This involves:

• identifying a range of relevant concepts, theories and models which help you understand an issue
• identifying relevant issues and sub-issues and associated problems, benefits, challenges, drawbacks, limitations
• showing that you understand the different perspectives presented in the literature around these issues, concepts, theories and models
• showing that you recognise the weight of these perspectives in the literature – what is the consensus of opinion on an issue or perspective? Is there broad agreement on an issue, is opinion roughly equally divided, or is a perspective held by only one or two writers?

At its heart, critical analysis involves asking questions: "What...", "How...", "Why...", "So what..."

You will read a variety of sources throughout your degree programme: textbooks, research articles, government and corporate reports, policy documents, organisational websites. It is useful to have in mind questions as you explore the definitions, key points of view/arguments, theories/models and policies discussed in these sources.

Click on this link for  examples of questions that can direct critical analysis

Writing about definitions

Writing critically about theory or models

• The Open University
• Guest user / Sign out
• Study with The Open University

My OpenLearn Profile

Personalise your OpenLearn profile, save your favourite content and get recognition for your learning

About this free course

Become an ou student, download this course, share this free course.

Start this free course now. Just create an account and sign in. Enrol and complete the course for a free statement of participation or digital badge if available.

4 The importance of critical thinking and analysis in academic studies

The aim of critical thinking is to try to maintain an objective position. When you think critically, you weigh up all sides of an argument and evaluate its strengths and weaknesses. So, critical thinking entails: actively seeking all sides of an argument, testing the soundness of the claims made, as well as testing the soundness of the evidence used to support the claims.

Box 1 What ‘being critical’ means in the context of critical thinking

Critical thinking is not :

• restating a claim that has been made
• describing an event
• challenging peoples’ worth as you engage with their work
• criticising someone or what they do (which is made from a personal, judgemental position).

Critical thinking and analysis are vital aspects of your academic life – when reading, when writing and working with other students.

While critical analysis requires you to examine ideas, evaluate them against what you already know and make decisions about their merit, critical reflection requires you to synthesise different perspectives (whether from other people or literature) to help explain, justify or challenge what you have encountered in your own or other people’s practice. It may be that theory or literature gives us an alternative perspective that we should consider; it may provide evidence to support our views or practices, or it may explicitly challenge them.

You will encounter a number of activities and assignments in your postgraduate studies that frequently demand interpretation and synthesis skills. We introduced such an activity in Session 1 (Activity 3). Part of this requires use of ‘higher-order thinking skills’, which are the skills used to analyse and manipulate information (rather than just memorise it). In the 1950s, Benjamin Bloom identified a set of important study and thinking skills for university students, which he called the ‘thinking triangle’ (Bloom, 1956) (Figure 1). Bloom’s taxonomy can provide a useful way of conceptualising higher-order thinking and learning. The six intellectual domains, their descriptions and associated keywords are outlined in Table 1.

This figure shows a pyramid with the following words, from top to bottom: evaluation (assessing theories; comparison of ideas; evaluating outcomes; solving; judging; recommending; rating), synthesis (using old concepts to create new ideas; design and invention; composing; imagining; inferring; modifying; predicting; combining), analysis (identifying and analysing patterns; organisation of ideas; recognising trends), application (using and applying knowledge; using problem solving methods; manipulating; designing; experimenting), comprehension (understanding; translating; summarising; demonstrating; discussing), knowledge (recall of information; discovery; observation; listing; locating; naming).

• USC Libraries
• Research Guides

Organizing Your Social Sciences Research Paper

• Applying Critical Thinking
• Purpose of Guide
• Design Flaws to Avoid
• Independent and Dependent Variables
• Glossary of Research Terms
• Reading Research Effectively
• Narrowing a Topic Idea
• Broadening a Topic Idea
• Extending the Timeliness of a Topic Idea
• Academic Writing Style
• Choosing a Title
• Making an Outline
• Paragraph Development
• Research Process Video Series
• Executive Summary
• The C.A.R.S. Model
• Background Information
• The Research Problem/Question
• Theoretical Framework
• Citation Tracking
• Content Alert Services
• Evaluating Sources
• Primary Sources
• Secondary Sources
• Tiertiary Sources
• Scholarly vs. Popular Publications
• Qualitative Methods
• Quantitative Methods
• Insiderness
• Using Non-Textual Elements
• Limitations of the Study
• Common Grammar Mistakes
• Writing Concisely
• Avoiding Plagiarism
• Footnotes or Endnotes?
• Further Readings
• Generative AI and Writing
• USC Libraries Tutorials and Other Guides
• Bibliography

Critical thinking refers to deliberately scrutinizing and evaluating theories, concepts, or ideas using reasoned reflection and analysis. The act of thinking critically implies moving beyond simply understanding information, but questioning its source, its production, and its presentation in order to expose potential bias or researcher subjectivity [i.e., being influenced by personal opinions and feelings rather than by external determinants ] . Applying critical thinking to investigating a research problem involves actively challenging assumptions and questioning the choices and potential motives underpinning how the author designed the study, conducted the research, and arrived at particular conclusions or recommended courses of action.

Mintz, Steven. "How the Word "Critical" Came to Signify the Leading Edge of Cultural Analysis." Higher Ed Gamma Blog , Inside Higher Ed, February 13, 2024; Van Merriënboer, Jeroen JG and Paul A. Kirschner. Ten Steps to Complex Learning: A Systematic Approach to Four-component Instructional Design . New York: Routledge, 2017.

Thinking Critically

Applying Critical Thinking to Research and Writing

Professors like to use the term critical thinking; in fact, the idea of being critical permeates much of higher education writ large. In the classroom, the idea of thinking critically is often mentioned by professors when students ask how they should approach a research and writing assignment [other approaches your professor might mention include interdisciplinarity, comparative, gendered, global, etc.]. However, critical thinking is more than just an approach to research and writing. It is an acquired skill used in becoming a complex learner capable of discerning important relationships among the elements of, as well as integrating multiple ways of understanding applied to, the research problem. Critical thinking is a lens through which you holistically interrogate a topic.

Given this, thinking critically encompasses a variety of inter-related connotations applied to college-level research and writing * :

• Integrated and Multi-Dimensional . Critical thinking is not focused on any one element of research, but rather, is applied holistically throughout the process of identifying the research problem, reviewing of literature, applying methods of analysis, describing the results, discussing their implications, and, if appropriate, offering recommendations for further research. The act of thinking critically is also non-linear [i.e., applies to going back and changing prior thoughts when new evidence emerges]; it permeates the entire research endeavor from contemplating what to write to proofreading the final product.
• Humanize Research . Thinking critically can help humanize the research problem by extending the scope of your analysis beyond the boundaries of traditional approaches to studying the topic. Traditional approaches can include, for example, sampling homogeneous populations, considering only certain factors related to investigating a phenomenon, or limiting the way you frame or represent the context of your study. Critical thinking can help reveal opportunities to incorporate the experiences of others into the research, creating a more representative examination of the research problem.
• Normative . This refers to the idea that critical thinking can be used to challenge prior assumptions in ways that advocate for social justice, equity, and inclusion and which can lead to research having a more transformative and expansive impact. In this respect, critical thinking can be a method for breaking away from dominant culture norms so as to produce research outcomes that illuminate previously hidden aspects of exploitation and injustice.
• Power Dynamics . Research in the social and behavioral sciences often includes examining aspects of power and influence that shape social relations, organizations, institutions, and the production and maintenance of knowledge. This approach encompasses studying how power operates, how it can be acquired, and how power and influence can be maintained. Critical thinking can reveal how societal structures perpetuate power and influence in ways that marginalizes and oppresses certain groups or communities within the contexts of history , politics, economics, culture, and other factors.
• Reflection . A key aspect of critical thinking is practicing reflexivity; the act of turning ideas and concepts back onto yourself in order to reveal and clarify your own beliefs, assumptions, and perspectives. Being critically reflexive is important because it can reveal hidden biases you may have that could unintentionally influence how you interpret and validate information. The more reflexive you are, the better able and more comfortable you are about opening yourself up to new modes of understanding.
• Rigorous Questioning . Thinking critically is guided by asking questions that lead to addressing complex concepts, principles, theories, or problems more effectively and to help distinguish what is known from from what is not known [or that may be hidden]. In this way, critical thinking involves deliberately framing inquiries not just as research questions, but as a way to focus on systematic, disciplined,  in-depth questioning concerning the research problem and your positionality as a researcher.
• Social Change . An overarching goal of critical thinking applied to research and writing is to seek to identify and challenge sources of inequality, exploitation, oppression, and marinalization that contributes to maintaining the status quo within institutions of society. This can include entities, such as, schools, courts, businesses, government agencies, religious centers, that have been created and maintained through certain ways of thinking within the dominant culture.

In writing a research paper, the act of critical thinking applies most directly to the literature review and discussion sections of your paper . In reviewing the literature, it is important to reflect upon specific aspects of a study, such as, determining if the research design effectively establishes cause and effect relationships or provides insight into explaining why certain phenomena do or do not occur, assessing whether the method of gathering data or information supports the objectives of the study, and evaluating if the assumptions used t o arrive at a specific conclusion are evidence-based and relevant to addressing the research problem. An assessment of whether a source is helpful to investigating the research problem also involves critically analyzing how the research challenges conventional approaches to investigations that perpetuate inequalities or hides the voices of others.

Critical thinking also applies to the discussion section of your paper because this is where you interpret the findings of your study and explain its significance. This involves more than summarizing findings and describing outcomes. It includes reflecting on their importance and providing reasoned explanations why the research study is important in filling a gap in the literature or expanding knowledge and understanding about the topic in ways that inform practice. Critical reflection helps you think introspectively about your own beliefs concerning the significance of the findings but in ways that avoid biased judgment and decision making.

* Mintz, Steven. "How the Word "Critical" Came to Signify the Leading Edge of Cultural Analysis." Higher Ed Gamma Blog , Inside Higher Ed, February 13, 2024; Suter, W. Newton. Introduction to Educational Research: A Critical Thinking Approach. 2nd edition. Thousand Oaks, CA: SAGE Publications, 2012

Behar-Horenstein, Linda S., and Lian Niu. “Teaching Critical Thinking Skills in Higher Education: A Review of the Literature.” Journal of College Teaching and Learning 8 (February 2011): 25-41; Bayou, Yemeserach and Tamene Kitila. "Exploring Instructors’ Beliefs about and Practices in Promoting Students’ Critical Thinking Skills in Writing Classes." GIST–Education and Learning Research Journal 26 (2023): 123-154; Butcher, Charity. "Using In-class Writing to Promote Critical Thinking and Application of Course Concepts." Journal of Political Science Education 18 (2022): 3-21; Loseke, Donileen R. Methodological Thinking: Basic Principles of Social Research Design. Thousand Oaks, CA: Sage, 2012; Hart, Claire et al. “Exploring Higher Education Students’ Critical Thinking Skills through Content Analysis.” Thinking Skills and Creativity 41 (September 2021): 100877; Sabrina, R., Emilda Sulasmi, and Mandra Saragih. "Student Critical Thinking Skills and Student Writing Ability: The Role of Teachers' Intellectual Skills and Student Learning." Cypriot Journal of Educational Sciences 17 (2022): 2493-2510.Van Merriënboer, Jeroen JG and Paul A. Kirschner. Ten Steps to Complex Learning: A Systematic Approach to Four-component Instructional Design. New York: Routledge, 2017; Yeh, Hui-Chin, Shih-hsien Yang, Jo Shan Fu, and Yen-Chen Shih. "Developing College Students’ Critical Thinking through Reflective Writing." Higher Education Research & Development 42 (2023): 244-259.

• << Previous: Academic Writing Style
• Next: Choosing a Title >>
• Last Updated: Apr 11, 2024 1:27 PM
• URL: https://libguides.usc.edu/writingguide

• Request Info
• Resource Library

What Is Policy Analysis? A Critical Concept in Public Administration

Policy Analysis at a Glance

Social, economic, and political variables influence policy decisions and outcomes in public administration. To develop, adopt, and implement policies that have the greatest benefits, individuals in public administration must master the concept of policy analysis.

What is policy analysis? According to Encyclopedia Britannica, it is the examination and evaluation of available options to address various economic, social, or other public issues. Effective policy analysis, whether to enact new policies or amending existing ones, is critical in the policymaking process. The process includes many facets, involving empirical research and statistical data collection, as well as the participation of key stakeholders such as economists, community members, and public officials tasked with enacting policy.

Pursuing a Master of Public Administration (MPA) degree can provide students with the foundation to apply this critical skill to a career in public administration.

Modern society is complex and growing more so every day. Governments rely on a robust array of policies to address a web of interconnected challenges related to issues like public safety, education, and infrastructure. Individuals involved in public administration may find it challenging to identify the best way to tackle those challenges. What is the most effective way to improve air quality? How can a society optimize access to education? How should a municipal government pay for an expensive infrastructure project?

These questions often have multiple answers. Policy analysis can help determine the best option that will produce the most desirable result. What policy analysis does is help lay out the goals of a potential policy, examine the various strengths and weaknesses of each policy option, and identify the most viable one. For example, when determining how to pay for a costly infrastructure project, a policy analysis would consider the various methods to do so. Raising taxes could be one solution. Cutting the budget for a department or reallocating funds from a different project may be another. Through policy analysis, those in public administration can identify the best solution.

Public Policy Keeps Changing

Public policy is subject to the surrounding political, social, and economic conditions. This dynamic underscores the need for ongoing policy analysis. A policy enacted five or even two years ago may no longer be relevant. Therefore, administrators must regularly evaluate policies that address both present and future concerns.

Policy Analysis in Corporations

While policy analysis is a feature of public administration, private enterprises employ it. For example, corporate policies regarding the privacy of consumer and employee data are subject to evolving laws and regulations. Failing to update these policies can put businesses at risk of legal action.

While the public policy in its development stage is theoretical, its implementation is tangible and has a real-world impact. As such policy analysts should involve key stakeholders throughout the process. Stakeholders may include economists who can examine the cost-benefit ratio of a particular policy, community partners who can provide context and assess a policy’s real or potential impact, and government officials who will implement policy and can speak to its feasibility. When the policy process involves stakeholders before implementation, policymakers can avoid misunderstandings and increase the likelihood of success, according to the World Health Organization (WHO).

The Benefits of Policy Analysis for Public Administrators

Effective policy analysis relies heavily on empirical research, pulling from both qualitative and quantitative sources. Personal interviews with policymakers and community partners constitute the former and provide valuable context. These firsthand accounts can explain how the proposed policy would affect members of the community, its potential economic and budgetary impact, as well as the legal and political landscape that surrounds the policy.

Qualitative research may also involve a literature review that examines the existing body of research on a particular policy issue. Analysts can identify current policy options as well as gaps in existing research to further narrow options and solutions. This type of research empowers policy analysts to learn important lessons from past policy attempts, both successful and unsuccessful. A proposed policy may seem innovative and cost-effective, but a literature review of past attempts may illuminate potential pitfalls.

Different from qualitative research, the quantitative study involves statistical data review and cost-benefit analysis, comparing the potential benefits of a policy with its expected or known costs. While conducted in monetary terms, many aspects of public policy may not be easily measured in dollars and cents.

A human element is involved in the creation of any policy. Both the officials responsible for implementing policy and those it impacts can influence a policy’s outcome. Cost-benefit analyses can fail to capture those nuances, which is why personal interviews (a form of qualitative research) also are an important part of the process.

Environmental scans are another aspect of forecasting policy options. The Centers for Disease Control and Prevention (CDC) defines an environmental scan as the collection of information about events, trends, and expectations that have the potential to influence the policy process.

Health care organizations frequently use environmental scans. For example, Public Health Ontario performed an environmental scan as part of its policy analysis when examining how to safely reopen schools during the COVID-19 pandemic. Based on the results, the health care institution was able to identify how other jurisdictions approached reopening schools, examine variables, and make an informed policy decision about the safest way to reopen schools.

How to Develop the Skills of Policy Analysis

Through Norwich University’s online MPA program and its Policy Analysis and Analytics concentration, those who are interested in a public administration career can cultivate the skills to conduct effective policy analysis. The curriculum provides the opportunity to analyze data, build decision-making skills, and use real-world software for data analysis through the following core and concentration-specific courses:

Foundations of Public Administration and Policy              

This core course focuses on governance, intergovernmental relationships, policies, and strategic planning, plus the influence of variables such as politics, social change, and fiscal constraints. It also introduces fundamental concepts including the role of leadership and the need for ethics and accountability in public administration. Students in this course will hone their skills in critical analysis, research, and writing.

Public Administration Research and Analysis

Students learn the methodologies of public administration research—including surveys, case studies, and interviews — and their application to policy development and evaluation. The course also highlights quantitative and qualitative statistical techniques commonly used in public administration and social science research.

Methods of Policy Analysis

This concentration course explores various policy analysis methodologies and how they can help individuals better understand complex policy issues. The curriculum examines multidisciplinary research strategies, data collection and analysis, establishing evaluation criteria, and identifying policy alternatives.

Tools for Policy Analysis

Students in this concentration examine the tools and techniques associated with policy analysis, such as scientific research, design, implementation, and evaluation. This course instructs participants on analyzing policies and making recommendations at all levels of government as well as the nonprofit sector. It also teaches various software applications used in data collection and analysis.

Pursue a Career in Policy Analysis

The ability to conduct effective policy analysis is one of the most fundamental skills policymakers need and critical to success in any public administration role. The Policy Analysis and Analytics concentration offered through the Norwich University online MPA program teaches the skills to master policy analysis and its many facets.

Learn more about how Norwich University provides students with the foundation to pursue a rewarding career in public administration.

Policy Analysis , Britannica Importance of Policy Evaluation , Houston Chronicle Environmental Scan of School Reopening During COVID-19 , Public Health Ontario  

Explore Norwich University

Your future starts here.

• 30+ On-Campus Undergraduate Programs
• 16:1 Student-Faculty Ratio
• 25+ Online Grad and Undergrad Programs
• Military Discounts Available
• 22 Varsity Athletic Teams

Future Leader Camp

Join us for our challenging military-style summer camp where we will inspire you to push beyond what you thought possible:

• Session I July 13 - 21, 2024
• Session II July 27 - August 4, 2024

Explore your sense of adventure, have fun, and forge new friendships. High school students and incoming rooks, discover the leader you aspire to be – today.

National Center for Science and Engineering Statistics

• Report PDF (588 KB)
• Report - All Formats .ZIP (2.2 MB)
• Share on X/Twitter
• Share on Facebook
• Share on LinkedIn
• Send as Email

International Collaboration in Selected Critical and Emerging Fields: COVID-19 and Artificial Intelligence

April 11, 2024

Research collaboration is a critical strategy for pooling resources, sharing expertise, and accelerating innovation, and institutions may use collaboration to synthesize novel ideas and bridge knowledge or material gaps (Katz and Hicks 1997; Lee, Walsh, and Wang 2015; Wagner et al. 2001). Ongoing research on the transformative potential of artificial intelligence (AI) and the mitigation and treatment of COVID-19 in 2020 are two cases in which scientific progress has been important. Both fields have been recognized as national priorities ( https://www.whitehouse.gov/priorities/ ) and have complex challenges that both domestic and international institutions are motivated to overcome.

A country’s collaboration patterns, both domestic and international, can indicate the presence of expertise or the necessity of knowledge and resource sharing, as countries tend to collaborate internationally less in fields when they have sufficient resources within their own borders (Chinchilla-Rodríguez, Sugimoto, and Larivière 2019). International research collaboration can provide a rapid response to societal challenges, including public health crises (Carvalho et al. 2023) or technological paradigm shifts, and strong international collaborators play a large role in shaping the direction and priorities of research fields worldwide (Leydesdorff and Wagner 2009). A concentration on domestic research can indicate the presence of sufficient domestic knowledge and resources or an interest in preserving in-house expertise. This InfoBrief examines the extent to which top producers of science and engineering (S&E) articles engaged in domestic and international collaborations in AI and COVID-19 research.

Growth in Artificial Intelligence Articles

Between 2003 and 2022, the number of published articles in AI grew faster relative to the number of articles in computer science, table SPBS-22 in National Science Board, National Science Foundation. 2023. Publications Output: U.S. Trends and International Comparisons. Science and Engineering Indicators 2024. NSB-2023-33. Available at https://ncses.nsf.gov/pubs/nsb202333 ." data-bs-content="See table SPBS-22 in National Science Board, National Science Foundation. 2023. Publications Output: U.S. Trends and International Comparisons. Science and Engineering Indicators 2024. NSB-2023-33. Available at https://ncses.nsf.gov/pubs/nsb202333 ." data-endnote-uuid="5569bd18-3709-4dce-830a-89d0460f257a">​ See table SPBS-22 in National Science Board, National Science Foundation. 2023. Publications Output: U.S. Trends and International Comparisons. Science and Engineering Indicators 2024. NSB-2023-33. Available at https://ncses.nsf.gov/pubs/nsb202333 . due in part to the newness of the AI field compared with the more established field of computer science. AI articles worldwide grew by 1,100% during this period, reaching 123,402 articles in 2022, table SPBS-99 ." data-bs-content="See NSB-2023-33, table SPBS-99 ." data-endnote-uuid="5d5b3221-7e43-4793-83a8-dfe2d9c83207">​ See NSB-2023-33, table SPBS-99 . or 4% of all S&E publications globally, figure PBS-3 ." data-bs-content="See NSB-2023-33, figure PBS-3 ." data-endnote-uuid="dca1499d-57bb-40e0-8612-5666dde1c402">​ See NSB-2023-33, figure PBS-3 . compared with 290% growth in computer science articles. table SPBS-22 ." data-bs-content="See NSB-2023-33, table SPBS-22 ." data-endnote-uuid="7542a24d-409a-4612-abb1-2b561d8afe2b">​ See NSB-2023-33, table SPBS-22 . From 2017 to 2022, the six countries with the highest overall publication outputs figure PBS-3 ." data-bs-content="See NSB-2023-33, figure PBS-3 ." data-endnote-uuid="77e4b989-e695-4853-90bc-fe667d3a3ea4">​ See NSB-2023-33, figure PBS-3 . were also the countries with the highest AI research output (China, India, the United States, Japan, the United Kingdom, and Germany) ( figure 1 ). In 2022, the top two producers of AI research articles were China (42,524 articles, or 35% of total AI publication output) and India (22,557, or 18%), followed by the United States (12,642, or 10%). Germany, Japan, and the United Kingdom published similar numbers of publications, ranging between 3,700 and 4,700 articles (3% – 4%).

• For grouped bar charts, Tab to the first data element (bar/line data point) which will bring up a pop-up with the data details
• To read the data in all groups Arrow-Down will go back and forth
• For bar/line chart data points are linear and not grouped, Arrow-Down will read each bar/line data points in order
• For line charts, Arrow-Left and Arrow-Right will move to the next set of data points after Tabbing to the first data point
• For stacked bars use the Arrow-Down key again after Tabbing to the first data bar
• Then use Arrow-Right and Arrow-Left to navigate the stacked bars within that stack
• Arrow-Down to advance to the next stack. Arrow-Up reverses

AI articles, by selected country: 2003–22

AI = artificial intelligence.

AI article counts refer to publications from a selection of conference proceedings and peer-reviewed journals in science and engineering fields from Scopus. The subset of AI articles was determined by All Science Journal Classification subject matter classification, supplemented by an algorithm that used a series of article characteristics to determine the field of papers published in multidisciplinary journals. Articles are classified by their year of publication and are assigned to a region, country, or economy on the basis of the institutional addresses of the authors listed in the article. Articles are credited on a whole count basis (i.e., for articles produced by authors from different countries, each country is credited for one article). Data for all regions, countries, and economies are available in supplemental table SPBS-99 in Publications Output: U.S. Trends and International Comparisons ( https://ncses.nsf.gov/pubs/nsb202333/table/SPBS-99 ).

National Center for Science and Engineering Statistics; Science-Metrix; Elsevier, Scopus abstract and citation database, accessed April 2023.

Collaboration Trends in Artificial Intelligence Articles

Coauthorship trends on S&E articles shed light on overall collaboration practices. The affiliations of authors to their home institutions and countries are used to infer whether collaboration has occurred across institutions, both domestically and internationally. Three types of collaboration are detailed in this InfoBrief, and an article is the unit of analysis. An article with at least one author from an institution of a given country is classified as one of three categories: an international collaboration , if an author from any other country is present; a domestic collaboration , if all authors are from the same country, but are affiliated with more than one institution; or a single institution article if all authors share the same institutional affiliation or the article is solo authored.

Collaboration Trends

From 2017 to 2022, 37% of U.S. research papers on AI were the result of international collaboration, placing the United States between the five other top producers of AI research papers, with the United Kingdom (61%) and Germany (40%) producing a higher rate of internationally collaborative research and with Japan (25%), China (17%), and India (10%) producing a lower rate ( figure 2 ). Rates of international collaboration for the United States were slightly lower for AI research papers than for all S&E research papers (37% versus 39%). Likewise, across the other five top producers of AI research papers, rates of international collaboration were lower for AI research papers than for all S&E research papers. Compared with other countries, China had the greatest proportion of AI papers that were domestic collaborations (41%). Across the six top-producing countries, the rate of articles produced by a single institution were more common in AI research than in all S&E research (42% versus 26%).

International collaboration, domestic collaboration, and single institution publications on AI research and overall international collaboration on all S&E research, by selected country: 2017–22

AI = artificial intelligence; S&E = science and engineering.

AI articles are assigned to a country, or economy on the basis of the institutional addresses of the authors listed in the article. The subset of AI articles was determined by All Science Journal Classification subject matter classification, supplemented by an algorithm that used a series of article characteristics to determine the field of papers published in multidisciplinary journals. Articles are credited on a whole count basis (i.e., for articles produced by authors from different countries, each country is credited for one article). The percentages refer to the proportion of AI articles to feature collaboration or to the proportion of general articles across all fields to feature collaboration. Articles were excluded when one or more coauthored publications had incomplete address information in the Scopus database; therefore, they cannot be reliably identified as international or domestic collaborations. Data for all regions, countries, and economies are available in supplemental table SPBS-99 and supplemental table SPBS-33 in Publications Output: U.S. Trends and International Comparisons ( https://ncses.nsf.gov/pubs/nsb202333/table/SPBS-99 and https://ncses.nsf.gov/pubs/nsb202333/table/SPBS-33 ).

International Collaboration

Overall, scientific research has become increasingly collaborative over time (Gazni, Sugimoto, and Didegah 2012; Wuchty, Jones, and Uzzi 2007). Although the rate of international collaboration in AI publications has been smaller than the rate of international collaboration across all S&E fields over the past 5 years, international collaboration in AI articles has gradually increased overall between 2003 and 2022. By country, international collaborations in AI increased in Japan (from 15% to 28%), the United States (from 24% to 39%), Germany (from 37% to 42%), and the United Kingdom (from 36% to 66%) ( figure 3 ). Over this same time period, India and China did not show an increasing trend, despite some fluctuation. For example, after China exhibited a period of increased international collaboration in AI research, from 7% in 2009 to 23% in 2015, the rate has since decreased to 16% in 2022.

International collaboration on AI articles, by selected country: 2003–22

AI article counts refer to publications from a selection of conference proceedings and peer-reviewed journals in science and engineering fields from Scopus. The subset of AI articles was determined by All Science Journal Classification subject matter classification, supplemented by an algorithm that used a series of article characteristics to determine the field of papers published in multidisciplinary journals. Articles are assigned to a country, or economy on the basis of the institutional addresses of the authors listed in the article. Articles are credited on a whole count basis (i.e., for articles produced by authors from different countries, each country is credited for one article). The percentages refer to the proportion of AI articles to feature collaboration. Data for all regions, countries, and economies are available in supplemental table SPBS-99 in Publications Output: U.S. Trends and International Comparisons ( https://ncses.nsf.gov/pubs/nsb202333/table/SPBS-99 ).

Domestic Collaborations and Single Institution Publications

The proportion of single institution publications in AI decreased over time in the United States, from 48% in 2003 to 31% in 2022 ( figure 4 ). Despite this decrease, the proportion of U.S. single institution publications remained higher in AI research than in all S&E research, which decreased from 36% to 20% over the same time period. Over time, the rate of domestic collaboration in AI between U.S. institutions remained relatively stable from 2003 to 2022, ranging between 25% and 30%. In China, the proportion of single institution publications in AI decreased from 59% to 38% between 2003 and 2022, albeit with more fluctuation. China’s proportion of single institution publications both in AI papers and among all S&E fields were similar until 2007, after which the proportion of single institution papers in AI research became higher, while the overall proportion of single institution papers in all S&E research continued to decrease.

Collaborative and single institution articles on AI and single institution articles on all S&E research in the United States and China: 2003–22

Article counts refer to publications from a selection of conference proceedings and peer-reviewed journals in S&E fields from Scopus. The subset of AI articles was determined by All Science Journal Classification subject matter classification, supplemented by an algorithm that used a series of article characteristics to determine the field of papers published in multidisciplinary journals. Articles are assigned to a country, or economy on the basis of the institutional addresses of the authors listed in the article. Articles are credited on a whole count basis (i.e., for articles produced by authors from different countries, each country is credited for one article). The percentages refer to the proportion of AI articles to feature collaboration or to the proportion of general articles across all fields to feature collaboration. Articles were excluded when one or more coauthored publications had incomplete address information in the Scopus database; therefore, they cannot be reliably identified as international or domestic collaborations. Data for all regions, countries, and economies are available in supplemental table SPBS-99 and supplemental table SPBS-33 in Publications Output: U.S. Trends and International Comparisons ( https://ncses.nsf.gov/pubs/nsb202333/table/SPBS-99 and https://ncses.nsf.gov/pubs/nsb202333/table/SPBS-33 ).

COVID-19 Research Collaboration

In 2020, COVID-19 was identified as a national priority ( https://www.whitehouse.gov/priorities/ ), and this shifting priority in research may have impacted collaboration patterns for this research area in 2020. In the same year, 35% of the United States’ published research on COVID-19 involved international collaborations, which was lower than the rates in the United Kingdom (55%), Germany (52%), and Japan (45%) but was higher than the rates in China (27%) and India (28%) ( figure 5 ). The overall rates of international collaboration in the United Kingdom and Germany were higher for all S&E research than for COVID-19 research (65% and 55%, respectively).

International collaboration, domestic collaboration, and single institution publications on COVID-19 research and overall international collaboration on all S&E research, by selected country: 2020

S&E = science and engineering.

Article counts refer to publications from a selection of conference proceedings and peer-reviewed journals in S&E fields from Scopus. Articles are assigned to a country, or economy on the basis of the institutional addresses of the authors listed in the article. Articles are credited on a whole count basis (i.e., for articles produced by authors from different countries, each country is credited for one article). The percents refer to the proportion of COVID-19 articles to feature collaboration or to the proportion of general articles across all fields to feature collaboration. Articles were excluded when one or more coauthored publications had incomplete address information in the Scopus database; therefore, they cannot be reliably identified as international or domestic collaborations. Data for all regions, countries, and economies are available in supplemental table SPBS-91 and supplemental table SPBS-35 in Publications Output: U.S. Trends and International Comparisons ( https://ncses.nsf.gov/pubs/nsb202333/table/SPBS-91 and https://ncses.nsf.gov/pubs/nsb202333/table/SPBS-35 ).

National Center for Science and Engineering Statistics; Science-Metrix; Elsevier, Scopus abstract and citation database, accessed April 2021.

Although each of the top producing countries had a lower rate of international collaborations in AI research than in S&E research, the results were mixed for COVID-19. As the number of articles in AI has increased, the rate of international collaboration also increased. For COVID-19 collaborations in 2020, only some of the top producing countries had lower rates of international collaboration in AI research than in all S&E research.

Data Sources, Limitations, and Availability

Publication data are derived from a large database of publication records that were developed for Science and Engineering Indicators 2024, Publications Output: U.S. Trends and International Comparisons (NSB-2023-33), from the Scopus database by Elsevier. The publication counts and coauthorship information presented are derived from information about research articles and conference papers (hereafter referred to collectively as articles) published in conference proceedings and peer-reviewed scientific and technical journals. Elsevier selects journals and conference proceedings for the Scopus database based on evaluation by an international group of subject-matter experts (see NSB-2023-33, Technical Appendix ), and the National Center for Science and Engineering Statistics (NCSES) undertakes additional filtering of the Scopus data to ensure that the statistics presented in Science and Engineering Indicators measure original and high-quality research publications (Science-Metrix 2023). Although the listed affiliation is generally reflective of the locations where research was conducted, authors may have honorary affiliations, have moved, or have experienced other circumstances preventing their affiliations from being an exact corollary to the research environment.

The subset of AI articles was determined by All Science Journal Classification subject matter classification. Global coronavirus publication output data for 2020 were extracted from two different sources. The COVID-19 Open Research Dataset (CORD-19) was created through a partnership between the Office of Science and Technology Policy, the Allen Institute for Artificial Intelligence, the Chan Zuckerberg Initiative, Microsoft Research, Kaggle, and the National Library of Medicine at the National Institutes of Health, coordinated by Georgetown University’s Center for Security and Emerging Technology. CORD-19 is a highly inclusive, noncurated database. The other coronavirus publication output data source was the Scopus database, which permits more refined analysis because it includes more fields (e.g., instructional country of each author). (See NSB-2021-4, Technical Appendix ).

1 See table SPBS-22 in National Science Board, National Science Foundation. 2023. Publications Output: U.S. Trends and International Comparisons. Science and Engineering Indicators 2024. NSB-2023-33. Available at https://ncses.nsf.gov/pubs/nsb202333 .

2 See NSB-2023-33, table SPBS-99 .

3 See NSB-2023-33, figure PBS-3 .

4 See NSB-2023-33, table SPBS-22 .

5 See NSB-2023-33, figure PBS-3 .

Carvalho DS, Felipe LL, Albuquerque PC, Zicker F, Fonseca BDP. 2023. Leadership and International Collaboration on COVID-19 Research: Reducing the North–South Divide? Scientometrics 128:4689–705. Available at https://doi.org/10.1007/s11192-023-04754-x .

Chinchilla-Rodríguez Z, Sugimoto CR, Larivière V. 2019. Follow the Leader: On the Relationship between Leadership and Scholarly Impact in International Collaborations. PLOS ONE 14:e0218309. Available at https://doi.org/10.1371/journal.pone.0218309 .

Gazni A, Sugimoto CR, Didegah F. 2012. Mapping World Scientific Collaboration: Authors, Institutions, and Countries. Journal of the American Society for Information Science and Technology 63:323–35. Available at https://doi.org/10.1002/asi.21688 .

Katz JS, Hicks D. 1997. How Much Is a Collaboration Worth? A Calibrated Bibliometric Model. Scientometrics 40:541–54. Available at https://doi.org/10.1007/BF02459299 .

Lee Y-N, Walsh JP, Wang J. 2015. Creativity in Scientific Teams: Unpacking Novelty and Impact. Research Policy 44:684–97. Available at https://doi.org/10.1016/j.respol.2014.10.007 .

Leydesdorff L, Wagner CS. 2008. International Collaboration in Science and the Formation of a Core Group. Journal of Informetrics 2:317–25. Available at https://doi.org/10.1016/j.joi.2008.07.003 .

Science-Metrix. 2023. Bibliometric Indicators for the Science and Engineering Indicators 2024. Technical Documentation . Available at https://science-metrix.com/bibliometrics-indicators-for-the-science-and-engineering-indicators-2024-technical-documentation/ . Accessed 26 August 2023.

Wagner CS, Brahmakulam IT, Jackson BA, Wong A, Yoda T. 2001. Science and Technology Collaboration : Building Capacity i n Developing Countries ? Santa Monica, CA: RAND Corporation. Available at https://www.rand.org/pubs/monograph_reports/MR1357z0.html .

Wuchty S, Jones BF, Uzzi B. 2007. The Increasing Dominance of Teams in Production of Knowledge. Science 316:1036. Available at https://doi.org/10.1126/science.1136099 .

Suggested Citation

Boothby C, Schneider B; National Center for Science and Engineering Statistics (NCSES). 2024. International Collaboration in Selected Critical and Emerging Fields: COVID-19 and Artificial Intelligence. NSF 24-323. Alexandria, VA: National Science Foundation. Available at https://ncses.nsf.gov/pubs/nsf24323 .

Report Authors

Clara Boothby ORISE Fellow NCSES E-mail: [email protected]

Benjamin Schneider Interdisciplinary Science Analyst NCSES Tel: 703.292.8828 E-mail: [email protected]

National Center for Science and Engineering Statistics Directorate for Social, Behavioral and Economic Sciences National Science Foundation 2415 Eisenhower Avenue, Suite W14200 Alexandria, VA 22314 Tel: (703) 292-8780 FIRS: (800) 877-8339 TDD: (800) 281-8749 E-mail: [email protected]

Source Data & Analysis

Related content, get e-mail updates from ncses.

NCSES is an official statistical agency. Subscribe below to receive our latest news and announcements.

• Open access
• Published: 09 April 2024

Active involvement in scientific research of persons living with dementia and long-term care users: a systematic review of existing methods with a specific focus on good practices, facilitators and barriers of involvement

• Janneke M. Groothuijse 1 , 2 ,
• Lisa S. van Tol 1 , 2 ,
• C. C. M. (Toos) Hoeksel-van Leeuwen 1 , 2 ,
• Johannes J. M. van Delden 3 ,
• Monique A. A. Caljouw 1 , 2 &
• Wilco P. Achterberg 1 , 2  

BMC Geriatrics volume  24 , Article number:  324 ( 2024 ) Cite this article

119 Accesses

Metrics details

Active involvement of persons living with dementia (PLWD) and long-term care (LTC) users in research is essential but less developed compared to other patient groups. However, their involvement in research is not only important but also feasible. This study aims to provide an overview of methods, facilitators, and barriers for involving PLWD and LTC users in scientific research.

A systematic literature search across 12 databases in December 2020 identified studies involving PLWD, LTC users, or their carers beyond research subjects and describing methods or models for involvement. Qualitative descriptions of involvement methods underwent a risk of bias assessment using the Critical Appraisal Skills Programme (CASP) Qualitative Checklist 2018. A data collection sheet in Microsoft Excel and thematic analysis were used to synthesize the results.

The eighteen included studies delineated five core involvement methods spanning all research phases: advisory groups, formal and informal research team meetings, action groups, workshops, and co-conducting interviews. Additionally, two co-research models with PLWD and carers were found, while only two studies detailed LTC user involvement methods. Four distinct involvement roles were identified: consulting and advisory roles, co-analysts, co-researchers, and partners. The review also addressed barriers, facilitators, and good practices in the preparation, execution, and translation phases of research, emphasizing the importance of diversity, bias reduction, and resource allocation. Trust-building, clear roles, ongoing training, and inclusive support were highlighted.

Conclusions

Planning enough time for active involvement is important to ensure that researchers have time to build a trusting relationship and meet personal needs and preferences of PLWD, LTC users and carers. Researchers are advised not to presume the meaning of burden and to avoid a deficit perspective. A flexible or emergent design could aid involved persons’ ownership of the research process.

Trial registration

Prospero 2021: CRD42021253736.

Peer Review reports

In research characterized by active involvement, the target group plays a pivotal role in shaping research decisions and outcomes, directly impacting them. Involving patients in health research offers significant benefits [ 1 , 2 ]: it enhances participant recruitment [ 2 ], refines research questions [ 2 ], aligns study results with the target population [ 1 , 2 ], and promotes effective implementation of findings [ 1 ]. Active involvement of patients has also benefits for themselves, namely an enhanced understanding of research, building relationships, personal development, improved health and wellbeing, and enjoyment and satisfaction [ 3 , 4 ]. It gives them a sense of purpose and satisfaction through their tangible impact.

However, for long-term care (LTC) users and persons living with dementia (PLWD) active involvement in research is less developed than for other patient groups [ 5 , 6 ]. PLWD and LTC users share similar care needs, encompassing assistance with activities of daily living (ADLs), medication management, medical condition monitoring, and emotional support. Furthermore, a substantial portion of LTC users comprises individuals living with dementia [ 7 ]. Additionally, statistical data from the United States reveals that one in four older individuals is likely to reside in long-term care (LTC) facilities [ 8 ], and approximately forty to eighty percent of LTC residents in the United States, Japan, Australia, and England experience dementia or severe memory problems [ 7 , 9 ].

Due to these considerations, we have chosen to combine the target audiences of PLWD and LTC users in our systematic review. However, it's important to note that while there are potential advantages to combining these target groups, there may also be challenges. PLWD and LTC users may have varying needs, preferences, and experiences, including differences in care requirements driven by individual factors like the stage of dementia, coexisting conditions, and personal preferences. Therefore, it's imperative to conduct comprehensive research and involve these communities to ensure that involvement approaches are not only inclusive but also tailored to meet their specific requirements.

Given our ageing population and the intricate health challenges faced by PLWD and LTC users, including their vulnerability and shorter life expectancy in old age, it's crucial to establish effective research involvement methods. These individuals have unique needs and preferences that require attention. They possess a voice, and as researchers, it is our responsibility to not only listen to them but also actively involve them in the research process. Consequently, it is essential to identify means through which the voices of PLWD and LTC users can be effectively heard and ensure that their input is incorporated into research.

Fortunately, publication of studies on involvement of PLWD and LTC users in scientific research is slowly increasing [ 5 , 9 , 10 , 11 ]. A few reviews have described how PLWD and LTC users were involved [ 5 , 9 , 10 ]. However, with the increasing attention for involvement, the understanding of when involvement is meaningful grows and stricter requirements can be imposed to increase the quality of active involvement [ 12 , 13 ]. To our knowledge there is no up to date overview of involvement methods used with either or both PLWD and LTC users. Such an overview of involvement methods for PWLD and LTC users would provide a valuable, comprehensive resource encompassing various stages of the research cycle and different aspects of involvement. It would equip researchers with the necessary guidance to navigate the complexities of involving PLWD and LTC users in their research projects.

Recognizing the need to enhance the involvement of PLWD and LTC users in scientific research, this systematic review aims to construct a comprehensive overview of the multiple methodologies employed in previous studies, along with an examination of the facilitators and barriers of involvement. Our overarching goal is to promote inclusive and effective involvement practices within the research community. To achieve this objective, this review will address the following questions: (1) What kind of methods are used and how are these methods implemented to facilitate involvement of PLWD and LTC users in scientific research? (2) What are the facilitators and barriers encountered in previous research projects involving PLWD and LTC users?

Protocol and registration

The search and analysis methods were specified in advance in a protocol. The protocol is registered and published in the PROSPERO database with registration number CRD42021253736. The search and analysis methods are also described below more briefly.

Information sources, search strategy, and eligibility criteria

In preparation of the systematic literature search, key articles and reviews about involvement of PLWD and LTC users in research were screened to identify search terms. In addition, Thesaurus and MeSH terms were used to broaden the search. The search was conducted on December 10, 2020, across multiple databases: PubMed, Medline, Embase, Emcare, Web of Science, Cochrane Library, PsycINFO, Academic Search Premier, JSTOR, Social Services Abstracts, Sociological Abstracts, Psychology and Behavioral Sciences Collection. The search terms were entered in "phrases". The search strategy included synonymous and related terms for dementia, LTC user, involvement, research, method, and long-term care. The full search strategy is provided in supplement 1 .

After conducting the search, records underwent initial screening based on titles and abstracts. Selected reports were retrieved for full-text assessment, and studies were evaluated for eligibility based on several criteria. However, no restriction was made regarding publication date. First, to be included studies had to be written in English, German, French, or Dutch. Second, we only included original research studies. Third, studies were excluded when the target group or their representatives were not involved in research, but only participated as research subjects. Fourth, studies were excluded when not describing involvement in research. Therefore, studies concerning involvement in care, policy, or self-help groups were excluded. Fifth, the focus of this systematic review is on methods. Therefore, studies with a main focus on the results, evaluation, ethical issues, and impact of involvement in research were excluded. Additionally, we have not set specific inclusion or exclusion criteria based on study design since our primary focus is on involvement methodologies, regardless of the chosen research design. Sixth, the included studies had to concern the involvement in research of PLWD or adult LTC users, whether living in the community or in institutional settings, as well as informal caregivers or other representatives of these groups who may represent PLWD and LTC users facing limitations. Studies that involved LTC users that were children or ‘young adults’, or their representatives, were excluded. Studies were also excluded if they involved mental healthcare users if it remained unclear if the care that they received entailed more than only treatment from mental healthcare providers, but for example also assistance with ADL.

Terminology

For readability purposes, we use the abbreviation PLWD to refer to persons diagnosed with dementia, and we use the abbreviation LTC users to refer to persons receiving long-term care, at home or as residents living in nursing homes or other residential facilities. We use the term carers to refer to informal caregivers and other representatives of either PLWD or LTC users. As clear and consistent definitions regarding participatory research remains elusive [ 14 , 15 ], we formulated a broad working definition of involvement in research so as not to exclude any approach to participatory research. We defined involvement in research as “research carried out ‘with’ or ‘by’ the target group” [ 16 ], where the target group or their representatives take part in the governance or conduct of research and have some degree of ownership of the research [ 12 ]. It concerns involvement in research in which lived experienced experts work alongside research teams. We use the terms participation and participants, to refer to people being part of the research as study subjects.

Selection process, data-collection process, and data items

Titles and abstracts were independently screened by the first and second author (JG and LT). Only the studies that both reviewers agreed and met the inclusion criteria were included in the full-text screening process. Any uncertainty about whether the studies truly described a model or approach for involvement, was resolved by a quick screening of the full-text paper. The full-text screening process was then conducted according to the same procedure by JG and LT. Any disagreement was resolved by discussion until consensus was reached. If no agreement could be reached, a third researcher (MC) was consulted. References of the included studies were screened for any missing papers.

The following information was collected on a data collection sheet in Microsoft Excel: year and country of publication, topic, research aim, study design, living situation of involved persons (at home or institutionalized), description of involved persons, study participants (study subjects), theories and methods used, type/role(s) of involvement, research phase(s), recruitment, consent approach, study setting, structure of participatory activities, training, resources, facilitators, barriers, ethics, benefits, impact, and definition of involvement used.

JG independently extracted data from all included studies, the involved co-researcher (THL) independently extracted data from two studies, the second author (LT) from five. Differences in the analysis were discussed with the co-researcher (THL) and second author (LT) until consensus was reached. As only minor differences emerged, limited to the facilitator and barrier categories, data from the remaining studies was extracted by JG.

Risk of bias assessment

Every research article identified through the systematic review exclusively comprised qualitative descriptions of the involvement method(s) employed. Consequently, all articles underwent evaluation using the Critical Appraisal Skills Programme (CASP) Qualitative Checklist 2018 [ 17 ], as opposed to the checklists intended for quantitative or mixed methods research. All included studies were independently assessed on quality by two reviewers (JG,LT) and any disagreement was resolved by discussion until consensus was reached. The CASP Qualitative Checklist consists of ten questions. The checklist does not provide suggestions on scoring, the first author designed a scoring system: zero points if no description was provided (‘no’), one point if a minimal description was provided (‘can’t tell’) and two points when the question was answered sufficiently (‘yes’). The second question of the checklist, “is a qualitative methodology appropriate”, was not applicable to the aims (i.e., to describe involvement) of the included studies and was therefore excluded. The tenth question was translated into a ‘yes’, ‘can’t tell’, or ‘no’ score to fit the scoring system. A maximum of eighteen points could be assigned.

Synthesis methods

Tables were used to summarize the findings and to acquire an overview of (1) the kinds of methods used to enable involvement of PLWD, LTC users, or carers in scientific research, and (2) the facilitators and barriers for involving this target group in scientific research. As to the first research aim, the headings of the first two tables are based on the Guidance for Reporting Involvement of Patients and the Public, long form version 2 (GRIPP2-LF) [ 18 ]. Because our systematic review focusses on methods, only the topics belonging to sections two, three, and four were included. Following Shippee et al., three main research phases were distinguished: preparation, execution, and translation [ 19 ]. Furthermore, the following fields were added to the GRIPP2-LF: First author, year of publication, country of study, setting of involvement, frequency of meetings, and a summary description of activities.

Concerning the second research aim, the extracted facilitators, barriers, and good practices were imported per study in ATLAS.ti for qualitative data analysis. Following the method for thematic synthesis of qualitative studies in systematic reviews [ 20 ], all imported barriers, facilitators and good practices were inductively coded staying 'close' to the results of the original studies, which resulted in 50 initial codes. After multiple rounds of pile sorting [ 21 ], based on similarities and differences and discussions in the research team, this long code list was grouped into a total of 27 categories, which were thereafter subsequently organized into 14 descriptive themes within the three research phases (preparation, execution, translation).

Study selection and characteristics

The Prisma Flow Diagram was used to summarize the study selection process [ 22 ]. In the full text screening, 72 of the 93 remaining studies were excluded because they were not original research articles (n = 5), not about involvement (n = 8), not about involvement in a research project (n = 1), they did not describe a model or method for involvement (n = 34), or they were not about PLWD or LTC users (n = 24). The search resulted in 18 publications eligible for analysis (Fig.  1 ).

Preferred Reporting items for Systematic Reviews and Meta-analyses (PRISMA) flow diagram

Table 1 presents the general study characteristics. Two studies explicitly aimed to develop a model for involvement or good practice, and both focus on co-research either with PLWD [ 23 ] or their carers [ 13 ]. The other sixteen provide a description of the involvement of PLWD [ 24 , 25 , 26 , 27 , 28 , 29 , 30 , 31 , 32 , 33 , 34 ] or LTC users in their research projects [ 35 , 36 , 37 , 38 , 39 ].

Quality assessment

Table 1 presents the CASP-score per study [ 17 ]. Five scored 16 to 18 points [ 13 , 28 , 29 , 32 , 35 ], indicating high quality with robust methods, clear aims, and strong data analysis. Eleven scored 12 to 15 [ 23 , 24 , 26 , 30 , 32 , 33 , 34 , 36 , 37 , 38 , 39 ], showing generally strong methodologies but with some limitations. Two scored 9 or lower [ 25 , 27 ], signifying significant methodological and analytical shortcomings. Notably, these low-scoring studies were short articles lacking clear recommendations for involvement in research.

Design and implementation of involvement

Phases and methods of involvement.

Table 2 describes the involvement methods used for and the implementation of involvement in research. The included studies jointly presented methods for involvement in the three main research phases [ 19 ]. Regarding the preparation phase, which involves the preparatory work for the study, only three studies provided detailed descriptions of the methods employed [ 26 , 30 , 32 ]. The execution phase, encompassing the actual conduct of the research, was most frequently discussed [ 23 , 24 , 25 , 26 , 27 , 28 , 29 ]. Five studies addressed the translation phase [ 13 , 25 , 31 , 36 , 37 ], where the focus shifts to translating research findings into actionable outcomes.

The eighteen studies introduced a variety of involvement methods, categorizable into five groups: 1) advisory groups, 2) research team meetings (both formal and informal), 3) action groups, 4) workshops, and 5) co-research in interviews. In five studies, individuals including PLWD, LTCF residents, carers, and health professionals participated in advisory/reference groups [ 25 , 26 , 27 , 32 ], working groups [ 27 ], and panels [ 28 ]. These groups offered valuable feedback on research aspects, spanning protocols, design, questionnaires, and implementation of research. Meetings occurred at varying frequencies - monthly, quarterly, or biannually.

Two studies exemplify diverse research collaboration settings. One involving older individuals within an academic research team of five [ 37 ], and another featuring a doctoral student and a co-researcher conducting informal monthly discussions at a local coffee shop [ 31 ]. Brown et al. sought to minimize power differentials and enhance inclusivity [ 37 ], while Mann and Hung focused on benefiting people with dementia and challenging negative discourse on dementia [ 31 ].

An additional five studies employed methods involving frequent meetings, including action [ 35 , 39 ], inquiry [ 23 ], and discussion groups [ 29 , 36 ] In these groups, involved persons with lived experience contributed to developing a shared vision and community improvements, such as enhancing the mealtime experience in care facilities [ 35 ].

Seven studies involved individuals through workshops, often conducted over one or two sessions. These workshops contributed to generating recommendations [ 37 ], informing future e-health designs [ 29 , 30 ], and ensuring diverse perspectives and lived experiences were included in data analysis [ 13 , 24 , 32 , 33 ]. In three studies, representatives worked as co-researchers in interviews, drawing on personal experiences to enhance the interview process, making it more dementia-appropriate and enriching data collection [ 13 , 32 , 34 ]. Finally, one study involved representatives in the recruitment and conduct of interviews [ 38 ].

People involved

The number of persons involved varied from a single co-researcher [ 31 ] to 34 panel individuals providing feedback on their experiences in a clinical trial [ 28 ]. Thirteen studies focussed on PLWD: eleven involved PLWD themselves [ 23 , 24 , 25 , 26 , 27 , 29 , 30 , 31 , 32 , 33 , 34 ], one exclusively focused on caregivers [ 13 ], and another one involved people without or with mild cognitive impairment, who participated in a study examining the risks of developing Alzheimer's disease [ 28 ]. Although not all articles provided descriptions of the dementia stage, available information indicated that individuals involved typically fell within the early to mid-stages of dementia [ 29 , 30 , 32 , 33 , 34 ]. Next to PLWD and carers, two studies additionally involved organizational or advocacy representatives [ 25 , 27 ]. The other five studies concerned older adults living in a LTC facility. Two of them involved older residents themselves [ 35 , 39 ], the other three carers, older community/client representatives or health care practitioners [ 36 , 37 , 38 ].

Roles and level of involvement

Four general roles could be identified. First, consultation and advisory roles were held by PLWD and carers [ 25 , 26 , 27 , 28 , 29 , 30 , 32 ], where involved persons share knowledge and experiences to make suggestions [ 32 ], but the research team retained formal decision-making power [ 25 ]. Second, PLWD were involved as co-analysts in data analysis [ 24 , 32 , 33 ]. Co-analysts influence data analysis, but the decision-making power remained with academic researchers [ 24 ]. Third, in six studies the co-researcher role was part of the research design in which involved persons and researchers steer and conduct research together [ 13 , 23 , 31 , 32 , 34 , 36 ]. Finally, two studies partnered with LTC residents [ 35 , 39 ], with residents at the core of the group, and positioned as experts by experience [ 39 ]. Residents had the decision-making authority regarding how to improve life in LTC facilities [ 35 ].

Models for involvement in research

Only two studies designed a model for co-research with PLWD [ 23 ] or their carers [ 13 ] across all research phases. These models underscored the importance of iterative training for co-researchers [ 13 , 23 ] and academic researchers [ 23 ]. Furthermore, these studies advocate involving co-researchers early on in the research process [ 13 ] and in steering committees [ 23 ]. Co-researchers can be involved in designing research materials [ 23 ], conducting interviews [ 13 , 23 ], analysing data [ 13 ], and co-disseminating findings [ 13 , 23 ]. Additionally, one study stressed involving PLWD in identifying (future) research priorities [ 23 ].

Barriers, facilitators, and good practices in research phases

Preparation phase.

Table 3 describes the barriers, facilitators, and good practices per main research phase. Lack of diversity in ethnicity and stages of dementia in the recruitment of involved persons is mentioned as a recurring barrier [ 26 , 28 , 32 , 33 ]. The exclusion of people with cognitive impairments is partly due to gatekeepers’ and recruiters’ bias towards cognitively healthy people [ 28 , 32 ]. It is stressed that researchers should refrain from making assumptions about the abilities of PLWD and ask the person what he/she is willing to do [ 31 ]. It is considered good practice to involve people regardless of cognitive abilities [ 23 ], based on skills, various personal characteristics [ 13 ] and, if possible, relevant prior experience [ 38 ].

Many studies stress the importance of building a mutual trusting relationship between involved persons and academic researchers [ 13 , 23 , 31 , 33 , 34 , 37 ]. A good relationship is believed to break down social barriers [ 37 ], foster freedom of expression [ 33 ], and thereby avoiding tokenistic involvement [ 13 ]. In addition, spending time with these persons is important to become familiar with an individual’s strengths and limitations [ 31 ].

Opting for naturally evolving involvement roles was mentioned as a barrier, as this may result in conflicting expectations and irrelevant tasks [ 37 ]. A clear role description and clarification of tasks is key to balancing potentially different expectations of the involved persons and researchers [ 26 , 28 , 29 , 32 , 38 ]. When designing a role for involvement in research, good practices dictate taking into account personal skills, preferences, development goals, and motivation for involvement [ 13 , 32 ]. This role should ideally be designed in collaboration with involved persons [ 13 , 32 ].

The perception of providing training to involved persons is ambivalent. Studies cited that training should not aim to transform them into “pseudo-scientist” [ 32 , 37 ] and that it raises the costs for involvement [ 28 ]. However, multiple scholars emphasize the importance of providing iterative training to facilitate meaningful involvement and development opportunities [ 13 , 23 , 28 , 31 , 32 , 33 , 36 , 37 ]. Training can empower involved persons to engage in the research process equally and with confidence, with the skills to fulfil their role [ 13 , 33 , 38 ]. However, the implementation of training may present a potential conflict with the fundamental principle of valuing experiential knowledge [ 37 ] and should avoid the objective of transforming co-researchers into 'expert' researchers [ 32 ]. Academic researchers should also be offered training on how to facilitate meaningful involvement [ 13 , 23 , 28 , 31 ].

Limited time and resources were mentioned as barriers to involvement that can delay the research process [ 13 , 33 , 36 , 39 ], restrict the involvement [ 28 ] and hinder the implementation of developed ideas [ 39 ]. Financial compensation for involvement is encouraged [ 25 , 26 , 27 , 32 ], as it acknowledges the contribution of involved persons [ 13 ]. Thus, meaningful involvement in research requires adequate funding and infrastructure to support the involvement activities [ 13 , 28 , 33 , 37 ].

Execution phase

The use of academic jargon and rapid paced discussions [ 13 , 37 ], power differentials, and the dominant discourse in biomedical research on what is considered “good science” can limit the impact of involvement [ 13 , 24 , 32 , 36 , 37 ]. Facilitating researchers should reflect on power differentials [ 35 ] and how decision-making power is shared [ 31 ]. Other facilitating factors are making a glossary of terms used and planning separate meetings for “technical topics” [ 37 ]. In addition, an emergent research design [ 35 ] or a design with flexible elements [ 28 ] can increase ownership in the research project and provide space for involvement to inform the research agenda [ 28 , 35 ]. This requires academic researchers to value experiential knowledge and to have an open mind towards the evolving research process [ 13 , 23 , 31 ].

Furthermore, managing the involvement process and ensuring equity in the collaboration [ 13 , 32 , 33 ], facilitating researchers must encourage involved persons to voice their perspectives. This means that they sometimes need to be convinced that they are experts of lived experience [ 32 , 33 , 36 , 37 , 39 ]. To enable involvement of PLWD, the use of visual and creative tools to prompt memories can be considered [ 24 , 30 , 33 , 34 ], as well as flexibility in relation to time frames and planning regular breaks to avoid too fast a pace for people who may tire easily [ 24 , 25 , 29 , 30 ].

Involvement can be experienced as stressful [ 13 , 32 , 38 ] and caring responsibilities may interfere [ 26 ]. Tailored [ 29 ] physical and emotional support should therefore be offered [ 13 , 23 , 38 ] without making assumptions about the meaning of burden [ 30 , 31 ]. Moreover, being the only PLWD involved in an advisory group was experienced as intimidating [ 25 ] and, ideally, a larger team of PLWD is involved to mitigate responsibilities [ 37 ]. PLWD having a focal point of contact [ 28 , 37 ] and involving nurses or other staff with experience working with PLWD and their carers [ 29 , 30 ] are mentioned as being beneficial. Some stress the importance of involving carers when engaging with PLWD in research [ 25 , 29 , 30 ].

To avoid an overload of information that is shared with the involved persons, tailoring information-sharing formats to individual preferences and abilities is essential to make communication effective [ 27 , 37 ].

Translation

Two studies indicated a need for more robust evaluation measures to assess the effect of involvement [ 28 , 33 ]. Reflection and evaluation of the involvement serves to improve the collaboration and to foster introspective learning [ 13 , 23 , 26 , 31 ]. The included studies evaluated involvement through the use of reflective diaries [ 13 ] or a template [ 38 ] with open-ended questions [ 33 ].

Two studies postulate that findings should benefit and be accessible to PLWD [ 23 , 31 ]. The use of creative tools not only enables involvement of PLWD, but can also increase accessibility of research findings and expand the present representation of PLWD [ 23 ].

The 18 included studies presented multiple methods for involvement in all three research phases. We found five types of involvement: advisory groups, (formal and informal) research team meetings, action groups, workshops, and co-conducting interviews. Only two studies described methods for involvement of LTC users in research. Involved persons were most often involved in consulting and advisory roles, but also as co-analysts, co-researchers, and partners. Involved persons’ roles can evolve and change over time. Especially as involved persons grow into their role, and gain confidence and knowledge of the specific research project, a more active role with shared responsibilities can become part of the research project. In addition, multiple involvement roles can be used throughout the research depending on the research phase.

Compared to the five types of involvement that we identified, other literature reviews about involvement methods for LTC users and PLWD in research also described advisory groups [ 10 ] and workshops [ 5 , 11 ], and methods that were similar to research team meetings (drop-in sessions and meetings [ 11 ]). Methods for action research (action groups) and co-conducting research (interviews) were not included by these other review studies. In addition to our findings, these other reviews also described as involvement methods interviews and focus groups [ 5 , 10 ] surveys [ 10 ], reader consultation [ 11 ]. Those types of methods were excluded from our study, because our definition of involvement is more strict; collecting opinions is not involvement per se, but sometimes only study participation. Moreover, compared to these previous reviews we set a high standard for transparency about the participation methods and the level of detail at which they are described.

Engaging the target group in research, particularly when collaborating with PLWD, LTC users, and carers, involves navigating unforeseen challenges [ 40 ]. This requires academic researchers to carefully balance academic research goals and expectations, and the expectations, personal circumstances and development goals related to the involved person. The aim is to maximize involvement while being attentive to the individual’s needs and avoiding a deficit perspective. Effective communication should be established, promoting respect, equality, and regular feedback between all stakeholders, including individuals living with dementia and LTCF staff. Building a mutual trusting relationship between involved persons and academic researchers through social interaction and clear communication is key to overcome barriers and ensure meaningful involvement. Inclusivity and empowerment, along with fostering an environment where diverse voices are heard, are crucial for the success of involvement in research. Our results are in line with a recent study concerning the experiences of frail older persons with involvement in research, confirming the importance of avoiding stereotypic views of ageing and frailty, building a trusting relationship, and being sensitive to older persons’ preferences and needs [ 41 ].

Furthermore, our results show that training academic researchers and involved persons is essential to develop the skills to facilitate involvement and to fulfil their role with confidence, respectively. Whilst the need for training is acknowledged by others [ 41 , 42 ], there are legitimate objections to the idea of training involved persons, as the professionalization underpinning the concept of training is at odds with voicing a lay perspective [ 43 , 44 ]. Furthermore, it is argued that experiential knowledge is compromised when training is structured according to the dominant professional epistemology of objectivity [ 45 ]. Therefore, training of involved persons should not focus on what researchers think they ought to know, but on what they want to learn [ 41 ].

Academic culture was frequently mentioned as a barrier to meaningful involvement. This result resonates with the wider debate related to involvement in health research which is concerned about active or “authentic involvement” being replaced with the appropriation of the patient voice as an add-on to conventional research designs [ 12 , 46 ]. It is argued that such tokenistic involvement limits the involved persons’ ability to shape research outcomes [ 46 ]. To reduce tokenism requires a culture shift [ 13 ]. We believe that due to the strict definition of involvement and high transparency standard used in this review, tokenistic approaches were excluded. This may set an example for how to stimulate making this culture shift.

Furthermore, the importance of practical aspects such as funding and, by extension, the availability of time should not be underestimated. Adequate funding is necessary for compensation of involvement, but also to ensure that researchers have ample time to plan involvement activities and provide personalized support for PLWD, LTC residents and their carers. Funding bodies increasingly require involvement of the public to be part of research proposals. Yet, support in terms of financial compensation and time for the implementation of involvement in research is rarely part of funding grants [ 42 ]. In addition, whereas an emergent design could aid the impact of involvement, funders often require a pre-set research proposal in which individual components are already fixed [ 5 , 47 ]. This indicates that not only do academic researchers and culture need to change, academic systems also need to be modified in order to facilitate and nurture meaningful involvement [ 47 ].

Strengths and limitations

A key strength of this review is the inclusion of over ten scientific databases, with a reach beyond the conventional biomedical science databases often consulted in systematic reviews. Besides, we believe that we have overcome the inconsistent use of terminology of involvement in research by including also other terms used, such as participation and engagement, in our search strategy. However, there was also inconsistency in length of publications and precision of the explanation of the process of involvement. E.g., involvement in the execution phase was often elaborated on, contributions to the research proposal and co-authoring research findings were only stated and not described. This presented challenges for data extraction and analysis, as it was not always possible to identify how the target group was involved. Involvement in these research phases is therefore not fully represented in this review.

The included studies in this review, the majority of which are of high quality, provide methods for involvement of PLWD and LTC users in research and they do not explicitly attend to the effectiveness or impact of the method for involvement used. Therefore, a limitation of this review is that it cannot make any statements regarding the effectiveness of the involvement methods included. Moreover, our target population was broad, although PLWD and LTC users are largely overlapping in their care needs and share important features, this may have led to heterogeneous results. In future research, it would be interesting to interpret potential differences between involvement of PLWD, LTC users, and their carers. However, as we expected, the amount of literature included in our analyses was too limited to do so. Furthermore, whereas the broad target group is a limitation it is also a strength of our review. Limiting our search to specifically persons living in LTC facilities would have provided limited methods for involvement of persons living with dementia. Our broad target groups enabled us to learn from research projects in which people living with early staged dementia are directly involved from which we can draw lessons on the involvement of people with more advanced stages of dementia and persons living with cognitive problems who live within LTC facilities.

Since January 2021 quite some research has been published about the importance of involvement in research. Although we had quickly screened for new methods, we realise that we may have missed some involvement methods in the past years. There will be a need for a search update in the future.

Implications for future research

Our review shows that a flexible and emergent design may help to increase involved persons' influence on and ownership in the research process. However, not all research objectives may be suitable for the implementation of an emergent design. Future research should therefore examine how aspects of a flexible emergent design can be integrated in, e.g., clinical research without compromising the validity of research outcomes.

Alzheimer Europe has called for the direct involvement of persons living with dementia in research [ 48 ]. In addition, Swarbrick et al. (this review) advise to involve persons regardless of their cognitive abilities [ 23 ]. These statements question the involvement of proxies, such as carers, professional caregivers and others involved in the care of PLWD. While PLWD and persons with other cognitive problems constitute a significant group within residential and nursing homes [ 7 ], none of the studies included in this review have provided methods to directly involve persons with more advanced stages of dementia. This raises the question if research methods should be adapted to allow those with more advanced stages of dementia to be involved themselves or if, concerning the progressive nature of the disease, it is more appropriate to involve proxies. And secondly who should these proxies be? Those that care for and live with persons with an advanced stage of dementia, or for example a person living with an early stage of dementia to represent the voices of persons with more advanced stages of dementia [ 31 ]?

Future research should adopt our example for stricter requirements for involvement and transparency about the involvement methods used. This will reduce tokenistic involvement and further promote the culture shift towards meaningful involvement. In addition, future research should assess the impact of the involvement methods that are described in this review. One of the first instruments that that may be used to do so in varying healthcare settings is the Public and Patient Engagement Evaluation Tool (PPEET) [ 49 ]. Moreover, scholars in this review stress, and we agree with this, that future research is needed on the involvement of persons with more advanced stages of dementia to ensure their voices are not excluded from research [ 33 , 34 ].

This review provides an overview of the existing methods used to actively involve PLWD, LTC users, and carers in scientific research. Our findings show that their involvement is feasible throughout all research phases. We have identified five different methods for involvement, four different roles, and two models for co-research. Our results suggest that planning enough time for involving PLWD, LTC users, and carers in research, is important to ensure that researchers have time to build a trusting relationship and meet their personal needs and preferences. In addition, researchers are advised not to presume the meaning of burden and to avoid a deficit perspective. A flexible or emergent design could aid involved persons’ ownership in the research process.

Availability of data and materials

The full search strategy is provided in supplement 1 . The data extraction form can be provided by the corresponding author on reasonable request.

Abbreviations

Critical Appraisal Skills Programme

Guidance for Reporting Involvement of Patients and the Public, long form version 2

• Long-term care

Persons living with dementia

Domecq JP, Prutsky G, Elraiyah T, et al. Patient engagement in research: a systematic review. BMC Health Serv Res. 2014;14(1):1–9. https://doi.org/10.1186/1472-6963-14-89 .

Article   Google Scholar  

Brett J, Staniszewska S, Mockford C, et al. A systematic review of the impact of patient and public involvement on service users, researchers and communities. Patient-Patient-Centered Outcomes Res. 2014;7(4):387–95. https://doi.org/10.1007/s40271-014-0065-0 .

Staley K. Exploring impact: Public involvement in NHS, public health and social care research. 2009. Available from: https://www.invo.org.uk/wp-content/uploads/2011/11/Involve_Exploring_Impactfinal28.10.09.pdf . Accessed 17 Jan 2024

Ashcroft J, Wykes T, Taylor J, et al. Impact on the individual: what do patients and carers gain, lose and expect from being involved in research? J Ment Health. 2016;25(1):28–35. https://doi.org/10.3109/09638237.2015.1101424 .

Article   PubMed   PubMed Central   Google Scholar  

Backhouse T, Kenkmann A, Lane K, et al. Older care-home residents as collaborators or advisors in research: a systematic review. Age Ageing. 2016;45(3):337–45. https://doi.org/10.1093/ageing/afv201 .

Bendien E, Groot B, Abma T. Circles of impacts within and beyond participatory action research with older people. Ageing Soc 2020:1–21. https://doi.org/10.1017/S0144686X20001336 .

Lepore MED, Meyer J, Igarashi A. How long-term care quality assurance measures address dementia in Australia, England, Japan, and the United States. Ageing Health Res 2021;1(2). https://doi.org/10.1016/j.ahr.2021.100013 .

Freedman VA, Spillman BC. Disability and care needs among older Americans. Milbank Q. 2014;92(3):509–41. https://doi.org/10.1111/1468-0009.12076 .

Bethell J, Commisso E, Rostad HM, et al. Patient engagement in research related to dementia: a scoping review. Dementia. 2018;17(8):944–75. https://doi.org/10.1177/1471301218789292 .

Article   PubMed   Google Scholar  

Miah J, Dawes P, Edwards S, et al. Patient and public involvement in dementia research in the European Union: a scoping review. BMC Geriatr. 2019;19(1):1–20. https://doi.org/10.1186/s12877-019-1217-9 .

Schilling I, Gerhardus A. Methods for involving older people in health research—a review of the literature. Int J Environ Res Public Health. 2017;14(12):1476. https://doi.org/10.3390/ijerph14121476 .

Andersson N. Participatory research—A modernizing science for primary health care. J Gen Fam Med. 2018;19(5):154–9. https://doi.org/10.1002/jgf2.187 .

Di Lorito C, Godfrey M, Dunlop M, et al. Adding to the knowledge on patient and public involvement: reflections from an experience of co-research with carers of people with dementia. Health Expect. 2020;23(3):691–706. https://doi.org/10.1111/hex.13049 .

Islam S, Small N. An annotated and critical glossary of the terminology of inclusion in healthcare and health research. Res Involve Engage. 2020;6(1):1–9. https://doi.org/10.1186/s40900-020-00186-6 .

Rose D. Patient and public involvement in health research: Ethical imperative and/or radical challenge? J Health Psychol. 2014;19(1):149–58. https://doi.org/10.1177/1359105313500249 .

NIHR. Briefing notes for researchers: public involvement in NHS, health and social care research. https://www.nihr.ac.uk/documents/briefing-notes-for-researchers-public-involvement-in-nhs-health-and-social-care-research/27371#Involvement . Accessed 12 Jan 2023.

Critical Appraisal Skills Programme. CASP Qualitative Checklist. 2018. https://casp-uk.net/images/checklist/documents/CASP-Qualitative-Studies-Checklist/CASP-Qualitative-Checklist-2018_fillable_form.pdf . Accessed 12 Jan 2023.

Staniszewska S, Brett J, Simera I, et al. GRIPP2 reporting checklists: tools to improve reporting of patient and public involvement in research. Res Involv Engagem. 2017;3:13. https://doi.org/10.1186/s40900-017-0062-2 .

Article   CAS   PubMed   PubMed Central   Google Scholar  

Shippee ND, Domecq Garces JP, Prutsky Lopez GJ, et al. Patient and service user engagement in research: a systematic review and synthesized framework. Health Expect. 2015;18(5):1151–66. https://doi.org/10.1111/hex.12090 .

Thomas J, Harden A. Methods for the thematic synthesis of qualitative research in systematic reviews. BMC Med Res Methodol. 2008;8(1):1–10. https://doi.org/10.1186/1471-2288-8-45 .

Saldana JM. The coding manual for qualitative researchers. London: SAGE Publications; 2015.

Google Scholar  

Page MJ, McKenzie JE, Bossuyt PM, The PRISMA, et al. statement: an updated guideline for reporting systematic reviews. BMJ. 2020;2021:372. https://doi.org/10.1136/bmj.n71 .

Swarbrick C, Doors O, et al. Developing the co-researcher involvement and engagement in dementia model (COINED): A co-operative inquiry. In: Keady J, Hydén L-C, Johnson A, et al., editors. Social research methods in dementia studies: Inclusion and innovation. New York, Routledge: Taylor & Francis Group; 2018. p. 8–19.

Clarke CL, Wilkinson H, Watson J, et al. A seat around the table: participatory data analysis with people living with dementia. Qual Health Res. 2018;28(9):1421–33. https://doi.org/10.1177/1049732318774768 .

Flavin T, Sinclair C. Reflections on involving people living with dementia in research in the Australian context. Australas J Ageing. 2019;38(Suppl 2):6–8. https://doi.org/10.1111/ajag.12596 .

Giebel C, Roe B, Hodgson A, et al. Effective public involvement in the HoST-D programme for dementia home care support: From proposal and design to methods of data collection (innovative practice). Dementia (London). 2019;18(7–8):3173–86. https://doi.org/10.1177/1471301216687698 .

Goeman DP, Corlis M, Swaffer K, et al. Partnering with people with dementia and their care partners, aged care service experts, policymakers and academics: a co-design process. Australas J Ageing. 2019;38(Suppl 2):53–8. https://doi.org/10.1111/ajag.12635 .

Gregory S, Bunnik EM, Callado AB, et al. Involving research participants in a pan-European research initiative: the EPAD participant panel experience. Res Involv Engagem. 2020;6:62. https://doi.org/10.1186/s40900-020-00236-z .

Hanson E, Magnusson L, Arvidsson H, et al. Working together with persons with early stage dementia and their family members to design a user-friendly technology-based support service. Dementia. 2007;6(3):411–34. https://doi.org/10.1177/1471301207081572 .

Hassan L, Swarbrick C, Sanders C, et al. Tea, talk and technology: patient and public involvement to improve connected health “wearables” research in dementia. Res Involv Engagem. 2017;3:12. https://doi.org/10.1186/s40900-017-0063-1 .

Mann J, Hung L. Co-research with people living with dementia for change. Action Research. 2019;17(4):573–90. https://doi.org/10.1177/1476750318787005 .

Poland F, Charlesworth G, Leung P, et al. Embedding patient and public involvement: managing tacit and explicit expectations. Health Expect. 2019;22(6):1231–9. https://doi.org/10.1111/hex.12952 .

Stevenson M, Taylor BJ. Involving individuals with dementia as co-researchers in analysis of findings from a qualitative study. Dementia (London). 2019;18(2):701–12. https://doi.org/10.1177/1471301217690904 .

Tanner D. Co-research with older people with dementia: experience and reflections. J Ment Health. 2012;21(3):296–306. https://doi.org/10.3109/09638237.2011.651658 .

Baur V, Abma T. “The Taste Buddies”: participation and empowerment in a residential home for older people. Ageing Soc. 2012;32(6):1055–78. https://doi.org/10.1017/S0144686X11000766 .

Beukema L, Valkenburg B. Demand-driven elderly care in the Netherlands. Action Research. 2007;5(2):161–80. https://doi.org/10.1177/1476750307077316 .

Brown LJE, Dickinson T, Smith S, et al. Openness, inclusion and transparency in the practice of public involvement in research: a reflective exercise to develop best practice recommendations. Health Expect. 2018;21(2):441–7. https://doi.org/10.1111/hex.12609 .

Froggatt K, Goodman C, Morbey H, et al. Public involvement in research within care homes: benefits and challenges in the APPROACH study. Health Expect. 2016;19(6):1336–45. https://doi.org/10.1111/hex.12431 .

Shura R, Siders RA, Dannefer D. Culture change in long-term care: participatory action research and the role of the resident. Gerontologist. 2011;51(2):212–25. https://doi.org/10.1093/geront/gnq099 .

Cook T. Participatory research: Its meaning and messiness. Beleidsonderzoek Online. 2020;3:1–21. https://doi.org/10.5553/BO/221335502021000003001 .

Haak M, Ivanoff S, Barenfeld E, et al. Research as an essentiality beyond one’s own competence: an interview study on frail older people’s view of research. Res Involv Engage. 2021;7(1):1–8. https://doi.org/10.1186/s40900-021-00333-7 .

Chamberlain SA, Gruneir A, Keefe JM, et al. Evolving partnerships: engagement methods in an established health services research team. Res Involve Engage. 2021;7(1):1–11. https://doi.org/10.1186/s40900-021-00314-w .

Bélisle-Pipon J-C, Rouleau G, Birko S. Early-career researchers’ views on ethical dimensions of patient engagement in research. BMC Med Ethics. 2018;19(1):1–10. https://doi.org/10.1186/s12910-018-0260-y .

Ives J, Damery S, Redwod S. PPI, paradoxes and Plato: who’s sailing the ship? J Med Ethics. 2013;39(3):181–5. https://doi.org/10.1136/medethics-2011-100150 .

De Graaff M, Stoopendaal A, Leistikow I. Transforming clients into experts-by-experience: a pilot in client participation in Dutch long-term elderly care homes inspectorate supervision. Health Policy. 2019;123(3):275–80. https://doi.org/10.1016/j.healthpol.2018.11.006 .

Cook T. Where Participatory Approaches Meet Pragmatism in Funded (Health) Research: The Challenge of Finding Meaningful Spaces. Forum Qualitative Sozialforschung Forum: Qualitative Social Research. 2012;13(1). https://doi.org/10.17169/fqs-13.1.1783 .

Paylor J, McKevitt C. The possibilities and limits of “co-producing” research. Front Sociol. 2019;4:23. https://doi.org/10.3389/fsoc.2019.00023 .

Gove D, Diaz-Ponce A, Georges J, et al. Alzheimer Europe’s position on involving people with dementia in research through PPI (patient and public involvement). Aging Ment Health. 2018;22(6):723–9. https://doi.org/10.1080/13607863.2017.1317334 .

Abelson J, Li K, Wilson G, et al. Supporting quality public and patient engagement in health system organizations: development and usability testing of the Public and Patient Engagement Evaluation Tool. Health Expect. 2016;19(4):817–27. https://doi.org/10.1111/hex.12378 .

Download references

Acknowledgements

We thank Jan W. Schoones, information specialist Directorate of Research Policy (formerly: Walaeus Library, Leiden University Medical Centre, Leiden, the Netherlands), for helping with the search.

This systematic review received no specific grant from any funding agency in the public, commercial, or not-for-profit sectors.

Author information

Authors and affiliations.

Department of Public Health and Primary Care, Leiden University Medical Center, P.O. Box 9600, 2300, RC, Leiden, the Netherlands

Janneke M. Groothuijse, Lisa S. van Tol, C. C. M. (Toos) Hoeksel-van Leeuwen, Monique A. A. Caljouw & Wilco P. Achterberg

University Network for the Care Sector Zuid-Holland, Leiden University Medical Center, Leiden, The Netherlands

Department of Medical Humanities, University Medical Center, Utrecht, The Netherlands

Johannes J. M. van Delden

You can also search for this author in PubMed   Google Scholar

Contributions

Concept: HD, LT, MC, WA; design of study protocol: JG, LT, MC; data collection and extraction: JG, LT, MC, THL; data analysis and interpretation: all authors; writing, editing and final approval of the manuscript: all authors.

Corresponding author

Correspondence to Monique A. A. Caljouw .

Ethics declarations

Competing interests.

The authors declare no competing interests.

Ethics approval and consent to participate

Not applicable.

Consent for publication

Competing interest.

There are no competing interests.

Additional information

Publisher’s note.

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Supplementary material 1., rights and permissions.

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ . The Creative Commons Public Domain Dedication waiver ( http://creativecommons.org/publicdomain/zero/1.0/ ) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Cite this article.

Groothuijse, J.M., van Tol, L.S., Leeuwen, C.C.M.(.Hv. et al. Active involvement in scientific research of persons living with dementia and long-term care users: a systematic review of existing methods with a specific focus on good practices, facilitators and barriers of involvement. BMC Geriatr 24 , 324 (2024). https://doi.org/10.1186/s12877-024-04877-7

Download citation

Received : 03 February 2023

Accepted : 05 March 2024

Published : 09 April 2024

DOI : https://doi.org/10.1186/s12877-024-04877-7

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

• Involvement in research
• Older residents

BMC Geriatrics

ISSN: 1471-2318

• Submission enquiries: [email protected]
• General enquiries: [email protected]

• International edition
• Australia edition
• Europe edition

Touch can reduce pain, depression and anxiety, say researchers

More consensual touch helps ease or buffer against mental and physical complaints, meta-analysis shows

Whether it is a hug from a friend or the caress of a weighted blanket, the sensation of touch appears to bring benefits for the body and mind, researchers say.

The sense of touch is the first to develop in babies and is crucial in allowing us to experience the environment around us as well as communicate. Indeed, the loss of touch from others during the Covid pandemic hit many hard.

However, while myriad studies have suggested touch is beneficial for our health, few have attempted to draw the vast field of research together.

Now experts have done just that, revealing a simple message: touch helps.

Dr Helena Hartmann, a co-author of the research from University Hospital Essen , said: “More consensual touch events throughout our day can help alleviate or potentially buffer against mental and physical complaints.”

Published in the journal Nature Human Behaviour , the research encompassed 212 previously published studies and included a statistical analysis of 85 studies involving adults and 52 involving newborns.

Among the results, the team found touch was just as beneficial for mental health as physical health – a finding that held for adults and newborns – although touch had a bigger impact on some areas than others.

“Our work illustrates that touch interventions are best suited for reducing pain, depression and anxiety in adults and children as well as for increasing weight gain in newborns,” the researchers write.

The analysis revealed humans gained similar benefits in terms of their physical health when touched by other humans as by objects – such as social robots or weighted blankets.

Hartmann said that was a surprise. “This means we need to undertake more research on the potential of weighted blankets or social robots to improve people’s wellbeing, especially during contact-limiting situations like the recent Covid-19 pandemic,” she said.

The positive impact on mental health was larger for human touch than touch from objects – possibly, the team said, because it involved skin-to-skin contact.

Among other results, the team found touch was beneficial for both healthy and unwell people, although the impact was larger among the latter for mental health benefits.

The type of touch and its duration was not important, although greater frequency was associated with greater benefits in adults.

Further, touching the head was associated with greater health benefits than touching other parts of the body.

The team cautioned that some of the findings could be false positives, while it was not clear if they would hold across different cultures.

Dr Mariana von Mohr, from Royal Holloway, University of London, who was not involved in the work, said if future robots could more accurately replicate the texture and warmth of human skin, they may be able to provide comparable mental health benefits to human touch.

“[These properties are] important because our skin contains specialised sensors, known as C-tactile afferents, which are particularly receptive to gentle, caressing touch and temperature similar to that of human skin, factors that are also thought to facilitate emotional regulation,” she said.

Prof Katerina Fotopoulou, at University College London, said the research gave a bird’s-eye view of the benefits of touch interventions on health.

She cautioned that the work could not offer more specific conclusions, such as the particular types of touch that may be associated with specific health benefits.

Dr Susannah Walker, at Liverpool John Moores University, agreed, noting that many of the studies considered were small and included varied types of touch and different measures of their outcomes. “This means it is hard to draw firm conclusions about why they work,” she said.

Fotopoulou added that the research could fuel new work in the field, including how touch could be used alongside other treatments.

“It is a historical misfortune that we have prioritised talking over touch or other somatic therapies in the past couple of centuries. This review gives us the necessary emphasis and confidence to redress this balance with further, careful study on touch interventions,” she said.

• Medical research
• Mental health
• Neuroscience

Most viewed

Data Specialist

• Madison, Wisconsin
• EXTENSION/AGRICULTURE INSTITUTE DIRECTOR
• Partially Remote
• Staff-Full Time
• Opening at: Apr 11 2024 at 16:30 CDT
• Closing at: May 2 2024 at 23:55 CDT

Job Summary:

On-farm and applied agricultural field trials are critical to engaging innovative farmers and better understanding the implications for agricultural management and adoption of innovative practices. The Data Specialist will work with UW faculty and Extension educators to strengthen field trial design and provide data analysis support for applied field research projects. This work is intended to assist farmers and industry partners in research-based decision making to improve the economic, environmental and social sustainability of Wisconsin farms. This position will also work closely with faculty to develop and analyze data to support agronomic and nutrient management recommendations. About Extension: UW-Madison's Division of Extension serves the people and communities of Wisconsin by addressing local, statewide and national issues, improving lives through research-based education, fostering partnerships and action, and facilitating positive impacts. The Agriculture Institute is one of six Institutes in the Division. About the Agriculture Institute's Crops and Soils Program: The Agriculture Institute's Crops and Soils Program works hand-in-hand with row crop, forage, fruit and vegetable producers to implement best practices for every aspect of the growing phase. The Crops and Soils program provides timely resources and information to help Wisconsin crop producers and their agricultural consultants manage crops efficiently and profitably. About this Position: The Data Specialist position is designed to work with crop producers and agribusiness professionals statewide to solve production challenges and incorporate new research findings into outreach and educational materials that improve the efficiency and profitability of crop production. Specific roles of the position will include: - Consult with colleagues on aspects of project design and data analysis in agricultural field research. - Develop systems for efficient data analysis and communication of results to farm and industry partners. - Compile and analyze existing datasets in collaboration with UW faculty to communicate findings and make management recommendations. - The ideal candidate will have experience with developing and evaluating educational programming and a track record of building positive relationships. The preferred location for this position is Madison, WI, but is flexible based on programmatic needs, successful candidate's preferences, and availability of suitable space. The Division of Extension has a deep and profound commitment to diversity, inclusion, and equity, believing that these values are foundational elements to eliminate disparities and expanding access for all. As Extension, we acknowledge the need for strategic and coordinated actions that help us form a more equitable, anti-racist, non-biased, and inclusive organization. ( https://blogs.extension.wisc.edu/oaic/call-to-action/ ) As such, all Extension employees are expected to foster and promote the values of diversity and inclusion.

Responsibilities:

• 30% Prepares data sets for analysis including cleaning/quality assurance, transformations, restructuring, and integration of multiple data sources
• 30% Independently identifies and implements appropriate data science techniques to find data patterns and answer research questions chosen by the lead researcher including data visualization, statistical analysis, machine learning, and data mining
• 10% Organizes and automates project steps for data preparation and analysis
• 10% Composes and assembles reproducible workflows and reports to clearly articulate patterns to researchers and/or administrators
• 10% Documents approaches to address research questions and contributes to the establishment of reproducible research methodologies and analysis workflows
• 10% Communicate plans, activities, and achievements to Program Managers, partners, and relevant stakeholders

Institutional Statement on Diversity:

Diversity is a source of strength, creativity, and innovation for UW-Madison. We value the contributions of each person and respect the profound ways their identity, culture, background, experience, status, abilities, and opinion enrich the university community. We commit ourselves to the pursuit of excellence in teaching, research, outreach, and diversity as inextricably linked goals. The University of Wisconsin-Madison fulfills its public mission by creating a welcoming and inclusive community for people from every background - people who as students, faculty, and staff serve Wisconsin and the world. For more information on diversity and inclusion on campus, please visit: Diversity and Inclusion

Required Master's Degree in a field related to this position's focus Preferred PhD in a field related to this position's focus

Qualifications:

Required: - Three or more years relevant professional experience; - Demonstrated skill with R or comparable statistical software - Demonstrated skill in data analysis and interpretation. - Demonstrated skills in interpreting, utilizing, and applying evidence-based information and research findings; - Demonstrated ability to communicate effectively, both written and verbal, through a variety of technologies; - Demonstrated ability to effectively work with people from different cultural backgrounds, including those associated with race, ethnicity, national origin, religion, socioeconomic status, age, gender, disability, sexual orientation, and other aspects of human diversity. Preferred: - Ability to conduct linear and non-linear regression analysis - Strong interpersonal relationship and problem-solving skills in a team setting - Demonstrated experience with building diverse, collaborative partnerships - Demonstrated ability to communicate scientific or technical materials in written and verbal forms for a variety of lay and other audiences

Full Time: 100% This position may require some work to be performed in-person, onsite, at a designated campus work location. Some work may be performed remotely, at an offsite, non-campus work location.

Appointment Type, Duration:

Ongoing/Renewable

Minimum $65,000 ANNUAL (12 months) Depending on Qualifications Employees in this position can expect to receive benefits such as generous vacation, holidays, and paid time off; competitive insurances and savings accounts; retirement benefits. Benefits information can be found at ( https://hr.wisc.edu/benefits/ ).

Additional Information:

Division of Extension headquarters are located within Madison, WI but the position location is flexible and will be determined based on programmatic needs and successful candidate's preferences and availability of suitable space. The University of Wisconsin-Madison has a remote work policy that offers the potential for remote or hybrid work. More about that policy within the Division of Extension can be found here: https://kb.wisc.edu/extension/113536 .  Please note that successful applicants are responsible for ensuring their eligibility to work in the United States (i.e. a citizen or national of the United States, a lawful permanent resident, a foreign national authorized to work in the United States without need of employer sponsorship) on or before the effective date of appointment.

How to Apply:

We are eager to learn more about how your experience and passion may align with this position. Please submit a cover letter referring to your related work experience and a resume detailing your educational and professional background.

Your cover letter should communicate your interest in the position and how your skillset aligns with the role. The application reviewers will be relying on written application materials to determine who may advance to preliminary interviews.

Anne Pfeiffer [email protected] 608-263-1095 Relay Access (WTRS): 7-1-1. See RELAY_SERVICE for further information.

Official Title:

Data Scientist II(RE021)

Department(s):

A47-EXTENSION/ANRCD/AGR/CROPS/CROPS&SOIL

Employment Class:

Academic Staff-Renewable

Job Number:

The university of wisconsin-madison is an equal opportunity and affirmative action employer..

You will be redirected to the application to launch your career momentarily. Thank you!

Frequently Asked Questions

Applicant Tutorial

Disability Accommodations

Pay Transparency Policy Statement

Refer a Friend

You've sent this job to a friend!

Website feedback, questions or accessibility issues: [email protected] .

Learn more about accessibility at UW–Madison .

© 2016–2024 Board of Regents of the University of Wisconsin System • Privacy Statement

CISA Launches New System for Automated Malware Analysis

The Cybersecurity and Infrastructure Security Agency has unveiled Malware Next-Gen, a new platform designed to provide automated analysis of newly identified malware to support threat detection and response efforts.

Malware Next-Gen works to enable government agencies to submit malware samples and suspicious artifacts for automated analysis to inform their cyber defense initiatives, CISA said Wednesday.

“Our new automated system enables CISA’s cybersecurity threat hunting analysts to better analyze, correlate, enrich data, and share cyber threat insights with partners. It facilitates and supports rapid and effective response to evolving cyber threats, ultimately safeguarding critical systems and infrastructure,” said Eric Goldstein, executive assistant director for cybersecurity at CISA.

Since November, Malware Next-Gen has analyzed over 1,600 files from nearly 400 registered users from defense and civilian agencies and has identified and shared approximately 200 suspicious or malicious files and uniform resource locators.

The Potomac Officers Club will host the 2024 Cyber Summit on June 6 to hear from government and industry experts about the dynamic and ever-evolving role of cyber in the public sector. Register here !

• Cybersecurity and Infrastructure Security Agency
• eric goldstein
• malware analysis system
• Malware Next-Gen

Space Force Launches Weather Monitoring Satellite to LEO

SBA Introduces Digital Portal to Access Investing in America Opportunities; Isabel Casillas Guzman Quoted

Proposed Marine Amphibious Landing Ship May Cost Up to $600M Per Unit, CBO Says