Qualitative Research & Evaluation Methods

Qualitative Research & Evaluation Methods Integrating Theory and Practice

  • Michael Quinn Patton - Utilization-Focused Evaluation, Saint Paul, MN

“It is refreshing to see a text that engages the multiple philosophical and historical trajectories within a qualitative research tradition while integrating this discussion so well with the practice of research design, fieldwork strategies, and data analysis.”

  “The content itself, based in years of thinking, reading, doing, conversing, is a huge strength. Reading the chapters is like sitting at the feet of one of the masters.”  

"Very thoughtful and thorough coverage of qualitative design and study."

“I can’t emphasize enough the quality, detail, and depth of the presentation of research design and methods… Students and experienced researchers will appreciate the depth of presentation of potential qualitative paradigms, theoretical orientations and frameworks as well as special methodological applications that are often not covered in other qualitative texts.”

I have used Patton for this course historically; I will continue to use him for this course. I have used previous editions as well.

Michael Quinn Patton

Michael Quinn Patton  is author of more than a dozen books on evaluation including Qualitative Research & Evaluation Methods, 4th ed (2015), Blue Marble Evaluation (2020), Principles-Focused Evaluation (2018), Facilitating Evaluation (2018) and Developmental Evaluation (2011). Based in Minnesota, he was on the faculty of the University of Minnesota for 18 years and is a former president of the American Evaluation Association (AEA). Michael is a recipient of the Alva and Gunnar Myrdal Evaluation Practice Award, the Paul F. Lazarsfeld Evaluation Theory Award, and the Research on Evaluation Award, all from AEA He has also received the Lester F. Ward Distinguished Contribution to Applied and Clinical Sociology Award from the Association for Applied and Clinical Sociology. In 2021 he received the first Transformative Evaluator Award from EvalYouth. He is an active speaker, trainer, and workshop presenter who has conducted applied research and evaluation on a broad range of issues and has worked with organizations and programs at the international, national, state, provincial, and local levels. Michael has three children—a musician, an engineer, and an evaluator—and four grandchildren. When not evaluating, he enjoys exploring the woods and rivers of Minnesota, where he lives.

Icon image

Qualitative Research & Evaluation Methods: Integrating Theory and Practice, Edition 4

About this ebook, about the author.

Michael Quinn Patton is author of more than a dozen books on evaluation including Qualitative Research & Evaluation Methods, 4th ed (2015), Blue Marble Evaluation (2020), Principles-Focused Evaluation (2018), Facilitating Evaluation (2018) and Developmental Evaluation (2011). Based in Minnesota, he was on the faculty of the University of Minnesota for 18 years and is a former president of the American Evaluation Association (AEA). Michael is a recipient of the Alva and Gunnar Myrdal Evaluation Practice Award, the Paul F. Lazarsfeld Evaluation Theory Award, and the Research on Evaluation Award, all from AEA He has also received the Lester F. Ward Distinguished Contribution to Applied and Clinical Sociology Award from the Association for Applied and Clinical Sociology. In 2021 he received the first Transformative Evaluator Award from EvalYouth. He is an active speaker, trainer, and workshop presenter who has conducted applied research and evaluation on a broad range of issues and has worked with organizations and programs at the international, national, state, provincial, and local levels. Michael has three children—a musician, an engineer, and an evaluator—and four grandchildren. When not evaluating, he enjoys exploring the woods and rivers of Minnesota, where he lives.

Rate this ebook

Reading information, more by michael quinn patton.

Thumbnail image

Similar ebooks

Thumbnail image

This website may not work correctly because your browser is out of date. Please update your browser .

  • Qualitative research & evaluation methods: integrating theory and practice

Resource link

The fourth edition of Michael Quinn Patton's  Qualitative Research & Evaluation Methods Integrating Theory and Practice,  published by Sage Publications, analyses and provides clear guidance and advice for using a range of different qualitative methods for evaluation.

  • Module 1. How qualitative inquiry contributes to our understanding of the world
  • Module 2. What makes qualitative data qualitative
  • Module 3. Making methods decisions
  • Module 4. The fruit of qualitative methods: Chapter summary and conclusion
  • Module 5. Strategic design principles for qualitative inquiry
  • Module 6. Strategic principles guiding data collection and fieldwork
  • Module 7. Strategic principles for qualitative analysis and reporting findings
  • Module 8: Integrating the 12 strategic qualitative principles in practice
  • Module 9. Understanding the Paradigms Debate: Quants versus Quals
  • Module 10. Introduction to Qualitative Inquiry Frameworks
  • Module 11. Ethnography and Autoethnography
  • Module 12. Positivism, Postpositivism, Empiricism and Foundationalist Epistemologies
  • Module 13. Grounded Theory and Realism
  • Module 14 Phenomenology and Heuristic Inquiry
  • Module 15 Social Constructionism, Constructivism, Postmodernism, and Narrative Inquiry
  • Module 16. Ethnomethodology, Semiotics, and Symbolic Interaction, Hermeneutics and Ecological Psychology
  • Module 17 Systems Theory and Complexity Theory
  • Module 18. Pragmatism, Generic Qualitative Inquiry, and Utilization-Focused Evaluation
  • Module 19 Patterns and themes across inquiry frameworks: Chapter summary and conclusions
  • Module 20. Practical purposes, concrete questions, and actionable answers: Illuminating and enhancing quality
  • Module 21. Program evaluation applications: Focus on outcomes
  • Module 22 Specialized qualitative evaluation applications
  • Module 23 Evaluating program models and theories of change, and evaluation models especially aligned with qualitative methods
  • Module 24 Interactive and participatory qualitative applications
  • Module 25 Democratic evaluation, indigenous research and evaluation, capacity building, and cultural competence
  • Module 26 Special methodological applications
  • Module 27 A vision of the utility of qualitative methods: Chapter summary and conclusion
  • Module 28 Design thinking: Questions derive from purpose, design answers questions
  • Module 29 Date Collection Decisions
  • Module 30 Purposeful sampling and case selection: Overview of strategies and options
  • Module 31 Single-significant-case sampling as a design strategy
  • Module 32 Comparison-focused sampling options
  • Module 33 Group characteristics sampling strategies and options
  • Module 34 Concept and theoretical sampling strategies and options
  • Module 35. Instrumental-use multiple-case sampling
  • Module 36 Sequential and emergence-driven sampling strategies and options
  • Module 37 Analytically focused sampling
  • Module 38 Mixed, stratified, and nested purposeful sampling strategies
  • Module 39 Information-rich cases
  • Module 40 Sample size for qualitative designs
  • Module 41 Mixed methods designs
  • Module 42 Qualitative design chapter summary and conclusion: Methods choices and decisions
  • Module 43 The Power of direct observation
  • Module 44. Variations in observational methods
  • Module 45. Variations in duration of observations and site visits: From rapid reconnaissance to longitudinal studies over years
  • Module 46. Variations in observational focus and summary of dimensions along which fieldwork varies
  • Module 47. What to observe: Sensitizing concepts
  • Module 48. Integrating what to observe with how to observe
  • Module 49. Unobtrusive observations and indicators, and documents and archival fieldwork
  • Module 50. Observing oneself: Reflexivity and Creativity, and Review of Fieldwork Dimensions
  • Module 51. Doing Fieldwork: The Data Gathering Process
  • Module 52. Stages of fieldwork: Entry into the field
  • Module 53. Routinization of fieldwork: The dynamics of the second stage
  • Module 54. Bringing fieldwork to a close
  • Module 55. The observer and what is observed: Unity, separation, and reactivity
  • Module 56. Chapter summary and conclusion: Guidelines for fieldwork
  • Module 57 The Interview Society: Diversity of applications
  • Module 58 Distinguishing interview approaches and types of interviews
  • Module 59 Question options and skilled question formulation
  • Module 60 Rapport, neutrality, and the interview relationship
  • Module 61 Interviewing groups and cross-cultural interviewing
  • Module 62. Creative modes of qualitative inquiry
  • Module 63. Ethical issues and challenges in qualitative interviewing
  • Module 64. Personal reflections on interviewing, and chapter summary and conclusion
  • Module 65. Setting the Context for Qualitative Analysis: Challenge, Purpose, and Focus
  • Module 66. Thick description and case studies: The bedrock of qualitative analysis
  • Module 67. Qualitative Analysis Approaches: Identifying Patterns and Themes
  • Module 68. The intellectual and operational work of analysis
  • Module 69. Logical and matrix analyses, and synthesizing qualitative studies
  • Module 70. Interpreting findings, determining substantive significance, phenomenological essence, and hermeneutic interpretation
  • Module 71. Causal explanation thorough qualitative analysis
  • Module 72. New analysis directions: Contribution analysis, participatory analysis, and qualitative counterfactuals
  • Module 73. Writing up and reporting findings, including using visuals
  • Module 74. Special analysis and reporting issues: Mixed methods, focused communications, and principles-focused report exemplar.
  • Module 75 Chapter summary and conclusion, plus case study exhibits
  • Module 76. Analytical processes for enhancing credibility: systematically engaging and questioning the data
  • Module 77. Four triangulation processes for enhancing credibility
  • Part 1, universal criteria, and traditional scientific research versus constructivist criteria
  • Part 2: artistic, participatory, critical change, systems, pragmatic, and mixed criteria
  • Module 80 Credibility of the inquirer
  • Module 81 Generalizations, Extrapolations, Transferability, Principles, and Lessons learned
  • Module 82 Enhancing the credibility and utility of qualitative inquiry by addressing philosophy of science issues

Patton, M. Q. (2014).  Qualitative Research & Evaluation Methods: Integrative Theory and Practice . SAGE Publications.

'Qualitative research & evaluation methods: integrating theory and practice' is referenced in:

  • Week 47: Rumination #3: Fools' gold: the widely touted methodological "gold standard" is neither golden nor a standard

Framework/Guide

  • Rainbow Framework :  Sample

Back to top

© 2022 BetterEvaluation. All right reserved.

Influence of Agrometeorological Factors on the Productivity of Grain Crops in the Municipal Regions of the Saratov Oblast

  • Published: 10 January 2024
  • Volume 48 , pages 855–862, ( 2023 )

Cite this article

  • E. I. Ormeli 1 ,
  • S. I. Pryakhina 1 ,
  • N. M. Tsetva 2 ,
  • I. S. Tsetva 2 &
  • I. V. Milovanov 2  

16 Accesses

Explore all metrics

The paper presents the results of studying the influence of modern agrometeorological conditions on the yield of different groups of grain crops in the municipal districts of the Saratov oblast. The climatic trends of the recent two decades are analyzed for five weather stations (Khvalynsk, Balashov, Saratov, Ershov, and Aleksandrov Gai). For the Saratov weather station, a longer period (1941–2022) is analyzed. There is an increase in the heat availability and aridity of the territory. The analysis of the dynamics of the crop yield distribution and variability has shown that the most favorable conditions of crop cultivation are formed in the Balashov municipal district. Operational forecast models of the maximum and minimum productivity of winter wheat are developed, which makes it possible to predict a yield with a monthly lead time.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price includes VAT (Russian Federation)

Instant access to the full article PDF.

Rent this article via DeepDyve

Institutional subscriptions

qualitative research and evaluation methods latest edition

Weather Archive for Khvalynsk (the Saratov Oblast, Russia) , Weather and Climate, http://www.pogodaiklimat.ru/ [in Russian].

The Archive of Monthly Mean Air Temperatures for the Saratov Oblast Stations , All-Russian Research Institute of Hydrometeorological Information–World Data Center, http://meteo.ru/ [in Russian].

Second Roshydromet Assessment Report on Climate Change and Its Consequences in the Russian Federation (Roshydromet, Moscow, 2014) [in Russian].

Report on Climate-related Risks in the Russian Federation (Roshydromet, St. Petersburg, 2017) [in Russian].

Report on Climate Features in the Russian Federation in 2021 (Moscow, 2022), https://www.meteorf.gov.ru/images/news/20220324/4/Doklad.pdf [in Russian].

Long-term Strategy for the Development of the Grain Complex of the Russian Federation until 2035 , https://www.garant.ru/products/ipo/prime/doc/72522534/?ysclid=lhxho4bhhs493933680 [in Russian].

Ministry of Agriculture of the Saratov Oblast , http://minagro.saratov.gov.ru/development/ index.php?ELEMENT_ID=8131 [in Russian].

V. V. Oganesyan, "Climate Change as a Risk Factor for the Russian Economy," Gidrometeorologicheskie Issledovaniya i Prognozy, No. 3 (2019).

E. I. Ormeli, "Dependence of Spring Wheat Yield on Hydrothermal Conditions in the Saratov Region," Vestnik Udmurtskogo Univ., Ser. Biol., Nauki o Zemle, No. 4, 31 (2021).

E. I. Ormeli, "Assessment of a Degree of Climate Continentality in the Saratov Oblast at the Beginning of the 21st Century," Vestnik Udmurtskogo Univ., Ser. Biol., Nauki o Zemle, No. 4, 32 (2022).

S. I. Pryakhina and E. I. Ormeli, "Agroclimatic Characteristic of Seasons in the Saratov Oblast," Izv. Saratovskogo Univ., Novaya Seriya, Ser.: Nauki o Zemle, No. 4, 18 (2018).

S. I. Pryakhina and E. I. Ormeli, "Influence of Global Climate Warming on Agricultural Production in the Saratov Oblast," in Proceedings of the 6th International Scientific and Practical Conference (Part 2) "Fundamental and Applied Aspects of Geology, Geophysics, and Geoecology Using Modern Information Technologies," Maikop, May 17–21, 2021 (IP Kucherenko V.O., Maikop, 2021) [in Russian].

Rosstat (2020), https://rosstat.gov.ru/statistic [in Russian].

Reference Book on the USSR Climate , Issue 12, Part 2: Temperature of Air and Soil (Gidrometeoizdat, Leningrad, 1965) [in Russian].

Average Long-term Values of Air Temperature and Precipitation (Climatological Normals) for the Saratov Oblast Stations , Hydrometcenter of Russia, https://meteoinfo.ru/climatcities/ [in Russian].

Third Assessment Report on the Climate Change and Its Consequences in the Russian Federations. General Summary (Naukoemkie Tekhnologii, St. Petersburg, 2022) [in Russian].

Harvesting in the Russian Federation as of January 20, 2023 , https://zerno.ru/node/19602?ysclid=li8xq9d6t5173367396 [in Russian].

Southeast Federal Agrarian Research Center, Division for Agriculture and Agricultural Technologies , https://www.arisersar.ru/labzemlagrot.htm [in Russian].

"Summary for Policymakers," in Climate Change and Land: An IPCC Special Report on Climate Change, Desertification, Land Degradation, Sustainable Land Management, Food Security, and Greenhouse Gas Fluxes in Terrestrial Ecosystems , Ed. by P. R. Shukla, J. Skea, E. Calvo Buendia, V. Masson-Delmotte, H.-O. Portner, D. C. Roberts, P. Zhai, R. Slade, S. Connors, R. van Diemen, M. Ferrat, E. Haughey, S. Luz, S. Neogi, M. Pathak, J. Petzold, J. Portugal Pereira, P. Vyas, E. Huntley, K. Kissick, M. Belkacemi, and J. Malley (IPCC, 2019), https://www.ipcc.ch/srccl-report-download-page.

N. Stern, The Economics of Climate Change: The Stern Review , http://www.cambridge.org/9780521700801.

Download references

Author information

Authors and affiliations.

Chernyshevsky Saratov National Research State University, 410012, Saratov, Russia

E. I. Ormeli & S. I. Pryakhina

Southeast Federal Agrarian Research Center, 410010, Saratov, Russia

N. M. Tsetva, I. S. Tsetva & I. V. Milovanov

You can also search for this author in PubMed   Google Scholar

Corresponding author

Correspondence to E. I. Ormeli .

Additional information

Translated from Meteorologiya i Gidrologiya , 2023, No. 10, pp. 37-46. https://doi.org/10.52002/0130-2906-2023-10-37-46 .

Publisher’s Note. Allerton Press remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

About this article

Ormeli, E.I., Pryakhina, S.I., Tsetva, N.M. et al. Influence of Agrometeorological Factors on the Productivity of Grain Crops in the Municipal Regions of the Saratov Oblast. Russ. Meteorol. Hydrol. 48 , 855–862 (2023). https://doi.org/10.3103/S1068373923100047

Download citation

Received : 06 June 2023

Revised : 31 July 2023

Accepted : 07 August 2023

Published : 10 January 2024

Issue Date : October 2023

DOI : https://doi.org/10.3103/S1068373923100047

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

  • climate change
  • regional monitoring
  • agrometeorological conditions
  • grain crops
  • productivity
  • Saratov oblast
  • Find a journal
  • Publish with us
  • Track your research

qualitative research and evaluation methods latest edition

  • Politics & Social Sciences
  • Social Sciences

Buy new: $117.37 $117.37 FREE delivery: April 30 - May 1 Ships from: textbooks_source Sold by: textbooks_source

Buy used: $92.11.

Fulfillment by Amazon (FBA) is a service we offer sellers that lets them store their products in Amazon's fulfillment centers, and we directly pack, ship, and provide customer service for these products. Something we hope you'll especially enjoy: FBA items qualify for FREE Shipping and Amazon Prime.

If you're a seller, Fulfillment by Amazon can help you grow your business. Learn more about the program.

Kindle app logo image

Download the free Kindle app and start reading Kindle books instantly on your smartphone, tablet, or computer - no Kindle device required .

Read instantly on your browser with Kindle for Web.

Using your mobile phone camera - scan the code below and download the Kindle app.

QR code to download the Kindle App

Image Unavailable

Qualitative Research & Evaluation Methods: Integrating Theory and Practice

  • To view this video download Flash Player

Follow the author

Michael Quinn Patton

Qualitative Research & Evaluation Methods: Integrating Theory and Practice 4th Edition

Purchase options and add-ons.

Drawing on more than 40 years of experience conducting applied social science research and program evaluation, author Michael Quinn Patton has crafted the most comprehensive and systematic book on qualitative research and evaluation methods, inquiry frameworks, and analysis options available today. Now offering more balance between applied research and evaluation, this Fourth Edition of Qualitative Research & Evaluation Methods illuminates all aspects of qualitative inquiry through new examples, stories, and cartoons; more than a hundred new summarizing and synthesizing exhibits; and a wide range of new highlight sections/sidebars that elaborate on important and emergent issues. For the first time, full case studies are included to illustrate extended research and evaluation examples. In addition, each chapter features an extended "rumination," written in a voice and style more emphatic and engaging than traditional textbook style, about a core issue of persistent debate and controversy.

  • ISBN-10 9781412972123
  • ISBN-13 978-1412972123
  • Edition 4th
  • Publisher SAGE Publications, Inc
  • Publication date November 11, 2014
  • Language English
  • Dimensions 8.75 x 1.5 x 11.25 inches
  • Print length 832 pages
  • See all details

Amazon First Reads | Editors' picks at exclusive prices

Frequently bought together

Qualitative Research & Evaluation Methods: Integrating Theory and Practice

Similar items that may deliver to you quickly

Qualitative Inquiry and Research Design: Choosing Among Five Approaches

Editorial Reviews

"The content itself, based in years of thinking, reading, doing, conversing, is a huge strength. Reading the chapters is like sitting at the feet of one of the masters."

"I can’t emphasize enough the quality, detail, and depth of the presentation of research design and methods… Students and experienced researchers will appreciate the depth of presentation of potential qualitative paradigms, theoretical orientations and frameworks as well as special methodological applications that are often not covered in other qualitative texts."

"It is refreshing to see a text that engages the multiple philosophical and historical trajectories within a qualitative research tradition while integrating this discussion so well with the practice of research design, fieldwork strategies, and data analysis."

About the Author

Michael Quinn Patton  is author of more than a dozen books on evaluation including Qualitative Research & Evaluation Methods, 4th ed (2015), Blue Marble Evaluation (2020), Principles-Focused Evaluation (2018), Facilitating Evaluation (2018) and Developmental Evaluation (2011). Based in Minnesota, he was on the faculty of the University of Minnesota for 18 years and is a former president of the American Evaluation Association (AEA). Michael is a recipient of the Alva and Gunnar Myrdal Evaluation Practice Award, the Paul F. Lazarsfeld Evaluation Theory Award, and the Research on Evaluation Award, all from AEA He has also received the Lester F. Ward Distinguished Contribution to Applied and Clinical Sociology Award from the Association for Applied and Clinical Sociology. In 2021 he received the first Transformative Evaluator Award from EvalYouth. He is an active speaker, trainer, and workshop presenter who has conducted applied research and evaluation on a broad range of issues and has worked with organizations and programs at the international, national, state, provincial, and local levels. Michael has three children―a musician, an engineer, and an evaluator―and four grandchildren. When not evaluating, he enjoys exploring the woods and rivers of Minnesota, where he lives.

Product details

  • ASIN ‏ : ‎ 1412972124
  • Publisher ‏ : ‎ SAGE Publications, Inc; 4th edition (November 11, 2014)
  • Language ‏ : ‎ English
  • Hardcover ‏ : ‎ 832 pages
  • ISBN-10 ‏ : ‎ 9781412972123
  • ISBN-13 ‏ : ‎ 978-1412972123
  • Item Weight ‏ : ‎ 4.34 pounds
  • Dimensions ‏ : ‎ 8.75 x 1.5 x 11.25 inches
  • #109 in Scientific Research
  • #235 in Social Sciences Research
  • #8,311 in Unknown

About the author

Michael quinn patton.

Michael Quinn Patton lives in Minnesota where, according to the state's poet laureate, Garrison Keillor, "all the women are strong, all the men are good looking, and all the children are above average." It was this lack of interesting statistical variation in Minnesota that led him to qualitative inquiry despite the strong quantitative orientation of his doctoral studies in sociology at the University of Wisconsin. He serves on the graduate faculty of The Union Institute, a nontraditional, interdisciplinary, nonresidential and individually designed doctoral program.

He was on the faculty of the University of Minnesota for 18 years, including five years as Director of the Minnesota Center for Social Research, where he was awarded the Morse-Amoco Award for innovative teaching. He won the University of Minnesota storytelling competition and has authored several other books which include Utilization-Focused Evaluation, Creative Evaluation, Practical Evaluation, How to Use Qualitative Methods in Evaluation, and Family Sexual Abuse: Frontline Research and Evaluation.

He edited Culture and Evaluation for the journal New Direction in Program Evaluation. His creative nonfiction book, Grand Canyon Celebration: A Father-Son Journey of Discovery, was a finalist for 1999 Minnesota Book of the Year.He is former President of the American Evaluation Association and the only recipient of both the Alva and Gunner Myrdal Award for Outstanding Contributions to Useful and Practical Evaluation from the Evaluation Research Society and the Paul F. Lazarsfeld Award for Lifelong Contributions to Evaluation Theory from the American Evaluation Association. The Society for Applied Sociology awarded him the 2001 Lester F. Ward Award for Outstanding Contributions to Applied Sociology.

Customer reviews

Customer Reviews, including Product Star Ratings help customers to learn more about the product and decide whether it is the right product for them.

To calculate the overall star rating and percentage breakdown by star, we don’t use a simple average. Instead, our system considers things like how recent a review is and if the reviewer bought the item on Amazon. It also analyzed reviews to verify trustworthiness.

Reviews with images

Customer Image

  • Sort reviews by Top reviews Most recent Top reviews

Top reviews from the United States

There was a problem filtering reviews right now. please try again later..

qualitative research and evaluation methods latest edition

Top reviews from other countries

qualitative research and evaluation methods latest edition

  • Amazon Newsletter
  • About Amazon
  • Accessibility
  • Sustainability
  • Press Center
  • Investor Relations
  • Amazon Devices
  • Amazon Science
  • Sell on Amazon
  • Sell apps on Amazon
  • Supply to Amazon
  • Protect & Build Your Brand
  • Become an Affiliate
  • Become a Delivery Driver
  • Start a Package Delivery Business
  • Advertise Your Products
  • Self-Publish with Us
  • Become an Amazon Hub Partner
  • › See More Ways to Make Money
  • Amazon Visa
  • Amazon Store Card
  • Amazon Secured Card
  • Amazon Business Card
  • Shop with Points
  • Credit Card Marketplace
  • Reload Your Balance
  • Amazon Currency Converter
  • Your Account
  • Your Orders
  • Shipping Rates & Policies
  • Amazon Prime
  • Returns & Replacements
  • Manage Your Content and Devices
  • Recalls and Product Safety Alerts
  • Conditions of Use
  • Privacy Notice
  • Consumer Health Data Privacy Disclosure
  • Your Ads Privacy Choices
  • Reference Manager
  • Simple TEXT file

People also looked at

Perspective article, the role of economic evaluations in advancing hiv multipurpose prevention technologies in early-stage development.

qualitative research and evaluation methods latest edition

  • 1 Global Access, IAVI, New York, NY, United States
  • 2 Department of Global Health and Development, London School of Hygiene and Tropical Medicine, London, United Kingdom
  • 3 Medical Devices and Health Technologies, PATH, Seattle, WA, United States
  • 4 CAMI Health, Initiative for MPTs, Public Health Institute, Sacramento, CA, United States
  • 5 Global Health Training, Advisory and Support Contract, United States Agency for International Development, Washington, DC, United States

Product development is a high-risk undertaking, especially so when investments are prioritized for low- and middle-income countries (LMICs) where markets may be smaller, fragile, and resource-constrained. New HIV prevention technologies, such as the dapivirine vaginal ring (DVR) and long-acting injectable cabotegravir (CAB-LA), are being introduced to these markets with one indication, meeting different needs of groups such as adolescent girls and young women (AGYW) and female sex workers (FSWs) in settings with high HIV burden. However, limited supply and demand have made their uptake a challenge. Economic evaluations conducted before Phase III trials can help optimize the potential public health value proposition of products in early-stage research and development (R&D), targeting investments in the development pathway that result in products likely to be available and taken up. Public investors in the HIV prevention pipeline, in particular those focused on innovative presentations such as multipurpose prevention technologies (MPTs), can leverage early economic evaluations to understand the intrinsic uncertainty in market characterization. In this perspective piece, we reflect on the role of economic evaluations in early product development and on methodological considerations that are central to these analyses. We also discuss methods, in quantitative and qualitative research that can be deployed in early economic evaluations to address uncertainty, with examples applied to the development of future technologies for HIV prevention and MPTs.

Introduction

Economic evaluations analyze new products or technologies in comparison with already available ones to assess incremental cost and health impact ( 1 ). They collate the available evidence up through the current stage of development and can use modelling, addressing uncertainty linked to incomplete trial data, variable clinical pathways, future costs, broadly defined markets, among others ( 2 ). These economic evaluations are usually conducted in late-stage product development (i.e., once safety and initial data on efficacy have been collected), to inform introduction and reimbursement decisions. However, the information gained when economic evaluations are conducted early in the research and development (R&D) process allows funders, future investors, and product developers to prioritize resources and support resource allocation decisions across portfolios. Early insights are of relevance when investing in products prioritized for access in low-and-middle income countries (LMICs). LMIC markets experience unique challenges such as overburdened health care systems, new and complex regulatory systems, and limited resources or multiple payers with different decision making criteria, contributing to a less predictable market ( 3 ).

Currently, HIV infection remains a global challenge, with approximately 1.3 million [1.0 million–1.7 million] new infections in 2022 ( 4 ), 51% of which were reported in sub-Saharan Africa (SSA) ( 4 ). Although substantial decreases in HIV transmission and AIDS-related deaths were observed between 2005 and 2015, mainly due to the scale up of antiretroviral therapy (ART) for treatment and for prevention, the rate in reduction of new infections has plateaued in recent years ( 4 ). Of an estimated 250,000 [150,000–360,000] adolescent girls and young women (AGYW) acquiring HIV in 2021 globally, 82% of them were living in SSA ( 5 ), with new HIV infections among AGYW declining slower than among their male counterparts (rate of decline 42% vs. 56%, respectively) ( 5 ). Reducing HIV transmission among key populations, such as female sex workers (FSWs), AGYW and pregnant and breastfeeding people (PBFP), remains an important challenge, particularly in SSA ( 5 ).

An expanding number of biomedical HIV prevention technologies with demonstrated efficacy in clinical trials and, where relevant, feasibility and acceptability data are either currently available or soon to be available ( 6 ). These include daily oral antiretroviral (ARV) pills for pre-exposure prophylaxis (PrEP), the monthly dapivirine vaginal ring (DVR) and long-acting cabotegravir for HIV prevention (CAB-LA), an intramuscular injectable form of PrEP ( 7 ). Efficacy studies in SSA have shown monthly DVR and bi-monthly CAB-LA to effectively reduce the risk of HIV infection. Monthly DVR demonstrated a reduction in the risk of HIV infection among African women of 31% and 27% in two Phase 3 multi-site placebo-controlled studies ( 8 , 9 ) and HPTN 084 reported the risk of HIV infection in the injectable cabotegravir group was reduced by 91% compared to the control group using oral PrEP ( 10 ). There are data to suggest implementation of the monthly DVR is feasible, while acceptability data are mixed. Some studies show the ring to be more acceptable than oral PrEP to AGYW while other studies suggest that acceptability varies across countries and usage during sex and menses ( 11 ). Data from the DELIVER and B-PROTECTED studies suggest DVR is safe to use during pregnancy and breastfeeding ( 12 ). However, the introduction and uptake of these products has been limited due to supply and demand challenges. DVR was prequalified and was recommended by the World Health Organization in 2020 and 2021, respectively, and regulatory approval from several countries in SSA has followed since then ( 13 ). Yet, it was not added to the South African Essential Medicines List ( 14 ), which guides the national health agenda, due to lack of studies comparing it to the current standard of care of oral PrEP and it being considered expensive at the initially proposed price of R300 per month compared to R52 for oral PrEP ( 14 ). Additionally, while CAB-LA has shown to be safe and efficacious and early implementation studies suggest high adherence rates ( 15 ), its introduction has been limited due to challenges relating to supply barriers in LMICs, implementation hurdles, and price ( 16 ). In 2022, ViiV, the product developer, signed a voluntary license with Medicines Patent Pool to enable manufacture of CAB-LA by generic companies, aiming to improve availability medium term ( 17 ).

While these efforts are underway to improve the introduction and scale up of currently or soon-to-be available HIV biomedical interventions, further work is needed to ensure future HIV prevention options meet women's varied needs including expanding choice by diversifying HIV prevention offering. Ongoing early development focuses on innovative combinations such as multipurpose technologies (MPTs), which aim to address the multiple needs of AGYW and others who are at risk for HIV, other STIs, and unwanted pregnancies ( 18 ). There are currently a number of MPTs in the pipeline such as oral pills, long acting injectables and implants with dual indication for HIV prevention and the prevention of unwanted pregnancies ( 19 ). Despite this agenda, investment for new HIV prevention products has flattened over the last eight years ( 20 , 21 ). Continued engagement including identification of commercial partners as these novel MPTs move through clinical development is needed. MPTs represent a unique business case, providing a potential dual market in both high-income countries (HIC) and LMICs.

Economic evaluations have become common in preparation for market introduction as part of health technology assessments (HTAs) with the intention of establishing cost-effectiveness for payer coverage ( 2 ). Opportunities to shape a product's target profile, business case and its readiness for introduction can be created by undertaking economic evaluations earlier in the development pathway.

Undertaking economic evaluations earlier in development poses a few challenges. The treatment of uncertainty is one of them. Therefore, an economic evaluation conducted early in development often relies on both quantitative and qualitative methods to address this uncertainty in the absence of observed estimates. Because economic evaluations at this stage are frequently conducted in-house, there are limited examples available to the public and limited methodological guidance. This can result in omissions of costs, inappropriate comparators and characterization of uncertainty or assumptions, among others ( 22 ). However, there are use case examples for how these evaluations are leveraged for internal decision making ( 2 , 23 ) and to mitigate the risks ( 23 ) and high costs of late-stage development ( 23 ). In this context, they can provide valuable insights into clinical trial design ( 23 , 24 ), into target populations or other drivers that improve value for money ( 25 , 26 ) and can guide decisions on what data need to be collected at the next phase of development ( 27 ) so that uncertainty is reduced when introduction decisions are made by policy makers and payers. Importantly, these early analyses can inform product developers' decisions on how to improve a product's eventual value for money, helping refine the target product profile as well as informing which product to prioritise across a given portfolio, focusing resources on those most promising products for further development and those most appropriate for a future programme ( Figure 1 ).

www.frontiersin.org

Figure 1 . Illustration of product development process and example of the value early economic evaluation can provide if integrated into the development pathway, leading to products better prepared for introduction.

Here we reflect on two methodological considerations that are central to early economic evaluations (approaches to uncertainty and the role of qualitative research). Either qualitative or quantitative data can be used to inform economic evaluations. In particular, early in the product development, researchers will focus on literature reviews and expert elicitation to parameterize model-based economic evaluations. We have described two methodological aspects of model-based economic evaluations that are key at this stage, namely, the use of qualitative data to inform model parameters and structure and the value of uncertainty analyses as main outputs to inform decisions. Using examples, we provide snapshots on how they might be applied to the context of the HIV MPT development landscape. The purpose of this paper is to illustrate the mixed method approach needed in early R&D and its applicability to HIV MPTs. Although early economic evaluation examples are limited, these examples can be applied to the development of future technologies for HIV prevention and MPTs.

Approaches to dealing with uncertainty

During early R&D, the data available to characterize products are limited and will evolve as the technology progresses in development. Data limitations include no efficacy, safety data, a limited target product profile, and limited awareness of the implementation pathway and usability of the product. To address these limitations, more attention has been paid in the last decade to the use of combined models of disease progression and pharmacodynamics linked to economic models ( 2 , 22 – 24 , 28 – 32 ). These linked models may then be used to inform trial design, guide strategic development decisions ( 33 ), and define and refine the target product profile and assumptions providing measurable value propositions, which emphasizes the need, the benefits, and its comparison to other products ( 34 ). Linked model outputs include estimates of efficacy, dosing regimen, pharmacokinetics, among others. These outputs can guide clinical development and help reframe value propositions once new data are collected during the different stages of clinical trials, providing an iterative framework for decision making ( 35 , 36 ), future trial design ( 25 ), and the preparation of strategies for reimbursement and pricing ( 2 , 29 , 32 , 37 – 39 ). Though researchers often emphasize the uncertainty that comes with modelling early in the development process as a limitation of early economic modelling ( 2 , 22 – 24 , 28 – 32 ), the framing and communication of this uncertainty becomes the objective of these analyses and future evidence generation will revolve around addressing this uncertainty. The framing of uncertainty and how to address it influences the methods used and the choice of output parameters. Deterministic and probabilistic sensitivity analyses as well as threshold analyses can be conducted across a broad range of parameters (e.g., expected efficacy with price, probable implementation strategies). These combinations help determine the viability of a future technology. Though similar analyses may be used later in product development, early insights that clarify trade-offs between product attributes inform developers on the specific product characteristics that could and must be optimised in future development.

For example, in the context of novel products for HIV prevention, Dugdale et al. selected three countries with a range of HIV epidemic characteristics to model cost effectiveness of novel HIV broadly neutralizing antibodies (bnAbs) for infant prophylaxis ( 25 ). Alongside a base case, bnAbs were modelled using sensitivity analysis across a range of varying parameters (e.g., efficacy, cost, different implementation strategies, different target populations) to determine parameter space of likely market feasibility ( 25 ). This information is critical, providing key parameters for product development targets for characteristics such as, efficacy, price, effect duration, and validating the potential cost effectiveness of implementation strategies to guide future HIV bnAb trials. As HIV prevention products and MPTs progress in development, evaluating the drivers of cost effectiveness can be used to tailor trials, guide future data collection, and better prepare a product for introduction (through complete evidence packages), increasing the likelihood of affordable, acceptable, scalable, and widely available technologies.

Central role of qualitative data

The context and setting where the future technologies will be delivered is one of the key determinants of market viability and return on investment. Expert elicitation is key to synthesize opinions of stakeholders and fully understand the use case and context of a potential technology. Unlike in later-stage economic evaluations where data is more readily available, early economic evaluations place a heavier emphasis on expert opinions ( 2 , 29 , 32 , 37 – 39 ) that can be used to complement the literature review, the existing trial data, and to illustrate uncertainty ( 29 ) in the absence of empirical data. For example, focus groups and key informant interviews (KIIs) can be used to validate assumptions and models ( 40 ). These expert opinions address uncertainty in the clinical pathway ( 32 ) through identification of clinical endpoints or patient target groups for testing as well as delivery strategies that may be possible in the future and their challenges ( 32 ). However, methods to conduct expert elicitation and to analyse the qualitative results are not standardized ( 41 ). Despite the lack of consensus on methods, expert opinion can help anchor key assumptions in early analyses ( 41 ). In the absence of performance data for an early-stage product, expert elicitation can also identify correlates that will serve as predictors of future performance. In the HIV prevention context, experts may use reference products such as oral, vaginal or injectable PrEP ( 6 ). An example is Unitaid's work when conducting conducted KIIs with global experts in HIV prevention, contraception and STIs, identifying key considerations for MPT development. Considerations included challenges to development and approval, but also variables and definitions guiding the development of an investment case, and the definition of decision points to advancing from pre-clinical to later stages of development ( 19 ). Key considerations identified by these KIIs can inform the MPT landscape for developers, providing insight into opportunities and challenges early in the development process. As public investors prioritize products for investment at an early stage of development, stakeholder inputs can help compensate for gaps in evidence, recommend implementation scenarios, and identify priority populations.

As useful as early economic evaluations are, they do present certain limitations. Using data from early trials may not reflect future clinical results or the ultimate patient population, making market viability difficult to assess. Additionally, it may not be possible to cover all possible scenarios and deciding the most important parameters to be considered will be essential yet mainly driven by the selection of stakeholders consulted. Data on future market competitors, public policy evolution, and manufacturing costs at scale will need to be estimated and arranged into scenarios where the likelihood of occurrence is unknown. However, in a time of growing development costs and with a higher proportion of funding for HIV prevention coming from public investment, MPTs can offer a unique business case, one with an expanded market and opportunities in both LMICs and HICs, making their development and commercialization feasible. Feeding into this business case, early economic evaluations provide an early look at implementation costs of a product, within target populations, and among indications that may improve PD efficiency and offer early insight into potential returns and economic feasibility. Additionally, investing resources into early and iterative economic modeling can produce stronger, better prepared products, and avoid the risk of expending resources carrying products through development that may be ill-suited for markets of interest.

Addressing uncertainty as one of the outputs of these early analyses can help improve upon decisions, model parameters, trial and product design, pricing, and lay groundwork for eventual market access. While stakeholder elicitation represents a resource to address evidence gaps, as data becomes available, these economic models can be further refined and improved in an iterative process. Finally, as products for HIV prevention and multipurpose prevention progress in development to phase 2 and 3, transparent business cases will facilitate engagement with commercial partners. Leveraging uncertainty analyses and qualitative data collection methods early on can refine the value proposition and strengthen those business cases, setting up products early for success.

Data availability statement

The original contributions presented in the study are included in the article, further inquiries can be directed to the corresponding author.

Author contributions

KC: Conceptualization, Methodology, Resources, Visualization, Writing – original draft. ST-R: Conceptualization, Methodology, Writing – review & editing, Resources. MM: Writing – review & editing. BYH: Writing – review & editing. EK-W: Conceptualization, Writing – review & editing. DT: Conceptualization, Writing – review & editing; GBG: Conceptualization, Methodology, Resources, Supervision, Visualization, Writing – review & editing.

The author(s) declare financial support was received for the research, authorship, and/or publication of this article.

This research/study was made possible with the generous support of the U.S. President's Emergency Plan for AIDS Relief (PEPFAR) through the U.S. Agency for International Development (USAID). The research/study was designed and implemented by MATRIX: A USAID Project to Advance the Research and Development of Innovative HIV Prevention Products for Women, under Cooperative Agreement #7200AA22CA00002. The content is solely the responsibility of the authors and does not necessarily represent the official views of USAID or PEPFAR.

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher's note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

1. Pham B, Tu HA, Han D, Pechlivanoglou P, Miller F, Rac V, et al. Early economic evaluation of emerging health technologies: protocol of a systematic review. Syst Rev . (2014) 3(1):81. doi: 10.1186/2046-4053-3-81

PubMed Abstract | Crossref Full Text | Google Scholar

2. Hartz S, John J. Contribution of economic evaluation to decision making in early phases of product development: a methodological and empirical review. Int J Technol Assess Health Care . (2008) 24(4):465–72. doi: 10.1017/S0266462308080616

3. Yenet A, Nibret G, Tegegne BA. Challenges to the availability and affordability of essential medicines in African countries: a scoping review. Clinicoecon Outcomes Res . (2023) 15:443–58. doi: 10.2147/CEOR.S413546

4. UNAIDS. UNAIDS HIV Fact Sheet 2022. (2022). Available online at: https://www.unaids.org/sites/default/files/media_asset/UNAIDS_FactSheet_en.pdf (Accessed April 09, 2024).

5. Joint United Nations Programme on HIV/AIVS. Dangerous Inequalities: World AIDS Day Report 2022. (2022). Available online at: https://www.unaids.org/en/resources/documents/2022/dangerous-inequalities (Accessed April 09, 2024).

6. Adamson B, Garrison L, Barnabas RV, Carlson JJ, Kublin J, Dimitrov D. Competing biomedical HIV prevention strategies: potential cost-effectiveness of HIV vaccines and PrEP in Seattle, WA. J Int AIDS Soc . (2019) 22(8):e25373. doi: 10.1002/jia2.25373

7. AVAC. The Future of ARV-Based Prevention and More. (2022). Available online at: https://avac.org/resource/infographic/the-future-of-arv-based-prevention-and-more/ (Accessed April 09, 2024).

8. Nel A, van Niekerk N, Kapiga S, Bekker LG, Gama C, Gill K, et al. Safety and efficacy of a dapivirine vaginal ring for HIV prevention in women. N Engl J Med . (2016) 375(22):2133–43. doi: 10.1056/NEJMoa1602046

9. Baeten JM, Palanee-Phillips T, Brown ER, Schwartz K, Soto-Torres LE, Govender V, et al. Use of a vaginal ring containing dapivirine for HIV-1 prevention in women. N Engl J Med . (2016) 375(22):2121–32. doi: 10.1056/NEJMoa1506110

10. Delany-Moretlwe S, Hughes JP, Bock P, Gurrion Ouma S, Hunidzarira P, Kalonji D, et al. Cabotegravir for the prevention of HIV-1 in women: results from HPTN 084, a Phase 3, Randomised Clinical Trial. Lancet . (2022) 399(10337):1779–89. doi: 10.1016/S0140-6736(22)00538-4

11. Mayo AJ, Browne EN, Montgomery ET, Torjesen K, Palanee-Phillips T, Jeenarain N, et al. Acceptability of the dapivirine vaginal ring for HIV-1 prevention and association with adherence in a phase III trial. AIDS Behav . (2021) 25(8):2430–40. doi: 10.1007/s10461-021-03205-z

12. Gonzalez L. Daprivirine Vaginal Ring Safe to Use in Third Trimester of Pregnancy and During Breastfeeding. Vaginal Rings & Topical PrEP. (2023). Available online at: https://www.aidsmap.com/news/feb-2023/dapivirine-vaginal-ring-safe-use-third-trimester-pregnancy-and-during-breastfeeding (Accessed April 09, 2024).

13. Peabody R. US Regulator’s Decision on Vaginal Ring Denies Choice to Women Who Need HIV Prevention. Vaginal Ring & Topical PrEP. (2022). Available online at: https://www.aidsmap.com/news/sep-2022/us-regulators-decision-vaginal-ring-denies-choice-women-who-need-hiv-prevention#:∼:text=These%20steps%20have%20allowed%20regulatory,support%20use%20of%20the%20ring (Accessed April 09, 2024).

14. Osih R, Nel J, Dawood H, Subedar H, Jamieson L, Leong T. To Determine if the Dapivirine Eluting Vaginal Ring (Dapivirine) is Safe and Effective in Preventing HIV Acquisition in Women at Substantial Risk of HIV Infection. (2022).

15. Nachega JB, Scarsi KK, Gandhi M, Scott RK, Mofenson LM, Archary M, et al. Long-acting antiretrovirals and HIV treatment adherence. Lancet HIV . (2023) 10(5):e332–42. doi: 10.1016/S2352-3018(23)00051-6

16. Henderson M, Schmidt HMA, Chitembo L, Peralta H, Alaama AS, Johnson C, et al. The future of pre-exposure prophylaxis (PrEP) for HIV prevention: a global qualitative consultation on provider perspectives on new products and differentiated service delivery. AIDS Behav . (2023) 27(11):3755–66. doi: 10.1007/s10461-023-04093-1

17. Medicines Patent Pool. Cabotegravir Long-Acting (La) for HIV Pre-Exposure Prophylaxis (PrEP) . (2022). Available online at: https://medicinespatentpool.org/licence-post/cabotegravir-long-acting-la-for-hiv-pre-exposure-prophylaxis-prep (Accessed April 09, 2024).

18. Young Holt B, Turpin JA, Romano J. Multipurpose prevention technologies: opportunities and challenges to ensure advancement of the most promising MPTs. Front Reprod Health . (2021) 3:704841. doi: 10.3389/frph.2021.704841

19. IMPT UNITAID CIFF. Multipurpose Prevention Technologies (MPTs): Technology Landscape and Potential for Low-and Middle-Income Countries . Geneva: The IMPT UNITAID CIFF (2021).

Google Scholar

20. HIV resource tracking. HIV Prevention Research & Development Investments. (2021). Available online at: https://www.hivresourcetracking.org/ (Accessed April 09, 2024).

21. AVAC. HIV Prevention R&D Funding Drops Again, Even as Major Scientific Advances Require Support. (2021). Available online at: https://www.avac.org/press-release/hiv-prevention-rd-funding-drops-again (Accessed April 09, 2024).

22. Drummond M, Sculpher M. Common methodological flaws in economic evaluations. Med Care . (2005) 43(7 Suppl):5–14. doi: 10.1097/01.mlr.0000170001.10393.b7

23. IJzerman MJ, Koffijberg H, Fenwick E, Krahn M. Emerging use of early health technology assessment in medical product development: a scoping review of the literature. Pharmacoeconomics . (2017) 35(7):727–40. doi: 10.1007/s40273-017-0509-1

24. Hill-McManus D, Marshall S, Soto E, Lane S, Hughes D. Impact of non-adherence and flare resolution on the cost-effectiveness of treatments for gout: application of a linked pharmacometric/pharmacoeconomic model. Value Health . (2018) 21(12):1373–81. doi: 10.1016/j.jval.2018.06.002

25. Dugdale CM, Ufio O, Alba C, Permar SR, Stranix-Chibanda L, Cunningham CK, et al. Cost-effectiveness of broadly neutralizing antibody prophylaxis for HIV-exposed infants in sub-saharan African settings. J Int AIDS Soc . (2023) 26(1):e26052. doi: 10.1002/jia2.26052

26. Miquel-Cases A, Steuten LMG, Retèl VP, van Harten WH. Early stage cost-effectiveness analysis of a BRCA1-like test to detect triple negative breast cancers responsive to high dose alkylating chemotherapy. Breast . (2015) 24(4):397–405. doi: 10.1016/j.breast.2015.03.002

27. Srinivasan M, White A, Chaturvedula A, Vozmediano V, Schmidt S, Plouffe L, et al. Incorporating pharmacometrics into pharmacoeconomic models: applications from drug development. Pharmacoeconomics . (2020) 38(10):1031–42. doi: 10.1007/s40273-020-00944-0

28. Annemans L, Cleemput I, Simoens S, Arickx F, Hulstaert F, Bogaert M. The increasing role of health economic evaluations in drug development. Drug Dev Res . (2010) 71(8):457–62. doi: 10.1002/ddr.20420

Crossref Full Text | Google Scholar

29. Girling A, Young T, Brown C, Lilford R. Early-stage valuation of medical devices: the role of developmental uncertainty. Value Health . (2010) 13(5):585–91. doi: 10.1111/j.1524-4733.2010.00726.x

30. Love-Koh J. How useful are early economic models? Comment on “problems and promises of health technologies: the role of early health economic modelling”. Int J Health Policy Manag . (2020) 9(5):215–7. doi: 10.15171/ijhpm.2019.119

31. Teljeur C, Ryan M. Early health economic modelling—optimizing development for medical device developers? Comment on “problems and promises of health technologies: the role of early health economic modeling”. Int J Health Policy Manag . (2020) 9(9):403–5. doi: 10.15171/ijhpm.2019.136

32. Abel L, Shinkins B, Smith A, Sutton AJ, Sagoo GS, Uchegbu I, et al. Early economic evaluation of diagnostic technologies: experiences of the NIHR diagnostic evidence co-operatives. Med Decis Making . (2019) 39(7):857–66. doi: 10.1177/0272989X19866415

33. Poland B, Wada R. Combining drug-disease and economic modelling to inform drug development decisions. Drug Discov Today . (2001) 6(22):1165–70. doi: 10.1016/S1359-6446(01)02014-1

34. Defining the value proposition of biotech therapies. Biotechnol Healthc . (2004) 1(2):42–4.

35. van Hasselt JGC, Gupta A, Hussein Z, Beijnen JH, Schellens JHM, Huitema ADR. Integrated simulation framework for toxicity, dose intensity, disease progression, and cost effectiveness for castration-resistant prostate cancer treatment with eribulin. CPT Pharmacometrics Syst Pharmacol . (2015) 4(7):374–85. doi: 10.1002/psp4.48

36. Drummond MF. Modeling in early stages of technology development: is an iterative approach needed? Comment on “problems and promises of health technologies: the role of early health economic modeling”. Int J Health Policy Manag . (2020) 9(6):260–2. doi: 10.15171/ijhpm.2019.118

37. Vallejo-Torres L, Steuten L, Parkinson B, Girling AJ, Buxton MJ. Integrating health economics into the product development cycle: a case study of absorbable pins for treating hallux valgus. Med Decis Making . (2011) 31(4):596–610. doi: 10.1177/0272989X10388041

38. Annemans L, Redekop K, Payne K. Current methodological issues in the economic assessment of personalized medicine. Value Health . (2013) 16(6 Suppl):S20–6. doi: 10.1016/j.jval.2013.06.008

39. Annemans L, Genesté B, Jolain B. Early modelling for assessing health and economic outcomes of drug therapy. Value Health . (2000) 3(6):427–34. doi: 10.1046/j.1524-4733.2000.36007.x

40. Brandes A, Sinner MF, Kääb S, Rogowski WH. Early decision-analytic modeling—a case study on vascular closure devices. BMC Health Serv Res . (2015) 15(1):486. doi: 10.1186/s12913-015-1118-3

41. Soares MA, Sharples L, Morton A, Claxton K, Bojke L. Experiences of structured elicitation for model-based cost-effectiveness analyses. Value Health . (2018) 21(6):715–23. doi: 10.1016/j.jval.2018.01.019

Keywords: economic evaluation, low- and middle-income countries, multipurpose prevention technologies, HIV, prevention, product development, research and development

Citation: Chapman K, Torres-Rueda S, Metzler M, Young Holt B, Kahn-Woods E, Thornton D and Gomez GB (2024) The role of economic evaluations in advancing HIV multipurpose prevention technologies in early-stage development. Front. Reprod. Health 6:1272950. doi: 10.3389/frph.2024.1272950

Received: 4 August 2023; Accepted: 22 March 2024; Published: 18 April 2024.

Reviewed by:

© 2024 Chapman, Torres-Rueda, Metzler, Young Holt, Kahn-Woods, Thornton and Gomez. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY) . The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Katerina Chapman [email protected]

Multilingual Education in Russia: Balashov and Saratov

Author: Tatyana Lipai and Eugenia Sergeevna

Originally Published at Peace and Conflict Monitor on: 12/03/2012

Currently, Russia and Belarus are undergoing significant changes in the political, social and other spheres of society, including increasing social tensions, and a qualitative change in the consciousness of views on education. Ideally, education helps individuals to determine the meaning of life, clarify social roles, and define moral obligations to themselves and others. Education involves not only separation, but also the integration of people according to their professions, accompanying the whole life of man.

For people with higher education, there are more opportunities to apply their knowledge, make effective use of material, and access financial and informational resources. It can be argued that education now has a crucial role in shaping the intellectual potential of society, and achieving a high level of education is a means toward the self-determination of students.

School graduates face a difficult choice: for whom to study? It would seem to be easy. It suffices to look at the ratings and determine what professions are the most relevant, in which area there is the largest wage increase and is now the biggest shortage. However, the labor market is changeable, and the current favorites may become outsiders in the future. For example, in the early to mid-1990s it was fashionable to study to be a lawyer, a designer, a dentist, and etc. And today tens of thousands of experts, including those who received the prestigious diplomas of Moscow State University and MGIMO, cannot find a decent job. The market is overcrowded with graduates, almost without any experience, without knowledge of any foreign languages, and not fully mobile in society, but having pretensions of higher wages.

The harsh and often unpredictable changes in demand for professions are not limited to Russia. The country’s crisis in the early 1990s only highlighted the trends that were observed in all developed countries during the 20th century. Dozens of professions disappeared, in place of which came hundreds of new ones. Consequently, the high competitiveness of graduates in the labor market is a key indicator of the successful activity of high schools.

The pledge of such high competitiveness of the young specialists may be only the high quality of their training. The problem of teaching students practical skills in activities within the classroom, even with the best-known contemporary methodological approaches, cannot be solved in full. The educational methodical association of universities in Russia sees one solution in more efficient use of extracurricular work with the students, especially the study of foreign languages, and different forms of participation in real-world affairs.

During their training, each student should develop an idea of their chosen path, as well as the necessary knowledge, skills, and ability to find their place in life, profession and society. The wrong selection of areas of professional activity leads to frustration, and the possible atrophy of creativity and personality.

Multilingual development of the student contributes to creative and flexible thinking skills and personal growth; this is the real purpose and measure of success for the modern multilingual education corresponding to his personal humane orientation and modern social reference point.

Particular attention in this article is given to foreign language education among students studying management in an economic institute.

Our study addressed the following questions: How interesting are the foreign languages for the future students in regional and provincial universities? And how do they appreciate their own multilingual knowledge in the outlook for their future career? How much time is devoted to study of foreign languages in the curriculum? And how much time do the students spend for independent study?

Research subjects were characterized by social, national, cultural and other indicators, such as sex, age, location, fertility, and migration. The most important indicators for this study were the standard of living, income and expense, their structure and differentiation, cost of living and the consumer basket, the proportion of the population with incomes below the subsistence level, consumption of goods and services. Regions differ in the level of employment and unemployment, the volume of financing of social expenditures of the regional budget. Significant differences in the social development of the regions are reflected in the index of human development, including education.

Our study compared subjects from a district city, Balashov, with those of a regional city, Saratov. According to the results of the study, the main reasons of studying of foreign languages by the management students were identified.

Based on the histogram, we can make following conclusions. First and foremost, it is clear that most students of Balashov study a foreign language to expand their horizons: the 1st year-22%, the 2nd year-30%, the 3d year-24%, and the 4th year-25%. The relatively low numbers are explained by the fact that students of regional cities are not fully aware of the possible benefits that may come with greater knowledge of foreign languages, haven’t had the opportunity to travel, speak to native foreign speakers, or take a part in different international projects. Furthermore, funding for regional higher educational institutions does not allow for international student exchanges.

As for the students of Saratov, we may note that the interest in foreign language is higher. According to the conducted research, students of Saratov more consciously study the foreign language, and see the urgency of foreign language acquisition in the prospect of a future profession: the 1st year-31%, the 2nd year-38%, the 3d year-55%, the 4th year-43%.

Answering the question, “what foreign language is most useful in the management?”, students of Balashov prefer English 71 %, in second place is German 22%, while French was chosen by 2 % of students, and Chinese 5%. In Saratov, 73% of students of management noted the importance of speaking English. 21 % of students gave preference to German and only 6 % thought that Chinese widens one’s prospective in the field of management.

Therefore, the preferred foreign language for students of Saratov and Balashov is English. English will most likely continue to dominate among its European counterparts, while Chinese and Arabic will be interesting for specialists working and having business in these countries.

In accordance with the state educational standards of higher education for a specialization in organizational management, a two years training program with a volume of 280 classroom hours has been developed and designed.

The process of multilingual training ideally involves the combination of classroom and extracurricular work with the aim of promoting creativity and independence in learning foreign languages, expanding horizons and applying an active use of knowledge in the process of intercultural communication. But in practice, the situation is different. First, many students have a weak pre-university training, which leads to poor motivation in the studying of foreign languages, and secondly, not all students realize the importance of multilingualism for their future profession. Respectively, they can’t always relate themselves to the study of foreign languages, to make the time for all the different activities at each stage of learning.

Our empirical study has shown that in a small Russian city the system of the pre-educating for the university preparation of students-managers is not developed with regard to foreign languages. Multilevel trade education of managers remains the unrealized organizational innovation.

On the basis of our research into the state of multilingual education in the modern management sphere, we will set forth recommendations on the intensification of preparation of multilingual specialists:

· to begin the study of foreign languages from preschool age;

· to raise the level of language mastery among graduating students, and on the final state examination;

· to plug the requirement of obligatory study of the second foreign language in curricula;

· to intensify the development and introduction of multilingual elective courses for future managers;

· to activate additional payment services for management students studying foreign languages.

Literature:

  • Blinov, A., Sidorova, A. Educating at higher school: self-bearings of students // Problems of theory and practice of management, 2007. no. 11, 206 p.
  • Semenov Igor The Difficult choice: on whom it is advantageous to study // the Socio-economic magazine “Circle of life”, 2006, no. 17, 68 p.
  • Social management: studies. manual / D.V/Zaitsev, G.G.Karpova, G.V.Lobacheva and other;. P.V. Romanov, E.R.Yarskaia-Smirnova – Saratov: Saratov state tech.un, 2008. 363 p.
  • On-line tutorial on discipline foreign language // the Educational complex on discipline the «Foreign language» (English) for the students of speciality «Management of organization», Balashov, 2007.

Bio: Tatyana Lipai, Professor of Management and Economics of Education, Minsk, Belarus. [email protected] Eugenia Sergeevna, Teacher, Municipal budgetary educational establishment, Murmansk area closed administrative territorial district Aleksandrovsk, Snezhnogorsk.

Ads

  • + - Font Size

IMAGES

  1. Qualitative research & evaluation methods by Michael Quinn Patton

    qualitative research and evaluation methods latest edition

  2. Evaluative Research: Definition, Methods & Types

    qualitative research and evaluation methods latest edition

  3. Qualitative Research Methods

    qualitative research and evaluation methods latest edition

  4. (PDF) Qualitative Research Methods

    qualitative research and evaluation methods latest edition

  5. Qualitative evaluation and research methods by Michael Quinn Patton

    qualitative research and evaluation methods latest edition

  6. 9780803931299: How to Use Qualitative Methods in Evaluation: 4 (CSE

    qualitative research and evaluation methods latest edition

VIDEO

  1. Overview of CU Denver's Research & Evaluation Methods Program Offerings

  2. RESEARCH CRITIQUE Qualitative Research

  3. Qualitative Research Reporting Standards: How are qualitative articles different from quantitative?

  4. 2023 PhD Research Methods: Qualitative Research and PhD Journey

  5. Exploring Qualitative and Quantitative Research Methods and why you should use them

  6. Comparison of Quantitative & Qualitative Research

COMMENTS

  1. Qualitative Research & Evaluation Methods

    Fourth Edition. Drawing on more than 40 years of experience conducting applied social science research and program evaluation, author Michael Quinn Patton has crafted the most comprehensive and systematic book on qualitative research and evaluation methods, inquiry frameworks, and analysis options available today.

  2. Qualitative Research & Evaluation Methods

    Drawing on more than 40 years of experience conducting applied social science research and program evaluation, author Michael Quinn Patton has crafted the most comprehensive and systematic book on qualitative research and evaluation methods, inquiry frameworks, and analysis options available today. Now offering more balance between applied research and evaluation, this Fourth Edition of ...

  3. Qualitative Research & Evaluation Methods 3rd Edition

    There is a newer edition of this item: Qualitative Research & Evaluation Methods: Integrating Theory and Practice. $131.32. (277) Only 10 left in stock - order soon. The book that has been a resource and training tool for countless applied researchers, evaluators, and graduate students has been completely revised with hundreds of new examples ...

  4. Qualitative Research & Evaluation Methods

    Michael Quinn Patton is author of more than a dozen books on evaluation including Qualitative Research & Evaluation Methods, 4th ed (2015), Blue Marble Evaluation (2020), Principles-Focused Evaluation (2018), Facilitating Evaluation (2018) and Developmental Evaluation (2011). Based in Minnesota, he was on the faculty of the University of ...

  5. Qualitative Research & Evaluation Methods: Michael Quinn Patton

    Now offering more balance between applied research and evaluation, this Fourth Edition of Qualitative Research & Evaluation Methods illuminates all aspects of qualitative inquiry through new examples, stories, and cartoons; more than a hundred new summarizing and synthesizing exhibits; and a wide range of new highlight sections/sidebars that ...

  6. Qualitative Research & Evaluation Methods

    Michael Quinn Patton . Michael Quinn Patton is author of more than a dozen books on evaluation including Qualitative Research & Evaluation Methods, 4th ed (2015), Blue Marble Evaluation (2020), Principles-Focused Evaluation (2018), Facilitating Evaluation (2018) and Developmental Evaluation (2011). Based in Minnesota, he was on the faculty of the University of Minnesota for 18 years and is a ...

  7. Qualitative Research & Evaluation Methods

    Drawing on more than 40 years of experience conducting applied social science research and program evaluation, author Michael Quinn Patton has crafted the most comprehensive and systematic book on qualitative research and evaluation methods, inquiry frameworks, and analysis options available today. Now offering more balance between applied research and evaluation, this Fourth Edition ...

  8. Qualitative Research & Evaluation Methods: Integrating Theory and

    Now offering more balance between applied research and evaluation, this Fourth Edition illuminates all aspects of qualitative inquiry through new examples, stories, and cartoons; more than a hundred new summarizing and synthesizing exhibits; and a wide range of new highlight sections/sidebars that elaborate on important and emergent issues.

  9. Qualitative research & evaluation methods: integrating theory and

    The fourth edition of Michael Quinn Patton's Qualitative Research & Evaluation Methods Integrating Theory and Practice, published by Sage Publications, analyses and provides clear guidance and advice for using a range of different qualitative methods for evaluation. Contents Part 1. Framing Qualitative Inquiry: Theory Informs Practice, Practice Informs Theory

  10. Qualitative research and evaluation methods

    Qualitative research and evaluation methods. 21 reviews. Author: Michael Quinn Patton. Summary: This book has been completely revised with hundreds of new examples and stories illuminating all aspects of qualitative inquiry. This third edition has retained and expanded upon the exhibits, which highlight and summarize major issues, guidelines ...

  11. Qualitative Research & Evaluation Methods: Integrating Theory and

    Michael Quinn Patton is author of more than a dozen books on evaluation including Qualitative Research & Evaluation Methods, 4th ed (2015), Blue Marble Evaluation (2020), Principles-Focused Evaluation (2018), Facilitating Evaluation (2018) and Developmental Evaluation (2011). Based in Minnesota, he was on the faculty of the University of Minnesota for 18 years and is a former president of the ...

  12. Advancing Qualitative Meta-Studies (QMS): Current Practices and

    In organization and management studies, QMS is still in its infancy. Recently, there has been a significant rise in QMS-related publications, which have introduced various protocols and standards for synthesizing qualitative data (e.g., Berente et al., 2019, 2022; Habersang et al., 2019; Omanović & Langley, 2023; Sarkar & Mateus, 2022).Given the increasing use of QMS in our field, it is ...

  13. Qualitative Evaluation and Research Methods 2nd Edition

    There is a newer edition of this item: Qualitative Research & Evaluation Methods: Integrating Theory and Practice. $109.44. (271) Only 5 left in stock - order soon. Once again setting the standard for the field, the Second Edition of Qualitative Evaluation Methods reflects the tremendous explosion of interest in qualitative methods over the ...

  14. Saratov State University: Past and Present

    Being one of the oldest universities in Russia, today it is a large and quickly growing university complex that has great educational, research and innovation potential. SSU has a long tradition of research and a wide range of international contacts. On May 20, 2010 Saratov State University got the status of National Research University.

  15. Influence of Agrometeorological Factors on the Productivity ...

    The analysis of agroclimatic changes was based on the data on monthly mean air temperature and monthly total precipitation from the official websites of All-Russian Research Institute of Hydrometeorological Information-World Data Center and Weather and Climate [1, 2] for five weather stations located in different natural and climatic zones of the Saratov oblast over the period from 2000 to ...

  16. Qualitative Research & Evaluation Methods: Integrating Theory and

    Now offering more balance between applied research and evaluation, this Fourth Edition of Qualitative Research & Evaluation Methods illuminates all aspects of qualitative inquiry through new examples, stories, and cartoons; more than a hundred new summarizing and synthesizing exhibits; and a wide range of new highlight sections/sidebars that ...

  17. Frontiers

    Therefore, an economic evaluation conducted early in development often relies on both quantitative and qualitative methods to address this uncertainty in the absence of observed estimates. Because economic evaluations at this stage are frequently conducted in-house, there are limited examples available to the public and limited methodological ...

  18. Qualitative Research & Evaluation Methods

    Drawing on more than 40 years of experience conducting applied social science research and program evaluation, author Michael Quinn Patton has crafted the most comprehensive and systematic book on qualitative research and evaluation methods, inquiry frameworks, and analysis options available today. Now offering more balance between applied research and evaluation, this Fourth Edition ...

  19. SaratovBioTech

    The first agreement for the supply of equipment. The delegation of «SaratovBioTech» visited the company Bühler in Switzerland. The concern occupies a leading position in the world market in the field of technologies and methods of grain processing. 65% of the mills in the world are equipped by Bühler.

  20. Multilingual Education in Russia: Balashov and Saratov

    Multilingual Education in Russia: Balashov and Saratov. Author: Tatyana Lipai and Eugenia Sergeevna Originally Published at Peace and Conflict Monitor on: 12/03/2012 . Currently, Russia and Belarus are undergoing significant changes in the political, social and other spheres of society, including increasing social tensions, and a qualitative change in the consciousness of views on education ...