integrative approach to literature review

University of Houston Libraries

• Literature Reviews in the Health Sciences
• Review Comparison Chart
• Decision Tools
• Systematic Review
• Meta-Analysis
• Scoping Review
• Mapping Review
• Integrative Review
• Rapid Review
• Realist Review
• Umbrella Review
• Review of Complex Interventions
• Diagnostic Test Accuracy Review
• Narrative Literature Reviews
• Standards and Guidelines

Navigate the links below to jump to a specific section of the page:

When is an Integrative Review methodology appropriate?

Outline of stages, methods and guidance, examples of integrative reviews, supplementary resources.

"An integrative review is a specific review method that summarizes past empirical or theoretical literature to provide a greater comprehensive understanding of a particular phenomenon or healthcare problem" (Broome, 1993). Thus, integrative reviews have the potential to build upon nursing science, informing research, practice, and policy initiatives.

An integrative review method is an approach that allows for the inclusion of diverse methodologies (i.e. experimental and non-experimental research) and have the potential to play a greater role in evidence-based practice for nursing ( Whittemore & Knafl, 2005 ).

Characteristics:

• An integrative review is best designed for nursing research
• The problem must be clearly defined
• define concepts
• review theories
• review evidence/point out gaps in the literature
• analyze methodological issues

When to Use It: According to Toronto & Remington (2020) , Whittmore & Knafl (2005) , and Broome (2000)  an integrative review approach is best suited for:

• A research scope focused more broadly at a phenomenon of interest rather than a systematic review and allows for diverse research, which may contain theoretical and methodological literature to address the aim of the review.
• Supporting a wide range of inquiry, such as defining concepts, reviewing theories, or analyzing methodological issues.
• Examining the complexity of nursing practice more broadly by using diverse data sources.

The following stages of conducting an integrative review are derived from  Whittemore & Knafl (2005) .

Timeframe:  12+ months

*Varies beyond the type of review. Depends on many factors such as but not limited to: resources available, the quantity and quality of the literature, and the expertise or experience of reviewers" ( Grant & Booth, 2009 ).

Question:  Formulation of a problem, may be related to practice and/or policy especially in nursing.

Is your review question a complex intervention?  Learn more about  Reviews of Complex Interventions .

Sources and searches:  Comprehensive but with a specific focus, integrated methodologies-experimental and non-experimental research. Purposive Sampling may be employed. Database searching is recommended along with grey literature searching. "Other recommended approaches to searching the literature include ancestry searching, journal hand searching, networking, and searching research registries." Search is transparent and reproducible.

Selection:  Selected as related to problem identified or question, Inclusion of empirical and theoretical reports and diverse study methodologies. 

Appraisal:  "How quality is evaluated in an integrative review will vary depending on the sampling frame." Limited/varying methods of critical appraisal and can be complex. "In a review that encompasses theoretical and empirical sources, two quality criteria instruments could be developed for each type of source and scores could be used as criteria for inclusion/exclusion or as a variable in the data analysis stage."

Synthesis:  Narrative synthesis for qualitative and quantitative studies. Data extracted for study characteristics and concept. Synthesis may be in the form of a table, diagram or model to portray results. "Extracted data are compared item by item so that similar data are categorized and grouped together."  

The method consists of:

• data reduction
• data display
• data comparison
• conclusion drawing,
• verification 

The following resources are considered to be the best guidance for conduct in the field of integrative reviews.

Methods & Guidance

• Hopia, H., Latvala, E., & Liimatainen, L. (2016). Reviewing the methodology of an integrative review .  Scandinavian journal of caring sciences ,  30 (4), 662–669. doi: 10.1111/scs.12327
• Russell C. L. (2005). An overview of the integrative research review .  Progress in transplantation ,  15 (1), 8–13. doi: 10.1177/152692480501500102
• Whittemore, R., & Knafl, K. (2005). The integrative review: updated methodology .  Journal of advanced nursing ,  52 (5), 546–553. doi: 10.1111/j.1365-2648.2005.03621.x

Reporting Guideline

There is currently no reporting guideline for integrative reviews.

• Collins, J. W., Zoucha, R., Lockhart, J. S., & Mixer, S. J. (2018). Cultural aspects of end-of-life care planning for African Americans: an integrative review of literature .  Journal of transcultural nursing ,  29 (6), 578–590. doi: 10.1177/1043659617753042
• Cowdell, F., Booth, A., & Appleby, B. (2017). Knowledge mobilization in bridging patient-practitioner-researcher boundaries: a systematic integrative review protocol .  Journal of advanced nursing ,  73 (11), 2757–2764. doi: 10.1111/jan.13378
• Frisch, N. C., & Rabinowitsch, D. (2019). What's in a definition? Holistic nursing, integrative health care, and integrative nursing: report of an integrated literature review .  Journal of holistic nursing ,  37 (3), 260–272. doi: 10.1177/0898010119860685
• Kim, J., Kim, Y. L., Jang, H., Cho, M., Lee, M., Kim, J., & Lee, H. (2020). Living labs for health: an integrative literature review .  European journal of public health ,  30 (1), 55–63. doi: 10.1093/eurpub/ckz105
• Luckett, T., Sellars, M., Tieman, J., Pollock, C. A., Silvester, W., Butow, P. N., Detering, K. M., Brennan, F., & Clayton, J. M. (2014). Advance care planning for adults with CKD: a systematic integrative review .  American journal of kidney diseases ,  63 (5), 761–770. doi: 10.1053/j.ajkd.2013.12.007
• Shinners, L., Aggar, C., Grace, S., & Smith, S. (2020). Exploring healthcare professionals' understanding and experiences of artificial intelligence technology use in the delivery of healthcare: an integrative review .  Health informatics journal ,  26 (2), 1225–1236. doi: 10.1177/1460458219874641
• Silva, D., Tavares, N. V., Alexandre, A. R., Freitas, D. A., Brêda, M. Z., Albuquerque, M. C., & Melo, V. L. (2015). Depressão e risco de suicídio entre profissionais de Enfermagem: revisão integrative [Depression and suicide risk among nursing professionals: an integrative review] .  Revista da Escola de Enfermagem da U S P ,  49 (6), 1027–1036. doi: 10.1590/S0080-623420150000600020
• Stormacq, C., Van den Broucke, S., & Wosinski, J. (2019). Does health literacy mediate the relationship between socioeconomic status and health disparities? integrative review .  Health promotion international ,  34 (5), e1–e17. doi: 10.1093/heapro/day062
• Broome M.E. (1993). Integrative literature reviews for the development of concepts. In Rodgers, B. L., & Knafl, K. A. (Eds.),  Concept development in nursing  (2nd ed., pp. 231-250). W.B. Saunders Company.
• da Silva, R. N., Brandão, M., & Ferreira, M. A. (2020). Integrative Review as a Method to Generate or to Test Nursing Theory .  Nursing science quarterly ,  33 (3), 258–263. doi: 10.1177/0894318420920602
• Garritty, C., Gartlehner, G., Nussbaumer-Streit, B., King, V. J., Hamel, C., Kamel, C., Affengruber, L., & Stevens, A. (2021). Cochrane Rapid Reviews Methods Group offers evidence-informed guidance to conduct rapid reviews .  Journal of clinical epidemiology ,  130 , 13–22. doi: 10.1016/j.jclinepi.2020.10.007
• Grant, M. J., & Booth, A. (2009). A typology of reviews: an analysis of 14 review types and associated methodologies .  Health information and libraries journal ,  26 (2), 91–108. doi: 10.1111/j.1471-1842.2009.00848.x

Toronto, C. E., & Remington, R. (2020).  A Step-By-Step Guide to Conducting an Integrative Review.  Springer International Publishing AG. doi: 10.1007/978-3-030-37504-1

• Torraco, R. J. (2005). Writing integrative literature reviews: guidelines and examples .  Human Resource Development Review, 4 (3), 356–367. doi: 10.1177/1534484305278283
• Whittemore. (2007). Rigour in Integrative Reviews . In Webb, C., & Roe, B. (Eds.),  Reviewing Research Evidence for Nursing Practice (pp. 149–156). Blackwell Publishing Ltd. https://doi.org/10.1002/9780470692127.ch11
• << Previous: Mapping Review
• Next: Rapid Review >>

Other Names for an Integrative Review

• Integrative Literature Review
• Systematic Integrative Review
• Integrative Research Review

Limitations of an Integrative Review

The following challenges of integrative reviews are derived from Toronto & Remington (2020) , Whitmore & Knafl (2005) , and Broome (2000) .

• The combination and complexity of incorporating diverse methodologies can contribute to lack of rigor, inaccuracy, and bias.
• Methods of analysis, synthesis, and conclusion-drawing remain poorly formulated.
• Combining empirical and theoretical reports can be difficult.
• There is no current guidance on reporting.

Medical Librarian

• Last Updated: Sep 5, 2023 11:14 AM
• URL: https://guides.lib.uh.edu/reviews

• Integrative Review

What is an Integrative Review?

An  integrative review provides a broader summary of the literature and includes findings from a range of research designs. It gathers and synthesizes  both empirical and theoretical evidence  relevant to a clearly defined problem. It may include case studies, observational studies, and meta-analyses, but may also include practice applications, theory, and guidelines. It is the only approach that allows for the combination of diverse methodologies. Its aim is to develop a holistic understanding   of the topic, present the state of the science and contribute to theory development.  The integrative review has been advocated as important for evidence-based practice initiatives in nursing  (Hopia et al., 2016).

Integrative reviews are popular in nursing because they use diverse data sources to investigate the complexity of nursing practice. An integrative review addresses the current state of the evidence, the quality of the available evidence, identifies gaps in the literature and suggests future directions for research and practice The clinical question(s)   of an integrative review   is broader  than that of a systematic review, yet should be clearly stated and well-defined. As with a systematic review, an integrative review requires a transparent and rigorous systematic approach  (Remington & Toronto, 2020).

Integrative reviews synthesize research data from various research designs to reach comprehensive and reliable conclusions. An integrative review helps to develop a comprehensive understanding of the topic by synthesizing  all forms of available evidence (Dhollande et al., 2021). They allow healthcare professionals to use all available evidence from both  qualitative and quantitative research to provide a more holistic understanding of the topic, which can then be applied to clinical practice. Sampling for an integrative review may include experimental and nonexperimental (empirical) and theoretical literature (Remington & Toronto, 2020). 

From:  Kutcher, & LeBaron, V. T. (2022). A simple guide for completing an integrative review using an example article.  Journal of Professional Nursing,  40 , 13-19. https://doi.org/10.1016/j.profnurs.2022.02.004

See Table 2: Steps of the integrative review (IR) process with key points and lessons learned

Steps of the Integrative Review Process

1: Select a Topic:  Formulate a purpose and/or review question(s).   An integrative review can be used to answer research questions related to nursing and other disciplines.   Clearly identify a problem from a gap in the literature. Perform a quick search for other literature reviews related to the topic of interest to avoid duplication. Integrative review questions should be  broad in scope, but narrow enough that the search is manageable.  It should be  well-defined,  and  clearly stated . Provide background on the topic and justification for the integrative review. Do a quick literature search to determine if any recent integrative or other types of reviews on or related to the topic have been performed.

Quality Appraisal Tools for Integrative Reviews

Critical Appraisal Skills Programme (CASP) Checklists  Appraisal checklists designed for use with Systematic Reviews, Randomized Controlled Trials, Cohort Studies,  Case Control  Studies, Economic Evaluations, Diagnostic Studies, Qualitative studies and Clinical Prediction Rule.

Mixed Methods Appraisal Tool (MMAT)  The MMAT is a critical appraisal tool that is designed for the appraisal stage of systematic mixed studies reviews, i.e., reviews that include qualitative, quantitative and mixed methods studies. It permits to appraise the methodological quality of five categories to studies: qualitative research, randomized controlled trials, non-randomized studies, quantitative descriptive studies, and mixed methods studies. (Hong et al., 2018).

Hong, Q. N., Fàbregues, S., Bartlett, G., Boardman, F., Cargo, M., Dagenais, P., Gagnon, M.-P., Griffiths, F., Nicolau, B., O’Cathain, A., Rousseau, M.-C., Vedel, I., & Pluye, P. (2018). The Mixed Methods Appraisal Tool (MMAT) version 2018 for information professionals and researchers.  Education for Information, 34 (4), 285–291. https://doi.org/10.3233/EFI-180221

More Information

For more information on integrative reviews:

Dhollande, S., Taylor, A., Meyer, S., & Scott, M. (2021). Conducting integrative reviews: A guide for novice nursing researchers.  Journal of Research in Nursing, 26( 5), 427–438. https://doi.org/10.1177/1744987121997907

Evans, D. (2007). Integrative reviews: Overview of methods. In C. Webb, & B. Roe (Eds.),  Reviewing research evidence for nursing practice: Systematic reviews  (pp. 135 - 148). John Wiley & Sons, Incorporated.

Hopia, Latvala, E., & Liimatainen, L. (2016). Reviewing the methodology of an integrative review.  Scandinavian Journal of Caring Sciences,  30 (4), 662–669. https://doi.org/10.1111/scs.12327

Kutcher, & LeBaron, V. T. (2022). A simple guide for completing an integrative review using an example article.  Journal of Professional Nursing,  40 , 13-19. https://doi.org/10.1016/j.profnurs.2022.02.004

Oermann, M. H., & Knafl, K. A. (2021). Strategies for completing a successful integrative review.  Nurse Author & Editor (Blackwell) ,  31 (3/4), 65–68. https://doi-org.libproxy.adelphi.edu/10.1111/nae2.30

Toronto, C. E., & Remington, R. (Eds.). (2020).  A step-by-step guide to conducting an integrative review . Springer.

Whittemore, R., & Knafl, K. (2005). The integrative review: updated methodology.  Journal of Advanced Nursing ,  52 (5), 546–553. https://doi.org/10.1111/j.1365-2648.2005.03621.x

Whittemore, R. (2007). Rigour in integrative reviews. In C. Webb, & B. Roe (Eds.),  Reviewing research evidence for nursing practice: Systematic reviews  (pp. 149 - 156). John Wiley & Sons, Incorporated.

• << Previous: Evidence Synthesis Review Types - Overview
• Next: Scoping Review >>
• Types of Questions
• Key Features and Limitations
• Is a Systematic Review Right for Your Research?
• Scoping Review
• Rapid Review
• Meta-Analysis/Meta-Synthesis
• Selecting a Review Type
• Reducing Bias
• Guidelines for Student Researchers
• Training Resources
• Register Your Protocol
• Handbooks & Manuals
• Reporting Guidelines
• PRESS 2015 Guidelines
• Search Strategies
• Selected Databases
• Grey Literature
• Handsearching
• Citation Searching
• Study Types & Terminology
• Quantitative vs. Qualitative Research
• Critical Appraisal of Studies
• Broad Functionality Programs & Tools
• Search Strategy Tools
• Deduplication Tools
• CItation Screening
• Critical Appraisal Tools
• Quality Assessment/Risk of Bias Tools
• Data Collection/Extraction
• Meta Analysis Tools
• Books on Systematic Reviews
• Finding Systematic Review Articles in the Databases
• Systematic Review Journals
• More Resources
• Evidence-Based Practice Research in Nursing
• Citation Management Programs
• Last Updated: May 22, 2024 2:36 PM
• URL: https://libguides.adelphi.edu/Systematic_Reviews

Gerstein Science Information Centre

Knowledge syntheses: systematic & scoping reviews, and other review types.

• Before you start
• Getting Started
• Different Types of Knowledge Syntheses
• Assemble a Team
• Develop your Protocol
• Eligibility Criteria
• Screening for articles
• Data Extraction
• Critical appraisal
• What are Systematic Reviews?
• What is a Meta-Analysis?
• What are Scoping Reviews?
• What are Rapid Reviews?
• What are Realist Reviews?
• What are Mapping Reviews?

When is an integrative review methodology appropiate?

Elements of an integrative review, methods and guidance.

• What are Umbrella Reviews?
• Standards and Guidelines
• Supplementary Resources for All Review Types
• Resources for Qualitative Synthesis
• Resources for Quantitative Synthesis
• Resources for Mixed Methods Synthesis
• Bibliography
• More Questions?
• Common Mistakes in Systematic Reviews, scoping reviews, and other review types

An integrative review is a specific review method that summarises past empirical or theoretical literature to provide a greater comprehensive understanding of a particular phenomenon or healthcare problem (Broome 1993). Thus, integrative reviews have the potential to build upon nursing science, informing research, practice, and policy initiatives. 

An integrative review method is an approach that allows for the inclusion of diverse methodologies (i.e. experimental and non-experimental research) and has the potential to play a greater role in evidence-based practice for nursing (Whittemore et al., 2005) .

When to Use It: According to  Toronto, C., & Remington, R.(2020) , Whitmore et al. (2005) , Broome (1993): an integrative review approach is best suited for:

A research scope focused more broadly at a phenomenon of interest rather than a systematic review and allows for diverse research, which may contain theoretical and methodological literature to address the aim of the review

Supporting a wide range of inquiry, such as defining concepts, reviewing theories, or analyzing methodological issues

Examining the complexity of nursing practice more broadly by using diverse data sources

The following characteristics, strengths, and challenges of integrative reviews are derived from Toronto, C., & Remington, R.(2020) , Whitmore et al. (2005) , Broome (1993):

Characteristics:

A review method that summarises past empirical or theoretical literature to provide a more comprehensive understanding of a particular phenomenon or healthcare problem

An integrative review is best designed for nursing practice

The problem must be clearly defined

The aim of the review is to analyze experimental and non-experimental research simultaneously in order to:

Define concepts

Review theories

Review evidence/point out gaps in the literature

Analyze methodological issues

Best designed for nursing research

Evidence produced from well-conducted integrative reviews contributes to nursing knowledge by clarifying phenomena, which in turn informs nursing practice and clinical practice guidelines

Challenges:

The combination and complexity of incorporating diverse methodologies can contribute to a lack of rigour, inaccuracy, and bias

Methods of analysis, synthesis, and conclusion-drawing remain poorly formulated

Combining empirical and theoretical reports can be difficult

There is no current guidance on reporting

The following resources are considered to be the best  guidance for conduct  in the field of integrative reviews.

METHODS & GUIDANCE

Hopia, H., Latvala, E., & Liimatainen, L. (2016). Reviewing the methodology of an integrative review.   Scandinavian journal of caring sciences ,  30 (4), 662–669. https://doi.org/10.1111/scs.12327

Russell C. L. (2005). An overview of the integrative research review.   Progress in transplantation (Aliso Viejo, Calif.) ,  15 (1), 8–13

Toronto, & Remington, R. (2020). A Step-By-Step Guide to Conducting an Integrative Review (1st ed.). Springer International Publishing AG.

Whittemore, R., & Knafl, K. (2005). The integrative review: updated methodology .  Journal of advanced nursing ,  52 (5), 546–553. https://doi.org/10.1111/j.1365-2648.2005.03621.x

REPORTING GUIDELINE

There is currently no reporting guideline for integrative reviews.

• << Previous: What are Mapping Reviews?
• Next: What are Umbrella Reviews? >>
• Last Updated: Apr 30, 2024 10:15 AM
• URL: https://guides.library.utoronto.ca/systematicreviews

Library links

• Gerstein Home
• U of T Libraries Home
• Renew items and pay fines
• Library hours
• Contact Gerstein
• University of Toronto Libraries
• UT Mississauga Library
• UT Scarborough Library
• Information Commons
• All libraries

© University of Toronto . All rights reserved.

Connect with us

An overview of the integrative research review

Affiliation.

• 1 University of Missouri-Columbia, Columbia, MO, USA.
• PMID: 15839365
• DOI: 10.1177/152692480501500102

The integrative literature review has many benefits to the scholarly reviewer, including evaluating the strength of the scientific evidence, identifying gaps in current research, identifying the need for future research, bridging between related areas of work, identifying central issues in an area, generating a research question, identifying a theoretical or conceptual framework, and exploring which research methods have been used successfully. The 5-stage integrative review process includes (1) problem formulation, (2) data collection or literature search, (3) evaluation of data, (4) data analysis, and (5) interpretation and presentation of results. Maintaining scientific integrity while conducting an integrative research review involves careful consideration to threats to validity. Strategies to overcome these threats are reviewed. The integrative review methodology must involve detailed and thoughtful work, the outcome of which can be a significant contribution to a particular body of knowledge and, consequently, to practice and research.

Publication types

• Research Design
• Review Literature as Topic*

An official website of the United States government

The .gov means it's official. Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you're on a federal government site.

The site is secure. The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

• Publications
• Account settings
• Browse Titles

NCBI Bookshelf. A service of the National Library of Medicine, National Institutes of Health.

Lau F, Kuziemsky C, editors. Handbook of eHealth Evaluation: An Evidence-based Approach [Internet]. Victoria (BC): University of Victoria; 2017 Feb 27.

Handbook of eHealth Evaluation: An Evidence-based Approach [Internet].

Chapter 9 methods for literature reviews.

Guy Paré and Spyros Kitsiou .

9.1. Introduction

Literature reviews play a critical role in scholarship because science remains, first and foremost, a cumulative endeavour ( vom Brocke et al., 2009 ). As in any academic discipline, rigorous knowledge syntheses are becoming indispensable in keeping up with an exponentially growing eHealth literature, assisting practitioners, academics, and graduate students in finding, evaluating, and synthesizing the contents of many empirical and conceptual papers. Among other methods, literature reviews are essential for: (a) identifying what has been written on a subject or topic; (b) determining the extent to which a specific research area reveals any interpretable trends or patterns; (c) aggregating empirical findings related to a narrow research question to support evidence-based practice; (d) generating new frameworks and theories; and (e) identifying topics or questions requiring more investigation ( Paré, Trudel, Jaana, & Kitsiou, 2015 ).

Literature reviews can take two major forms. The most prevalent one is the “literature review” or “background” section within a journal paper or a chapter in a graduate thesis. This section synthesizes the extant literature and usually identifies the gaps in knowledge that the empirical study addresses ( Sylvester, Tate, & Johnstone, 2013 ). It may also provide a theoretical foundation for the proposed study, substantiate the presence of the research problem, justify the research as one that contributes something new to the cumulated knowledge, or validate the methods and approaches for the proposed study ( Hart, 1998 ; Levy & Ellis, 2006 ).

The second form of literature review, which is the focus of this chapter, constitutes an original and valuable work of research in and of itself ( Paré et al., 2015 ). Rather than providing a base for a researcher’s own work, it creates a solid starting point for all members of the community interested in a particular area or topic ( Mulrow, 1987 ). The so-called “review article” is a journal-length paper which has an overarching purpose to synthesize the literature in a field, without collecting or analyzing any primary data ( Green, Johnson, & Adams, 2006 ).

When appropriately conducted, review articles represent powerful information sources for practitioners looking for state-of-the art evidence to guide their decision-making and work practices ( Paré et al., 2015 ). Further, high-quality reviews become frequently cited pieces of work which researchers seek out as a first clear outline of the literature when undertaking empirical studies ( Cooper, 1988 ; Rowe, 2014 ). Scholars who track and gauge the impact of articles have found that review papers are cited and downloaded more often than any other type of published article ( Cronin, Ryan, & Coughlan, 2008 ; Montori, Wilczynski, Morgan, Haynes, & Hedges, 2003 ; Patsopoulos, Analatos, & Ioannidis, 2005 ). The reason for their popularity may be the fact that reading the review enables one to have an overview, if not a detailed knowledge of the area in question, as well as references to the most useful primary sources ( Cronin et al., 2008 ). Although they are not easy to conduct, the commitment to complete a review article provides a tremendous service to one’s academic community ( Paré et al., 2015 ; Petticrew & Roberts, 2006 ). Most, if not all, peer-reviewed journals in the fields of medical informatics publish review articles of some type.

The main objectives of this chapter are fourfold: (a) to provide an overview of the major steps and activities involved in conducting a stand-alone literature review; (b) to describe and contrast the different types of review articles that can contribute to the eHealth knowledge base; (c) to illustrate each review type with one or two examples from the eHealth literature; and (d) to provide a series of recommendations for prospective authors of review articles in this domain.

9.2. Overview of the Literature Review Process and Steps

As explained in Templier and Paré (2015) , there are six generic steps involved in conducting a review article:

• formulating the research question(s) and objective(s),
• searching the extant literature,
• screening for inclusion,
• assessing the quality of primary studies,
• extracting data, and
• analyzing data.

Although these steps are presented here in sequential order, one must keep in mind that the review process can be iterative and that many activities can be initiated during the planning stage and later refined during subsequent phases ( Finfgeld-Connett & Johnson, 2013 ; Kitchenham & Charters, 2007 ).

Formulating the research question(s) and objective(s): As a first step, members of the review team must appropriately justify the need for the review itself ( Petticrew & Roberts, 2006 ), identify the review’s main objective(s) ( Okoli & Schabram, 2010 ), and define the concepts or variables at the heart of their synthesis ( Cooper & Hedges, 2009 ; Webster & Watson, 2002 ). Importantly, they also need to articulate the research question(s) they propose to investigate ( Kitchenham & Charters, 2007 ). In this regard, we concur with Jesson, Matheson, and Lacey (2011) that clearly articulated research questions are key ingredients that guide the entire review methodology; they underscore the type of information that is needed, inform the search for and selection of relevant literature, and guide or orient the subsequent analysis. Searching the extant literature: The next step consists of searching the literature and making decisions about the suitability of material to be considered in the review ( Cooper, 1988 ). There exist three main coverage strategies. First, exhaustive coverage means an effort is made to be as comprehensive as possible in order to ensure that all relevant studies, published and unpublished, are included in the review and, thus, conclusions are based on this all-inclusive knowledge base. The second type of coverage consists of presenting materials that are representative of most other works in a given field or area. Often authors who adopt this strategy will search for relevant articles in a small number of top-tier journals in a field ( Paré et al., 2015 ). In the third strategy, the review team concentrates on prior works that have been central or pivotal to a particular topic. This may include empirical studies or conceptual papers that initiated a line of investigation, changed how problems or questions were framed, introduced new methods or concepts, or engendered important debate ( Cooper, 1988 ). Screening for inclusion: The following step consists of evaluating the applicability of the material identified in the preceding step ( Levy & Ellis, 2006 ; vom Brocke et al., 2009 ). Once a group of potential studies has been identified, members of the review team must screen them to determine their relevance ( Petticrew & Roberts, 2006 ). A set of predetermined rules provides a basis for including or excluding certain studies. This exercise requires a significant investment on the part of researchers, who must ensure enhanced objectivity and avoid biases or mistakes. As discussed later in this chapter, for certain types of reviews there must be at least two independent reviewers involved in the screening process and a procedure to resolve disagreements must also be in place ( Liberati et al., 2009 ; Shea et al., 2009 ). Assessing the quality of primary studies: In addition to screening material for inclusion, members of the review team may need to assess the scientific quality of the selected studies, that is, appraise the rigour of the research design and methods. Such formal assessment, which is usually conducted independently by at least two coders, helps members of the review team refine which studies to include in the final sample, determine whether or not the differences in quality may affect their conclusions, or guide how they analyze the data and interpret the findings ( Petticrew & Roberts, 2006 ). Ascribing quality scores to each primary study or considering through domain-based evaluations which study components have or have not been designed and executed appropriately makes it possible to reflect on the extent to which the selected study addresses possible biases and maximizes validity ( Shea et al., 2009 ). Extracting data: The following step involves gathering or extracting applicable information from each primary study included in the sample and deciding what is relevant to the problem of interest ( Cooper & Hedges, 2009 ). Indeed, the type of data that should be recorded mainly depends on the initial research questions ( Okoli & Schabram, 2010 ). However, important information may also be gathered about how, when, where and by whom the primary study was conducted, the research design and methods, or qualitative/quantitative results ( Cooper & Hedges, 2009 ). Analyzing and synthesizing data : As a final step, members of the review team must collate, summarize, aggregate, organize, and compare the evidence extracted from the included studies. The extracted data must be presented in a meaningful way that suggests a new contribution to the extant literature ( Jesson et al., 2011 ). Webster and Watson (2002) warn researchers that literature reviews should be much more than lists of papers and should provide a coherent lens to make sense of extant knowledge on a given topic. There exist several methods and techniques for synthesizing quantitative (e.g., frequency analysis, meta-analysis) and qualitative (e.g., grounded theory, narrative analysis, meta-ethnography) evidence ( Dixon-Woods, Agarwal, Jones, Young, & Sutton, 2005 ; Thomas & Harden, 2008 ).

9.3. Types of Review Articles and Brief Illustrations

EHealth researchers have at their disposal a number of approaches and methods for making sense out of existing literature, all with the purpose of casting current research findings into historical contexts or explaining contradictions that might exist among a set of primary research studies conducted on a particular topic. Our classification scheme is largely inspired from Paré and colleagues’ (2015) typology. Below we present and illustrate those review types that we feel are central to the growth and development of the eHealth domain.

9.3.1. Narrative Reviews

The narrative review is the “traditional” way of reviewing the extant literature and is skewed towards a qualitative interpretation of prior knowledge ( Sylvester et al., 2013 ). Put simply, a narrative review attempts to summarize or synthesize what has been written on a particular topic but does not seek generalization or cumulative knowledge from what is reviewed ( Davies, 2000 ; Green et al., 2006 ). Instead, the review team often undertakes the task of accumulating and synthesizing the literature to demonstrate the value of a particular point of view ( Baumeister & Leary, 1997 ). As such, reviewers may selectively ignore or limit the attention paid to certain studies in order to make a point. In this rather unsystematic approach, the selection of information from primary articles is subjective, lacks explicit criteria for inclusion and can lead to biased interpretations or inferences ( Green et al., 2006 ). There are several narrative reviews in the particular eHealth domain, as in all fields, which follow such an unstructured approach ( Silva et al., 2015 ; Paul et al., 2015 ).

Despite these criticisms, this type of review can be very useful in gathering together a volume of literature in a specific subject area and synthesizing it. As mentioned above, its primary purpose is to provide the reader with a comprehensive background for understanding current knowledge and highlighting the significance of new research ( Cronin et al., 2008 ). Faculty like to use narrative reviews in the classroom because they are often more up to date than textbooks, provide a single source for students to reference, and expose students to peer-reviewed literature ( Green et al., 2006 ). For researchers, narrative reviews can inspire research ideas by identifying gaps or inconsistencies in a body of knowledge, thus helping researchers to determine research questions or formulate hypotheses. Importantly, narrative reviews can also be used as educational articles to bring practitioners up to date with certain topics of issues ( Green et al., 2006 ).

Recently, there have been several efforts to introduce more rigour in narrative reviews that will elucidate common pitfalls and bring changes into their publication standards. Information systems researchers, among others, have contributed to advancing knowledge on how to structure a “traditional” review. For instance, Levy and Ellis (2006) proposed a generic framework for conducting such reviews. Their model follows the systematic data processing approach comprised of three steps, namely: (a) literature search and screening; (b) data extraction and analysis; and (c) writing the literature review. They provide detailed and very helpful instructions on how to conduct each step of the review process. As another methodological contribution, vom Brocke et al. (2009) offered a series of guidelines for conducting literature reviews, with a particular focus on how to search and extract the relevant body of knowledge. Last, Bandara, Miskon, and Fielt (2011) proposed a structured, predefined and tool-supported method to identify primary studies within a feasible scope, extract relevant content from identified articles, synthesize and analyze the findings, and effectively write and present the results of the literature review. We highly recommend that prospective authors of narrative reviews consult these useful sources before embarking on their work.

Darlow and Wen (2015) provide a good example of a highly structured narrative review in the eHealth field. These authors synthesized published articles that describe the development process of mobile health ( m-health ) interventions for patients’ cancer care self-management. As in most narrative reviews, the scope of the research questions being investigated is broad: (a) how development of these systems are carried out; (b) which methods are used to investigate these systems; and (c) what conclusions can be drawn as a result of the development of these systems. To provide clear answers to these questions, a literature search was conducted on six electronic databases and Google Scholar . The search was performed using several terms and free text words, combining them in an appropriate manner. Four inclusion and three exclusion criteria were utilized during the screening process. Both authors independently reviewed each of the identified articles to determine eligibility and extract study information. A flow diagram shows the number of studies identified, screened, and included or excluded at each stage of study selection. In terms of contributions, this review provides a series of practical recommendations for m-health intervention development.

9.3.2. Descriptive or Mapping Reviews

The primary goal of a descriptive review is to determine the extent to which a body of knowledge in a particular research topic reveals any interpretable pattern or trend with respect to pre-existing propositions, theories, methodologies or findings ( King & He, 2005 ; Paré et al., 2015 ). In contrast with narrative reviews, descriptive reviews follow a systematic and transparent procedure, including searching, screening and classifying studies ( Petersen, Vakkalanka, & Kuzniarz, 2015 ). Indeed, structured search methods are used to form a representative sample of a larger group of published works ( Paré et al., 2015 ). Further, authors of descriptive reviews extract from each study certain characteristics of interest, such as publication year, research methods, data collection techniques, and direction or strength of research outcomes (e.g., positive, negative, or non-significant) in the form of frequency analysis to produce quantitative results ( Sylvester et al., 2013 ). In essence, each study included in a descriptive review is treated as the unit of analysis and the published literature as a whole provides a database from which the authors attempt to identify any interpretable trends or draw overall conclusions about the merits of existing conceptualizations, propositions, methods or findings ( Paré et al., 2015 ). In doing so, a descriptive review may claim that its findings represent the state of the art in a particular domain ( King & He, 2005 ).

In the fields of health sciences and medical informatics, reviews that focus on examining the range, nature and evolution of a topic area are described by Anderson, Allen, Peckham, and Goodwin (2008) as mapping reviews . Like descriptive reviews, the research questions are generic and usually relate to publication patterns and trends. There is no preconceived plan to systematically review all of the literature although this can be done. Instead, researchers often present studies that are representative of most works published in a particular area and they consider a specific time frame to be mapped.

An example of this approach in the eHealth domain is offered by DeShazo, Lavallie, and Wolf (2009). The purpose of this descriptive or mapping review was to characterize publication trends in the medical informatics literature over a 20-year period (1987 to 2006). To achieve this ambitious objective, the authors performed a bibliometric analysis of medical informatics citations indexed in medline using publication trends, journal frequencies, impact factors, Medical Subject Headings (MeSH) term frequencies, and characteristics of citations. Findings revealed that there were over 77,000 medical informatics articles published during the covered period in numerous journals and that the average annual growth rate was 12%. The MeSH term analysis also suggested a strong interdisciplinary trend. Finally, average impact scores increased over time with two notable growth periods. Overall, patterns in research outputs that seem to characterize the historic trends and current components of the field of medical informatics suggest it may be a maturing discipline (DeShazo et al., 2009).

9.3.3. Scoping Reviews

Scoping reviews attempt to provide an initial indication of the potential size and nature of the extant literature on an emergent topic (Arksey & O’Malley, 2005; Daudt, van Mossel, & Scott, 2013 ; Levac, Colquhoun, & O’Brien, 2010). A scoping review may be conducted to examine the extent, range and nature of research activities in a particular area, determine the value of undertaking a full systematic review (discussed next), or identify research gaps in the extant literature ( Paré et al., 2015 ). In line with their main objective, scoping reviews usually conclude with the presentation of a detailed research agenda for future works along with potential implications for both practice and research.

Unlike narrative and descriptive reviews, the whole point of scoping the field is to be as comprehensive as possible, including grey literature (Arksey & O’Malley, 2005). Inclusion and exclusion criteria must be established to help researchers eliminate studies that are not aligned with the research questions. It is also recommended that at least two independent coders review abstracts yielded from the search strategy and then the full articles for study selection ( Daudt et al., 2013 ). The synthesized evidence from content or thematic analysis is relatively easy to present in tabular form (Arksey & O’Malley, 2005; Thomas & Harden, 2008 ).

One of the most highly cited scoping reviews in the eHealth domain was published by Archer, Fevrier-Thomas, Lokker, McKibbon, and Straus (2011) . These authors reviewed the existing literature on personal health record ( phr ) systems including design, functionality, implementation, applications, outcomes, and benefits. Seven databases were searched from 1985 to March 2010. Several search terms relating to phr s were used during this process. Two authors independently screened titles and abstracts to determine inclusion status. A second screen of full-text articles, again by two independent members of the research team, ensured that the studies described phr s. All in all, 130 articles met the criteria and their data were extracted manually into a database. The authors concluded that although there is a large amount of survey, observational, cohort/panel, and anecdotal evidence of phr benefits and satisfaction for patients, more research is needed to evaluate the results of phr implementations. Their in-depth analysis of the literature signalled that there is little solid evidence from randomized controlled trials or other studies through the use of phr s. Hence, they suggested that more research is needed that addresses the current lack of understanding of optimal functionality and usability of these systems, and how they can play a beneficial role in supporting patient self-management ( Archer et al., 2011 ).

9.3.4. Forms of Aggregative Reviews

Healthcare providers, practitioners, and policy-makers are nowadays overwhelmed with large volumes of information, including research-based evidence from numerous clinical trials and evaluation studies, assessing the effectiveness of health information technologies and interventions ( Ammenwerth & de Keizer, 2004 ; Deshazo et al., 2009 ). It is unrealistic to expect that all these disparate actors will have the time, skills, and necessary resources to identify the available evidence in the area of their expertise and consider it when making decisions. Systematic reviews that involve the rigorous application of scientific strategies aimed at limiting subjectivity and bias (i.e., systematic and random errors) can respond to this challenge.

Systematic reviews attempt to aggregate, appraise, and synthesize in a single source all empirical evidence that meet a set of previously specified eligibility criteria in order to answer a clearly formulated and often narrow research question on a particular topic of interest to support evidence-based practice ( Liberati et al., 2009 ). They adhere closely to explicit scientific principles ( Liberati et al., 2009 ) and rigorous methodological guidelines (Higgins & Green, 2008) aimed at reducing random and systematic errors that can lead to deviations from the truth in results or inferences. The use of explicit methods allows systematic reviews to aggregate a large body of research evidence, assess whether effects or relationships are in the same direction and of the same general magnitude, explain possible inconsistencies between study results, and determine the strength of the overall evidence for every outcome of interest based on the quality of included studies and the general consistency among them ( Cook, Mulrow, & Haynes, 1997 ). The main procedures of a systematic review involve:

• Formulating a review question and developing a search strategy based on explicit inclusion criteria for the identification of eligible studies (usually described in the context of a detailed review protocol).
• Searching for eligible studies using multiple databases and information sources, including grey literature sources, without any language restrictions.
• Selecting studies, extracting data, and assessing risk of bias in a duplicate manner using two independent reviewers to avoid random or systematic errors in the process.
• Analyzing data using quantitative or qualitative methods.
• Presenting results in summary of findings tables.
• Interpreting results and drawing conclusions.

Many systematic reviews, but not all, use statistical methods to combine the results of independent studies into a single quantitative estimate or summary effect size. Known as meta-analyses , these reviews use specific data extraction and statistical techniques (e.g., network, frequentist, or Bayesian meta-analyses) to calculate from each study by outcome of interest an effect size along with a confidence interval that reflects the degree of uncertainty behind the point estimate of effect ( Borenstein, Hedges, Higgins, & Rothstein, 2009 ; Deeks, Higgins, & Altman, 2008 ). Subsequently, they use fixed or random-effects analysis models to combine the results of the included studies, assess statistical heterogeneity, and calculate a weighted average of the effect estimates from the different studies, taking into account their sample sizes. The summary effect size is a value that reflects the average magnitude of the intervention effect for a particular outcome of interest or, more generally, the strength of a relationship between two variables across all studies included in the systematic review. By statistically combining data from multiple studies, meta-analyses can create more precise and reliable estimates of intervention effects than those derived from individual studies alone, when these are examined independently as discrete sources of information.

The review by Gurol-Urganci, de Jongh, Vodopivec-Jamsek, Atun, and Car (2013) on the effects of mobile phone messaging reminders for attendance at healthcare appointments is an illustrative example of a high-quality systematic review with meta-analysis. Missed appointments are a major cause of inefficiency in healthcare delivery with substantial monetary costs to health systems. These authors sought to assess whether mobile phone-based appointment reminders delivered through Short Message Service ( sms ) or Multimedia Messaging Service ( mms ) are effective in improving rates of patient attendance and reducing overall costs. To this end, they conducted a comprehensive search on multiple databases using highly sensitive search strategies without language or publication-type restrictions to identify all rct s that are eligible for inclusion. In order to minimize the risk of omitting eligible studies not captured by the original search, they supplemented all electronic searches with manual screening of trial registers and references contained in the included studies. Study selection, data extraction, and risk of bias assessments were performed inde­­pen­dently by two coders using standardized methods to ensure consistency and to eliminate potential errors. Findings from eight rct s involving 6,615 participants were pooled into meta-analyses to calculate the magnitude of effects that mobile text message reminders have on the rate of attendance at healthcare appointments compared to no reminders and phone call reminders.

Meta-analyses are regarded as powerful tools for deriving meaningful conclusions. However, there are situations in which it is neither reasonable nor appropriate to pool studies together using meta-analytic methods simply because there is extensive clinical heterogeneity between the included studies or variation in measurement tools, comparisons, or outcomes of interest. In these cases, systematic reviews can use qualitative synthesis methods such as vote counting, content analysis, classification schemes and tabulations, as an alternative approach to narratively synthesize the results of the independent studies included in the review. This form of review is known as qualitative systematic review.

A rigorous example of one such review in the eHealth domain is presented by Mickan, Atherton, Roberts, Heneghan, and Tilson (2014) on the use of handheld computers by healthcare professionals and their impact on access to information and clinical decision-making. In line with the methodological guide­lines for systematic reviews, these authors: (a) developed and registered with prospero ( www.crd.york.ac.uk/ prospero / ) an a priori review protocol; (b) conducted comprehensive searches for eligible studies using multiple databases and other supplementary strategies (e.g., forward searches); and (c) subsequently carried out study selection, data extraction, and risk of bias assessments in a duplicate manner to eliminate potential errors in the review process. Heterogeneity between the included studies in terms of reported outcomes and measures precluded the use of meta-analytic methods. To this end, the authors resorted to using narrative analysis and synthesis to describe the effectiveness of handheld computers on accessing information for clinical knowledge, adherence to safety and clinical quality guidelines, and diagnostic decision-making.

In recent years, the number of systematic reviews in the field of health informatics has increased considerably. Systematic reviews with discordant findings can cause great confusion and make it difficult for decision-makers to interpret the review-level evidence ( Moher, 2013 ). Therefore, there is a growing need for appraisal and synthesis of prior systematic reviews to ensure that decision-making is constantly informed by the best available accumulated evidence. Umbrella reviews , also known as overviews of systematic reviews, are tertiary types of evidence synthesis that aim to accomplish this; that is, they aim to compare and contrast findings from multiple systematic reviews and meta-analyses ( Becker & Oxman, 2008 ). Umbrella reviews generally adhere to the same principles and rigorous methodological guidelines used in systematic reviews. However, the unit of analysis in umbrella reviews is the systematic review rather than the primary study ( Becker & Oxman, 2008 ). Unlike systematic reviews that have a narrow focus of inquiry, umbrella reviews focus on broader research topics for which there are several potential interventions ( Smith, Devane, Begley, & Clarke, 2011 ). A recent umbrella review on the effects of home telemonitoring interventions for patients with heart failure critically appraised, compared, and synthesized evidence from 15 systematic reviews to investigate which types of home telemonitoring technologies and forms of interventions are more effective in reducing mortality and hospital admissions ( Kitsiou, Paré, & Jaana, 2015 ).

9.3.5. Realist Reviews

Realist reviews are theory-driven interpretative reviews developed to inform, enhance, or supplement conventional systematic reviews by making sense of heterogeneous evidence about complex interventions applied in diverse contexts in a way that informs policy decision-making ( Greenhalgh, Wong, Westhorp, & Pawson, 2011 ). They originated from criticisms of positivist systematic reviews which centre on their “simplistic” underlying assumptions ( Oates, 2011 ). As explained above, systematic reviews seek to identify causation. Such logic is appropriate for fields like medicine and education where findings of randomized controlled trials can be aggregated to see whether a new treatment or intervention does improve outcomes. However, many argue that it is not possible to establish such direct causal links between interventions and outcomes in fields such as social policy, management, and information systems where for any intervention there is unlikely to be a regular or consistent outcome ( Oates, 2011 ; Pawson, 2006 ; Rousseau, Manning, & Denyer, 2008 ).

To circumvent these limitations, Pawson, Greenhalgh, Harvey, and Walshe (2005) have proposed a new approach for synthesizing knowledge that seeks to unpack the mechanism of how “complex interventions” work in particular contexts. The basic research question — what works? — which is usually associated with systematic reviews changes to: what is it about this intervention that works, for whom, in what circumstances, in what respects and why? Realist reviews have no particular preference for either quantitative or qualitative evidence. As a theory-building approach, a realist review usually starts by articulating likely underlying mechanisms and then scrutinizes available evidence to find out whether and where these mechanisms are applicable ( Shepperd et al., 2009 ). Primary studies found in the extant literature are viewed as case studies which can test and modify the initial theories ( Rousseau et al., 2008 ).

The main objective pursued in the realist review conducted by Otte-Trojel, de Bont, Rundall, and van de Klundert (2014) was to examine how patient portals contribute to health service delivery and patient outcomes. The specific goals were to investigate how outcomes are produced and, most importantly, how variations in outcomes can be explained. The research team started with an exploratory review of background documents and research studies to identify ways in which patient portals may contribute to health service delivery and patient outcomes. The authors identified six main ways which represent “educated guesses” to be tested against the data in the evaluation studies. These studies were identified through a formal and systematic search in four databases between 2003 and 2013. Two members of the research team selected the articles using a pre-established list of inclusion and exclusion criteria and following a two-step procedure. The authors then extracted data from the selected articles and created several tables, one for each outcome category. They organized information to bring forward those mechanisms where patient portals contribute to outcomes and the variation in outcomes across different contexts.

9.3.6. Critical Reviews

Lastly, critical reviews aim to provide a critical evaluation and interpretive analysis of existing literature on a particular topic of interest to reveal strengths, weaknesses, contradictions, controversies, inconsistencies, and/or other important issues with respect to theories, hypotheses, research methods or results ( Baumeister & Leary, 1997 ; Kirkevold, 1997 ). Unlike other review types, critical reviews attempt to take a reflective account of the research that has been done in a particular area of interest, and assess its credibility by using appraisal instruments or critical interpretive methods. In this way, critical reviews attempt to constructively inform other scholars about the weaknesses of prior research and strengthen knowledge development by giving focus and direction to studies for further improvement ( Kirkevold, 1997 ).

Kitsiou, Paré, and Jaana (2013) provide an example of a critical review that assessed the methodological quality of prior systematic reviews of home telemonitoring studies for chronic patients. The authors conducted a comprehensive search on multiple databases to identify eligible reviews and subsequently used a validated instrument to conduct an in-depth quality appraisal. Results indicate that the majority of systematic reviews in this particular area suffer from important methodological flaws and biases that impair their internal validity and limit their usefulness for clinical and decision-making purposes. To this end, they provide a number of recommendations to strengthen knowledge development towards improving the design and execution of future reviews on home telemonitoring.

9.4. Summary

Table 9.1 outlines the main types of literature reviews that were described in the previous sub-sections and summarizes the main characteristics that distinguish one review type from another. It also includes key references to methodological guidelines and useful sources that can be used by eHealth scholars and researchers for planning and developing reviews.

Typology of Literature Reviews (adapted from Paré et al., 2015).

As shown in Table 9.1 , each review type addresses different kinds of research questions or objectives, which subsequently define and dictate the methods and approaches that need to be used to achieve the overarching goal(s) of the review. For example, in the case of narrative reviews, there is greater flexibility in searching and synthesizing articles ( Green et al., 2006 ). Researchers are often relatively free to use a diversity of approaches to search, identify, and select relevant scientific articles, describe their operational characteristics, present how the individual studies fit together, and formulate conclusions. On the other hand, systematic reviews are characterized by their high level of systematicity, rigour, and use of explicit methods, based on an “a priori” review plan that aims to minimize bias in the analysis and synthesis process (Higgins & Green, 2008). Some reviews are exploratory in nature (e.g., scoping/mapping reviews), whereas others may be conducted to discover patterns (e.g., descriptive reviews) or involve a synthesis approach that may include the critical analysis of prior research ( Paré et al., 2015 ). Hence, in order to select the most appropriate type of review, it is critical to know before embarking on a review project, why the research synthesis is conducted and what type of methods are best aligned with the pursued goals.

9.5. Concluding Remarks

In light of the increased use of evidence-based practice and research generating stronger evidence ( Grady et al., 2011 ; Lyden et al., 2013 ), review articles have become essential tools for summarizing, synthesizing, integrating or critically appraising prior knowledge in the eHealth field. As mentioned earlier, when rigorously conducted review articles represent powerful information sources for eHealth scholars and practitioners looking for state-of-the-art evidence. The typology of literature reviews we used herein will allow eHealth researchers, graduate students and practitioners to gain a better understanding of the similarities and differences between review types.

We must stress that this classification scheme does not privilege any specific type of review as being of higher quality than another ( Paré et al., 2015 ). As explained above, each type of review has its own strengths and limitations. Having said that, we realize that the methodological rigour of any review — be it qualitative, quantitative or mixed — is a critical aspect that should be considered seriously by prospective authors. In the present context, the notion of rigour refers to the reliability and validity of the review process described in section 9.2. For one thing, reliability is related to the reproducibility of the review process and steps, which is facilitated by a comprehensive documentation of the literature search process, extraction, coding and analysis performed in the review. Whether the search is comprehensive or not, whether it involves a methodical approach for data extraction and synthesis or not, it is important that the review documents in an explicit and transparent manner the steps and approach that were used in the process of its development. Next, validity characterizes the degree to which the review process was conducted appropriately. It goes beyond documentation and reflects decisions related to the selection of the sources, the search terms used, the period of time covered, the articles selected in the search, and the application of backward and forward searches ( vom Brocke et al., 2009 ). In short, the rigour of any review article is reflected by the explicitness of its methods (i.e., transparency) and the soundness of the approach used. We refer those interested in the concepts of rigour and quality to the work of Templier and Paré (2015) which offers a detailed set of methodological guidelines for conducting and evaluating various types of review articles.

To conclude, our main objective in this chapter was to demystify the various types of literature reviews that are central to the continuous development of the eHealth field. It is our hope that our descriptive account will serve as a valuable source for those conducting, evaluating or using reviews in this important and growing domain.

• Ammenwerth E., de Keizer N. An inventory of evaluation studies of information technology in health care. Trends in evaluation research, 1982-2002. International Journal of Medical Informatics. 2004; 44 (1):44–56. [ PubMed : 15778794 ]
• Anderson S., Allen P., Peckham S., Goodwin N. Asking the right questions: scoping studies in the commissioning of research on the organisation and delivery of health services. Health Research Policy and Systems. 2008; 6 (7):1–12. [ PMC free article : PMC2500008 ] [ PubMed : 18613961 ] [ CrossRef ]
• Archer N., Fevrier-Thomas U., Lokker C., McKibbon K. A., Straus S.E. Personal health records: a scoping review. Journal of American Medical Informatics Association. 2011; 18 (4):515–522. [ PMC free article : PMC3128401 ] [ PubMed : 21672914 ]
• Arksey H., O’Malley L. Scoping studies: towards a methodological framework. International Journal of Social Research Methodology. 2005; 8 (1):19–32.
• A systematic, tool-supported method for conducting literature reviews in information systems. Paper presented at the Proceedings of the 19th European Conference on Information Systems ( ecis 2011); June 9 to 11; Helsinki, Finland. 2011.
• Baumeister R. F., Leary M.R. Writing narrative literature reviews. Review of General Psychology. 1997; 1 (3):311–320.
• Becker L. A., Oxman A.D. In: Cochrane handbook for systematic reviews of interventions. Higgins J. P. T., Green S., editors. Hoboken, nj : John Wiley & Sons, Ltd; 2008. Overviews of reviews; pp. 607–631.
• Borenstein M., Hedges L., Higgins J., Rothstein H. Introduction to meta-analysis. Hoboken, nj : John Wiley & Sons Inc; 2009.
• Cook D. J., Mulrow C. D., Haynes B. Systematic reviews: Synthesis of best evidence for clinical decisions. Annals of Internal Medicine. 1997; 126 (5):376–380. [ PubMed : 9054282 ]
• Cooper H., Hedges L.V. In: The handbook of research synthesis and meta-analysis. 2nd ed. Cooper H., Hedges L. V., Valentine J. C., editors. New York: Russell Sage Foundation; 2009. Research synthesis as a scientific process; pp. 3–17.
• Cooper H. M. Organizing knowledge syntheses: A taxonomy of literature reviews. Knowledge in Society. 1988; 1 (1):104–126.
• Cronin P., Ryan F., Coughlan M. Undertaking a literature review: a step-by-step approach. British Journal of Nursing. 2008; 17 (1):38–43. [ PubMed : 18399395 ]
• Darlow S., Wen K.Y. Development testing of mobile health interventions for cancer patient self-management: A review. Health Informatics Journal. 2015 (online before print). [ PubMed : 25916831 ] [ CrossRef ]
• Daudt H. M., van Mossel C., Scott S.J. Enhancing the scoping study methodology: a large, inter-professional team’s experience with Arksey and O’Malley’s framework. bmc Medical Research Methodology. 2013; 13 :48. [ PMC free article : PMC3614526 ] [ PubMed : 23522333 ] [ CrossRef ]
• Davies P. The relevance of systematic reviews to educational policy and practice. Oxford Review of Education. 2000; 26 (3-4):365–378.
• Deeks J. J., Higgins J. P. T., Altman D.G. In: Cochrane handbook for systematic reviews of interventions. Higgins J. P. T., Green S., editors. Hoboken, nj : John Wiley & Sons, Ltd; 2008. Analysing data and undertaking meta-analyses; pp. 243–296.
• Deshazo J. P., Lavallie D. L., Wolf F.M. Publication trends in the medical informatics literature: 20 years of “Medical Informatics” in mesh . bmc Medical Informatics and Decision Making. 2009; 9 :7. [ PMC free article : PMC2652453 ] [ PubMed : 19159472 ] [ CrossRef ]
• Dixon-Woods M., Agarwal S., Jones D., Young B., Sutton A. Synthesising qualitative and quantitative evidence: a review of possible methods. Journal of Health Services Research and Policy. 2005; 10 (1):45–53. [ PubMed : 15667704 ]
• Finfgeld-Connett D., Johnson E.D. Literature search strategies for conducting knowledge-building and theory-generating qualitative systematic reviews. Journal of Advanced Nursing. 2013; 69 (1):194–204. [ PMC free article : PMC3424349 ] [ PubMed : 22591030 ]
• Grady B., Myers K. M., Nelson E. L., Belz N., Bennett L., Carnahan L. … Guidelines Working Group. Evidence-based practice for telemental health. Telemedicine Journal and E Health. 2011; 17 (2):131–148. [ PubMed : 21385026 ]
• Green B. N., Johnson C. D., Adams A. Writing narrative literature reviews for peer-reviewed journals: secrets of the trade. Journal of Chiropractic Medicine. 2006; 5 (3):101–117. [ PMC free article : PMC2647067 ] [ PubMed : 19674681 ]
• Greenhalgh T., Wong G., Westhorp G., Pawson R. Protocol–realist and meta-narrative evidence synthesis: evolving standards ( rameses ). bmc Medical Research Methodology. 2011; 11 :115. [ PMC free article : PMC3173389 ] [ PubMed : 21843376 ]
• Gurol-Urganci I., de Jongh T., Vodopivec-Jamsek V., Atun R., Car J. Mobile phone messaging reminders for attendance at healthcare appointments. Cochrane Database System Review. 2013; 12 cd 007458. [ PMC free article : PMC6485985 ] [ PubMed : 24310741 ] [ CrossRef ]
• Hart C. Doing a literature review: Releasing the social science research imagination. London: SAGE Publications; 1998.
• Higgins J. P. T., Green S., editors. Cochrane handbook for systematic reviews of interventions: Cochrane book series. Hoboken, nj : Wiley-Blackwell; 2008.
• Jesson J., Matheson L., Lacey F.M. Doing your literature review: traditional and systematic techniques. Los Angeles & London: SAGE Publications; 2011.
• King W. R., He J. Understanding the role and methods of meta-analysis in IS research. Communications of the Association for Information Systems. 2005; 16 :1.
• Kirkevold M. Integrative nursing research — an important strategy to further the development of nursing science and nursing practice. Journal of Advanced Nursing. 1997; 25 (5):977–984. [ PubMed : 9147203 ]
• Kitchenham B., Charters S. ebse Technical Report Version 2.3. Keele & Durham. uk : Keele University & University of Durham; 2007. Guidelines for performing systematic literature reviews in software engineering.
• Kitsiou S., Paré G., Jaana M. Systematic reviews and meta-analyses of home telemonitoring interventions for patients with chronic diseases: a critical assessment of their methodological quality. Journal of Medical Internet Research. 2013; 15 (7):e150. [ PMC free article : PMC3785977 ] [ PubMed : 23880072 ]
• Kitsiou S., Paré G., Jaana M. Effects of home telemonitoring interventions on patients with chronic heart failure: an overview of systematic reviews. Journal of Medical Internet Research. 2015; 17 (3):e63. [ PMC free article : PMC4376138 ] [ PubMed : 25768664 ]
• Levac D., Colquhoun H., O’Brien K. K. Scoping studies: advancing the methodology. Implementation Science. 2010; 5 (1):69. [ PMC free article : PMC2954944 ] [ PubMed : 20854677 ]
• Levy Y., Ellis T.J. A systems approach to conduct an effective literature review in support of information systems research. Informing Science. 2006; 9 :181–211.
• Liberati A., Altman D. G., Tetzlaff J., Mulrow C., Gøtzsche P. C., Ioannidis J. P. A. et al. Moher D. The prisma statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: Explanation and elaboration. Annals of Internal Medicine. 2009; 151 (4):W-65. [ PubMed : 19622512 ]
• Lyden J. R., Zickmund S. L., Bhargava T. D., Bryce C. L., Conroy M. B., Fischer G. S. et al. McTigue K. M. Implementing health information technology in a patient-centered manner: Patient experiences with an online evidence-based lifestyle intervention. Journal for Healthcare Quality. 2013; 35 (5):47–57. [ PubMed : 24004039 ]
• Mickan S., Atherton H., Roberts N. W., Heneghan C., Tilson J.K. Use of handheld computers in clinical practice: a systematic review. bmc Medical Informatics and Decision Making. 2014; 14 :56. [ PMC free article : PMC4099138 ] [ PubMed : 24998515 ]
• Moher D. The problem of duplicate systematic reviews. British Medical Journal. 2013; 347 (5040) [ PubMed : 23945367 ] [ CrossRef ]
• Montori V. M., Wilczynski N. L., Morgan D., Haynes R. B., Hedges T. Systematic reviews: a cross-sectional study of location and citation counts. bmc Medicine. 2003; 1 :2. [ PMC free article : PMC281591 ] [ PubMed : 14633274 ]
• Mulrow C. D. The medical review article: state of the science. Annals of Internal Medicine. 1987; 106 (3):485–488. [ PubMed : 3813259 ] [ CrossRef ]
• Evidence-based information systems: A decade later. Proceedings of the European Conference on Information Systems ; 2011. Retrieved from http://aisel ​.aisnet.org/cgi/viewcontent ​.cgi?article ​=1221&context ​=ecis2011 .
• Okoli C., Schabram K. A guide to conducting a systematic literature review of information systems research. ssrn Electronic Journal. 2010
• Otte-Trojel T., de Bont A., Rundall T. G., van de Klundert J. How outcomes are achieved through patient portals: a realist review. Journal of American Medical Informatics Association. 2014; 21 (4):751–757. [ PMC free article : PMC4078283 ] [ PubMed : 24503882 ]
• Paré G., Trudel M.-C., Jaana M., Kitsiou S. Synthesizing information systems knowledge: A typology of literature reviews. Information & Management. 2015; 52 (2):183–199.
• Patsopoulos N. A., Analatos A. A., Ioannidis J.P. A. Relative citation impact of various study designs in the health sciences. Journal of the American Medical Association. 2005; 293 (19):2362–2366. [ PubMed : 15900006 ]
• Paul M. M., Greene C. M., Newton-Dame R., Thorpe L. E., Perlman S. E., McVeigh K. H., Gourevitch M.N. The state of population health surveillance using electronic health records: A narrative review. Population Health Management. 2015; 18 (3):209–216. [ PubMed : 25608033 ]
• Pawson R. Evidence-based policy: a realist perspective. London: SAGE Publications; 2006.
• Pawson R., Greenhalgh T., Harvey G., Walshe K. Realist review—a new method of systematic review designed for complex policy interventions. Journal of Health Services Research & Policy. 2005; 10 (Suppl 1):21–34. [ PubMed : 16053581 ]
• Petersen K., Vakkalanka S., Kuzniarz L. Guidelines for conducting systematic mapping studies in software engineering: An update. Information and Software Technology. 2015; 64 :1–18.
• Petticrew M., Roberts H. Systematic reviews in the social sciences: A practical guide. Malden, ma : Blackwell Publishing Co; 2006.
• Rousseau D. M., Manning J., Denyer D. Evidence in management and organizational science: Assembling the field’s full weight of scientific knowledge through syntheses. The Academy of Management Annals. 2008; 2 (1):475–515.
• Rowe F. What literature review is not: diversity, boundaries and recommendations. European Journal of Information Systems. 2014; 23 (3):241–255.
• Shea B. J., Hamel C., Wells G. A., Bouter L. M., Kristjansson E., Grimshaw J. et al. Boers M. amstar is a reliable and valid measurement tool to assess the methodological quality of systematic reviews. Journal of Clinical Epidemiology. 2009; 62 (10):1013–1020. [ PubMed : 19230606 ]
• Shepperd S., Lewin S., Straus S., Clarke M., Eccles M. P., Fitzpatrick R. et al. Sheikh A. Can we systematically review studies that evaluate complex interventions? PLoS Medicine. 2009; 6 (8):e1000086. [ PMC free article : PMC2717209 ] [ PubMed : 19668360 ]
• Silva B. M., Rodrigues J. J., de la Torre Díez I., López-Coronado M., Saleem K. Mobile-health: A review of current state in 2015. Journal of Biomedical Informatics. 2015; 56 :265–272. [ PubMed : 26071682 ]
• Smith V., Devane D., Begley C., Clarke M. Methodology in conducting a systematic review of systematic reviews of healthcare interventions. bmc Medical Research Methodology. 2011; 11 (1):15. [ PMC free article : PMC3039637 ] [ PubMed : 21291558 ]
• Sylvester A., Tate M., Johnstone D. Beyond synthesis: re-presenting heterogeneous research literature. Behaviour & Information Technology. 2013; 32 (12):1199–1215.
• Templier M., Paré G. A framework for guiding and evaluating literature reviews. Communications of the Association for Information Systems. 2015; 37 (6):112–137.
• Thomas J., Harden A. Methods for the thematic synthesis of qualitative research in systematic reviews. bmc Medical Research Methodology. 2008; 8 (1):45. [ PMC free article : PMC2478656 ] [ PubMed : 18616818 ]
• Reconstructing the giant: on the importance of rigour in documenting the literature search process. Paper presented at the Proceedings of the 17th European Conference on Information Systems ( ecis 2009); Verona, Italy. 2009.
• Webster J., Watson R.T. Analyzing the past to prepare for the future: Writing a literature review. Management Information Systems Quarterly. 2002; 26 (2):11.
• Whitlock E. P., Lin J. S., Chou R., Shekelle P., Robinson K.A. Using existing systematic reviews in complex systematic reviews. Annals of Internal Medicine. 2008; 148 (10):776–782. [ PubMed : 18490690 ]

This publication is licensed under a Creative Commons License, Attribution-Noncommercial 4.0 International License (CC BY-NC 4.0): see https://creativecommons.org/licenses/by-nc/4.0/

• Cite this Page Paré G, Kitsiou S. Chapter 9 Methods for Literature Reviews. In: Lau F, Kuziemsky C, editors. Handbook of eHealth Evaluation: An Evidence-based Approach [Internet]. Victoria (BC): University of Victoria; 2017 Feb 27.
• PDF version of this title (4.5M)
• Disable Glossary Links

In this Page

• Introduction
• Overview of the Literature Review Process and Steps
• Types of Review Articles and Brief Illustrations
• Concluding Remarks

Related information

• PMC PubMed Central citations
• PubMed Links to PubMed

Recent Activity

• Chapter 9 Methods for Literature Reviews - Handbook of eHealth Evaluation: An Ev... Chapter 9 Methods for Literature Reviews - Handbook of eHealth Evaluation: An Evidence-based Approach

Your browsing activity is empty.

Activity recording is turned off.

Turn recording back on

Connect with NLM

National Library of Medicine 8600 Rockville Pike Bethesda, MD 20894

Web Policies FOIA HHS Vulnerability Disclosure

Help Accessibility Careers

• Print this article

Research & theory

Integrated system responses for families impacted by violence: a scoping review.

• Carey Manuel
• Elizabeth Eppel
• Jane Koziol-McLain
• Chien Ting , Centre for Interdisciplinary Trauma Research, School of Clinical Sciences, Auckland University of Technology, Private Bag 92006, Auckland 1142, New Zealand ORCID
• Carey Manuel , Āio Consulting Limited, Tauranga Moana, New Zealand ORCID
• Elizabeth Eppel , School of Government, Victoria University of Wellington, Wellington, New Zealand ORCID
• Jane Koziol-McLain , Centre for Interdisciplinary Trauma Research, School of Clinical Sciences, Auckland University of Technology, Private Bag 92006, Auckland 1142, New Zealand ORCID

Introduction: Violence within families is a complex problem which significantly impacts health and wellbeing. Despite the ubiquitous call for integrated family violence service delivery, integrated approaches vary significantly and challenges to implementation remain. This scoping review explored how integrated approaches to family violence service delivery are conceptualised within international and Aotearoa New Zealand literature.

Methods: Following a documented scoping review process identified from literature, dynamic interplay between system agents within integrated family violence service delivery were mapped with the assistance of a complexity theory lens. We analysed characteristics of included studies, agents involved, how they interacted and the methods and mechanisms of integration among them.

Results: Seventy-two published reports were included. The most common interactions occurred between statutory agencies such as police and child protection. While health care service providers were included within 55 studies, their engagement was often peripheral. Qualitative analysis elucidated three broad pathways to service delivery impact underpinned by systems-centred, person-centred, or Indigenous-centred worldviews.

Discussion and Conclusion:: Integrated approaches to family violence service delivery are highly variable. Despite a strong assumption that integration leads to improved safety, health, and wellbeing for care-seekers, most studies did not include evidence of such impact. Consideration of how worldviews characterise service provision provides insight into why integration has proven challenging over time.

• Page/Article: 17
• Accepted on 7 May 2024
• Published on 21 May 2024
• Peer Reviewed

A Novel Integrated Supply Chain Model to Manage Perishable Products Demand and Quality by Applying IoT in Vendor-Managed Inventory

• Original Research Paper
• Published: 23 May 2024

Cite this article

• Vahideh Bafandegan Emroozi   ORCID: orcid.org/0000-0002-1177-818X 1 ,
• Azam Modares 1 ,
• Pardis Roozkhosh 1 &
• Renu Agarwal 2  

21 Accesses

Explore all metrics

Vendor-managed inventory (VMI) policies within integrated supply chain management (SCM) represent a robust approach that effectively addresses demand, quality, and inventory management, encompassing the sharing of information and data between vendors and retailers. However, in the context of perishable products, timely inventory management becomes crucial, as its success hinges significantly on product quality, which is an area that has been relatively unexplored in the VMI literature. One emerging and efficient method to tackle VMI for perishable products is the deployment of Internet of Things (IoT) devices throughout the entire supply chain. These devices enable real-time tracking and tracing of product quality, encompassing manufacturing processes. Consequently, this study aims to develop a model for selecting the most suitable IoT devices for managing perishable products in supply chains. Despite its significance, the problem of retailer selection based on critical criteria in VMI has not been thoroughly investigated to date. This paper offers optimal policies to enhance production planning and minimize waste for suppliers by harnessing the advantages of VMI and IoT. To validate the proposed model, a case study involving real data from the food supply chain is examined.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price includes VAT (Russian Federation)

Instant access to the full article PDF.

Rent this article via DeepDyve

Institutional subscriptions

Similar content being viewed by others

Internet of things for perishable inventory management systems: an application and managerial insights for micro, small and medium enterprises

Optimal pricing in the presence of IoT investment and quality-dependent demand

IoT Quality-Controlled Demand Pricing Model in Food Supply Chains

Data availability.

The data that support the findings of this study are available on request from the corresponding author. The data are not publicly available due to restrictions, e.g., their containing information that could compromise the privacy of research participants.

Astanti RD, Daryanto Y, Dewa PK (2022) Low-carbon supply chain model under a vendor-managed inventory partnership and carbon cap-and-trade policy. J. Open Innov. Technol. Mark, Complex, p 8

Google Scholar  

Bafandegan Emroozi V, Kazemi M, Modares A, Roozkhosh P (2024) Improving quality and reducing costs in supply chain: the developing VIKOR method and optimization. Journal of Industrial and Management Optimization 20(2):494–524

Article   MathSciNet   Google Scholar  

Bafandegan Emroozi V, Modares A, Roozkhosh P (2023) A new model to optimize the human reliability based on CREAM and group decision making Abstract. Qual Reliab Eng Int. https://doi.org/10.1002/qre.3457

Article   Google Scholar  

Bafandegan Emroozi V, Roozkhosh P, Modares A, Roozkhosh F (2023) Selecting green suppliers by considering the Internet of Things and CMCDM approach.Process Integration and Optimization for Sustainability 7(5): 1167–1189

Bazan E (2014) Vendor managed inventory (VMI) with consignment stock (CS) agreement for a two-level supply chain with an imperfect production process with/without restoration interruptions. Knowl-Based Syst 157:289–301

Ben-Dayaa M, Hassinib E, Bahrouna Z (2017) Internet of Things and supply chain management: a literature review International Journal of Production Research 4719–4742

Borgia E (2014) The Internet of Things vision: key features, applications and open issues. Comput Commun 54:1–31

Bieniek M (2017) The ubiquitous nature of inventory: vendor managed consignment inventory in adverse market conditions. Eur J Oper Res 291(2):411–420

Busacca PG, Marseguerra M, Zio E (2007) Multi-objective optimization by genetic algorithms: application to safety systems. Reliab Eng Syst Saf 72:59–74

Cammarano A, Varriale V, Michelino F, Caputo M (2022) Blockchain as enabling factor for implementing RFID and IoT technologies in VMI: a simulation on the Parmigiano Reggiano supply chain. Operations Management Research 1–29

Chiou HK, Tzeng GH (2022) An extended approach of multicriteria optimization for MODM problems. In: Multi-Objective Programming and Goal Programming. Advances in Soft Computing 21:111–116. https://doi.org/10.1007/978-3-540-36510-513

Choudhary D, Shankar R (2022) The value of VMI beyond information sharing in a single supplier multiple retailers supply chain under a nonstationary (Rn, Sn) policy. Omega 5:59–70

Darwish M, Odah OM (2010) Vendor managed inventory model for single-vendor multiretailer supply chains. Eur J Oper Res 204(3):473–484

Dasaklis T, Casino F (2019) Improving vendor-managed inventory strategy based on Internet of Things (IoT) applications and blockchain technology. In 2019 IEEE International Conference on Blockchain and Cryptocurrency (ICBC). IEEE. (50–55)

Edwards C, Hopkins J (2018) The Australian supply chain tech survey results. Loganholme, Australia, SCLAA

Elliott MA (2010) Selecting numerical scales for pairwise comparisons. Reliability Engineering & System Safety 95(7):750–763

Fang X, Chen HC (2021) Using vendor management inventory system for goods inventory management in IoT manufacturing. Enterprise Information Systems 1–27

Garg H, Sharma S (1995) Computers industrial engineering. In Proceedings of ICNN’95 -International Conference on Neural Networks 58–191

Gibson M, Bernardo J, Chung C, Badinelli R (1987) A comparison of interactive multiple-objective decision making procedures. Comput Oper Res 14(2):97–105. https://doi.org/10.1016/0305-0548(87)90002-5

Giovanni P (2021) Smart supply chains with vendor managed inventory, coordination, and environmental performance. Eur J Oper Res 299(2):515–531

Goyal S (1995) A one-vendor multi-buyer integrated inventory model: a comment. Eur J Oper Res 82:209–210

Heising JK, Dekker M, Bartels PV, Van Boekel MAJS (2014) Monitoring the quality of perishable foods: opportunities for intelligent packaging. Crit Rev Food Sci Nutr 54(5):645–654

Hu B, Meng C, Xu D, Son Y (2018) Supply chain coordination under vendor managed inventory-consignment stocking contracts with wholesale price constraint and fairness. Int J Prod Econ 202:21–31

Holland JH (2002) Adaptation in natural and artificial systems, Michigan: an overview of the current state-of-the-art. European Journal Operation Research 137:1–9

Jarek S (2016) Removing inconsistency in pairwise comparisons matrix in the AHP. Multiple Criteria Decision Making 11:63–76

Karbasi-bonab V, Yousefi Nejad Attari M, Neishabouri E (2018) Presenting a bi-objective vendor managed inventory model with fuzzy demand for multiple vendor. Journal of Decisions and Operations Research 2(2):147–168

Karimi M, Niknamfar A (2017) A vendor-managed inventory system considering the redundancy allocation problem and carbon emissions. International Journal of Management Science and Engineering Management 12(4):269–279

Kao CY, Chueh HE (2022) A vendor-managed inventory mechanism based on SCADA of Internet of Things framework. Electronics 11(6):881

Kim S, Kim S (2016) A multicriteria approach toward discovering killer IOT application in Korea. Technol Forecast Soc Chang 102:143–155

Kennedy J, Eberhart R (2013) Multi-objective reliability-redundancy allocation problem using particle swarm optimization. Computers Industrial Engineering 247–255

Kumar A, Sah B, Singh AR, Deng Y, He X, Kumar P, Bansal RC (2017) A review of multi criteria decision making (MCDM) towards sustainable renewable energy development. Renew Sustain Energy Rev 69:596–609

Kusuma P, Kallista M (2022) Collaborative vender managed inventory model by using multi agent system and continuous review (r,Q) replenishment policy. Journal of Applied Engineering Science

Lalwani P, Banka H, Kumar C (2017) GSA-CHSR: gravitational search algorithm for cluster head selection and routing in wireless sensor networks. Applications of Soft Computing for the Web. https://doi.org/10.1007/978-981-10-7098-3-13

Li X, Wang W, Zhao X, Zai J, Zhao Q, Li Y, Cha A (2020) Ransmission dynamics and evolutionary history of 2019-nCoV. Med Virol 91:501–511

Liu W, Ke JV, Chen J, Zhang L (2020) Scheduling the distribution of blood products: a vendor-managed inventory routing approach. Transportation Research Part E: Logistics and Transportation Review 140:274–292

Liu X, Sun Y (2017) Information flow control of vendor-managed inventory based on Internet of Things. In International Conference on Computer Science and Information Engineering (448–454). Springer, Berlin, Heidelberg

Lotfi R, Kargar B, Rajabzadeh M, Hesabi F, Ozceylan E (2022) Hybrid fuzzy and data-driven robust optimization for resilience and sustainable health care supply chain with vendor-managed inventory approach. Int. J, Fuzzy Syst

Book   Google Scholar  

Maheshwari P, Kamble S, Pundir A, Belhadi A, Ndubisi NO, Tiwari S (2021) Internet of Things for perishable inventory management systems: an application and managerial insights for micro, small and medium enterprises. Annals of Operations Research 1–29

Manavalan E, Jayakrishna K (2018) A review of Internet of Things (IoT) embedded sustainable supply chain for Industry 4.0 requirements. Computers & Industrial Engineering 127:925–953

Massam BH (1988) Multi-criteria decision making (MCDM) techniques in planning. Prog Plan 30:1–84

Mital M, Choudhary P, Chang V, Papa A, Pani AK (2017) Adoption of Internet of Things in India: a test of competing models using a structured equation modeling approach. Technological Forecasting & Social Change

Modares A, Kazemi M, Bafandegan Emroozi V, Roozkhosh P (2023) A new supply chain design to solve supplier selection based on Internet of Things and delivery reliability. Journal of Industrial and Management Optimization 19(11):7993–8028. https://doi.org/10.3934/jimo.2023028

Modares A, Motahari Farimani N, Bafandegan Emroozi V (2023) A vendor-managed inventory model based on optimal retailers selection and reliability of supply chain. Journal of Industrial and Management Optimization 19(5):3075–3106. https://doi.org/10.3934/jimo.2022078

Modares A, Motahari Farimani N, Bafandegan Emroozi V (2023) Applying a multi-criteria group decision-making method in a probabilistic environment for supplier selection (Case study: Urban railway in Iran). Journal of Optimization in Industrial Engineering 16(1):129–140. https://doi.org/10.22094/joie.2023.1950386.1929

Modares A, Motahari Farimani N, Dehghanian F (2024) A new vendor-managed inventory four-tier model based on reducing environmental impacts and optimal suppliers selection under uncertainty. Journal of Industrial and Management Optimization 20(1):188–220. https://doi.org/10.3934/jimo.2023074

Mohammadi M, Rezaei J (2020) Bayesian best-worst method: a probabilistic group decision-making model. Omega 96. https://doi.org/10.1016/j.omega.2019.06.001

Poursoltan L, Seyedhosseini SM, Jabbarzadeh A (2021) A two-level closed-loop supply chain under the constract of vendor managed inventory with learning: a novel hybrid algorithm. J Ind Prod Eng 38(4):254–270

Rezaei J (2015) Best-worst multi-criteria decision-making method. Omega 53:49–57

Saaty TL (1977) A scaling method for priorities in hierarchical structures. J Math Psychol 15(3):234–281

Sadeghi J, Mousavi S, Niaki S, Sadeghi S (2013) Optimizing a multi-vendor multi-retailer vendor managed inventory problem: two tuned metaheuristic algorithms. Knowl-Based Syst 50:159–170

Sadeghi J, Mousavi S, Niaki S, Sadeghi S (2014) Optimizing a bi-objective inventory model of a three-echelon supply chain using a tuned hybrid bat algorithm. Transp Res Part E 70:274–292

Sainathan A, Groenevelt H (2019) Vendor managed inventory contracts-coordinating the supply chain while looking from the vendor’s perspective. Eur J Oper Res 272:249–260

Shafique MN, Rashid A, Bajwa I, Kazmi R (2018) Effect of IoT capabilities and energy consumption behavior on green supply chain integration. Appl Sci 8:2481

Shankar U (2017) How the Internet of Things impacts supply chains. In bound Logistics, white paper

Shang X, Zhang G, Jia B, Almanaseer M (2022) The healthcare supply location-inventory routing problem: a robust approach. Transportation Research Part E: Logistics and Transportation Review 158

Tirkolaee EB, Alinaghian M, Sasi MB, Esfahani MMS (2019) Solving a robust capacitated arc routing problem using a hybrid simulated annealing algorithm: a waste collection application. Journal of Industrial Engineering and Management Studies 3:61–76

Kilic E, Ali S, Weber GW, Dubey R (2014) A value-adding approach to reliability under preventive maintenance costs and its applications, Optimization. Journal of Mathematical Programming and Operations Research 63:1805–1816

MathSciNet   Google Scholar  

You P, Chen T (2005) An efficient heuristic for series-parallel redundant reliability problems. Comput Oper Res 32:17–27

Ardakan M, Hamadani A, Naghian A (2014) Optimizing bi-objective redundancy allocation problem with a mixed redundancy strategy. ISA Trans 55:116–128

Stellingwerf HM, Kanellopoulos A, Cruijssen F, Bloemhof J (2019) Fair gain allocation in eco-efficient vendor-managed inventory cooperation. J Clean Prod 231:746–755

Verdouw CN, Wolfert J, Beulens A, Rialland A (2015) Virtualization of food supply chains with the Internet of Things. J Food Eng 176:128–136

Wang Y, Geng X, Zhang F, Ruan J (2018) An immune genetic algorithm for multi-echelon inventory cost control of IoT based supply chains. IEEE Access 6:8547–8555

Wettasinghe J, Trung Luong H (2020) A vendor managed inventory policy with emergency orders. J Ind Prod Eng 37(2–3):120–133

Weibhuhn S, Hoberg K (2021) Designing smart replenishment systems: Internet-of-Things technology for vendor-managed inventory at end consumers. Eur J Oper Res 295(3):949–964

Xu L, He W, Li S (2014) Internet of Things in industries: a survey. IEEE Trans Industr Inf 10(4):2233–2243

Yan R (2017) Optimization approach for increasing revenue of perishable product supply chain with the Internet of Things. Industrial Management & Data Systems 117(4):729–741

Yao Y, Dresner M (2008) The inventory value of information sharing continuous replenishment and vendor-managed inventory. Transportation Research Part E: Logistics and Transportation Review 44(3):361–378

Yousefnezhad N, Malhi A, Främling K (2020) TSecurity in product lifecycle of IoT devices: a survey. J Netw Comput Appl 171. https://doi.org/10.1016/j.jnca.2020.102779

Zavadskas EK, Turskis Z, Kildienė S (2014) State of art surveys of overviews on MCDM/MADM methods. Technol Econ Dev Econ 20(1):165–179

Zhu L (2020) Optimization and simulation for e-commerce supply chain in the Internet of Things environment. Complexity

Download references

Author information

Authors and affiliations.

Operations Research, Department of Management, Faculty of Economics and Administrative Sciences, Ferdowsi University of Mashhad, Mashhad, Iran

Vahideh Bafandegan Emroozi, Azam Modares & Pardis Roozkhosh

Management Department, University of Technology Sydney (UTS), Sydney, Australia

Renu Agarwal

You can also search for this author in PubMed   Google Scholar

Corresponding author

Correspondence to Vahideh Bafandegan Emroozi .

Ethics declarations

Ethical approval.

Hereby, we consciously assure that for this manuscript, the following is fulfilled: (1) This material is the authors’ own original work, which has not been previously published elsewhere. (2) The paper is not currently being considered for publication elsewhere. (3) The paper reflects the authors’ own research and analysis in a truthful and complete manner. (4) The paper properly credits the meaningful contributions of co-authors and co-researchers. (5) The results are appropriately placed in the context of prior and existing research. (6) All sources used are properly disclosed (correct citation). Literally copying of text must be indicated as such by using quotation marks and giving proper references. (7) All authors have been personally and actively involved in substantial work leading to the paper and will take public responsibility for its content.

Conflict of Interest

The authors declare no competing interests.

Additional information

Publisher's note.

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Data of case study

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Bafandegan Emroozi, V., Modares, A., Roozkhosh, P. et al. A Novel Integrated Supply Chain Model to Manage Perishable Products Demand and Quality by Applying IoT in Vendor-Managed Inventory. Process Integr Optim Sustain (2024). https://doi.org/10.1007/s41660-024-00421-7

Download citation

Received : 17 September 2023

Revised : 28 March 2024

Accepted : 02 May 2024

Published : 23 May 2024

DOI : https://doi.org/10.1007/s41660-024-00421-7

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

• Supply chain management (SCM)
• Perishable products
• Vendor-managed inventory (VMI)
• Internet of Things (IoT)
• Find a journal
• Publish with us
• Track your research