database research articles

Trending Articles

• Small extracellular vesicles from young plasma reverse age-related functional declines by improving mitochondrial energy metabolism. Chen X, et al. Nat Aging. 2024. PMID: 38627524
• Dual-role transcription factors stabilize intermediate expression levels. He J, et al. Cell. 2024. PMID: 38631355
• ITPRIPL1 binds CD3ε to impede T cell activation and enable tumor immune evasion. Deng S, et al. Cell. 2024. PMID: 38614099
• Brain endothelial GSDMD activation mediates inflammatory BBB breakdown. Wei C, et al. Nature. 2024. PMID: 38632402
• Overall Survival with Adjuvant Pembrolizumab in Renal-Cell Carcinoma. Choueiri TK, et al. N Engl J Med. 2024. PMID: 38631003 Clinical Trial.

Latest Literature

• Am J Clin Nutr (1)
• J Biol Chem (10)
• J Immunol (3)
• Nature (11)
• PLoS One (36)
• Pediatrics (1)
• Proc Natl Acad Sci U S A (10)

NCBI Literature Resources

MeSH PMC Bookshelf Disclaimer

The PubMed wordmark and PubMed logo are registered trademarks of the U.S. Department of Health and Human Services (HHS). Unauthorized use of these marks is strictly prohibited.

Database Search

What is Database Search?

Harvard Library licenses hundreds of online databases, giving you access to academic and news articles, books, journals, primary sources, streaming media, and much more.

The contents of these databases are only partially included in HOLLIS. To make sure you're really seeing everything, you need to search in multiple places. Use Database Search to identify and connect to the best databases for your topic.

In addition to digital content, you will find specialized search engines used in specific scholarly domains.

Related Services & Tools

Reference management. Clean and simple.

The top list of academic research databases

2. Web of Science

5. ieee xplore, 6. sciencedirect, 7. directory of open access journals (doaj), get the most out of your academic research database, frequently asked questions about academic research databases, related articles.

Whether you are writing a thesis , dissertation, or research paper it is a key task to survey prior literature and research findings. More likely than not, you will be looking for trusted resources, most likely peer-reviewed research articles.

Academic research databases make it easy to locate the literature you are looking for. We have compiled the top list of trusted academic resources to help you get started with your research:

Scopus is one of the two big commercial, bibliographic databases that cover scholarly literature from almost any discipline. Besides searching for research articles, Scopus also provides academic journal rankings, author profiles, and an h-index calculator .

• Coverage: 90.6 million core records
• References: N/A
• Discipline: Multidisciplinary
• Access options: Limited free preview, full access by institutional subscription only
• Provider: Elsevier

Web of Science also known as Web of Knowledge is the second big bibliographic database. Usually, academic institutions provide either access to Web of Science or Scopus on their campus network for free.

• Coverage: approx. 100 million items
• References: 1.4 billion
• Access options: institutional subscription only
• Provider: Clarivate (formerly Thomson Reuters)

PubMed is the number one resource for anyone looking for literature in medicine or biological sciences. PubMed stores abstracts and bibliographic details of more than 30 million papers and provides full text links to the publisher sites or links to the free PDF on PubMed Central (PMC) .

• Coverage: approx. 35 million items
• Discipline: Medicine and Biological Sciences
• Access options: free
• Provider: NIH

For education sciences, ERIC is the number one destination. ERIC stands for Education Resources Information Center, and is a database that specifically hosts education-related literature.

• Coverage: approx. 1.6 million items
• Discipline: Education
• Provider: U.S. Department of Education

IEEE Xplore is the leading academic database in the field of engineering and computer science. It's not only journal articles, but also conference papers, standards and books that can be search for.

• Coverage: approx. 6 million items
• Discipline: Engineering
• Provider: IEEE (Institute of Electrical and Electronics Engineers)

ScienceDirect is the gateway to the millions of academic articles published by Elsevier, 1.4 million of which are open access. Journals and books can be searched via a single interface.

• Coverage: approx. 19.5 million items

The DOAJ is an open-access academic database that can be accessed and searched for free.

• Coverage: over 8 million records
• Provider: DOAJ

JSTOR is another great resource to find research papers. Any article published before 1924 in the United States is available for free and JSTOR also offers scholarships for independent researchers.

• Coverage: more than 12 million items
• Provider: ITHAKA

Start using a reference manager like Paperpile to save, organize, and cite your references. Paperpile integrates with PubMed and many popular databases, so you can save references and PDFs directly to your library using the Paperpile buttons:

Scopus is one of the two big commercial, bibliographic databases that cover scholarly literature from almost any discipline. Beside searching for research articles, Scopus also provides academic journal rankings, author profiles, and an h-index calculator .

PubMed is the number one resource for anyone looking for literature in medicine or biological sciences. PubMed stores abstracts and bibliographic details of more than 30 million papers and provides full text links to the publisher sites or links to the free PDF on PubMed Central (PMC)

Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

• View all journals
• Explore content
• About the journal
• Publish with us
• Sign up for alerts

Databases articles within Nature

Nature Index | 13 March 2024

A guide to the Nature Index

A description of the terminology and methodology used in this supplement, and a guide to the functionality that is available free online at natureindex.com.

Article 06 March 2024 | Open Access

Decoding chromatin states by proteomic profiling of nucleosome readers

A multidimensional proteomics analysis of the interactions between around 2,000 nuclear proteins and over 80 modified dinucleosomes representing promoter, enhancer and heterochromatin states provides insights into how chromatin states are decoded by chromatin readers.

• Saulius Lukauskas
• , Andrey Tvardovskiy
•  &  Till Bartke

News | 23 February 2024

‘All of Us’ genetics chart stirs unease over controversial depiction of race

Debate over figure connecting genes, race and ethnicity reignites concerns among geneticists about how to represent human diversity.

Article 19 February 2024 | Open Access

Genomic data in the All of Us Research Program

A study describes the release of clinical-grade whole-genome sequence data for 245,388 diverse participants by the All of Us Research Program and characterizes the properties of the dataset.

• Alexander G. Bick
• , Ginger A. Metcalf
•  &  Joshua C. Denny

Career Column | 01 February 2024

In the AI science boom, beware: your results are only as good as your data

Machine-learning systems are voracious data consumers — but trustworthy results require more vetting both before and after publication.

• Hunter Moseley

Correspondence | 23 January 2024

Funders must get behind brain project data sharing

• Helena Ledmyr
• , Mathew Abrams
•  &  Randy McIntosh

Nature Index | 13 December 2023

News | 30 November 2023

World’s biggest set of human genome sequences opens to scientists

The whole genomes of 500,000 people in the UK Biobank will help researchers to probe our genetic code for links to disease.

• Ewen Callaway

Nature Index | 29 November 2023

Why is China’s high-quality research footprint becoming more introverted?

Data from the Nature Index suggest China-based authors are increasingly publishing without international colleagues.

• Brian Owens

News | 23 November 2023

‘Treasure trove’ of new CRISPR systems holds promise for genome editing

An algorithm that can analyse hundreds of millions of genetic sequences has identified DNA-cutting genes and enzymes that are extremely rare in nature.

• Sara Reardon

Nature Index | 21 November 2023

Nature Index | 08 November 2023

Editorial | 17 October 2023

How to share data — not just equally, but equitably

Just as with many natural resources, wealthy countries have been extracting scientific data from poorer nations for centuries. Researchers are changing that.

Nature Index | 11 October 2023

Nature Index | 06 September 2023

Nature Index | 09 August 2023

News | 03 August 2023

Ancient DNA reveals the living descendants of enslaved people through 23andMe

A landmark genomic study raises the possibility that many more people could find links to distant ancestors through genetic analysis.

News | 02 August 2023

ChatGPT-like AIs are coming to major science search engines

The Scopus, Dimensions and Web of Science databases are introducing conversational AI search.

• Richard Van Noorden

Article 19 July 2023 | Open Access

Mega-scale experimental analysis of protein folding stability in biology and design

Large-scale assays using cDNA display proteolysis are used to measure the folding stabilities of protein domains, providing a method to quantify the effects of mutations on protein folding, with applications in protein design.

• Kotaro Tsuboyama
• , Justas Dauparas
•  &  Gabriel J. Rocklin

Career Column | 13 July 2023

Fourteen things you need to know about collaborating with data scientists

Experimentalists often need help to analyse data. Here’s how to ensure your collaboration is productive.

• Michele Tobias
• , Nick Ulle
•  &  Tyler Shoemaker

Career Column | 05 July 2023

Computer algorithms infer gender, race and ethnicity. Here’s how to avoid their pitfalls

Demographic-prediction algorithms have various challenges, following best practices can minimize the harms.

• Jeffrey W. Lockhart
• , Molly M. King
•  &  Christin L. Munsch

Technology Feature | 27 June 2023

How to make your scientific data accessible, discoverable and useful

Specialists offer seven tips for effectively sharing your data.

• Jeffrey M. Perkel

Nature Index | 15 June 2023

Nature Index Annual Tables 2023: China tops natural-science table

India is another notable riser whereas Russia is among those losing ground.

• Chris Woolston

Correspondence | 13 June 2023

Focus on health for global adaptation to climate change

• Shihui Zhang
• , Wenjia Cai
•  &  Peng Gong

News | 25 May 2023

China’s souped-up data privacy laws deter researchers

Recent regulations have strengthened Chinese data privacy, but are impinging on international research collaboration.

• Dyani Lewis

Major ocean database that will guide deep-sea mining has flaws, scientists warn

As sea-bed mining looms, researchers say better records of sea-floor biodiversity are needed to assess its environmental impact.

• Natasha Gilbert

Nature Index | 09 May 2023

Proposed EU data laws leave researchers out in the cold

Some scientists say the European Commission’s Data Act would favour businesses in its aim to expand access rights to big data, and fear that publicly funded science will suffer.

• Nic Fleming

News Feature | 04 May 2023

GISAID in crisis: can the controversial COVID genome database survive?

The most popular repository for sharing SARS-CoV-2 sequence data has come under increasing scrutiny. Scientists and funders around the world must now consider what lies ahead for the open sharing of genome data.

• Mariana Lenharo

News Feature | 05 April 2023

Diversity in German science: researchers push for missing ethnicity data

The European country is one of several reassessing its cultural unease with collecting information on scientists’ race and ethnicity.

• Hristio Boytchev

Nature Index | 08 March 2023

News | 23 January 2023

Massive health-record review links viral illnesses to brain disease

Study ties common viruses such as flu to Alzheimer’s and other conditions — but the analysis has limitations, researchers warn.

News | 13 January 2023

Researchers blast US agency’s decision not to collect LGBT+ data

Scientists call for the National Science Foundation to add a question about sexual orientation to its 2023 workforce surveys.

Nature Index | 14 December 2022

Nature Index | 07 December 2022

Nature Index | 25 November 2022

News | 11 November 2022

Carbon emissions hit new high: warning from COP27

Fresh data released at the climate summit show global carbon dioxide emissions from fossil fuels are soaring despite energy crisis.

• Jeff Tollefson

World View | 25 October 2022

Cancer research needs better databases

Progress on one of the world’s biggest killers will stall without big registries linking scattered records.

• T. S. Karin Eisinger-Mathason

Nature Index | 14 October 2022

Should AI have a role in assessing research quality?

A UK study aims to find out whether artificial intelligence could ease the peer-review process for the country’s Research Excellence Framework.

• Dalmeet Singh Chawla

Nature Index | 12 October 2022

Correspondence | 04 October 2022

Climate data need shared and open governance

• Marco Schletz
• , Angel Hsu
•  &  Martin Wainstein

Technology Feature | 03 October 2022

Taking the pain out of data sharing

Despite agreeing to make raw data available, some authors fail to comply. The right strategies and platforms can ease the task.

• Matthew Hutson

News | 13 September 2022

Five-year campaign breaks science’s citation paywall

Reference lists for more than 60 million journal studies in Crossref are now free to view and reuse.

Nature Index | 07 September 2022

World View | 07 September 2022

Register animal-tracking tags to boost conservation

The COVID-19 pandemic highlighted the value of pooling animal-tracking data — a global tag registry would facilitate data discovery and collaboration.

• Christian Rutz

Correspondence | 06 September 2022

Map soil nutrients to tackle imbalances worldwide

• Ronald Vargas

Nature Index | 10 August 2022

News | 03 August 2022

Major chemical database investigates hundreds of suspicious crystal structures

An unprecedented number of crystallography database entries are undergoing extra checks amid fears that they are based on fabricated data.

Comment | 18 July 2022

Africa: regulate surveillance technologies and personal data

CCTV cameras and spyware are proliferating in the continent without checks and balances. Governments must legislate locally to prevent civil-rights abuses.

• Bulelani Jili

World View | 15 June 2022

The human microbiome: there is much left to do

It’s time to make the survey of humanity’s ‘second genome’ more complete.

News | 02 June 2022

How science could aid the US quest for environmental justice

Research tools to identify and help protect disadvantaged communities have been in the works for years. Scientists and activists want them put into action.

Browse broader subjects

• Research data
• Computational biology and bioinformatics
• Publication characteristics

Browse narrower subjects

• Genetic databases
• Protein databases

Quick links

• Explore articles by subject
• Guide to authors
• Editorial policies

• Search Menu
• Volume 2024, 2024 (In Progress)
• Volume 2023, 2023
• Author Guidelines
• Submission Site
• Open Access
• About Database
• About the International Society for Biocuration
• Editorial Board
• Advertising and Corporate Services
• Journals Career Network
• Self-Archiving Policy
• Journals on Oxford Academic
• Books on Oxford Academic

Editor-in-Chief

David Landsman

About the journal

Database : The Journal of Biological Databases and Curation provides an open access platform for the presentation of novel ideas in database research and biocuration, and aims to help strengthen the bridge between …

Virtual Issues

Database  publishes a number of virtual issues focusing on different areas of interest and research from relevant conferences.

Click here to find out more

High-Impact Research Collection

Explore a collection of the most read and most cited articles making an impact in  Database  published within the past two years.

Browse the collection

Submit your research

Are you interested in submitting your research to  Database ?

Latest articles

The International Society of Biocuration

The ISB is a non profit organisation for biocurators, developers, and researchers with an interest in biocuration. The society promotes the field of biocuration and provides a forum for information exchange through meeting and workshops.

Find out more

Discover a more complete picture of how readers engage with research in Database  through Altmetric data. Now available on article pages.

Email alerts

Register to receive table of contents email alerts as soon as new issues of Database are published online.

Related Titles

• Recommend to your Library

Affiliations

• Online ISSN 1758-0463
• Copyright © 2024 Oxford University Press
• About Oxford Academic
• Publish journals with us
• University press partners
• What we publish
• New features  
• Open access
• Institutional account management
• Rights and permissions
• Get help with access
• Accessibility
• Advertising
• Media enquiries
• Oxford University Press
• Oxford Languages
• University of Oxford

Oxford University Press is a department of the University of Oxford. It furthers the University's objective of excellence in research, scholarship, and education by publishing worldwide

• Copyright © 2024 Oxford University Press
• Cookie settings
• Cookie policy
• Privacy policy
• Legal notice

This Feature Is Available To Subscribers Only

Sign In or Create an Account

This PDF is available to Subscribers Only

For full access to this pdf, sign in to an existing account, or purchase an annual subscription.

An official website of the United States government

The .gov means it’s official. Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

The site is secure. The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

• Publications
• Account settings

Preview improvements coming to the PMC website in October 2024. Learn More or Try it out now .

• Advanced Search
• Journal List
• Springer Nature - PMC COVID-19 Collection

Advances in database systems education: Methods, tools, curricula, and way forward

Muhammad ishaq.

1 Department of Computer Science, National University of Computer and Emerging Sciences, Lahore, Pakistan

2 Department of Computer Science, Virtual University of Pakistan, Lahore, Pakistan

3 Department of Computer Science, University of Management and Technology, Lahore, Pakistan

Muhammad Shoaib Farooq

Muhammad faraz manzoor.

4 Department of Computer Science, Lahore Garrison University, Lahore, Pakistan

Uzma Farooq

Kamran abid.

5 Department of Electrical Engineering, University of the Punjab, Lahore, Pakistan

Mamoun Abu Helou

6 Faculty of Information Technology, Al Istiqlal University, Jericho, Palestine

Associated Data

Not Applicable.

Fundamentals of Database Systems is a core course in computing disciplines as almost all small, medium, large, or enterprise systems essentially require data storage component. Database System Education (DSE) provides the foundation as well as advanced concepts in the area of data modeling and its implementation. The first course in DSE holds a pivotal role in developing students’ interest in this area. Over the years, the researchers have devised several different tools and methods to teach this course effectively, and have also been revisiting the curricula for database systems education. In this study a Systematic Literature Review (SLR) is presented that distills the existing literature pertaining to the DSE to discuss these three perspectives for the first course in database systems. Whereby, this SLR also discusses how the developed teaching and learning assistant tools, teaching and assessment methods and database curricula have evolved over the years due to rapid change in database technology. To this end, more than 65 articles related to DSE published between 1995 and 2022 have been shortlisted through a structured mechanism and have been reviewed to find the answers of the aforementioned objectives. The article also provides useful guidelines to the instructors, and discusses ideas to extend this research from several perspectives. To the best of our knowledge, this is the first research work that presents a broader review about the research conducted in the area of DSE.

Introduction

Database systems play a pivotal role in the successful implementation of the information systems to ensure the smooth running of many different organizations and companies (Etemad & Küpçü, 2018 ; Morien, 2006 ). Therefore, at least one course about the fundamentals of database systems is taught in every computing and information systems degree (Nagataki et al., 2013 ). Database System Education (DSE) is concerned with different aspects of data management while developing software (Park et al., 2017 ). The IEEE/ACM computing curricula guidelines endorse 30–50 dedicated hours for teaching fundamentals of design and implementation of database systems so as to build a very strong theoretical and practical understanding of the DSE topics (Cvetanovic et al., 2010 ).

Practically, most of the universities offer one user-oriented course at undergraduate level that covers topics related to the data modeling and design, querying, and a limited number of hours on theory (Conklin & Heinrichs, 2005 ; Robbert & Ricardo, 2003 ), where it is often debatable whether to utilize a design-first or query-first approach. Furthermore, in order to update the course contents, some recent trends, including big data and the notion of NoSQL should also be introduced in this basic course (Dietrich et al., 2008 ; Garcia-Molina, 2008 ). Whereas, the graduate course is more theoretical and includes topics related to DB architecture, transactions, concurrency, reliability, distribution, parallelism, replication, query optimization, along with some specialized classes.

Researchers have designed a variety of tools for making different concepts of introductory database course more interesting and easier to teach and learn interactively (Brusilovsky et al., 2010 ) either using visual support (Nagataki et al., 2013 ), or with the help of gamification (Fisher & Khine, 2006 ). Similarly, the instructors have been improvising different methods to teach (Abid et al., 2015 ; Domínguez & Jaime, 2010 ) and evaluate (Kawash et al., 2020 ) this theoretical and practical course. Also, the emerging and hot topics such as cloud computing and big data has also created the need to revise the curriculum and methods to teach DSE (Manzoor et al., 2020 ).

The research in database systems education has evolved over the years with respect to modern contents influenced by technological advancements, supportive tools to engage the learners for better learning, and improvisations in teaching and assessment methods. Particularly, in recent years there is a shift from self-describing data-driven systems to a problem-driven paradigm that is the bottom-up approach where data exists before being designed. This mainly relies on scientific, quantitative, and empirical methods for building models, while pushing the boundaries of typical data management by involving mathematics, statistics, data mining, and machine learning, thus opening a multidisciplinary perspective. Hence, it is important to devote a few lectures to introducing the relevance of such advance topics.

Researchers have provided useful review articles on other areas including Introductory Programming Language (Mehmood et al., 2020 ), use of gamification (Obaid et al., 2020 ), research trends in the use of enterprise service bus (Aziz et al., 2020 ), and the role of IoT in agriculture (Farooq et al., 2019 , 2020 ) However, to the best of our knowledge, no such study was found in the area of database systems education. Therefore, this study discusses research work published in different areas of database systems education involving curricula, tools, and approaches that have been proposed to teach an introductory course on database systems in an effective manner. The rest of the article has been structured in the following manner: Sect.  2 presents related work and provides a comparison of the related surveys with this study. Section  3 presents the research methodology for this study. Section  4 analyses the major findings of the literature reviewed in this research and categorizes it into different important aspects. Section  5 represents advices for the instructors and future directions. Lastly, Sect.  6 concludes the article.

Related work

Systematic Literature Reviews have been found to be a very useful artifact for covering and understanding a domain. A number of interesting review studies have been found in different fields (Farooq et al., 2021 ; Ishaq et al., 2021 ). Review articles are generally categorized into narrative or traditional reviews (Abid et al., 2016 ; Ramzan et al., 2019 ), systematic literature review (Naeem et al., 2020 ) and meta reviews or mapping study (Aria & Cuccurullo, 2017 ; Cobo et al., 2012 ; Tehseen et al., 2020 ). This study presents a systematic literature review on database system education.

The database systems education has been discussed from many different perspectives which include teaching and learning methods, curriculum development, and the facilitation of instructors and students by developing different tools. For instance, a number of research articles have been published focusing on developing tools for teaching database systems course (Abut & Ozturk, 1997 ; Connolly et al., 2005 ; Pahl et al., 2004 ). Furthermore, few authors have evaluated the DSE tools by conducting surveys and performing empirical experiments so as to gauge the effectiveness of these tools and their degree of acceptance among important stakeholders, teachers and students (Brusilovsky et al., 2010 ; Nelson & Fatimazahra, 2010 ). On the other hand, some case studies have also been discussed to evaluate the effectiveness of the improvised approaches and developed tools. For example, Regueras et al. ( 2007 ) presented a case study using the QUEST system, in which e-learning strategies are used to teach the database course at undergraduate level, while, Myers and Skinner ( 1997 ) identified the conflicts that arise when theories in text books regarding the development of databases do not work on specific applications.

Another important facet of DSE research focuses on the curriculum design and evolution for database systems, whereby (Alrumaih, 2016 ; Bhogal et al., 2012 ; Cvetanovic et al., 2010 ; Sahami et al., 2011 ) have proposed solutions for improvements in database curriculum for the better understanding of DSE among the students, while also keeping the evolving technology into the perspective. Similarly, Mingyu et al. ( 2017 ) have shared their experience in reforming the DSE curriculum by adding topics related to Big Data. A few authors have also developed and evaluated different tools to help the instructors teaching DSE.

There are further studies which focus on different aspects including specialized tools for specific topics in DSE (Mcintyre et al, 1995 ; Nelson & Fatimazahra, 2010 ). For instance, Mcintyre et al. ( 1995 ) conducted a survey about using state of the art software tools to teach advanced relational database design courses at Cleveland State University. However, the authors did not discuss the DSE curricula and pedagogy in their study. Similarly, a review has been conducted by Nelson and Fatimazahra ( 2010 ) to highlight the fact that the understanding of basic knowledge of database is important for students of the computer science domain as well as those belonging to other domains. They highlighted the issues encountered while teaching the database course in universities and suggested the instructors investigate these difficulties so as to make this course more effective for the students. Although authors have discussed and analyzed the tools to teach database, the tools are yet to be categorized according to different methods and research types within DSE. There also exists an interesting systematic mapping study by Taipalus and Seppänen ( 2020 ) that focuses on teaching SQL which is a specific topic of DSE. Whereby, they categorized the selected primary studies into six categories based on their research types. They utilized directed content analysis, such as, student errors in query formulation, characteristics and presentation of the exercise database, specific or non-specific teaching approach suggestions, patterns and visualization, and easing teacher workload.

Another relevant study that focuses on collaborative learning techniques to teach the database course has been conducted by Martin et al. ( 2013 ) This research discusses collaborative learning techniques and adapted it for the introductory database course at the Barcelona School of Informatics. The motive of the authors was to introduce active learning methods to improve learning and encourage the acquisition of competence. However, the focus of the study was only on a few methods for teaching the course of database systems, while other important perspectives, including database curricula, and tools for teaching DSE were not discussed in this study.

The above discussion shows that a considerable amount of research work has been conducted in the field of DSE to propose various teaching methods; develop and test different supportive tools, techniques, and strategies; and to improve the curricula for DSE. However, to the best of our knowledge, there is no study that puts all these relevant and pertinent aspects together while also classifying and discussing the supporting methods, and techniques. This review is considerably different from previous studies. Table ​ Table1 1 highlights the differences between this study and other relevant studies in the field of DSE using ✓ and – symbol reflecting "included" and "not included" respectively. Therefore, this study aims to conduct a systematic mapping study on DSE that focuses on compiling, classifying, and discussing the existing work related to pedagogy, supporting tools, and curricula.

Comparison with other related research articles

Research methodology

In order to preserve the principal aim of this study, which is to review the research conducted in the area of database systems education, a piece of advice has been collected from existing methods described in various studies (Elberzhager et al., 2012 ; Keele et al., 2007 ; Mushtaq et al., 2017 ) to search for the relevant papers. Thus, proper research objectives were formulated, and based on them appropriate research questions and search strategy were formulated as shown in Fig.  1 .

Research objectives

The Following are the research objectives of this study:

• i. To find high quality research work in DSE.
• ii. To categorize different aspects of DSE covered by other researchers in the field.
• iii. To provide a thorough discussion of the existing work in this study to provide useful information in the form of evolution, teaching guidelines, and future research directions of the instructors.

Research questions

In order to fulfill the research objectives, some relevant research questions have been formulated. These questions along with their motivations have been presented in Table ​ Table2 2 .

Study selection results

Search strategy

The Following search string used to find relevant articles to conduct this study. “Database” AND (“System” OR “Management”) AND (“Education*” OR “Train*” OR “Tech*” OR “Learn*” OR “Guide*” OR “Curricul*”).

Articles have been taken from different sources i.e. IEEE, Springer, ACM, Science Direct and other well-known journals and conferences such as Wiley Online Library, PLOS and ArXiv. The planning for search to find the primary study in the field of DSE is a vital task.

Study selection

A total of 29,370 initial studies were found. These articles went through a selection process, and two authors were designated to shortlist the articles based on the defined inclusion criteria as shown in Fig.  2 . Their conflicts were resolved by involving a third author; while the inclusion/exclusion criteria were also refined after resolving the conflicts as shown in Table ​ Table3. 3 . Cohen’s Kappa coefficient 0.89 was observed between the two authors who selected the articles, which reflects almost perfect agreement between them (Landis & Koch, 1977 ). While, the number of papers in different stages of the selection process for all involved portals has been presented in Table ​ Table4 4 .

Selection criteria

Title based search: Papers that are irrelevant based on their title are manually excluded in the first stage. At this stage, there was a large portion of irrelevant papers. Only 609 papers remained after this stage.

Abstract based search: At this stage, abstracts of the selected papers in the previous stage are studied and the papers are categorized for the analysis along with research approach. After this stage only 152 papers were left.

Full text based analysis: Empirical quality of the selected articles in the previous stage is evaluated at this stage. The analysis of full text of the article has been conducted. The total of 70 papers were extracted from 152 papers for primary study. Following questions are defined for the conduction of final data extraction.

Quality assessment criteria

Following are the criteria used to assess the quality of the selected primary studies. This quality assessment was conducted by two authors as explained above.

• The study focuses on curricula, tools, approach, or assessments in DSE, the possible answers were Yes (1), No (0)
• The study presents a solution to the problem in DSE, the possible answers to this question were Yes (1), Partially (0.5), No (0)
• The study focuses on empirical results, Yes (1), No (0)

Score pattern of publication channels

Almost 50.00% of papers had scored more than average and 33.33% of papers had scored between the average range i.e., 2.50–3.50. Some articles with the score below 2.50 have also been included in this study as they present some useful information and were published in education-based journals. Also, these studies discuss important demography and technology based aspects that are directly related to DSE.

Threats to validity

The validity of this study could be influenced by the following factors during the literature of this publication.

Construct validity

In this study this validity identifies the primary study for research (Elberzhager et al., 2012 ). To ensure that many primary studies have been included in this literature two authors have proposed possible search keywords in multiple repetitions. Search string is comprised of different terms related to DS and education. Though, list might be incomplete, count of final papers found can be changed by the alternative terms (Ampatzoglou et al., 2013 ). IEEE digital library, Science direct, ACM digital library, Wiley Online Library, PLOS, ArXiv and Google scholar are the main libraries where search is done. We believe according to the statistics of search engines of literature the most research can be found on these digital libraries (Garousi et al., 2013 ). Researchers also searched related papers in main DS research sites (VLDB, ICDM, EDBT) in order to minimize the risk of missing important publication.

Including the papers that does not belong to top journals or conferences may reduce the quality of primary studies in this research but it indicates that the representativeness of the primary studies is improved. However, certain papers which were not from the top publication sources are included because of their relativeness wisth the literature, even though they reduce the average score for primary studies. It also reduces the possibility of alteration of results which might have caused by the improper handling of duplicate papers. Some cases of duplications were found which were inspected later whether they were the same study or not. The two authors who have conducted the search has taken the final decision to the select the papers. If there is no agreement between then there must be discussion until an agreement is reached.

Internal validity

This validity deals with extraction and data analysis (Elberzhager et al., 2012 ). Two authors carried out the data extraction and primary studies classification. While the conflicts between them were resolved by involving a third author. The Kappa coefficient was 0.89, according to Landis and Koch ( 1977 ), this value indicates almost perfect level of agreement between the authors that reduces this threat significantly.

Conclusion validity

This threat deals with the identification of improper results which may cause the improper conclusions. In this case this threat deals with the factors like missing studies and wrong data extraction (Ampatzoglou et al., 2013 ). The objective of this is to limit these factors so that other authors can perform study and produce the proper conclusions (Elberzhager et al., 2012 ).

Interpretation of results might be affected by the selection and classification of primary studies and analyzing the selected study. Previous section has clearly described each step performed in primary study selection and data extraction activity to minimize this threat. The traceability between the result and data extracted was supported through the different charts. In our point of view, slight difference based on the publication selection and misclassification would not alter the main results.

External validity

This threat deals with the simplification of this research (Mateo et al., 2012 ). The results of this study were only considered that related to the DSE filed and validation of the conclusions extracted from this study only concerns the DSE context. The selected study representativeness was not affected because there was no restriction on time to find the published research. Therefore, this external validity threat is not valid in the context of this research. DS researchers can take search string and the paper classification scheme represented in this study as an initial point and more papers can be searched and categorized according to this scheme.

Analysis of compiled research articles

This section presents the analysis of the compiled research articles carefully selected for this study. It presents the findings with respect to the research questions described in Table ​ Table2 2 .

Selection results

A total of 70 papers were identified and analyzed for the answers of RQs described above. Table ​ Table6 6 represents a list of the nominated papers with detail of the classification results and their quality assessment scores.

Classification and quality assessment of selected articles

RQ1.Categorization of research work in DSE field

The analysis in this study reveals that the literature can be categorized as: Tools: any additional application that helps instructors in teaching and students in learning. Methods: any improvisation aimed at improving pedagogy or cognition. Curriculum: refers to the course content domains and their relative importance in a degree program, as shown in Fig.  3 .

Taxonomy of DSE study types

Most of the articles provide a solution by gathering the data and also prove the novelty of their research through results. These papers are categorized as experiments w.r.t. their research types. Whereas, some of them case study papers which are used to generate an in depth, multifaceted understanding of a complex issue in its real-life context, while few others are review studies analyzing the previously used approaches. On the other hand, a majority of included articles have evaluated their results with the help of experiments, while others conducted reviews to establish an opinion as shown in Fig.  4 .

Cross Mapping of DSE study type and research Types

Educational tools, especially those related to technology, are making their place in market faster than ever before (Calderon et al., 2011 ). The transition to active learning approaches, with the learner more engaged in the process rather than passively taking in information, necessitates a variety of tools to help ensure success. As with most educational initiatives, time should be taken to consider the goals of the activity, the type of learners, and the tools needed to meet the goals. Constant reassessment of tools is important to discover innovation and reforms that improve teaching and learning (Irby & Wilkerson, 2003 ). For this purpose, various type of educational tools such as, interactive, web-based and game based have been introduced to aid the instructors in order to explain the topic in more effective way.

The inclusion of technology into the classroom may help learners to compete in the competitive market when approaching the start of their career. It is important for the instructors to acknowledge that the students are more interested in using technology to learn database course instead of merely being taught traditional theory, project, and practice-based methods of teaching (Adams et al., 2004 ). Keeping these aspects in view many authors have done significant research which includes web-based and interactive tools to help the learners gain better understanding of basic database concepts.

Great research has been conducted with the focus of students learning. In this study we have discussed the students learning supportive with two major finding’s objectives i.e., tools which prove to be more helpful than other tools. Whereas, proposed tools with same outcome as traditional classroom environment. Such as, Abut and Ozturk ( 1997 ) proposed an interactive classroom environment to conduct database classes. The online tools such as electronic “Whiteboard”, electronic textbooks, advance telecommunication networks and few other resources such as Matlab and World Wide Web were the main highlights of their proposed smart classroom. Also, Pahl et al. ( 2004 ) presented an interactive multimedia-based system for the knowledge and skill oriented Web-based education of database course students. The authors had differentiated their proposed classroom environment from traditional classroom-based approach by using tool mediated independent learning and training in an authentic setting. On the other hand, some authors have also evaluated the educational tools based on their usage and impact on students’ learning. For example, Brusilovsky et al. ( 2010 )s evaluated the technical and conceptual difficulties of using several interactive educational tools in the context of a single course. A combined Exploratorium has been presented for database courses and an experimental platform, which delivers modified access to numerous types of interactive learning activities.

Also, Taipalus and Perälä ( 2019 ) investigated the types of errors that are persistent in writing SQL by the students. The authors also contemplated the errors while mapping them onto different query concepts. Moreover, Abelló Gamazo et al. ( 2016 ) presented a software tool for the e-assessment of relational database skills named LearnSQL. The proposed software allows the automatic and efficient e-learning and e-assessment of relational database skills. Apart from these, Yue ( 2013 ) proposed the database tool named Sakila as a unified platform to support instructions and multiple assignments of a graduate database course for five semesters. According to this study, students find this tool more useful and interesting than the highly simplified databases developed by the instructor, or obtained from textbook. On the other hand, authors have proposed tools with the main objective to help the student’s grip on the topic by addressing the pedagogical problems in using the educational tools. Connolly et al. ( 2005 ) discussed some of the pedagogical problems sustaining the development of a constructive learning environment using problem-based learning, a simulation game and interactive visualizations to help teach database analysis and design. Also, Yau and Karim ( 2003 ) proposed smart classroom with prevalent computing technology which will facilitate collaborative learning among the learners. The major aim of this smart classroom is to improve the quality of interaction between the instructors and students during lecture.

Student satisfaction is also an important factor for the educational tools to more effective. While it supports in students learning process it should also be flexible to achieve the student’s confidence by making it as per student’s needs (Brusilovsky et al., 2010 ; Connolly et al., 2005 ; Pahl et al., 2004 ). Also, Cvetanovic et al. ( 2010 ) has proposed a web-based educational system named ADVICE. The proposed solution helps the students to reduce the gap between DBMS, theory and its practice. On the other hand, authors have enhanced the already existing educational tools in the traditional classroom environment to addressed the student’s concerns (Nelson & Fatimazahra, 2010 ; Regueras et al., 2007 ) Table ​ Table7 7 .

Tools: Adopted in DSE and their impacts

Hands on database development is the main concern in most of the institute as well as in industry. However, tools assisting the students in database development and query writing is still major concern especially in SQL (Brusilovsky et al., 2010 ; Nagataki et al., 2013 ).

Student’s grades reflect their conceptual clarity and database development skills. They are also important to secure jobs and scholarships after passing out, which is why it is important to have the educational learning tools to help the students to perform well in the exams (Cvetanovic et al., 2010 ; Taipalus et al., 2018 ). While, few authors (Wang et al., 2010 ) proposed Metube which is a variation of YouTube. Subsequently, existing educational tools needs to be upgraded or replaced by the more suitable assessment oriented interactive tools to attend challenging students needs (Pahl et al., 2004 ; Yuelan et al., 2011 ).

One other objective of developing the educational tools is to increase the interaction between the students and the instructors. In the modern era, almost every institute follows the student centered learning(SCL). In SCL the interaction between students and instructor increases with most of the interaction involves from the students. In order to support SCL the educational based interactive and web-based tools need to assign more roles to students than the instructors (Abbasi et al., 2016 ; Taipalus & Perälä, 2019 ; Yau & Karim, 2003 ).

Theory versus practice is still one of the main issues in DSE teaching methods. The traditional teaching method supports theory first and then the concepts learned in the theoretical lectures implemented in the lab. Whereas, others think that it is better to start by teaching how to write query, which should be followed by teaching the design principles for database, while a limited amount of credit hours are also allocated for the general database theory topics. This part of the article discusses different trends of teaching and learning style along with curriculum and assessments methods discussed in DSE literature.

A variety of teaching methods have been designed, experimented, and evaluated by different researchers (Yuelan et al., 2011 ; Chen et al., 2012 ; Connolly & Begg, 2006 ). Some authors have reformed teaching methods based on the requirements of modern way of delivering lectures such as Yuelan et al. ( 2011 ) reform teaching method by using various approaches e.g. a) Modern ways of education: includes multimedia sound, animation, and simulating the process and working of database systems to motivate and inspire the students. b) Project driven approach: aims to make the students familiar with system operations by implementing a project. c) Strengthening the experimental aspects: to help the students get a strong grip on the basic knowledge of database and also enable them to adopt a self-learning ability. d) Improving the traditional assessment method: the students should turn in their research and development work as the content of the exam, so that they can solve their problem on their own.

The main aim of any teaching method is to make student learn the subject effectively. Student must show interest in order to gain something from the lectures delivered by the instructors. For this, teaching methods should be interactive and interesting enough to develop the interest of the students in the subject. Students can show interest in the subject by asking more relative questions or completing the home task and assignments on time. Authors have proposed few teaching methods to make topic more interesting such as, Chen et al. ( 2012 ) proposed a scaffold concept mapping strategy, which considers a student’s prior knowledge, and provides flexible learning aids (scaffolding and fading) for reading and drawing concept maps. Also, Connolly & Begg (200s6) examined different problems in database analysis and design teaching, and proposed a teaching approach driven by principles found in the constructivist epistemology to overcome these problems. This constructivist approach is based on the cognitive apprenticeship model and project-based learning. Similarly, Domínguez & Jaime ( 2010 ) proposed an active method for database design through practical tasks development in a face-to-face course. They analyzed results of five academic years using quasi experimental. The first three years a traditional strategy was followed and a course management system was used as material repository. On the other hand, Dietrich and Urban ( 1996 ) have described the use of cooperative group learning concepts in support of an undergraduate database management course. They have designed the project deliverables in such a way that students develop skills for database implementation. Similarly, Zhang et al. ( 2018 ) have discussed several effective classroom teaching measures from the aspects of the innovation of teaching content, teaching methods, teaching evaluation and assessment methods. They have practiced the various teaching measures by implementing the database technologies and applications in Qinghai University. Moreover, Hou and Chen ( 2010 ) proposed a new teaching method based on blending learning theory, which merges traditional and constructivist methods. They adopted the method by applying the blending learning theory on Access Database programming course teaching.

Problem solving skills is a key aspect to any type of learning at any age. Student must possess this skill to tackle the hurdles in institute and also in industry. Create mind and innovative students find various and unique ways to solve the daily task which is why they are more likeable to secure good grades and jobs. Authors have been working to introduce teaching methods to develop problem solving skills in the students(Al-Shuaily, 2012 ; Cai & Gao, 2019 ; Martinez-González & Duffing, 2007 ; Gudivada et al., 2007 ). For instance, Al-Shuaily ( 2012 ) has explored four cognitive factors such as i) Novices’ ability in understanding, ii) Novices’ ability to translate, iii) Novice’s ability to write, iv) Novices’ skills that might influence SQL teaching, and learning methods and approaches. Also, Cai and Gao ( 2019 ) have reformed the teaching method in the database course of two higher education institutes in China. Skills and knowledge, innovation ability, and data abstraction were the main objective of their study. Similarly, Martinez-González and Duffing ( 2007 ) analyzed the impact of convergence of European Union (EU) in different universities across Europe. According to their study, these institutes need to restructure their degree program and teaching methodologies. Moreover, Gudivada et al. ( 2007 ) proposed a student’s learning method to work with the large datasets. they have used the Amazon Web Services API and.NET/C# application to extract a subset of the product database to enhance student learning in a relational database course.

On the other hand, authors have also evaluated the traditional teaching methods to enhance the problem-solving skills among the students(Eaglestone & Nunes, 2004 ; Wang & Chen, 2014 ; Efendiouglu & Yelken, 2010 ) Such as, Eaglestone and Nunes ( 2004 ) shared their experiences of delivering a database design course at Sheffield University and discussed some of the issues they faced, regarding teaching, learning and assessments. Likewise, Wang and Chen ( 2014 ) summarized the problems mainly in teaching of the traditional database theory and application. According to the authors the teaching method is outdated and does not focus on the important combination of theory and practice. Moreover, Efendiouglu and Yelken ( 2010 ) investigated the effects of two different methods Programmed Instruction (PI) and Meaningful Learning (ML) on primary school teacher candidates’ academic achievements and attitudes toward computer-based education, and to define their views on these methods. The results show that PI is not favoured for teaching applications because of its behavioural structure Table ​ Table8 8 .

Methods: Teaching approaches adopted in DSE

Students become creative and innovative when the try to study on their own and also from different resources rather than curriculum books only. In the modern era, there are various resources available on both online and offline platforms. Modern teaching methods must emphasize on making the students independent from the curriculum books and educate them to learn independently(Amadio et al., 2003 ; Cai & Gao, 2019 ; Martin et al., 2013 ). Also, in the work of Kawash et al. ( 2020 ) proposed he group study-based learning approach called Graded Group Activities (GGAs). In this method students team up in order to take the exam as a group. On the other hand, few studies have emphasized on course content to prepare students for the final exams such as, Zheng and Dong ( 2011 ) have discussed the issues of computer science teaching with particular focus on database systems, where different characteristics of the course, teaching content and suggestions to teach this course effectively have been presented.

As technology is evolving at rapid speed, so students need to have practical experience from the start. Basic theoretical concepts of database are important but they are of no use without its implementation in real world projects. Most of the students study in the institutes with the aim of only clearing the exams with the help of theoretical knowledge and very few students want to have practical experience(Wang & Chen, 2014 ; Zheng & Dong, 2011 ). To reduce the gap between the theory and its implementation, authors have proposed teaching methods to develop the student’s interest in the real-world projects (Naik & Gajjar, 2021 ; Svahnberg et al., 2008 ; Taipalus et al., 2018 ). Moreover, Juxiang and Zhihong ( 2012 ) have proposed that the teaching organization starts from application scenarios, and associate database theoretical knowledge with the process from analysis, modeling to establishing database application. Also, Svahnberg et al. ( 2008 ) explained that in particular conditions, there is a possibility to use students as subjects for experimental studies in DSE and influencing them by providing responses that are in line with industrial practice.

On the other hand, Nelson et al. ( 2003 ) evaluated the different teaching methods used to teach different modules of database in the School of Computing and Technology at the University of Sunder- land. They outlined suggestions for changes to the database curriculum to further integrate research and state-of-the-art systems in databases.

• III. Curriculum

Database curriculum has been revisited many times in the form of guidelines that not only present the contents but also suggest approximate time to cover different topics. According to the ACM curriculum guidelines (Lunt et al., 2008 ) for the undergraduate programs in computer science, the overall coverage time for this course is 46.50 h distributed in such a way that 11 h is the total coverage time for the core topics such as, Information Models (4 core hours), Database Systems (3 core hours) and Data Modeling (4 course hours). Whereas, the remaining hours are allocated for elective topics such as Indexing, Relational Databases, Query Languages, Relational Database Design, Transaction Processing, Distributed Databases, Physical Database Design, Data Mining, Information Storage and Retrieval, Hypermedia, Multimedia Systems, and Digital Libraries(Marshall, 2012 ). While, according to the ACM curriculum guidelines ( 2013 ) for undergraduate programs in computer science, this course should be completed in 15 weeks with two and half hour lecture per week and lab session of four hours per week on average (Brady et al., 2004 ). Thus, the revised version emphasizes on the practice based learning with the help of lab component. Numerous organizations have exerted efforts in this field to classify DSE (Dietrich et al., 2008 ). DSE model curricula, bodies of knowledge (BOKs), and some standardization aspects in this field are discussed below:

Model curricula

There are standard bodies who set the curriculum guidelines for teaching undergraduate degree programs in computing disciplines. Curricula which include the guidelines to teach database are: Computer Engineering Curricula (CEC) (Meier et al., 2008 ), Information Technology Curricula (ITC) (Alrumaih, 2016 ), Computing Curriculum Software Engineering (CCSE) (Meyer, 2001 ), Cyber Security Curricula (CSC) (Brady et al., 2004 ; Bishop et al., 2017 ).

Bodies of knowledge (BOK)

A BOK includes the set of thoughts and activities related to the professional area, while in model curriculum set of guidelines are given to address the education issues (Sahami et al., 2011 ). Database body of Knowledge comprises of (a) The Data Management Body of Knowledge (DM- BOK), (b) Software Engineering Education Knowledge (SEEK) (Sobel, 2003 ) (Sobel, 2003 ), and (c) The SE body of knowledge (SWEBOK) (Swebok Evolution: IEEE Computer Society n.d. ).

Apart from the model curricula, and bodies of knowledge, there also exist some standards related to the database and its different modules: ISO/IEC 9075–1:2016 (Computing Curricula, 1991 ), ISO/IEC 10,026–1: 1998 (Suryn, 2003 ).

We also utilize advices from some studies (Elberzhager et al., 2012 ; Keele et al., 2007 ) to search for relevant papers. In order to conduct this systematic study, it is essential to formulate the primary research questions (Mushtaq et al., 2017 ). Since the data management techniques and software are evolving rapidly, the database curriculum should also be updated accordingly to meet these new requirements. Some authors have described ways of updating the content of courses to keep pace with specific developments in the field and others have developed new database curricula to keep up with the new data management techniques.

Furthermore, some authors have suggested updates for the database curriculum based on the continuously evolving technology and introduction of big data. For instance Bhogal et al. ( 2012 ) have shown that database curricula need to be updated and modernized, which can be achieved by extending the current database concepts that cover the strategies to handle the ever changing user requirements and how database technology has evolved to meet the requirements. Likewise, Picciano ( 2012 ) examines the evolving world of big data and analytics in American higher education. According to the author, the “data driven” decision making method should be used to help the institutes evaluate strategies that can improve retention and update the curriculum that has big data basic concepts and applications, since data driven decision making has already entered in the big data and learning analytic era. Furthermore, Marshall ( 2011 ) presented the challenges faced when developing a curriculum for a Computer Science degree program in the South African context that is earmarked for international recognition. According to the author, the Curricula needs to adhere both to the policy and content requirements in order to be rated as being of a particular quality.

Similarly, some studies (Abourezq & Idrissi, 2016 ; Mingyu et al., 2017 ) described big data influence from a social perspective and also proceeded with the gaps in database curriculum of computer science, especially, in the big data era and discovers the teaching improvements in practical and theoretical teaching mode, teaching content and teaching practice platform in database curriculum. Also Silva et al. ( 2016 ) propose teaching SQL as a general language that can be used in a wide range of database systems from traditional relational database management systems to big data systems.

On the other hand, different authors have developed a database curriculum based on the different academic background of students. Such as, Dean and Milani ( 1995 ) have recommended changes in computer science curricula based on the practice in United Stated Military Academy (USMA). They emphasized greatly on the practical demonstration of the topic rather than the theoretical explanation. Especially, for the non-computer science major students. Furthermore, Urban and Dietrich ( 2001 ) described the development of a second course on database systems for undergraduates, preparing students for the advanced database concepts that they will exercise in the industry. They also shared their experience with teaching the course, elaborating on the topics and assignments. Also, Andersson et al. ( 2019 ) proposed variations in core topics of database management course for the students with the engineering background. Moreover, Dietrich et al. ( 2014 ) described two animations developed with images and color that visually and dynamically introduce fundamental relational database concepts and querying to students of many majors. The goal is that the educators, in diverse academic disciplines, should be able to incorporate these animations in their existing courses to meet their pedagogical needs.

The information systems have evolved into large scale distributed systems that store and process a huge amount of data across different servers, and process them using different distributed data processing frameworks. This evolution has given birth to new paradigms in database systems domain termed as NoSQL and Big Data systems, which significantly deviate from conventional relational and distributed database management systems. It is pertinent to mention that in order to offer a sustainable and practical CS education, these new paradigms and methodologies as shown in Fig.  5 should be included into database education (Kleiner, 2015 ). Tables ​ Tables9 9 and ​ and10 10 shows the summarized findings of the curriculum based reviewed studies. This section also proposed appropriate text book based on the theory, project, and practice-based teaching methodology as shown in Table ​ Table9. 9 . The proposed books are selected purely on the bases of their usage in top universities around the world such as, Massachusetts Institute of Technology, Stanford University, Harvard University, University of Oxford, University of Cambridge and, University of Singapore and the coverage of core topics mentioned in the database curriculum.

Concepts in Database Systems Education (Kleiner, 2015 )

Recommended text books for DSE

Curriculum: Findings of Reviewed Literature

RQ.2 Evolution of DSE research

This section discusses the evolution of database while focusing the DSE over the past 25 years as shown in Fig.  6 .

Evolution of DSE studies

This study shows that there is significant increase in research in DSE after 2004 with 78% of the selected papers are published after 2004. The main reason of this outcome is that some of the papers are published in well-recognized channels like IEEE Transactions on Education, ACM Transactions on Computing Education, International Conference on Computer Science and Education (ICCSE), and Teaching, Learning and Assessment of Database (TLAD) workshop. It is also evident that several of these papers were published before 2004 and only a few articles were published during late 1990s. This is because of the fact that DSE started to gain interest after the introduction of Body of Knowledge and DSE standards. The data intensive scientific discovery has been discussed as the fourth paradigm (Hey et al., 2009 ): where the first involves empirical science and observations; second contains theoretical science and mathematically driven insights; third considers computational science and simulation driven insights; while the fourth involves data driven insights of modern scientific research.

Over the past few decades, students have gone from attending one-room class to having the world at their fingertips, and it is a great challenge for the instructors to develop the interest of students in learning database. This challenge has led to the development of the different types of interactive tools to help the instructors teach DSE in this technology oriented era. Keeping the importance of interactive tools in DSE in perspective, various authors have proposed different interactive tools over the years, such as during 1995–2003, when different authors proposed various interactive tools. Some studies (Abut & Ozturk, 1997 ; Mcintyre et al., 1995 ) introduced state of the art interactive tools to teach and enhance the collaborative learning among the students. Similarly, during 2004–2005 more interactive tools in the field of DSE were proposed such as Pahl et al. ( 2004 ), Connolly et al. ( 2005 ) introduced multimedia system based interactive model and game based collaborative learning environment.

The Internet has started to become more common in the first decade of the twenty-first century and its positive impact on the education sector was undeniable. Cost effective, student teacher peer interaction, keeping in touch with the latest information were the main reasons which made the instructors employ web-based tools to teach database in the education sector. Due to this spike in the demand of web-based tools, authors also started to introduce new instruments to assist with teaching database. In 2007 Regueras et al. ( 2007 ) proposed an e-learning tool named QUEST with a feedback module to help the students to learn from their mistakes. Similarly, in 2010, multiple authors have proposed and evaluated various web-based tools. Cvetanovic et al. ( 2010 ) proposed ADVICE with the functionality to monitor student’s progress, while, few authors (Wang et al., 2010 ) proposed Metube which is a variation of YouTube. Furthermore, Nelson and Fatimazahra ( 2010 ) evaluated different web-based tools to highlight the complexities of using these web-based instruments.

Technology has changed the teaching methods in the education sector but technology cannot replace teachers, and despite the amount of time most students spend online, virtual learning will never recreate the teacher-student bond. In the modern era, innovation in technology used in educational sectors is not meant to replace the instructors or teaching methods.

During the 1990s some studies (Dietrich & Urban, 1996 ; Urban & Dietrich, 1997 ) proposed learning and teaching methods respectively keeping the evolving technology in view. The highlight of their work was project deliverables and assignments where students progressively advanced to a step-by-step extension, from a tutorial exercise and then attempting more difficult extension of assignment.

During 2002–2007 various authors have discussed a number of teaching and learning methods to keep up the pace with the ever changing database technology, such as Connolly and Begg ( 2006 ) proposing a constructive approach to teach database analysis and design. Similarly, Prince and Felder ( 2006 ) reviewed the effectiveness of inquiry learning, problem based learning, project-based learning, case-based teaching, discovery learning, and just-in-time teaching. Also, McIntyre et al. (Mcintyre et al., 1995 ) brought to light the impact of convergence of European Union (EU) in different universities across Europe. They suggested a reconstruction of teaching and learning methodologies in order to effectively teach database.

During 2008–2013 more work had been done to address the different methods of teaching and learning in the field of DSE, like the work of Dominguez and Jaime ( 2010 ) who proposed an active learning approach. The focus of their study was to develop the interest of students in designing and developing databases. Also, Zheng and Dong ( 2011 ) have highlighted various characteristics of the database course and its teaching content. Similarly, Yuelan et al. ( 2011 ) have reformed database teaching methods. The main focus of their study were the Modern ways of education, project driven approach, strengthening the experimental aspects, and improving the traditional assessment method. Likewise, Al-Shuaily ( 2012 ) has explored 4 cognitive factors that can affect the learning process of database. The main focus of their study was to facilitate the students in learning SQL. Subsequently, Chen et al. ( 2012 ) also proposed scaffolding-based concept mapping strategy. This strategy helps the students to better understand database management courses. Correspondingly, Martin et al. ( 2013 ) discussed various collaborative learning techniques in the field of DSE while keeping database as an introductory course.

In the years between 2014 and 2021, research in the field of DSE increased, which was the main reason that the most of teaching, learning and assessment methods were proposed and discussed during this period. Rashid and Al-Radhy ( 2014 ) discussed the issues of traditional teaching, learning, assessing methods of database courses at different universities in Kurdistan and the main focus of their study being reformation issues, such as absence of teaching determination and contradiction between content and theory. Similarly, Wang and Chen ( 2014 ) summarized the main problems in teaching the traditional database theory and its application. Curriculum assessment mode was the main focus of their study. Eaglestone and Nunes ( 2004 ) shared their experiences of delivering a databases design course at Sheffield University. Their focus of study included was to teach the database design module to a diverse group of students from different backgrounds. Rashid ( 2015 ) discussed some important features of database courses, whereby reforming the conventional teaching, learning, and assessing strategies of database courses at universities were the main focus of this study. Kui et al. ( 2018 ) reformed the teaching mode of database courses based on flipped classroom. Initiative learning of database courses was their main focus in this study. Similarly, Zhang et al. ( 2018 ) discussed several effective classroom teaching measures. The main focus of their study was teaching content, teaching methods, teaching evaluation and assessment methods. Cai and Gao ( 2019 ) also carried out the teaching reforms in the database course of liberal arts. Diversified teaching modes, such as flipping classroom, case oriented teaching and task oriented were the focus of their study. Teaching Kawash et al. ( 2020 ) proposed a learning approach called Graded Group Activities (GGAs). Their main focus of the study was reforming learning and assessment method.

Database course covers several topics that range from data modeling to data implementation and examination. Over the years, various authors have given their suggestions to update these topics in database curriculum to meet the requirements of modern technologies. On the other hand, authors have also proposed a new curriculum for the students of different academic backgrounds and different areas. These reformations in curriculum helped the students in their preparation, practically and theoretically, and enabled them to compete in the competitive market after graduation.

During 2003 and 2006 authors have proposed various suggestions to update and develop computer science curriculum across different universities. Robbert and Ricardo ( 2003 ) evaluated three reviews from 1999 to 2002 that were given to the groups of educators. The focus of their study was to highlight the trends that occurred in database curriculum. Also, Calero et al. ( 2003 ) proposed a first draft for this Database Body of Knowledge (DBBOK). Database (DB), Database Design (DBD), Database Administration (DBAd), Database Application (DBAp) and Advance Databases (ADVDB) were the main focus of their study. Furthermore, Conklin and Heinrichs (Conklin & Heinrichs, 2005 ) compared the content included in 13 database textbooks and the main focus of their study was IS 2002, CC2001, and CC2004 model curricula.

The years from 2007 and 2011, authors managed to developed various database curricula, like Luo et al. ( 2008 ) developed curricula in Zhejiang University City College. The aim of their study to nurture students to be qualified computer scientists. Likewise, Dietrich et al. ( 2008 ) proposed the techniques to assess the development of an advanced database course. The purpose behind the addition of an advanced database course at undergraduate level was to prepare the students to respond to industrial requirements. Also, Marshall ( 2011 ) developed a new database curriculum for Computer Science degree program in the South African context.

During 2012 and 2021 various authors suggested updates for the database curriculum such as Bhogal et al. ( 2012 ) who suggested updating and modernizing the database curriculum. Data management and data analytics were the focus of their study. Similarly, Picciano ( 2012 ) examined the curriculum in the higher level of American education. The focus of their study was big data and analytics. Also, Zhanquan et al. ( 2016 ) proposed the design for the course content and teaching methods in the classroom. Massive Open Online Courses (MOOCs) were the focus of their study. Likewise, Mingyu et al. ( 2017 ) suggested updating the database curriculum while keeping new technology concerning the database in perspective. The focus of their study was big data.

The above discussion clearly shows that the SQL is most discussed topic in the literature where more than 25% of the studies have discussed it in the previous decade as shown in Fig.  7 . It is pertinent to mention that other SQL databases such as Oracle, MS access are discussed under the SQL banner (Chen et al., 2012 ; Hou & Chen, 2010 ; Wang & Chen, 2014 ). It is mainly because of its ability to handle data in a relational database management system and direct implementation of database theoretical concepts. Also, other database topics such as transaction management, application programming etc. are also the main highlights of the topics discussed in the literature.

Evolution of Database topics discussed in literature

Research synthesis, advice for instructors, and way forward

This section presents the synthesized information extracted after reading and analyzing the research articles considered in this study. To this end, it firstly contextualizes the tools and methods to help the instructors find suitable tools and methods for their settings. Similarly, developments in curriculum design have also been discussed. Subsequently, general advice for instructors have been discussed. Lastly, promising future research directions for developing new tools, methods, and for revising the curriculum have also been discussed in this section.

Methods, tools, and curriculum

Methods and tools.

Web-based tools proposed by Cvetanovic et al. ( 2010 ) and Wang et al. ( 2010 ) have been quite useful, as they are growing increasingly pertinent as online mode of education is prevalent all around the globe during COVID-19. On the other hand, interactive tools and smart class room methodology has also been used successfully to develop the interest of students in database class. (Brusilovsky et al., 2010 ; Connolly et al., 2005 ; Pahl et al., 2004 ; Canedo et al., 2021 ; Ko et al., 2021 ).

One of the most promising combination of methodology and tool has been proposed by Cvetanovic et al. ( 2010 ), whereby they developed a tool named ADVICE that helps students learn and implement database concepts while using project centric methodology, while a game based collaborative learning environment was proposed by Connolly et al. ( 2005 ) that involves a methodology comprising of modeling, articulation, feedback, and exploration. As a whole, project centric teaching (Connolly & Begg, 2006 ; Domínguez & Jaime, 2010 ) and teaching database design and problem solving skills Wang and Chen ( 2014 ), are two successful approaches for DSE. Whereas, other studies (Urban & Dietrich, 1997 ) proposed teaching methods that are more inclined towards practicing database concepts. While a topic specific approach has been proposed by Abbasi et al. ( 2016 ), Taipalus et al. ( 2018 ) and Silva et al. ( 2016 ) to teach and learn SQL. On the other hand, Cai and Gao ( 2019 ) developed a teaching method for students who do not have a computer science background. Lastly, some useful ways for defining assessments for DSE have been proposed by Kawash et al. ( 2020 ) and Zhang et al. ( 2018 ).

Curriculum of database adopted by various institutes around the world does not address how to teach the database course to the students who do not have a strong computer science background. Such as Marshall ( 2012 ), Luo et al. ( 2008 ) and Zhanquan et al. ( 2016 ) have proposed the updates in current database curriculum for the students who are not from computer science background. While Abid et al. ( 2015 ) proposed a combined course content and various methodologies that can be used for teaching database systems course. On the other hand, current database curriculum does not include the topics related to latest technologies in database domain. This factor was discussed by many other studies as well (Bhogal et al., 2012 ; Mehmood et al., 2020 ; Picciano, 2012 ).

Guidelines for instructors

The major conclusion of this study are the suggestions based on the impact and importance for instructors who are teaching DSE. Furthermore, an overview of productivity of every method can be provided by the empirical studies. These instructions are for instructors which are the focal audience of this study. These suggestions are subjective opinions after literature analysis in form of guidelines according to the authors and their meaning and purpose were maintained. According to the literature reviewed, various issues have been found in this section. Some other issues were also found, but those were not relevant to DSE. Following are some suggestions that provide interesting information:

Project centric and applied approach

• To inculcate database development skills for the students, basic elements of database development need to be incorporated into teaching and learning at all levels including undergraduate studies (Bakar et al., 2011 ). To fulfill this objective, instructors should also improve the data quality in DSE by assigning the projects and assignments to the students where they can assess, measure and improve the data quality using already deployed databases. They should demonstrate that the quality of data is determined not only by the effective design of a database, but also through the perception of the end user (Mathieu & Khalil, 1997 )
• The gap between the database course theory and industrial practice is big. Fresh graduate students find it difficult to cope up with the industrial pressure because of the contrast between what they have been taught in institutes and its application in industry (Allsopp et al., 2006 ). Involve top performers from classes in industrial projects so that they are able to acquiring sufficient knowledge and practice, especially for post graduate courses. There must be some other activities in which industry practitioners come and present the real projects and also share their industrial experiences with the students. The gap between theoretical and the practical sides of database has been identified by Myers and Skinner ( 1997 ). In order to build practical DS concepts, instructors should provide the students an accurate view of reality and proper tools.

Importance of software development standards and impact of DB in software success

• They should have the strategies, ability and skills that can align the DSE course with the contemporary Global Software Development (GSD) (Akbar & Safdar, 2015 ; Damian et al., 2006 ).
• Enable the students to explain the approaches to problem solving, development tools and methodologies. Also, the DS courses are usually taught in normal lecture format. The result of this method is that students cannot see the influence on the success or failure of projects because they do not realize the importance of DS activities.

Pedagogy and the use of education technology

• Some studies have shown that teaching through play and practical activities helps to improve the knowledge and learning outcome of students (Dicheva et al., 2015 ).
• Interactive classrooms can help the instructors to deliver their lecture in a more effective way by using virtual white board, digital textbooks, and data over network(Abut & Ozturk, 1997 ). We suggest that in order to follow the new concept of smart classroom, instructors should use the experience of Yau and Karim ( 2003 ) which benefits in cooperative learning among students and can also be adopted in DSE.
• The instructors also need to update themselves with full spectrum of technology in education, in general, and for DSE, in particular. This is becoming more imperative as during COVID the world is relying strongly on the use of technology, particularly in education sector.

Periodic Curriculum Revision

• There is also a need to revisit the existing series of courses periodically, so that they are able to offer the following benefits: (a) include the modern day database system concepts; (b) can be offered as a specialization track; (c) a specialized undergraduate degree program may also be designed.

DSE: Way forward

This research combines a significant work done on DSE at one place, thus providing a point to find better ways forward in order to improvise different possible dimensions for improving the teaching process of a database system course in future. This section discusses technology, methods, and modifications in curriculum would most impact the delivery of lectures in coming years.

Several tools have already been developed for effective teaching and learning in database systems. However, there is a great room for developing new tools. Recent rise of the notion of “serious games” is marking its success in several domains. Majority of the research work discussed in this review revolves around web-based tools. The success of serious games invites researchers to explore this new paradigm of developing useful tools for learning and practice database systems concepts.

Likewise, due to COVID-19 the world is setting up new norms, which are expected to affect the methods of teaching as well. This invites the researchers to design, develop, and test flexible tools for online teaching in a more interactive manner. At the same time, it is also imperative to devise new techniques for assessments, especially conducting online exams at massive scale. Moreover, the researchers can implement the idea of instructional design in web-based teaching in which an online classroom can be designed around the learners’ unique backgrounds and effectively delivering the concepts that are considered to be highly important by the instructors.

The teaching, learning and assessment methods discussed in this study can help the instructors to improve their methods in order to teach the database system course in a better way. It is noticed that only 16% of authors have the assessment methods as their focus of study, which clearly highlights that there is still plenty of work needed to be done in this particular domain. Assessment techniques in the database course will help the learners to learn from their mistakes. Also, instructors must realize that there is a massive gap between database theory and practice which can only be reduced with maximum practice and real world database projects.

Similarly, the technology is continuously influencing the development and expansion of modern education, whereas the instructors’ abilities to teach using online platforms are critical to the quality of online education.

In the same way, the ideas like flipped classroom in which students have to prepare the lesson prior to the class can be implemented on web-based teaching. This ensures that the class time can be used for further discussion of the lesson, share ideas and allow students to interact in a dynamic learning environment.

The increasing impact of big data systems, and data science and its anticipated impact on the job market invites the researchers to revisit the fundamental course of database systems as well. There is a need to extend the boundaries of existing contents by including the concepts related to distributed big data systems data storage, processing, and transaction management, with possible glimpse of modern tools and technologies.

As a whole, an interesting and long term extension is to establish a generic and comprehensive framework that engages all the stakeholders with the support of technology to make the teaching, learning, practicing, and assessing easier and more effective.

This SLR presents review on the research work published in the area of database system education, with particular focus on teaching the first course in database systems. The study was carried out by systematically selecting research papers published between 1995 and 2021. Based on the study, a high level categorization presents a taxonomy of the published under the heads of Tools, Methods, and Curriculum. All the selected articles were evaluated on the basis of a quality criteria. Several methods have been developed to effectively teach the database course. These methods focus on improving learning experience, improve student satisfaction, improve students’ course performance, or support the instructors. Similarly, many tools have been developed, whereby some tools are topic based, while others are general purpose tools that apply for whole course. Similarly, the curriculum development activities have also been discussed, where some guidelines provided by ACM/IEEE along with certain standards have been discussed. Apart from this, the evolution in these three areas has also been presented which shows that the researchers have been presenting many different teaching methods throughout the selected period; however, there is a decrease in research articles that address the curriculum and tools in the past five years. Besides, some guidelines for the instructors have also been shared. Also, this SLR proposes a way forward in DSE by emphasizing on the tools: that need to be developed to facilitate instructors and students especially post Covid-19 era, methods: to be adopted by the instructors to close the gap between the theory and practical, Database curricula update after the introduction of emerging technologies such as big data and data science. We also urge that the recognized publication venues for database research including VLDB, ICDM, EDBT should also consider publishing articles related to DSE. The study also highlights the importance of reviving the curricula, tools, and methodologies to cater for recent advancements in the field of database systems.

Data availability

Code availability, declarations.

Publisher's note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

• Abbasi, S., Kazi, H., Khowaja, K., Abelló Gamazo, A., Burgués Illa, X., Casany Guerrero, M. J., Martin Escofet, C., Quer, C., Rodriguez González, M. E., Romero Moral, Ó., Urpi Tubella, A., Abid, A., Farooq, M. S., Raza, I., Farooq, U., Abid, K., Hussain, N., Abid, K., Ahmad, F., …, Yatim, N. F. M. (2016). Research trends in enterprise service bus (ESB) applications: A systematic mapping study. Journal of Informetrics, 27 (1), 217–220.
• Abbasi, S., Kazi, H., & Khowaja, K. (2017). A systematic review of learning object oriented programming through serious games and programming approaches. 2017 4th IEEE International Conference on Engineering Technologies and Applied Sciences (ICETAS) , 1–6.
• Abelló Gamazo A, Burgués Illa X, Casany Guerrero MJ, Martin Escofet C, Quer C, Rodriguez González ME, Romero Moral Ó, Urpi Tubella A. A software tool for E-assessment of relational database skills. International Journal of Engineering Education. 2016; 32 (3A):1289–1312. [ Google Scholar ]
• Abid A, Farooq MS, Raza I, Farooq U, Abid K. Variants of teaching first course in database systems. Bulletin of Education and Research. 2015; 37 (2):9–25. [ Google Scholar ]
• Abid A, Hussain N, Abid K, Ahmad F, Farooq MS, Farooq U, Khan SA, Khan YD, Naeem MA, Sabir N. A survey on search results diversification techniques. Neural Computing and Applications. 2016; 27 (5):1207–1229. [ Google Scholar ]
• Abourezq, M., & Idrissi, A. (2016). Database-as-a-service for big data: An overview. International Journal of Advanced Computer Science and Applications (IJACSA) , 7 (1).
• Abut, H., & Ozturk, Y. (1997). Interactive classroom for DSP/communication courses. 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing , 1 , 15–18.
• Adams ES, Granger M, Goelman D, Ricardo C. Managing the introductory database course: What goes in and what comes out? ACM SIGCSE Bulletin. 2004; 36 (1):497–498. [ Google Scholar ]
• Akbar, R., & Safdar, S. (2015). A short review of global software development (gsd) and latest software development trends. 2015 International Conference on Computer, Communications, and Control Technology (I4CT) , 314–317.
• Allsopp DH, DeMarie D, Alvarez-McHatton P, Doone E. Bridging the gap between theory and practice: Connecting courses with field experiences. Teacher Education Quarterly. 2006; 33 (1):19–35. [ Google Scholar ]
• Alrumaih, H. (2016). ACM/IEEE-CS information technology curriculum 2017: status report. Proceedings of the 1st National Computing Colleges Conference (NC3 2016) .
• Al-Shuaily, H. (2012). Analyzing the influence of SQL teaching and learning methods and approaches. 10 Th International Workshop on the Teaching, Learning and Assessment of Databases , 3.
• Amadio, W., Riyami, B., Mansouri, K., Poirier, F., Ramzan, M., Abid, A., Khan, H. U., Awan, S. M., Ismail, A., Ahmed, M., Ilyas, M., Mahmood, A., Hey, A. J. G., Tansley, S., Tolle, K. M., others, Tehseen, R., Farooq, M. S., Abid, A., …, Fatimazahra, E. (2003). The fourth paradigm: data-intensive scientific discovery. Innovation in Teaching and Learning in Information and Computer Sciences , 1 (1), 823–828. https://www.iso.org/standard/27614.html
• Amadio, W. (2003). The dilemma of Team Learning: An assessment from the SQL programming classroom . 823–828.
• Ampatzoglou A, Charalampidou S, Stamelos I. Research state of the art on GoF design patterns: A mapping study. Journal of Systems and Software. 2013; 86 (7):1945–1964. [ Google Scholar ]
• Andersson C, Kroisandt G, Logofatu D. Including active learning in an online database management course for industrial engineering students. IEEE Global Engineering Education Conference (EDUCON) 2019; 2019 :217–220. [ Google Scholar ]
• Aria M, Cuccurullo C. bibliometrix: An R-tool for comprehensive science mapping analysis. Journal of Informetrics. 2017; 11 (4):959–975. [ Google Scholar ]
• Aziz O, Farooq MS, Abid A, Saher R, Aslam N. Research trends in enterprise service bus (ESB) applications: A systematic mapping study. IEEE Access. 2020; 8 :31180–31197. [ Google Scholar ]
• Bakar MA, Jailani N, Shukur Z, Yatim NFM. Final year supervision management system as a tool for monitoring computer science projects. Procedia-Social and Behavioral Sciences. 2011; 18 :273–281. [ Google Scholar ]
• Beecham S, Baddoo N, Hall T, Robinson H, Sharp H. Motivation in Software Engineering: A systematic literature review. Information and Software Technology. 2008; 50 (9–10):860–878. [ Google Scholar ]
• Bhogal, J. K., Cox, S., & Maitland, K. (2012). Roadmap for Modernizing Database Curricula. 10 Th International Workshop on the Teaching, Learning and Assessment of Databases , 73.
• Bishop, M., Burley, D., Buck, S., Ekstrom, J. J., Futcher, L., Gibson, D., ... & Parrish, A. (2017, May). Cybersecurity curricular guidelines . In IFIP World Conference on Information Security Education (pp. 3–13). Cham: Springer.
• Brady A, Bruce K, Noonan R, Tucker A, Walker H. The 2003 model curriculum for a liberal arts degree in computer science: preliminary report. ACM SIGCSE Bulletin. 2004; 36 (1):282–283. [ Google Scholar ]
• Brusilovsky P, Sosnovsky S, Lee DH, Yudelson M, Zadorozhny V, Zhou X. An open integrated exploratorium for database courses. AcM SIGcSE Bulletin. 2008; 40 (3):22–26. [ Google Scholar ]
• Brusilovsky P, Sosnovsky S, Yudelson MV, Lee DH, Zadorozhny V, Zhou X. Learning SQL programming with interactive tools: From integration to personalization. ACM Transactions on Computing Education (TOCE) 2010; 9 (4):1–15. [ Google Scholar ]
• Cai, Y., & Gao, T. (2019). Teaching Reform in Database Course for Liberal Arts Majors under the Background of" Internet Plus". 2018 6th International Education, Economics, Social Science, Arts, Sports and Management Engineering Conference (IEESASM 2018) , 208–213.
• Calderon KR, Vij RS, Mattana J, Jhaveri KD. Innovative teaching tools in nephrology. Kidney International. 2011; 79 (8):797–799. [ PubMed ] [ Google Scholar ]
• Calero C, Piattini M, Ruiz F. Towards a database body of knowledge: A study from Spain. ACM SIGMOD Record. 2003; 32 (2):48–53. [ Google Scholar ]
• Canedo, E. D., Bandeira, I. N., & Costa, P. H. T. (2021). Challenges of database systems teaching amidst the Covid-19 pandemic. In 2021 IEEE Frontiers in Education Conference (FIE) (pp. 1–9). IEEE.
• Chen H-H, Chen Y-J, Chen K-J. The design and effect of a scaffolded concept mapping strategy on learning performance in an undergraduate database course. IEEE Transactions on Education. 2012; 56 (3):300–307. [ Google Scholar ]
• Cobo MJ, López-Herrera AG, Herrera-Viedma E, Herrera F. SciMAT: A new science mapping analysis software tool. Journal of the American Society for Information Science and Technology. 2012; 63 (8):1609–1630. [ Google Scholar ]
• Conklin M, Heinrichs L. In search of the right database text. Journal of Computing Sciences in Colleges. 2005; 21 (2):305–312. [ Google Scholar ]
• Connolly, T. M., & Begg, C. E. (2006). A constructivist-based approach to teaching database analysis and design. Journal of Information Systems Education , 17 (1).
• Connolly, T. M., Stansfield, M., & McLellan, E. (2005). An online games-based collaborative learning environment to teach database design. Web-Based Education: Proceedings of the Fourth IASTED International Conference(WBE-2005) .
• Curricula Computing. (1991). Report of the ACM/IEEE-CS Joint Curriculum Task Force. Technical Report . New York: Association for Computing Machinery.
• Cvetanovic M, Radivojevic Z, Blagojevic V, Bojovic M. ADVICE—Educational system for teaching database courses. IEEE Transactions on Education. 2010; 54 (3):398–409. [ Google Scholar ]
• Damian, D., Hadwin, A., & Al-Ani, B. (2006). Instructional design and assessment strategies for teaching global software development: a framework. Proceedings of the 28th International Conference on Software Engineering , 685–690.
• Dean, T. J., & Milani, W. G. (1995). Transforming a database systems and design course for non computer science majors. Proceedings Frontiers in Education 1995 25th Annual Conference. Engineering Education for the 21st Century , 2 , 4b2--17.
• Dicheva, D., Dichev, C., Agre, G., & Angelova, G. (2015). Gamification in education: A systematic mapping study. Journal of Educational Technology \& Society , 18 (3), 75–88.
• Dietrich SW, Urban SD, Haag S. Developing advanced courses for undergraduates: A case study in databases. IEEE Transactions on Education. 2008; 51 (1):138–144. [ Google Scholar ]
• Dietrich SW, Goelman D, Borror CM, Crook SM. An animated introduction to relational databases for many majors. IEEE Transactions on Education. 2014; 58 (2):81–89. [ Google Scholar ]
• Dietrich, S. W., & Urban, S. D. (1996). Database theory in practice: learning from cooperative group projects. Proceedings of the Twenty-Seventh SIGCSE Technical Symposium on Computer Science Education , 112–116.
• Dominguez, C., & Jaime, A. (2010). Database design learning: A project-based approach organized through a course management system. Computers \& Education , 55 (3), 1312–1320.
• Eaglestone, B., & Nunes, M. B. (2004). Pragmatics and practicalities of teaching and learning in the quicksand of database syllabuses. Journal of Innovations in Teaching and Learning for Information and Computer Sciences , 3 (1).
• Efendiouglu A, Yelken TY. Programmed instruction versus meaningful learning theory in teaching basic structured query language (SQL) in computer lesson. Computers & Education. 2010; 55 (3):1287–1299. [ Google Scholar ]
• Elberzhager F, Münch J, Nha VTN. A systematic mapping study on the combination of static and dynamic quality assurance techniques. Information and Software Technology. 2012; 54 (1):1–15. [ Google Scholar ]
• Etemad M, Küpçü A. Verifiable database outsourcing supporting join. Journal of Network and Computer Applications. 2018; 115 :1–19. [ Google Scholar ]
• Farooq MS, Riaz S, Abid A, Abid K, Naeem MA. A Survey on the role of IoT in agriculture for the implementation of smart farming. IEEE Access. 2019; 7 :156237–156271. [ Google Scholar ]
• Farooq MS, Riaz S, Abid A, Umer T, Zikria YB. Role of IoT technology in agriculture: A systematic literature review. Electronics. 2020; 9 (2):319. [ Google Scholar ]
• Farooq U, Rahim MSM, Sabir N, Hussain A, Abid A. Advances in machine translation for sign language: Approaches, limitations, and challenges. Neural Computing and Applications. 2021; 33 (21):14357–14399. [ Google Scholar ]
• Fisher, D., & Khine, M. S. (2006). Contemporary approaches to research on learning environments: Worldviews . World Scientific.
• Garcia-Molina, H. (2008). Database systems: the complete book . Pearson Education India.
• Garousi V, Mesbah A, Betin-Can A, Mirshokraie S. A systematic mapping study of web application testing. Information and Software Technology. 2013; 55 (8):1374–1396. [ Google Scholar ]
• Gudivada, V. N., Nandigam, J., & Tao, Y. (2007). Enhancing student learning in database courses with large data sets. 2007 37th Annual Frontiers In Education Conference-Global Engineering: Knowledge Without Borders, Opportunities Without Passports , S2D--13.
• Hey, A. J. G., Tansley, S., Tolle, K. M., & others. (2009). The fourth paradigm: data-intensive scientific discovery (Vol. 1). Microsoft research Redmond, WA.
• Holliday, M. A., & Wang, J. Z. (2009). A multimedia database project and the evolution of the database course. 2009 39th IEEE Frontiers in Education Conference , 1–6.
• Hou, S., & Chen, S. (2010). Research on applying the theory of Blending Learning on Access Database Programming Course teaching. 2010 2nd International Conference on Education Technology and Computer , 3 , V3--396.
• Irby DM, Wilkerson L. Educational innovations in academic medicine and environmental trends. Journal of General Internal Medicine. 2003; 18 (5):370–376. [ PMC free article ] [ PubMed ] [ Google Scholar ]
• Ishaq K, Zin NAM, Rosdi F, Jehanghir M, Ishaq S, Abid A. Mobile-assisted and gamification-based language learning: A systematic literature review. PeerJ Computer Science. 2021; 7 :e496. [ PMC free article ] [ PubMed ] [ Google Scholar ]
• Joint Task Force on Computing Curricula, A. F. C. M. (acm), & Society, I. C. (2013). Computer science curricula 2013: Curriculum guidelines for undergraduate degree programs in computer science . New York, NY, USA: Association for Computing Machinery.
• Juxiang R, Zhihong N. Taking database design as trunk line of database courses. Fourth International Conference on Computational and Information Sciences. 2012; 2012 :767–769. [ Google Scholar ]
• Kawash, J., Jarada, T., & Moshirpour, M. (2020). Group exams as learning tools: Evidence from an undergraduate database course. Proceedings of the 51st ACM Technical Symposium on Computer Science Education , 626–632.
• Keele, S., et al. (2007). Guidelines for performing systematic literature reviews in software engineering .
• Kleiner, C. (2015). New Concepts in Database System Education: Experiences and Ideas. Proceedings of the 46th ACM Technical Symposium on Computer Science Education , 698.
• Ko J, Paek S, Park S, Park J. A news big data analysis of issues in higher education in Korea amid the COVID-19 pandemic. Sustainability. 2021; 13 (13):7347. [ Google Scholar ]
• Kui, X., Du, H., Zhong, P., & Liu, W. (2018). Research and application of flipped classroom in database course. 2018 13th International Conference on Computer Science \& Education (ICCSE) , 1–5.
• Landis, J. R., & Koch, G. G. (1977). The measurement of observer agreement for categorical data. Biometrics , 159–174. [ PubMed ]
• Lunt, B., Ekstrom, J., Gorka, S., Hislop, G., Kamali, R., Lawson, E., ... & Reichgelt, H. (2008). Curriculum guidelines for undergraduate degree programs in information technology . ACM.
• Luo, R., Wu, M., Zhu, Y., & Shen, Y. (2008). Exploration of Curriculum Structures and Educational Models of Database Applications. 2008 The 9th International Conference for Young Computer Scientists , 2664–2668.
• Luxton-Reilly, A., Albluwi, I., Becker, B. A., Giannakos, M., Kumar, A. N., Ott, L., Paterson, J., Scott, M. J., Sheard, J., & Szabo, C. (2018). Introductory programming: a systematic literature review. Proceedings Companion of the 23rd Annual ACM Conference on Innovation and Technology in Computer Science Education , 55–106.
• Manzoor MF, Abid A, Farooq MS, Nawaz NA, Farooq U. Resource allocation techniques in cloud computing: A review and future directions. Elektronika Ir Elektrotechnika. 2020; 26 (6):40–51. doi: 10.5755/j01.eie.26.6.25865. [ CrossRef ] [ Google Scholar ]
• Marshall, L. (2011). Developing a computer science curriculum in the South African context. CSERC , 9–19.
• Marshall, L. (2012). A comparison of the core aspects of the acm/ieee computer science curriculum 2013 strawman report with the specified core of cc2001 and cs2008 review. Proceedings of Second Computer Science Education Research Conference , 29–34.
• Martin C, Urpi T, Casany MJ, Illa XB, Quer C, Rodriguez ME, Abello A. Improving learning in a database course using collaborative learning techniques. The International Journal of Engineering Education. 2013; 29 (4):986–997. [ Google Scholar ]
• Martinez-González MM, Duffing G. Teaching databases in compliance with the European dimension of higher education: Best practices for better competences. Education and Information Technologies. 2007; 12 (4):211–228. [ Google Scholar ]
• Mateo PR, Usaola MP, Alemán JLF. Validating second-order mutation at system level. IEEE Transactions on Software Engineering. 2012; 39 (4):570–587. [ Google Scholar ]
• Mathieu, R. G., & Khalil, O. (1997). Teaching Data Quality in the Undergraduate Database Course. IQ , 249–266.
• Mcintyre, D. R., Pu, H.-C., & Wolff, F. G. (1995). Use of software tools in teaching relational database design. Computers \& Education , 24 (4), 279–286.
• Mehmood E, Abid A, Farooq MS, Nawaz NA. Curriculum, teaching and learning, and assessments for introductory programming course. IEEE Access. 2020; 8 :125961–125981. [ Google Scholar ]
• Meier, R., Barnicki, S. L., Barnekow, W., & Durant, E. (2008). Work in progress-Year 2 results from a balanced, freshman-first computer engineering curriculum. In 38th Annual Frontiers in Education Conference (pp. S1F-17). IEEE.
• Meyer B. Software engineering in the academy. Computer. 2001; 34 (5):28–35. [ Google Scholar ]
• Mingyu, L., Jianping, J., Yi, Z., & Cuili, Z. (2017). Research on the teaching reform of database curriculum major in computer in big data era. 2017 12th International Conference on Computer Science and Education (ICCSE) , 570–573.
• Morien, R. I. (2006). A Critical Evaluation Database Textbooks, Curriculum and Educational Outcomes. Director , 7 .
• Mushtaq Z, Rasool G, Shehzad B. Multilingual source code analysis: A systematic literature review. IEEE Access. 2017; 5 :11307–11336. [ Google Scholar ]
• Myers M, Skinner P. The gap between theory and practice: A database application case study. Journal of International Information Management. 1997; 6 (1):5. [ Google Scholar ]
• Naeem A, Farooq MS, Khelifi A, Abid A. Malignant melanoma classification using deep learning: Datasets, performance measurements, challenges and opportunities. IEEE Access. 2020; 8 :110575–110597. [ Google Scholar ]
• Nagataki, H., Nakano, Y., Nobe, M., Tohyama, T., & Kanemune, S. (2013). A visual learning tool for database operation. Proceedings of the 8th Workshop in Primary and Secondary Computing Education , 39–40.
• Naik, S., & Gajjar, K. (2021). Applying and Evaluating Engagement and Application-Based Learning and Education (ENABLE): A Student-Centered Learning Pedagogy for the Course Database Management System. Journal of Education , 00220574211032319.
• Nelson, D., Stirk, S., Patience, S., & Green, C. (2003). An evaluation of a diverse database teaching curriculum and the impact of research. 1st LTSN Workshop on Teaching, Learning and Assessment of Databases, Coventry .
• Nelson D, Fatimazahra E. Review of Contributions to the Teaching, Learning and Assessment of Databases (TLAD) Workshops. Innovation in Teaching and Learning in Information and Computer Sciences. 2010; 9 (1):78–86. [ Google Scholar ]
• Obaid I, Farooq MS, Abid A. Gamification for recruitment and job training: Model, taxonomy, and challenges. IEEE Access. 2020; 8 :65164–65178. [ Google Scholar ]
• Pahl C, Barrett R, Kenny C. Supporting active database learning and training through interactive multimedia. ACM SIGCSE Bulletin. 2004; 36 (3):27–31. [ Google Scholar ]
• Park, Y., Tajik, A. S., Cafarella, M., & Mozafari, B. (2017). Database learning: Toward a database that becomes smarter every time. Proceedings of the 2017 ACM International Conference on Management of Data , 587–602.
• Picciano AG. The evolution of big data and learning analytics in American higher education. Journal of Asynchronous Learning Networks. 2012; 16 (3):9–20. [ Google Scholar ]
• Prince MJ, Felder RM. Inductive teaching and learning methods: Definitions, comparisons, and research bases. Journal of Engineering Education. 2006; 95 (2):123–138. [ Google Scholar ]
• Ramzan M, Abid A, Khan HU, Awan SM, Ismail A, Ahmed M, Ilyas M, Mahmood A. A review on state-of-the-art violence detection techniques. IEEE Access. 2019; 7 :107560–107575. [ Google Scholar ]
• Rashid, T. A., & Al-Radhy, R. S. (2014). Transformations to issues in teaching, learning, and assessing methods in databases courses. 2014 IEEE International Conference on Teaching, Assessment and Learning for Engineering (TALE) , 252–256.
• Rashid, T. (2015). Investigation of instructing reforms in databases. International Journal of Scientific \& Engineering Research , 6 (8), 64–72.
• Regueras, L. M., Verdú, E., Verdú, M. J., Pérez, M. A., & De Castro, J. P. (2007). E-learning strategies to support databases courses: a case study. First International Conference on Technology, Training and Communication .
• Robbert MA, Ricardo CM. Trends in the evolution of the database curriculum. ACM SIGCSE Bulletin. 2003; 35 (3):139–143. [ Google Scholar ]
• Sahami, M., Guzdial, M., McGettrick, A., & Roach, S. (2011). Setting the stage for computing curricula 2013: computer science--report from the ACM/IEEE-CS joint task force. Proceedings of the 42nd ACM Technical Symposium on Computer Science Education , 161–162.
• Sciore E. SimpleDB: A simple java-based multiuser syst for teaching database internals. ACM SIGCSE Bulletin. 2007; 39 (1):561–565. [ Google Scholar ]
• Shebaro B. Using active learning strategies in teaching introductory database courses. Journal of Computing Sciences in Colleges. 2018; 33 (4):28–36. [ Google Scholar ]
• Sibia, N., & Liut, M. (2022, June). The Positive Effects of using Reflective Prompts in a Database Course. In 1st International Workshop on Data Systems Education (pp. 32–37).
• Silva, Y. N., Almeida, I., & Queiroz, M. (2016). SQL: From traditional databases to big data. Proceedings of the 47th ACM Technical Symposium on Computing Science Education , 413–418.
• Sobel, A. E. K. (2003). Computing Curricula--Software Engineering Volume. Proc. of the Final Draft of the Software Engineering Education Knowledge (SEEK) .
• Suryn, W., Abran, A., & April, A. (2003). ISO/IEC SQuaRE: The second generation of standards for software product quality .
• Svahnberg, M., Aurum, A., & Wohlin, C. (2008). Using students as subjects-an empirical evaluation. Proceedings of the Second ACM-IEEE International Symposium on Empirical Software Engineering and Measurement , 288–290.
• Swebok evolution: IEEE Computer Society. (n.d.). In IEEE Computer Society SWEBOK Evolution Comments . Retrieved March 24, 2021 https://www.computer.org/volunteering/boards-and-committees/professional-educational-activities/software-engineering-committee/swebok-evolution
• Taipalus T, Seppänen V. SQL education: A systematic mapping study and future research agenda. ACM Transactions on Computing Education (TOCE) 2020; 20 (3):1–33. [ Google Scholar ]
• Taipalus T, Siponen M, Vartiainen T. Errors and complications in SQL query formulation. ACM Transactions on Computing Education (TOCE) 2018; 18 (3):1–29. [ Google Scholar ]
• Taipalus, T., & Perälä, P. (2019). What to expect and what to focus on in SQL query teaching. Proceedings of the 50th ACM Technical Symposium on Computer Science Education , 198–203.
• Tehseen R, Farooq MS, Abid A. Earthquake prediction using expert systems: A systematic mapping study. Sustainability. 2020; 12 (6):2420. [ Google Scholar ]
• Urban, S. D., & Dietrich, S. W. (2001). Advanced database concepts for undergraduates: experience with teaching a second course. Proceedings of the Thirty-Second SIGCSE Technical Symposium on Computer Science Education , 357–361.
• Urban SD, Dietrich SW. Integrating the practical use of a database product into a theoretical curriculum. ACM SIGCSE Bulletin. 1997; 29 (1):121–125. [ Google Scholar ]
• Wang, J., & Chen, H. (2014). Research and practice on the teaching reform of database course. International Conference on Education Reform and Modern Management, ERMM .
• Wang, J. Z., Davis, T. A., Westall, J. M., & Srimani, P. K. (2010). Undergraduate database instruction with MeTube. Proceedings of the Fifteenth Annual Conference on Innovation and Technology in Computer Science Education , 279–283.
• Yau, G., & Karim, S. W. (2003). Smart classroom: Enhancing collaborative learning using pervasive computing technology. II American Society… .
• Yue K-B. Using a semi-realistic database to support a database course. Journal of Information Systems Education. 2013; 24 (4):327. [ Google Scholar ]
• Yuelan L, Yiwei L, Yuyan H, Yuefan L. Study on teaching methods of database application courses. Procedia Engineering. 2011; 15 :5425–5428. [ Google Scholar ]
• Zhang, X., Wang, X., Liu, Z., Xue, W., & ZHU, X. (2018). The Exploration and Practice on the Classroom Teaching Reform of the Database Technologies Course in colleges. 2018 3rd International Conference on Modern Management, Education Technology, and Social Science (MMETSS 2018) , 320–323.
• Zhanquan W, Zeping Y, Chunhua G, Fazhi Z, Weibin G. Research of database curriculum construction under the environment of massive open online courses. International Journal of Educational and Pedagogical Sciences. 2016; 10 (12):3873–3877. [ Google Scholar ]
• Zheng, Y., & Dong, J. (2011). Teaching reform and practice of database principles. 2011 6th International Conference on Computer Science \& Education (ICCSE) , 1460–1462.

21 Legit Research Databases for Free Journal Articles in 2024

#scribendiinc

Written by  Scribendi

Has this ever happened to you? While looking for websites for research, you come across a research paper site that claims to connect academics to a peer-reviewed article database for free.

Intrigued, you search for keywords related to your topic, only to discover that you must pay a hefty subscription fee to access the service. After the umpteenth time being duped, you begin to wonder if there's even such a thing as free journal articles.

Subscription fees and paywalls are often the bane of students and academics, especially those at small institutions who don't provide access to many free article directories and repositories.

Whether you're working on an undergraduate paper, a PhD dissertation, or a medical research study, we want to help you find tools to locate and access the information you need to produce well-researched, compelling, and innovative work.

Below, we discuss why peer-reviewed articles are superior and list out the best free article databases to use in 2024.

Download Our Free Research Database Roundup PDF

Why peer-reviewed scholarly journal articles are more authoritative.

Determining what sources are reliable can be challenging. Peer-reviewed scholarly journal articles are the gold standard in academic research. Reputable academic journals have a rigorous peer-review process.

The peer review process provides accountability to the academic community, as well as to the content of the article. The peer review process involves qualified experts in a specific (often very specific) field performing a review of an article's methods and findings to determine things like quality and credibility.

Peer-reviewed articles can be found in peer-reviewed article databases and research databases, and if you know that a database of journals is reliable, that can offer reassurances about the reliability of a free article. Peer review is often double blind, meaning that the author removes all identifying information and, likewise, does not know the identity of the reviewers. This helps reviewers maintain objectivity and impartiality so as to judge an article based on its merit.

Where to Find Peer-Reviewed Articles

Peer-reviewed articles can be found in a variety of research databases. Below is a list of some of the major databases you can use to find peer-reviewed articles and other sources in disciplines spanning the humanities, sciences, and social sciences.

What Are Open Access Journals?

An open access (OA) journal is a journal whose content can be accessed without payment. This provides scholars, students, and researchers with free journal articles. OA journals use alternate methods of funding to cover publication costs so that articles can be published without having to pass those publication costs on to the reader.

Some of these funding models include standard funding methods like advertising, public funding, and author payment models, where the author pays a fee in order to publish in the journal. There are OA journals that have non-peer-reviewed academic content, as well as journals that focus on dissertations, theses, and papers from conferences, but the main focus of OA is peer-reviewed scholarly journal articles.

The internet has certainly made it easier to access research articles and other scholarly publications without needing access to a university library, and OA takes another step in that direction by removing financial barriers to academic content.

Choosing Wisely

Features of legitimate oa journals.

 There are things to look out for when trying to decide if a free publication journal is legitimate:

Mission statement —The mission statement for an OA journal should be available on their website.

Publication history —Is the journal well established? How long has it been available?

Editorial board —Who are the members of the editorial board, and what are their credentials?

Indexing —Can the journal be found in a reliable database?

Peer review —What is the peer review process? Does the journal allow enough time in the process for a reliable assessment of quality?

Impact factor —What is the average number of times the journal is cited over a two-year period?

Features of Illegitimate OA Journals

There are predatory publications that take advantage of the OA format, and they are something to be wary of. Here are some things to look out for:

Contact information —Is contact information provided? Can it be verified?

Turnaround —If the journal makes dubious claims about the amount of time from submission to publication, it is likely unreliable.

Editorial board —Much like determining legitimacy, looking at the editorial board and their credentials can help determine illegitimacy.

Indexing —Can the journal be found in any scholarly databases?

Peer review —Is there a statement about the peer review process? Does it fit what you know about peer review?

How to Find Scholarly Articles

Identify keywords.

Keywords are included in an article by the author. Keywords are an excellent way to find content relevant to your research topic or area of interest. In academic searches, much like you would on a search engine, you can use keywords to navigate through what is available to find exactly what you're looking for.

Authors provide keywords that will help you easily find their article when researching a related topic, often including general terms to accommodate broader searches, as well as some more specific terms for those with a narrower scope. Keywords can be used individually or in combination to refine your scholarly article search.

Narrow Down Results

Sometimes, search results can be overwhelming, and searching for free articles on a journal database is no exception, but there are multiple ways to narrow down your results. A good place to start is discipline.

What category does your topic fall into (psychology, architecture, machine learning, etc.)? You can also narrow down your search with a year range if you're looking for articles that are more recent.

A Boolean search can be incredibly helpful. This entails including terms like AND between two keywords in your search if you need both keywords to be in your results (or, if you are looking to exclude certain keywords, to exclude these words from the results).

Consider Different Avenues

If you're not having luck using keywords in your search for free articles, you may still be able to find what you're looking for by changing your tactics. Casting a wider net sometimes yields positive results, so it may be helpful to try searching by subject if keywords aren't getting you anywhere.

You can search for a specific publisher to see if they have OA publications in the academic journal database. And, if you know more precisely what you're looking for, you can search for the title of the article or the author's name.

Determining the Credibility of Scholarly Sources

Ensuring that sources are both credible and reliable is crucial to academic research. Use these strategies to help evaluate the usefulness of scholarly sources:

• Peer Review : Look for articles that have undergone a rigorous peer-review process. Peer-reviewed articles are typically vetted by experts in the field, ensuring the accuracy of the research findings.

Tip: To determine whether an article has undergone rigorous peer review, review the journal's editorial policies, which are often available on the journal's website. Look for information about the peer-review process, including the criteria for selecting reviewers, the process for handling conflicts of interest, and any transparency measures in place.

• Publisher Reputation : Consider the reputation of the publisher. Established publishers, such as well-known academic journals, are more likely to adhere to high editorial standards and publishing ethics.
• Author Credentials : Evaluate the credentials and expertise of the authors. Check their affiliations, academic credentials, and past publications to assess their authority in the field.
• Citations and References : Examine the citations and references provided in the article. A well-researched article will cite credible sources to support its arguments and findings. Verify the accuracy of the cited sources and ensure they are from reputable sources.
• Publication Date : Consider the publication date of the article. While older articles may still be relevant, particularly in certain fields, it is best to prioritize recent publications for up-to-date research and findings.
• Journal Impact Factor : Assess the journal's impact factor or other metrics that indicate its influence and reputation within the academic community. Higher impact factor journals are generally considered more prestigious and reliable. 

Tip: Journal Citation Reports (JCR), produced by Clarivate Analytics, is a widely used source for impact factor data. You can access JCR through academic libraries or directly from the Clarivate Analytics website if you have a subscription.

• Peer Recommendations : Seek recommendations from peers, mentors, or professors in your field. They can provide valuable insights and guidance on reputable sources and journals within your area of study.
• Cross-Verification : Cross-verify the information presented in the article with other credible sources. Compare findings, methodologies, and conclusions with similar studies to ensure consistency and reliability.

By employing these strategies, researchers can confidently evaluate the credibility and reliability of scholarly sources, ensuring the integrity of their research contributions in an ever-evolving landscape.

The Top 21 Free Online Journal and Research Databases

Navigating OA journals, research article databases, and academic websites trying to find high-quality sources for your research can really make your head spin. What constitutes a reliable database? What is a useful resource for your discipline and research topic? How can you find and access full-text, peer-reviewed articles?

Fortunately, we're here to help. Having covered some of the ins and outs of peer review, OA journals, and how to search for articles, we have compiled a list of the top 21 free online journals and the best research databases. This list of databases is a great resource to help you navigate the wide world of academic research.

These databases provide a variety of free sources, from abstracts and citations to full-text, peer-reviewed OA journals. With databases covering specific areas of research and interdisciplinary databases that provide a variety of material, these are some of our favorite free databases, and they're totally legit!

CORE is a multidisciplinary aggregator of OA research. CORE has the largest collection of OA articles available. It allows users to search more than 219 million OA articles. While most of these link to the full-text article on the original publisher's site, or to a PDF available for download, five million records are hosted directly on CORE.

CORE's mission statement is a simple and straightforward commitment to offering OA articles to anyone, anywhere in the world. They also host communities that are available for researchers to join and an ambassador community to enhance their services globally. In addition to a straightforward keyword search, CORE offers advanced search options to filter results by publication type, year, language, journal, repository, and author.

CORE's user interface is easy to use and navigate. Search results can be sorted based on relevance or recency, and you can search for relevant content directly from the results screen.

Collection : 219,537,133 OA articles

Other Services : Additional services are available from CORE, with extras that are geared toward researchers, repositories, and businesses. There are tools for accessing raw data, including an API that provides direct access to data, datasets that are available for download, and FastSync for syncing data content from the CORE database.

CORE has a recommender plug-in that suggests relevant OA content in the database while conducting a search and a discovery feature that helps you discover OA versions of paywalled articles. Other features include tools for managing content, such as a dashboard for managing repository output and the Repository Edition service to enhance discoverability.

Good Source of Peer-Reviewed Articles : Yes

Advanced Search Options : Language, author, journal, publisher, repository, DOI, year

2. ScienceOpen

Functioning as a research and publishing network, ScienceOpen offers OA to more than 74 million articles in all areas of science. Although you do need to register to view the full text of articles, registration is free. The advanced search function is highly detailed, allowing you to find exactly the research you're looking for.

The Berlin- and Boston-based company was founded in 2013 to "facilitate open and public communications between academics and to allow ideas to be judged on their merit, regardless of where they come from." Search results can be exported for easy integration with reference management systems.

You can also bookmark articles for later research. There are extensive networking options, including your Science Open profile, a forum for interacting with other researchers, the ability to track your usage and citations, and an interactive bibliography. Users have the ability to review articles and provide their knowledge and insight within the community.

Collection : 74,560,631

Other Services : None

Advanced Search Options :   Content type, source, author, journal, discipline

3. Directory of Open Access Journals

A multidisciplinary, community-curated directory, the Directory of Open Access Journals (DOAJ) gives researchers access to high-quality peer-reviewed journals. It has archived more than two million articles from 17,193 journals, allowing you to either browse by subject or search by keyword.

The site was launched in 2003 with the aim of increasing the visibility of OA scholarly journals online. Content on the site covers subjects from science, to law, to fine arts, and everything in between. DOAJ has a commitment to "increase the visibility, accessibility, reputation, usage and impact of quality, peer-reviewed, OA scholarly research journals globally, regardless of discipline, geography or language."

Information about the journal is available with each search result. Abstracts are also available in a collapsible format directly from the search screen. The scholarly article website is somewhat simple, but it is easy to navigate. There are 16 principles of transparency and best practices in scholarly publishing that clearly outline DOAJ policies and standards.

Collection : 6,817,242

Advanced Search Options :   Subject, journal, year

4. Education Resources Information Center

The Education Resources Information Center (ERIC) of the Institution of Education Sciences allows you to search by topic for material related to the field of education. Links lead to other sites, where you may have to purchase the information, but you can search for full-text articles only. You can also search only peer-reviewed sources.

The service primarily indexes journals, gray literature (such as technical reports, white papers, and government documents), and books. All sources of material on ERIC go through a formal review process prior to being indexed. ERIC's selection policy is available as a PDF on their website.

The ERIC website has an extensive FAQ section to address user questions. This includes categories like general questions, peer review, and ERIC content. There are also tips for advanced searches, as well as general guidance on the best way to search the database. ERIC is an excellent database for content specific to education.

Collection : 1,292,897

Advanced Search Options : Boolean

5. arXiv e-Print Archive

The arXiv e-Print Archive is run by Cornell University Library and curated by volunteer moderators, and it now offers OA to more than one million e-prints.

There are advisory committees for all eight subjects available on the database. With a stated commitment to an "emphasis on openness, collaboration, and scholarship," the arXiv e-Print Archive is an excellent STEM resource.

The interface is not as user-friendly as some of the other databases available, and the website hosts a blog to provide news and updates, but it is otherwise a straightforward math and science resource. There are simple and advanced search options, and, in addition to conducting searches for specific topics and articles, users can browse content by subject. The arXiv e-Print Archive clearly states that they do not peer review the e-prints in the database.

Collection : 1,983,891

Good Source of Peer-Reviewed Articles : No

Advanced Search Options :   Subject, date, title, author, abstract, DOI

6. Social Science Research Network

The Social Science Research Network (SSRN) is a collection of papers from the social sciences community. It is a highly interdisciplinary platform used to search for scholarly articles related to 67 social science topics. SSRN has a variety of research networks for the various topics available through the free scholarly database.

The site offers more than 700,000 abstracts and more than 600,000 full-text papers. There is not yet a specific option to search for only full-text articles, but, because most of the papers on the site are free access, it's not often that you encounter a paywall. There is currently no option to search for only peer-reviewed articles.

You must become a member to use the services, but registration is free and enables you to interact with other scholars around the world. SSRN is "passionately committed to increasing inclusion, diversity and equity in scholarly research," and they encourage and discuss the use of inclusive language in scholarship whenever possible.

Collection : 1,058,739 abstracts; 915,452 articles

Advanced Search Options : Term, author, date, network

7. Public Library of Science

Public Library of Science (PLOS) is a big player in the world of OA science. Publishing 12 OA journals, the nonprofit organization is committed to facilitating openness in academic research. According to the site, "all PLOS content is at the highest possible level of OA, meaning that scientific articles are immediately and freely available to anyone, anywhere."

PLOS outlines four fundamental goals that guide the organization: break boundaries, empower researchers, redefine quality, and open science. All PLOS journals are peer-reviewed, and all 12 journals uphold rigorous ethical standards for research, publication, and scientific reporting.

PLOS does not offer advanced search options. Content is organized by topic into research communities that users can browse through, in addition to options to search for both articles and journals. The PLOS website also has resources for peer reviewers, including guidance on becoming a reviewer and on how to best participate in the peer review process.

Collection : 12 journals

Advanced Search Options : None

8. OpenDOAR

OpenDOAR, or the Directory of Open Access Repositories, is a comprehensive resource for finding free OA journals and articles. Using Google Custom Search, OpenDOAR combs through OA repositories around the world and returns relevant research in all disciplines.

The repositories it searches through are assessed and categorized by OpenDOAR staff to ensure they meet quality standards. Inclusion criteria for the database include requirements for OA content, global access, and categorically appropriate content, in addition to various other quality assurance measures. OpenDOAR has metadata, data, content, preservation, and submission policies for repositories, in addition to two OA policy statements regarding minimum and optimum recommendations.

This database allows users to browse and search repositories, which can then be selected, and articles and data can be accessed from the repository directly. As a repository database, much of the content on the site is geared toward the support of repositories and OA standards.

Collection : 5,768 repositories

Other Services : OpenDOAR offers a variety of additional services. Given the nature of the platform, services are primarily aimed at repositories and institutions, and there is a marked focus on OA in general. Sherpa services are OA archiving tools for authors and institutions.

They also offer various resources for OA support and compliance regarding standards and policies. The publication router matches publications and publishers with appropriate repositories.

There are also services and resources from JISC for repositories for cost management, discoverability, research impact, and interoperability, including ORCID consortium membership information. Additionally, a repository self-assessment tool is available for members.

Advanced Search Options :   Name, organization name, repository type, software name, content type, subject, country, region

9. Bielefeld Academic Search Engine

The Bielefeld Academic Search Engine (BASE) is operated by the Bielefeld University Library in Germany, and it offers more than 240 million documents from more than 8,000 sources. Sixty percent of its content is OA, and you can filter your search accordingly.

BASE has rigorous inclusion requirements for content providers regarding quality and relevance, and they maintain a list of content providers for the sake of transparency, which can be easily found on their website. BASE has a fairly elegant interface. Search results can be organized by author, title, or date.

From the search results, items can be selected and exported, added to favorites, emailed, and searched in Google Scholar. There are basic and advanced search features, with the advanced search offering numerous options for refining search criteria. There is also a feature on the website that saves recent searches without additional steps from the user.

Collection : 276,019,066 documents; 9,286 content providers

Advanced Search Options :   Author, subject, year, content provider, language, document type, access, terms of reuse

10. Digital Library of the Commons Repository

Run by Indiana University, the Digital Library of the Commons (DLC) Repository is a multidisciplinary journal repository that allows users to access thousands of free and OA articles from around the world. You can browse by document type, date, author, title, and more or search for keywords relevant to your topic.

DCL also offers the Comprehensive Bibliography of the Commons, an image database, and a keyword thesaurus for enhanced search parameters. The repository includes books, book chapters, conference papers, journal articles, surveys, theses and dissertations, and working papers. DCL advanced search features drop-down menus of search types with built-in Boolean search options.

Searches can be sorted by relevance, title, date, or submission date in ascending or descending order. Abstracts are included in selected search results, with access to full texts available, and citations can be exported from the same page. Additionally, the image database search includes tips for better search results.

Collection : 10,784

Advanced Search Options :   Author, date, title, subject, sector, region, conference

11. CIA World Factbook

The CIA World Factbook is a little different from the other resources on this list in that it is not an online journal directory or repository. It is, however, a useful free online research database for academics in a variety of disciplines.

All the information is free to access, and it provides facts about every country in the world, which are organized by category and include information about history, geography, transportation, and much more. The World Factbook can be searched by country or region, and there is also information about the world's oceans.

This site contains resources related to the CIA as an organization rather than being a scientific journal database specifically. The site has a user interface that is easy to navigate. The site also provides a section for updates regarding changes to what information is available and how it is organized, making it easier to interact with the information you are searching for.

Collection : 266 countries

12. Paperity

Paperity boasts its status as the "first multidisciplinary aggregator of OA journals and papers." Their focus is on helping you avoid paywalls while connecting you to authoritative research. In addition to providing readers with easy access to thousands of journals, Paperity seeks to help authors reach their audiences and help journals increase their exposure to boost readership.

Paperity has journal articles for every discipline, and the database offers more than a dozen advanced search options, including the length of the paper and the number of authors. There is even an option to include, exclude, or exclusively search gray papers.

Paperity is available for mobile, with both a mobile site and the Paperity Reader, an app that is available for both Android and Apple users. The database is also available on social media. You can interact with Paperity via Twitter and Facebook, and links to their social media are available on their homepage, including their Twitter feed.

Collection : 8,837,396

Advanced Search Options : Title, abstract, journal title, journal ISSN, publisher, year of publication, number of characters, number of authors, DOI, author, affiliation, language, country, region, continent, gray papers

13. dblp Computer Science Bibliography

The dblp Computer Science Bibliography is an online index of major computer science publications. dblp was founded in 1993, though until 2010 it was a university-specific database at the University of Trier in Germany. It is currently maintained by the Schloss Dagstuhl – Leibniz Center for Informatics.

Although it provides access to both OA articles and those behind a paywall, you can limit your search to only OA articles. The site indexes more than three million publications, making it an invaluable resource in the world of computer science. dblp entries are color-coded based on the type of item.

dblp has an extensive FAQ section, so questions that might arise about topics like the database itself, navigating the website, or the data on dblp, in addition to several other topics, are likely to be answered. The website also hosts a blog and has a section devoted to website statistics.

Collection : 5,884,702

14. EconBiz

EconBiz is a great resource for economic and business studies. A service of the Leibniz Information Centre for Economics, it offers access to full texts online, with the option of searching for OA material only. Their literature search is performed across multiple international databases.

EconBiz has an incredibly useful research skills section, with resources such as Guided Walk, a service to help students and researchers navigate searches, evaluate sources, and correctly cite references; the Research Guide EconDesk, a help desk to answer specific questions and provide advice to aid in literature searches; and the Academic Career Kit for what they refer to as Early Career Researchers.

Other helpful resources include personal literature lists, a calendar of events for relevant calls for papers, conferences, and workshops, and an economics terminology thesaurus to help in finding keywords for searches. To stay up-to-date with EconBiz, you can sign up for their newsletter.

Collection : 1,075,219

Advanced Search Options :   Title, subject, author, institution, ISBN/ISSN, journal, publisher, language, OA only

15. BioMed Central

BioMed Central provides OA research from more than 300 peer-reviewed journals. While originally focused on resources related to the physical sciences, math, and engineering, BioMed Central has branched out to include journals that cover a broader range of disciplines, with the aim of providing a single platform that provides OA articles for a variety of research needs. You can browse these journals by subject or title, or you can search all articles for your required keyword.

BioMed Central has a commitment to peer-reviewed sources and to the peer review process itself, continually seeking to help and improve the peer review process. They're "committed to maintaining high standards through full and stringent peer review."

Additionally, the website includes resources to assist and support editors as part of their commitment to providing high-quality, peer-reviewed OA articles.

Collection : 507,212

Other Services : BMC administers the International Standard Randomised Controlled Trial Number (ISRCTN) registry. While initially designed for registering clinical trials, since its creation in 2000, the registry has broadened its scope to include other health studies as well.

The registry is recognized by the International Committee of Medical Journal Editors, as well as the World Health Organization (WHO), and it meets the requirements established by the WHO International Clinical Trials Registry Platform.

The study records included in the registry are all searchable and free to access. The ISRCTN registry "supports transparency in clinical research, helps reduce selective reporting of results and ensures an unbiased and complete evidence base."

Advanced Search Options :   Author, title, journal, list

A multidisciplinary search engine, JURN provides links to various scholarly websites, articles, and journals that are free to access or OA. Covering the fields of the arts, humanities, business, law, nature, science, and medicine, JURN has indexed almost 5,000 repositories to help you find exactly what you're looking for.

Search features are enhanced by Google, but searches are filtered through their index of repositories. JURN seeks to reach a wide audience, with their search engine tailored to researchers from "university lecturers and students seeking a strong search tool for OA content" and "advanced and ambitious students, age 14-18" to "amateur historians and biographers" and "unemployed and retired lecturers."

That being said, JURN is very upfront about its limitations. They admit to not being a good resource for educational studies, social studies, or psychology, and conference archives are generally not included due to frequently unstable URLs.

Collection : 5,064 indexed journals

Other Services : JURN has a browser add-on called UserScript. This add-on allows users to integrate the JURN database directly into Google Search. When performing a search through Google, the add-on creates a link that sends the search directly to JURN CSE. JURN CSE is a search service that is hosted by Google.

Clicking the link from the Google Search bar will run your search through the JURN database from the Google homepage. There is also an interface for a DuckDuckGo search box; while this search engine has an emphasis on user privacy, for smaller sites that may be indexed by JURN, DuckDuckGo may not provide the same depth of results.

Advanced Search Options :   Google search modifiers

Dryad is a digital repository of curated, OA scientific research data. Launched in 2009, it is run by a not-for-profit membership organization, with a community of institutional and publisher members for whom their services have been designed. Members include institutions such as Stanford, UCLA, and Yale, as well as publishers like Oxford University Press and Wiley.

Dryad aims to "promote a world where research data is openly available, integrated with the scholarly literature, and routinely reused to create knowledge." It is free to access for the search and discovery of data. Their user experience is geared toward easy self-depositing, supports Creative Commons licensing, and provides DOIs for all their content.

Note that there is a publishing charge associated if you wish to publish your data in Dryad.  When searching datasets, they are accompanied by author information and abstracts for the associated studies, and citation information is provided for easy attribution.

Collection : 44,458

Advanced Search Options : No

Run by the British Library, the E-Theses Online Service (EThOS) allows you to search over 500,000 doctoral theses in a variety of disciplines. All of the doctoral theses available on EThOS have been awarded by higher education institutions in the United Kingdom.

Although some full texts are behind paywalls, you can limit your search to items available for immediate download, either directly through EThOS or through an institution's website. More than half of the records in the database provide access to full-text theses.

EThOS notes that they do not hold all records for all institutions, but they strive to index as many doctoral theses as possible, and the database is constantly expanding, with approximately 3,000 new records added and 2,000 new full-text theses available every month. The availability of full-text theses is dependent on multiple factors, including their availability in the institutional repository and the level of repository development.

Collection : 500,000+

Advanced Search Options : Abstract, author's first name, author's last name, awarding body, current institution, EThOS ID, year, language, qualifications, research supervisor, sponsor/funder, keyword, title

PubMed is a research platform well-known in the fields of science and medicine. It was created and developed by the National Center for Biotechnology Information (NCBI) at the National Library of Medicine (NLM). It has been available since 1996 and offers access to "more than 33 million citations for biomedical literature from MEDLINE, life science journals, and online books."

While PubMed does not provide full-text articles directly, and many full-text articles may be behind paywalls or require subscriptions to access them, when articles are available from free sources, such as through PubMed Central (PMC), those links are provided with the citations and abstracts that PubMed does provide.

PMC, which was established in 2000 by the NLM, is a free full-text archive that includes more than 6,000,000 records. PubMed records link directly to corresponding PMC results. PMC content is provided by publishers and other content owners, digitization projects, and authors directly.

Collection : 33,000,000+

Advanced Search Options : Author's first name, author's last name, identifier, corporation, date completed, date created, date entered, date modified, date published, MeSH, book, conflict of interest statement, EC/RN number, editor, filter, grant number, page number, pharmacological action, volume, publication type, publisher, secondary source ID, text, title, abstract, transliterated title

20. Semantic Scholar

A unique and easy-to-use resource, Semantic Scholar defines itself not just as a research database but also as a "search and discovery tool." Semantic Scholar harnesses the power of artificial intelligence to efficiently sort through millions of science-related papers based on your search terms.

Through this singular application of machine learning, Semantic Scholar expands search results to include topic overviews based on your search terms, with the option to create an alert for or further explore the topic. It also provides links to related topics.

In addition, search results produce "TLDR" summaries in order to provide concise overviews of articles and enhance your research by helping you to navigate quickly and easily through the available literature to find the most relevant information. According to the site, although some articles are behind paywalls, "the data [they] have for those articles is limited," so you can expect to receive mostly full-text results.

Collection : 203,379,033

Other Services : Semantic Scholar supports multiple popular browsers. Content can be accessed through both mobile and desktop versions of Firefox, Microsoft Edge, Google Chrome, Apple Safari, and Opera.

Additionally, Semantic Scholar provides browser extensions for both Chrome and Firefox, so AI-powered scholarly search results are never more than a click away. The mobile interface includes an option for Semantic Swipe, a new way of interacting with your research results.

There are also beta features that can be accessed as part of the Beta Program, which will provide you with features that are being actively developed and require user feedback for further improvement.

Advanced Search Options : Field of study, date range, publication type, author, journal, conference, PDF

Zenodo, powered by the European Organization for Nuclear Research (CERN), was launched in 2013. Taking its name from Zenodotus, the first librarian of the ancient library of Alexandria, Zenodo is a tool "built and developed by researchers, to ensure that everyone can join in open science." Zenodo accepts all research from every discipline in any file format.

However, Zenodo also curates uploads and promotes peer-reviewed material that is available through OA. A DOI is assigned to everything that is uploaded to Zenodo, making research easily findable and citable. You can sort by keyword, title, journal, and more and download OA documents directly from the site.

While there are closed access and restricted access items in the database, the vast majority of research is OA material. Search results can be filtered by access type, making it easy to view the free articles available in the database.

Collection : 2,220,000+

Advanced Search Options : Access, file type, keywords

Check out our roundup of free research databases as a handy one-page PDF.

How to find peer-reviewed articles.

There are a lot of free scholarly articles available from various sources. The internet is a big place. So how do you go about finding peer-reviewed articles when conducting your research? It's important to make sure you are using reputable sources.

The first source of the article is the person or people who wrote it. Checking out the author can give you some initial insight into how much you can trust what you’re reading. Looking into the publication information of your sources can also indicate whether the article is reliable.

Aspects of the article, such as subject and audience, tone, and format, are other things you can look at when evaluating whether the article you're using is valid, reputable, peer-reviewed material. So, let's break that down into various components so you can assess your research to ensure that you're using quality articles and conducting solid research.

Check the Author

Peer-reviewed articles are written by experts or scholars with experience in the field or discipline they're writing about. The research in a peer-reviewed article has to pass a rigorous evaluation process, so it's a foregone conclusion that the author(s) of a peer-reviewed article should have experience or training related to that research.

When evaluating an article, take a look at the author's information. What credentials does the author have to indicate that their research has scholarly weight behind it? Finding out what type of degree the author has—and what that degree is in—can provide insight into what kind of authority the author is on the subject.

Something else that might lend credence to the author's scholarly role is their professional affiliation. A look at what organization or institution they are affiliated with can tell you a lot about their experience or expertise. Where were they trained, and who is verifying their research?

Identify Subject and Audience

The ultimate goal of a study is to answer a question. Scholarly articles are also written for scholarly audiences, especially articles that have gone through the peer review process. This means that the author is trying to reach experts, researchers, academics, and students in the field or topic the research is based on.

Think about the question the author is trying to answer by conducting this research, why, and for whom. What is the subject of the article? What question has it set out to answer? What is the purpose of finding the information? Is the purpose of the article of importance to other scholars? Is it original content?

Research should also be approached analytically. Is the methodology sound? Is the author using an analytical approach to evaluate the data that they have obtained? Are the conclusions they've reached substantiated by their data and analysis? Answering these questions can reveal a lot about the article's validity.

Format Matters

Reliable articles from peer-reviewed sources have certain format elements to be aware of. The first is an abstract. An abstract is a short summary or overview of the article. Does the article have an abstract? It's unlikely that you're reading a peer-reviewed article if it doesn't. Peer-reviewed journals will also have a word count range. If an article seems far too short or incredibly long, that may be reason to doubt it.

Another feature of reliable articles is the sections the information is divided into. Peer-reviewed research articles will have clear, concise sections that appropriately organize the information. This might include a literature review, methodology, results (in the case of research articles), and a conclusion.

One of the most important sections is the references or bibliography. This is where the researcher lists all the sources of their information. A peer-reviewed source will have a comprehensive reference section.

An article that has been written to reach an academic community will have an academic tone. The language that is used, and the way this language is used, is important to consider. If the article is riddled with grammatical errors, confusing syntax, and casual language, it almost definitely didn't make it through the peer review process.

Also consider the use of terminology. Every discipline is going to have standard terminology or jargon that can be used and understood by other academics in the discipline. The language in a peer-reviewed article is going to reflect that.

If the author is going out of their way to explain simple terms, or terms that are standard to the field or discipline, it's unlikely that the article has been peer reviewed, as this is something that the author would be asked to address during the review process.

Publication

The source of the article will be a very good indicator of the likelihood that it was peer reviewed. Where was the article published? Was it published alongside other academic articles in the same discipline? Is it a legitimate and reputable scholarly publication?

A trade publication or newspaper might be legitimate or reputable, but it is not a scholarly source, and it will not have been subject to the peer review process. Scholarly journals are the best resource for peer-reviewed articles, but it's important to remember that not all scholarly journals are peer reviewed.

It's helpful to look at a scholarly source's website, as peer-reviewed journals will have a clear indication of the peer review process. University libraries, institutional repositories, and reliable databases (and now you have a list of legit ones) can also help provide insight into whether an article comes from a peer-reviewed journal.

Common Research Mistakes to Avoid

Research is a lot of work. Even with high standards and good intentions, it's easy to make mistakes. Perhaps you searched for access to scientific journals for free and found the perfect peer-reviewed sources, but you forgot to document everything, and your references are a mess. Or, you only searched for free online articles and missed out on a ground-breaking study that was behind a paywall.

Whether your research is for a degree or to get published or to satisfy your own inquisitive nature, or all of the above, you want all that work to produce quality results. You want your research to be thorough and accurate.

To have any hope of contributing to the literature on your research topic, your results need to be high quality. You might not be able to avoid every potential mistake, but here are some that are both common and easy to avoid.

Sticking to One Source

One of the hallmarks of good research is a healthy reference section. Using a variety of sources gives you a better answer to your question. Even if all of the literature is in agreement, looking at various aspects of the topic may provide you with an entirely different picture than you would have if you looked at your research question from only one angle.

Not Documenting Every Fact

As you conduct your research, do yourself a favor and write everything down. Everything you include in your paper or article that you got from another source is going to need to be added to your references and cited.

It's important, especially if your aim is to conduct ethical, high-quality research, that all of your research has proper attribution. If you don't document as you go, you could end up making a lot of work for yourself if the information you don't write down is something that later, as you write your paper, you really need.

Using Outdated Materials

Academia is an ever-changing landscape. What was true in your academic discipline or area of research ten years ago may have since been disproven. If fifteen studies have come out since the article that you're using was published, it's more than a little likely that you're going to be basing your research on flawed or dated information.

If the information you're basing your research on isn't as up-to-date as possible, your research won't be of quality or able to stand up to any amount of scrutiny. You don't want all of your hard work to be for naught.

Relying Solely on Open Access Journals

OA is a great resource for conducting academic research. There are high-quality journal articles available through OA, and that can be very helpful for your research. But, just because you have access to free articles, that doesn't mean that there's nothing to be found behind a paywall.

Just as dismissing high-quality peer-reviewed articles because they are OA would be limiting, not exploring any paid content at all is equally short-sighted. If you're seeking to conduct thorough and comprehensive research, exploring all of your options for quality sources is going to be to your benefit.

Digging Too Deep or Not Deep Enough

Research is an art form, and it involves a delicate balance of information. If you conduct your research using only broad search terms, you won't be able to answer your research question well, or you'll find that your research provides information that is closely related to your topic but, ultimately, your findings are vague and unsubstantiated.

On the other hand, if you delve deeply into your research topic with specific searches and turn up too many sources, you might have a lot of information that is adjacent to your topic but without focus and perhaps not entirely relevant. It's important to answer your research question concisely but thoroughly.

Different Types of Scholarly Articles

Different types of scholarly articles have different purposes. An original research article, also called an empirical article, is the product of a study or an experiment. This type of article seeks to answer a question or fill a gap in the existing literature.

Research articles will have a methodology, results, and a discussion of the findings of the experiment or research and typically a conclusion.

Review articles overview the current literature and research and provide a summary of what the existing research indicates or has concluded. This type of study will have a section for the literature review, as well as a discussion of the findings of that review. Review articles will have a particularly extensive reference or bibliography section.

Theoretical articles draw on existing literature to create new theories or conclusions, or look at current theories from a different perspective, to contribute to the foundational knowledge of the field of study.

10 Tips for Navigating Journal Databases

Use the right academic journal database for your search, be that interdisciplinary or specific to your field. Or both!

If it's an option, set the search results to return only peer-reviewed sources.

Start by using search terms that are relevant to your topic without being overly specific.

Try synonyms, especially if your keywords aren't returning the desired results.

Even if you've found some good articles, try searching using different terms.

Explore the advanced search features of the database(s).

Learn to use Booleans (AND, OR, NOT) to expand or narrow your results.

Once you've gotten some good results from a more general search, try narrowing your search.

Read through abstracts when trying to find articles relevant to your research.

Keep track of your research and use citation tools. It'll make life easier when it comes time to compile your references.

7 Frequently Asked Questions

1. how do i get articles for free.

Free articles can be found through free online academic journals, OA databases, or other databases that include OA journals and articles. These resources allow you to access free papers online so you can conduct your research without getting stuck behind a paywall.

Academics don't receive payment for the articles they contribute to journals. There are often, in fact, publication fees that scholars pay in order to publish. This is one of the funding structures that allows OA journals to provide free content so that you don't have to pay fees or subscription costs to access journal articles.

2. How Do I Find Journal Articles?

Journal articles can be found in databases and institutional repositories that can be accessed at university libraries. However, online research databases that contain OA articles are the best resource for getting free access to journal articles that are available online.

Peer-reviewed journal articles are the best to use for academic research, and there are a number of databases where you can find peer-reviewed OA journal articles. Once you've found a useful article, you can look through the references for the articles the author used to conduct their research, and you can then search online databases for those articles, too.

3. How Do I Find Peer-Reviewed Articles?

Peer-reviewed articles can be found in reputable scholarly peer-reviewed journals. High-quality journals and journal articles can be found online using academic search engines and free research databases. These resources are excellent for finding OA articles, including peer-reviewed articles.

OA articles are articles that can be accessed for free. While some scholarly search engines and databases include articles that aren't peer reviewed, there are also some that provide only peer-reviewed articles, and databases that include non-peer-reviewed articles often have advanced search features that enable you to select "peer review only." The database will return results that are exclusively peer-reviewed content.

4. What Are Research Databases?

A research database is a list of journals, articles, datasets, and/or abstracts that allows you to easily search for scholarly and academic resources and conduct research online. There are databases that are interdisciplinary and cover a variety of topics.

For example, Paperity might be a great resource for a chemist as well as a linguist, and there are databases that are more specific to a certain field. So, while ERIC might be one of the best educational databases available for OA content, it's not going to be one of the best databases for finding research in the field of microbiology.

5. How Do I Find Scholarly Articles for Specific Fields?

There are interdisciplinary research databases that provide articles in a variety of fields, as well as research databases that provide articles that cater to specific disciplines. Additionally, a journal repository or index can be a helpful resource for finding articles in a specific field.

When searching an interdisciplinary database, there are frequently advanced search features that allow you to narrow the search results down so that they are specific to your field. Selecting "psychology" in the advanced search features will return psychology journal articles in your search results. You can also try databases that are specific to your field.

If you're searching for law journal articles, many law reviews are OA. If you don't know of any databases specific to history, visiting a journal repository or index and searching "history academic journals" can return a list of journals specific to history and provide you with a place to begin your research.

6. Are Peer-Reviewed Articles Really More Legitimate?

The short answer is yes, peer-reviewed articles are more legitimate resources for academic research. The peer review process provides legitimacy, as it is a rigorous review of the content of an article that is performed by scholars and academics who are experts in their field of study. The review provides an evaluation of the quality and credibility of the article.

Non-peer-reviewed articles are not subject to a review process and do not undergo the same level of scrutiny. This means that non-peer-reviewed articles are unlikely, or at least not as likely, to meet the same standards that peer-reviewed articles do.

7. Are Free Article Directories Legitimate?

Yes! As with anything, some databases are going to be better for certain requirements than others. But, a scholarly article database being free is not a reason in itself to question its legitimacy.

Free scholarly article databases can provide access to abstracts, scholarly article websites, journal repositories, and high-quality peer-reviewed journal articles. The internet has a lot of information, and it's often challenging to figure out what information is reliable. 

Research databases and article directories are great resources to help you conduct your research. Our list of the best research paper websites is sure to provide you with sources that are totally legit.

Get Professional Academic Editing

Hire an expert academic editor , or get a free sample, about the author.

Scribendi's in-house editors work with writers from all over the globe to perfect their writing. They know that no piece of writing is complete without a professional edit, and they love to see a good piece of writing transformed into a great one. Scribendi's in-house editors are unrivaled in both experience and education, having collectively edited millions of words and obtained numerous degrees. They love consuming caffeinated beverages, reading books of various genres, and relaxing in quiet, dimly lit spaces.

Have You Read?

"The Complete Beginner's Guide to Academic Writing"

Related Posts

How to Write a Research Proposal

How to Write a Scientific Paper

How to Write a Thesis or Dissertation

Upload your file(s) so we can calculate your word count, or enter your word count manually.

We will also recommend a service based on the file(s) you upload.

English is not my first language. I need English editing and proofreading so that I sound like a native speaker.

I need to have my journal article, dissertation, or term paper edited and proofread, or I need help with an admissions essay or proposal.

I have a novel, manuscript, play, or ebook. I need editing, copy editing, proofreading, a critique of my work, or a query package.

I need editing and proofreading for my white papers, reports, manuals, press releases, marketing materials, and other business documents.

I need to have my essay, project, assignment, or term paper edited and proofread.

I want to sound professional and to get hired. I have a resume, letter, email, or personal document that I need to have edited and proofread.

 Prices include your personal % discount.

 Prices include % sales tax ( ).

Articles & Databases

Explore our collection of hundreds of online resources and databases. Use our free online content to help with your research, whether it's finding a single article, tracing a family tree, learning a new language, or anything in between.

Featured Resources

.css-1t84354{transition-property:var(--nypl-transition-property-common);transition-duration:var(--nypl-transition-duration-fast);transition-timing-function:var(--nypl-transition-easing-ease-out);cursor:pointer;-webkit-text-decoration:underline;text-decoration:underline;outline:2px solid transparent;outline-offset:2px;color:var(--nypl-colors-ui-link-primary);text-decoration-style:dotted;text-decoration-thickness:1px;text-underline-offset:2px;}.css-1t84354:hover,.css-1t84354[data-hover]{-webkit-text-decoration:underline;text-decoration:underline;color:var(--nypl-colors-ui-link-secondary);text-decoration-style:dotted;text-decoration-thickness:1px;}.chakra-ui-dark .css-1t84354:hover:not([data-theme]),.chakra-ui-dark .css-1t84354[data-hover]:not([data-theme]),[data-theme=dark] .css-1t84354:hover:not([data-theme]),[data-theme=dark] .css-1t84354[data-hover]:not([data-theme]),.css-1t84354:hover[data-theme=dark],.css-1t84354[data-hover][data-theme=dark]{color:var(--nypl-colors-dark-ui-link-secondary);}.css-1t84354:focus,.css-1t84354[data-focus]{box-shadow:var(--nypl-shadows-outline);}.chakra-ui-dark .css-1t84354:not([data-theme]),[data-theme=dark] .css-1t84354:not([data-theme]),.css-1t84354[data-theme=dark]{color:var(--nypl-colors-dark-ui-link-primary);}.css-1t84354:visited{color:var(--nypl-colors-ui-link-tertiary);}.chakra-ui-dark .css-1t84354:visited:not([data-theme]),[data-theme=dark] .css-1t84354:visited:not([data-theme]),.css-1t84354:visited[data-theme=dark]{color:var(--nypl-colors-dark-ui-link-tertiary);}.css-1t84354 a:hover,.css-1t84354 a[data-hover]{color:var(--nypl-colors-ui-link-secondary);}.css-1t84354 screenreaderOnly{clip:rect(1px, 1px, 1px, 1px);height:1px;overflow:hidden;position:absolute!important;width:1px;word-wrap:normal;} Start Your Research

Not sure where to begin? From primary sources to scholarly articles, start your research with resources chosen by our expert librarians.

Homework Help

Discover the wide range of learning resources the Library has to offer students of all ages, from chemistry and history to English and math.

Newspapers and Magazines

Browse popular contemporary and historic publications including The New York Times , People magazine, and Sports Illustrated among others.

World Languages

Read e-books, newspapers, and more in languages including Spanish, Chinese, Russian, and French.

African American Studies

Explore a variety of academic, historic, and cultural resources curated by the Schomburg Center for Research in Black Culture.

Performing Arts

Find materials about theatre, film, dance, music, and recorded sound selected by The New York Public Library for the Performing Arts.

New York City History

Uncover primary and secondary sources about the five boroughs, including neighborhood data, historic photos, newspaper archives, and more.

Trace ancestry information and family trees through public records, historical documents, and other genealogical archives.

Job Search and Career Development

Whether you’re looking for a new job or changing careers, these resources will help you find training tutorials, resume guides, and more.

Most Popular

.css-1t84354{transition-property:var(--nypl-transition-property-common);transition-duration:var(--nypl-transition-duration-fast);transition-timing-function:var(--nypl-transition-easing-ease-out);cursor:pointer;-webkit-text-decoration:underline;text-decoration:underline;outline:2px solid transparent;outline-offset:2px;color:var(--nypl-colors-ui-link-primary);text-decoration-style:dotted;text-decoration-thickness:1px;text-underline-offset:2px;}.css-1t84354:hover,.css-1t84354[data-hover]{-webkit-text-decoration:underline;text-decoration:underline;color:var(--nypl-colors-ui-link-secondary);text-decoration-style:dotted;text-decoration-thickness:1px;}.chakra-ui-dark .css-1t84354:hover:not([data-theme]),.chakra-ui-dark .css-1t84354[data-hover]:not([data-theme]),[data-theme=dark] .css-1t84354:hover:not([data-theme]),[data-theme=dark] .css-1t84354[data-hover]:not([data-theme]),.css-1t84354:hover[data-theme=dark],.css-1t84354[data-hover][data-theme=dark]{color:var(--nypl-colors-dark-ui-link-secondary);}.css-1t84354:focus,.css-1t84354[data-focus]{box-shadow:var(--nypl-shadows-outline);}.chakra-ui-dark .css-1t84354:not([data-theme]),[data-theme=dark] .css-1t84354:not([data-theme]),.css-1t84354[data-theme=dark]{color:var(--nypl-colors-dark-ui-link-primary);}.css-1t84354:visited{color:var(--nypl-colors-ui-link-tertiary);}.chakra-ui-dark .css-1t84354:visited:not([data-theme]),[data-theme=dark] .css-1t84354:visited:not([data-theme]),.css-1t84354:visited[data-theme=dark]{color:var(--nypl-colors-dark-ui-link-tertiary);}.css-1t84354 a:hover,.css-1t84354 a[data-hover]{color:var(--nypl-colors-ui-link-secondary);}.css-1t84354 screenreaderonly{clip:rect(1px, 1px, 1px, 1px);height:1px;overflow:hidden;position:absoluteimportant;width:1px;word-wrap:normal;} novelny resources.

NOVELny Resources are available to all New Yorkers without a password as long as one is in New York State, via a NY driver or non-driver ID if not currently in New York State and/or via a Library Card.

A searchable, digitized archive -- from the first date of publication to the last three to five years -- of major scholarly journals in many academic fields. 

Access to this resource has been temporarily expanded to NYPL cardholders working from home, courtesy of JSTOR.

Ancestry Library Edition

Access billions of names in thousands of genealogical databases including Census and Vital Records, birth, marriage and death notices, the Social Security Death Index, Passenger lists and naturalizations, Military and Holocaust Records, City Directories, New York Emigrant Savings Bank records, and African American and Native American Records. Library version of Ancestry.com.  

***PLEASE NOTE THAT TEMPORARY REMOTE ACCESS TO THIS DATABASE HAS BEEN TERMINATED.***

Huge database gives insight into salmon patterns at sea

A massive new analysis of high seas salmon surveys is enhancing the understanding of salmon ecology, adding details about where various species congregate in the North Pacific Ocean and their different temperature tolerances.

The project, led by researchers at the University of Alaska Fairbanks, integrates numerous international salmon studies from the North Pacific dating back to the 1950s. Although many individual reports were published by nations and agencies that funded those efforts, they were never fully compiled into an overarching database or analyzed comprehensively at this scale. This new research effort builds upon the extensive and valuable past body of work on the marine component of the salmon life cycle.

Together the data represent a trove of more than 44,000 high seas survey gear hauls across the North Pacific, netting over 14 million salmon. That ocean-based data also provides a contrast from the bulk of salmon research, which tends to focus on river habitat.

"This is a portion of the salmon life cycle that arguably gets overlooked, at least in terms of the grand investment in salmon research," said Curry Cunningham, an assistant professor at UAF's College of Fisheries and Ocean Sciences. "As someone who always wondered where all these fish went when they left Bristol Bay, seeing that pattern come to life was so satisfying."

Although methods and data varied among the studies, they consistently noted the water temperature and location where salmon were caught. That data allowed the research team to create maps with unprecedented detail showing the areas that various salmon species occupy while at sea.

For example, the maps highlight a hotspot for Chinooks gathering in the Bering Sea. They chart a path that maturing sockeye tend to take from the North Pacific and Gulf of Alaska toward the Alaska Peninsula, traveling through passes into the Bering Sea outside Bristol Bay throughout the spring and summer.

"It's not as if all these salmon are going to some party in the middle of the Pacific," said lead author Joe Langan, who worked on the project as a postdoctoral fellow at UAF. "This gives us a broad look at where they go."

The study also produced more evidence that cold-water tolerance varies significantly among salmon species. Sockeye and chum salmon were commonly found in temperatures down to just a few degrees above freezing, while coho and steelhead were absent from the coldest areas. Chinook and pink salmon lived in the middle of those ranges.

Those tendencies are likely to influence which species will be most capable of shifting to colder waters as their traditional ranges are warmed by climate change, Cunningham said.

The heart of the dataset is from the 1950s to the 1990s, and the research required digging up forgotten reports from varying sources. Skip McKinnell, a retired Department of Fisheries and Oceans Canada researcher and expert in high seas salmon research, participated in some of the earlier surveys. He helped dredge up, compile and standardize many of those older reports.

"It was more of a search and rescue mission rather than convincing anyone to provide their data," Langan said.

The project was funded by the National Oceanic and Atmospheric Administration's Office of Law Enforcement, which hopes to use information about where salmon are concentrated at sea to help curb illegal fishing. The centralized database will be housed by the North Pacific Anadromous Fish Commission and made publicly available.

• Marine Biology
• Environmental Awareness
• Oceanography
• Global Warming
• Coho salmon
• Atlantic salmon
• Short-tailed Albatross
• Fish migration
• El Niño-Southern Oscillation

Story Source:

Materials provided by University of Alaska Fairbanks . Note: Content may be edited for style and length.

Journal Reference :

• Joseph A. Langan, Curry J. Cunningham, Jordan T. Watson, Skip McKinnell. Opening the black box: New insights into the role of temperature in the marine distributions of Pacific salmon . Fish and Fisheries , 2024; DOI: 10.1111/faf.12825

Cite This Page :

Explore More

• Warming Antarctic Deep-Sea and Sea Level Rise
• Octopus Inspires New Suction Mechanism for ...
• Cities Sinking: Urban Populations at Risk
• Puzzle Solved About Ancient Galaxy
• How 3D Printers Can Give Robots a Soft Touch
• Combo of Multiple Health Stressors Harming Bees
• Methane Emission On a Cold Brown Dwarf
• Remarkable Memories of Mountain Chickadees
• Predicting Future Marine Extinctions
• Drain On Economy Due to Climate Change

Trending Topics

Strange & offbeat.

• Open access
• Published: 20 April 2024

Specific mortality in patients with diffuse large B-cell lymphoma: a retrospective analysis based on the surveillance, epidemiology, and end results database

• Rong Yan 2 ,
• Chunmei Ye 1 ,
• Jun Li 1 &

European Journal of Medical Research volume  29 , Article number:  241 ( 2024 ) Cite this article

Metrics details

The full potential of competing risk modeling approaches in the context of diffuse large B-cell lymphoma (DLBCL) patients has yet to be fully harnessed. This study aims to address this gap by developing a sophisticated competing risk model specifically designed to predict specific mortality in DLBCL patients.

We extracted DLBCL patients’ data from the SEER (Surveillance, Epidemiology, and End Results) database. To identify relevant variables, we conducted a two-step screening process using univariate and multivariate Fine and Gray regression analyses. Subsequently, a nomogram was constructed based on the results. The model’s consistency index (C-index) was calculated to assess its performance. Additionally, calibration curves and receiver operator characteristic (ROC) curves were generated to validate the model’s effectiveness.

This study enrolled a total of 24,402 patients. The feature selection analysis identified 13 variables that were statistically significant and therefore included in the model. The model validation results demonstrated that the area under the receiver operating characteristic (ROC) curve (AUC) for predicting 6-month, 1-year, and 3-year DLBCL-specific mortality was 0.748, 0.718, and 0.698, respectively, in the training cohort. In the validation cohort, the AUC values were 0.747, 0.721, and 0.697. The calibration curves indicated good consistency between the training and validation cohorts.

The most significant predictor of DLBCL-specific mortality is the age of the patient, followed by the Ann Arbor stage and the administration of chemotherapy. This predictive model has the potential to facilitate the identification of high-risk DLBCL patients by clinicians, ultimately leading to improved prognosis.

Introduction

DLBCL, known as diffuse large B-cell lymphoma, is a highly heterogeneous disease and is the most common type of non-Hodgkin’s lymphoma, accounting for approximately 30–40% of all lymphoma cases [ 1 ]. While there have been significant advancements in the diagnosis and treatment of DLBCL in recent years, it is disheartening to note that 40–50% of patients with DLBCL still remain incurable [ 2 ]. For patients who experience a relapse or have refractory DLBCL, the prognosis is generally poor [ 3 ]. Hence, it becomes imperative to identify highly specific and sensitive prognostic markers that can effectively identify high-risk patients, thereby enabling improved treatment decisions and ultimately enhancing patient survival.

Several studies have examined prognostic factors in patients with DLBCL [ 2 , 4 , 5 , 6 , 7 ]. However, many of these studies have relied on the conventional Cox proportional hazards model [ 7 , 8 ]. It is important to note that competing mortality events frequently arise during the analysis of survival data. Yet, the traditional Cox regression often fails to consider the occurrence of these competing mortality events, leading to potential misjudgment of patient prognosis, irrespective of the independence between such events. If a patient dies from causes other than DLBCL, and the Cox regression fails to account for these competing mortality events, it introduces bias into the analysis results. The Fine and Gray model enables us to analyze data while taking into account competing risks. Similar to the Cox model, the Fine and Gray model utilizes a risk set function, but it also incorporates the concept of competition between different types of events. This model estimates the probability of each event by comparing the event-specific risk set function with the overall risk set function, while accounting for the impact of other event types. Competing risk models, specifically the Fine and Gray proportional hazards model, demonstrate excellent capability in addressing the correlation between cancer outcomes and competing events, ultimately leading to a remarkable enhancement in the accuracy of prognostic analysis [ 9 ]. Despite its potential, this methodology remains largely underutilized. Leveraging the SEER database, a comprehensive and extensive multi-center database with credible data sources, this study aims to establish a competing risk model based on DLBCL patients. The objective is to investigate the factors that influence cause-specific mortality in DLBCL patients.

Study cohort

We extracted data from the SEER database [Incidence—SEER Research Plus Data, 17 Registries, Nov 2021 Sub (2000–2019)] using SEER Stat (Version 8.4.1) software. The data pertain to patients diagnosed with DLBCL between 2000 and 2015. To ensure data quality, patients with less than 1 month of follow-up and those with one or more missing variables were excluded from the analysis. The collected data encompassed demographic information such as sex, race, age, marital status, median household income, and place of residence. It also included tumor characteristics such as site, primary site, presence of B symptoms, number of malignant tumors, and whether it was the first primary tumor. Additionally, the data recorded the Ann Arbor Stage, surgical and chemoradiotherapy information including surgery, radiation, chemotherapy, the sequence of systemic therapy and surgery, and treatment timing. Furthermore, the cause of death and follow-up information were documented. The diagnosis of diffuse large B-cell lymphoma (DLBCL) was made based on the criteria outlined in the International Classification of Diseases for Oncology, 3rd Edition (ICD-O-3). The staging of lymphoma was determined using the Ann Arbor stage system (AASS). Regarding the analysis of continuous variables, the subjects were categorized into different groups based on their treatment timing (the interval between the diagnosis and initiation of treatment): more than 1 month and 1 month or less. The subjects were also divided into 5 age groups: 0–19 years, 20–39 years, 40–59 years, 60–79 years, and 80–100 years. Furthermore, based on the median annual household income, the subjects were divided into 3 groups: less than $50,000, $50,000–$74,999, and greater than $75,000.

Statistical analysis

The study cohort was divided into a training cohort and a validation cohort in a ratio of 7:3. The purpose of this division was to use the training cohort to train the model and the validation cohort to test the model. All patient features were divided into the training and validation cohorts, and the balance of the data was assessed by comparing the differences between the two groups. Categorical variables were presented as frequencies and percentages (25%), and chi-square tests were used to compare the differences between the two groups. Normally distributed continuous variables were displayed as means and standard deviations [Mean (S.E.)], and t -tests were used to compare the differences. Non-normally distributed continuous variables were presented as medians and quartiles (median [IQR]), and rank sum tests were used to compare the differences. In the competing risk model, the outcome event of interest was death from DLBCL, and death from other causes was treated as a competing event. Variables were screened in two steps using univariate and multivariate Fine and Gray regression analyses. Variables that were statistically significant in the univariate analysis were included in the multivariate analysis. The variables that remained statistically significant in the multivariate analysis were used to construct a competing risk model and develop a corresponding nomogram. The model’s C-index was calculated, and its predictions were compared with the observed actual values. Calibration curves and ROC curves were plotted to assess the consistency and accuracy of the model. All statistical analyses were performed using R 4.2.1 ( https://www.r-project.org/ ). The Fine and Gray regression analysis and competing risk modeling were conducted using the riskRegression (2021.10.10) software package. The pmsampsize (1.1.3) package was used to calculate the sample size and plot ROC and calibration curves, while the rms package was used for nomogram plotting.

Patient features

A total of 117,171 patients diagnosed with diffuse large B-cell lymphoma (DLBCL) were identified from the dataset titled “Incidence—SEER Research Plus Data, 17 Registries, Nov 2021 Sub (2000–2019)” that was submitted to the SEER database in 2021. Patients who had less than 1 month of follow-up ( N  = 9758), patients without Ann Arbor Stage data ( N  = 29,974), and patients with one or more missing variables ( N  = 53,037) were excluded from the study (Fig.  1 ). Eventually, a total of 24,402 patients were included in this study. Among them, 6459 died from DLBCL and 4076 died from other causes. The median survival time for patients in the entire study cohort was 58 months (IQR: [16.00, 83.00]). The majority of patients were between the ages of 60 and 79 years (48.0%), and there was a higher proportion of men compared to women (57.1%). The characteristics of patients in both the training cohort and the validation cohort are described in Table  1 . There were no statistically significant differences in each variable between the two cohorts ( P  > 0.05), indicating a balanced distribution of data.

Patient selection flowchart

Feature selection

The selection of features was carried out using univariate and multivariate Fine and Gray regression analyses. In the univariate analyses, only variables that showed statistical significance were included in the multivariate analyses. Similarly, in the multivariate analyses, only variables that showed statistical significance were included in the final model. The univariate analysis revealed that 14 variables were found to be statistically significant and were, therefore, considered potential risk factors for cause-specific mortality in DLBCL patients. These variables included race, tumor site (extranodal or nodal), primary site, Ann Arbor stage, whether surgery was performed, whether radiation therapy was administered, whether chemotherapy was administered, sequence of systemic therapy and surgery, treatment timing, presence of B symptoms, whether it was the first primary tumor, age, marital status, and median annual household income. Upon conducting a multivariate analysis with the above variables included in the adjusted model, it was revealed that 13 variables remained statistically significant and were identified as independent risk factors for cause-specific mortality in DLBCL patients (Additional file 1 : Table S1). These variables included race, tumor site (extranodal or nodal), Ann Arbor stage, whether surgery was performed, whether radiation therapy was administered, whether chemotherapy was administered, sequence of systemic therapy and surgery, treatment timing, presence of B symptoms, whether it was the first primary tumor, age, marital status, and median annual household income. These 13 variables were further included in the competing risk model (Table  2 ). Furthermore, to effectively compare the disparities between Fine and Gray regression and Cox regression, we incorporated the aforementioned variables into the multivariate Cox regression analysis. The findings revealed that age, Ann Arbor Stage, b symptoms, absence of chemotherapy, absence of radiation, absence of surgery, the sequence of systemic therapy and surgery, and treatment timing exerted a more prominent influence on the risk of all-cause mortality (in the Cox proportional risk model) compared to the risk of DLBCL-specific mortality (in the Competing Risk Model) (refer to Table  3 ).

Model development and validation

The competing risk model incorporated 13 independent risk factors, achieving a C-statistic of 0.709 (± 0.002). To facilitate the application of this model, a corresponding nomogram, as shown in Fig.  2 , was constructed. The points assigned to each individual variable were determined based on the patients’ classification, and the sum of these points yielded the Total Points. By matching the Total Points with the corresponding predictor, the cause-specific survival probability of patients could be estimated. The performance of the model was further evaluated through ROC curve analysis. The area under the curve (AUC) for 6-month, 1-year, and 3-year mortality in DLBCL patients was 0.748 (95% confidence interval [CI] [0.736, 0.759]), 0.718 (95% CI [0.708, 0.728]), and 0.698 (95% CI [0.689, 0.707]) in the training cohort, respectively. In the validation cohort, the AUC values were 0.747 (95% CI [0.729, 0.765]), 0.721 (95% CI [0.706, 0.737]), and 0.697 (95% CI [0.683, 0.711]), as depicted in Fig.  3 . Moreover, the calibration curve analysis demonstrated that the model’s predicted results aligned closely with the actual values, as illustrated in Fig.  4 . This further confirms the reliability and accuracy of the model in predicting outcomes.

The nomogram of the competing risk model

a The results of ROC curve analysis in the training cohort. b The results of ROC curve analysis in the validation cohort

a The results of calibration curve analysis in the training cohort. b The results of calibration curve analysis in the validation cohort

We have devised a competing risk model in this research to forecast cause-specific mortality among DLBCL patients, which is then represented by a graphical nomogram. The model demonstrated favorable predictive accuracy and can offer reliable prognostic insights. This, in turn, may enhance clinicians’ comprehension of DLBCL and facilitate the provision of targeted clinical assistance to individuals at high risk.

The results of the feature selection demonstrated that there are 13 variables that serve as independent predictors of cause-specific mortality in DLBCL patients. These variables include race, tumor site (extranodal or nodal), Ann Arbor stage, surgery, radiation therapy, chemotherapy, sequence of systemic therapy and surgery, treatment timing, B Symptoms, whether it was the first primary tumor, age, marital status, and median annual household income. According to the results obtained from the nomogram, patient age was identified as the most accurate predictor, followed by Ann Arbor stage and chemotherapy. With regard to treatment, our study revealed that the absence of surgery, radiation therapy, chemotherapy, and systemic therapy was associated with a poorer prognosis for patients. It is widely acknowledged that chemotherapy is the primary treatment for DLBCL, and its efficacy has been supported by numerous studies [ 10 , 11 ]. Radiation therapy is often used in conjunction with chemotherapy and has been shown to improve clinical symptoms in relapsed or refractory DLBCL patients following chemotherapy [ 12 ]. For the majority of lymphoma patients, chemotherapeutic agents are deemed more effective, thus surgical treatment is generally not recommended [ 13 ]. In fact, one study has shown that surgical treatment for lymphoma does not improve patient prognosis [ 14 ]. Nevertheless, there are certain specific cases where surgical intervention is necessary. For example, patients with primary gastrointestinal lymphoma may present with intestinal obstruction or splenomegaly alongside symptoms of compression [ 15 ]. In terms of demographic information, our findings suggest that Asians have a significantly higher mortality rate among DLBCL patients as compared to whites, and divorced patients exhibit a higher mortality rate than married patients. Furthermore, age [ 16 ], Ann Arbor stage [ 17 ], and B symptoms [ 18 ] have all been identified as predictors for cause-specific mortality in DLBCL patients, which is consistent with our study’s findings.

We utilized both the Fine and Gray model and the Cox proportional risk model to evaluate the influence of various variables on the outcome. To determine the impact of each variable, we computed the hazard ratio (HR). Table 3 illustrates the disparities between the variables in the two models. Considering the independent risk factors, we observed that age, Ann Arbor Stage, presence of b symptoms, absence of chemotherapy, absence of radiation, absence of surgery, and the sequence of systemic therapy and surgery significantly affected the risk of all-cause mortality in comparison to DLBCL-specific mortality. Regarding the independent protective factors, we found that the presence of a first primary tumor, marital status, median household income, and timing of treatment exerted a more pronounced influence on the risk of all-cause mortality compared to the risk of DLBCL-specific mortality. However, the effect of race (White) on the risk of all-cause mortality was relatively smaller.

Several studies have been conducted to assess the prognosis of patients with DLBCL using the SEER database. One particular study focused on the risk of developing second primary malignancies in DLBCL patients and revealed that the oral cavity and pharynx were the most vulnerable regions for malignant tumor development [ 19 ]. Other studies, encompassing diverse populations with DLBCL, investigated the prognosis of patients [ 20 , 21 , 22 , 23 ]. However, it is worth noting that the majority of these studies relied on the conventional Cox proportional risk model. In contrast, our study adopts a competing risk model, which takes into account both DLBCL-specific mortality events and the influence of competing events on the analysis outcomes. Most prognostic studies commonly utilize the traditional Kaplan–Meier method and Cox regression model to analyze survival patterns and identify significant prognostic indicators [ 24 ]. Nevertheless, real-world medical studies often involve the occurrence of multiple competing outcome events rather than a single event. Consequently, it becomes imperative to employ a competing risk model to mitigate the bias resulting from the presence of these competing risk events [ 25 , 26 ]. The Competitive Risk Model, also known as the Fine and Gray model, was proposed by Fine and Gray in 1999 to address proportional risk situations in which competing risks are present. Unlike traditional survival models, this model focuses on modeling the subdistribution hazard function instead of the risk function for survival time. The subdistribution hazard function calculates the conditional risk of a specific event occurring before a certain point in time, considering the occurrence of competing events. This model is particularly useful when the endpoint event of a study, such as disease recurrence, can be “competed for” by other types of events, such as patient death from other causes. In such cases, traditional survival analysis methods may not provide accurate results. Using competing risk models, researchers can obtain more precise risk estimates and evaluate and compare the risk of specific events while accounting for the influence of other risk events.

The nomogram, a visual representation of models [ 27 ], has been widely recognized for its ability to depict complex relationships. Numerous studies have shown that machine learning models, such as random forests, neural networks, and support vector machines, can effectively capture nonlinear patterns in the data, thereby enhancing their predictive power [ 28 , 29 , 30 , 31 ]. However, one drawback of these models is their “black box” nature, which limits our understanding of the underlying computational process and the importance of each feature. In contrast, the nomogram offers a simple and intuitive graphical interface that allows for the quantification of the risk associated with each feature, making it particularly valuable for clinical applications [ 32 ]. The SEER database, maintained by the National Cancer Institute (NCI) [ 33 ], is a comprehensive and diverse collection of cancer incidence and survival data for specific populations in the United States. It serves as a valuable resource for researchers and healthcare professionals in understanding and analyzing cancer trends. With its large sample size and inclusion of multiple centers and racial backgrounds, the SEER database ensures that statistical findings derived from it are generally representative and reliable. This database offers detailed information on various aspects of cancer cases, such as patient demographics, cancer type, onset time, treatment approaches, and follow-up outcomes. Researchers can utilize this wealth of data to gain insights into the impact of cancer and develop effective strategies for diagnosis, treatment, and prevention.

In summary, an extensive dataset was utilized to develop a competing risk model for the prediction of cause-specific mortality in DLBCL patients. The model was effectively visualized as a nomogram and displayed favorable predictive performance, offering valuable information. However, it is crucial to acknowledge certain limitations within this study. Firstly, although the model exhibited satisfactory performance within both the training and validation cohorts, external validation remains necessary and is planned for the subsequent phase of our research. Secondly, due to constraints imposed by public databases, certain variables of interest were regrettably excluded from this investigation, including the specific chemotherapy agents administered to the patients. Furthermore, the lack of clarity in the categorization of certain variables within the database hinders the interpretation of their clinical significance. One such instance is the subcategory labeled as “Other”. Additionally, the potential impact of small subcategorical sample sizes on the model’s performance should be taken into consideration. However, it should be noted that the large sample sizes in this study mitigated this concern.

Based on the SEER database, we have successfully developed a competing risk model for predicting the specific prognosis of DLBCL patients. The model has shown excellent performance in terms of its predictive accuracy. Among the various predictors evaluated, patient age emerges as the most crucial independent factor associated with DLBCL-specific mortality. Moreover, Ann Arbor stage and chemotherapy also demonstrate significant importance in predicting the prognosis. The clinical implications of our model are noteworthy as it aids clinicians in promptly identifying high-risk DLBCL patients. Consequently, this would facilitate the implementation of targeted clinical interventions and ultimately lead to improved patient outcomes.

Availability of data and materials

On reasonable request, the corresponding author will provide the information supporting the study’s conclusions.

Arber DA, Orazi A, Hasserjian R, Thiele J, Borowitz MJ, Le Beau MM, Bloomfield CD, Cazzola M, Vardiman JW. The 2016 revision to the World Health Organization classification of myeloid neoplasms and acute leukemia. Blood. 2016;127(20):2391–405.

Article   CAS   PubMed   Google Scholar  

Liang XJ, Song XY, Wu JL, Liu D, Lin BY, Zhou HS, Wang L. Advances in multi-omics study of prognostic biomarkers of diffuse large B-cell lymphoma. Int J Biol Sci. 2022;18(4):1313–27.

Article   CAS   PubMed   PubMed Central   Google Scholar  

Zheng W, Lin Q, Issah MA, Liao Z, Shen J. Identification of PLA2G7 as a novel biomarker of diffuse large B cell lymphoma. BMC Cancer. 2021;21(1):927.

Zhu YH, Meng WJ, He LH, Jia YS, Tong ZS. Prognosis analysis of primary breast diffuse large B cell lymphoma. Zhonghua zhong liu za zhi [Chin J Oncol]. 2019;41(3):235–40.

CAS   PubMed   Google Scholar  

Gao F, Wang ZF, Tian L, Dong F, Wang J, Jing HM, Ke XY. A prognostic model of gastrointestinal diffuse large B cell lymphoma. Med Sci Monit Int Med J Exp Clin Res. 2021;27: e929898.

Google Scholar  

Huo YJ, Xu PP, Fu D, Yi HM, Huang YH, Wang L, Wang N, Ji MM, Liu QX, Shi Q, et al. Molecular heterogeneity of CD30+ diffuse large B-cell lymphoma with prognostic significance and therapeutic implication. Blood Cancer J. 2022;12(3):48.

Article   PubMed   PubMed Central   Google Scholar  

He J, Chen Z, Xue Q, Sun P, Wang Y, Zhu C, Shi W. Identification of molecular subtypes and a novel prognostic model of diffuse large B-cell lymphoma based on a metabolism-associated gene signature. J Transl Med. 2022;20(1):186.

Xu H, Li Y, Jiang Y, Wang J, Sun H, Wu W, Lv Y, Liu S, Zhai Y, Tian L, et al. A novel defined super-enhancer associated gene signature to predict prognosis in patients with diffuse large B-cell lymphoma. Front Genet. 2022;13: 827840.

Austin PC, Lee DS, Fine JP. Introduction to the analysis of survival data in the presence of competing risks. Circulation. 2016;133(6):601–9.

Mondello P, Mian M. Frontline treatment of diffuse large B-cell lymphoma: beyond R-CHOP. Hematol Oncol. 2019;37(4):333–44.

Article   PubMed   Google Scholar  

He MY, Kridel R. Treatment resistance in diffuse large B-cell lymphoma. Leukemia. 2021;35(8):2151–65.

Ng AK, Yahalom J, Goda JS, Constine LS, Pinnix CC, Kelsey CR, Hoppe B, Oguchi M, Suh CO, Wirth A, et al. Role of radiation therapy in patients with relapsed/refractory diffuse large B-cell lymphoma: guidelines from the international lymphoma radiation oncology group. Int J Radiat Oncol Biol Phys. 2018;100(3):652–69.

Ollila TA, Olszewski AJ. Extranodal diffuse large B cell lymphoma: molecular features, prognosis, and risk of central nervous system recurrence. Curr Treat Options Oncol. 2018;19(8):38.

Ayub A, Santana-Rodríguez N, Raad W, Bhora FY. Primary appendiceal lymphoma: clinical characteristics and outcomes of 116 patients. J Surg Res. 2017;207:174–80.

Abbott S, Nikolousis E, Badger I. Intestinal lymphoma—a review of the management of emergency presentations to the general surgeon. Int J Colorectal Dis. 2015;30(2):151–7.

Zhao P, Zhu L, Li L, Zhou S, Qiu L, Qian Z, Xu W, Zhang H. A modified prognostic model in patients with diffuse large B-cell lymphoma treated with immunochemotherapy. Oncol Lett. 2021;21(3):218.

Shen Z, Zhang S, Jiao Y, Shi Y, Zhang H, Wang F, Wang L, Zhu T, Miao Y, Sang W, et al. LASSO model better predicted the prognosis of DLBCL than random forest model: a retrospective multicenter analysis of HHLWG. J Oncol. 2022;2022:1618272.

Yin T, Qi L, Zhou Y, Kong F, Wang S, Yu M, Li F. CD5+ diffuse large B-cell lymphoma has heterogeneous clinical features and poor prognosis: a single-center retrospective study in China. J Int Med Res. 2022;50(9):3000605221110075.

Jiang S, Zhen H, Jiang H. Second primary malignancy in diffuse large B-cell lymphoma patients: a SEER database analysis. Curr Probl Cancer. 2020;44(1): 100502.

Yang S, Chang W, Zhang B, Shang P. What factors are associated with the prognosis of primary testicular diffuse large B-cell lymphoma? A study based on the SEER database. J Cancer Res Clin Oncol. 2023;149(12):10269–78.

Du Y, Wang Y, Li Q, Chang X, Zhang H, Xiao M, Xing S. Risk and outcome of acute myeloid leukaemia among survivors of primary diffuse large B-cell lymphoma: a retrospective observational study based on SEER database. BMJ Open. 2022;12(9): e061699.

Kuczmarski TM, Tramontano AC, Mozessohn L, LaCasce AS, Roemer L, Abel GA, Odejide OO. Mental health disorders and survival among older patients with diffuse large B-cell lymphoma in the USA: a population-based study. Lancet Haematol. 2023;10(7):e530–8.

Liu P-P, Xia Y, Bi X-W, Wang Y, Sun P, Yang H, Li Z-M, Jiang W-Q. Trends in survival of patients with primary gastric diffuse large B-cell lymphoma: an analysis of 7051 cases in the SEER database. Dis Markers. 2018. https://doi.org/10.1155/2018/7473935 .

Shao W, Wang T, Huang Z, Han Z, Zhang J, Huang K. Weakly supervised deep ordinal cox model for survival prediction from whole-slide pathological images. IEEE Trans Med Imaging. 2021;40(12):3739–47.

Southern DA, Faris PD, Brant R, Galbraith PD, Norris CM, Knudtson ML, Ghali WA. Kaplan–Meier methods yielded misleading results in competing risk scenarios. J Clin Epidemiol. 2006;59(10):1110–4.

Johnstone PAS, Spiess PE, Giuliano AR. New directions in penile cancer. Lancet Oncol. 2019;20(1):16–7.

Yang Y, Wang Y, Deng H, Tan C, Li Q, He Z, Wei W, Zhou E, Liu Q, Liu J. Development and validation of nomograms predicting survival in Chinese patients with triple negative breast cancer. BMC Cancer. 2019;19(1):541.

Moll M, Qiao D, Regan EA, Hunninghake GM, Make BJ, Tal-Singer R, McGeachie MJ, Castaldi PJ, SanJoseEstepar R, Washko GR, et al. Machine learning and prediction of all-cause mortality in COPD. Chest. 2020;158(3):952–64.

Poirion OB, Jing Z, Chaudhary K, Huang S, Garmire LX. DeepProg: an ensemble of deep-learning and machine-learning models for prognosis prediction using multi-omics data. Genome Med. 2021;13(1):112.

Ambale-Venkatesh B, Yang X, Wu CO, Liu K, Hundley WG, McClelland R, Gomes AS, Folsom AR, Shea S, Guallar E, et al. Cardiovascular event prediction by machine learning: the multi-ethnic study of atherosclerosis. Circ Res. 2017;121(9):1092–101.

Khera R, Haimovich J, Hurley NC, McNamara R, Spertus JA, Desai N, Rumsfeld JS, Masoudi FA, Huang C, Normand SL, et al. Use of Machine learning models to predict death after acute myocardial infarction. JAMA Cardiol. 2021;6(6):633–41.

Balachandran VP, Gonen M, Smith JJ, DeMatteo RP. Nomograms in oncology: more than meets the eye. Lancet Oncol. 2015;16(4):e173-180.

Doll KM, Rademaker A, Sosa JA. Practical guide to surgical data sets: surveillance, epidemiology, and end results (SEER) database. JAMA Surg. 2018;153(6):588–9.

Download references

Acknowledgements

Not applicable.

The authors declare that they did not receive any funding from any source.

Author information

Authors and affiliations.

Department of Hematology, Taixing People’s Hospital, No. 98, Runtai South Road, Taixing, 225400, Jiangsu, China

Hui Xu, Chunmei Ye, Jun Li & Guo Ji

Taixing People’s Hospital, Taixing, Jiangsu, China

You can also search for this author in PubMed   Google Scholar

Contributions

Conception and design: Hui Xu and Guo Ji were responsible for the conception and design of the study. Jun Li and Hui Xu provided administrative support. Provision of study materials or patients: Rong Yan was responsible for providing the study materials or patients. Collection and assembly of data: Hui Xu, Rong Yan, and Chunmei Ye collected and assembled the data. Data analysis and interpretation: Hui Xu and Rong Yan conducted the data analysis and interpretation. Manuscript writing: all authors contributed to writing the manuscript. Final approval of manuscript: all authors gave their final approval of the manuscript.

Corresponding author

Correspondence to Guo Ji .

Ethics declarations

Ethics approval and consent to participate, consent for publication, competing interests.

The authors have no conflicts of interest to declare.

Additional information

Publisher's note.

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1: table s1..

The results of univariate and multivariate analysis in competing risk model.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ . The Creative Commons Public Domain Dedication waiver ( http://creativecommons.org/publicdomain/zero/1.0/ ) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Cite this article.

Xu, H., Yan, R., Ye, C. et al. Specific mortality in patients with diffuse large B-cell lymphoma: a retrospective analysis based on the surveillance, epidemiology, and end results database. Eur J Med Res 29 , 241 (2024). https://doi.org/10.1186/s40001-024-01833-4

Download citation

Received : 17 January 2024

Accepted : 06 April 2024

Published : 20 April 2024

DOI : https://doi.org/10.1186/s40001-024-01833-4

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

• Diffuse large B-cell lymphoma
• Competing risk model
• Fine and Gray regression
• SEER database

European Journal of Medical Research

ISSN: 2047-783X

• Submission enquiries: [email protected]
• General enquiries: [email protected]

ENG 111 ver.3

• Databases and Resources
• Evaluating Sources
• Citations and Writing

We are here to help!  Get help via chat, text, or email.

Click the Chat Now tab located at the top right of this page.

 text 704-707-4960

[email protected]

You can also make an appointment with a librarian. 

Start Your Research Here

This guide contains resources for ENG 111 Writing and Inquiry .

Start your research with  tertiary and secondary sources to get a better understanding of your topic.

• Tertiary sources , like encyclopedias, summarize or consolidate information on a topic or subject.  
• Secondary sources  are books, periodicals, websites, etc. that analyze and interpret primary sources.  
• Primary sources are original sources and first-hand accounts from people who had a direct connection with an event or topic. Some examples include photographs, political cartoons, letters, diaries, interviews, oral histories, speeches, etc. To learn more about primary sources and how to use them, visit our Primary Sources guide .

Databases and resources that contain tertiary, secondary, and primary sources are located below .

Tertiary Sources (Encyclopedias, Dictionaries, etc.)

Credo Reference

Secondary sources (journals, books, etc.).

ProQuest Central

General reference database for over 175 subjects from magazines, journals and newspapers, including peer-reviewed and scholarly works.

Opposing Viewpoints In Context

Opposing Viewpoints in Context is the premier online resource covering today’s hottest social issues, from Offshore Drilling to Climate Change, Health Care to Immigration. Opposing Viewpoints in Context helps students research, analyze and organize a broad variety of data for conducting research, completing writing assignments, preparing for debates, creating presentations and more.

SIRS Issues Researcher

eBook Central

Secondary sources (newspapers).

Selected full-text newspaper articles and newswires from the United States and abroad. NewsBank is particularly strong in providing access to local, state, regional, and national news.

Charlotte Observer

The Charlotte Observer is a general circulation paper that provides local, regional, national, and international news coverage. Local news of the Observer focuses on the area schools and education, business information, banking and sports. Full-text available from 1985-present.

Primary Sources

Pew Research Center

The Pew Research Center is an organization that informs the public about issues, attitudes and trends shaping the world. They conduct opinion polling, demographic research, content analysis, and other data-driven social science research.

Digital Public Library of America

The Digital Public Library of America (DPLA) makes millions of materials from libraries, archives, museums, and other cultural institutions across the country available to everyone in one location. They also provide Primary Source Sets that include photographs, audio clips, drawings, letters, and much more.

Social Explorer

Visualization and data-mapping tool with hundreds of thousands of data indicators and across demography, economy, health, education, religion, crime and more

Explore More Primary Source Databases

Primary Sources Guide

Additional help.

• Next: Evaluating Sources >>
• Last Updated: Apr 19, 2024 2:07 PM
• URL: https://researchguides.cpcc.edu/c.php?g=1393937

Maintenance work is planned for Wednesday 1st May 2024 from 9:00am to 11:00am (BST).

During this time, the performance of our website may be affected - searches may run slowly and some pages may be temporarily unavailable. If this happens, please try refreshing your web browser or try waiting two to three minutes before trying again.

We apologise for any inconvenience this might cause and thank you for your patience.

Chemical Society Reviews

Bridging the gap between academic research and industrial development in advanced all-solid-state lithium–sulfur batteries.

* Corresponding authors

a Chemical Sciences and Engineering Division, Argonne National Laboratory, 9700 S Cass Ave, Lemont, IL 60439, USA E-mail: [email protected] , [email protected]

b Eastern Institute for Advanced Study, Eastern Institute of Technology, Ningbo, Zhejiang, P. R. China

c Laurel Heights Secondary School, 650 Laurelwood Dr, Waterloo, ON, Canada

The energy storage and vehicle industries are heavily investing in advancing all-solid-state batteries to overcome critical limitations in existing liquid electrolyte-based lithium-ion batteries, specifically focusing on mitigating fire hazards and improving energy density. All-solid-state lithium–sulfur batteries (ASSLSBs), featuring earth-abundant sulfur cathodes, high-capacity metallic lithium anodes, and non-flammable solid electrolytes, hold significant promise. Despite these appealing advantages, persistent challenges like sluggish sulfur redox kinetics, lithium metal failure, solid electrolyte degradation, and manufacturing complexities hinder their practical use. To facilitate the transition of these technologies to an industrial scale, bridging the gap between fundamental scientific research and applied R&D activities is crucial. Our review will address the inherent challenges in cell chemistries within ASSLSBs, explore advanced characterization techniques, and delve into innovative cell structure designs. Furthermore, we will provide an overview of the recent trends in R&D and investment activities from both academia and industry. Building on the fundamental understandings and significant progress that has been made thus far, our objective is to motivate the battery community to advance ASSLSBs in a practical direction and propel the industrialized process.

Article information

Download citation, permissions.

J. Lee, C. Zhao, C. Wang, A. Chen, X. Sun, K. Amine and G. Xu, Chem. Soc. Rev. , 2024, Advance Article , DOI: 10.1039/D3CS00439B

To request permission to reproduce material from this article, please go to the Copyright Clearance Center request page .

If you are an author contributing to an RSC publication, you do not need to request permission provided correct acknowledgement is given.

If you are the author of this article, you do not need to request permission to reproduce figures and diagrams provided correct acknowledgement is given. If you want to reproduce the whole article in a third-party publication (excluding your thesis/dissertation for which permission is not required) please go to the Copyright Clearance Center request page .

Read more about how to correctly acknowledge RSC content .

Social activity

Search articles by author.

This article has not yet been cited.

Advertisements

• Locations and Hours
• UCLA Library
• Research Guides

Cluster 60W: Histories and Theories of Anti-Colonialism (Hussein Spring 2024)

• Secondary Sources
• Primary Sources
• Citing Your Sources

Secondary Source Databases

• UC Library Search This link opens in a new window UC Library Search is the unified discovery and borrowing system for all 10 UC Campuses. Select the UCLA Library Catalog scope to search holdings of materials owned by the UCLA Library and other UCLA collections, whether online or in print. Does not contain full-text articles or article citations. Select the Articles, books and more scope to search for materials in all 10 UC campuses. More information in this guide . OPAC, SRLF, UCLA Library Catalog

Article Search Tips

• Finding articles
• Citing sources and avoiding plagiarism
• Breaking down academic articles
• Finding review articles
• Off-campus access

This quick introduction to searching for academic journal articles in databases will help you make your searches more efficient and more effective:

Avoiding plagiarism can be more tricky than it seems at first glance. Complete this activity to learn strategies for avoiding plagiarism.

Few of us can recall every detail and argument from academic articles - they’re packed with so much information! It’s best to create reading strategies that help you focus on comprehending the most essential elements of an academic article.  Breaking Down Academic Articles  is a webcomic tutorial that walks you through the most important aspects of an academic article, to help you prepare for class discussion on the article(s) or take away essential information from the article to support future research.

Note:  a transcript for each slide can be located at the bottom of each slide. Click the button to preview transcript of slide for description of art in each panel and the script of tutorial guide.

Looking for an efficient way to get a research overview on a topic? A review article is a great place to start.

A review article provides an analysis of the state of research on a set of related research questions. Review articles often: summarize key research findings, reference must-read articles, describe current areas of agreement as well as controversies and debates, point out gaps in knowledge and unanswered questions, suggest directions for future research.

Check out this quick overview of finding review articles in Web of Science, PubMed, Google Scholar, and more.

The Library's online subscription resources can always be accessed from computers and wireless networks on campus. However, off-campus access is restricted to current UCLA, students, faculty, and staff who have set up their computer using one of the following methods.

VPN on Mac with Natalie

"I chose VPN for my mac because I need to be able to access the full text of articles on different browsers." - Natalie, Environmental Science

VPN on Windows with Michael

"I chose VPN because I like the security it provides and the control it gives me as a user to manually enable or disable it when I'm browsing online." - Michael, Public Affairs

Additional Platforms

• Proxy for Safari on a Mac with Kate

For more information:

• UCLA OnLine Proxy Server A simple browser setting which will automatically divert you to a UCLA logon page when you first access a restricted site.
• Virtual Private Networking (VPN) A program you can download and install, or use the built-in version on many computers or mobile devices. VPN software must be logged on manually before you access a restricted site, but works for all programs on your computer.
• << Previous: Home
• Next: Primary Sources >>
• Last Updated: Apr 18, 2024 3:40 PM
• URL: https://guides.library.ucla.edu/c.php?g=1394382

LEAD 100AW: Advanced Difficult Dialogues (Medina)

• Activity 3: Searching & Finding Articles
• Find Scholarly Articles
• Literature Review
• Contact Me!

Getting Started with Databases

• OneSearch vs Databases
• Example Searches
• Where's the article???!

Use OneSearch for Broad Searching

OneSearch is a simple search engine that allows you to search simultaneously for books, articles, and more available at SCU Library. OneSearch brings together content of a large selection of our subscribed e-journals and databases, our library catalog, and our digital library collections in a single search interface. It can be a good starting point for interdisciplinary research, which you then might augment with some discipline-specific databases.  Access OneSearch  directly on the Library homepage.  Learn more about OneSearch here. 

If you are unable to view the PDF of the article. You can submit an InterLibrary Loan Request! Our staff will find the article (within 3 days) and email you when the PDF is ready to be viewed! 

Click here to learn more 

Click Here to view all Databases

Education & Psychology

Indexes and abstracts over 500 professional and scholarly education journals. Dates of coverage vary by title, but some go back to 1983. For 250 of the journals, full-text of the articles is provided, some back to 1994, but most for only the most recent 5 years.

Education Source  

This database will lead you to articles from more than 3,000 professional and scholarly education journals and magazines as well as some books and conference papers. The vast majority of sources are in English, but other countries and languages are represented. Dates of coverage vary wildly, but you could find something from as far back as 1929.

• APA PsycInfo  

Abstracts professional and scholarly psychology journals and book chapters, plus dissertations and technical reports. The coverage includes over 1300 journals in 27 languages from approximately 50 countries. 1887-present. Updated monthly.

• APA PsycArticles  

Provides access to more than 100 important journals in all subject areas relevant to psychology. Journals published by the American Psychological Association, the Canadian Psychological Association, and English language journals from Hogrefe Publishing are included. Most titles are covered from volume one to the present. Citations in PsycINFO have links to the full-text in PsycARTICLES.

Social Sciences Databases

Contains more than 1,800 full-text articles and over 14,000 abstracts from scholarly journals and dissertations in the social sciences such as criminal justice, education, language behavior, linguistics, political science, sociology, etc.

Indexes and abstracts articles at least one column in length from over 544 different English language periodicals in the social sciences, which includes anthropology, psychology, sociology, ethnic studies, political science, economics, geography, urban studies, and more. Fulltext of articles are available from about 175 of these periodicals. Indexing goes back to 1983. Abstracts began with January 1994. Fulltext availability varies title to title, but may go back to 1995. Updated daily. For indexing of articles appearing prior to 1983, use Humanities & Social Sciences Retrospective.

The most comprehensive resource for scholars studying mass media, communication theory, linguistics, organizational communication, rhetoric & discourse, phonetics, and speech pathology. It includes the full text of more than 600 publications (academic journals, conference papers, magazines, and periodicals). Coverage goes back to 1915.

Women & Gender Studies

GenderWatch enhances gender and women's studies, and gay, lesbian, bisexual, and transgender (GLBT) research by providing authoritative perspectives from 1970 to present. GenderWatch provides access to over 300 titles, with more than 250 in full-text, from an array of academic, radical, community and independent presses.

Contains all of the content available in LGBT Life as well as full text for more than 140 of the most important and historically significant LGBTQ+ journals, magazines and regional newspapers, plus full text for 150 monographs/books. The database includes comprehensive indexing and abstract coverage as well as a specialized LGBTQ+ Thesaurus containing over 10,000 terms.

The ultimate women's studies resource! Includes over 540,000 records drawn from a variety of essential women's studies databases. 1972-present.

Ethnic Studies

A collection of three full-text databases, namely GenderWatch, Ethnic NewsWatch, and Alt-PressWatch. GenderWatch enhances gender and women's studies, and gay, lesbian, bisexual, and transgender (GLBT) research by providing authoritative perspectives from 1970 to present. GenderWatch provides access to over 300 titles, with more than 250 in full-text, from an array of academic, radical, community and independent presses. Ethnic NewsWatch is a comprehensive full-text database of the newspapers, magazines, journals and newsletters of the ethnic, minority and native presses as well as many journals concerned with issues of race and ethnicity, with archival material back to 1985. Alt-PressWatch includes over 1.5M articles from more than 300 small sources including unique, independent voices from respected and cited grassroots newspapers, magazines, and journals covering the arts and all viewpoints across the social and political spectrum from 1970 to present.

Political Science and Public Policy

Political Science Complete contains full-text for more than 520 journals and indexing & abstracts for over 2,900 titles, including top-ranked scholarly journals. The database has a worldwide focus, reflecting the globalization of contemporary political discourse. The database also features over 340 full-text reference books and monographs and over 36,000 full-text conference papers. The subject specific thesaurus contains over 17,500 terms to aid researchers.

Contains information on many health topics including the medical sciences, food sciences and nutrition, childcare, sports medicine and general health. Indexing, abstracts and full-text of around 600 journals covering nursing and allied health subjects. 1975-present. Updated daily.

Includes MedLine. The National Library of Medicine's bibliographic database. It includes such topics as microbiology, delivery of health care, nutrition, pharmacology, and environment health. 1966-present. Click  here  for our PubMed Quick Guide.

• << Previous: Activity 3: Searching & Finding Articles
• Next: Literature Review >>
• Last Updated: Apr 17, 2024 3:50 PM
• URL: https://libguides.scu.edu/LEAD100AW_Medina