research paper about website

An official website of the United States government

The .gov means it’s official. Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

The site is secure. The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

• Publications
• Account settings

Preview improvements coming to the PMC website in October 2024. Learn More or Try it out now .

• Advanced Search
• Journal List
• JMIR Form Res
• v.3(4); Oct-Dec 2019

A Comprehensive Framework to Evaluate Websites: Literature Review and Development of GoodWeb

Rosalie allison.

1 Public Health England, Gloucester, United Kingdom

Catherine Hayes

Cliodna a m mcnulty, vicki young, associated data.

Summary of included studies, including information on the participant.

Interventions: methodologies and tools to evaluate websites.

Methods used or described in each study.

Summary of the most used website attributes evaluated.

Attention is turning toward increasing the quality of websites and quality evaluation to attract new users and retain existing users.

This scoping study aimed to review and define existing worldwide methodologies and techniques to evaluate websites and provide a framework of appropriate website attributes that could be applied to any future website evaluations.

We systematically searched electronic databases and gray literature for studies of website evaluation. The results were exported to EndNote software, duplicates were removed, and eligible studies were identified. The results have been presented in narrative form.

A total of 69 studies met the inclusion criteria. The extracted data included type of website, aim or purpose of the study, study populations (users and experts), sample size, setting (controlled environment and remotely assessed), website attributes evaluated, process of methodology, and process of analysis. Methods of evaluation varied and included questionnaires, observed website browsing, interviews or focus groups, and Web usage analysis. Evaluations using both users and experts and controlled and remote settings are represented. Website attributes that were examined included usability or ease of use, content, design criteria, functionality, appearance, interactivity, satisfaction, and loyalty. Website evaluation methods should be tailored to the needs of specific websites and individual aims of evaluations. GoodWeb, a website evaluation guide, has been presented with a case scenario.

Conclusions

This scoping study supports the open debate of defining the quality of websites, and there are numerous approaches and models to evaluate it. However, as this study provides a framework of the existing literature of website evaluation, it presents a guide of options for evaluating websites, including which attributes to analyze and options for appropriate methods.

Introduction

Since its conception in the early 1990s, there has been an explosion in the use of the internet, with websites taking a central role in diverse fields such as finance, education, medicine, industry, and business. Organizations are increasingly attempting to exploit the benefits of the World Wide Web and its features as an interface for internet-enabled businesses, information provision, and promotional activities [ 1 , 2 ]. As the environment becomes more competitive and websites become more sophisticated, attention is turning toward increasing the quality of the website itself and quality evaluation to attract new and retain existing users [ 3 , 4 ]. What determines website quality has not been conclusively established, and there are many different definitions and meanings of the term quality, mainly in relation to the website’s purpose [ 5 ]. Traditionally, website evaluations have focused on usability, defined as “the extent to which a product can be used by specified users to achieve specified goals with effectiveness, efficiency and satisfaction in a specified context of use [ 6 ].” The design of websites and users’ needs go beyond pure usability, as increased engagement and pleasure experienced during interactions with websites can be more important predictors of website preference than usability [ 7 - 10 ]. Therefore, in the last decade, website evaluations have shifted their focus to users’ experience, employing various assessment techniques [ 11 ], with no universally accepted method or procedure for website evaluation.

This scoping study aimed to review and define existing worldwide methodologies and techniques to evaluate websites and provide a simple framework of appropriate website attributes, which could be applied to future website evaluations.

A scoping study is similar to a systematic review as it collects and reviews content in a field of interest. However, scoping studies cover a broader question and do not rigorously evaluate the quality of the studies included [ 12 ]. Scoping studies are commonly used in the fields of public services such as health and education, as they are more rapid to perform and less costly in terms of staff costs [ 13 ]. Scoping studies can be precursors to a systematic review or stand-alone studies to examine the range of research around a particular topic.

The following research question is based on the need to gain knowledge and insight from worldwide website evaluation to inform the future study design of website evaluations: what website evaluation methodologies can be robustly used to assess users’ experience?

To show how the framework of attributes and methods can be applied to evaluating a website, e-Bug, an international educational health website, will be used as a case scenario [ 14 ].

This scoping study followed a 5-stage framework and methodology, as outlined by Arksey and O’Malley [ 12 ], involving the following: (1) identifying the research question, as above; (2) identifying relevant studies; (3) study selection; (4) charting the data; and (5) collating, summarizing, and reporting the results.

Identifying Relevant Studies

Following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines [ 15 ], studies for consideration in the review were located by searching the following electronic databases: Excerpta Medica dataBASE, PsycINFO, Cochrane, Cumulative Index to Nursing and Allied Health Literature, Scopus, ACM digital library, and IEEE Xplore SPORTDiscus. The keywords used referred to the following:

• Population: websites
• Intervention: evaluation methodologies
• Outcome: user’s experience.

Table 1 shows the specific search criteria for each database. These keywords were also used to search gray literature for unpublished or working documents to minimize publication bias.

Full search strategy used to search each electronic database.

a EMBASE: Excerpta Medica database.

b CINAHL: Cumulative Index to Nursing and Allied Health Literature.

c ACM: Association for Computing Machinery.

d IEEE: Institute of Electrical and Electronics Engineers.

Study Selection

Once all sources had been systematically searched, the list of citations was exported to EndNote software to identify eligible studies. By scanning the title, and abstract if necessary, studies that did not fit the inclusion criteria were removed by 2 researchers (RA and CH). As abstracts are not always representative of the full study that follows or capture the full scope [ 16 ], if the title and abstract did not provide sufficient information, the full manuscript was examined to ascertain whether they met all the inclusion criteria, which included (1) studies focused on websites, (2) studies of evaluative methods (eg, use of questionnaire and task completion), (3) studies that reported outcomes that affect the user’s experience (eg, quality, satisfaction, efficiency, effectiveness without necessarily focusing on methodology), (4) studies carried out between 2006 and 2016, (5) studies published in English, and (6) type of study (any study design that is appropriate).

Exclusion criteria included (1) studies that focus on evaluations using solely experts and are not transferrable to user evaluations; (2) studies that are in the form of electronic book or are not freely available on the Web or through OpenAthens, the University of Bath library, or the University of the West of England library; (3)studies that evaluate banking, electronic commerce (e-commerce), or online libraries’ websites and do not have transferrable measures to a range of other websites; (4) studies that report exclusively on minority or special needs groups (eg, blind or deaf users); and (5) studies that do not meet all the inclusion criteria.

Charting the Data

The next stage involved charting key items of information obtained from studies being reviewed. Charting [ 17 ] describes a technique for synthesizing and interpreting qualitative data by sifting, charting, and sorting material according to key issues and themes. This is similar to a systematic review in which the process is called data extraction. The data extracted included general information about the study and specific information relating to, for instance, the study population or target, the type of intervention, outcome measures employed, and the study design.

The information of interest included the following: type of website, aim or purpose of the study, study populations (users and experts), sample size, setting (laboratory, real life, and remotely assessed), website attributes evaluated, process of methodology, and process of analysis.

NVivo version 10.0 software was used for this stage by 2 researchers (RA and CH) to chart the data.

Collating, Summarizing, and Reporting the Results

Although the scoping study does not seek to assess the quality of evidence, it does present an overview of all material reviewed with a narrative account of findings.

Ethics Approval and Consent to Participate

As no primary research was carried out, no ethical approval was required to undertake this scoping study. No specific reference was made to any of the participants in the individual studies, nor does this study infringe on their rights in any way.

The electronic database searches produced 6657 papers; a further 7 papers were identified through other sources. After removing duplicates (n=1058), 5606 publications remained. After titles and abstracts were examined, 784 full-text papers were read and assessed further for eligibility. Of those, 69 articles were identified as suitable by meeting all the inclusion criteria ( Figure 1 ).

Preferred Reporting Items for Systematic Reviews and Meta-Analyses flowchart of search results.

Study Characteristics

Studies referred to or used a mixture of users (72%) and experts (39%) to evaluate their websites; 54% used a controlled environment, and 26% evaluated websites remotely ( Multimedia Appendix 1 [ 2 - 4 , 11 , 18 - 85 ]). Remote usability, in its most basic form, involves working with participants who are not in the same physical location as the researcher, employing techniques such as live screen sharing or questionnaires. Advantages to remote website evaluations include the ability to evaluate using a larger number of participants as travel time and costs are not a factor, and participants are able to partake at a time that is appropriate to them, increasing the likelihood of participation and the possibility of a greater diversity of participants [ 18 ]. However, the disadvantages of remote website evaluations, in comparison with a controlled setting, are that system performance, network traffic, and the participant’s computer setup can all affect the results.

A variety of types of websites evaluated were included in this review including government (9%), online news (6%), education (1%), university (12%), and sports organizations (4%). The aspects of quality considered, and their relative importance varied according to the type of website and the goals to be achieved by the users. For example, criteria such as ease of paying or security are not very important to educational websites, whereas they are especially important for online shopping. In this sense, much attention must be paid when evaluating the quality of a website, establishing a specific context of use and purpose [ 19 ].

The context of the participants was also discussed, in relation to the generalizability of results. For example, when evaluations used potential or current users of their website, it was important that computer literacy was reflective of all users [ 20 ]. This could mean ensuring that participants with a range of computer abilities and experiences were used so that results were not biased to the most or least experienced users.

Intervention

A total of 43 evaluation methodologies were identified in the 69 studies in this review. Most of them were variations of similar methodologies, and a brief description of each is provided in Multimedia Appendix 2 . Multimedia Appendix 3 shows the methods used or described in each study.

Questionnaire

Use of questionnaires was the most common methodology referred to (37/69, 54%), including questions to rank or rate attributes and open questions to allow text feedback and suggested improvements. Questionnaires were used in a combination of before or after usability testing to assess usability and overall user experience.

Observed Browsing the Website

Browsing the website using a form of task completion with the participant, such as cognitive walkthrough, was used in 33/69 studies (48%), whereby an expert evaluator used a detailed procedure to simulate task execution and browse all particular solution paths, examining each action while determining if expected user’s goals and memory content would lead to choosing a correct option [ 30 ]. Screen capture was often used (n=6) to record participants’ navigation through the website, and eye tracking was used (n=7) to assess where the eye focuses on each page or the motion of the eye as an individual views a Web page. The think-aloud protocol was used (n=10) to encourage users to express out loud what they were looking at, thinking, doing, and feeling, as they performed tasks. This allows observers to see and understand the cognitive processes associated with task completion. Recording the time to complete tasks (n=6) and mouse movement or clicks (n=8) were used to assess the efficiency of the websites.

Qualitative Data Collection

Several forms of qualitative data collection were used in 27/69 studies (39%). Observed browsing, interviews, and focus groups were used either before or after the use of the website. Pre-website-use, qualitative research was often used to collect details of which website attributes were important for participants or what weighting participants would give to each attribute. Postevaluation, qualitative techniques were used to collate feedback on the quality of the website and any suggestions for improvements.

Automated Usability Evaluation Software

In 9/69 studies (13%), automated usability evaluation focused on developing software, tools, and techniques to speed evaluation (rapid), tools that reach a wider audience for usability testing (remote), and tools that have built-in analyses features (automated). The latter can involve assessing server logs, website coding, and simulations of user experience to assess usability [ 42 ].

Card Sorting

A technique that is often linked with assessing navigability of a website, card sorting, is useful for discovering the logical structure of an unsorted list of statements or ideas by exploring how people group items and structures that maximize the probability of users finding items (5/69 studies, 7%). This can assist with determining effective website structure.

Web Usage Analysis

Of 69 studies, 3 studies used Web usage analysis or Web analytics to identify browsing patterns by analyzing the participants’ navigational behavior. This could include tracking at the widget level, that is, combining knowledge of the mouse coordinates with elements such as buttons and links, with the layout of the HTML pages, enabling complete tracking of all user activity.

Outcomes (Attributes Used to Evaluate Websites)

Often, different terminology for website attributes was used to describe the same or similar concepts ( Multimedia Appendix 4 ). The most used website attributes that were assessed can be broken down into 8 broad categories and further subcategories:

• Usability or ease of use is the degree to which a website can be used to achieve given goals (n=58). It includes navigation such as intuitiveness, learnability, memorability, and information architecture; effectiveness such as errors; and efficiency.
• Content (n=41) includes completeness, accuracy, relevancy, timeliness, and understandability of the information.
• Web design criteria (n=29) include use of media, search engines, help resources, originality of the website, site map, user interface, multilanguage, and maintainability.
• Functionality (n=31) includes links, website speed, security, and compatibility with devices and browsers.
• Appearance (n=26) includes layout, font, colors, and page length.
• Interactivity (n=25) includes sense of community, such as ability to leave feedback and comments and email or share with a friend option or forum discussion boards; personalization; help options such as frequently answered questions or customer services; and background music.
• Satisfaction (n=26) includes usefulness, entertainment, look and feel, and pleasure.
• Loyalty (n=8) includes first impression of the website.

GoodWeb: Website Evaluation Guide

As there was such a range of methods used, a suggested guide of options for evaluating websites is presented below ( Figure 2 ), coined GoodWeb, and applied to an evaluation of e-Bug, an international educational health website [ 14 ]. Allison at al [ 86 ] show the full details of how GoodWeb has been applied and outcomes of the e-Bug website evaluation.

Framework for website evaluation.

Step 1. What Are the Important Website Attributes That Affect User's Experience of the Chosen Website?

Usability or ease of use, content, Web design criteria, functionality, appearance, interactivity, satisfaction, and loyalty were the umbrella terms that encompassed the website attributes identified or evaluated in the 69 studies in this scoping study. Multimedia Appendix 4 contains a summary of the most used website attributes that have been assessed. Recent website evaluations have shifted focus from usability of websites to an overall user’s experience of website use. A decision on which website attributes to evaluate for specific websites could come from interviews or focus groups with users or experts or a literature search of attributes used in similar evaluations.

Application

In the scenario of evaluating e-Bug or similar educational health websites, the attributes chosen to assess could be the following:

• Appearance: colors, fonts, media or graphics, page length, style consistency, and first impression
• Content: clarity, completeness, current and timely information, relevance, reliability, and uniqueness
• Interactivity: sense of community and modern features
• Ease of use: home page indication, navigation, guidance, and multilanguage support
• Technical adequacy: compatibility with other devices, load time, valid links, and limited use of special plug-ins
• Satisfaction: loyalty

These cover the main website attributes appropriate for an educational health website. If the website did not currently have features such as search engines, site map, background music, it may not be appropriate to evaluate these, but may be better suited to question whether they would be suitable additions to the website; or these could be combined under the heading modern features . Furthermore, security may not be a necessary attribute to evaluate if participant identifiable information or bank details are not needed to use the website.

Step 2. What Is the Best Way to Evaluate These Attributes?

Often, a combination of methods is suitable to evaluate a website, as 1 method may not be appropriate to assess all attributes of interest [ 29 ] (see Multimedia Appendix 3 for a summary of the most used methods for evaluating websites). For example, screen capture of task completion may be appropriate to assess the efficiency of a website but would not be the chosen method to assess loyalty. A questionnaire or qualitative interview may be more appropriate for this attribute.

In the scenario of evaluating e-Bug, a questionnaire before browsing the website would be appropriate to rank the importance of the selected website attributes, chosen in step 1. It would then be appropriate to observe browsing of the website, collecting data on completion of typical task scenarios, using the screen capture function for future reference. This method could be used to evaluate the effectiveness (number of tasks successfully completed), efficiency (whether the most direct route through the website was used to complete the task), and learnability (whether task completion is more efficient or effective second time of trying). It may then be suitable to use a follow-up questionnaire to rate e-Bug against the website attributes previously ranked. The attribute ranking and rating could then be combined to indicate where the website performs well and areas for improvement.

Step 3: Who Should Evaluate the Website?

Both users and experts can be used to evaluate websites. Experts are able to identify areas for improvements, in relation to usability; whereas, users are able to appraise quality as well as identify areas for improvement. In this respect, users are able to fully evaluate user’s experience, where experts may not be able to.

For this reason, it may be more appropriate to use current or potential users of the website for the scenario of evaluating e-Bug.

Step 4: What Setting Should Be Used?

A combination of controlled and remote settings can be used, depending on the methods chosen. For example, it may be appropriate to collect data via a questionnaire, remotely, to increase sample size and reach a more diverse audience, whereas a controlled setting may be more appropriate for task completion using eye-tracking methods.

Strengths and Limitations

A scoping study differs from a systematic review, in that it does not critically appraise the quality of the studies before extracting or charting the data. Therefore, this study cannot compare the effectiveness of the different methods or methodologies in evaluating the website attributes. However, what it does do is review and summarize a huge amount of literature, from different sources, in a format that is understandable and informative for future designs of website evaluations.

Furthermore, studies that evaluate banking, e-commerce, or online libraries’ websites and do not have transferrable measures to a range of other websites were excluded from this study. This decision was made to limit the number of studies that met the remaining inclusion criteria, and it was deemed that the website attributes for these websites would be too specialist and not necessarily transferable to a range of websites. Therefore, the findings of this study may not be generalizable to all types of website. However, Multimedia Appendix 1 shows that data were extracted from a very broad range of websites when it was deemed that the information was transferrable to a range of other websites.

A robust website evaluation can identify areas for improvement to both fulfill the goals and desires of its users [ 62 ] and influence their perception of the organization and overall quality of resources [ 48 ]. An improved website could attract and retain more online users; therefore, an evidence-based website evaluation guide is essential.

This scoping study emphasizes the fact that the debate about how to define the quality of websites remains open, and there are numerous approaches and models to evaluate it. Multimedia Appendix 2 shows existing methodologies or tools that can be used to evaluate websites. Many of these are variations of similar approaches; therefore, it is not strictly necessary to use these tools at face value; however, some could be used to guide analysis, following data collection. By following steps 1 to 4 of GoodWeb, the framework suggested in this study, taking into account the desired participants and setting and website evaluation methods, can be tailored to the needs of specific websites and individual aims of evaluations.

Acknowledgments

This work was supported by the Primary Care Unit, Public Health England. This study is not applicable as secondary research.

Abbreviations

Multimedia appendix 1, multimedia appendix 2, multimedia appendix 3, multimedia appendix 4.

Authors' Contributions: RA wrote the protocol with input from CH, CM, and VY. RA and CH conducted the scoping review. RA wrote the final manuscript with input from CH, CM, and VY. All authors reviewed and approved the final manuscript.

Conflicts of Interest: None declared.

Academia.edu no longer supports Internet Explorer.

To browse Academia.edu and the wider internet faster and more securely, please take a few seconds to  upgrade your browser .

Enter the email address you signed up with and we'll email you a reset link.

• We're Hiring!
• Help Center

A Critical Review of Research on Website Development and Design Related to Diversity Issues

Related Papers

Journal of Computer Science IJCSIS , Dr. Mahdi Miraz , Maaruf Ali

Due to mass global migration and increased usage of the Internet, it is now very important to address the cultural aspects of the usability problems of any Information and Communication Technology (ICT) products such as software, websites or applications (apps) whether to be used on PCs, Laptops, Smartphones, Tablets, Smart TVs or any other devices. To augment the " Design for All " concept, this research demonstrates the need to cater for culturally diverse users while designing user interfaces. This has been achieved, by investigating ICT products and conducting an extensive literature survey. The study concludes that it is very important to work on cross-cultural usability problems and bring these issues under focus.

Jennifer Mankoff

ABSTRACT The World Wide Web plays an important role in our society—enabling broader access to information and services than was previously available. However, Website usability and accessibility are still a problem. Numerous, automated, evaluation and transformation tools are available to help Web developers build better sites for users with diverse needs. A survey of these automated tools is presented in the context of the user abilities they support.

Jatinder Manhas

The web is one of the most revolutionary and global technique influencing every aspect of the people throughout the world including culture. The web has become the most intelligible technique throughout the world which enables distribution of services through its websites. The professionals and designers suggest that a well designed user interface is more influential and improves the performance of the website. In this paper, the authors have examined and found out the cultural influences on website design. Culture can be defined as a group of people having certain things in common which could affect the website design. The authors in this paper took different charity websites from North and South India and examined them by comparing the differences in the design with respect to culture. Authors examined these websites for 5 different parameters i.e. Information, Visual design, page layout, user input and multimedia. Findings suggest that north Indian and south Indian websites diffe...

Proceedings of CHI 2001

Carina de Villiers

Shohreh Hadian

The 40th ACM International Conference on Design of Communication

Meghalee Das

Ann Borda , Giuliano Gaia

Iosif Klironomos

International Journal of People-Oriented Programming

Renate Motschnig

Human-Centered Design focuses on the analysis, specification and involvement of a product's end users as driving elements in the design process. The primary research objective of the case-study presented in this paper is to illustrate that it is essential to include users with special needs into all major steps of designing a web-portal that provides services to these special users. But how can this be accomplished in the case of users with special cognitive and affective needs? Would the “classical” Human-Centered Design Process (HCD) be sufficient or would it need to be adapted and complemented with special procedures and tools? In this paper the design team shares the strategies they adopted and the experiences they gained by including users with dyslexia in the design of the LITERACY Web-Portal. Besides providing insight into the special effort and steps needed to adapt HCD for users with special needs, the paper encourages application designers to include end-users even tho...

Achmad Syarief

RELATED TOPICS

•   We're Hiring!
•   Help Center
• Find new research papers in:
• Health Sciences
• Earth Sciences
• Cognitive Science
• Mathematics
• Computer Science
• Academia ©2024

How To Write A Research Paper

Step-By-Step Tutorial With Examples + FREE Template

By: Derek Jansen (MBA) | Expert Reviewer: Dr Eunice Rautenbach | March 2024

For many students, crafting a strong research paper from scratch can feel like a daunting task – and rightly so! In this post, we’ll unpack what a research paper is, what it needs to do , and how to write one – in three easy steps. 🙂 

Overview: Writing A Research Paper

What (exactly) is a research paper.

• How to write a research paper
• Stage 1 : Topic & literature search
• Stage 2 : Structure & outline
• Stage 3 : Iterative writing
• Key takeaways

Let’s start by asking the most important question, “ What is a research paper? ”.

Simply put, a research paper is a scholarly written work where the writer (that’s you!) answers a specific question (this is called a research question ) through evidence-based arguments . Evidence-based is the keyword here. In other words, a research paper is different from an essay or other writing assignments that draw from the writer’s personal opinions or experiences. With a research paper, it’s all about building your arguments based on evidence (we’ll talk more about that evidence a little later).

Now, it’s worth noting that there are many different types of research papers , including analytical papers (the type I just described), argumentative papers, and interpretative papers. Here, we’ll focus on analytical papers , as these are some of the most common – but if you’re keen to learn about other types of research papers, be sure to check out the rest of the blog .

With that basic foundation laid, let’s get down to business and look at how to write a research paper .

Overview: The 3-Stage Process

While there are, of course, many potential approaches you can take to write a research paper, there are typically three stages to the writing process. So, in this tutorial, we’ll present a straightforward three-step process that we use when working with students at Grad Coach.

These three steps are:

• Finding a research topic and reviewing the existing literature
• Developing a provisional structure and outline for your paper, and
• Writing up your initial draft and then refining it iteratively

Let’s dig into each of these.

Need a helping hand?

Step 1: Find a topic and review the literature

As we mentioned earlier, in a research paper, you, as the researcher, will try to answer a question . More specifically, that’s called a research question , and it sets the direction of your entire paper. What’s important to understand though is that you’ll need to answer that research question with the help of high-quality sources – for example, journal articles, government reports, case studies, and so on. We’ll circle back to this in a minute.

The first stage of the research process is deciding on what your research question will be and then reviewing the existing literature (in other words, past studies and papers) to see what they say about that specific research question. In some cases, your professor may provide you with a predetermined research question (or set of questions). However, in many cases, you’ll need to find your own research question within a certain topic area.

Finding a strong research question hinges on identifying a meaningful research gap – in other words, an area that’s lacking in existing research. There’s a lot to unpack here, so if you wanna learn more, check out the plain-language explainer video below.

Once you’ve figured out which question (or questions) you’ll attempt to answer in your research paper, you’ll need to do a deep dive into the existing literature – this is called a “ literature search ”. Again, there are many ways to go about this, but your most likely starting point will be Google Scholar .

If you’re new to Google Scholar, think of it as Google for the academic world. You can start by simply entering a few different keywords that are relevant to your research question and it will then present a host of articles for you to review. What you want to pay close attention to here is the number of citations for each paper – the more citations a paper has, the more credible it is (generally speaking – there are some exceptions, of course).

Ideally, what you’re looking for are well-cited papers that are highly relevant to your topic. That said, keep in mind that citations are a cumulative metric , so older papers will often have more citations than newer papers – just because they’ve been around for longer. So, don’t fixate on this metric in isolation – relevance and recency are also very important.

Beyond Google Scholar, you’ll also definitely want to check out academic databases and aggregators such as Science Direct, PubMed, JStor and so on. These will often overlap with the results that you find in Google Scholar, but they can also reveal some hidden gems – so, be sure to check them out.

Once you’ve worked your way through all the literature, you’ll want to catalogue all this information in some sort of spreadsheet so that you can easily recall who said what, when and within what context. If you’d like, we’ve got a free literature spreadsheet that helps you do exactly that.

Step 2: Develop a structure and outline

With your research question pinned down and your literature digested and catalogued, it’s time to move on to planning your actual research paper .

It might sound obvious, but it’s really important to have some sort of rough outline in place before you start writing your paper. So often, we see students eagerly rushing into the writing phase, only to land up with a disjointed research paper that rambles on in multiple

Now, the secret here is to not get caught up in the fine details . Realistically, all you need at this stage is a bullet-point list that describes (in broad strokes) what you’ll discuss and in what order. It’s also useful to remember that you’re not glued to this outline – in all likelihood, you’ll chop and change some sections once you start writing, and that’s perfectly okay. What’s important is that you have some sort of roadmap in place from the start.

At this stage you might be wondering, “ But how should I structure my research paper? ”. Well, there’s no one-size-fits-all solution here, but in general, a research paper will consist of a few relatively standardised components:

• Introduction
• Literature review
• Methodology

Let’s take a look at each of these.

First up is the introduction section . As the name suggests, the purpose of the introduction is to set the scene for your research paper. There are usually (at least) four ingredients that go into this section – these are the background to the topic, the research problem and resultant research question , and the justification or rationale. If you’re interested, the video below unpacks the introduction section in more detail. 

The next section of your research paper will typically be your literature review . Remember all that literature you worked through earlier? Well, this is where you’ll present your interpretation of all that content . You’ll do this by writing about recent trends, developments, and arguments within the literature – but more specifically, those that are relevant to your research question . The literature review can oftentimes seem a little daunting, even to seasoned researchers, so be sure to check out our extensive collection of literature review content here .

With the introduction and lit review out of the way, the next section of your paper is the research methodology . In a nutshell, the methodology section should describe to your reader what you did (beyond just reviewing the existing literature) to answer your research question. For example, what data did you collect, how did you collect that data, how did you analyse that data and so on? For each choice, you’ll also need to justify why you chose to do it that way, and what the strengths and weaknesses of your approach were.

Now, it’s worth mentioning that for some research papers, this aspect of the project may be a lot simpler . For example, you may only need to draw on secondary sources (in other words, existing data sets). In some cases, you may just be asked to draw your conclusions from the literature search itself (in other words, there may be no data analysis at all). But, if you are required to collect and analyse data, you’ll need to pay a lot of attention to the methodology section. The video below provides an example of what the methodology section might look like.

By this stage of your paper, you will have explained what your research question is, what the existing literature has to say about that question, and how you analysed additional data to try to answer your question. So, the natural next step is to present your analysis of that data . This section is usually called the “results” or “analysis” section and this is where you’ll showcase your findings.

Depending on your school’s requirements, you may need to present and interpret the data in one section – or you might split the presentation and the interpretation into two sections. In the latter case, your “results” section will just describe the data, and the “discussion” is where you’ll interpret that data and explicitly link your analysis back to your research question. If you’re not sure which approach to take, check in with your professor or take a look at past papers to see what the norms are for your programme.

Alright – once you’ve presented and discussed your results, it’s time to wrap it up . This usually takes the form of the “ conclusion ” section. In the conclusion, you’ll need to highlight the key takeaways from your study and close the loop by explicitly answering your research question. Again, the exact requirements here will vary depending on your programme (and you may not even need a conclusion section at all) – so be sure to check with your professor if you’re unsure.

Step 3: Write and refine

Finally, it’s time to get writing. All too often though, students hit a brick wall right about here… So, how do you avoid this happening to you?

Well, there’s a lot to be said when it comes to writing a research paper (or any sort of academic piece), but we’ll share three practical tips to help you get started.

First and foremost , it’s essential to approach your writing as an iterative process. In other words, you need to start with a really messy first draft and then polish it over multiple rounds of editing. Don’t waste your time trying to write a perfect research paper in one go. Instead, take the pressure off yourself by adopting an iterative approach.

Secondly , it’s important to always lean towards critical writing , rather than descriptive writing. What does this mean? Well, at the simplest level, descriptive writing focuses on the “ what ”, while critical writing digs into the “ so what ” – in other words, the implications . If you’re not familiar with these two types of writing, don’t worry! You can find a plain-language explanation here.

Last but not least, you’ll need to get your referencing right. Specifically, you’ll need to provide credible, correctly formatted citations for the statements you make. We see students making referencing mistakes all the time and it costs them dearly. The good news is that you can easily avoid this by using a simple reference manager . If you don’t have one, check out our video about Mendeley, an easy (and free) reference management tool that you can start using today.

Recap: Key Takeaways

We’ve covered a lot of ground here. To recap, the three steps to writing a high-quality research paper are:

• To choose a research question and review the literature
• To plan your paper structure and draft an outline
• To take an iterative approach to writing, focusing on critical writing and strong referencing

Remember, this is just a b ig-picture overview of the research paper development process and there’s a lot more nuance to unpack. So, be sure to grab a copy of our free research paper template to learn more about how to write a research paper.

You Might Also Like:

Submit a Comment Cancel reply

Your email address will not be published. Required fields are marked *

Save my name, email, and website in this browser for the next time I comment.

• Print Friendly

web development Recently Published Documents

Total documents.

• Latest Documents
• Most Cited Documents
• Contributed Authors
• Related Sources
• Related Keywords

Website Developmemt Technologies: A Review

Abstract: Service Science is that the basis of knowledge system and net services that judge to the provider/client model. This paper developments a technique which will be utilized in the event of net services like websites, net applications and eCommerce. The goal is to development a technique that may add structure to a extremely unstructured drawback to help within the development and success of net services. The new methodology projected are going to be referred to as {the net|the online|the net} Development Life Cycle (WDLC) and tailored from existing methodologies and applied to the context of web development. This paper can define well the projected phases of the WDLC. Keywords: Web Development, Application Development, Technologies, eCommerce.

Analysis of Russian Segment of the Web Development Market Operating Online on Upwork

The Russian segment of the web services market in the online environment, on the platform of the Upwork freelance exchange, is considered, its key characteristics, the composition of participants, development trends are highlighted, and the market structure is identified. It is found that despite the low barriers to entry, the web development market is very stable, since the composition of entrenched firms that have been operating for more than six years remains. The pricing policy of most Russian companies indicates that they work in the middle price segment and have low budgets, which is due to the specifics of the foreign market and high competition.

Farming Assistant Web Services: Agricultor

Abstract: Our farming assistant web services provides assistance to new as well as establish farmers to get the solutions to dayto-day problems faced in the field. A farmer gets to connect with other farmers throughout India to get more information about a particular crop which is popular in other states. Keywords: Farmers, Assistance, Web Development

Tradução de ementas e histórico escolar para o inglês: contribuição para participação de discentes do curso técnico em informática para internet integrado ao ensino médio em programas de mobilidade acadêmica / Translation of summary and school records into english: contribution to the participation of high school with associate technical degree on web development students in academic mobility programs

Coded websites vs wordpress websites.

This document gives multiple instructions related to web developers using older as well as newer technology. Websites are being created using newer technologies like wordpress whereas on the other hand many people prefer making websites using the traditional way. This document will clear the doubt whether an individual should use wordpress websites or coded websites according to the users convenience. The Responsiveness of the websites, the use of CMS nowadays, more and more up gradation of technologies with SEO, themes, templates, etc. make things like web development much much easier. The aesthetics, the culture, the expressions, the features all together add up in order make the designing and development a lot more efficient and effective. Digital Marketing has a tremendous growth over the last two years and yet shows no signs of stopping, is closely related with the web development environment. Nowadays all businesses are going online due to which the impact of web development has become such that it has become an integral part of any online business.

Cognitive disabilities and web accessibility: a survey into the Brazilian web development community

Cognitive disabilities include a diversity of conditions related to cognitive functions, such as reading, understanding, learning, solving problems, memorization and speaking. They differ largely from each other, making them a heterogeneous complex set of disabilities. Although the awareness about cognitive disabilities has been increasing in the last few years, it is still less than necessary compared to other disabilities. The need for an investigation about this issue is part of the agenda of the Challenge 2 (Accessibility and Digital Inclusion) from GranDIHC-Br. This paper describes the results of an online exploratory survey conducted with 105 web development professionals from different sectors to understand their knowledge and barriers regarding accessibility for people with cognitive disabilities. The results evidenced three biases that potentially prevent those professionals from approaching cogni-tive disabilities: strong organizational barriers; difficulty to understand user needs related to cognitive disabilities; a knowledge gap about web accessibility principles and guidelines. Our results confirmed that web development professionals are unaware about cognitive disabilities mostly by a lack of knowledge about them, even if they understand web accessibility in a technical level. Therefore, we suggest that applied research studies focus on how to fill this knowledge gap before providing tools, artifacts or frameworks.

PERANCANGAN WEB RESPONSIVE UNTUK SISTEM INFORMASI OBAT-OBATAN

A good information system must not only be neat, effective, and resilient, but also must be user friendly and up to date. In a sense, it is able to be applied to various types of electronic devices, easily accessible at any whereand time (real time), and can be modified according to user needs in a relatively easy and simple way. Information systems are now needed by various parties, especially in the field of administration and sale of medicines for Cut Nyak Dhien Hospital. During this time, recording in books has been very ineffective and caused many problems, such as difficulty in accessing old data, asa well as the information obtained was not real time. To solve it, this research raises the theme of the appropriate information system design for the hospital concerned, by utilizing CSS Bootstrap framework and research methodology for web development, namely Web Development Life Cycle. This research resulted in a responsive system by providing easy access through desktop computers, tablets, and smartphones so that it would help the hospital in the data processing process in real time.

Web Development and performance comparison of Web Development Technologies in Node.js and Python

“tom had us all doing front-end web development”: a nostalgic (re)imagining of myspace, assessment of site classifications according to layout type in web development, export citation format, share document.

Explore millions of high-quality primary sources and images from around the world, including artworks, maps, photographs, and more.

Explore migration issues through a variety of media types

• Part of The Streets are Talking: Public Forms of Creative Expression from Around the World
• Part of The Journal of Economic Perspectives, Vol. 34, No. 1 (Winter 2020)
• Part of Cato Institute (Aug. 3, 2021)
• Part of University of California Press
• Part of Open: Smithsonian National Museum of African American History & Culture
• Part of Indiana Journal of Global Legal Studies, Vol. 19, No. 1 (Winter 2012)
• Part of R Street Institute (Nov. 1, 2020)
• Part of Leuven University Press
• Part of UN Secretary-General Papers: Ban Ki-moon (2007-2016)
• Part of Perspectives on Terrorism, Vol. 12, No. 4 (August 2018)
• Part of Leveraging Lives: Serbia and Illegal Tunisian Migration to Europe, Carnegie Endowment for International Peace (Mar. 1, 2023)
• Part of UCL Press

Harness the power of visual materials—explore more than 3 million images now on JSTOR.

Enhance your scholarly research with underground newspapers, magazines, and journals.

Explore collections in the arts, sciences, and literature from the world’s leading museums, archives, and scholars.

A free, AI-powered research tool for scientific literature

• Linda B. Buck
• Cyber Security
• Law of Demand

New & Improved API for Developers

Introducing semantic reader in beta.

Stay Connected With Semantic Scholar Sign Up What Is Semantic Scholar? Semantic Scholar is a free, AI-powered research tool for scientific literature, based at the Allen Institute for AI.

How to Write a Research Paper

Use the links below to jump directly to any section of this guide:

Research Paper Fundamentals

How to choose a topic or question, how to create a working hypothesis or thesis, common research paper methodologies, how to gather and organize evidence , how to write an outline for your research paper, how to write a rough draft, how to revise your draft, how to produce a final draft, resources for teachers .

It is not fair to say that no one writes anymore. Just about everyone writes text messages, brief emails, or social media posts every single day. Yet, most people don't have a lot of practice with the formal, organized writing required for a good academic research paper. This guide contains links to a variety of resources that can help demystify the process. Some of these resources are intended for teachers; they contain exercises, activities, and teaching strategies. Other resources are intended for direct use by students who are struggling to write papers, or are looking for tips to make the process go more smoothly.

The resources in this section are designed to help students understand the different types of research papers, the general research process, and how to manage their time. Below, you'll find links from university writing centers, the trusted Purdue Online Writing Lab, and more.

What is an Academic Research Paper?

"Genre and the Research Paper" (Purdue OWL)

There are different types of research papers. Different types of scholarly questions will lend themselves to one format or another. This is a brief introduction to the two main genres of research paper: analytic and argumentative. 

"7 Most Popular Types of Research Papers" (Personal-writer.com)

This resource discusses formats that high school students commonly encounter, such as the compare and contrast essay and the definitional essay. Please note that the inclusion of this link is not an endorsement of this company's paid service.

How to Prepare and Plan Out Writing a Research Paper

Teachers can give their students a step-by-step guide like these to help them understand the different steps of the research paper process. These guides can be combined with the time management tools in the next subsection to help students come up with customized calendars for completing their papers.

"Ten Steps for Writing Research Papers" (American University)  

This resource from American University is a comprehensive guide to the research paper writing process, and includes examples of proper research questions and thesis topics.

"Steps in Writing a Research Paper" (SUNY Empire State College)

This guide breaks the research paper process into 11 steps. Each "step" links to a separate page, which describes the work entailed in completing it.

How to Manage Time Effectively

The links below will help students determine how much time is necessary to complete a paper. If your sources are not available online or at your local library, you'll need to leave extra time for the Interlibrary Loan process. Remember that, even if you do not need to consult secondary sources, you'll still need to leave yourself ample time to organize your thoughts.

"Research Paper Planner: Timeline" (Baylor University)

This interactive resource from Baylor University creates a suggested writing schedule based on how much time a student has to work on the assignment.

"Research Paper Planner" (UCLA)

UCLA's library offers this step-by-step guide to the research paper writing process, which also includes a suggested planning calendar.

There's a reason teachers spend a long time talking about choosing a good topic. Without a good topic and a well-formulated research question, it is almost impossible to write a clear and organized paper. The resources below will help you generate ideas and formulate precise questions.

"How to Select a Research Topic" (Univ. of Michigan-Flint)

This resource is designed for college students who are struggling to come up with an appropriate topic. A student who uses this resource and still feels unsure about his or her topic should consult the course instructor for further personalized assistance.

"25 Interesting Research Paper Topics to Get You Started" (Kibin)

This resource, which is probably most appropriate for high school students, provides a list of specific topics to help get students started. It is broken into subsections, such as "paper topics on local issues."

"Writing a Good Research Question" (Grand Canyon University)

This introduction to research questions includes some embedded videos, as well as links to scholarly articles on research questions. This resource would be most appropriate for teachers who are planning lessons on research paper fundamentals.

"How to Write a Research Question the Right Way" (Kibin)

This student-focused resource provides more detail on writing research questions. The language is accessible, and there are embedded videos and examples of good and bad questions.

It is important to have a rough hypothesis or thesis in mind at the beginning of the research process. People who have a sense of what they want to say will have an easier time sorting through scholarly sources and other information. The key, of course, is not to become too wedded to the draft hypothesis or thesis. Just about every working thesis gets changed during the research process.

CrashCourse Video: "Sociology Research Methods" (YouTube)

Although this video is tailored to sociology students, it is applicable to students in a variety of social science disciplines. This video does a good job demonstrating the connection between the brainstorming that goes into selecting a research question and the formulation of a working hypothesis.

"How to Write a Thesis Statement for an Analytical Essay" (YouTube)

Students writing analytical essays will not develop the same type of working hypothesis as students who are writing research papers in other disciplines. For these students, developing the working thesis may happen as a part of the rough draft (see the relevant section below). 

"Research Hypothesis" (Oakland Univ.)

This resource provides some examples of hypotheses in social science disciplines like Political Science and Criminal Justice. These sample hypotheses may also be useful for students in other soft social sciences and humanities disciplines like History.

When grading a research paper, instructors look for a consistent methodology. This section will help you understand different methodological approaches used in research papers. Students will get the most out of these resources if they use them to help prepare for conversations with teachers or discussions in class.

"Types of Research Designs" (USC)

A "research design," used for complex papers, is related to the paper's method. This resource contains introductions to a variety of popular research designs in the social sciences. Although it is not the most intuitive site to read, the information here is very valuable. 

"Major Research Methods" (YouTube)

Although this video is a bit on the dry side, it provides a comprehensive overview of the major research methodologies in a format that might be more accessible to students who have struggled with textbooks or other written resources.

"Humanities Research Strategies" (USC)

This is a portal where students can learn about four methodological approaches for humanities papers: Historical Methodologies, Textual Criticism, Conceptual Analysis, and the Synoptic method.

"Selected Major Social Science Research Methods: Overview" (National Academies Press)

This appendix from the book  Using Science as Evidence in Public Policy , printed by National Academies Press, introduces some methods used in social science papers.

"Organizing Your Social Sciences Research Paper: 6. The Methodology" (USC)

This resource from the University of Southern California's library contains tips for writing a methodology section in a research paper.

How to Determine the Best Methodology for You

Anyone who is new to writing research papers should be sure to select a method in consultation with their instructor. These resources can be used to help prepare for that discussion. They may also be used on their own by more advanced students.

"Choosing Appropriate Research Methodologies" (Palgrave Study Skills)

This friendly and approachable resource from Palgrave Macmillan can be used by students who are just starting to think about appropriate methodologies.

"How to Choose Your Research Methods" (NFER (UK))

This is another approachable resource students can use to help narrow down the most appropriate methods for their research projects.

The resources in this section introduce the process of gathering scholarly sources and collecting evidence. You'll find a range of material here, from introductory guides to advanced explications best suited to college students. Please consult the LitCharts  How to Do Academic Research guide for a more comprehensive list of resources devoted to finding scholarly literature.

Google Scholar

Students who have access to library websites with detailed research guides should start there, but people who do not have access to those resources can begin their search for secondary literature here.

"Gathering Appropriate Information" (Texas Gateway)

This resource from the Texas Gateway for online resources introduces students to the research process, and contains interactive exercises. The level of complexity is suitable for middle school, high school, and introductory college classrooms.

"An Overview of Quantitative and Qualitative Data Collection Methods" (NSF)

This PDF from the National Science Foundation goes into detail about best practices and pitfalls in data collection across multiple types of methodologies.

"Social Science Methods for Data Collection and Analysis" (Swiss FIT)

This resource is appropriate for advanced undergraduates or teachers looking to create lessons on research design and data collection. It covers techniques for gathering data via interviews, observations, and other methods.

"Collecting Data by In-depth Interviewing" (Leeds Univ.)

This resource contains enough information about conducting interviews to make it useful for teachers who want to create a lesson plan, but is also accessible enough for college juniors or seniors to make use of it on their own.

There is no "one size fits all" outlining technique. Some students might devote all their energy and attention to the outline in order to avoid the paper. Other students may benefit from being made to sit down and organize their thoughts into a lengthy sentence outline. The resources in this section include strategies and templates for multiple types of outlines. 

"Topic vs. Sentence Outlines" (UC Berkeley)

This resource introduces two basic approaches to outlining: the shorter topic-based approach, and the longer, more detailed sentence-based approach. This resource also contains videos on how to develop paper paragraphs from the sentence-based outline.

"Types of Outlines and Samples" (Purdue OWL)

The Purdue Online Writing Lab's guide is a slightly less detailed discussion of different types of outlines. It contains several sample outlines.

"Writing An Outline" (Austin C.C.)

This resource from a community college contains sample outlines from an American history class that students can use as models.

"How to Structure an Outline for a College Paper" (YouTube)

This brief (sub-2 minute) video from the ExpertVillage YouTube channel provides a model of outline writing for students who are struggling with the idea.

"Outlining" (Harvard)

This is a good resource to consult after completing a draft outline. It offers suggestions for making sure your outline avoids things like unnecessary repetition.

As with outlines, rough drafts can take on many different forms. These resources introduce teachers and students to the various approaches to writing a rough draft. This section also includes resources that will help you cite your sources appropriately according to the MLA, Chicago, and APA style manuals.

"Creating a Rough Draft for a Research Paper" (Univ. of Minnesota)

This resource is useful for teachers in particular, as it provides some suggested exercises to help students with writing a basic rough draft. 

Rough Draft Assignment (Duke of Definition)

This sample assignment, with a brief list of tips, was developed by a high school teacher who runs a very successful and well-reviewed page of educational resources.

"Creating the First Draft of Your Research Paper" (Concordia Univ.)

This resource will be helpful for perfectionists or procrastinators, as it opens by discussing the problem of avoiding writing. It also provides a short list of suggestions meant to get students writing.

Using Proper Citations

There is no such thing as a rough draft of a scholarly citation. These links to the three major citation guides will ensure that your citations follow the correct format. Please consult the LitCharts How to Cite Your Sources guide for more resources.

Chicago Manual of Style Citation Guide

Some call  The Chicago Manual of Style , which was first published in 1906, "the editors' Bible." The manual is now in its 17th edition, and is popular in the social sciences, historical journals, and some other fields in the humanities.

APA Citation Guide

According to the American Psychological Association, this guide was developed to aid reading comprehension, clarity of communication, and to reduce bias in language in the social and behavioral sciences. Its first full edition was published in 1952, and it is now in its sixth edition.

MLA Citation Guide

The Modern Language Association style is used most commonly within the liberal arts and humanities. The  MLA Style Manual and Guide to Scholarly Publishing  was first published in 1985 and (as of 2008) is in its third edition.

Any professional scholar will tell you that the best research papers are made in the revision stage. No matter how strong your research question or working thesis, it is not possible to write a truly outstanding paper without devoting energy to revision. These resources provide examples of revision exercises for the classroom, as well as tips for students working independently.

"The Art of Revision" (Univ. of Arizona)

This resource provides a wealth of information and suggestions for both students and teachers. There is a list of suggested exercises that teachers might use in class, along with a revision checklist that is useful for teachers and students alike.

"Script for Workshop on Revision" (Vanderbilt University)

Vanderbilt's guide for leading a 50-minute revision workshop can serve as a model for teachers who wish to guide students through the revision process during classtime. 

"Revising Your Paper" (Univ. of Washington)

This detailed handout was designed for students who are beginning the revision process. It discusses different approaches and methods for revision, and also includes a detailed list of things students should look for while they revise.

"Revising Drafts" (UNC Writing Center)

This resource is designed for students and suggests things to look for during the revision process. It provides steps for the process and has a FAQ for students who have questions about why it is important to revise.

Conferencing with Writing Tutors and Instructors

No writer is so good that he or she can't benefit from meeting with instructors or peer tutors. These resources from university writing, learning, and communication centers provide suggestions for how to get the most out of these one-on-one meetings.

"Getting Feedback" (UNC Writing Center)

This very helpful resource talks about how to ask for feedback during the entire writing process. It contains possible questions that students might ask when developing an outline, during the revision process, and after the final draft has been graded.

"Prepare for Your Tutoring Session" (Otis College of Art and Design)

This guide from a university's student learning center contains a lot of helpful tips for getting the most out of working with a writing tutor.

"The Importance of Asking Your Professor" (Univ. of Waterloo)

This article from the university's Writing and Communication Centre's blog contains some suggestions for how and when to get help from professors and Teaching Assistants.

Once you've revised your first draft, you're well on your way to handing in a polished paper. These resources—each of them produced by writing professionals at colleges and universities—outline the steps required in order to produce a final draft. You'll find proofreading tips and checklists in text and video form.

"Developing a Final Draft of a Research Paper" (Univ. of Minnesota)

While this resource contains suggestions for revision, it also features a couple of helpful checklists for the last stages of completing a final draft.

Basic Final Draft Tips and Checklist (Univ. of Maryland-University College)

This short and accessible resource, part of UMUC's very thorough online guide to writing and research, contains a very basic checklist for students who are getting ready to turn in their final drafts.

Final Draft Checklist (Everett C.C.)

This is another accessible final draft checklist, appropriate for both high school and college students. It suggests reading your essay aloud at least once.

"How to Proofread Your Final Draft" (YouTube)

This video (approximately 5 minutes), produced by Eastern Washington University, gives students tips on proofreading final drafts.

"Proofreading Tips" (Georgia Southern-Armstrong)

This guide will help students learn how to spot common errors in their papers. It suggests focusing on content and editing for grammar and mechanics.

This final set of resources is intended specifically for high school and college instructors. It provides links to unit plans and classroom exercises that can help improve students' research and writing skills. You'll find resources that give an overview of the process, along with activities that focus on how to begin and how to carry out research. 

"Research Paper Complete Resources Pack" (Teachers Pay Teachers)

This packet of assignments, rubrics, and other resources is designed for high school students. The resources in this packet are aligned to Common Core standards.

"Research Paper—Complete Unit" (Teachers Pay Teachers)

This packet of assignments, notes, PowerPoints, and other resources has a 4/4 rating with over 700 ratings. It is designed for high school teachers, but might also be useful to college instructors who work with freshmen.

"Teaching Students to Write Good Papers" (Yale)

This resource from Yale's Center for Teaching and Learning is designed for college instructors, and it includes links to appropriate activities and exercises.

"Research Paper Writing: An Overview" (CUNY Brooklyn)

CUNY Brooklyn offers this complete lesson plan for introducing students to research papers. It includes an accompanying set of PowerPoint slides.

"Lesson Plan: How to Begin Writing a Research Paper" (San Jose State Univ.)

This lesson plan is designed for students in the health sciences, so teachers will have to modify it for their own needs. It includes a breakdown of the brainstorming, topic selection, and research question process. 

"Quantitative Techniques for Social Science Research" (Univ. of Pittsburgh)

This is a set of PowerPoint slides that can be used to introduce students to a variety of quantitative methods used in the social sciences.

• PDFs for all 136 Lit Terms we cover
• Downloads of 1929 LitCharts Lit Guides
• Teacher Editions for every Lit Guide
• Explanations and citation info for 40,694 quotes across 1929 books
• Downloadable (PDF) line-by-line translations of every Shakespeare play

Need something? Request a new guide .

How can we improve? Share feedback .

LitCharts is hiring!

Reference management. Clean and simple.

The top list of academic search engines

1. Google Scholar

4. science.gov, 5. semantic scholar, 6. baidu scholar, get the most out of academic search engines, frequently asked questions about academic search engines, related articles.

Academic search engines have become the number one resource to turn to in order to find research papers and other scholarly sources. While classic academic databases like Web of Science and Scopus are locked behind paywalls, Google Scholar and others can be accessed free of charge. In order to help you get your research done fast, we have compiled the top list of free academic search engines.

Google Scholar is the clear number one when it comes to academic search engines. It's the power of Google searches applied to research papers and patents. It not only lets you find research papers for all academic disciplines for free but also often provides links to full-text PDF files.

• Coverage: approx. 200 million articles
• Abstracts: only a snippet of the abstract is available
• Related articles: ✔
• References: ✔
• Cited by: ✔
• Links to full text: ✔
• Export formats: APA, MLA, Chicago, Harvard, Vancouver, RIS, BibTeX

BASE is hosted at Bielefeld University in Germany. That is also where its name stems from (Bielefeld Academic Search Engine).

• Coverage: approx. 136 million articles (contains duplicates)
• Abstracts: ✔
• Related articles: ✘
• References: ✘
• Cited by: ✘
• Export formats: RIS, BibTeX

CORE is an academic search engine dedicated to open-access research papers. For each search result, a link to the full-text PDF or full-text web page is provided.

• Coverage: approx. 136 million articles
• Links to full text: ✔ (all articles in CORE are open access)
• Export formats: BibTeX

Science.gov is a fantastic resource as it bundles and offers free access to search results from more than 15 U.S. federal agencies. There is no need anymore to query all those resources separately!

• Coverage: approx. 200 million articles and reports
• Links to full text: ✔ (available for some databases)
• Export formats: APA, MLA, RIS, BibTeX (available for some databases)

Semantic Scholar is the new kid on the block. Its mission is to provide more relevant and impactful search results using AI-powered algorithms that find hidden connections and links between research topics.

• Coverage: approx. 40 million articles
• Export formats: APA, MLA, Chicago, BibTeX

Although Baidu Scholar's interface is in Chinese, its index contains research papers in English as well as Chinese.

• Coverage: no detailed statistics available, approx. 100 million articles
• Abstracts: only snippets of the abstract are available
• Export formats: APA, MLA, RIS, BibTeX

RefSeek searches more than one billion documents from academic and organizational websites. Its clean interface makes it especially easy to use for students and new researchers.

• Coverage: no detailed statistics available, approx. 1 billion documents
• Abstracts: only snippets of the article are available
• Export formats: not available

Consider using a reference manager like Paperpile to save, organize, and cite your references. Paperpile integrates with Google Scholar and many popular databases, so you can save references and PDFs directly to your library using the Paperpile buttons:

Google Scholar is an academic search engine, and it is the clear number one when it comes to academic search engines. It's the power of Google searches applied to research papers and patents. It not only let's you find research papers for all academic disciplines for free, but also often provides links to full text PDF file.

Semantic Scholar is a free, AI-powered research tool for scientific literature developed at the Allen Institute for AI. Sematic Scholar was publicly released in 2015 and uses advances in natural language processing to provide summaries for scholarly papers.

BASE , as its name suggest is an academic search engine. It is hosted at Bielefeld University in Germany and that's where it name stems from (Bielefeld Academic Search Engine).

CORE is an academic search engine dedicated to open access research papers. For each search result a link to the full text PDF or full text web page is provided.

Science.gov is a fantastic resource as it bundles and offers free access to search results from more than 15 U.S. federal agencies. There is no need any more to query all those resources separately!

Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

• View all journals
• Explore content
• About the journal
• Publish with us
• Sign up for alerts
• CORRESPONDENCE
• 21 May 2024

Internet use and teen mental health: it’s about more than just screen time

• Linxiao Zhang 0

University of Toronto, Ontario, Canada.

You can also search for this author in PubMed   Google Scholar

Candice Odgers writes that more research is needed on the effects of social media on adolescents’ mental well-being ( Nature 628 , 29–30; 2024 ). She and others have extensively discussed methodologies for establishing causal effects (see C. L. Odgers and M. R. Jensen J. Child Psychol. Psychiatry 61 , 336–348; 2020 ), but other aspects also need further nuanced consideration.

Access options

Access Nature and 54 other Nature Portfolio journals

Get Nature+, our best-value online-access subscription

24,99 € / 30 days

cancel any time

Subscribe to this journal

Receive 51 print issues and online access

185,98 € per year

only 3,65 € per issue

Rent or buy this article

Prices vary by article type

Prices may be subject to local taxes which are calculated during checkout

Nature 629 , 757 (2024)

doi: https://doi.org/10.1038/d41586-024-01489-4

Competing Interests

The author declares no competing interests.

Related Articles

See more letters to the editor

Anglo-American bias could make generative AI an invisible intellectual cage

Correspondence 28 MAY 24

I had my white colleagues walk in a Black student’s shoes for a day

Career Q&A 28 MAY 24

Monsoons are changing in India — here’s how to climate-proof the economy

World View 28 MAY 24

The AI revolution is coming to robots: how will it change them?

News Feature 28 MAY 24

Software tools identify forgotten genes

Technology Feature 24 MAY 24

Guidelines for academics aim to lessen ethical pitfalls in generative-AI use

Nature Index 22 MAY 24

Social-media influence on teen mental health goes beyond just cause and effect

Correspondence 21 MAY 24

Interpersonal therapy can be an effective tool against the devastating effects of loneliness

Correspondence 14 MAY 24

Use fines from EU social-media act to fund research on adolescent mental health

Correspondence 09 APR 24

Postdoctoral Scholar - Organic Synthesis

Memphis, Tennessee

The University of Tennessee Health Science Center (UTHSC)

Postdoctoral Scholar - Chemical Biology

Postdoctoral scholar - clinical pharmacy & translational science, postdoctoral associate- genome editing for cell therapy.

Houston, Texas (US)

Baylor College of Medicine (BCM)

Postdoctoral Research Associate- Oncology

St. Jude Children's Research Hospital (St. Jude)

Sign up for the Nature Briefing newsletter — what matters in science, free to your inbox daily.

Quick links

• Explore articles by subject
• Guide to authors
• Editorial policies

Purdue Online Writing Lab Purdue OWL® College of Liberal Arts

Writing a Research Paper

Welcome to the Purdue OWL

This page is brought to you by the OWL at Purdue University. When printing this page, you must include the entire legal notice.

Copyright ©1995-2018 by The Writing Lab & The OWL at Purdue and Purdue University. All rights reserved. This material may not be published, reproduced, broadcast, rewritten, or redistributed without permission. Use of this site constitutes acceptance of our terms and conditions of fair use.

The Research Paper

There will come a time in most students' careers when they are assigned a research paper. Such an assignment often creates a great deal of unneeded anxiety in the student, which may result in procrastination and a feeling of confusion and inadequacy. This anxiety frequently stems from the fact that many students are unfamiliar and inexperienced with this genre of writing. Never fear—inexperience and unfamiliarity are situations you can change through practice! Writing a research paper is an essential aspect of academics and should not be avoided on account of one's anxiety. In fact, the process of writing a research paper can be one of the more rewarding experiences one may encounter in academics. What is more, many students will continue to do research throughout their careers, which is one of the reasons this topic is so important.

Becoming an experienced researcher and writer in any field or discipline takes a great deal of practice. There are few individuals for whom this process comes naturally. Remember, even the most seasoned academic veterans have had to learn how to write a research paper at some point in their career. Therefore, with diligence, organization, practice, a willingness to learn (and to make mistakes!), and, perhaps most important of all, patience, students will find that they can achieve great things through their research and writing.

The pages in this section cover the following topic areas related to the process of writing a research paper:

• Genre - This section will provide an overview for understanding the difference between an analytical and argumentative research paper.
• Choosing a Topic - This section will guide the student through the process of choosing topics, whether the topic be one that is assigned or one that the student chooses themselves.
• Identifying an Audience - This section will help the student understand the often times confusing topic of audience by offering some basic guidelines for the process.
• Where Do I Begin - This section concludes the handout by offering several links to resources at Purdue, and also provides an overview of the final stages of writing a research paper.

• I Tried Both: Apple Watch 9 vs Fitbit Charge 6
• Best Places to Print Photos Online

The Best Research and Reference Websites

Where to look when you need information

• Emporia State University
• Cloud Services
• Error Messages
• Family Tech
• Home Networking
• Around the Web

Research websites come in handy in all kinds of situations, whether you're looking for the average rainfall in the Amazon rainforest, researching Roman history, or just having fun learning to find information.

This list of the best research websites will help greatly, and most of them are updated daily with new information.

I like to pair these sites with free research organizational tools to keep track of everything I gather online.

Best Research Websites

• Library of Congress : LOC.gov lets you not only ask a librarian for help , but also search catalogs of libraries from all over the world. This is truly a huge resource that should be on your Top 10 best research sites list. Anything from Academia Sinica in Taiwan to Yale University in the U.S. is here and ready to be searched.
• ReferenceDesk.org : Dubbed "The Internet's Best Reference Source," this extremely useful web directory provides everything from business and finance information to federal government resources, scholarship details, links to newspapers and calendars, search engines, and more.
• Ask the Space Expert: NASA's source for space and science research help. Use the video links to listen to questions answered by experts. These are from 2013 through 2015.
• USA.gov : This is where you should start when looking for specific U.S. government information. Learn about the country in general or education, housing, disability services, jobs, taxes, laws, and more.
• Reference.com : Extremely simple to use with a basic layout, this reference website lets you browse by category or search by keywords to research everything from food and health to history, beauty, education, technology, vehicles, art, and more.
• Refdesk.com : Billing itself as the internet's fact-checker, this site includes in-depth research links to breaking news, editorials, Today in History, Word of the Day, and other references.
• Encyclopedia.com : The #1 online encyclopedia that lets you search over 200 reference books and encyclopedias at once. The Picks of the week is a neat section to examine each week.
• Encyclopedia Britannica : One of the world's oldest encyclopedias online; has featured posts and category listings. The company launched in the 18th century and has been publishing exclusively online since 2011.
• Purdue University Quick Reference : This site has tons of information that includes resources specific to Purdue University and surrounding areas in Indiana. It also includes an Ask a Librarian service.
• Prescriber's Digital Reference : A wonderful research tool when gathering detailed medical information. The drug name browser includes summaries (dosage, description, and more) for hundreds of drugs.
• iTools.com : Serves as a gateway for reference and research links. It uses other websites for its searches, like YouTube and Google.
• ResearchGate : Scientific knowledge from over 160 million publication pages; browse topics in categories like engineering, biology, climate change, medicine, math, and more.
• Baseball-Reference.com : Here's everything you ever wanted to know about baseball.
• FOLDOC : Free Online Dictionary of Computing is a detailed computing dictionary for researching the meaning behind computer-related tools, standards, jargon, languages, and more. The "random" button is a fun way to learn new concepts.

Depending on the type of research you're doing or how you need to reference the information, you may need quick access to books. There are lots of places to find free book downloads , textbooks , and educational movies .

Other Ways to Do Research

Search engines like Google are a great way to perform online research. You can locate books, articles, interviews, and lots more. Learn how to search better to get the most out of your research.

Another top source of expert information is your local librarian— search for libraries near you at WorldCat . Librarians are trained to find answers to obscure questions, they're friendly, and best of all, you can talk with them face to face. They often ask you questions you might not have considered, leading to even better results. You can get help from librarians online, too, through some of the sources above.

Get the Latest Tech News Delivered Every Day

• How to Use the Wayback Machine 
• 17 Best Sites to Download Free Books in 2024
• The Best Free People Search Websites
• How to Find Zip Codes and Area Codes Online
• Best Niche Search Engines
• 22 Best Places to Get Free Kindle Books in 2024
• The 8 Best Search Engines of 2024
• The 8 Best Free Genealogy Websites of 2024
• What Is a Search Engine?
• 13 Best Sites for Free Documentaries
• The 20 Best Free Learning Websites for Kids in 2024
• How Do I Make Short URLs on X (formerly Twitter)?
• The 10 Best ChatGPT Alternatives (2024)
• X Slang and Key Terms Explained
• 10 Best Web Search Tricks Everyone Should Know
• The 7 Best Free PC Game Websites of 2024

is Mainsite

• Search all IEEE websites
• Mission and vision
• IEEE at a glance
• IEEE Strategic Plan
• Organization of IEEE
• Diversity, Equity, & Inclusion
• Organizational Ethics
• Annual Report
• History of IEEE
• Volunteer resources
• IEEE Corporate Awards Program
• Financials and Statistics
• IEEE Future Directions
• IEEE for Industry (Corporations, Government, Individuals)

IEEE Climate Change

• Humanitarian and Philanthropic Opportunities
• Select an option
• Get the latest news
• Access volunteer resources (Code of Ethics, financial forms, tools and templates, and more)
• Find IEEE locations
• Get help from the IEEE Support Center
• Recover your IEEE Account username and password
• Learn about the IEEE Awards program and submit nomination
• View IEEE's organizational structure and leadership
• Apply for jobs at IEEE
• See the history of IEEE
• Learn more about Diversity, Equity & Inclusion at IEEE
• Join an IEEE Society
• Renew your membership
• Member benefits
• IEEE Contact Center
• Connect locally
• Memberships and Subscriptions Catalog
• Member insurance and discounts
• Member Grade Elevation
• Get your company engaged
• Access your Account
• Learn about membership dues
• Learn about Women in Engineering (WIE)
• Access IEEE member email
• Find information on IEEE Fellows
• Access the IEEE member directory
• Learn about the Member-Get-a-Member program
• Learn about IEEE Potentials magazine
• Learn about Student membership
• Affinity groups
• IEEE Societies
• Technical Councils
• Technical Communities
• Geographic Activities
• Working groups
• IEEE Regions
• IEEE Collabratec®
• IEEE Resource Centers
• IEEE DataPort
• See the IEEE Regions
• View the MGA Operations Manual
• Find information on IEEE Technical Activities
• Get IEEE Chapter resources
• Find IEEE Sections, Chapters, Student Branches, and other communities
• Learn how to create an IEEE Student Chapter
• Upcoming conferences
• IEEE Meetings, Conferences & Events (MCE)
• IEEE Conference Application
• IEEE Conference Organizer Education Program
• See benefits of authoring a conference paper
• Search for 2025 conferences
• Search for 2024 conferences
• Find conference organizer resources
• Register a conference
• Publish conference papers
• Manage conference finances
• Learn about IEEE Meetings, Conferences & Events (MCE)
• Visit the IEEE SA site
• Become a member of the IEEE SA
• Find information on the IEEE Registration Authority
• Obtain a MAC, OUI, or Ethernet address
• Access the IEEE 802.11™ WLAN standard
• Purchase standards
• Get free select IEEE standards
• Purchase standards subscriptions on IEEE Xplore®
• Get involved with standards development
• Find a working group
• Find information on IEEE 802.11™
• Access the National Electrical Safety Code® (NESC®)
• Find MAC, OUI, and Ethernet addresses from Registration Authority (regauth)
• Get free IEEE standards
• Learn more about the IEEE Standards Association
• View Software and Systems Engineering Standards
• IEEE Xplore® Digital Library
• Subscription options
• IEEE Spectrum
• The Institute
• Proceedings of the IEEE
• IEEE Access®
• Author resources
• Get an IEEE Xplore Digital Library trial for IEEE members
• Review impact factors of IEEE journals
• Request access to the IEEE Thesaurus and Taxonomy
• Access the IEEE copyright form
• Find article templates in Word and LaTeX formats
• Get author education resources
• Visit the IEEE Xplore digital library
• Find Author Digital Tools for IEEE paper submission
• Review the IEEE plagiarism policy
• Get information about all stages of publishing with IEEE
• IEEE Learning Network (ILN)
• IEEE Credentialing Program
• Pre-university
• IEEE-Eta Kappa Nu
• Accreditation
• Access continuing education courses on the IEEE Learning Network
• Find STEM education resources on TryEngineering.org
• Learn about the TryEngineering Summer Institute for high school students
• Explore university education program resources
• Access pre-university STEM education resources
• Learn about IEEE certificates and how to offer them
• Find information about the IEEE-Eta Kappa Nu honor society
• Learn about resources for final-year engineering projects
• Access career resources

Conferences

Ieee sponsors over 2,000 annual conferences and events worldwide, curating cutting-edge content for all of the technical fields of interest within ieee..

Expand All | Collapse All

• > Search for 2025 conferences
• > Search for 2024 conferences
• > Find conference organizer resources
• > Apply for IEEE sponsorship
• > Publish conference papers
• > Manage conference finances
• > Learn about IEEE Meetings, Conferences & Events (MCE)

• Register now
• Search all IEEE conferences

Registration is open—register today!

• 2024 46th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC)
• 2024 IEEE AUTOTESTCON
• 2024 IEEE SustainTech Expo: Technology Solutions for a Sustainable Future (SustainTech)

Calls for Papers

• 2024 IEEE Asian Solid-State Circuits Conference (A-SSCC)
• 2024 31st IEEE International Conference on Electronics, Circuits and Systems (ICECS)

IEEE Conferences, Events & Experiences

IEEE Conferences, Events & Experiences (CEE) is a dedicated partner made up of event industry experts driven to shape innovative and high-quality events.

CEE specializes in event management including registration, audience development, and program design, as well as sponsorship, publications, and financial management for over 2,000 annual events worldwide.

• Visit the CEE website

The CEE team is available to assist you.

Email  [email protected]  with questions or concerns, or call: Toll-Free: +1 855 340 4333 (US & Canada) Toll: +1 732 562 3878 (worldwide)

Virtual Events team  

• View the presentation (PPTX, 3 MB)

IEEE Conference Application  

• Submit an IEEE Conference Application
• View tutorials on the IEEE Conference Application
• Read about the IEEE Conference Application

Conference publications

IEEE produces cutting-edge conference publications in various technology areas that are recognized by academia and industry worldwide. Articles submitted for publication follow a paper-selection process and are peer reviewed before they are published.

• Learn more about IEEE conference publications (PDF, 2 MB)
• Browse conference publications in the IEEE Xplore® Digital Library
• Learn more about the IEEE Conference Publications Committee

Calls for papers

IEEE provides the right forum for authors and speakers to present their work at various annual conferences worldwide. IEEE continuously updates its database with opportunities to submit abstracts and papers.

• Search for upcoming call for papers deadlines in your field of interest

IEEE Conferences Committee

* IEEE volunteers and staff must use their IEEE Account to access content within the IEEE Technical Activities Operations site. In some instances, access to certain content areas is further limited based on IEEE volunteer roles.

• Learn more about the IEEE Conferences Committee (PDF, 2 MB)
• Search for IEEE Committee Meetings - use filter: IEEE Conferences Committee (sign-in required)
• View IEEE Organizational Roster - IEEE Conferences Committee (sign-in required)

Local meetings and events

IEEE provides its members and volunteers with networking and interaction opportunities through local meetings and events hosted by the local Sections, Chapters, and other regional governing bodies.

• Find a local Section or Chapter meeting

Related Information >

Join/Renew IEEE or a Society

Receive member access to select content, product discounts, and more.

• Review all member benefits

The IEEE App

Let's stay connected.

• Download today

Sustainable events

Find guidance, online tools, and resources for designing and supporting sustainable IEEE events.

IEEE is committed to helping combat and mitigate the effects of climate change.  

• See what's new on the IEEE Climate Change site

Numbers, Facts and Trends Shaping Your World

Read our research on:

Full Topic List

Regions & Countries

• Publications
• Our Methods
• Short Reads
• Tools & Resources

Read Our Research On:

When Online Content Disappears

38% of webpages that existed in 2013 are no longer accessible a decade later, table of contents.

• Webpages from the last decade
• Links on government websites
• Links on news websites
• Reference links on Wikipedia
• Posts on Twitter
• Acknowledgments
• Collection and analysis of Twitter data
• Data collection for World Wide Web websites, government websites and news websites
• Data collection for Wikipedia source links
• Evaluating the status of pages and links
• Definition of links

Pew Research Center conducted the analysis to examine how often online content that once existed becomes inaccessible. One part of the study looks at a representative sample of webpages that existed over the past decade to see how many are still accessible today. For this analysis, we collected a sample of pages from the Common Crawl web repository for each year from 2013 to 2023. We then tried to access those pages to see how many still exist.

A second part of the study looks at the links on existing webpages to see how many of those links are still functional. We did this by collecting a large sample of pages from government websites, news websites and the online encyclopedia Wikipedia .

We identified relevant news domains using data from the audience metrics company comScore and relevant government domains (at multiple levels of government) using data from get.gov , the official administrator for the .gov domain. We collected the news and government pages via Common Crawl and the Wikipedia pages from an archive maintained by the Wikimedia Foundation . For each collection, we identified the links on those pages and followed them to their destination to see what share of those links point to sites that are no longer accessible.

A third part of the study looks at how often individual posts on social media sites are deleted or otherwise removed from public view. We did this by collecting a large sample of public tweets on the social media platform X (then known as Twitter) in real time using the Twitter Streaming API. We then tracked the status of those tweets for a period of three months using the Twitter Search API to monitor how many were still publicly available. Refer to the report methodology for more details.

The internet is an unimaginably vast repository of modern life, with hundreds of billions of indexed webpages. But even as users across the world rely on the web to access books, images, news articles and other resources, this content sometimes disappears from view.

A new Pew Research Center analysis shows just how fleeting online content actually is:

• A quarter of all webpages that existed at one point between 2013 and 2023 are no longer accessible, as of October 2023. In most cases, this is because an individual page was deleted or removed on an otherwise functional website.

• For older content, this trend is even starker. Some 38% of webpages that existed in 2013 are not available today, compared with 8% of pages that existed in 2023.

This “digital decay” occurs in many different online spaces. We examined the links that appear on government and news websites, as well as in the “References” section of Wikipedia pages as of spring 2023. This analysis found that:

• 23% of news webpages contain at least one broken link, as do 21% of webpages from government sites. News sites with a high level of site traffic and those with less are about equally likely to contain broken links. Local-level government webpages (those belonging to city governments) are especially likely to have broken links.
• 54% of Wikipedia pages contain at least one link in their “References” section that points to a page that no longer exists.

To see how digital decay plays out on social media, we also collected a real-time sample of tweets during spring 2023 on the social media platform X (then known as Twitter) and followed them for three months. We found that:

• Nearly one-in-five tweets are no longer publicly visible on the site just months after being posted. In 60% of these cases, the account that originally posted the tweet was made private, suspended or deleted entirely. In the other 40%, the account holder deleted the individual tweet, but the account itself still existed.
• Certain types of tweets tend to go away more often than others. More than 40% of tweets written in Turkish or Arabic are no longer visible on the site within three months of being posted. And tweets from accounts with the default profile settings are especially likely to disappear from public view.

How this report defines inaccessible links and webpages

There are many ways of defining whether something on the internet that used to exist is now inaccessible to people trying to reach it today. For instance, “inaccessible” could mean that:

• The page no longer exists on its host server, or the host server itself no longer exists. Someone visiting this type of page would typically receive a variation on the “404 Not Found” server error instead of the content they were looking for.
• The page address exists but its content has been changed – sometimes dramatically – from what it was originally.
• The page exists but certain users – such as those with blindness or other visual impairments – might find it difficult or impossible to read.

For this report, we focused on the first of these: pages that no longer exist. The other definitions of accessibility are beyond the scope of this research.

Our approach is a straightforward way of measuring whether something online is accessible or not. But even so, there is some ambiguity.

First, there are dozens of status codes indicating a problem that a user might encounter when they try to access a page. Not all of them definitively indicate whether the page is permanently defunct or just temporarily unavailable. Second, for security reasons, many sites actively try to prevent the sort of automated data collection that we used to test our full list of links.

For these reasons, we used the most conservative estimate possible for deciding whether a site was actually accessible or not. We counted pages as inaccessible only if they returned one of nine error codes that definitively indicate that the page and/or its host server no longer exist or have become nonfunctional – regardless of how they are being accessed, and by whom. The full list of error codes that we included in our definition are in the methodology .

Here are some of the findings from our analysis of digital decay in various online spaces.

To conduct this part of our analysis, we collected a random sample of just under 1 million webpages from the archives of Common Crawl , an internet archive service that periodically collects snapshots of the internet as it exists at different points in time. We sampled pages collected by Common Crawl each year from 2013 through 2023 (approximately 90,000 pages per year) and checked to see if those pages still exist today.

We found that 25% of all the pages we collected from 2013 through 2023 were no longer accessible as of October 2023. This figure is the sum of two different types of broken pages: 16% of pages are individually inaccessible but come from an otherwise functional root-level domain; the other 9% are inaccessible because their entire root domain is no longer functional.

Not surprisingly, the older snapshots in our collection had the largest share of inaccessible links. Of the pages collected from the 2013 snapshot, 38% were no longer accessible in 2023. But even for pages collected in the 2021 snapshot, about one-in-five were no longer accessible just two years later.

We sampled around 500,000 pages from government websites using the Common Crawl March/April 2023 snapshot of the internet, including a mix of different levels of government (federal, state, local and others). We found every link on each page and followed a random selection of those links to their destination to see if the pages they refer to still exist.

Across the government websites we sampled, there were 42 million links. The vast majority of those links (86%) were internal, meaning they link to a different page on the same website. An explainer resource on the IRS website that links to other documents or forms on the IRS site would be an example of an internal link.

Around three-quarters of government webpages we sampled contained at least one on-page link. The typical (median) page contains 50 links, but many pages contain far more. A page in the 90th percentile contains 190 links, and a page in the 99th percentile (that is, the top 1% of pages by number of links) has 740 links.

Other facts about government webpage links:

• The vast majority go to secure HTTP pages (and have a URL starting with “https://”).
• 6% go to a static file, like a PDF document.
• 16% now redirect to a different URL than the one they originally pointed to.

When we followed these links, we found that 6% point to pages that are no longer accessible. Similar shares of internal and external links are no longer functional.

Overall, 21% of all the government webpages we examined contained at least one broken link. Across every level of government we looked at, there were broken links on at least 14% of pages; city government pages had the highest rates of broken links.

For this analysis, we sampled 500,000 pages from 2,063 websites classified as “News/Information” by the audience metrics firm comScore. The pages were collected from the Common Crawl March/April 2023 snapshot of the internet.

Across the news sites sampled, this collection contained more than 14 million links pointing to an outside website. 1 Some 94% of these pages contain at least one external-facing link. The median page contains 20 links, and pages in the top 10% by link count have 56 links.

Like government websites, the vast majority of these links go to secure HTTP pages (those with a URL beginning with “https://”). Around 12% of links on these news sites point to a static file, like a PDF document. And 32% of links on news sites redirected to a different URL than the one they originally pointed to – slightly less than the 39% of external links on government sites that redirect.

When we tracked these links to their destination, we found that 5% of all links on news site pages are no longer accessible. And 23% of all the pages we sampled contained at least one broken link.

Broken links are about as prevalent on the most-trafficked news websites as they are on the least-trafficked sites. Some 25% of pages on news websites in the top 20% by site traffic have at least one broken link. That is nearly identical to the 26% of sites in the bottom 20% by site traffic.

For this analysis, we collected a random sample of 50,000 English-language Wikipedia pages and examined the links in their “References” section. The vast majority of these pages (82%) contain at least one reference link – that is, one that directs the reader to a webpage other than Wikipedia itself.

In total, there are just over 1 million reference links across all the pages we collected. The typical page has four reference links.

The analysis indicates that 11% of all references linked on Wikipedia are no longer accessible. On about 2% of source pages containing reference links, every link on the page was broken or otherwise inaccessible, while another 53% of pages contained at least one broken link.

For this analysis, we collected nearly 5 million tweets posted from March 8 to April 27, 2023, on the social media platform X, which at the time was known as Twitter. We did this using Twitter’s Streaming API, collecting 3,000 public tweets every 30 minutes in real time. This provided us with a representative sample of all tweets posted on the platform during that period. We monitored those tweets until June 15, 2023, and checked each day to see if they were still available on the site or not.

At the end of the observation period, we found that 18% of the tweets from our initial collection window were no longer publicly visible on the site . In a majority of cases, this was because the account that originally posted the tweet was made private, suspended or deleted entirely. For the remaining tweets, the account that posted the tweet was still visible on the site, but the individual tweet had been deleted.

Which tweets tend to disappear?

Tweets were especially likely to be deleted or removed over the course of our collection period if they were:

• Written in certain languages. Nearly half of all the Turkish-language tweets we collected – and a slightly smaller share of those written in Arabic – were no longer available at the end of the tracking period.
• Posted by accounts using the site’s default profile settings. More than half of tweets from accounts using the default profile image were no longer available at the end of the tracking period, as were more than a third from accounts with a default bio field. Tweets from these accounts tend to disappear because the entire account has been deleted or made private, as opposed to the individual tweet being deleted.
• Posted by unverified accounts.

We also found that removed or deleted tweets tended to come from newer accounts with relatively few followers and modest activityon the site. On average, tweets that were no longer visible on the site were posted by accounts around eight months younger than those whose tweets stayed on the site.

And when we analyzed the types of tweets that were no longer available, we found that retweets, quote tweets and original tweets did not differ much from the overall average. But replies were relatively unlikely to be removed – just 12% of replies were inaccessible at the end of our monitoring period.

Most tweets that are removed from the site tend to disappear soon after being posted. In addition to looking at how many tweets from our collection were still available at the end of our tracking period, we conducted a survival analysis to see how long these tweets tended to remain available. We found that:

• 1% of tweets are removed within one hour
• 3% within a day
• 10% within a week
• 15% within a month

Put another way: Half of tweets that are eventually removed from the platform are unavailable within the first six days of being posted. And 90% of these tweets are unavailable within 46 days.

Tweets don’t always disappear forever, though. Some 6% of the tweets we collected disappeared and then became available again at a later point. This could be due to an account going private and then returning to public status, or to the account being suspended and later reinstated. Of those “reappeared” tweets, the vast majority (90%) were still accessible on Twitter at the end of the monitoring period.

• For our analysis of news sites, we did not collect or check the functionality of internal-facing on-page links – those that point to another page on the same root domain. ↩

Sign up for our weekly newsletter

Fresh data delivery Saturday mornings

Sign up for The Briefing

Weekly updates on the world of news & information

• Internet & Technology
• Online Search
• Public Knowledge

Electric Vehicle Charging Infrastructure in the U.S.

A quarter of u.s. teachers say ai tools do more harm than good in k-12 education, teens and video games today, americans’ views of technology companies, 6 facts about americans and tiktok, most popular, report materials.

1615 L St. NW, Suite 800 Washington, DC 20036 USA (+1) 202-419-4300 | Main (+1) 202-857-8562 | Fax (+1) 202-419-4372 |  Media Inquiries

Research Topics

• Email Newsletters

ABOUT PEW RESEARCH CENTER  Pew Research Center is a nonpartisan fact tank that informs the public about the issues, attitudes and trends shaping the world. It conducts public opinion polling, demographic research, media content analysis and other empirical social science research. Pew Research Center does not take policy positions. It is a subsidiary of  The Pew Charitable Trusts .

Copyright 2024 Pew Research Center

Special Features

Vendor voice.

Personal Tech

Pew: Quarter of web pages vanished in past decade

Luckily we have the wayback machine.

The web is melting away like so many glaciers these days.

A report published by the Pew Research Center finds that digital decay is erasing online news, Twitter/X posts, and web links.

The Pew team - Athena Chapekis, Samuel Bestvater, Emma Remy, and Gonzalo Rivero - found that 25 percent of web pages that existed at some point between 2013 and October 2023 no longer function. As for older web pages that existed before 2013, 38 percent can no longer be accessed. As a point of comparison, about 8 percent of web pages from 2023 have disappeared.

The study, based on an analysis of web crawl data from Common Crawl , some 50,000 Wikipedia articles, and Twitter/X posts from last year, confirms longstanding concerns about the ephemeral nature of digital content.

"The internet is an unimaginably vast repository of modern life, with hundreds of billions of indexed webpages," Pew says. "But even as users across the world rely on the web to access books, images, news articles and other resources, this content sometimes disappears from view."

This has particular implications for news and government websites. A sample of half a million news pages from Common Crawl in March/April 2023 found that 23 percent had at least one broken link. For government websites – the same size sample during the same period – 21 percent had at least one broken link.

In a sample of 50,000 English-language Wikipedia pages, 82 percent included at least one reference link – a cited source – and 11 percent of these are no longer accessible. This makes fact checking much more difficult.

For the social media platform X, which was still referred to as Twitter during the March 8 to April 27, 2023 sample period, some 18 percent of 5 million tweets were no longer accessible by June 15 of that year. Some had been suspended, some had been removed, and some had been made private.

Among the portion of tweets that got removed, half vanished within the first six days of posting, and 90 percent were no longer available within 46 days.

Twitter posts, however, also get resurrected – about 6 percent resurface at some point, a phenomenon the researchers attribute to accounts that went private and then returned to public status, or suspended accounts that got reinstated.

• The internet – not as great as we all thought it was going to be, eh?
• How the Internet Archive faces potential destruction at the hands of Big Four publishers
• Internet Archive's 2046 Wayforward Machine says Google will cease to exist

Mark Graham, director of the Wayback Machine at the non-profit Internet Archive, told The Register : "This is why we do what we do."

The Wayback Machine crawls the web and archives copies of websites for posterity.

"We have identified and fixed more than 21 million broken URLs in Wikipedia articles, replacing them with archived versions of those web resources from The Wayback Machine," he explained.

Graham said the consequence of digital decay is the loss of our collective history. "When a society or people lose the ability to cite and compare and contrast, they lose the ability to do any kind of critical analysis or contextualize current events."

"We operate in the forever-now," he said. "We lose access to our memory. The ability to contextualize the events of our times depends upon having a record of our times." ®

• World Wide Web

Narrower topics

• Domain Name
• Federal government of the United States
• Government of the United Kingdom
• Insider Trading
• Search Engine
• Voice over IP

Broader topics

• Tim Berners-Lee

Send us news

Other stories you might like

Uncle sam's had enough of live nation and ticketmaster, sues to end monopoly, wiley shuts 19 scholarly journals amid ai paper mill problems, google i/o is google a/i as search biz goes all-in on ai, the sky’s the limit for 5g app developers.

Big brains divided over training AI with more AI: Is model collapse inevitable?

Critical infrastructure security will stay poor until everyone pulls together, and it begins. openai mulls nsfw ai model output, deepmind spinoff isomorphic claims alphafold 3 predicts bio-matter down to the dna, ml suggests all that relaxing whale song might just be human-esque gossiping, semiconductor digital twins to sip $285m from america's chips act funding pool, some scientists can't stop using ai to write research papers, relax, google's drop in search market share in april was just an illusion.

• Advertise with us

Our Websites

• The Next Platform
• Blocks and Files

Your Privacy

• Cookies Policy
• Privacy Policy
• Ts & Cs

Copyright. All rights reserved © 1998–2024

• Media and Speeches
• Completed research

A snapshot of inequality in Australia

Research paper.

Released 20 / 05 / 2024

This paper provides an update on the state of economic inequality in Australia, reviewing the period of the COVID-19 induced recession and recovery. It also deep dives into economic inequality for three cohorts:

• older people
• Aboriginal and Torres Strait Islander people.

• A snapshot of inequality in Australia (PDF 1.2 MB)
• A snapshot of inequality in Australia (Word 8.4 MB)

Media release

New research provides a snapshot of inequality in australia.

New research from the Productivity Commission has unpacked changes to income and wealth levels during the COVID-19 pandemic.

“The initial pandemic period saw an unprecedented decline in income inequality. The incomes of lower-income households grew rapidly in relative terms in the early stages of the pandemic, due to the massive increase in support payments from the Government,” said Commissioner Catherine de Fontenay.

“Income inequality increased later in the pandemic period as the economy recovered and government support was phased out.”

The report also finds that wealth inequality fell across the pandemic period.

“Some lower-income Australians were able to save or reduce debt due to early government support. And although house prices soared during the pandemic period, the strongest price increases were in regional areas where house prices are lower. This all had the effect of reducing wealth inequality,” said Commissioner de Fontenay.

The report examines three cohorts in closer detail: older people, women, and Aboriginal and Torres Strait Islander people.

The report finds that while older Australians have relatively low incomes compared to working age Australians, many have significant wealth they can draw on to fund their spending.

“When you look at wealth and income together, older Australians are doing better on average than younger Australians,” said Commissioner de Fontenay.

The report also examines gender differences in income and wealth. It finds that women still have lower income than men at all levels of the distribution, but that the share of women at the top of the income distribution has increased.

“We are seeing some improvements in the income gap between men and women consistent with an increase in women’s workforce participation and a declining gender pay gap,” said Commissioner de Fontenay.

The gap between the average incomes of Aboriginal and Torres Strait Islander people and the Australian average income narrowed slightly early in the pandemic before widening in 2022.

“Economic measures provide only a partial indicator for overall wellbeing. This is a particularly significant consideration in the case of Aboriginal and Torres Strait Islander people, for whom wellbeing encompasses cultural identity, community connections and other measures of quality of life,” said Commissioner de Fontenay.

Media requests

Simon Kinsmore – 02 6240 3330 / [email protected]

• Preliminaries: Cover, Copyright and publication detail, Contents and Acknowledgements
• Executive summary
• 1.1 What is economic inequality and why examine it again?
• 1.2 How to measure inequality – a policymaker’s toolkit
• 2.1 Income inequality
• 2.2 Wealth inequality
• 2.3 Measures of potential and actual consumption
• 3.1 Variations in income and transfers across age groups
• 3.2 Measures of potential and actual consumption suggest less inequality between age groups
• 4.1 Income snapshot by gender
• 4.2 Gender differences in transfer payments
• 4.3 Men tend to have more assets and debts than women
• 5.1 Wellbeing encompasses more than income
• 5.2 Changes in income during the pandemic
• 5.3 Geography matters for Aboriginal and Torres Strait Islander incomes
• 5.4 Age and gender inequality within Aboriginal and Torres Strait Islander incomes
• A.1 Equivalised measures
• A.2 Calculating income
• A.3 Data sources

Printed copies

Printed copies of this report can be purchased from Canprint Communications.

Leveraging digital technology in healthcare

We value your comments about this publication and encourage you to provide feedback.

Submit publications feedback

Suggestions or feedback?

MIT News | Massachusetts Institute of Technology

• Machine learning
• Social justice
• Black holes
• Classes and programs

Departments

• Aeronautics and Astronautics
• Brain and Cognitive Sciences
• Architecture
• Political Science
• Mechanical Engineering

Centers, Labs, & Programs

• Abdul Latif Jameel Poverty Action Lab (J-PAL)
• Picower Institute for Learning and Memory
• Lincoln Laboratory
• School of Architecture + Planning
• School of Engineering
• School of Humanities, Arts, and Social Sciences
• Sloan School of Management
• School of Science
• MIT Schwarzman College of Computing

In international relations, it’s the message, not the medium

Press contact :, media download.

*Terms of Use:

Images for download on the MIT News office website are made available to non-commercial entities, press and the general public under a Creative Commons Attribution Non-Commercial No Derivatives license . You may not alter the images provided, other than to crop them to size. A credit line must be used when reproducing images; if one is not provided below, credit the images to "MIT."

Previous image Next image

Over 180 world leaders maintain social media accounts, and some of them issue policy warnings to rivals and the public on these platforms rather than relying on traditional government statements. How seriously do people take such social media postings?

A new study suggests the general public and policymakers alike take leaders’ social media posts just as seriously as they take formal government statements. The research, by MIT political scientists, deploys novel surveys of both the public and experienced foreign policy specialists.

“What we find, which is really surprising, across both expert audiences and public audiences, is that tweets are not necessarily seen as this form of cheap talk,” says Erik Lin-Greenberg, an MIT faculty member and co-author of a new paper detailing the results. “They’re viewed as the same type of signal as that being offered through more formal and traditional communications.”

The findings suggest that people have become so fully acclimatized to social media that they regard the medium as a vehicle for messages that have just as much credibility as those generated through the old-school method, in which official statements are released in formal language on official government documents.

“One clue that sheds some light on our unexpected findings is that a slight majority of our survey respondents who read a tweet identified what they read as a White House press release,” says Benjamin Norwood Harris, an MIT doctoral candidate and co-author of the paper. “Respondents really seemed to believe that tweets were just another way presidents communicate in their official capacity.”

The paper, “ Cheap Tweets?: Crisis Signaling in the Age of Twitter ,” appears in the June issue of International Studies Quarterly . Greenberg is the Leo Marx Career Development Assistant Professor of the History and Culture of Science and Technology at MIT; Harris is a PhD candidate in MIT’s Department of Political Science who specializes in security studies and international relations.

The study fits into a larger body of political science research in the area of “crisis signaling” — the way words and actions in international relations are interpreted, which is often critical to diplomacy. However, when it comes to the use of social media, “There’s been very little research that looks at the credibility of public signals,” Lin-Greenberg notes.

The research consisted of a multilayered set of surveys, conducted in 2021. Using the survey platform Lucid, the scholars surveyed 977 members of the general public about a hypothetical confrontation between the U.S. and Iran, using facsimiles of messages on Twitter (now known as X) and formal White House statements that might have been sent by U.S. President Joe Biden during such a scenario. Separately, the scholars also recruited foreign policy experts from the U.S., India, and Singapore, which all have active English-language think tank spheres, to take the same survey.

Asked to rate the credibility of tweets and official statements on a five-point scale, the public rated official press releases at 3.30 and tweets at 3.22. The policy experts gave a 3.10 rating to the official statement, and a 3.11 rating to the tweets.

“No matter how we cut the data, we just don’t see much difference in how respondents rated Tweets versus official statements,” Harris says. “Even when we vary the formality of the tweet language — including things like all caps and lots of exclamation points — we don’t find an effect.”

A follow-up layer of the survey then asked respondents about a related hypothetical conflict between the U.S. and Iran in 2026, with facsimile tweets and White House statements attributed to both Biden and former president Donald Trump, given that either could be president then. The aim was to see if different leaders influenced perceptions of the two forms of statements.

But in this instance, the public and policy experts regarded tweets and official statements virtually equally seriously. Trump’s statements were given slightly more credibility overall, but with a strong partisan divide: Liberals took Biden’s statements to have more credibility, and conservatives took Trump’s statements to have more credibility.

Overall, the study suggests that many people are simply unaffected by the medium in which a global leader might choose to issue a warning to leaders of other nations. In the surveys, participants were given the opportunity to describe qualitatively what shaped their responses; only about 2 percent cited the medium as an issue.

As Harris notes, the survey data also indicate that slightly more than 51 percent of respondents believed a tweet constituted an officially released government statement. Additionally, about 73 percent of respondents thought tweets were generated in the same way as statements that have the official imprint of a national government.

“People who see a tweet don’t really differentiate it in their minds. They don’t think the tweet is not an official statement,” Lin-Greenberg says. “About three-quarters of the population think it’s coordinated, whether it’s a tweet or an official statement.”

In the paper, the scholars suggest there is considerable room for follow-up research in this area. Among other things, future studies might compare the effect of social media statements to other types of communication, such as speeches. Scholars might also study other social media platforms or broaden the set of countries being studied. Such research, Lin-Greenberg and Harris conclude in the paper, “will further enrich our understanding of the interactions between emerging technology and international politics.”

Share this news article on:

Related links.

• Erik Lin-Greenberg
• Department of Political Science

Related Topics

• Political science
• Social media
• Technology and society
• School of Humanities Arts and Social Sciences

Related Articles

On social media platforms, more sharing means less caring about accuracy

Empowering social media users to assess content helps fight misinformation

Why social media has changed the world — and how to fix it

Previous item Next item

More MIT News

A modest intervention that helps low-income families beat the poverty trap

Read full story →

Understanding why autism symptoms sometimes improve amid fever

School of Engineering welcomes new faculty

Study explains why the brain can robustly recognize images, even without color

Turning up the heat on next-generation semiconductors

Sarah Millholland receives 2024 Vera Rubin Early Career Award

• More news on MIT News homepage →

Massachusetts Institute of Technology 77 Massachusetts Avenue, Cambridge, MA, USA

• Map (opens in new window)
• Events (opens in new window)
• People (opens in new window)
• Careers (opens in new window)
• Accessibility
• Social Media Hub
• MIT on Facebook
• MIT on YouTube
• MIT on Instagram