thesis research questionnaires

How to Design Effective Research Questionnaires for Robust Findings

As a staple in data collection, questionnaires help uncover robust and reliable findings that can transform industries, shape policies, and revolutionize understanding. Whether you are exploring societal trends or delving into scientific phenomena, the effectiveness of your research questionnaire can make or break your findings.

In this article, we aim to understand the core purpose of questionnaires, exploring how they serve as essential tools for gathering systematic data, both qualitative and quantitative, from diverse respondents. Read on as we explore the key elements that make up a winning questionnaire, the art of framing questions which are both compelling and rigorous, and the careful balance between simplicity and depth.

Table of Contents

The Role of Questionnaires in Research

So, what is a questionnaire? A questionnaire is a structured set of questions designed to collect information, opinions, attitudes, or behaviors from respondents. It is one of the most commonly used data collection methods in research. Moreover, questionnaires can be used in various research fields, including social sciences, market research, healthcare, education, and psychology. Their adaptability makes them suitable for investigating diverse research questions.

Questionnaire and survey  are two terms often used interchangeably, but they have distinct meanings in the context of research. A survey refers to the broader process of data collection that may involve various methods. A survey can encompass different data collection techniques, such as interviews , focus groups, observations, and yes, questionnaires.

Pros and Cons of Using Questionnaires in Research:

While questionnaires offer numerous advantages in research, they also come with some disadvantages that researchers must be aware of and address appropriately. Careful questionnaire design, validation, and consideration of potential biases can help mitigate these disadvantages and enhance the effectiveness of using questionnaires as a data collection method.

Structured vs Unstructured Questionnaires

Structured questionnaire:.

A structured questionnaire consists of questions with predefined response options. Respondents are presented with a fixed set of choices and are required to select from those options. The questions in a structured questionnaire are designed to elicit specific and quantifiable responses. Structured questionnaires are particularly useful for collecting quantitative data and are often employed in surveys and studies where standardized and comparable data are necessary.

Advantages of Structured Questionnaires:

• Easy to analyze and interpret: The fixed response options facilitate straightforward data analysis and comparison across respondents.
• Efficient for large-scale data collection: Structured questionnaires are time-efficient, allowing researchers to collect data from a large number of respondents.
• Reduces response bias: The predefined response options minimize potential response bias and maintain consistency in data collection.

Limitations of Structured Questionnaires:

• Lack of depth: Structured questionnaires may not capture in-depth insights or nuances as respondents are limited to pre-defined response choices. Hence, they may not reveal the reasons behind respondents’ choices, limiting the understanding of their perspectives.
• Limited flexibility: The fixed response options may not cover all potential responses, therefore, potentially restricting respondents’ answers.

Unstructured Questionnaire:

An unstructured questionnaire consists of questions that allow respondents to provide detailed and unrestricted responses. Unlike structured questionnaires, there are no predefined response options, giving respondents the freedom to express their thoughts in their own words. Furthermore, unstructured questionnaires are valuable for collecting qualitative data and obtaining in-depth insights into respondents’ experiences, opinions, or feelings.

Advantages of Unstructured Questionnaires:

• Rich qualitative data: Unstructured questionnaires yield detailed and comprehensive qualitative data, providing valuable and novel insights into respondents’ perspectives.
• Flexibility in responses: Respondents have the freedom to express themselves in their own words. Hence, allowing for a wide range of responses.

Limitations of Unstructured Questionnaires:

• Time-consuming analysis: Analyzing open-ended responses can be time-consuming, since, each response requires careful reading and interpretation.
• Subjectivity in interpretation: The analysis of open-ended responses may be subjective, as researchers interpret and categorize responses based on their judgment.
• May require smaller sample size: Due to the depth of responses, researchers may need a smaller sample size for comprehensive analysis, making generalizations more challenging.

Types of Questions in a Questionnaire

In a questionnaire, researchers typically use the following most common types of questions to gather a variety of information from respondents:

1. Open-Ended Questions:

These questions allow respondents to provide detailed and unrestricted responses in their own words. Open-ended questions are valuable for gathering qualitative data and in-depth insights.

Example: What suggestions do you have for improving our product?

2. Multiple-Choice Questions

Respondents choose one answer from a list of provided options. This type of question is suitable for gathering categorical data or preferences.

Example: Which of the following social media/academic networking platforms do you use to promote your research?

• ResearchGate
• Academia.edu

3. Dichotomous Questions

Respondents choose between two options, typically “yes” or “no”, “true” or “false”, or “agree” or “disagree”.

Example: Have you ever published in open access journals before?

4. Scaling Questions

These questions, also known as rating scale questions, use a predefined scale that allows respondents to rate or rank their level of agreement, satisfaction, importance, or other subjective assessments. These scales help researchers quantify subjective data and make comparisons across respondents.

There are several types of scaling techniques used in scaling questions:

i. Likert Scale:

The Likert scale is one of the most common scaling techniques. It presents respondents with a series of statements and asks them to rate their level of agreement or disagreement using a range of options, typically from “strongly agree” to “strongly disagree”.For example: Please indicate your level of agreement with the statement: “The content presented in the webinar was relevant and aligned with the advertised topic.”

• Strongly Agree
• Strongly Disagree

ii. Semantic Differential Scale:

The semantic differential scale measures respondents’ perceptions or attitudes towards an item using opposite adjectives or bipolar words. Respondents rate the item on a scale between the two opposites. For example:

• Easy —— Difficult
• Satisfied —— Unsatisfied
• Very likely —— Very unlikely

iii. Numerical Rating Scale:

This scale requires respondents to provide a numerical rating on a predefined scale. It can be a simple 1 to 5 or 1 to 10 scale, where higher numbers indicate higher agreement, satisfaction, or importance.

iv. Ranking Questions:

Respondents rank items in order of preference or importance. Ranking questions help identify preferences or priorities.

Example: Please rank the following features of our app in order of importance (1 = Most Important, 5 = Least Important):

• User Interface
• Functionality
• Customer Support

By using a mix of question types, researchers can gather both quantitative and qualitative data, providing a comprehensive understanding of the research topic and enabling meaningful analysis and interpretation of the results. The choice of question types depends on the research objectives , the desired depth of information, and the data analysis requirements.

Methods of Administering Questionnaires

There are several methods for administering questionnaires, and the choice of method depends on factors such as the target population, research objectives , convenience, and resources available. Here are some common methods of administering questionnaires:

Each method has its advantages and limitations. Online surveys offer convenience and a large reach, but they may be limited to individuals with internet access. Face-to-face interviews allow for in-depth responses but can be time-consuming and costly. Telephone surveys have broad reach but may be limited by declining response rates. Researchers should choose the method that best suits their research objectives, target population, and available resources to ensure successful data collection.

How to Design a Questionnaire

Designing a good questionnaire is crucial for gathering accurate and meaningful data that aligns with your research objectives. Here are essential steps and tips to create a well-designed questionnaire:

1. Define Your Research Objectives : Clearly outline the purpose and specific information you aim to gather through the questionnaire.

2. Identify Your Target Audience : Understand respondents’ characteristics and tailor the questionnaire accordingly.

3. Develop the Questions :

• Write Clear and Concise Questions
• Avoid Leading or Biasing Questions
• Sequence Questions Logically
• Group Related Questions
• Include Demographic Questions

4. Provide Well-defined Response Options : Offer exhaustive response choices for closed-ended questions.

5. Consider Skip Logic and Branching : Customize the questionnaire based on previous answers.

6. Pilot Test the Questionnaire : Identify and address issues through a pilot study .

7. Seek Expert Feedback : Validate the questionnaire with subject matter experts.

8. Obtain Ethical Approval : Comply with ethical guidelines , obtain consent, and ensure confidentiality before administering the questionnaire.

9. Administer the Questionnaire : Choose the right mode and provide clear instructions.

10. Test the Survey Platform : Ensure compatibility and usability for online surveys.

By following these steps and paying attention to questionnaire design principles, you can create a well-structured and effective questionnaire that gathers reliable data and helps you achieve your research objectives.

Characteristics of a Good Questionnaire

A good questionnaire possesses several essential elements that contribute to its effectiveness. Furthermore, these characteristics ensure that the questionnaire is well-designed, easy to understand, and capable of providing valuable insights. Here are some key characteristics of a good questionnaire:

1. Clarity and Simplicity : Questions should be clear, concise, and unambiguous. Avoid using complex language or technical terms that may confuse respondents. Simple and straightforward questions ensure that respondents interpret them consistently.

2. Relevance and Focus : Each question should directly relate to the research objectives and contribute to answering the research questions. Consequently, avoid including extraneous or irrelevant questions that could lead to data clutter.

3. Mix of Question Types : Utilize a mix of question types, including open-ended, Likert scale, and multiple-choice questions. This variety allows for both qualitative and quantitative data collections .

4. Validity and Reliability : Ensure the questionnaire measures what it intends to measure (validity) and produces consistent results upon repeated administration (reliability). Validation should be conducted through expert review and previous research.

5. Appropriate Length : Keep the questionnaire’s length appropriate and manageable to avoid respondent fatigue or dropouts. Long questionnaires may result in incomplete or rushed responses.

6. Clear Instructions : Include clear instructions at the beginning of the questionnaire to guide respondents on how to complete it. Explain any technical terms, formats, or concepts if necessary.

7. User-Friendly Format : Design the questionnaire to be visually appealing and user-friendly. Use consistent formatting, adequate spacing, and a logical page layout.

8. Data Validation and Cleaning : Incorporate validation checks to ensure data accuracy and reliability. Consider mechanisms to detect and correct inconsistent or missing responses during data cleaning.

By incorporating these characteristics, researchers can create a questionnaire that maximizes data quality, minimizes response bias, and provides valuable insights for their research.

In the pursuit of advancing research and gaining meaningful insights, investing time and effort into designing effective questionnaires is a crucial step. A well-designed questionnaire is more than a mere set of questions; it is a masterpiece of precision and ingenuity. Each question plays a vital role in shaping the narrative of our research, guiding us through the labyrinth of data to meaningful conclusions. Indeed, a well-designed questionnaire serves as a powerful tool for unlocking valuable insights and generating robust findings that impact society positively.

Have you ever designed a research questionnaire? Reflect on your experience and share your insights with researchers globally through Enago Academy’s Open Blogging Platform . Join our diverse community of 1000K+ researchers and authors to exchange ideas, strategies, and best practices, and together, let’s shape the future of data collection and maximize the impact of questionnaires in the ever-evolving landscape of research.

Frequently Asked Questions

A research questionnaire is a structured tool used to gather data from participants in a systematic manner. It consists of a series of carefully crafted questions designed to collect specific information related to a research study.

Questionnaires play a pivotal role in both quantitative and qualitative research, enabling researchers to collect insights, opinions, attitudes, or behaviors from respondents. This aids in hypothesis testing, understanding, and informed decision-making, ensuring consistency, efficiency, and facilitating comparisons.

Questionnaires are a versatile tool employed in various research designs to gather data efficiently and comprehensively. They find extensive use in both quantitative and qualitative research methodologies, making them a fundamental component of research across disciplines. Some research designs that commonly utilize questionnaires include: a) Cross-Sectional Studies b) Longitudinal Studies c) Descriptive Research d) Correlational Studies e) Causal-Comparative Studies f) Experimental Research g) Survey Research h) Case Studies i) Exploratory Research

A survey is a comprehensive data collection method that can include various techniques like interviews and observations. A questionnaire is a specific set of structured questions within a survey designed to gather standardized responses. While a survey is a broader approach, a questionnaire is a focused tool for collecting specific data.

The choice of questionnaire type depends on the research objectives, the type of data required, and the preferences of respondents. Some common types include: • Structured Questionnaires: These questionnaires consist of predefined, closed-ended questions with fixed response options. They are easy to analyze and suitable for quantitative research. • Semi-Structured Questionnaires: These questionnaires combine closed-ended questions with open-ended ones. They offer more flexibility for respondents to provide detailed explanations. • Unstructured Questionnaires: These questionnaires contain open-ended questions only, allowing respondents to express their thoughts and opinions freely. They are commonly used in qualitative research.

Following these steps ensures effective questionnaire administration for reliable data collection: • Choose a Method: Decide on online, face-to-face, mail, or phone administration. • Online Surveys: Use platforms like SurveyMonkey • Pilot Test: Test on a small group before full deployment • Clear Instructions: Provide concise guidelines • Follow-Up: Send reminders if needed

Thank you, Riya. This is quite helpful. As discussed, response bias is one of the disadvantages in the use of questionnaires. One way to help limit this can be to use scenario based questions. These type of questions may help the respondents to be more reflective and active in the process.

Thank you, Dear Riya. This is quite helpful.

Rate this article Cancel Reply

Your email address will not be published.

Enago Academy's Most Popular Articles

• Publishing Research
• Reporting Research

How to Optimize Your Research Process: A step-by-step guide

For researchers across disciplines, the path to uncovering novel findings and insights is often filled…

• Industry News
• Trending Now

Breaking Barriers: Sony and Nature unveil “Women in Technology Award”

Sony Group Corporation and the prestigious scientific journal Nature have collaborated to launch the inaugural…

Achieving Research Excellence: Checklist for good research practices

Academia is built on the foundation of trustworthy and high-quality research, supported by the pillars…

• Promoting Research

Plain Language Summary — Communicating your research to bridge the academic-lay gap

Science can be complex, but does that mean it should not be accessible to the…

Science under Surveillance: Journals adopt advanced AI to uncover image manipulation

Journals are increasingly turning to cutting-edge AI tools to uncover deceitful images published in manuscripts.…

Choosing the Right Analytical Approach: Thematic analysis vs. content analysis for…

Comparing Cross Sectional and Longitudinal Studies: 5 steps for choosing the right…

Research Recommendations – Guiding policy-makers for evidence-based decision making

Sign-up to read more

Subscribe for free to get unrestricted access to all our resources on research writing and academic publishing including:

• 2000+ blog articles
• 50+ Webinars
• 10+ Expert podcasts
• 50+ Infographics
• 10+ Checklists
• Research Guides

We hate spam too. We promise to protect your privacy and never spam you.

I am looking for Editing/ Proofreading services for my manuscript Tentative date of next journal submission:

What should universities' stance be on AI tools in research and academic writing?

Libraries & Cultural Resources

Research guides, guide to research and writing for the academic study of religion.

• Topic Pyramids
• Research Assignment Parameters
• Thesis statement
• Identifying Interests
• Controversy
• Availability of Sources
• Preliminary Research
• Developing Your Question and Thesis
• Research Question and Thesis Statement Examples
• Periodicals
• Primary Sources
• Reference Works - Encyclopedias, Dictionaries, Biographies etc
• Journal Articles
• Primary Sources This link opens in a new window
• Web Search Engines
• Web Directories
• Invisible Web
• Does the Library hold the article I need?
• Locating resources unavailable at U of C Library
• Content of Databases
• Standardized Terminology
• Review Quiz Databases
• Keyword Searching
• Search Limits
• Phrase Searching
• Truncations and Wildcards
• Boolean Operators
• Proximity Operators
• Natural Language Searching
• Searching Basics Quiz
• Search Overview
• Selecting Records
• Combing Searchers
• General Criteria
• Quoting in text
• in Text Citations
• List of References
• Avoiding Plagiarism
• Staying Organized
• Links to Writing Help
• Sources Used in Creating this Workbook

Research Question and Thesis

If you have followed all the previous steps, you should be very close to developing a good question if you haven’t already. Here are a few examples of good and bad questions to help you distinguish an effective research question from an ineffective one.

Example #1: Why has religious fundamentalism arisen in North America?

Example #2: what is the relationship between theology and religious studies.

This is a good start, but it is much too general.

What does Donald Wiebe say about theology and religious studies?

This is more specific but you still need to bring the controversy to the forefront. As it stands, it invites a mere summary of Donald Wiebe's position.

Good research questions on this topic might be :

• Are there any conceptual problems with Wiebe's distinction between theology and religious studies?
• Does Wiebe's position on the distinction between theology and religious studies represent a radical departure from previous understandings of the relationship between the two?
• Does Wiebe's agenda to eliminate theology from Religious Studies have any unforeseen or undesirable practical implications?

All three of these questions have a narrower focus and can be answered in a variety of ways. Answering any of these questions will generate a thesis statement. Remember, the answer that you give to a research question is your thesis statement.

For further examples of good research questions, see Research Strategies by  Badke .

The Thesis Statement

Your thesis statement directly answers your research question, and takes a stand (rather than announces the subject) that others might dispute. In other words, it is provocative and contestable. A strong thesis clearly asserts your position or conclusion and avoids vague language (e.g. “It seems…). Your thesis should be obvious, easy to find, and clearly stated in the opening paragraph of your paper. The rest of your paper is devoted to substantiating your thesis by offering evidence in support of your claim. Remember, that it is perfectly acceptable to change your thesis if the evidence leads you to an alternative conclusion.

For examples of strong thesis statements, look for abstracts and articles from peer-reviewed journals and books, and attempt to find the thesis in each of these sources. The author(s) of these sources typically state their conclusions in several different ways.

Examples of thesis statements are italicized in the abstracts provided below.

“S tating the problem under discussion as "Islam and Science" is false because this formulation implies that there is such a thing as a reified and ahistorical and hence immutable "Islam" that is responsible for advancing or impeding scientific activity, both past and present.   In fact, Islam, like all other religions, is the specific ideology of a particular, historically determined society (i.e., Islam in Baghdad in the 830s, in Damascus in 1300, in Cairo around 1000, etc.) and has itself no historical agency; what that particular society accomplishes in the way of science wholly depends on who is using that ideology (if it is being used) and to what ends. The analysis of scientific activity in Islamic societies, therefore, can proceed only from the investigation of the social and political factors at play in each particular case. Injecting the notion of “Islam” into these discussions merely obfuscates the issue and confuses students, distracting them from historical analysis and political action.” Source: Gutas, Dimitri. 2003. “Islam and Science: A False Statement of the Problem.”  Islam & Science  1, no.2: 215-20.

“In this response article, some of the most challenging aspects of Islam and science discourse are discussed. Responding to the specific issues of the relationship between Islam and science and the normative Islamic tradition, the article explores the claims of a secular view that there is no such thing as essential Islam and that there is no relationship between Islam and the scientific tradition that arose in the Islamic civilization.  This view is refuted on the basis of historical, logical and internal evidence .”                                                                                     Source: Iqbal, Muzaffar. 2003. “Islam and Science: Responding to a False Approach.”   Islam & Science  ,  1, no. 2: 221-34.

“This rejoinder is a further contribution to the debate begun by M. Iqbal and D. Gutas on the differing perspectives and methodological assumptions of faith-based and secular approaches to the study of the history of science in religious cultures.  While the arguments presented are to some degree ad hominem, they do aim to highlight certain logical inconsistencies in the conceptualization of the role of religion in the study of science and in the revisionist portrayal of as a causal agent that functions independently of its adherents .” Source :  Reisman, David C.  2004. “An Unfortunate Response: Iqbal on Gutas.”  Islam & Science  2, no.1: 63-73.

• << Previous: Developing Your Question and Thesis
• Next: Selecting Sources >>
• Last Updated: Jun 9, 2022 2:27 PM
• URL: https://libguides.ucalgary.ca/research-and-writing-religion

Libraries & Cultural Resources

• 403.220.8895

Research Aims, Objectives & Questions

The “Golden Thread” Explained Simply (+ Examples)

By: David Phair (PhD) and Alexandra Shaeffer (PhD) | June 2022

The research aims , objectives and research questions (collectively called the “golden thread”) are arguably the most important thing you need to get right when you’re crafting a research proposal , dissertation or thesis . We receive questions almost every day about this “holy trinity” of research and there’s certainly a lot of confusion out there, so we’ve crafted this post to help you navigate your way through the fog.

Overview: The Golden Thread

• What is the golden thread
• What are research aims ( examples )
• What are research objectives ( examples )
• What are research questions ( examples )
• The importance of alignment in the golden thread

What is the “golden thread”?  

The golden thread simply refers to the collective research aims , research objectives , and research questions for any given project (i.e., a dissertation, thesis, or research paper ). These three elements are bundled together because it’s extremely important that they align with each other, and that the entire research project aligns with them.

Importantly, the golden thread needs to weave its way through the entirety of any research project , from start to end. In other words, it needs to be very clearly defined right at the beginning of the project (the topic ideation and proposal stage) and it needs to inform almost every decision throughout the rest of the project. For example, your research design and methodology will be heavily influenced by the golden thread (we’ll explain this in more detail later), as well as your literature review.

The research aims, objectives and research questions (the golden thread) define the focus and scope ( the delimitations ) of your research project. In other words, they help ringfence your dissertation or thesis to a relatively narrow domain, so that you can “go deep” and really dig into a specific problem or opportunity. They also help keep you on track , as they act as a litmus test for relevance. In other words, if you’re ever unsure whether to include something in your document, simply ask yourself the question, “does this contribute toward my research aims, objectives or questions?”. If it doesn’t, chances are you can drop it.

Alright, enough of the fluffy, conceptual stuff. Let’s get down to business and look at what exactly the research aims, objectives and questions are and outline a few examples to bring these concepts to life.

Research Aims: What are they?

Simply put, the research aim(s) is a statement that reflects the broad overarching goal (s) of the research project. Research aims are fairly high-level (low resolution) as they outline the general direction of the research and what it’s trying to achieve .

Research Aims: Examples  

True to the name, research aims usually start with the wording “this research aims to…”, “this research seeks to…”, and so on. For example:

“This research aims to explore employee experiences of digital transformation in retail HR.”   “This study sets out to assess the interaction between student support and self-care on well-being in engineering graduate students”  

As you can see, these research aims provide a high-level description of what the study is about and what it seeks to achieve. They’re not hyper-specific or action-oriented, but they’re clear about what the study’s focus is and what is being investigated.

Need a helping hand?

Research Objectives: What are they?

The research objectives take the research aims and make them more practical and actionable . In other words, the research objectives showcase the steps that the researcher will take to achieve the research aims.

The research objectives need to be far more specific (higher resolution) and actionable than the research aims. In fact, it’s always a good idea to craft your research objectives using the “SMART” criteria. In other words, they should be specific, measurable, achievable, relevant and time-bound”.

Research Objectives: Examples  

Let’s look at two examples of research objectives. We’ll stick with the topic and research aims we mentioned previously.  

For the digital transformation topic:

To observe the retail HR employees throughout the digital transformation. To assess employee perceptions of digital transformation in retail HR. To identify the barriers and facilitators of digital transformation in retail HR.

And for the student wellness topic:

To determine whether student self-care predicts the well-being score of engineering graduate students. To determine whether student support predicts the well-being score of engineering students. To assess the interaction between student self-care and student support when predicting well-being in engineering graduate students.

  As you can see, these research objectives clearly align with the previously mentioned research aims and effectively translate the low-resolution aims into (comparatively) higher-resolution objectives and action points . They give the research project a clear focus and present something that resembles a research-based “to-do” list.

Research Questions: What are they?

Finally, we arrive at the all-important research questions. The research questions are, as the name suggests, the key questions that your study will seek to answer . Simply put, they are the core purpose of your dissertation, thesis, or research project. You’ll present them at the beginning of your document (either in the introduction chapter or literature review chapter) and you’ll answer them at the end of your document (typically in the discussion and conclusion chapters).  

The research questions will be the driving force throughout the research process. For example, in the literature review chapter, you’ll assess the relevance of any given resource based on whether it helps you move towards answering your research questions. Similarly, your methodology and research design will be heavily influenced by the nature of your research questions. For instance, research questions that are exploratory in nature will usually make use of a qualitative approach, whereas questions that relate to measurement or relationship testing will make use of a quantitative approach.  

Let’s look at some examples of research questions to make this more tangible.

Research Questions: Examples  

Again, we’ll stick with the research aims and research objectives we mentioned previously.  

For the digital transformation topic (which would be qualitative in nature):

How do employees perceive digital transformation in retail HR? What are the barriers and facilitators of digital transformation in retail HR?  

And for the student wellness topic (which would be quantitative in nature):

Does student self-care predict the well-being scores of engineering graduate students? Does student support predict the well-being scores of engineering students? Do student self-care and student support interact when predicting well-being in engineering graduate students?  

You’ll probably notice that there’s quite a formulaic approach to this. In other words, the research questions are basically the research objectives “converted” into question format. While that is true most of the time, it’s not always the case. For example, the first research objective for the digital transformation topic was more or less a step on the path toward the other objectives, and as such, it didn’t warrant its own research question.  

So, don’t rush your research questions and sloppily reword your objectives as questions. Carefully think about what exactly you’re trying to achieve (i.e. your research aim) and the objectives you’ve set out, then craft a set of well-aligned research questions . Also, keep in mind that this can be a somewhat iterative process , where you go back and tweak research objectives and aims to ensure tight alignment throughout the golden thread.

The importance of strong alignment 

Alignment is the keyword here and we have to stress its importance . Simply put, you need to make sure that there is a very tight alignment between all three pieces of the golden thread. If your research aims and research questions don’t align, for example, your project will be pulling in different directions and will lack focus . This is a common problem students face and can cause many headaches (and tears), so be warned.

Take the time to carefully craft your research aims, objectives and research questions before you run off down the research path. Ideally, get your research supervisor/advisor to review and comment on your golden thread before you invest significant time into your project, and certainly before you start collecting data .  

Recap: The golden thread

In this post, we unpacked the golden thread of research, consisting of the research aims , research objectives and research questions . You can jump back to any section using the links below.

As always, feel free to leave a comment below – we always love to hear from you. Also, if you’re interested in 1-on-1 support, take a look at our private coaching service here.

Psst... there’s more!

This post was based on one of our popular Research Bootcamps . If you're working on a research project, you'll definitely want to check this out ...

You Might Also Like:

39 Comments

Thank you very much for your great effort put. As an Undergraduate taking Demographic Research & Methodology, I’ve been trying so hard to understand clearly what is a Research Question, Research Aim and the Objectives in a research and the relationship between them etc. But as for now I’m thankful that you’ve solved my problem.

Well appreciated. This has helped me greatly in doing my dissertation.

An so delighted with this wonderful information thank you a lot.

so impressive i have benefited a lot looking forward to learn more on research.

I am very happy to have carefully gone through this well researched article.

Infact,I used to be phobia about anything research, because of my poor understanding of the concepts.

Now,I get to know that my research question is the same as my research objective(s) rephrased in question format.

I please I would need a follow up on the subject,as I intends to join the team of researchers. Thanks once again.

Thanks so much. This was really helpful.

I know you pepole have tried to break things into more understandable and easy format. And God bless you. Keep it up

i found this document so useful towards my study in research methods. thanks so much.

This is my 2nd read topic in your course and I should commend the simplified explanations of each part. I’m beginning to understand and absorb the use of each part of a dissertation/thesis. I’ll keep on reading your free course and might be able to avail the training course! Kudos!

Thank you! Better put that my lecture and helped to easily understand the basics which I feel often get brushed over when beginning dissertation work.

This is quite helpful. I like how the Golden thread has been explained and the needed alignment.

This is quite helpful. I really appreciate!

The article made it simple for researcher students to differentiate between three concepts.

Very innovative and educational in approach to conducting research.

I am very impressed with all these terminology, as I am a fresh student for post graduate, I am highly guided and I promised to continue making consultation when the need arise. Thanks a lot.

A very helpful piece. thanks, I really appreciate it .

Very well explained, and it might be helpful to many people like me.

Wish i had found this (and other) resource(s) at the beginning of my PhD journey… not in my writing up year… 😩 Anyways… just a quick question as i’m having some issues ordering my “golden thread”…. does it matter in what order you mention them? i.e., is it always first aims, then objectives, and finally the questions? or can you first mention the research questions and then the aims and objectives?

Thank you for a very simple explanation that builds upon the concepts in a very logical manner. Just prior to this, I read the research hypothesis article, which was equally very good. This met my primary objective.

My secondary objective was to understand the difference between research questions and research hypothesis, and in which context to use which one. However, I am still not clear on this. Can you kindly please guide?

In research, a research question is a clear and specific inquiry that the researcher wants to answer, while a research hypothesis is a tentative statement or prediction about the relationship between variables or the expected outcome of the study. Research questions are broader and guide the overall study, while hypotheses are specific and testable statements used in quantitative research. Research questions identify the problem, while hypotheses provide a focus for testing in the study.

Exactly what I need in this research journey, I look forward to more of your coaching videos.

This helped a lot. Thanks so much for the effort put into explaining it.

What data source in writing dissertation/Thesis requires?

What is data source covers when writing dessertation/thesis

This is quite useful thanks

I’m excited and thankful. I got so much value which will help me progress in my thesis.

where are the locations of the reserch statement, research objective and research question in a reserach paper? Can you write an ouline that defines their places in the researh paper?

Very helpful and important tips on Aims, Objectives and Questions.

Thank you so much for making research aim, research objectives and research question so clear. This will be helpful to me as i continue with my thesis.

Thanks much for this content. I learned a lot. And I am inspired to learn more. I am still struggling with my preparation for dissertation outline/proposal. But I consistently follow contents and tutorials and the new FB of GRAD Coach. Hope to really become confident in writing my dissertation and successfully defend it.

As a researcher and lecturer, I find splitting research goals into research aims, objectives, and questions is unnecessarily bureaucratic and confusing for students. For most biomedical research projects, including ‘real research’, 1-3 research questions will suffice (numbers may differ by discipline).

Awesome! Very important resources and presented in an informative way to easily understand the golden thread. Indeed, thank you so much.

Well explained

The blog article on research aims, objectives, and questions by Grad Coach is a clear and insightful guide that aligns with my experiences in academic research. The article effectively breaks down the often complex concepts of research aims and objectives, providing a straightforward and accessible explanation. Drawing from my own research endeavors, I appreciate the practical tips offered, such as the need for specificity and clarity when formulating research questions. The article serves as a valuable resource for students and researchers, offering a concise roadmap for crafting well-defined research goals and objectives. Whether you’re a novice or an experienced researcher, this article provides practical insights that contribute to the foundational aspects of a successful research endeavor.

A great thanks for you. it is really amazing explanation. I grasp a lot and one step up to research knowledge.

I really found these tips helpful. Thank you very much Grad Coach.

I found this article helpful. Thanks for sharing this.

thank you so much, the explanation and examples are really helpful

Submit a Comment Cancel reply

Your email address will not be published. Required fields are marked *

Save my name, email, and website in this browser for the next time I comment.

• Print Friendly

An official website of the United States government

The .gov means it’s official. Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

The site is secure. The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

• Publications
• Account settings

Preview improvements coming to the PMC website in October 2024. Learn More or Try it out now .

• Advanced Search
• Journal List
• Perspect Clin Res
• v.14(3); Jul-Sep 2023
• PMC10405529

Designing and validating a research questionnaire - Part 1

Priya ranganathan.

Department of Anaesthesiology, Tata Memorial Centre, Homi Bhabha National Institute, Mumbai, Maharashtra, India

Carlo Caduff

1 Department of Global Health and Social Medicine, King’s College London, London, United Kingdom

Questionnaires are often used as part of research studies to collect data from participants. However, the information obtained through a questionnaire is dependent on how it has been designed, used, and validated. In this article, we look at the types of research questionnaires, their applications and limitations, and how a new questionnaire is developed.

INTRODUCTION

In research studies, questionnaires are commonly used as data collection tools, either as the only source of information or in combination with other techniques in mixed-method studies. However, the quality and accuracy of data collected using a questionnaire depend on how it is designed, used, and validated. In this two-part series, we discuss how to design (part 1) and how to use and validate (part 2) a research questionnaire. It is important to emphasize that questionnaires seek to gather information from other people and therefore entail a social relationship between those who are doing the research and those who are being researched. This social relationship comes with an obligation to learn from others , an obligation that goes beyond the purely instrumental rationality of gathering data. In that sense, we underscore that any research method is not simply a tool but a situation, a relationship, a negotiation, and an encounter. This points to both ethical questions (what is the relationship between the researcher and the researched?) and epistemological ones (what are the conditions under which we can know something?).

At the start of any kind of research project, it is crucial to select the right methodological approach. What is the research question, what is the research object, and what can a questionnaire realistically achieve? Not every research question and not every research object are suitable to the questionnaire as a method. Questionnaires can only provide certain kinds of empirical evidence and it is thus important to be aware of the limitations that are inherent in any kind of methodology.

WHAT IS A RESEARCH QUESTIONNAIRE?

A research questionnaire can be defined as a data collection tool consisting of a series of questions or items that are used to collect information from respondents and thus learn about their knowledge, opinions, attitudes, beliefs, and behavior and informed by a positivist philosophy of the natural sciences that consider methods mainly as a set of rules for the production of knowledge; questionnaires are frequently used instrumentally as a standardized and standardizing tool to ask a set of questions to participants. Outside of such a positivist philosophy, questionnaires can be seen as an encounter between the researcher and the researched, where knowledge is not simply gathered but negotiated through a distinct form of communication that is the questionnaire.

STRENGTHS AND LIMITATIONS OF QUESTIONNAIRES

A questionnaire may not always be the most appropriate way of engaging with research participants and generating knowledge that is needed for a research study. Questionnaires have advantages that have made them very popular, especially in quantitative studies driven by a positivist philosophy: they are a low-cost method for the rapid collection of large amounts of data, even from a wide sample. They are practical, can be standardized, and allow comparison between groups and locations. However, it is important to remember that a questionnaire only captures the information that the method itself (as the structured relationship between the researcher and the researched) allows for and that the respondents are willing to provide. For example, a questionnaire on diet captures what the respondents say they eat and not what they are eating. The problem of social desirability emerges precisely because the research process itself involves a social relationship. This means that respondents may often provide socially acceptable and idealized answers, particularly in relation to sensitive questions, for example, alcohol consumption, drug use, and sexual practices. Questionnaires are most useful for studies investigating knowledge, beliefs, values, self-understandings, and self-perceptions that reflect broader social, cultural, and political norms that may well diverge from actual practices.

TYPES OF RESEARCH QUESTIONNAIRES

Research questionnaires may be classified in several ways:

Depending on mode of administration

Research questionnaires may be self-administered (by the research participant) or researcher administered. Self-administered (also known as self-reported or self-completed) questionnaires are designed to be completed by respondents without assistance from a researcher. Self-reported questionnaires may be administered to participants directly during hospital or clinic visits, mailed through the post or E-mail, or accessed through websites. This technique allows respondents to answer at their own pace and simplifies research costs and logistics. The anonymity offered by self-reporting may facilitate more accurate answers. However, the disadvantages are that there may be misinterpretations of questions and low response rates. Significantly, relevant context information is missing to make sense of the answers provided. Researcher-reported (or interviewer-reported) questionnaires may be administered face-to-face or through remote techniques such as telephone or videoconference and are associated with higher response rates. They allow the researcher to have a better understanding of how the data are collected and how answers are negotiated, but are more resource intensive and require more training from the researchers.

The choice between self-administered and researcher-administered questionnaires depends on various factors such as the characteristics of the target audience (e.g., literacy and comprehension level and ability to use technology), costs involved, and the need for confidentiality/privacy.

Depending on the format of the questions

Research questionnaires can have structured or semi-structured formats. Semi-structured questionnaires allow respondents to answer more freely and on their terms, with no restrictions on their responses. They allow for unusual or surprising responses and are useful to explore and discover a range of answers to determine common themes. Typically, the analysis of responses to open-ended questions is more complex and requires coding and analysis. In contrast, structured questionnaires provide a predefined set of responses for the participant to choose from. The use of standard items makes the questionnaire easier to complete and allows quick aggregation, quantification, and analysis of the data. However, structured questionnaires can be restrictive if the scope of responses is limited and may miss potential answers. They also may suggest answers that respondents may not have considered before. Respondents may be forced to fit their answers into the predetermined format and may not be able to express personal views and say what they really want to say or think. In general, this type of questionnaire can turn the research process into a mechanical, anonymous survey with little incentive for participants to feel engaged, understood, and taken seriously.

STRUCTURED QUESTIONS: FORMATS

Some examples of close-ended questions include:

e.g., Please indicate your marital status:

• Prefer not to say.

e.g., Describe your areas of work (circle or tick all that apply):

• Clinical service
• Administration
• Strongly agree
• Strongly disagree.
• Numerical scales: Please rate your current pain on a scale of 1–10 where 1 is no pain and 10 is the worst imaginable pain
• Symbolic scales: For example, the Wong-Baker FACES scale to rate pain in older children
• Ranking: Rank the following cities as per the quality of public health care, where 1 is the best and 5 is the worst.

A matrix questionnaire consists of a series of rows with items to be answered with a series of columns providing the same answer options. This is an efficient way of getting the respondent to provide answers to multiple questions. The EORTC QLQ-C30 is an example of a matrix questionnaire.[ 1 ]

For a more detailed review of the types of research questions, readers are referred to a paper by Boynton and Greenhalgh.[ 2 ]

USING PRE-EXISTING QUESTIONNAIRES VERSUS DEVELOPING A NEW QUESTIONNAIRE

Before developing a questionnaire for a research study, a researcher can check whether there are any preexisting-validated questionnaires that might be adapted and used for the study. The use of validated questionnaires saves time and resources needed to design a new questionnaire and allows comparability between studies.

However, certain aspects need to be kept in mind: is the population/context/purpose for which the original questionnaire was designed similar to the new study? Is cross-cultural adaptation required? Are there any permission needed to use the questionnaire? In many situations, the development of a new questionnaire may be more appropriate given that any research project entails both methodological and epistemological questions: what is the object of knowledge and what are the conditions under which it can be known? It is important to understand that the standardizing nature of questionnaires contributes to the standardization of objects of knowledge. Thus, the seeming similarity in the object of study across diverse locations may be an artifact of the method. Whatever method one uses, it will always operate as the ground on which the object of study is known.

DESIGNING A NEW RESEARCH QUESTIONNAIRE

Once the researcher has decided to design a new questionnaire, several steps should be considered:

Gathering content

It creates a conceptual framework to identify all relevant areas for which the questionnaire will be used to collect information. This may require a scoping review of the published literature, appraising other questionnaires on similar topics, or the use of focus groups to identify common themes.

Create a list of questions

Questions need to be carefully formulated with attention to language and wording to avoid ambiguity and misinterpretation. Table 1 lists a few examples of poorlyworded questions that could have been phrased in a more appropriate manner. Other important aspects to be noted are:

Examples of poorly phrased questions in a research questionnaire

• Provide a brief introduction to the research study along with instructions on how to complete the questionnaire
• Allow respondents to indicate levels of intensity in their replies, so that they are not forced into “yes” or “no” answers where intensity of feeling may be more appropriate
• Collect specific and detailed data wherever possible – this can be coded into categories. For example, age can be captured in years and later classified as <18 years, 18–45 years, 46 years, and above. The reverse is not possible
• Avoid technical terms, slang, and abbreviations. Tailor the reading level to the expected education level of respondents
• The format of the questionnaire should be attractive with different sections for various subtopics. The font should be large and easy to read, especially if the questionnaire is targeted at the elderly
• Question sequence: questions should be arranged from general to specific, from easy to difficult, from facts to opinions, and sensitive topics should be introduced later in the questionnaire.[ 3 ] Usually, demographic details are captured initially followed by questions on other aspects
• Use contingency questions: these are questions which need to be answered only by a subgroup of the respondents who provide a particular answer to a previous question. This ensures that participants only respond to relevant sections of the questionnaire, for example, Do you smoke? If yes, then how long have you been smoking? If not, then please go to the next section.

TESTING A QUESTIONNAIRE

A questionnaire needs to be valid and reliable, and therefore, any new questionnaire needs to be pilot tested in a small sample of respondents who are representative of the larger population. In addition to validity and reliability, pilot testing provides information on the time taken to complete the questionnaire and whether any questions are confusing or misleading and need to be rephrased. Validity indicates that the questionnaire measures what it claims to measure – this means taking into consideration the limitations that come with any questionnaire-based study. Reliability means that the questionnaire yields consistent responses when administered repeatedly even by different researchers, and any variations in the results are due to actual differences between participants and not because of problems with the interpretation of the questions or their responses. In the next article in this series, we will discuss methods to determine the reliability and validity of a questionnaire.

Financial support and sponsorship

Conflicts of interest.

There are no conflicts of interest.

• Resources Home 🏠
• Try SciSpace Copilot
• Search research papers
• Add Copilot Extension
• Try AI Detector
• Try Paraphraser
• Try Citation Generator
• April Papers
• June Papers
• July Papers

What is a thesis | A Complete Guide with Examples

Table of Contents

A thesis is a comprehensive academic paper based on your original research that presents new findings, arguments, and ideas of your study. It’s typically submitted at the end of your master’s degree or as a capstone of your bachelor’s degree.

However, writing a thesis can be laborious, especially for beginners. From the initial challenge of pinpointing a compelling research topic to organizing and presenting findings, the process is filled with potential pitfalls.

Therefore, to help you, this guide talks about what is a thesis. Additionally, it offers revelations and methodologies to transform it from an overwhelming task to a manageable and rewarding academic milestone.

What is a thesis?

A thesis is an in-depth research study that identifies a particular topic of inquiry and presents a clear argument or perspective about that topic using evidence and logic.

Writing a thesis showcases your ability of critical thinking, gathering evidence, and making a compelling argument. Integral to these competencies is thorough research, which not only fortifies your propositions but also confers credibility to your entire study.

Furthermore, there's another phenomenon you might often confuse with the thesis: the ' working thesis .' However, they aren't similar and shouldn't be used interchangeably.

A working thesis, often referred to as a preliminary or tentative thesis, is an initial version of your thesis statement. It serves as a draft or a starting point that guides your research in its early stages.

As you research more and gather more evidence, your initial thesis (aka working thesis) might change. It's like a starting point that can be adjusted as you learn more. It's normal for your main topic to change a few times before you finalize it.

While a thesis identifies and provides an overarching argument, the key to clearly communicating the central point of that argument lies in writing a strong thesis statement.

What is a thesis statement?

A strong thesis statement (aka thesis sentence) is a concise summary of the main argument or claim of the paper. It serves as a critical anchor in any academic work, succinctly encapsulating the primary argument or main idea of the entire paper.

Typically found within the introductory section, a strong thesis statement acts as a roadmap of your thesis, directing readers through your arguments and findings. By delineating the core focus of your investigation, it offers readers an immediate understanding of the context and the gravity of your study.

Furthermore, an effectively crafted thesis statement can set forth the boundaries of your research, helping readers anticipate the specific areas of inquiry you are addressing.

Different types of thesis statements

A good thesis statement is clear, specific, and arguable. Therefore, it is necessary for you to choose the right type of thesis statement for your academic papers.

Thesis statements can be classified based on their purpose and structure. Here are the primary types of thesis statements:

Argumentative (or Persuasive) thesis statement

Purpose : To convince the reader of a particular stance or point of view by presenting evidence and formulating a compelling argument.

Example : Reducing plastic use in daily life is essential for environmental health.

Analytical thesis statement

Purpose : To break down an idea or issue into its components and evaluate it.

Example : By examining the long-term effects, social implications, and economic impact of climate change, it becomes evident that immediate global action is necessary.

Expository (or Descriptive) thesis statement

Purpose : To explain a topic or subject to the reader.

Example : The Great Depression, spanning the 1930s, was a severe worldwide economic downturn triggered by a stock market crash, bank failures, and reduced consumer spending.

Cause and effect thesis statement

Purpose : To demonstrate a cause and its resulting effect.

Example : Overuse of smartphones can lead to impaired sleep patterns, reduced face-to-face social interactions, and increased levels of anxiety.

Compare and contrast thesis statement

Purpose : To highlight similarities and differences between two subjects.

Example : "While both novels '1984' and 'Brave New World' delve into dystopian futures, they differ in their portrayal of individual freedom, societal control, and the role of technology."

When you write a thesis statement , it's important to ensure clarity and precision, so the reader immediately understands the central focus of your work.

What is the difference between a thesis and a thesis statement?

While both terms are frequently used interchangeably, they have distinct meanings.

A thesis refers to the entire research document, encompassing all its chapters and sections. In contrast, a thesis statement is a brief assertion that encapsulates the central argument of the research.

Here’s an in-depth differentiation table of a thesis and a thesis statement.

Now, to craft a compelling thesis, it's crucial to adhere to a specific structure. Let’s break down these essential components that make up a thesis structure

15 components of a thesis structure

Navigating a thesis can be daunting. However, understanding its structure can make the process more manageable.

Here are the key components or different sections of a thesis structure:

Your thesis begins with the title page. It's not just a formality but the gateway to your research.

Here, you'll prominently display the necessary information about you (the author) and your institutional details.

• Title of your thesis
• Your full name
• Your department
• Your institution and degree program
• Your submission date
• Your Supervisor's name (in some cases)
• Your Department or faculty (in some cases)
• Your University's logo (in some cases)
• Your Student ID (in some cases)

In a concise manner, you'll have to summarize the critical aspects of your research in typically no more than 200-300 words.

This includes the problem statement, methodology, key findings, and conclusions. For many, the abstract will determine if they delve deeper into your work, so ensure it's clear and compelling.

Acknowledgments

Research is rarely a solitary endeavor. In the acknowledgments section, you have the chance to express gratitude to those who've supported your journey.

This might include advisors, peers, institutions, or even personal sources of inspiration and support. It's a personal touch, reflecting the humanity behind the academic rigor.

Table of contents

A roadmap for your readers, the table of contents lists the chapters, sections, and subsections of your thesis.

By providing page numbers, you allow readers to navigate your work easily, jumping to sections that pique their interest.

List of figures and tables

Research often involves data, and presenting this data visually can enhance understanding. This section provides an organized listing of all figures and tables in your thesis.

It's a visual index, ensuring that readers can quickly locate and reference your graphical data.

Introduction

Here's where you introduce your research topic, articulate the research question or objective, and outline the significance of your study.

• Present the research topic : Clearly articulate the central theme or subject of your research.
• Background information : Ground your research topic, providing any necessary context or background information your readers might need to understand the significance of your study.
• Define the scope : Clearly delineate the boundaries of your research, indicating what will and won't be covered.
• Literature review : Introduce any relevant existing research on your topic, situating your work within the broader academic conversation and highlighting where your research fits in.
• State the research Question(s) or objective(s) : Clearly articulate the primary questions or objectives your research aims to address.
• Outline the study's structure : Give a brief overview of how the subsequent sections of your work will unfold, guiding your readers through the journey ahead.

The introduction should captivate your readers, making them eager to delve deeper into your research journey.

Literature review section

Your study correlates with existing research. Therefore, in the literature review section, you'll engage in a dialogue with existing knowledge, highlighting relevant studies, theories, and findings.

It's here that you identify gaps in the current knowledge, positioning your research as a bridge to new insights.

To streamline this process, consider leveraging AI tools. For example, the SciSpace literature review tool enables you to efficiently explore and delve into research papers, simplifying your literature review journey.

Methodology

In the research methodology section, you’ll detail the tools, techniques, and processes you employed to gather and analyze data. This section will inform the readers about how you approached your research questions and ensures the reproducibility of your study.

Here's a breakdown of what it should encompass:

• Research Design : Describe the overall structure and approach of your research. Are you conducting a qualitative study with in-depth interviews? Or is it a quantitative study using statistical analysis? Perhaps it's a mixed-methods approach?
• Data Collection : Detail the methods you used to gather data. This could include surveys, experiments, observations, interviews, archival research, etc. Mention where you sourced your data, the duration of data collection, and any tools or instruments used.
• Sampling : If applicable, explain how you selected participants or data sources for your study. Discuss the size of your sample and the rationale behind choosing it.
• Data Analysis : Describe the techniques and tools you used to process and analyze the data. This could range from statistical tests in quantitative research to thematic analysis in qualitative research.
• Validity and Reliability : Address the steps you took to ensure the validity and reliability of your findings to ensure that your results are both accurate and consistent.
• Ethical Considerations : Highlight any ethical issues related to your research and the measures you took to address them, including — informed consent, confidentiality, and data storage and protection measures.

Moreover, different research questions necessitate different types of methodologies. For instance:

• Experimental methodology : Often used in sciences, this involves a controlled experiment to discern causality.
• Qualitative methodology : Employed when exploring patterns or phenomena without numerical data. Methods can include interviews, focus groups, or content analysis.
• Quantitative methodology : Concerned with measurable data and often involves statistical analysis. Surveys and structured observations are common tools here.
• Mixed methods : As the name implies, this combines both qualitative and quantitative methodologies.

The Methodology section isn’t just about detailing the methods but also justifying why they were chosen. The appropriateness of the methods in addressing your research question can significantly impact the credibility of your findings.

Results (or Findings)

This section presents the outcomes of your research. It's crucial to note that the nature of your results may vary; they could be quantitative, qualitative, or a mix of both.

Quantitative results often present statistical data, showcasing measurable outcomes, and they benefit from tables, graphs, and figures to depict these data points.

Qualitative results , on the other hand, might delve into patterns, themes, or narratives derived from non-numerical data, such as interviews or observations.

Regardless of the nature of your results, clarity is essential. This section is purely about presenting the data without offering interpretations — that comes later in the discussion.

In the discussion section, the raw data transforms into valuable insights.

Start by revisiting your research question and contrast it with the findings. How do your results expand, constrict, or challenge current academic conversations?

Dive into the intricacies of the data, guiding the reader through its implications. Detail potential limitations transparently, signaling your awareness of the research's boundaries. This is where your academic voice should be resonant and confident.

Practical implications (Recommendation) section

Based on the insights derived from your research, this section provides actionable suggestions or proposed solutions.

Whether aimed at industry professionals or the general public, recommendations translate your academic findings into potential real-world actions. They help readers understand the practical implications of your work and how it can be applied to effect change or improvement in a given field.

When crafting recommendations, it's essential to ensure they're feasible and rooted in the evidence provided by your research. They shouldn't merely be aspirational but should offer a clear path forward, grounded in your findings.

The conclusion provides closure to your research narrative.

It's not merely a recap but a synthesis of your main findings and their broader implications. Reconnect with the research questions or hypotheses posited at the beginning, offering clear answers based on your findings.

Reflect on the broader contributions of your study, considering its impact on the academic community and potential real-world applications.

Lastly, the conclusion should leave your readers with a clear understanding of the value and impact of your study.

References (or Bibliography)

Every theory you've expounded upon, every data point you've cited, and every methodological precedent you've followed finds its acknowledgment here.

In references, it's crucial to ensure meticulous consistency in formatting, mirroring the specific guidelines of the chosen citation style .

Proper referencing helps to avoid plagiarism , gives credit to original ideas, and allows readers to explore topics of interest. Moreover, it situates your work within the continuum of academic knowledge.

To properly cite the sources used in the study, you can rely on online citation generator tools  to generate accurate citations!

Here’s more on how you can cite your sources.

Often, the depth of research produces a wealth of material that, while crucial, can make the core content of the thesis cumbersome. The appendix is where you mention extra information that supports your research but isn't central to the main text.

Whether it's raw datasets, detailed procedural methodologies, extended case studies, or any other ancillary material, the appendices ensure that these elements are archived for reference without breaking the main narrative's flow.

For thorough researchers and readers keen on meticulous details, the appendices provide a treasure trove of insights.

Glossary (optional)

In academics, specialized terminologies, and jargon are inevitable. However, not every reader is versed in every term.

The glossary, while optional, is a critical tool for accessibility. It's a bridge ensuring that even readers from outside the discipline can access, understand, and appreciate your work.

By defining complex terms and providing context, you're inviting a wider audience to engage with your research, enhancing its reach and impact.

Remember, while these components provide a structured framework, the essence of your thesis lies in the originality of your ideas, the rigor of your research, and the clarity of your presentation.

As you craft each section, keep your readers in mind, ensuring that your passion and dedication shine through every page.

Thesis examples

To further elucidate the concept of a thesis, here are illustrative examples from various fields:

Example 1 (History): Abolition, Africans, and Abstraction: the Influence of the ‘Noble Savage’ on British and French Antislavery Thought, 1787-1807 by Suchait Kahlon.

Example 2 (Climate Dynamics): Influence of external forcings on abrupt millennial-scale climate changes: a statistical modelling study by Takahito Mitsui · Michel Crucifix

Checklist for your thesis evaluation

Evaluating your thesis ensures that your research meets the standards of academia. Here's an elaborate checklist to guide you through this critical process.

Content and structure

• Is the thesis statement clear, concise, and debatable?
• Does the introduction provide sufficient background and context?
• Is the literature review comprehensive, relevant, and well-organized?
• Does the methodology section clearly describe and justify the research methods?
• Are the results/findings presented clearly and logically?
• Does the discussion interpret the results in light of the research question and existing literature?
• Is the conclusion summarizing the research and suggesting future directions or implications?

Clarity and coherence

• Is the writing clear and free of jargon?
• Are ideas and sections logically connected and flowing?
• Is there a clear narrative or argument throughout the thesis?

Research quality

• Is the research question significant and relevant?
• Are the research methods appropriate for the question?
• Is the sample size (if applicable) adequate?
• Are the data analysis techniques appropriate and correctly applied?
• Are potential biases or limitations addressed?

Originality and significance

• Does the thesis contribute new knowledge or insights to the field?
• Is the research grounded in existing literature while offering fresh perspectives?

Formatting and presentation

• Is the thesis formatted according to institutional guidelines?
• Are figures, tables, and charts clear, labeled, and referenced in the text?
• Is the bibliography or reference list complete and consistently formatted?
• Are appendices relevant and appropriately referenced in the main text?

Grammar and language

• Is the thesis free of grammatical and spelling errors?
• Is the language professional, consistent, and appropriate for an academic audience?
• Are quotations and paraphrased material correctly cited?

Feedback and revision

• Have you sought feedback from peers, advisors, or experts in the field?
• Have you addressed the feedback and made the necessary revisions?

Overall assessment

• Does the thesis as a whole feel cohesive and comprehensive?
• Would the thesis be understandable and valuable to someone in your field?

Ensure to use this checklist to leave no ground for doubt or missed information in your thesis.

After writing your thesis, the next step is to discuss and defend your findings verbally in front of a knowledgeable panel. You’ve to be well prepared as your professors may grade your presentation abilities.

Preparing your thesis defense

A thesis defense, also known as "defending the thesis," is the culmination of a scholar's research journey. It's the final frontier, where you’ll present their findings and face scrutiny from a panel of experts.

Typically, the defense involves a public presentation where you’ll have to outline your study, followed by a question-and-answer session with a committee of experts. This committee assesses the validity, originality, and significance of the research.

The defense serves as a rite of passage for scholars. It's an opportunity to showcase expertise, address criticisms, and refine arguments. A successful defense not only validates the research but also establishes your authority as a researcher in your field.

Here’s how you can effectively prepare for your thesis defense .

Now, having touched upon the process of defending a thesis, it's worth noting that scholarly work can take various forms, depending on academic and regional practices.

One such form, often paralleled with the thesis, is the 'dissertation.' But what differentiates the two?

Dissertation vs. Thesis

Often used interchangeably in casual discourse, they refer to distinct research projects undertaken at different levels of higher education.

To the uninitiated, understanding their meaning might be elusive. So, let's demystify these terms and delve into their core differences.

Here's a table differentiating between the two.

Wrapping up

From understanding the foundational concept of a thesis to navigating its various components, differentiating it from a dissertation, and recognizing the importance of proper citation — this guide covers it all.

As scholars and readers, understanding these nuances not only aids in academic pursuits but also fosters a deeper appreciation for the relentless quest for knowledge that drives academia.

It’s important to remember that every thesis is a testament to curiosity, dedication, and the indomitable spirit of discovery.

Good luck with your thesis writing!

Frequently Asked Questions

A thesis typically ranges between 40-80 pages, but its length can vary based on the research topic, institution guidelines, and level of study.

A PhD thesis usually spans 200-300 pages, though this can vary based on the discipline, complexity of the research, and institutional requirements.

To identify a thesis topic, consider current trends in your field, gaps in existing literature, personal interests, and discussions with advisors or mentors. Additionally, reviewing related journals and conference proceedings can provide insights into potential areas of exploration.

The conceptual framework is often situated in the literature review or theoretical framework section of a thesis. It helps set the stage by providing the context, defining key concepts, and explaining the relationships between variables.

A thesis statement should be concise, clear, and specific. It should state the main argument or point of your research. Start by pinpointing the central question or issue your research addresses, then condense that into a single statement, ensuring it reflects the essence of your paper.

You might also like

AI for Meta-Analysis — A Comprehensive Guide

How To Write An Argumentative Essay

Beyond Google Scholar: Why SciSpace is the best alternative

Have a language expert improve your writing

Run a free plagiarism check in 10 minutes, automatically generate references for free.

• Knowledge Base
• Methodology
• Questionnaire Design | Methods, Question Types & Examples

Questionnaire Design | Methods, Question Types & Examples

Published on 6 May 2022 by Pritha Bhandari . Revised on 10 October 2022.

A questionnaire is a list of questions or items used to gather data from respondents about their attitudes, experiences, or opinions. Questionnaires can be used to collect quantitative and/or qualitative information.

Questionnaires are commonly used in market research as well as in the social and health sciences. For example, a company may ask for feedback about a recent customer service experience, or psychology researchers may investigate health risk perceptions using questionnaires.

Table of contents

Questionnaires vs surveys, questionnaire methods, open-ended vs closed-ended questions, question wording, question order, step-by-step guide to design, frequently asked questions about questionnaire design.

A survey is a research method where you collect and analyse data from a group of people. A questionnaire is a specific tool or instrument for collecting the data.

Designing a questionnaire means creating valid and reliable questions that address your research objectives, placing them in a useful order, and selecting an appropriate method for administration.

But designing a questionnaire is only one component of survey research. Survey research also involves defining the population you’re interested in, choosing an appropriate sampling method , administering questionnaires, data cleaning and analysis, and interpretation.

Sampling is important in survey research because you’ll often aim to generalise your results to the population. Gather data from a sample that represents the range of views in the population for externally valid results. There will always be some differences between the population and the sample, but minimising these will help you avoid sampling bias .

Prevent plagiarism, run a free check.

Questionnaires can be self-administered or researcher-administered . Self-administered questionnaires are more common because they are easy to implement and inexpensive, but researcher-administered questionnaires allow deeper insights.

Self-administered questionnaires

Self-administered questionnaires can be delivered online or in paper-and-pen formats, in person or by post. All questions are standardised so that all respondents receive the same questions with identical wording.

Self-administered questionnaires can be:

• Cost-effective
• Easy to administer for small and large groups
• Anonymous and suitable for sensitive topics

But they may also be:

• Unsuitable for people with limited literacy or verbal skills
• Susceptible to a nonreponse bias (most people invited may not complete the questionnaire)
• Biased towards people who volunteer because impersonal survey requests often go ignored

Researcher-administered questionnaires

Researcher-administered questionnaires are interviews that take place by phone, in person, or online between researchers and respondents.

Researcher-administered questionnaires can:

• Help you ensure the respondents are representative of your target audience
• Allow clarifications of ambiguous or unclear questions and answers
• Have high response rates because it’s harder to refuse an interview when personal attention is given to respondents

But researcher-administered questionnaires can be limiting in terms of resources. They are:

• Costly and time-consuming to perform
• More difficult to analyse if you have qualitative responses
• Likely to contain experimenter bias or demand characteristics
• Likely to encourage social desirability bias in responses because of a lack of anonymity

Your questionnaire can include open-ended or closed-ended questions, or a combination of both.

Using closed-ended questions limits your responses, while open-ended questions enable a broad range of answers. You’ll need to balance these considerations with your available time and resources.

Closed-ended questions

Closed-ended, or restricted-choice, questions offer respondents a fixed set of choices to select from. Closed-ended questions are best for collecting data on categorical or quantitative variables.

Categorical variables can be nominal or ordinal. Quantitative variables can be interval or ratio. Understanding the type of variable and level of measurement means you can perform appropriate statistical analyses for generalisable results.

Examples of closed-ended questions for different variables

Nominal variables include categories that can’t be ranked, such as race or ethnicity. This includes binary or dichotomous categories.

It’s best to include categories that cover all possible answers and are mutually exclusive. There should be no overlap between response items.

In binary or dichotomous questions, you’ll give respondents only two options to choose from.

White Black or African American American Indian or Alaska Native Asian Native Hawaiian or Other Pacific Islander

Ordinal variables include categories that can be ranked. Consider how wide or narrow a range you’ll include in your response items, and their relevance to your respondents.

Likert-type questions collect ordinal data using rating scales with five or seven points.

When you have four or more Likert-type questions, you can treat the composite data as quantitative data on an interval scale . Intelligence tests, psychological scales, and personality inventories use multiple Likert-type questions to collect interval data.

With interval or ratio data, you can apply strong statistical hypothesis tests to address your research aims.

Pros and cons of closed-ended questions

Well-designed closed-ended questions are easy to understand and can be answered quickly. However, you might still miss important answers that are relevant to respondents. An incomplete set of response items may force some respondents to pick the closest alternative to their true answer. These types of questions may also miss out on valuable detail.

To solve these problems, you can make questions partially closed-ended, and include an open-ended option where respondents can fill in their own answer.

Open-ended questions

Open-ended, or long-form, questions allow respondents to give answers in their own words. Because there are no restrictions on their choices, respondents can answer in ways that researchers may not have otherwise considered. For example, respondents may want to answer ‘multiracial’ for the question on race rather than selecting from a restricted list.

• How do you feel about open science?
• How would you describe your personality?
• In your opinion, what is the biggest obstacle to productivity in remote work?

Open-ended questions have a few downsides.

They require more time and effort from respondents, which may deter them from completing the questionnaire.

For researchers, understanding and summarising responses to these questions can take a lot of time and resources. You’ll need to develop a systematic coding scheme to categorise answers, and you may also need to involve other researchers in data analysis for high reliability .

Question wording can influence your respondents’ answers, especially if the language is unclear, ambiguous, or biased. Good questions need to be understood by all respondents in the same way ( reliable ) and measure exactly what you’re interested in ( valid ).

Use clear language

You should design questions with your target audience in mind. Consider their familiarity with your questionnaire topics and language and tailor your questions to them.

For readability and clarity, avoid jargon or overly complex language. Don’t use double negatives because they can be harder to understand.

Use balanced framing

Respondents often answer in different ways depending on the question framing. Positive frames are interpreted as more neutral than negative frames and may encourage more socially desirable answers.

Use a mix of both positive and negative frames to avoid bias , and ensure that your question wording is balanced wherever possible.

Unbalanced questions focus on only one side of an argument. Respondents may be less likely to oppose the question if it is framed in a particular direction. It’s best practice to provide a counterargument within the question as well.

Avoid leading questions

Leading questions guide respondents towards answering in specific ways, even if that’s not how they truly feel, by explicitly or implicitly providing them with extra information.

It’s best to keep your questions short and specific to your topic of interest.

• The average daily work commute in the US takes 54.2 minutes and costs $29 per day. Since 2020, working from home has saved many employees time and money. Do you favour flexible work-from-home policies even after it’s safe to return to offices?
• Experts agree that a well-balanced diet provides sufficient vitamins and minerals, and multivitamins and supplements are not necessary or effective. Do you agree or disagree that multivitamins are helpful for balanced nutrition?

Keep your questions focused

Ask about only one idea at a time and avoid double-barrelled questions. Double-barrelled questions ask about more than one item at a time, which can confuse respondents.

This question could be difficult to answer for respondents who feel strongly about the right to clean drinking water but not high-speed internet. They might only answer about the topic they feel passionate about or provide a neutral answer instead – but neither of these options capture their true answers.

Instead, you should ask two separate questions to gauge respondents’ opinions.

Strongly Agree Agree Undecided Disagree Strongly Disagree

Do you agree or disagree that the government should be responsible for providing high-speed internet to everyone?

You can organise the questions logically, with a clear progression from simple to complex. Alternatively, you can randomise the question order between respondents.

Logical flow

Using a logical flow to your question order means starting with simple questions, such as behavioural or opinion questions, and ending with more complex, sensitive, or controversial questions.

The question order that you use can significantly affect the responses by priming them in specific directions. Question order effects, or context effects, occur when earlier questions influence the responses to later questions, reducing the validity of your questionnaire.

While demographic questions are usually unaffected by order effects, questions about opinions and attitudes are more susceptible to them.

• How knowledgeable are you about Joe Biden’s executive orders in his first 100 days?
• Are you satisfied or dissatisfied with the way Joe Biden is managing the economy?
• Do you approve or disapprove of the way Joe Biden is handling his job as president?

It’s important to minimise order effects because they can be a source of systematic error or bias in your study.

Randomisation

Randomisation involves presenting individual respondents with the same questionnaire but with different question orders.

When you use randomisation, order effects will be minimised in your dataset. But a randomised order may also make it harder for respondents to process your questionnaire. Some questions may need more cognitive effort, while others are easier to answer, so a random order could require more time or mental capacity for respondents to switch between questions.

Follow this step-by-step guide to design your questionnaire.

Step 1: Define your goals and objectives

The first step of designing a questionnaire is determining your aims.

• What topics or experiences are you studying?
• What specifically do you want to find out?
• Is a self-report questionnaire an appropriate tool for investigating this topic?

Once you’ve specified your research aims, you can operationalise your variables of interest into questionnaire items. Operationalising concepts means turning them from abstract ideas into concrete measurements. Every question needs to address a defined need and have a clear purpose.

Step 2: Use questions that are suitable for your sample

Create appropriate questions by taking the perspective of your respondents. Consider their language proficiency and available time and energy when designing your questionnaire.

• Are the respondents familiar with the language and terms used in your questions?
• Would any of the questions insult, confuse, or embarrass them?
• Do the response items for any closed-ended questions capture all possible answers?
• Are the response items mutually exclusive?
• Do the respondents have time to respond to open-ended questions?

Consider all possible options for responses to closed-ended questions. From a respondent’s perspective, a lack of response options reflecting their point of view or true answer may make them feel alienated or excluded. In turn, they’ll become disengaged or inattentive to the rest of the questionnaire.

Step 3: Decide on your questionnaire length and question order

Once you have your questions, make sure that the length and order of your questions are appropriate for your sample.

If respondents are not being incentivised or compensated, keep your questionnaire short and easy to answer. Otherwise, your sample may be biased with only highly motivated respondents completing the questionnaire.

Decide on your question order based on your aims and resources. Use a logical flow if your respondents have limited time or if you cannot randomise questions. Randomising questions helps you avoid bias, but it can take more complex statistical analysis to interpret your data.

Step 4: Pretest your questionnaire

When you have a complete list of questions, you’ll need to pretest it to make sure what you’re asking is always clear and unambiguous. Pretesting helps you catch any errors or points of confusion before performing your study.

Ask friends, classmates, or members of your target audience to complete your questionnaire using the same method you’ll use for your research. Find out if any questions were particularly difficult to answer or if the directions were unclear or inconsistent, and make changes as necessary.

If you have the resources, running a pilot study will help you test the validity and reliability of your questionnaire. A pilot study is a practice run of the full study, and it includes sampling, data collection , and analysis.

You can find out whether your procedures are unfeasible or susceptible to bias and make changes in time, but you can’t test a hypothesis with this type of study because it’s usually statistically underpowered .

A questionnaire is a data collection tool or instrument, while a survey is an overarching research method that involves collecting and analysing data from people using questionnaires.

Closed-ended, or restricted-choice, questions offer respondents a fixed set of choices to select from. These questions are easier to answer quickly.

Open-ended or long-form questions allow respondents to answer in their own words. Because there are no restrictions on their choices, respondents can answer in ways that researchers may not have otherwise considered.

A Likert scale is a rating scale that quantitatively assesses opinions, attitudes, or behaviours. It is made up of four or more questions that measure a single attitude or trait when response scores are combined.

To use a Likert scale in a survey , you present participants with Likert-type questions or statements, and a continuum of items, usually with five or seven possible responses, to capture their degree of agreement.

You can organise the questions logically, with a clear progression from simple to complex, or randomly between respondents. A logical flow helps respondents process the questionnaire easier and quicker, but it may lead to bias. Randomisation can minimise the bias from order effects.

Questionnaires can be self-administered or researcher-administered.

Researcher-administered questionnaires are interviews that take place by phone, in person, or online between researchers and respondents. You can gain deeper insights by clarifying questions for respondents or asking follow-up questions.

Cite this Scribbr article

If you want to cite this source, you can copy and paste the citation or click the ‘Cite this Scribbr article’ button to automatically add the citation to our free Reference Generator.

Bhandari, P. (2022, October 10). Questionnaire Design | Methods, Question Types & Examples. Scribbr. Retrieved 22 April 2024, from https://www.scribbr.co.uk/research-methods/questionnaire-design/

Is this article helpful?

Pritha Bhandari

Other students also liked, doing survey research | a step-by-step guide & examples, what is a likert scale | guide & examples, reliability vs validity in research | differences, types & examples.

• PRO Courses Guides New Tech Help Pro Expert Videos About wikiHow Pro Upgrade Sign In
• EDIT Edit this Article
• EXPLORE Tech Help Pro About Us Random Article Quizzes Request a New Article Community Dashboard This Or That Game Popular Categories Arts and Entertainment Artwork Books Movies Computers and Electronics Computers Phone Skills Technology Hacks Health Men's Health Mental Health Women's Health Relationships Dating Love Relationship Issues Hobbies and Crafts Crafts Drawing Games Education & Communication Communication Skills Personal Development Studying Personal Care and Style Fashion Hair Care Personal Hygiene Youth Personal Care School Stuff Dating All Categories Arts and Entertainment Finance and Business Home and Garden Relationship Quizzes Cars & Other Vehicles Food and Entertaining Personal Care and Style Sports and Fitness Computers and Electronics Health Pets and Animals Travel Education & Communication Hobbies and Crafts Philosophy and Religion Work World Family Life Holidays and Traditions Relationships Youth
• Browse Articles
• Learn Something New
• Quizzes Hot
• This Or That Game New
• Train Your Brain
• Explore More
• Support wikiHow
• About wikiHow
• Log in / Sign up
• Education and Communications

How to Develop a Questionnaire for Research

Last Updated: December 4, 2022 Fact Checked

This article was co-authored by Alexander Ruiz, M.Ed. . Alexander Ruiz is an Educational Consultant and the Educational Director of Link Educational Institute, a tutoring business based in Claremont, California that provides customizable educational plans, subject and test prep tutoring, and college application consulting. With over a decade and a half of experience in the education industry, Alexander coaches students to increase their self-awareness and emotional intelligence while achieving skills and the goal of achieving skills and higher education. He holds a BA in Psychology from Florida International University and an MA in Education from Georgia Southern University. There are 13 references cited in this article, which can be found at the bottom of the page. This article has been fact-checked, ensuring the accuracy of any cited facts and confirming the authority of its sources. This article has been viewed 587,763 times.

A questionnaire is a technique for collecting data in which a respondent provides answers to a series of questions. [1] X Research source To develop a questionnaire that will collect the data you want takes effort and time. However, by taking a step-by-step approach to questionnaire development, you can come up with an effective means to collect data that will answer your unique research question.

Designing Your Questionnaire

• Come up with a research question. It can be one question or several, but this should be the focal point of your questionnaire.
• Develop one or several hypotheses that you want to test. The questions that you include on your questionnaire should be aimed at systematically testing these hypotheses.

• Dichotomous question: this is a question that will generally be a “yes/no” question, but may also be an “agree/disagree” question. It is the quickest and simplest question to analyze, but is not a highly sensitive measure.
• Open-ended questions: these questions allow the respondent to respond in their own words. They can be useful for gaining insight into the feelings of the respondent, but can be a challenge when it comes to analysis of data. It is recommended to use open-ended questions to address the issue of “why.” [2] X Research source
• Multiple choice questions: these questions consist of three or more mutually-exclusive categories and ask for a single answer or several answers. [3] X Research source Multiple choice questions allow for easy analysis of results, but may not give the respondent the answer they want.
• Rank-order (or ordinal) scale questions: this type of question asks your respondent to rank items or choose items in a particular order from a set. For example, it might ask your respondents to order five things from least to most important. These types of questions forces discrimination among alternatives, but does not address the issue of why the respondent made these discriminations. [4] X Research source
• Rating scale questions: these questions allow the respondent to assess a particular issue based on a given dimension. You can provide a scale that gives an equal number of positive and negative choices, for example, ranging from “strongly agree” to “strongly disagree.” [5] X Research source These questions are very flexible, but also do not answer the question “why.”

• Write questions that are succinct and simple. You should not be writing complex statements or using technical jargon, as it will only confuse your respondents and lead to incorrect responses.
• Ask only one question at a time. This will help avoid confusion
• Asking questions such as these usually require you to anonymize or encrypt the demographic data you collect.
• Determine if you will include an answer such as “I don’t know” or “Not applicable to me.” While these can give your respondents a way of not answering certain questions, providing these options can also lead to missing data, which can be problematic during data analysis.
• Put the most important questions at the beginning of your questionnaire. [7] X Research source This can help you gather important data even if you sense that your respondents may be becoming distracted by the end of the questionnaire.

• Only include questions that are directly useful to your research question. [9] X Trustworthy Source Food and Agricultural Organization of the United Nations Specialized agency of the United Nations responsible for leading international efforts to end world hunger and improve nutrition Go to source A questionnaire is not an opportunity to collect all kinds of information about your respondents.
• Avoid asking redundant questions. This will frustrate those who are taking your questionnaire.

• Consider if you want your questionnaire to collect information from both men and women. Some studies will only survey one sex.
• Consider including a range of ages in your target demographic. For example, you can consider young adult to be 18-29 years old, adults to be 30-54 years old, and mature adults to be 55+. Providing the an age range will help you get more respondents than limiting yourself to a specific age.
• Consider what else would make a person a target for your questionnaire. Do they need to drive a car? Do they need to have health insurance? Do they need to have a child under 3? Make sure you are very clear about this before you distribute your questionnaire.

• Consider an anonymous questionnaire. You may not want to ask for names on your questionnaire. This is one step you can take to prevent privacy, however it is often possible to figure out a respondent’s identity using other demographic information (such as age, physical features, or zipcode).
• Consider de-identifying the identity of your respondents. Give each questionnaire (and thus, each respondent) a unique number or word, and only refer to them using that new identifier. Shred any personal information that can be used to determine identity.
• Remember that you do not need to collect much demographic information to be able to identify someone. People may be wary to provide this information, so you may get more respondents by asking less demographic questions (if it is possible for your questionnaire).
• Make sure you destroy all identifying information after your study is complete.

Writing your questionnaire

• My name is Jack Smith and I am one of the creators of this questionnaire. I am part of the Department of Psychology at the University of Michigan, where I am focusing in developing cognition in infants.
• I’m Kelly Smith, a 3rd year undergraduate student at the University of New Mexico. This questionnaire is part of my final exam in statistics.
• My name is Steve Johnson, and I’m a marketing analyst for The Best Company. I’ve been working on questionnaire development to determine attitudes surrounding drug use in Canada for several years.

• I am collecting data regarding the attitudes surrounding gun control. This information is being collected for my Anthropology 101 class at the University of Maryland.
• This questionnaire will ask you 15 questions about your eating and exercise habits. We are attempting to make a correlation between healthy eating, frequency of exercise, and incidence of cancer in mature adults.
• This questionnaire will ask you about your recent experiences with international air travel. There will be three sections of questions that will ask you to recount your recent trips and your feelings surrounding these trips, as well as your travel plans for the future. We are looking to understand how a person’s feelings surrounding air travel impact their future plans.

• Beware that if you are collecting information for a university or for publication, you may need to check in with your institution’s Institutional Review Board (IRB) for permission before beginning. Most research universities have a dedicated IRB staff, and their information can usually be found on the school’s website.
• Remember that transparency is best. It is important to be honest about what will happen with the data you collect.
• Include an informed consent for if necessary. Note that you cannot guarantee confidentiality, but you will make all reasonable attempts to ensure that you protect their information. [12] X Research source

• Time yourself taking the survey. Then consider that it will take some people longer than you, and some people less time than you.
• Provide a time range instead of a specific time. For example, it’s better to say that a survey will take between 15 and 30 minutes than to say it will take 15 minutes and have some respondents quit halfway through.
• Use this as a reason to keep your survey concise! You will feel much better asking people to take a 20 minute survey than you will asking them to take a 3 hour one.

• Incentives can attract the wrong kind of respondent. You don’t want to incorporate responses from people who rush through your questionnaire just to get the reward at the end. This is a danger of offering an incentive. [13] X Research source
• Incentives can encourage people to respond to your survey who might not have responded without a reward. This is a situation in which incentives can help you reach your target number of respondents. [14] X Research source
• Consider the strategy used by SurveyMonkey. Instead of directly paying respondents to take their surveys, they offer 50 cents to the charity of their choice when a respondent fills out a survey. They feel that this lessens the chances that a respondent will fill out a questionnaire out of pure self-interest. [15] X Research source
• Consider entering each respondent in to a drawing for a prize if they complete the questionnaire. You can offer a 25$ gift card to a restaurant, or a new iPod, or a ticket to a movie. This makes it less tempting just to respond to your questionnaire for the incentive alone, but still offers the chance of a pleasant reward.

• Always proof read. Check for spelling, grammar, and punctuation errors.
• Include a title. This is a good way for your respondents to understand the focus of the survey as quickly as possible.
• Thank your respondents. Thank them for taking the time and effort to complete your survey.

Distributing Your Questionnaire

• Was the questionnaire easy to understand? Were there any questions that confused you?
• Was the questionnaire easy to access? (Especially important if your questionnaire is online).
• Do you feel the questionnaire was worth your time?
• Were you comfortable answering the questions asked?
• Are there any improvements you would make to the questionnaire?

• Use an online site, such as SurveyMonkey.com. This site allows you to write your own questionnaire with their survey builder, and provides additional options such as the option to buy a target audience and use their analytics to analyze your data. [19] X Research source
• Consider using the mail. If you mail your survey, always make sure you include a self-addressed stamped envelope so that the respondent can easily mail their responses back. Make sure that your questionnaire will fit inside a standard business envelope.
• Conduct face-to-face interviews. This can be a good way to ensure that you are reaching your target demographic and can reduce missing information in your questionnaires, as it is more difficult for a respondent to avoid answering a question when you ask it directly.
• Try using the telephone. While this can be a more time-effective way to collect your data, it can be difficult to get people to respond to telephone questionnaires.

• Make your deadline reasonable. Giving respondents up to 2 weeks to answer should be more than sufficient. Anything longer and you risk your respondents forgetting about your questionnaire.
• Consider providing a reminder. A week before the deadline is a good time to provide a gentle reminder about returning the questionnaire. Include a replacement of the questionnaire in case it has been misplaced by your respondent. [20] X Research source

Community Q&A

You Might Also Like

• ↑ https://www.questionpro.com/blog/what-is-a-questionnaire/
• ↑ https://www.hotjar.com/blog/open-ended-questions/
• ↑ https://www.questionpro.com/a/showArticle.do?articleID=survey-questions
• ↑ https://surveysparrow.com/blog/ranking-questions-examples/
• ↑ https://www.lumoa.me/blog/rating-scale/
• ↑ http://www.sciencebuddies.org/science-fair-projects/project_ideas/Soc_survey.shtml
• ↑ http://www.monash.edu.au/lls/hdr/design/2.4.3.html
• ↑ http://www.fao.org/docrep/W3241E/w3241e05.htm
• ↑ http://managementhelp.org/businessresearch/questionaires.htm
• ↑ https://www.surveymonkey.com/mp/survey-rewards/
• ↑ http://www.ideafit.com/fitness-library/how-to-develop-a-questionnaire
• ↑ https://www.surveymonkey.com/mp/take-a-tour/?ut_source=header

About This Article

To develop a questionnaire for research, identify the main objective of your research to act as the focal point for the questionnaire. Then, choose the type of questions that you want to include, and come up with succinct, straightforward questions to gather the information that you need to answer your questions. Keep your questionnaire as short as possible, and identify a target demographic who you would like to answer the questions. Remember to make the questionnaires as anonymous as possible to protect the integrity of the person answering the questions! For tips on writing out your questions and distributing the questionnaire, keep reading! Did this summary help you? Yes No

• Send fan mail to authors

Reader Success Stories

Abdul Bari Khan

Nov 11, 2020

Did this article help you?

Jul 25, 2023

Iman Ilhusadi

Nov 26, 2016

Jaydeepa Das

Aug 21, 2018

Atefeh Abdollahi

Jan 3, 2017

Featured Articles

Trending Articles

Watch Articles

• Terms of Use
• Privacy Policy
• Do Not Sell or Share My Info
• Not Selling Info

Don’t miss out! Sign up for

wikiHow’s newsletter

• Spartanburg Community College Library
• SCC Research Guides

The Research Process

• 4. Research Question and Thesis Statement

Research Question and Thesis Statement

Research question.

Research is all about finding finding the answer to a question. Once you have chosen your research topic and completed some background research, you are ready to come up with your research question. Your research question will be the overall question you are going to answer in your essay. 

For example, let's say you decided to write a paper on the Polar Ice Caps melting. While you were doing your background research, you decided you were interested in human involvement in the Polar Ice Caps melting. Your research question would become: How can humans stop the Polar Ice Caps from melting?

Thesis Statement

Next, you will transform your research question into a thesis statement, which is the answer to your research question. Your thesis statement will clearly show the position you will take in your paper and how you intend to argue that position. 

For example, if your research question is How can humans stop the Polar Ice Caps from melting?, an answer to that question (and the position to take in a paper) might be:  Humans can stop the Polar Ice Caps from melting by becoming more conscientious with their use of electricity.

It is  common  and  normal  for your research topic, question, or thesis to change over time, especially as you do more research and learn more about your topic. Remember, research is a process, and you can always go back an revisit steps when needed.

• << Previous: 3. Background Research
• Next: 5. In-Depth Research >>
• 1. Project Requirements
• 2. Topic Selection
• 3. Background Research
• 5. In-Depth Research
• 6. Outline Notes
• 7. Write Your Paper
• 8. Cite Your Sources

Questions? Ask a Librarian

• Last Updated: Mar 19, 2024 12:13 PM
• URL: https://libguides.sccsc.edu/researchprocess

Giles Campus | 864.592.4764 | Toll Free 866.542.2779 | Contact Us

Copyright © 2024 Spartanburg Community College. All rights reserved.

Info for Library Staff | Guide Search

Return to SCC Website

• Privacy Policy

Buy Me a Coffee

Home » Thesis – Structure, Example and Writing Guide

Thesis – Structure, Example and Writing Guide

Table of contents.

Definition:

Thesis is a scholarly document that presents a student’s original research and findings on a particular topic or question. It is usually written as a requirement for a graduate degree program and is intended to demonstrate the student’s mastery of the subject matter and their ability to conduct independent research.

History of Thesis

The concept of a thesis can be traced back to ancient Greece, where it was used as a way for students to demonstrate their knowledge of a particular subject. However, the modern form of the thesis as a scholarly document used to earn a degree is a relatively recent development.

The origin of the modern thesis can be traced back to medieval universities in Europe. During this time, students were required to present a “disputation” in which they would defend a particular thesis in front of their peers and faculty members. These disputations served as a way to demonstrate the student’s mastery of the subject matter and were often the final requirement for earning a degree.

In the 17th century, the concept of the thesis was formalized further with the creation of the modern research university. Students were now required to complete a research project and present their findings in a written document, which would serve as the basis for their degree.

The modern thesis as we know it today has evolved over time, with different disciplines and institutions adopting their own standards and formats. However, the basic elements of a thesis – original research, a clear research question, a thorough review of the literature, and a well-argued conclusion – remain the same.

Structure of Thesis

The structure of a thesis may vary slightly depending on the specific requirements of the institution, department, or field of study, but generally, it follows a specific format.

Here’s a breakdown of the structure of a thesis:

This is the first page of the thesis that includes the title of the thesis, the name of the author, the name of the institution, the department, the date, and any other relevant information required by the institution.

This is a brief summary of the thesis that provides an overview of the research question, methodology, findings, and conclusions.

This page provides a list of all the chapters and sections in the thesis and their page numbers.

Introduction

This chapter provides an overview of the research question, the context of the research, and the purpose of the study. The introduction should also outline the methodology and the scope of the research.

Literature Review

This chapter provides a critical analysis of the relevant literature on the research topic. It should demonstrate the gap in the existing knowledge and justify the need for the research.

Methodology

This chapter provides a detailed description of the research methods used to gather and analyze data. It should explain the research design, the sampling method, data collection techniques, and data analysis procedures.

This chapter presents the findings of the research. It should include tables, graphs, and charts to illustrate the results.

This chapter interprets the results and relates them to the research question. It should explain the significance of the findings and their implications for the research topic.

This chapter summarizes the key findings and the main conclusions of the research. It should also provide recommendations for future research.

This section provides a list of all the sources cited in the thesis. The citation style may vary depending on the requirements of the institution or the field of study.

This section includes any additional material that supports the research, such as raw data, survey questionnaires, or other relevant documents.

How to write Thesis

Here are some steps to help you write a thesis:

• Choose a Topic: The first step in writing a thesis is to choose a topic that interests you and is relevant to your field of study. You should also consider the scope of the topic and the availability of resources for research.
• Develop a Research Question: Once you have chosen a topic, you need to develop a research question that you will answer in your thesis. The research question should be specific, clear, and feasible.
• Conduct a Literature Review: Before you start your research, you need to conduct a literature review to identify the existing knowledge and gaps in the field. This will help you refine your research question and develop a research methodology.
• Develop a Research Methodology: Once you have refined your research question, you need to develop a research methodology that includes the research design, data collection methods, and data analysis procedures.
• Collect and Analyze Data: After developing your research methodology, you need to collect and analyze data. This may involve conducting surveys, interviews, experiments, or analyzing existing data.
• Write the Thesis: Once you have analyzed the data, you need to write the thesis. The thesis should follow a specific structure that includes an introduction, literature review, methodology, results, discussion, conclusion, and references.
• Edit and Proofread: After completing the thesis, you need to edit and proofread it carefully. You should also have someone else review it to ensure that it is clear, concise, and free of errors.
• Submit the Thesis: Finally, you need to submit the thesis to your academic advisor or committee for review and evaluation.

Example of Thesis

Example of Thesis template for Students:

Title of Thesis

Table of Contents:

Chapter 1: Introduction

Chapter 2: Literature Review

Chapter 3: Research Methodology

Chapter 4: Results

Chapter 5: Discussion

Chapter 6: Conclusion

References:

Appendices:

Note: That’s just a basic template, but it should give you an idea of the structure and content that a typical thesis might include. Be sure to consult with your department or supervisor for any specific formatting requirements they may have. Good luck with your thesis!

Application of Thesis

Thesis is an important academic document that serves several purposes. Here are some of the applications of thesis:

• Academic Requirement: A thesis is a requirement for many academic programs, especially at the graduate level. It is an essential component of the evaluation process and demonstrates the student’s ability to conduct original research and contribute to the knowledge in their field.
• Career Advancement: A thesis can also help in career advancement. Employers often value candidates who have completed a thesis as it demonstrates their research skills, critical thinking abilities, and their dedication to their field of study.
• Publication : A thesis can serve as a basis for future publications in academic journals, books, or conference proceedings. It provides the researcher with an opportunity to present their research to a wider audience and contribute to the body of knowledge in their field.
• Personal Development: Writing a thesis is a challenging task that requires time, dedication, and perseverance. It provides the student with an opportunity to develop critical thinking, research, and writing skills that are essential for their personal and professional development.
• Impact on Society: The findings of a thesis can have an impact on society by addressing important issues, providing insights into complex problems, and contributing to the development of policies and practices.

Purpose of Thesis

The purpose of a thesis is to present original research findings in a clear and organized manner. It is a formal document that demonstrates a student’s ability to conduct independent research and contribute to the knowledge in their field of study. The primary purposes of a thesis are:

• To Contribute to Knowledge: The main purpose of a thesis is to contribute to the knowledge in a particular field of study. By conducting original research and presenting their findings, the student adds new insights and perspectives to the existing body of knowledge.
• To Demonstrate Research Skills: A thesis is an opportunity for the student to demonstrate their research skills. This includes the ability to formulate a research question, design a research methodology, collect and analyze data, and draw conclusions based on their findings.
• To Develop Critical Thinking: Writing a thesis requires critical thinking and analysis. The student must evaluate existing literature and identify gaps in the field, as well as develop and defend their own ideas.
• To Provide Evidence of Competence : A thesis provides evidence of the student’s competence in their field of study. It demonstrates their ability to apply theoretical concepts to real-world problems, and their ability to communicate their ideas effectively.
• To Facilitate Career Advancement : Completing a thesis can help the student advance their career by demonstrating their research skills and dedication to their field of study. It can also provide a basis for future publications, presentations, or research projects.

When to Write Thesis

The timing for writing a thesis depends on the specific requirements of the academic program or institution. In most cases, the opportunity to write a thesis is typically offered at the graduate level, but there may be exceptions.

Generally, students should plan to write their thesis during the final year of their graduate program. This allows sufficient time for conducting research, analyzing data, and writing the thesis. It is important to start planning the thesis early and to identify a research topic and research advisor as soon as possible.

In some cases, students may be able to write a thesis as part of an undergraduate program or as an independent research project outside of an academic program. In such cases, it is important to consult with faculty advisors or mentors to ensure that the research is appropriately designed and executed.

It is important to note that the process of writing a thesis can be time-consuming and requires a significant amount of effort and dedication. It is important to plan accordingly and to allocate sufficient time for conducting research, analyzing data, and writing the thesis.

Characteristics of Thesis

The characteristics of a thesis vary depending on the specific academic program or institution. However, some general characteristics of a thesis include:

• Originality : A thesis should present original research findings or insights. It should demonstrate the student’s ability to conduct independent research and contribute to the knowledge in their field of study.
• Clarity : A thesis should be clear and concise. It should present the research question, methodology, findings, and conclusions in a logical and organized manner. It should also be well-written, with proper grammar, spelling, and punctuation.
• Research-Based: A thesis should be based on rigorous research, which involves collecting and analyzing data from various sources. The research should be well-designed, with appropriate research methods and techniques.
• Evidence-Based : A thesis should be based on evidence, which means that all claims made in the thesis should be supported by data or literature. The evidence should be properly cited using appropriate citation styles.
• Critical Thinking: A thesis should demonstrate the student’s ability to critically analyze and evaluate information. It should present the student’s own ideas and arguments, and engage with existing literature in the field.
• Academic Style : A thesis should adhere to the conventions of academic writing. It should be well-structured, with clear headings and subheadings, and should use appropriate academic language.

Advantages of Thesis

There are several advantages to writing a thesis, including:

• Development of Research Skills: Writing a thesis requires extensive research and analytical skills. It helps to develop the student’s research skills, including the ability to formulate research questions, design and execute research methodologies, collect and analyze data, and draw conclusions based on their findings.
• Contribution to Knowledge: Writing a thesis provides an opportunity for the student to contribute to the knowledge in their field of study. By conducting original research, they can add new insights and perspectives to the existing body of knowledge.
• Preparation for Future Research: Completing a thesis prepares the student for future research projects. It provides them with the necessary skills to design and execute research methodologies, analyze data, and draw conclusions based on their findings.
• Career Advancement: Writing a thesis can help to advance the student’s career. It demonstrates their research skills and dedication to their field of study, and provides a basis for future publications, presentations, or research projects.
• Personal Growth: Completing a thesis can be a challenging and rewarding experience. It requires dedication, hard work, and perseverance. It can help the student to develop self-confidence, independence, and a sense of accomplishment.

Limitations of Thesis

There are also some limitations to writing a thesis, including:

• Time and Resources: Writing a thesis requires a significant amount of time and resources. It can be a time-consuming and expensive process, as it may involve conducting original research, analyzing data, and producing a lengthy document.
• Narrow Focus: A thesis is typically focused on a specific research question or topic, which may limit the student’s exposure to other areas within their field of study.
• Limited Audience: A thesis is usually only read by a small number of people, such as the student’s thesis advisor and committee members. This limits the potential impact of the research findings.
• Lack of Real-World Application : Some thesis topics may be highly theoretical or academic in nature, which may limit their practical application in the real world.
• Pressure and Stress : Writing a thesis can be a stressful and pressure-filled experience, as it may involve meeting strict deadlines, conducting original research, and producing a high-quality document.
• Potential for Isolation: Writing a thesis can be a solitary experience, as the student may spend a significant amount of time working independently on their research and writing.

About the author

Muhammad Hassan

Researcher, Academic Writer, Web developer

You may also like

Data Collection – Methods Types and Examples

Delimitations in Research – Types, Examples and...

Research Process – Steps, Examples and Tips

Research Design – Types, Methods and Examples

Institutional Review Board – Application Sample...

Evaluating Research – Process, Examples and...

Numbers, Facts and Trends Shaping Your World

Read our research on:

Full Topic List

Regions & Countries

• Publications
• Our Methods
• Short Reads
• Tools & Resources

Read Our Research On:

Writing Survey Questions

Perhaps the most important part of the survey process is the creation of questions that accurately measure the opinions, experiences and behaviors of the public. Accurate random sampling will be wasted if the information gathered is built on a shaky foundation of ambiguous or biased questions. Creating good measures involves both writing good questions and organizing them to form the questionnaire.

Questionnaire design is a multistage process that requires attention to many details at once. Designing the questionnaire is complicated because surveys can ask about topics in varying degrees of detail, questions can be asked in different ways, and questions asked earlier in a survey may influence how people respond to later questions. Researchers are also often interested in measuring change over time and therefore must be attentive to how opinions or behaviors have been measured in prior surveys.

Surveyors may conduct pilot tests or focus groups in the early stages of questionnaire development in order to better understand how people think about an issue or comprehend a question. Pretesting a survey is an essential step in the questionnaire design process to evaluate how people respond to the overall questionnaire and specific questions, especially when questions are being introduced for the first time.

For many years, surveyors approached questionnaire design as an art, but substantial research over the past forty years has demonstrated that there is a lot of science involved in crafting a good survey questionnaire. Here, we discuss the pitfalls and best practices of designing questionnaires.

Question development

There are several steps involved in developing a survey questionnaire. The first is identifying what topics will be covered in the survey. For Pew Research Center surveys, this involves thinking about what is happening in our nation and the world and what will be relevant to the public, policymakers and the media. We also track opinion on a variety of issues over time so we often ensure that we update these trends on a regular basis to better understand whether people’s opinions are changing.

At Pew Research Center, questionnaire development is a collaborative and iterative process where staff meet to discuss drafts of the questionnaire several times over the course of its development. We frequently test new survey questions ahead of time through qualitative research methods such as  focus groups , cognitive interviews, pretesting (often using an  online, opt-in sample ), or a combination of these approaches. Researchers use insights from this testing to refine questions before they are asked in a production survey, such as on the ATP.

Measuring change over time

Many surveyors want to track changes over time in people’s attitudes, opinions and behaviors. To measure change, questions are asked at two or more points in time. A cross-sectional design surveys different people in the same population at multiple points in time. A panel, such as the ATP, surveys the same people over time. However, it is common for the set of people in survey panels to change over time as new panelists are added and some prior panelists drop out. Many of the questions in Pew Research Center surveys have been asked in prior polls. Asking the same questions at different points in time allows us to report on changes in the overall views of the general public (or a subset of the public, such as registered voters, men or Black Americans), or what we call “trending the data”.

When measuring change over time, it is important to use the same question wording and to be sensitive to where the question is asked in the questionnaire to maintain a similar context as when the question was asked previously (see  question wording  and  question order  for further information). All of our survey reports include a topline questionnaire that provides the exact question wording and sequencing, along with results from the current survey and previous surveys in which we asked the question.

The Center’s transition from conducting U.S. surveys by live telephone interviewing to an online panel (around 2014 to 2020) complicated some opinion trends, but not others. Opinion trends that ask about sensitive topics (e.g., personal finances or attending religious services ) or that elicited volunteered answers (e.g., “neither” or “don’t know”) over the phone tended to show larger differences than other trends when shifting from phone polls to the online ATP. The Center adopted several strategies for coping with changes to data trends that may be related to this change in methodology. If there is evidence suggesting that a change in a trend stems from switching from phone to online measurement, Center reports flag that possibility for readers to try to head off confusion or erroneous conclusions.

Open- and closed-ended questions

One of the most significant decisions that can affect how people answer questions is whether the question is posed as an open-ended question, where respondents provide a response in their own words, or a closed-ended question, where they are asked to choose from a list of answer choices.

For example, in a poll conducted after the 2008 presidential election, people responded very differently to two versions of the question: “What one issue mattered most to you in deciding how you voted for president?” One was closed-ended and the other open-ended. In the closed-ended version, respondents were provided five options and could volunteer an option not on the list.

When explicitly offered the economy as a response, more than half of respondents (58%) chose this answer; only 35% of those who responded to the open-ended version volunteered the economy. Moreover, among those asked the closed-ended version, fewer than one-in-ten (8%) provided a response other than the five they were read. By contrast, fully 43% of those asked the open-ended version provided a response not listed in the closed-ended version of the question. All of the other issues were chosen at least slightly more often when explicitly offered in the closed-ended version than in the open-ended version. (Also see  “High Marks for the Campaign, a High Bar for Obama”  for more information.)

Researchers will sometimes conduct a pilot study using open-ended questions to discover which answers are most common. They will then develop closed-ended questions based off that pilot study that include the most common responses as answer choices. In this way, the questions may better reflect what the public is thinking, how they view a particular issue, or bring certain issues to light that the researchers may not have been aware of.

When asking closed-ended questions, the choice of options provided, how each option is described, the number of response options offered, and the order in which options are read can all influence how people respond. One example of the impact of how categories are defined can be found in a Pew Research Center poll conducted in January 2002. When half of the sample was asked whether it was “more important for President Bush to focus on domestic policy or foreign policy,” 52% chose domestic policy while only 34% said foreign policy. When the category “foreign policy” was narrowed to a specific aspect – “the war on terrorism” – far more people chose it; only 33% chose domestic policy while 52% chose the war on terrorism.

In most circumstances, the number of answer choices should be kept to a relatively small number – just four or perhaps five at most – especially in telephone surveys. Psychological research indicates that people have a hard time keeping more than this number of choices in mind at one time. When the question is asking about an objective fact and/or demographics, such as the religious affiliation of the respondent, more categories can be used. In fact, they are encouraged to ensure inclusivity. For example, Pew Research Center’s standard religion questions include more than 12 different categories, beginning with the most common affiliations (Protestant and Catholic). Most respondents have no trouble with this question because they can expect to see their religious group within that list in a self-administered survey.

In addition to the number and choice of response options offered, the order of answer categories can influence how people respond to closed-ended questions. Research suggests that in telephone surveys respondents more frequently choose items heard later in a list (a “recency effect”), and in self-administered surveys, they tend to choose items at the top of the list (a “primacy” effect).

Because of concerns about the effects of category order on responses to closed-ended questions, many sets of response options in Pew Research Center’s surveys are programmed to be randomized to ensure that the options are not asked in the same order for each respondent. Rotating or randomizing means that questions or items in a list are not asked in the same order to each respondent. Answers to questions are sometimes affected by questions that precede them. By presenting questions in a different order to each respondent, we ensure that each question gets asked in the same context as every other question the same number of times (e.g., first, last or any position in between). This does not eliminate the potential impact of previous questions on the current question, but it does ensure that this bias is spread randomly across all of the questions or items in the list. For instance, in the example discussed above about what issue mattered most in people’s vote, the order of the five issues in the closed-ended version of the question was randomized so that no one issue appeared early or late in the list for all respondents. Randomization of response items does not eliminate order effects, but it does ensure that this type of bias is spread randomly.

Questions with ordinal response categories – those with an underlying order (e.g., excellent, good, only fair, poor OR very favorable, mostly favorable, mostly unfavorable, very unfavorable) – are generally not randomized because the order of the categories conveys important information to help respondents answer the question. Generally, these types of scales should be presented in order so respondents can easily place their responses along the continuum, but the order can be reversed for some respondents. For example, in one of Pew Research Center’s questions about abortion, half of the sample is asked whether abortion should be “legal in all cases, legal in most cases, illegal in most cases, illegal in all cases,” while the other half of the sample is asked the same question with the response categories read in reverse order, starting with “illegal in all cases.” Again, reversing the order does not eliminate the recency effect but distributes it randomly across the population.

Question wording

The choice of words and phrases in a question is critical in expressing the meaning and intent of the question to the respondent and ensuring that all respondents interpret the question the same way. Even small wording differences can substantially affect the answers people provide.

[View more Methods 101 Videos ]

An example of a wording difference that had a significant impact on responses comes from a January 2003 Pew Research Center survey. When people were asked whether they would “favor or oppose taking military action in Iraq to end Saddam Hussein’s rule,” 68% said they favored military action while 25% said they opposed military action. However, when asked whether they would “favor or oppose taking military action in Iraq to end Saddam Hussein’s rule  even if it meant that U.S. forces might suffer thousands of casualties, ” responses were dramatically different; only 43% said they favored military action, while 48% said they opposed it. The introduction of U.S. casualties altered the context of the question and influenced whether people favored or opposed military action in Iraq.

There has been a substantial amount of research to gauge the impact of different ways of asking questions and how to minimize differences in the way respondents interpret what is being asked. The issues related to question wording are more numerous than can be treated adequately in this short space, but below are a few of the important things to consider:

First, it is important to ask questions that are clear and specific and that each respondent will be able to answer. If a question is open-ended, it should be evident to respondents that they can answer in their own words and what type of response they should provide (an issue or problem, a month, number of days, etc.). Closed-ended questions should include all reasonable responses (i.e., the list of options is exhaustive) and the response categories should not overlap (i.e., response options should be mutually exclusive). Further, it is important to discern when it is best to use forced-choice close-ended questions (often denoted with a radio button in online surveys) versus “select-all-that-apply” lists (or check-all boxes). A 2019 Center study found that forced-choice questions tend to yield more accurate responses, especially for sensitive questions.  Based on that research, the Center generally avoids using select-all-that-apply questions.

It is also important to ask only one question at a time. Questions that ask respondents to evaluate more than one concept (known as double-barreled questions) – such as “How much confidence do you have in President Obama to handle domestic and foreign policy?” – are difficult for respondents to answer and often lead to responses that are difficult to interpret. In this example, it would be more effective to ask two separate questions, one about domestic policy and another about foreign policy.

In general, questions that use simple and concrete language are more easily understood by respondents. It is especially important to consider the education level of the survey population when thinking about how easy it will be for respondents to interpret and answer a question. Double negatives (e.g., do you favor or oppose  not  allowing gays and lesbians to legally marry) or unfamiliar abbreviations or jargon (e.g., ANWR instead of Arctic National Wildlife Refuge) can result in respondent confusion and should be avoided.

Similarly, it is important to consider whether certain words may be viewed as biased or potentially offensive to some respondents, as well as the emotional reaction that some words may provoke. For example, in a 2005 Pew Research Center survey, 51% of respondents said they favored “making it legal for doctors to give terminally ill patients the means to end their lives,” but only 44% said they favored “making it legal for doctors to assist terminally ill patients in committing suicide.” Although both versions of the question are asking about the same thing, the reaction of respondents was different. In another example, respondents have reacted differently to questions using the word “welfare” as opposed to the more generic “assistance to the poor.” Several experiments have shown that there is much greater public support for expanding “assistance to the poor” than for expanding “welfare.”

We often write two versions of a question and ask half of the survey sample one version of the question and the other half the second version. Thus, we say we have two  forms  of the questionnaire. Respondents are assigned randomly to receive either form, so we can assume that the two groups of respondents are essentially identical. On questions where two versions are used, significant differences in the answers between the two forms tell us that the difference is a result of the way we worded the two versions.

One of the most common formats used in survey questions is the “agree-disagree” format. In this type of question, respondents are asked whether they agree or disagree with a particular statement. Research has shown that, compared with the better educated and better informed, less educated and less informed respondents have a greater tendency to agree with such statements. This is sometimes called an “acquiescence bias” (since some kinds of respondents are more likely to acquiesce to the assertion than are others). This behavior is even more pronounced when there’s an interviewer present, rather than when the survey is self-administered. A better practice is to offer respondents a choice between alternative statements. A Pew Research Center experiment with one of its routinely asked values questions illustrates the difference that question format can make. Not only does the forced choice format yield a very different result overall from the agree-disagree format, but the pattern of answers between respondents with more or less formal education also tends to be very different.

One other challenge in developing questionnaires is what is called “social desirability bias.” People have a natural tendency to want to be accepted and liked, and this may lead people to provide inaccurate answers to questions that deal with sensitive subjects. Research has shown that respondents understate alcohol and drug use, tax evasion and racial bias. They also may overstate church attendance, charitable contributions and the likelihood that they will vote in an election. Researchers attempt to account for this potential bias in crafting questions about these topics. For instance, when Pew Research Center surveys ask about past voting behavior, it is important to note that circumstances may have prevented the respondent from voting: “In the 2012 presidential election between Barack Obama and Mitt Romney, did things come up that kept you from voting, or did you happen to vote?” The choice of response options can also make it easier for people to be honest. For example, a question about church attendance might include three of six response options that indicate infrequent attendance. Research has also shown that social desirability bias can be greater when an interviewer is present (e.g., telephone and face-to-face surveys) than when respondents complete the survey themselves (e.g., paper and web surveys).

Lastly, because slight modifications in question wording can affect responses, identical question wording should be used when the intention is to compare results to those from earlier surveys. Similarly, because question wording and responses can vary based on the mode used to survey respondents, researchers should carefully evaluate the likely effects on trend measurements if a different survey mode will be used to assess change in opinion over time.

Question order

Once the survey questions are developed, particular attention should be paid to how they are ordered in the questionnaire. Surveyors must be attentive to how questions early in a questionnaire may have unintended effects on how respondents answer subsequent questions. Researchers have demonstrated that the order in which questions are asked can influence how people respond; earlier questions can unintentionally provide context for the questions that follow (these effects are called “order effects”).

One kind of order effect can be seen in responses to open-ended questions. Pew Research Center surveys generally ask open-ended questions about national problems, opinions about leaders and similar topics near the beginning of the questionnaire. If closed-ended questions that relate to the topic are placed before the open-ended question, respondents are much more likely to mention concepts or considerations raised in those earlier questions when responding to the open-ended question.

For closed-ended opinion questions, there are two main types of order effects: contrast effects ( where the order results in greater differences in responses), and assimilation effects (where responses are more similar as a result of their order).

An example of a contrast effect can be seen in a Pew Research Center poll conducted in October 2003, a dozen years before same-sex marriage was legalized in the U.S. That poll found that people were more likely to favor allowing gays and lesbians to enter into legal agreements that give them the same rights as married couples when this question was asked after one about whether they favored or opposed allowing gays and lesbians to marry (45% favored legal agreements when asked after the marriage question, but 37% favored legal agreements without the immediate preceding context of a question about same-sex marriage). Responses to the question about same-sex marriage, meanwhile, were not significantly affected by its placement before or after the legal agreements question.

Another experiment embedded in a December 2008 Pew Research Center poll also resulted in a contrast effect. When people were asked “All in all, are you satisfied or dissatisfied with the way things are going in this country today?” immediately after having been asked “Do you approve or disapprove of the way George W. Bush is handling his job as president?”; 88% said they were dissatisfied, compared with only 78% without the context of the prior question.

Responses to presidential approval remained relatively unchanged whether national satisfaction was asked before or after it. A similar finding occurred in December 2004 when both satisfaction and presidential approval were much higher (57% were dissatisfied when Bush approval was asked first vs. 51% when general satisfaction was asked first).

Several studies also have shown that asking a more specific question before a more general question (e.g., asking about happiness with one’s marriage before asking about one’s overall happiness) can result in a contrast effect. Although some exceptions have been found, people tend to avoid redundancy by excluding the more specific question from the general rating.

Assimilation effects occur when responses to two questions are more consistent or closer together because of their placement in the questionnaire. We found an example of an assimilation effect in a Pew Research Center poll conducted in November 2008 when we asked whether Republican leaders should work with Obama or stand up to him on important issues and whether Democratic leaders should work with Republican leaders or stand up to them on important issues. People were more likely to say that Republican leaders should work with Obama when the question was preceded by the one asking what Democratic leaders should do in working with Republican leaders (81% vs. 66%). However, when people were first asked about Republican leaders working with Obama, fewer said that Democratic leaders should work with Republican leaders (71% vs. 82%).

The order questions are asked is of particular importance when tracking trends over time. As a result, care should be taken to ensure that the context is similar each time a question is asked. Modifying the context of the question could call into question any observed changes over time (see  measuring change over time  for more information).

A questionnaire, like a conversation, should be grouped by topic and unfold in a logical order. It is often helpful to begin the survey with simple questions that respondents will find interesting and engaging. Throughout the survey, an effort should be made to keep the survey interesting and not overburden respondents with several difficult questions right after one another. Demographic questions such as income, education or age should not be asked near the beginning of a survey unless they are needed to determine eligibility for the survey or for routing respondents through particular sections of the questionnaire. Even then, it is best to precede such items with more interesting and engaging questions. One virtue of survey panels like the ATP is that demographic questions usually only need to be asked once a year, not in each survey.

U.S. Surveys

Other research methods, sign up for our weekly newsletter.

Fresh data delivered Saturday mornings

1615 L St. NW, Suite 800 Washington, DC 20036 USA (+1) 202-419-4300 | Main (+1) 202-857-8562 | Fax (+1) 202-419-4372 |  Media Inquiries

Research Topics

• Age & Generations
• Coronavirus (COVID-19)
• Economy & Work
• Family & Relationships
• Gender & LGBTQ
• Immigration & Migration
• International Affairs
• Internet & Technology
• Methodological Research
• News Habits & Media
• Non-U.S. Governments
• Other Topics
• Politics & Policy
• Race & Ethnicity
• Email Newsletters

ABOUT PEW RESEARCH CENTER  Pew Research Center is a nonpartisan fact tank that informs the public about the issues, attitudes and trends shaping the world. It conducts public opinion polling, demographic research, media content analysis and other empirical social science research. Pew Research Center does not take policy positions. It is a subsidiary of  The Pew Charitable Trusts .

Copyright 2024 Pew Research Center

Terms & Conditions

Privacy Policy

Cookie Settings

Reprints, Permissions & Use Policy

• Future Students
• Parents and Families

Rhody Today

Graduate students recognized with ‘three minute thesis’ awards for influential research.

KINGSTON, R.I., – April 22, 2024 – Three Ph.D. students at the University of Rhode Island have been recognized for their ability to communicate their research effectively to the public as part of URI’s inaugural Three Minute Thesis (3MT) competition. Each student who entered the competition was challenged to present the content and contributions of their research in a 3-minute “ elevator pitch ” that attempted to  capture the attention of a non-specialist audience in a vivid, cogent, jargon-free style – without reverting to academic language – while relying on only a  single static slide as a visual aid.  

“An 80,000 word Ph.D. thesis would take 9 hours to present.  Your time limit… 3 minutes” according to the University of Queensland , which founded the 3MT competition in 2008.  3MT is now replicated at over 900 universities around the world.  “3MT cultivates students’ academic, presentation, and research communication skills, . . . and supports their capacity to effectively explain their research in 3 minutes, in a language appropriate to a non-specialist audience,” according to University of Queensland.

The finals of URI’s 3MT competition took place last month, in Lippitt Hall before an audience of nearly 100 spectators. Winners are: Sarah Davis, who is studying biological and environmental sciences; Md Abdullah Al Rumon, a student in electrical engineering; and Helani Singhapurage, who is studying physics.

“Graduate programs are the secret sauce that makes URI such a great place to study and work, and the Three Minute Thesis competition was an incredible opportunity to showcase the innovative work that our graduate students do every day,” said Professor of Chemistry and Graduate School Dean Brenton DeBoef.

Davis’ first-place presentation, “A Crab’s Eye View of the Plastic Pollution Crisis,” about the New England native Jonah crab, highlighted the urgent threat that pollution poses to ocean life. 

According to Davis, the greatest threat to this species is the level of plastic pollution in the ocean. When the plastic refuse breaks down, becoming microplastics, ingesting these synthetic materials becomes unavoidable for ocean-floor scavengers like crustaceans. 

Second-place winner Al Rumon, wrote his thesis on a device that would more efficiently monitor the vital signs of infants in neonatal intensive care units. His “smart belt” device is a “softer” non-invasive way to gather essential medical information from infants and newborns in delicate conditions. 

Current standard equipment for taking vital signs in infant intensive care units is composed of equipment, including leads for monitors and tubes that are fastened directly to the baby’s skin, which has many drawbacks, says Rumon. Not only can the wires damage or irritate the skin of a newborn, causing bleeding and contact dermatitis, they can prevent the baby from moving freely, making it more difficult for mothers and nurses to hold them. Al Rumon’s belt design is simpler than what exists now for taking vital signs. An article on the $2.6 million grant awarded by the National Institutes of Health to al Rumon and the team developing this device was featured in Rhody Today on Oct. 19, 2023.

Singhapurage, was voted winner of the people’s choice award by the audience, for her research in the field of physics. Singhapurage’s thesis explores light refraction on the microscopic level, and compares the refractions of different kinds of light on different materials by measuring the vibrations emitted. 

Studies of this sort have been conducted before, but Singhapurage’s methods of light and vibration measurement allowed her to discern minute variations in the emitted frequencies that speak to the chemical differences of the material, and perceived differences in its color.

DeBoef, who judged the event, along with Jen Riley, dean of the College of Arts and Sciences; Vinka Oyanedel-Craver, professor and associate dean of research in the College of Engineering; and Christopher Lavan, associate vice provost for the advancement of teaching and learning, called the event a resounding success.

You can view the presentations of all the winners and see the list of the 10 finalists HERE

This story was written by Samantha Melia, a senior journalism and political science major at the University of Rhode Island and an intern in the Department of Marketing and Communications.

• Tahiya Tarannum selected as a 3 Minute Thesis Finalist

Penn State held its inaugural 3 Minute Thesis competition in March, where doctoral candidates were invited to explain their research to a broad audience in less than 3 minutes. McPhillips Lab PhD student Tahiya Tarannum was a finalist in the competition, presenting on her research on duckweed for nutrient remediation. Congrats Tahiya!! link to PSU news story

Recent Posts

• New article on Pittsburgh hazard detection project using fiber-optic cables
• New article highlighting Australia summer water quality student research
• Congrats to summer graduates Alex and Bishwodeep!!
• New blog post on maximizing landscape benefits of solar farms

Recent Comments

• November 2023
• October 2023
• August 2023
• January 2023
• August 2021
• August 2020
• January 2020
• February 2019
• August 2018
• Lab Updates
• Entries feed
• Comments feed
• WordPress.org

Florida State University

FSU | College of Social Sciences & Public Policy

Site Navigation

Global navigation.

College of Social Sciences & Public Policy

DeVoe L. Moore Center Director of Research Receives Honors Thesis Mentor Award  

By: Jordan Brown | Published: April 22, 2024 | 11:00 am

Florida State University’s Honors in the Major Program recognized Crystal Taylor, Ph.D., AICP, with the 2024 Honors Thesis Mentor Award for excellence in directing and advising her undergraduate students in their honors theses.  

Dr. Taylor is the Director of Research for the DeVoe L. Moore Center (DMC), and most of her instructional time is spent at the DMC preparing ambitious new scholars to engage in policy discussions through evidence-based research. 

“I’m extremely pleased to see Dr. Taylor recognized for her excellent mentorship in research,” said Tim Chapin, Ph.D., Dean of the College of Social Sciences and Public Policy. “Her dedication to mentoring and guiding undergraduates in their research is commendable. This award showcases what a great faculty member she is and her ability to get the best out of students.” 

Dr. Taylor was nominated for the award by Camila Aponte, a senior majoring in Political Science and International Affairs. 

In her nomination, Aponte detailed the impact Dr. Taylor had on her development, starting with her time in the Undergraduate Research Opportunity Program (UROP) here at Florida State and culminating with her current Honors in the Major thesis, titled “The Every Student Succeeds Act: Preparing Students for College.”  

Dr. Taylor’s assistance with understanding statistics, quantitative research methods, the format and structure of a thesis project, and research design was crucial for Aponte’s success. 

“I am extremely grateful for Dr. Taylor’s guidance and support,” Aponte said. “Her dedication to the DeVoe L. Moore Center, in pushing high-quality and highly valuable undergraduate research work, indicates that she truly believes in her students and believes that they can achieve greatness and success.” 

Aponte’s first research project was a qualitative study that analyzed citizen involvement in the decision-making process of public infrastructure plans for Leon County, officially termed “participatory planning processes,” by performing a content analysis. In her current thesis, Aponte has switched gears to explore quantitative research within federal policy regarding education and how it’s implemented in Florida; her research primarily tackles how to address gaps in education and graduation rates, including looking at factors like ethnicity and race and how college and career readiness vary by school. 

Dr. Taylor is currently chairing two honors theses and serving on two committees. Since starting as the Director of Research at the DMC, her undergraduate research mentees have presented posters 61 times at conferences. Dr. Taylor personally interviewed and recruited Aponte as part of the UROP during her sophomore year and is now supervising Aponte’s honors thesis in her senior year. 

“Ms. Camila Aponte’s honors thesis research with me has been a wonderful scholarly and professional development journey transitioning from my Undergraduate Research Opportunity Program mentee to my policy research intern, to my Honors Thesis mentee,” Dr. Taylor said. “I am proud of her for all of her work, as she has become a formidable scholar, and am pleased to report she was selected by an external committee of professors across the country to represent Florida State University this April at an academic conference in Las Vegas. I have mentored Camila at several local and state conferences and advocated for travel funds on her behalf. However, this is her first research competition and her first time presenting at the national level.” 

Dr. Taylor received her Bachelor’s in Management from Missouri State University, her Master’s in Geography from the University of Alabama, and her Ph.D. in Urban Planning from Florida State.  

Click here to learn more about the Honors Thesis Mentor Award and its previous recipients. For more information about the DeVoe L. Moore Center, visit coss.fsu.edu/dmc . 

The scourge of customer satisfaction surveys

On a scale of 1 to 5, how likely are you to share this story with a friend?

All I can really say about the appointment at my kid's allergist is that it occurred. We waited weeks to get in, got some tests, received a diagnosis and a treatment plan, had a weird insurance thing that wasted our time. American healthcare took place.

Then I got a survey. 

The email contained the usual set of questions . How would I rate the service I received? How likely was I to recommend them to a friend? But I've gotta say, getting asked how satisfied I was with the care provided by a pediatric allergist was baffling to me. My child received necessary medical treatment at a speed commensurate with its urgency. It was fine. What aspect of it could I possibly evaluate? I don't need to express an opinion about the chairs in the waiting room.

The whole thing vexed me enough that I started to really notice customer satisfaction surveys — and, as I'm sure you've seen, they are everywhere . It seems like every interaction I have with a money-involving organization also comes with a polite request for my feedback. A restaurant. A hotel. A shop. The insurance company that wasted my time. Every time I buy something or interact with someone: another survey. While I was pitching this story to my editor, his email dinged. A survey! How'd we do? How long was your wait time? How satisfied were you with the knowledge and professionalism of the salesperson who served you?

Most of the time I'm not asked to evaluate the quality of a product or service. I'm asked to evaluate the experience , the meta-consumption that drives our hyperactive service economy. A tsunami of surveys has turned us all into optimization analysts for multibillion-dollar companies. Bad enough I'm providing free labor to help a transnational corporation improve its share price or "evaluate" a low-paid, overworked, nonunion employee. It's more than annoying. I'm starting to suspect it's unethical.

This isn't just my imagination. We're all getting more requests for feedback. Global spending on market research has doubled since 2016, to more than $80 billion a year. More than half of that money is doled out in the United States, and a fifth of it — $16 billion! — is devoted to customer surveys.

Consider the experience of Qualtrics, one of the largest survey-data companies. In the past year, the firm has analyzed 1.6 billion survey responses. That's a 4% increase over the prior year — and responses for the first quarter of 2024 were 10% above what Qualtrics projected. Its analysis of "non-structured data," which is to say customer-service phone calls and online chatter, hit 2 billion conversations last year. This year the company projects an increase of 62%.

Why are there suddenly so many surveys? Because people have so many options today that they're not bothering to complain when something sucks. They just move on to a different, equally accessible website. A company pisses them off or disappoints them, and poof! They're gone.

"When a customer has a poor experience, 10% fewer of them are telling the company about it than they did in 2021," says Brad Anderson, the president of product and engineering at Qualtrics. "What's happening is they're just switching." So companies are using surveys in a bid to hang on to those unloyal customers. After all, it's way more expensive to acquire a new customer than keep an old one.

The tricky part is marketing research has shown that the objective quality of a product, its nominal goodness, matters less than whether it meets customer expectations. "Quality," as one research paper put it, "is what the customer says it is." Customer satisfaction correlates with profitability, with share price , with success .

Now, to get all philosophical for a moment, what even is satisfaction , anyway? People tried for decades to figure that out. Then, in 2004, a Bain consultant named Fred Reichheld came up with an answer. He called it the Net Promoter Score. 

Before I tell you what that is, let me ask you a question: On a scale of 1 to 10, how likely would you be to recommend this article to someone else?

That's it. That's what the Net Promoter Score does. If you'd recommend something to someone else, it has by definition satisfied you. Mystery solved.

The NPS came along at the same time as the widening use of the internet and social media, which made it very easy to ask about. Phone calls, snail mail — that stuff is time-consuming and expensive. But surveys sent via email and text are fast and cheap. 

"People don't choose based on objective quality anymore," says one marketing expert.

In American marketing, NPS became an unstoppable craze. Other metrics followed: the Customer Satisfaction Score, the Customer Effort Score, measurements of the entire Customer Experience. A survey, or monitoring calls to customer service, could reveal loyalty, intent to buy again, the specific parts of the "customer journey" that were most pleasant. "People don't choose based on objective quality anymore," says Nick Lee, a marketing professor at the Warwick Business School. "Value is added by way more than what we would call objective product features."

At the peak of the so-called sharing economy, customer surveys were all-powerful. They went both ways: Suddenly, Uber drivers and Uber riders both had star ratings to care about. Customer surveys were going to fix asymmetrical marketplace information. But of course, the whole thing was frothier than a five-star milkshake. By the late 2010s it was becoming clear that all those reviews and ratings were getting less useful over time. They were subject, it turned out, to " reputation inflation ." Eventually everything gets four stars out of five.

The glut of customer surveys has created an additional problem for marketers. Email surveys are like the robocalls of old: You hit delete without even looking at them. "People receive so many survey requests that they're more likely to refuse to participate in any survey," says James Wagner, a researcher at the University of Michigan's Institute for Social Research. It's called oversurveying, and it makes people less likely to respond . Which means that, for statistical validity, companies have to send out more surveys. Which lowers the response rate even further, which means that companies have to send out yet more surveys, in a never-ending doom loop. On a scale of 1 to 5, customer satisfaction with customer-satisfaction surveys is headed to zero.

In reality, nobody's even sure these surveys are measuring the right thing . "Companies regularly collect customer-satisfaction measures, Net Promoter Scores, things like that," says Christine Moorman, a business-administration professor at Duke University who heads up a semiannual survey of hundreds of chief marketing officers. "But then the question is what do they do with it, and to what strategic ends? Most of them are doing it out of habit, not because they're thinking about the larger strategic questions they have."

Big survey companies don't just dump a giant Excel spreadsheet on their clients and send them an invoice. They offer sophisticated analyses of the data they collect. But unless those numbers are tied to possible changes the client might make, what's the point? "It's a huge arms race," says Lee, the Warwick marketing prof. "If you can give me more data rather than less data, I want more data. But the business model as to whether that data is valuable, it's sometimes questionable. Because people don't know what to do with the data, and they let the agency tell them what it says." Just because a company gets a bunch of survey results doesn't mean it knows what to do with them.

Customer surveys aren't just bad for companies. After reading the copious research on how surveys are actually used, I've come to the conclusion that they're even worse for us, the oversurveyed customers.

Any time a scientist wants to do research involving humans, it's a whole thing. That always comes with risks, from exposing people to an untested drug to simply wasting their time. To get approved by an Institutional Review Board, the potential results have to be worth the risks, to provide some benefit to humanity. That's called "equipoise." And if a proposed experiment on living things doesn't have it, you ain't supposed to do the experiment. 

Perhaps customer surveys should be evaluated for "equipoise." What if they're only being used to discipline or fire employees?

Perhaps customer surveys should be evaluated for equipoise. If the companies actually use the data to improve a product or experience, that's good for us subjects. But what if it's used only to improve the company's share value or profitability? Or to discipline or fire employees? That only helps the company. And that doesn't even take into account whether I, the surveyed one, gave my consent for data I provided to be used in that way — a key to ethical research. 

"Maybe we should have to pre-tell people what we're going to do with the data before we get it," Lee says. "That would be a way to stop companies from doing it indiscriminately." But he knows that's a nonstarter. "We'd be adding bureaucracy into the system. Never a popular thing to do with companies."

Worse, for vast swaths of services, you and I are the last people anyone should be soliciting opinions from. Things like doctor visits, legal services, or school classes are "pretty hard for the user to evaluate," Lee says. "We ask for customer feedback on these things all the time, but it's hard for a customer to give you immediate feedback, because a customer doesn't know what quality is yet." The college class you hated because it was hard, and at 8 a.m., might turn out to be your favorite academic memory and the foundation for your professional skill set 15 years later. Whether a visit to the mechanic was pleasant doesn't tell you how well they fixed your car. You have to drive around with your new drive shaft awhile to know whether you got shafted. 

Lee has unpublished data, which hasn't been peer-reviewed, comparing hospital performance in Britain's National Health Service with surveys of both patients and employees. "It's not surprising that the best hospitals have the best patient feedback and best worker feedback," he says. But what is surprising is that worker feedback, not customer responses, correlates most closely with quality. Users, it turns out, aren't very good at telling what's what.

You know what is good at sorting through tons of data? Artificial intelligence. As email surveys get lower and lower response rates, consumer marketing companies have begun to tout their acumen at applying AI to the unstructured verbiage of online reviews, social-media posts, and call-center transcripts. Maybe these new tools, based on large language models, will be able to coax better responses from oversurveyed consumers. "It's the ability to be able to detect when there's a low-quality answer and come back and ask the customer for more data," Anderson says. "When we ask the second question, 40% of the time the customer engages and provides more data. The number of syllables in the second response increases by 9x." 

Now, if I get a callback from a customer-survey robot, there's a good chance most of those additional syllables will be profane. How will I rate my experience getting interviewed by an AI? It might get more actionable data out of me than that email from my kid's allergist did. But I'm pretty sure I won't recommend it to a friend.

Adam Rogers is a senior correspondent at Business Insider.

About Discourse Stories

Through our Discourse journalism, Business Insider seeks to explore and illuminate the day’s most fascinating issues and ideas. Our writers provide thought-provoking perspectives, informed by analysis, reporting, and expertise. Read more Discourse stories here .

Related stories

More from Retail

Most popular

• Main content