5 research methods used in psychology

Research Methods In Psychology

Saul Mcleod, PhD

Editor-in-Chief for Simply Psychology

BSc (Hons) Psychology, MRes, PhD, University of Manchester

Saul Mcleod, PhD., is a qualified psychology teacher with over 18 years of experience in further and higher education. He has been published in peer-reviewed journals, including the Journal of Clinical Psychology.

Learn about our Editorial Process

Olivia Guy-Evans, MSc

Associate Editor for Simply Psychology

BSc (Hons) Psychology, MSc Psychology of Education

Olivia Guy-Evans is a writer and associate editor for Simply Psychology. She has previously worked in healthcare and educational sectors.

Research methods in psychology are systematic procedures used to observe, describe, predict, and explain behavior and mental processes. They include experiments, surveys, case studies, and naturalistic observations, ensuring data collection is objective and reliable to understand and explain psychological phenomena.

Hypotheses are statements about the prediction of the results, that can be verified or disproved by some investigation.

There are four types of hypotheses :

• Null Hypotheses (H0 ) – these predict that no difference will be found in the results between the conditions. Typically these are written ‘There will be no difference…’
• Alternative Hypotheses (Ha or H1) – these predict that there will be a significant difference in the results between the two conditions. This is also known as the experimental hypothesis.
• One-tailed (directional) hypotheses – these state the specific direction the researcher expects the results to move in, e.g. higher, lower, more, less. In a correlation study, the predicted direction of the correlation can be either positive or negative.
• Two-tailed (non-directional) hypotheses – these state that a difference will be found between the conditions of the independent variable but does not state the direction of a difference or relationship. Typically these are always written ‘There will be a difference ….’

All research has an alternative hypothesis (either a one-tailed or two-tailed) and a corresponding null hypothesis.

Once the research is conducted and results are found, psychologists must accept one hypothesis and reject the other. 

So, if a difference is found, the Psychologist would accept the alternative hypothesis and reject the null.  The opposite applies if no difference is found.

Sampling techniques

Sampling is the process of selecting a representative group from the population under study.

A sample is the participants you select from a target population (the group you are interested in) to make generalizations about.

Representative means the extent to which a sample mirrors a researcher’s target population and reflects its characteristics.

Generalisability means the extent to which their findings can be applied to the larger population of which their sample was a part.

• Volunteer sample : where participants pick themselves through newspaper adverts, noticeboards or online.
• Opportunity sampling : also known as convenience sampling , uses people who are available at the time the study is carried out and willing to take part. It is based on convenience.
• Random sampling : when every person in the target population has an equal chance of being selected. An example of random sampling would be picking names out of a hat.
• Systematic sampling : when a system is used to select participants. Picking every Nth person from all possible participants. N = the number of people in the research population / the number of people needed for the sample.
• Stratified sampling : when you identify the subgroups and select participants in proportion to their occurrences.
• Snowball sampling : when researchers find a few participants, and then ask them to find participants themselves and so on.
• Quota sampling : when researchers will be told to ensure the sample fits certain quotas, for example they might be told to find 90 participants, with 30 of them being unemployed.

Experiments always have an independent and dependent variable .

• The independent variable is the one the experimenter manipulates (the thing that changes between the conditions the participants are placed into). It is assumed to have a direct effect on the dependent variable.
• The dependent variable is the thing being measured, or the results of the experiment.

Operationalization of variables means making them measurable/quantifiable. We must use operationalization to ensure that variables are in a form that can be easily tested.

For instance, we can’t really measure ‘happiness’, but we can measure how many times a person smiles within a two-hour period. 

By operationalizing variables, we make it easy for someone else to replicate our research. Remember, this is important because we can check if our findings are reliable.

Extraneous variables are all variables which are not independent variable but could affect the results of the experiment.

It can be a natural characteristic of the participant, such as intelligence levels, gender, or age for example, or it could be a situational feature of the environment such as lighting or noise.

Demand characteristics are a type of extraneous variable that occurs if the participants work out the aims of the research study, they may begin to behave in a certain way.

For example, in Milgram’s research , critics argued that participants worked out that the shocks were not real and they administered them as they thought this was what was required of them. 

Extraneous variables must be controlled so that they do not affect (confound) the results.

Randomly allocating participants to their conditions or using a matched pairs experimental design can help to reduce participant variables. 

Situational variables are controlled by using standardized procedures, ensuring every participant in a given condition is treated in the same way

Experimental Design

Experimental design refers to how participants are allocated to each condition of the independent variable, such as a control or experimental group.

• Independent design ( between-groups design ): each participant is selected for only one group. With the independent design, the most common way of deciding which participants go into which group is by means of randomization. 
• Matched participants design : each participant is selected for only one group, but the participants in the two groups are matched for some relevant factor or factors (e.g. ability; sex; age).
• Repeated measures design ( within groups) : each participant appears in both groups, so that there are exactly the same participants in each group.
• The main problem with the repeated measures design is that there may well be order effects. Their experiences during the experiment may change the participants in various ways.
• They may perform better when they appear in the second group because they have gained useful information about the experiment or about the task. On the other hand, they may perform less well on the second occasion because of tiredness or boredom.
• Counterbalancing is the best way of preventing order effects from disrupting the findings of an experiment, and involves ensuring that each condition is equally likely to be used first and second by the participants.

If we wish to compare two groups with respect to a given independent variable, it is essential to make sure that the two groups do not differ in any other important way. 

Experimental Methods

All experimental methods involve an iv (independent variable) and dv (dependent variable)..

• Field experiments are conducted in the everyday (natural) environment of the participants. The experimenter still manipulates the IV, but in a real-life setting. It may be possible to control extraneous variables, though such control is more difficult than in a lab experiment.
• Natural experiments are when a naturally occurring IV is investigated that isn’t deliberately manipulated, it exists anyway. Participants are not randomly allocated, and the natural event may only occur rarely.

Case studies are in-depth investigations of a person, group, event, or community. It uses information from a range of sources, such as from the person concerned and also from their family and friends.

Many techniques may be used such as interviews, psychological tests, observations and experiments. Case studies are generally longitudinal: in other words, they follow the individual or group over an extended period of time. 

Case studies are widely used in psychology and among the best-known ones carried out were by Sigmund Freud . He conducted very detailed investigations into the private lives of his patients in an attempt to both understand and help them overcome their illnesses.

Case studies provide rich qualitative data and have high levels of ecological validity. However, it is difficult to generalize from individual cases as each one has unique characteristics.

Correlational Studies

Correlation means association; it is a measure of the extent to which two variables are related. One of the variables can be regarded as the predictor variable with the other one as the outcome variable.

Correlational studies typically involve obtaining two different measures from a group of participants, and then assessing the degree of association between the measures. 

The predictor variable can be seen as occurring before the outcome variable in some sense. It is called the predictor variable, because it forms the basis for predicting the value of the outcome variable.

Relationships between variables can be displayed on a graph or as a numerical score called a correlation coefficient.

• If an increase in one variable tends to be associated with an increase in the other, then this is known as a positive correlation .
• If an increase in one variable tends to be associated with a decrease in the other, then this is known as a negative correlation .
• A zero correlation occurs when there is no relationship between variables.

After looking at the scattergraph, if we want to be sure that a significant relationship does exist between the two variables, a statistical test of correlation can be conducted, such as Spearman’s rho.

The test will give us a score, called a correlation coefficient . This is a value between 0 and 1, and the closer to 1 the score is, the stronger the relationship between the variables. This value can be both positive e.g. 0.63, or negative -0.63.

A correlation between variables, however, does not automatically mean that the change in one variable is the cause of the change in the values of the other variable. A correlation only shows if there is a relationship between variables.

Correlation does not always prove causation, as a third variable may be involved. 

Interview Methods

Interviews are commonly divided into two types: structured and unstructured.

A fixed, predetermined set of questions is put to every participant in the same order and in the same way. 

Responses are recorded on a questionnaire, and the researcher presets the order and wording of questions, and sometimes the range of alternative answers.

The interviewer stays within their role and maintains social distance from the interviewee.

There are no set questions, and the participant can raise whatever topics he/she feels are relevant and ask them in their own way. Questions are posed about participants’ answers to the subject

Unstructured interviews are most useful in qualitative research to analyze attitudes and values.

Though they rarely provide a valid basis for generalization, their main advantage is that they enable the researcher to probe social actors’ subjective point of view. 

Questionnaire Method

Questionnaires can be thought of as a kind of written interview. They can be carried out face to face, by telephone, or post.

The choice of questions is important because of the need to avoid bias or ambiguity in the questions, ‘leading’ the respondent or causing offense.

• Open questions are designed to encourage a full, meaningful answer using the subject’s own knowledge and feelings. They provide insights into feelings, opinions, and understanding. Example: “How do you feel about that situation?”
• Closed questions can be answered with a simple “yes” or “no” or specific information, limiting the depth of response. They are useful for gathering specific facts or confirming details. Example: “Do you feel anxious in crowds?”

Its other practical advantages are that it is cheaper than face-to-face interviews and can be used to contact many respondents scattered over a wide area relatively quickly.

Observations

There are different types of observation methods :

• Covert observation is where the researcher doesn’t tell the participants they are being observed until after the study is complete. There could be ethical problems or deception and consent with this particular observation method.
• Overt observation is where a researcher tells the participants they are being observed and what they are being observed for.
• Controlled : behavior is observed under controlled laboratory conditions (e.g., Bandura’s Bobo doll study).
• Natural : Here, spontaneous behavior is recorded in a natural setting.
• Participant : Here, the observer has direct contact with the group of people they are observing. The researcher becomes a member of the group they are researching.  
• Non-participant (aka “fly on the wall): The researcher does not have direct contact with the people being observed. The observation of participants’ behavior is from a distance

Pilot Study

A pilot  study is a small scale preliminary study conducted in order to evaluate the feasibility of the key s teps in a future, full-scale project.

A pilot study is an initial run-through of the procedures to be used in an investigation; it involves selecting a few people and trying out the study on them. It is possible to save time, and in some cases, money, by identifying any flaws in the procedures designed by the researcher.

A pilot study can help the researcher spot any ambiguities (i.e. unusual things) or confusion in the information given to participants or problems with the task devised.

Sometimes the task is too hard, and the researcher may get a floor effect, because none of the participants can score at all or can complete the task – all performances are low.

The opposite effect is a ceiling effect, when the task is so easy that all achieve virtually full marks or top performances and are “hitting the ceiling”.

Research Design

In cross-sectional research , a researcher compares multiple segments of the population at the same time

Sometimes, we want to see how people change over time, as in studies of human development and lifespan. Longitudinal research is a research design in which data-gathering is administered repeatedly over an extended period of time.

In cohort studies , the participants must share a common factor or characteristic such as age, demographic, or occupation. A cohort study is a type of longitudinal study in which researchers monitor and observe a chosen population over an extended period.

Triangulation means using more than one research method to improve the study’s validity.

Reliability

Reliability is a measure of consistency, if a particular measurement is repeated and the same result is obtained then it is described as being reliable.

• Test-retest reliability :  assessing the same person on two different occasions which shows the extent to which the test produces the same answers.
• Inter-observer reliability : the extent to which there is an agreement between two or more observers.

Meta-Analysis

A meta-analysis is a systematic review that involves identifying an aim and then searching for research studies that have addressed similar aims/hypotheses.

This is done by looking through various databases, and then decisions are made about what studies are to be included/excluded.

Strengths: Increases the conclusions’ validity as they’re based on a wider range.

Weaknesses: Research designs in studies can vary, so they are not truly comparable.

Peer Review

A researcher submits an article to a journal. The choice of the journal may be determined by the journal’s audience or prestige.

The journal selects two or more appropriate experts (psychologists working in a similar field) to peer review the article without payment. The peer reviewers assess: the methods and designs used, originality of the findings, the validity of the original research findings and its content, structure and language.

Feedback from the reviewer determines whether the article is accepted. The article may be: Accepted as it is, accepted with revisions, sent back to the author to revise and re-submit or rejected without the possibility of submission.

The editor makes the final decision whether to accept or reject the research report based on the reviewers comments/ recommendations.

Peer review is important because it prevent faulty data from entering the public domain, it provides a way of checking the validity of findings and the quality of the methodology and is used to assess the research rating of university departments.

Peer reviews may be an ideal, whereas in practice there are lots of problems. For example, it slows publication down and may prevent unusual, new work being published. Some reviewers might use it as an opportunity to prevent competing researchers from publishing work.

Some people doubt whether peer review can really prevent the publication of fraudulent research.

The advent of the internet means that a lot of research and academic comment is being published without official peer reviews than before, though systems are evolving on the internet where everyone really has a chance to offer their opinions and police the quality of research.

Types of Data

• Quantitative data is numerical data e.g. reaction time or number of mistakes. It represents how much or how long, how many there are of something. A tally of behavioral categories and closed questions in a questionnaire collect quantitative data.
• Qualitative data is virtually any type of information that can be observed and recorded that is not numerical in nature and can be in the form of written or verbal communication. Open questions in questionnaires and accounts from observational studies collect qualitative data.
• Primary data is first-hand data collected for the purpose of the investigation.
• Secondary data is information that has been collected by someone other than the person who is conducting the research e.g. taken from journals, books or articles.

Validity means how well a piece of research actually measures what it sets out to, or how well it reflects the reality it claims to represent.

Validity is whether the observed effect is genuine and represents what is actually out there in the world.

• Concurrent validity is the extent to which a psychological measure relates to an existing similar measure and obtains close results. For example, a new intelligence test compared to an established test.
• Face validity : does the test measure what it’s supposed to measure ‘on the face of it’. This is done by ‘eyeballing’ the measuring or by passing it to an expert to check.
• Ecological validit y is the extent to which findings from a research study can be generalized to other settings / real life.
• Temporal validity is the extent to which findings from a research study can be generalized to other historical times.

Features of Science

• Paradigm – A set of shared assumptions and agreed methods within a scientific discipline.
• Paradigm shift – The result of the scientific revolution: a significant change in the dominant unifying theory within a scientific discipline.
• Objectivity – When all sources of personal bias are minimised so not to distort or influence the research process.
• Empirical method – Scientific approaches that are based on the gathering of evidence through direct observation and experience.
• Replicability – The extent to which scientific procedures and findings can be repeated by other researchers.
• Falsifiability – The principle that a theory cannot be considered scientific unless it admits the possibility of being proved untrue.

Statistical Testing

A significant result is one where there is a low probability that chance factors were responsible for any observed difference, correlation, or association in the variables tested.

If our test is significant, we can reject our null hypothesis and accept our alternative hypothesis.

If our test is not significant, we can accept our null hypothesis and reject our alternative hypothesis. A null hypothesis is a statement of no effect.

In Psychology, we use p < 0.05 (as it strikes a balance between making a type I and II error) but p < 0.01 is used in tests that could cause harm like introducing a new drug.

A type I error is when the null hypothesis is rejected when it should have been accepted (happens when a lenient significance level is used, an error of optimism).

A type II error is when the null hypothesis is accepted when it should have been rejected (happens when a stringent significance level is used, an error of pessimism).

Ethical Issues

• Informed consent is when participants are able to make an informed judgment about whether to take part. It causes them to guess the aims of the study and change their behavior.
• To deal with it, we can gain presumptive consent or ask them to formally indicate their agreement to participate but it may invalidate the purpose of the study and it is not guaranteed that the participants would understand.
• Deception should only be used when it is approved by an ethics committee, as it involves deliberately misleading or withholding information. Participants should be fully debriefed after the study but debriefing can’t turn the clock back.
• All participants should be informed at the beginning that they have the right to withdraw if they ever feel distressed or uncomfortable.
• It causes bias as the ones that stayed are obedient and some may not withdraw as they may have been given incentives or feel like they’re spoiling the study. Researchers can offer the right to withdraw data after participation.
• Participants should all have protection from harm . The researcher should avoid risks greater than those experienced in everyday life and they should stop the study if any harm is suspected. However, the harm may not be apparent at the time of the study.
• Confidentiality concerns the communication of personal information. The researchers should not record any names but use numbers or false names though it may not be possible as it is sometimes possible to work out who the researchers were.

Want to create or adapt books like this? Learn more about how Pressbooks supports open publishing practices.

Ch 2: Psychological Research Methods

Have you ever wondered whether the violence you see on television affects your behavior? Are you more likely to behave aggressively in real life after watching people behave violently in dramatic situations on the screen? Or, could seeing fictional violence actually get aggression out of your system, causing you to be more peaceful? How are children influenced by the media they are exposed to? A psychologist interested in the relationship between behavior and exposure to violent images might ask these very questions.

The topic of violence in the media today is contentious. Since ancient times, humans have been concerned about the effects of new technologies on our behaviors and thinking processes. The Greek philosopher Socrates, for example, worried that writing—a new technology at that time—would diminish people’s ability to remember because they could rely on written records rather than committing information to memory. In our world of quickly changing technologies, questions about the effects of media continue to emerge. Is it okay to talk on a cell phone while driving? Are headphones good to use in a car? What impact does text messaging have on reaction time while driving? These are types of questions that psychologist David Strayer asks in his lab.

Watch this short video to see how Strayer utilizes the scientific method to reach important conclusions regarding technology and driving safety.

You can view the transcript for “Understanding driver distraction” here (opens in new window) .

How can we go about finding answers that are supported not by mere opinion, but by evidence that we can all agree on? The findings of psychological research can help us navigate issues like this.

Introduction to the Scientific Method

Learning objectives.

• Explain the steps of the scientific method
• Describe why the scientific method is important to psychology
• Summarize the processes of informed consent and debriefing
• Explain how research involving humans or animals is regulated

Scientists are engaged in explaining and understanding how the world around them works, and they are able to do so by coming up with theories that generate hypotheses that are testable and falsifiable. Theories that stand up to their tests are retained and refined, while those that do not are discarded or modified. In this way, research enables scientists to separate fact from simple opinion. Having good information generated from research aids in making wise decisions both in public policy and in our personal lives. In this section, you’ll see how psychologists use the scientific method to study and understand behavior.

The Scientific Process

The goal of all scientists is to better understand the world around them. Psychologists focus their attention on understanding behavior, as well as the cognitive (mental) and physiological (body) processes that underlie behavior. In contrast to other methods that people use to understand the behavior of others, such as intuition and personal experience, the hallmark of scientific research is that there is evidence to support a claim. Scientific knowledge is empirical : It is grounded in objective, tangible evidence that can be observed time and time again, regardless of who is observing.

While behavior is observable, the mind is not. If someone is crying, we can see the behavior. However, the reason for the behavior is more difficult to determine. Is the person crying due to being sad, in pain, or happy? Sometimes we can learn the reason for someone’s behavior by simply asking a question, like “Why are you crying?” However, there are situations in which an individual is either uncomfortable or unwilling to answer the question honestly, or is incapable of answering. For example, infants would not be able to explain why they are crying. In such circumstances, the psychologist must be creative in finding ways to better understand behavior. This module explores how scientific knowledge is generated, and how important that knowledge is in forming decisions in our personal lives and in the public domain.

Process of Scientific Research

Scientific knowledge is advanced through a process known as the scientific method. Basically, ideas (in the form of theories and hypotheses) are tested against the real world (in the form of empirical observations), and those empirical observations lead to more ideas that are tested against the real world, and so on.

The basic steps in the scientific method are:

• Observe a natural phenomenon and define a question about it
• Make a hypothesis, or potential solution to the question
• Test the hypothesis
• If the hypothesis is true, find more evidence or find counter-evidence
• If the hypothesis is false, create a new hypothesis or try again
• Draw conclusions and repeat–the scientific method is never-ending, and no result is ever considered perfect

In order to ask an important question that may improve our understanding of the world, a researcher must first observe natural phenomena. By making observations, a researcher can define a useful question. After finding a question to answer, the researcher can then make a prediction (a hypothesis) about what he or she thinks the answer will be. This prediction is usually a statement about the relationship between two or more variables. After making a hypothesis, the researcher will then design an experiment to test his or her hypothesis and evaluate the data gathered. These data will either support or refute the hypothesis. Based on the conclusions drawn from the data, the researcher will then find more evidence to support the hypothesis, look for counter-evidence to further strengthen the hypothesis, revise the hypothesis and create a new experiment, or continue to incorporate the information gathered to answer the research question.

Basic Principles of the Scientific Method

Two key concepts in the scientific approach are theory and hypothesis. A theory is a well-developed set of ideas that propose an explanation for observed phenomena that can be used to make predictions about future observations. A hypothesis is a testable prediction that is arrived at logically from a theory. It is often worded as an if-then statement (e.g., if I study all night, I will get a passing grade on the test). The hypothesis is extremely important because it bridges the gap between the realm of ideas and the real world. As specific hypotheses are tested, theories are modified and refined to reflect and incorporate the result of these tests.

Other key components in following the scientific method include verifiability, predictability, falsifiability, and fairness. Verifiability means that an experiment must be replicable by another researcher. To achieve verifiability, researchers must make sure to document their methods and clearly explain how their experiment is structured and why it produces certain results.

Predictability in a scientific theory implies that the theory should enable us to make predictions about future events. The precision of these predictions is a measure of the strength of the theory.

Falsifiability refers to whether a hypothesis can be disproved. For a hypothesis to be falsifiable, it must be logically possible to make an observation or do a physical experiment that would show that there is no support for the hypothesis. Even when a hypothesis cannot be shown to be false, that does not necessarily mean it is not valid. Future testing may disprove the hypothesis. This does not mean that a hypothesis has to be shown to be false, just that it can be tested.

To determine whether a hypothesis is supported or not supported, psychological researchers must conduct hypothesis testing using statistics. Hypothesis testing is a type of statistics that determines the probability of a hypothesis being true or false. If hypothesis testing reveals that results were “statistically significant,” this means that there was support for the hypothesis and that the researchers can be reasonably confident that their result was not due to random chance. If the results are not statistically significant, this means that the researchers’ hypothesis was not supported.

Fairness implies that all data must be considered when evaluating a hypothesis. A researcher cannot pick and choose what data to keep and what to discard or focus specifically on data that support or do not support a particular hypothesis. All data must be accounted for, even if they invalidate the hypothesis.

Applying the Scientific Method

To see how this process works, let’s consider a specific theory and a hypothesis that might be generated from that theory. As you’ll learn in a later module, the James-Lange theory of emotion asserts that emotional experience relies on the physiological arousal associated with the emotional state. If you walked out of your home and discovered a very aggressive snake waiting on your doorstep, your heart would begin to race and your stomach churn. According to the James-Lange theory, these physiological changes would result in your feeling of fear. A hypothesis that could be derived from this theory might be that a person who is unaware of the physiological arousal that the sight of the snake elicits will not feel fear.

Remember that a good scientific hypothesis is falsifiable, or capable of being shown to be incorrect. Recall from the introductory module that Sigmund Freud had lots of interesting ideas to explain various human behaviors (Figure 5). However, a major criticism of Freud’s theories is that many of his ideas are not falsifiable; for example, it is impossible to imagine empirical observations that would disprove the existence of the id, the ego, and the superego—the three elements of personality described in Freud’s theories. Despite this, Freud’s theories are widely taught in introductory psychology texts because of their historical significance for personality psychology and psychotherapy, and these remain the root of all modern forms of therapy.

In contrast, the James-Lange theory does generate falsifiable hypotheses, such as the one described above. Some individuals who suffer significant injuries to their spinal columns are unable to feel the bodily changes that often accompany emotional experiences. Therefore, we could test the hypothesis by determining how emotional experiences differ between individuals who have the ability to detect these changes in their physiological arousal and those who do not. In fact, this research has been conducted and while the emotional experiences of people deprived of an awareness of their physiological arousal may be less intense, they still experience emotion (Chwalisz, Diener, & Gallagher, 1988).

Link to Learning

Why the scientific method is important for psychology.

The use of the scientific method is one of the main features that separates modern psychology from earlier philosophical inquiries about the mind. Compared to chemistry, physics, and other “natural sciences,” psychology has long been considered one of the “social sciences” because of the subjective nature of the things it seeks to study. Many of the concepts that psychologists are interested in—such as aspects of the human mind, behavior, and emotions—are subjective and cannot be directly measured. Psychologists often rely instead on behavioral observations and self-reported data, which are considered by some to be illegitimate or lacking in methodological rigor. Applying the scientific method to psychology, therefore, helps to standardize the approach to understanding its very different types of information.

The scientific method allows psychological data to be replicated and confirmed in many instances, under different circumstances, and by a variety of researchers. Through replication of experiments, new generations of psychologists can reduce errors and broaden the applicability of theories. It also allows theories to be tested and validated instead of simply being conjectures that could never be verified or falsified. All of this allows psychologists to gain a stronger understanding of how the human mind works.

Scientific articles published in journals and psychology papers written in the style of the American Psychological Association (i.e., in “APA style”) are structured around the scientific method. These papers include an Introduction, which introduces the background information and outlines the hypotheses; a Methods section, which outlines the specifics of how the experiment was conducted to test the hypothesis; a Results section, which includes the statistics that tested the hypothesis and state whether it was supported or not supported, and a Discussion and Conclusion, which state the implications of finding support for, or no support for, the hypothesis. Writing articles and papers that adhere to the scientific method makes it easy for future researchers to repeat the study and attempt to replicate the results.

Ethics in Research

Today, scientists agree that good research is ethical in nature and is guided by a basic respect for human dignity and safety. However, as you will read in the Tuskegee Syphilis Study, this has not always been the case. Modern researchers must demonstrate that the research they perform is ethically sound. This section presents how ethical considerations affect the design and implementation of research conducted today.

Research Involving Human Participants

Any experiment involving the participation of human subjects is governed by extensive, strict guidelines designed to ensure that the experiment does not result in harm. Any research institution that receives federal support for research involving human participants must have access to an institutional review board (IRB) . The IRB is a committee of individuals often made up of members of the institution’s administration, scientists, and community members (Figure 6). The purpose of the IRB is to review proposals for research that involves human participants. The IRB reviews these proposals with the principles mentioned above in mind, and generally, approval from the IRB is required in order for the experiment to proceed.

An institution’s IRB requires several components in any experiment it approves. For one, each participant must sign an informed consent form before they can participate in the experiment. An informed consent  form provides a written description of what participants can expect during the experiment, including potential risks and implications of the research. It also lets participants know that their involvement is completely voluntary and can be discontinued without penalty at any time. Furthermore, the informed consent guarantees that any data collected in the experiment will remain completely confidential. In cases where research participants are under the age of 18, the parents or legal guardians are required to sign the informed consent form.

While the informed consent form should be as honest as possible in describing exactly what participants will be doing, sometimes deception is necessary to prevent participants’ knowledge of the exact research question from affecting the results of the study. Deception involves purposely misleading experiment participants in order to maintain the integrity of the experiment, but not to the point where the deception could be considered harmful. For example, if we are interested in how our opinion of someone is affected by their attire, we might use deception in describing the experiment to prevent that knowledge from affecting participants’ responses. In cases where deception is involved, participants must receive a full debriefing  upon conclusion of the study—complete, honest information about the purpose of the experiment, how the data collected will be used, the reasons why deception was necessary, and information about how to obtain additional information about the study.

Dig Deeper: Ethics and the Tuskegee Syphilis Study

Unfortunately, the ethical guidelines that exist for research today were not always applied in the past. In 1932, poor, rural, black, male sharecroppers from Tuskegee, Alabama, were recruited to participate in an experiment conducted by the U.S. Public Health Service, with the aim of studying syphilis in black men (Figure 7). In exchange for free medical care, meals, and burial insurance, 600 men agreed to participate in the study. A little more than half of the men tested positive for syphilis, and they served as the experimental group (given that the researchers could not randomly assign participants to groups, this represents a quasi-experiment). The remaining syphilis-free individuals served as the control group. However, those individuals that tested positive for syphilis were never informed that they had the disease.

While there was no treatment for syphilis when the study began, by 1947 penicillin was recognized as an effective treatment for the disease. Despite this, no penicillin was administered to the participants in this study, and the participants were not allowed to seek treatment at any other facilities if they continued in the study. Over the course of 40 years, many of the participants unknowingly spread syphilis to their wives (and subsequently their children born from their wives) and eventually died because they never received treatment for the disease. This study was discontinued in 1972 when the experiment was discovered by the national press (Tuskegee University, n.d.). The resulting outrage over the experiment led directly to the National Research Act of 1974 and the strict ethical guidelines for research on humans described in this chapter. Why is this study unethical? How were the men who participated and their families harmed as a function of this research?

Learn more about the Tuskegee Syphilis Study on the CDC website .

Research Involving Animal Subjects

This does not mean that animal researchers are immune to ethical concerns. Indeed, the humane and ethical treatment of animal research subjects is a critical aspect of this type of research. Researchers must design their experiments to minimize any pain or distress experienced by animals serving as research subjects.

Whereas IRBs review research proposals that involve human participants, animal experimental proposals are reviewed by an Institutional Animal Care and Use Committee (IACUC) . An IACUC consists of institutional administrators, scientists, veterinarians, and community members. This committee is charged with ensuring that all experimental proposals require the humane treatment of animal research subjects. It also conducts semi-annual inspections of all animal facilities to ensure that the research protocols are being followed. No animal research project can proceed without the committee’s approval.

Introduction to Approaches to Research

• Differentiate between descriptive, correlational, and experimental research
• Explain the strengths and weaknesses of case studies, naturalistic observation, and surveys
• Describe the strength and weaknesses of archival research
• Compare longitudinal and cross-sectional approaches to research
• Explain what a correlation coefficient tells us about the relationship between variables
• Describe why correlation does not mean causation
• Describe the experimental process, including ways to control for bias
• Identify and differentiate between independent and dependent variables

Psychologists use descriptive, experimental, and correlational methods to conduct research. Descriptive, or qualitative, methods include the case study, naturalistic observation, surveys, archival research, longitudinal research, and cross-sectional research.

Experiments are conducted in order to determine cause-and-effect relationships. In ideal experimental design, the only difference between the experimental and control groups is whether participants are exposed to the experimental manipulation. Each group goes through all phases of the experiment, but each group will experience a different level of the independent variable: the experimental group is exposed to the experimental manipulation, and the control group is not exposed to the experimental manipulation. The researcher then measures the changes that are produced in the dependent variable in each group. Once data is collected from both groups, it is analyzed statistically to determine if there are meaningful differences between the groups.

When scientists passively observe and measure phenomena it is called correlational research. Here, psychologists do not intervene and change behavior, as they do in experiments. In correlational research, they identify patterns of relationships, but usually cannot infer what causes what. Importantly, with correlational research, you can examine only two variables at a time, no more and no less.

Watch It: More on Research

If you enjoy learning through lectures and want an interesting and comprehensive summary of this section, then click on the Youtube link to watch a lecture given by MIT Professor John Gabrieli . Start at the 30:45 minute mark  and watch through the end to hear examples of actual psychological studies and how they were analyzed. Listen for references to independent and dependent variables, experimenter bias, and double-blind studies. In the lecture, you’ll learn about breaking social norms, “WEIRD” research, why expectations matter, how a warm cup of coffee might make you nicer, why you should change your answer on a multiple choice test, and why praise for intelligence won’t make you any smarter.

You can view the transcript for “Lec 2 | MIT 9.00SC Introduction to Psychology, Spring 2011” here (opens in new window) .

Descriptive Research

There are many research methods available to psychologists in their efforts to understand, describe, and explain behavior and the cognitive and biological processes that underlie it. Some methods rely on observational techniques. Other approaches involve interactions between the researcher and the individuals who are being studied—ranging from a series of simple questions to extensive, in-depth interviews—to well-controlled experiments.

The three main categories of psychological research are descriptive, correlational, and experimental research. Research studies that do not test specific relationships between variables are called descriptive, or qualitative, studies . These studies are used to describe general or specific behaviors and attributes that are observed and measured. In the early stages of research it might be difficult to form a hypothesis, especially when there is not any existing literature in the area. In these situations designing an experiment would be premature, as the question of interest is not yet clearly defined as a hypothesis. Often a researcher will begin with a non-experimental approach, such as a descriptive study, to gather more information about the topic before designing an experiment or correlational study to address a specific hypothesis. Descriptive research is distinct from correlational research , in which psychologists formally test whether a relationship exists between two or more variables. Experimental research  goes a step further beyond descriptive and correlational research and randomly assigns people to different conditions, using hypothesis testing to make inferences about how these conditions affect behavior. It aims to determine if one variable directly impacts and causes another. Correlational and experimental research both typically use hypothesis testing, whereas descriptive research does not.

Each of these research methods has unique strengths and weaknesses, and each method may only be appropriate for certain types of research questions. For example, studies that rely primarily on observation produce incredible amounts of information, but the ability to apply this information to the larger population is somewhat limited because of small sample sizes. Survey research, on the other hand, allows researchers to easily collect data from relatively large samples. While this allows for results to be generalized to the larger population more easily, the information that can be collected on any given survey is somewhat limited and subject to problems associated with any type of self-reported data. Some researchers conduct archival research by using existing records. While this can be a fairly inexpensive way to collect data that can provide insight into a number of research questions, researchers using this approach have no control on how or what kind of data was collected.

Correlational research can find a relationship between two variables, but the only way a researcher can claim that the relationship between the variables is cause and effect is to perform an experiment. In experimental research, which will be discussed later in the text, there is a tremendous amount of control over variables of interest. While this is a powerful approach, experiments are often conducted in very artificial settings. This calls into question the validity of experimental findings with regard to how they would apply in real-world settings. In addition, many of the questions that psychologists would like to answer cannot be pursued through experimental research because of ethical concerns.

The three main types of descriptive studies are, naturalistic observation, case studies, and surveys.

Naturalistic Observation

If you want to understand how behavior occurs, one of the best ways to gain information is to simply observe the behavior in its natural context. However, people might change their behavior in unexpected ways if they know they are being observed. How do researchers obtain accurate information when people tend to hide their natural behavior? As an example, imagine that your professor asks everyone in your class to raise their hand if they always wash their hands after using the restroom. Chances are that almost everyone in the classroom will raise their hand, but do you think hand washing after every trip to the restroom is really that universal?

This is very similar to the phenomenon mentioned earlier in this module: many individuals do not feel comfortable answering a question honestly. But if we are committed to finding out the facts about hand washing, we have other options available to us.

Suppose we send a classmate into the restroom to actually watch whether everyone washes their hands after using the restroom. Will our observer blend into the restroom environment by wearing a white lab coat, sitting with a clipboard, and staring at the sinks? We want our researcher to be inconspicuous—perhaps standing at one of the sinks pretending to put in contact lenses while secretly recording the relevant information. This type of observational study is called naturalistic observation : observing behavior in its natural setting. To better understand peer exclusion, Suzanne Fanger collaborated with colleagues at the University of Texas to observe the behavior of preschool children on a playground. How did the observers remain inconspicuous over the duration of the study? They equipped a few of the children with wireless microphones (which the children quickly forgot about) and observed while taking notes from a distance. Also, the children in that particular preschool (a “laboratory preschool”) were accustomed to having observers on the playground (Fanger, Frankel, & Hazen, 2012).

It is critical that the observer be as unobtrusive and as inconspicuous as possible: when people know they are being watched, they are less likely to behave naturally. If you have any doubt about this, ask yourself how your driving behavior might differ in two situations: In the first situation, you are driving down a deserted highway during the middle of the day; in the second situation, you are being followed by a police car down the same deserted highway (Figure 9).

It should be pointed out that naturalistic observation is not limited to research involving humans. Indeed, some of the best-known examples of naturalistic observation involve researchers going into the field to observe various kinds of animals in their own environments. As with human studies, the researchers maintain their distance and avoid interfering with the animal subjects so as not to influence their natural behaviors. Scientists have used this technique to study social hierarchies and interactions among animals ranging from ground squirrels to gorillas. The information provided by these studies is invaluable in understanding how those animals organize socially and communicate with one another. The anthropologist Jane Goodall, for example, spent nearly five decades observing the behavior of chimpanzees in Africa (Figure 10). As an illustration of the types of concerns that a researcher might encounter in naturalistic observation, some scientists criticized Goodall for giving the chimps names instead of referring to them by numbers—using names was thought to undermine the emotional detachment required for the objectivity of the study (McKie, 2010).

The greatest benefit of naturalistic observation is the validity, or accuracy, of information collected unobtrusively in a natural setting. Having individuals behave as they normally would in a given situation means that we have a higher degree of ecological validity, or realism, than we might achieve with other research approaches. Therefore, our ability to generalize  the findings of the research to real-world situations is enhanced. If done correctly, we need not worry about people or animals modifying their behavior simply because they are being observed. Sometimes, people may assume that reality programs give us a glimpse into authentic human behavior. However, the principle of inconspicuous observation is violated as reality stars are followed by camera crews and are interviewed on camera for personal confessionals. Given that environment, we must doubt how natural and realistic their behaviors are.

The major downside of naturalistic observation is that they are often difficult to set up and control. In our restroom study, what if you stood in the restroom all day prepared to record people’s hand washing behavior and no one came in? Or, what if you have been closely observing a troop of gorillas for weeks only to find that they migrated to a new place while you were sleeping in your tent? The benefit of realistic data comes at a cost. As a researcher you have no control of when (or if) you have behavior to observe. In addition, this type of observational research often requires significant investments of time, money, and a good dose of luck.

Sometimes studies involve structured observation. In these cases, people are observed while engaging in set, specific tasks. An excellent example of structured observation comes from Strange Situation by Mary Ainsworth (you will read more about this in the module on lifespan development). The Strange Situation is a procedure used to evaluate attachment styles that exist between an infant and caregiver. In this scenario, caregivers bring their infants into a room filled with toys. The Strange Situation involves a number of phases, including a stranger coming into the room, the caregiver leaving the room, and the caregiver’s return to the room. The infant’s behavior is closely monitored at each phase, but it is the behavior of the infant upon being reunited with the caregiver that is most telling in terms of characterizing the infant’s attachment style with the caregiver.

Another potential problem in observational research is observer bias . Generally, people who act as observers are closely involved in the research project and may unconsciously skew their observations to fit their research goals or expectations. To protect against this type of bias, researchers should have clear criteria established for the types of behaviors recorded and how those behaviors should be classified. In addition, researchers often compare observations of the same event by multiple observers, in order to test inter-rater reliability : a measure of reliability that assesses the consistency of observations by different observers.

Case Studies

In 2011, the New York Times published a feature story on Krista and Tatiana Hogan, Canadian twin girls. These particular twins are unique because Krista and Tatiana are conjoined twins, connected at the head. There is evidence that the two girls are connected in a part of the brain called the thalamus, which is a major sensory relay center. Most incoming sensory information is sent through the thalamus before reaching higher regions of the cerebral cortex for processing.

The implications of this potential connection mean that it might be possible for one twin to experience the sensations of the other twin. For instance, if Krista is watching a particularly funny television program, Tatiana might smile or laugh even if she is not watching the program. This particular possibility has piqued the interest of many neuroscientists who seek to understand how the brain uses sensory information.

These twins represent an enormous resource in the study of the brain, and since their condition is very rare, it is likely that as long as their family agrees, scientists will follow these girls very closely throughout their lives to gain as much information as possible (Dominus, 2011).

In observational research, scientists are conducting a clinical or case study when they focus on one person or just a few individuals. Indeed, some scientists spend their entire careers studying just 10–20 individuals. Why would they do this? Obviously, when they focus their attention on a very small number of people, they can gain a tremendous amount of insight into those cases. The richness of information that is collected in clinical or case studies is unmatched by any other single research method. This allows the researcher to have a very deep understanding of the individuals and the particular phenomenon being studied.

If clinical or case studies provide so much information, why are they not more frequent among researchers? As it turns out, the major benefit of this particular approach is also a weakness. As mentioned earlier, this approach is often used when studying individuals who are interesting to researchers because they have a rare characteristic. Therefore, the individuals who serve as the focus of case studies are not like most other people. If scientists ultimately want to explain all behavior, focusing attention on such a special group of people can make it difficult to generalize any observations to the larger population as a whole. Generalizing refers to the ability to apply the findings of a particular research project to larger segments of society. Again, case studies provide enormous amounts of information, but since the cases are so specific, the potential to apply what’s learned to the average person may be very limited.

Often, psychologists develop surveys as a means of gathering data. Surveys are lists of questions to be answered by research participants, and can be delivered as paper-and-pencil questionnaires, administered electronically, or conducted verbally (Figure 11). Generally, the survey itself can be completed in a short time, and the ease of administering a survey makes it easy to collect data from a large number of people.

Surveys allow researchers to gather data from larger samples than may be afforded by other research methods . A sample is a subset of individuals selected from a population , which is the overall group of individuals that the researchers are interested in. Researchers study the sample and seek to generalize their findings to the population.

There is both strength and weakness of the survey in comparison to case studies. By using surveys, we can collect information from a larger sample of people. A larger sample is better able to reflect the actual diversity of the population, thus allowing better generalizability. Therefore, if our sample is sufficiently large and diverse, we can assume that the data we collect from the survey can be generalized to the larger population with more certainty than the information collected through a case study. However, given the greater number of people involved, we are not able to collect the same depth of information on each person that would be collected in a case study.

Another potential weakness of surveys is something we touched on earlier in this chapter: people don’t always give accurate responses. They may lie, misremember, or answer questions in a way that they think makes them look good. For example, people may report drinking less alcohol than is actually the case.

Any number of research questions can be answered through the use of surveys. One real-world example is the research conducted by Jenkins, Ruppel, Kizer, Yehl, and Griffin (2012) about the backlash against the US Arab-American community following the terrorist attacks of September 11, 2001. Jenkins and colleagues wanted to determine to what extent these negative attitudes toward Arab-Americans still existed nearly a decade after the attacks occurred. In one study, 140 research participants filled out a survey with 10 questions, including questions asking directly about the participant’s overt prejudicial attitudes toward people of various ethnicities. The survey also asked indirect questions about how likely the participant would be to interact with a person of a given ethnicity in a variety of settings (such as, “How likely do you think it is that you would introduce yourself to a person of Arab-American descent?”). The results of the research suggested that participants were unwilling to report prejudicial attitudes toward any ethnic group. However, there were significant differences between their pattern of responses to questions about social interaction with Arab-Americans compared to other ethnic groups: they indicated less willingness for social interaction with Arab-Americans compared to the other ethnic groups. This suggested that the participants harbored subtle forms of prejudice against Arab-Americans, despite their assertions that this was not the case (Jenkins et al., 2012).

Think It Over

Archival research.

In comparing archival research to other research methods, there are several important distinctions. For one, the researcher employing archival research never directly interacts with research participants. Therefore, the investment of time and money to collect data is considerably less with archival research. Additionally, researchers have no control over what information was originally collected. Therefore, research questions have to be tailored so they can be answered within the structure of the existing data sets. There is also no guarantee of consistency between the records from one source to another, which might make comparing and contrasting different data sets problematic.

Longitudinal and Cross-Sectional Research

Sometimes we want to see how people change over time, as in studies of human development and lifespan. When we test the same group of individuals repeatedly over an extended period of time, we are conducting longitudinal research. Longitudinal research  is a research design in which data-gathering is administered repeatedly over an extended period of time. For example, we may survey a group of individuals about their dietary habits at age 20, retest them a decade later at age 30, and then again at age 40.

Another approach is cross-sectional research . In cross-sectional research, a researcher compares multiple segments of the population at the same time. Using the dietary habits example above, the researcher might directly compare different groups of people by age. Instead of observing a group of people for 20 years to see how their dietary habits changed from decade to decade, the researcher would study a group of 20-year-old individuals and compare them to a group of 30-year-old individuals and a group of 40-year-old individuals. While cross-sectional research requires a shorter-term investment, it is also limited by differences that exist between the different generations (or cohorts) that have nothing to do with age per se, but rather reflect the social and cultural experiences of different generations of individuals make them different from one another.

To illustrate this concept, consider the following survey findings. In recent years there has been significant growth in the popular support of same-sex marriage. Many studies on this topic break down survey participants into different age groups. In general, younger people are more supportive of same-sex marriage than are those who are older (Jones, 2013). Does this mean that as we age we become less open to the idea of same-sex marriage, or does this mean that older individuals have different perspectives because of the social climates in which they grew up? Longitudinal research is a powerful approach because the same individuals are involved in the research project over time, which means that the researchers need to be less concerned with differences among cohorts affecting the results of their study.

Often longitudinal studies are employed when researching various diseases in an effort to understand particular risk factors. Such studies often involve tens of thousands of individuals who are followed for several decades. Given the enormous number of people involved in these studies, researchers can feel confident that their findings can be generalized to the larger population. The Cancer Prevention Study-3 (CPS-3) is one of a series of longitudinal studies sponsored by the American Cancer Society aimed at determining predictive risk factors associated with cancer. When participants enter the study, they complete a survey about their lives and family histories, providing information on factors that might cause or prevent the development of cancer. Then every few years the participants receive additional surveys to complete. In the end, hundreds of thousands of participants will be tracked over 20 years to determine which of them develop cancer and which do not.

Clearly, this type of research is important and potentially very informative. For instance, earlier longitudinal studies sponsored by the American Cancer Society provided some of the first scientific demonstrations of the now well-established links between increased rates of cancer and smoking (American Cancer Society, n.d.) (Figure 13).

As with any research strategy, longitudinal research is not without limitations. For one, these studies require an incredible time investment by the researcher and research participants. Given that some longitudinal studies take years, if not decades, to complete, the results will not be known for a considerable period of time. In addition to the time demands, these studies also require a substantial financial investment. Many researchers are unable to commit the resources necessary to see a longitudinal project through to the end.

Research participants must also be willing to continue their participation for an extended period of time, and this can be problematic. People move, get married and take new names, get ill, and eventually die. Even without significant life changes, some people may simply choose to discontinue their participation in the project. As a result, the attrition  rates, or reduction in the number of research participants due to dropouts, in longitudinal studies are quite high and increases over the course of a project. For this reason, researchers using this approach typically recruit many participants fully expecting that a substantial number will drop out before the end. As the study progresses, they continually check whether the sample still represents the larger population, and make adjustments as necessary.

Correlational Research

Did you know that as sales in ice cream increase, so does the overall rate of crime? Is it possible that indulging in your favorite flavor of ice cream could send you on a crime spree? Or, after committing crime do you think you might decide to treat yourself to a cone? There is no question that a relationship exists between ice cream and crime (e.g., Harper, 2013), but it would be pretty foolish to decide that one thing actually caused the other to occur.

It is much more likely that both ice cream sales and crime rates are related to the temperature outside. When the temperature is warm, there are lots of people out of their houses, interacting with each other, getting annoyed with one another, and sometimes committing crimes. Also, when it is warm outside, we are more likely to seek a cool treat like ice cream. How do we determine if there is indeed a relationship between two things? And when there is a relationship, how can we discern whether it is attributable to coincidence or causation?

Correlation Does Not Indicate Causation

Correlational research is useful because it allows us to discover the strength and direction of relationships that exist between two variables. However, correlation is limited because establishing the existence of a relationship tells us little about cause and effect . While variables are sometimes correlated because one does cause the other, it could also be that some other factor, a confounding variable , is actually causing the systematic movement in our variables of interest. In the ice cream/crime rate example mentioned earlier, temperature is a confounding variable that could account for the relationship between the two variables.

Even when we cannot point to clear confounding variables, we should not assume that a correlation between two variables implies that one variable causes changes in another. This can be frustrating when a cause-and-effect relationship seems clear and intuitive. Think back to our discussion of the research done by the American Cancer Society and how their research projects were some of the first demonstrations of the link between smoking and cancer. It seems reasonable to assume that smoking causes cancer, but if we were limited to correlational research , we would be overstepping our bounds by making this assumption.

Unfortunately, people mistakenly make claims of causation as a function of correlations all the time. Such claims are especially common in advertisements and news stories. For example, recent research found that people who eat cereal on a regular basis achieve healthier weights than those who rarely eat cereal (Frantzen, Treviño, Echon, Garcia-Dominic, & DiMarco, 2013; Barton et al., 2005). Guess how the cereal companies report this finding. Does eating cereal really cause an individual to maintain a healthy weight, or are there other possible explanations, such as, someone at a healthy weight is more likely to regularly eat a healthy breakfast than someone who is obese or someone who avoids meals in an attempt to diet (Figure 15)? While correlational research is invaluable in identifying relationships among variables, a major limitation is the inability to establish causality. Psychologists want to make statements about cause and effect, but the only way to do that is to conduct an experiment to answer a research question. The next section describes how scientific experiments incorporate methods that eliminate, or control for, alternative explanations, which allow researchers to explore how changes in one variable cause changes in another variable.

Watch this clip from Freakonomics for an example of how correlation does  not  indicate causation.

You can view the transcript for “Correlation vs. Causality: Freakonomics Movie” here (opens in new window) .

Illusory Correlations

The temptation to make erroneous cause-and-effect statements based on correlational research is not the only way we tend to misinterpret data. We also tend to make the mistake of illusory correlations, especially with unsystematic observations. Illusory correlations , or false correlations, occur when people believe that relationships exist between two things when no such relationship exists. One well-known illusory correlation is the supposed effect that the moon’s phases have on human behavior. Many people passionately assert that human behavior is affected by the phase of the moon, and specifically, that people act strangely when the moon is full (Figure 16).

There is no denying that the moon exerts a powerful influence on our planet. The ebb and flow of the ocean’s tides are tightly tied to the gravitational forces of the moon. Many people believe, therefore, that it is logical that we are affected by the moon as well. After all, our bodies are largely made up of water. A meta-analysis of nearly 40 studies consistently demonstrated, however, that the relationship between the moon and our behavior does not exist (Rotton & Kelly, 1985). While we may pay more attention to odd behavior during the full phase of the moon, the rates of odd behavior remain constant throughout the lunar cycle.

Why are we so apt to believe in illusory correlations like this? Often we read or hear about them and simply accept the information as valid. Or, we have a hunch about how something works and then look for evidence to support that hunch, ignoring evidence that would tell us our hunch is false; this is known as confirmation bias . Other times, we find illusory correlations based on the information that comes most easily to mind, even if that information is severely limited. And while we may feel confident that we can use these relationships to better understand and predict the world around us, illusory correlations can have significant drawbacks. For example, research suggests that illusory correlations—in which certain behaviors are inaccurately attributed to certain groups—are involved in the formation of prejudicial attitudes that can ultimately lead to discriminatory behavior (Fiedler, 2004).

We all have a tendency to make illusory correlations from time to time. Try to think of an illusory correlation that is held by you, a family member, or a close friend. How do you think this illusory correlation came about and what can be done in the future to combat them?

Experiments

Causality: conducting experiments and using the data, experimental hypothesis.

In order to conduct an experiment, a researcher must have a specific hypothesis to be tested. As you’ve learned, hypotheses can be formulated either through direct observation of the real world or after careful review of previous research. For example, if you think that children should not be allowed to watch violent programming on television because doing so would cause them to behave more violently, then you have basically formulated a hypothesis—namely, that watching violent television programs causes children to behave more violently. How might you have arrived at this particular hypothesis? You may have younger relatives who watch cartoons featuring characters using martial arts to save the world from evildoers, with an impressive array of punching, kicking, and defensive postures. You notice that after watching these programs for a while, your young relatives mimic the fighting behavior of the characters portrayed in the cartoon (Figure 17).

These sorts of personal observations are what often lead us to formulate a specific hypothesis, but we cannot use limited personal observations and anecdotal evidence to rigorously test our hypothesis. Instead, to find out if real-world data supports our hypothesis, we have to conduct an experiment.

Designing an Experiment

The most basic experimental design involves two groups: the experimental group and the control group. The two groups are designed to be the same except for one difference— experimental manipulation. The experimental group  gets the experimental manipulation—that is, the treatment or variable being tested (in this case, violent TV images)—and the control group does not. Since experimental manipulation is the only difference between the experimental and control groups, we can be sure that any differences between the two are due to experimental manipulation rather than chance.

In our example of how violent television programming might affect violent behavior in children, we have the experimental group view violent television programming for a specified time and then measure their violent behavior. We measure the violent behavior in our control group after they watch nonviolent television programming for the same amount of time. It is important for the control group to be treated similarly to the experimental group, with the exception that the control group does not receive the experimental manipulation. Therefore, we have the control group watch non-violent television programming for the same amount of time as the experimental group.

We also need to precisely define, or operationalize, what is considered violent and nonviolent. An operational definition is a description of how we will measure our variables, and it is important in allowing others understand exactly how and what a researcher measures in a particular experiment. In operationalizing violent behavior, we might choose to count only physical acts like kicking or punching as instances of this behavior, or we also may choose to include angry verbal exchanges. Whatever we determine, it is important that we operationalize violent behavior in such a way that anyone who hears about our study for the first time knows exactly what we mean by violence. This aids peoples’ ability to interpret our data as well as their capacity to repeat our experiment should they choose to do so.

Once we have operationalized what is considered violent television programming and what is considered violent behavior from our experiment participants, we need to establish how we will run our experiment. In this case, we might have participants watch a 30-minute television program (either violent or nonviolent, depending on their group membership) before sending them out to a playground for an hour where their behavior is observed and the number and type of violent acts is recorded.

Ideally, the people who observe and record the children’s behavior are unaware of who was assigned to the experimental or control group, in order to control for experimenter bias. Experimenter bias refers to the possibility that a researcher’s expectations might skew the results of the study. Remember, conducting an experiment requires a lot of planning, and the people involved in the research project have a vested interest in supporting their hypotheses. If the observers knew which child was in which group, it might influence how much attention they paid to each child’s behavior as well as how they interpreted that behavior. By being blind to which child is in which group, we protect against those biases. This situation is a single-blind study , meaning that one of the groups (participants) are unaware as to which group they are in (experiment or control group) while the researcher who developed the experiment knows which participants are in each group.

In a double-blind study , both the researchers and the participants are blind to group assignments. Why would a researcher want to run a study where no one knows who is in which group? Because by doing so, we can control for both experimenter and participant expectations. If you are familiar with the phrase placebo effect, you already have some idea as to why this is an important consideration. The placebo effect occurs when people’s expectations or beliefs influence or determine their experience in a given situation. In other words, simply expecting something to happen can actually make it happen.

The placebo effect is commonly described in terms of testing the effectiveness of a new medication. Imagine that you work in a pharmaceutical company, and you think you have a new drug that is effective in treating depression. To demonstrate that your medication is effective, you run an experiment with two groups: The experimental group receives the medication, and the control group does not. But you don’t want participants to know whether they received the drug or not.

Why is that? Imagine that you are a participant in this study, and you have just taken a pill that you think will improve your mood. Because you expect the pill to have an effect, you might feel better simply because you took the pill and not because of any drug actually contained in the pill—this is the placebo effect.

To make sure that any effects on mood are due to the drug and not due to expectations, the control group receives a placebo (in this case a sugar pill). Now everyone gets a pill, and once again neither the researcher nor the experimental participants know who got the drug and who got the sugar pill. Any differences in mood between the experimental and control groups can now be attributed to the drug itself rather than to experimenter bias or participant expectations (Figure 18).

Independent and Dependent Variables

In a research experiment, we strive to study whether changes in one thing cause changes in another. To achieve this, we must pay attention to two important variables, or things that can be changed, in any experimental study: the independent variable and the dependent variable. An independent variable is manipulated or controlled by the experimenter. In a well-designed experimental study, the independent variable is the only important difference between the experimental and control groups. In our example of how violent television programs affect children’s display of violent behavior, the independent variable is the type of program—violent or nonviolent—viewed by participants in the study (Figure 19). A dependent variable is what the researcher measures to see how much effect the independent variable had. In our example, the dependent variable is the number of violent acts displayed by the experimental participants.

We expect that the dependent variable will change as a function of the independent variable. In other words, the dependent variable depends on the independent variable. A good way to think about the relationship between the independent and dependent variables is with this question: What effect does the independent variable have on the dependent variable? Returning to our example, what effect does watching a half hour of violent television programming or nonviolent television programming have on the number of incidents of physical aggression displayed on the playground?

Selecting and Assigning Experimental Participants

Now that our study is designed, we need to obtain a sample of individuals to include in our experiment. Our study involves human participants so we need to determine who to include. Participants  are the subjects of psychological research, and as the name implies, individuals who are involved in psychological research actively participate in the process. Often, psychological research projects rely on college students to serve as participants. In fact, the vast majority of research in psychology subfields has historically involved students as research participants (Sears, 1986; Arnett, 2008). But are college students truly representative of the general population? College students tend to be younger, more educated, more liberal, and less diverse than the general population. Although using students as test subjects is an accepted practice, relying on such a limited pool of research participants can be problematic because it is difficult to generalize findings to the larger population.

Our hypothetical experiment involves children, and we must first generate a sample of child participants. Samples are used because populations are usually too large to reasonably involve every member in our particular experiment (Figure 20). If possible, we should use a random sample   (there are other types of samples, but for the purposes of this section, we will focus on random samples). A random sample is a subset of a larger population in which every member of the population has an equal chance of being selected. Random samples are preferred because if the sample is large enough we can be reasonably sure that the participating individuals are representative of the larger population. This means that the percentages of characteristics in the sample—sex, ethnicity, socioeconomic level, and any other characteristics that might affect the results—are close to those percentages in the larger population.

In our example, let’s say we decide our population of interest is fourth graders. But all fourth graders is a very large population, so we need to be more specific; instead we might say our population of interest is all fourth graders in a particular city. We should include students from various income brackets, family situations, races, ethnicities, religions, and geographic areas of town. With this more manageable population, we can work with the local schools in selecting a random sample of around 200 fourth graders who we want to participate in our experiment.

In summary, because we cannot test all of the fourth graders in a city, we want to find a group of about 200 that reflects the composition of that city. With a representative group, we can generalize our findings to the larger population without fear of our sample being biased in some way.

Now that we have a sample, the next step of the experimental process is to split the participants into experimental and control groups through random assignment. With random assignment , all participants have an equal chance of being assigned to either group. There is statistical software that will randomly assign each of the fourth graders in the sample to either the experimental or the control group.

Random assignment is critical for sound experimental design. With sufficiently large samples, random assignment makes it unlikely that there are systematic differences between the groups. So, for instance, it would be very unlikely that we would get one group composed entirely of males, a given ethnic identity, or a given religious ideology. This is important because if the groups were systematically different before the experiment began, we would not know the origin of any differences we find between the groups: Were the differences preexisting, or were they caused by manipulation of the independent variable? Random assignment allows us to assume that any differences observed between experimental and control groups result from the manipulation of the independent variable.

Issues to Consider

While experiments allow scientists to make cause-and-effect claims, they are not without problems. True experiments require the experimenter to manipulate an independent variable, and that can complicate many questions that psychologists might want to address. For instance, imagine that you want to know what effect sex (the independent variable) has on spatial memory (the dependent variable). Although you can certainly look for differences between males and females on a task that taps into spatial memory, you cannot directly control a person’s sex. We categorize this type of research approach as quasi-experimental and recognize that we cannot make cause-and-effect claims in these circumstances.

Experimenters are also limited by ethical constraints. For instance, you would not be able to conduct an experiment designed to determine if experiencing abuse as a child leads to lower levels of self-esteem among adults. To conduct such an experiment, you would need to randomly assign some experimental participants to a group that receives abuse, and that experiment would be unethical.

Introduction to Statistical Thinking

Psychologists use statistics to assist them in analyzing data, and also to give more precise measurements to describe whether something is statistically significant. Analyzing data using statistics enables researchers to find patterns, make claims, and share their results with others. In this section, you’ll learn about some of the tools that psychologists use in statistical analysis.

• Define reliability and validity
• Describe the importance of distributional thinking and the role of p-values in statistical inference
• Describe the role of random sampling and random assignment in drawing cause-and-effect conclusions
• Describe the basic structure of a psychological research article

Interpreting Experimental Findings

Once data is collected from both the experimental and the control groups, a statistical analysis is conducted to find out if there are meaningful differences between the two groups. A statistical analysis determines how likely any difference found is due to chance (and thus not meaningful). In psychology, group differences are considered meaningful, or significant, if the odds that these differences occurred by chance alone are 5 percent or less. Stated another way, if we repeated this experiment 100 times, we would expect to find the same results at least 95 times out of 100.

The greatest strength of experiments is the ability to assert that any significant differences in the findings are caused by the independent variable. This occurs because random selection, random assignment, and a design that limits the effects of both experimenter bias and participant expectancy should create groups that are similar in composition and treatment. Therefore, any difference between the groups is attributable to the independent variable, and now we can finally make a causal statement. If we find that watching a violent television program results in more violent behavior than watching a nonviolent program, we can safely say that watching violent television programs causes an increase in the display of violent behavior.

Reporting Research

When psychologists complete a research project, they generally want to share their findings with other scientists. The American Psychological Association (APA) publishes a manual detailing how to write a paper for submission to scientific journals. Unlike an article that might be published in a magazine like Psychology Today, which targets a general audience with an interest in psychology, scientific journals generally publish peer-reviewed journal articles aimed at an audience of professionals and scholars who are actively involved in research themselves.

A peer-reviewed journal article is read by several other scientists (generally anonymously) with expertise in the subject matter. These peer reviewers provide feedback—to both the author and the journal editor—regarding the quality of the draft. Peer reviewers look for a strong rationale for the research being described, a clear description of how the research was conducted, and evidence that the research was conducted in an ethical manner. They also look for flaws in the study’s design, methods, and statistical analyses. They check that the conclusions drawn by the authors seem reasonable given the observations made during the research. Peer reviewers also comment on how valuable the research is in advancing the discipline’s knowledge. This helps prevent unnecessary duplication of research findings in the scientific literature and, to some extent, ensures that each research article provides new information. Ultimately, the journal editor will compile all of the peer reviewer feedback and determine whether the article will be published in its current state (a rare occurrence), published with revisions, or not accepted for publication.

Peer review provides some degree of quality control for psychological research. Poorly conceived or executed studies can be weeded out, and even well-designed research can be improved by the revisions suggested. Peer review also ensures that the research is described clearly enough to allow other scientists to replicate it, meaning they can repeat the experiment using different samples to determine reliability. Sometimes replications involve additional measures that expand on the original finding. In any case, each replication serves to provide more evidence to support the original research findings. Successful replications of published research make scientists more apt to adopt those findings, while repeated failures tend to cast doubt on the legitimacy of the original article and lead scientists to look elsewhere. For example, it would be a major advancement in the medical field if a published study indicated that taking a new drug helped individuals achieve a healthy weight without changing their diet. But if other scientists could not replicate the results, the original study’s claims would be questioned.

Dig Deeper: The Vaccine-Autism Myth and the Retraction of Published Studies

Some scientists have claimed that routine childhood vaccines cause some children to develop autism, and, in fact, several peer-reviewed publications published research making these claims. Since the initial reports, large-scale epidemiological research has suggested that vaccinations are not responsible for causing autism and that it is much safer to have your child vaccinated than not. Furthermore, several of the original studies making this claim have since been retracted.

A published piece of work can be rescinded when data is called into question because of falsification, fabrication, or serious research design problems. Once rescinded, the scientific community is informed that there are serious problems with the original publication. Retractions can be initiated by the researcher who led the study, by research collaborators, by the institution that employed the researcher, or by the editorial board of the journal in which the article was originally published. In the vaccine-autism case, the retraction was made because of a significant conflict of interest in which the leading researcher had a financial interest in establishing a link between childhood vaccines and autism (Offit, 2008). Unfortunately, the initial studies received so much media attention that many parents around the world became hesitant to have their children vaccinated (Figure 21). For more information about how the vaccine/autism story unfolded, as well as the repercussions of this story, take a look at Paul Offit’s book, Autism’s False Prophets: Bad Science, Risky Medicine, and the Search for a Cure.

Reliability and Validity

Dig deeper:  everyday connection: how valid is the sat.

Standardized tests like the SAT are supposed to measure an individual’s aptitude for a college education, but how reliable and valid are such tests? Research conducted by the College Board suggests that scores on the SAT have high predictive validity for first-year college students’ GPA (Kobrin, Patterson, Shaw, Mattern, & Barbuti, 2008). In this context, predictive validity refers to the test’s ability to effectively predict the GPA of college freshmen. Given that many institutions of higher education require the SAT for admission, this high degree of predictive validity might be comforting.

However, the emphasis placed on SAT scores in college admissions has generated some controversy on a number of fronts. For one, some researchers assert that the SAT is a biased test that places minority students at a disadvantage and unfairly reduces the likelihood of being admitted into a college (Santelices & Wilson, 2010). Additionally, some research has suggested that the predictive validity of the SAT is grossly exaggerated in how well it is able to predict the GPA of first-year college students. In fact, it has been suggested that the SAT’s predictive validity may be overestimated by as much as 150% (Rothstein, 2004). Many institutions of higher education are beginning to consider de-emphasizing the significance of SAT scores in making admission decisions (Rimer, 2008).

In 2014, College Board president David Coleman expressed his awareness of these problems, recognizing that college success is more accurately predicted by high school grades than by SAT scores. To address these concerns, he has called for significant changes to the SAT exam (Lewin, 2014).

Statistical Significance

Does drinking coffee actually increase your life expectancy? A recent study (Freedman, Park, Abnet, Hollenbeck, & Sinha, 2012) found that men who drank at least six cups of coffee a day also had a 10% lower chance of dying (women’s chances were 15% lower) than those who drank none. Does this mean you should pick up or increase your own coffee habit? We will explore these results in more depth in the next section about drawing conclusions from statistics. Modern society has become awash in studies such as this; you can read about several such studies in the news every day.

Conducting such a study well, and interpreting the results of such studies requires understanding basic ideas of statistics , the science of gaining insight from data. Key components to a statistical investigation are:

• Planning the study: Start by asking a testable research question and deciding how to collect data. For example, how long was the study period of the coffee study? How many people were recruited for the study, how were they recruited, and from where? How old were they? What other variables were recorded about the individuals? Were changes made to the participants’ coffee habits during the course of the study?
• Examining the data: What are appropriate ways to examine the data? What graphs are relevant, and what do they reveal? What descriptive statistics can be calculated to summarize relevant aspects of the data, and what do they reveal? What patterns do you see in the data? Are there any individual observations that deviate from the overall pattern, and what do they reveal? For example, in the coffee study, did the proportions differ when we compared the smokers to the non-smokers?
• Inferring from the data: What are valid statistical methods for drawing inferences “beyond” the data you collected? In the coffee study, is the 10%–15% reduction in risk of death something that could have happened just by chance?
• Drawing conclusions: Based on what you learned from your data, what conclusions can you draw? Who do you think these conclusions apply to? (Were the people in the coffee study older? Healthy? Living in cities?) Can you draw a cause-and-effect conclusion about your treatments? (Are scientists now saying that the coffee drinking is the cause of the decreased risk of death?)

Notice that the numerical analysis (“crunching numbers” on the computer) comprises only a small part of overall statistical investigation. In this section, you will see how we can answer some of these questions and what questions you should be asking about any statistical investigation you read about.

Distributional Thinking

When data are collected to address a particular question, an important first step is to think of meaningful ways to organize and examine the data. Let’s take a look at an example.

Example 1 : Researchers investigated whether cancer pamphlets are written at an appropriate level to be read and understood by cancer patients (Short, Moriarty, & Cooley, 1995). Tests of reading ability were given to 63 patients. In addition, readability level was determined for a sample of 30 pamphlets, based on characteristics such as the lengths of words and sentences in the pamphlet. The results, reported in terms of grade levels, are displayed in Figure 23.

• Data vary . More specifically, values of a variable (such as reading level of a cancer patient or readability level of a cancer pamphlet) vary.
• Analyzing the pattern of variation, called the distribution of the variable, often reveals insights.

Addressing the research question of whether the cancer pamphlets are written at appropriate levels for the cancer patients requires comparing the two distributions. A naïve comparison might focus only on the centers of the distributions. Both medians turn out to be ninth grade, but considering only medians ignores the variability and the overall distributions of these data. A more illuminating approach is to compare the entire distributions, for example with a graph, as in Figure 24.

Figure 24 makes clear that the two distributions are not well aligned at all. The most glaring discrepancy is that many patients (17/63, or 27%, to be precise) have a reading level below that of the most readable pamphlet. These patients will need help to understand the information provided in the cancer pamphlets. Notice that this conclusion follows from considering the distributions as a whole, not simply measures of center or variability, and that the graph contrasts those distributions more immediately than the frequency tables.

Finding Significance in Data

Even when we find patterns in data, often there is still uncertainty in various aspects of the data. For example, there may be potential for measurement errors (even your own body temperature can fluctuate by almost 1°F over the course of the day). Or we may only have a “snapshot” of observations from a more long-term process or only a small subset of individuals from the population of interest. In such cases, how can we determine whether patterns we see in our small set of data is convincing evidence of a systematic phenomenon in the larger process or population? Let’s take a look at another example.

Example 2 : In a study reported in the November 2007 issue of Nature , researchers investigated whether pre-verbal infants take into account an individual’s actions toward others in evaluating that individual as appealing or aversive (Hamlin, Wynn, & Bloom, 2007). In one component of the study, 10-month-old infants were shown a “climber” character (a piece of wood with “googly” eyes glued onto it) that could not make it up a hill in two tries. Then the infants were shown two scenarios for the climber’s next try, one where the climber was pushed to the top of the hill by another character (“helper”), and one where the climber was pushed back down the hill by another character (“hinderer”). The infant was alternately shown these two scenarios several times. Then the infant was presented with two pieces of wood (representing the helper and the hinderer characters) and asked to pick one to play with.

The researchers found that of the 16 infants who made a clear choice, 14 chose to play with the helper toy. One possible explanation for this clear majority result is that the helping behavior of the one toy increases the infants’ likelihood of choosing that toy. But are there other possible explanations? What about the color of the toy? Well, prior to collecting the data, the researchers arranged so that each color and shape (red square and blue circle) would be seen by the same number of infants. Or maybe the infants had right-handed tendencies and so picked whichever toy was closer to their right hand?

Well, prior to collecting the data, the researchers arranged it so half the infants saw the helper toy on the right and half on the left. Or, maybe the shapes of these wooden characters (square, triangle, circle) had an effect? Perhaps, but again, the researchers controlled for this by rotating which shape was the helper toy, the hinderer toy, and the climber. When designing experiments, it is important to control for as many variables as might affect the responses as possible. It is beginning to appear that the researchers accounted for all the other plausible explanations. But there is one more important consideration that cannot be controlled—if we did the study again with these 16 infants, they might not make the same choices. In other words, there is some randomness inherent in their selection process.

Maybe each infant had no genuine preference at all, and it was simply “random luck” that led to 14 infants picking the helper toy. Although this random component cannot be controlled, we can apply a probability model to investigate the pattern of results that would occur in the long run if random chance were the only factor.

If the infants were equally likely to pick between the two toys, then each infant had a 50% chance of picking the helper toy. It’s like each infant tossed a coin, and if it landed heads, the infant picked the helper toy. So if we tossed a coin 16 times, could it land heads 14 times? Sure, it’s possible, but it turns out to be very unlikely. Getting 14 (or more) heads in 16 tosses is about as likely as tossing a coin and getting 9 heads in a row. This probability is referred to as a p-value . The p-value represents the likelihood that experimental results happened by chance. Within psychology, the most common standard for p-values is “p < .05”. What this means is that there is less than a 5% probability that the results happened just by random chance, and therefore a 95% probability that the results reflect a meaningful pattern in human psychology. We call this statistical significance .

So, in the study above, if we assume that each infant was choosing equally, then the probability that 14 or more out of 16 infants would choose the helper toy is found to be 0.0021. We have only two logical possibilities: either the infants have a genuine preference for the helper toy, or the infants have no preference (50/50) and an outcome that would occur only 2 times in 1,000 iterations happened in this study. Because this p-value of 0.0021 is quite small, we conclude that the study provides very strong evidence that these infants have a genuine preference for the helper toy.

If we compare the p-value to some cut-off value, like 0.05, we see that the p=value is smaller. Because the p-value is smaller than that cut-off value, then we reject the hypothesis that only random chance was at play here. In this case, these researchers would conclude that significantly more than half of the infants in the study chose the helper toy, giving strong evidence of a genuine preference for the toy with the helping behavior.

Drawing Conclusions from Statistics

Generalizability.

One limitation to the study mentioned previously about the babies choosing the “helper” toy is that the conclusion only applies to the 16 infants in the study. We don’t know much about how those 16 infants were selected. Suppose we want to select a subset of individuals (a sample ) from a much larger group of individuals (the population ) in such a way that conclusions from the sample can be generalized to the larger population. This is the question faced by pollsters every day.

Example 3 : The General Social Survey (GSS) is a survey on societal trends conducted every other year in the United States. Based on a sample of about 2,000 adult Americans, researchers make claims about what percentage of the U.S. population consider themselves to be “liberal,” what percentage consider themselves “happy,” what percentage feel “rushed” in their daily lives, and many other issues. The key to making these claims about the larger population of all American adults lies in how the sample is selected. The goal is to select a sample that is representative of the population, and a common way to achieve this goal is to select a r andom sample  that gives every member of the population an equal chance of being selected for the sample. In its simplest form, random sampling involves numbering every member of the population and then using a computer to randomly select the subset to be surveyed. Most polls don’t operate exactly like this, but they do use probability-based sampling methods to select individuals from nationally representative panels.

In 2004, the GSS reported that 817 of 977 respondents (or 83.6%) indicated that they always or sometimes feel rushed. This is a clear majority, but we again need to consider variation due to random sampling . Fortunately, we can use the same probability model we did in the previous example to investigate the probable size of this error. (Note, we can use the coin-tossing model when the actual population size is much, much larger than the sample size, as then we can still consider the probability to be the same for every individual in the sample.) This probability model predicts that the sample result will be within 3 percentage points of the population value (roughly 1 over the square root of the sample size, the margin of error. A statistician would conclude, with 95% confidence, that between 80.6% and 86.6% of all adult Americans in 2004 would have responded that they sometimes or always feel rushed.

The key to the margin of error is that when we use a probability sampling method, we can make claims about how often (in the long run, with repeated random sampling) the sample result would fall within a certain distance from the unknown population value by chance (meaning by random sampling variation) alone. Conversely, non-random samples are often suspect to bias, meaning the sampling method systematically over-represents some segments of the population and under-represents others. We also still need to consider other sources of bias, such as individuals not responding honestly. These sources of error are not measured by the margin of error.

Cause and Effect

In many research studies, the primary question of interest concerns differences between groups. Then the question becomes how were the groups formed (e.g., selecting people who already drink coffee vs. those who don’t). In some studies, the researchers actively form the groups themselves. But then we have a similar question—could any differences we observe in the groups be an artifact of that group-formation process? Or maybe the difference we observe in the groups is so large that we can discount a “fluke” in the group-formation process as a reasonable explanation for what we find?

Example 4 : A psychology study investigated whether people tend to display more creativity when they are thinking about intrinsic (internal) or extrinsic (external) motivations (Ramsey & Schafer, 2002, based on a study by Amabile, 1985). The subjects were 47 people with extensive experience with creative writing. Subjects began by answering survey questions about either intrinsic motivations for writing (such as the pleasure of self-expression) or extrinsic motivations (such as public recognition). Then all subjects were instructed to write a haiku, and those poems were evaluated for creativity by a panel of judges. The researchers conjectured beforehand that subjects who were thinking about intrinsic motivations would display more creativity than subjects who were thinking about extrinsic motivations. The creativity scores from the 47 subjects in this study are displayed in Figure 26, where higher scores indicate more creativity.

In this example, the key question is whether the type of motivation affects creativity scores. In particular, do subjects who were asked about intrinsic motivations tend to have higher creativity scores than subjects who were asked about extrinsic motivations?

Figure 26 reveals that both motivation groups saw considerable variability in creativity scores, and these scores have considerable overlap between the groups. In other words, it’s certainly not always the case that those with extrinsic motivations have higher creativity than those with intrinsic motivations, but there may still be a statistical tendency in this direction. (Psychologist Keith Stanovich (2013) refers to people’s difficulties with thinking about such probabilistic tendencies as “the Achilles heel of human cognition.”)

The mean creativity score is 19.88 for the intrinsic group, compared to 15.74 for the extrinsic group, which supports the researchers’ conjecture. Yet comparing only the means of the two groups fails to consider the variability of creativity scores in the groups. We can measure variability with statistics using, for instance, the standard deviation: 5.25 for the extrinsic group and 4.40 for the intrinsic group. The standard deviations tell us that most of the creativity scores are within about 5 points of the mean score in each group. We see that the mean score for the intrinsic group lies within one standard deviation of the mean score for extrinsic group. So, although there is a tendency for the creativity scores to be higher in the intrinsic group, on average, the difference is not extremely large.

We again want to consider possible explanations for this difference. The study only involved individuals with extensive creative writing experience. Although this limits the population to which we can generalize, it does not explain why the mean creativity score was a bit larger for the intrinsic group than for the extrinsic group. Maybe women tend to receive higher creativity scores? Here is where we need to focus on how the individuals were assigned to the motivation groups. If only women were in the intrinsic motivation group and only men in the extrinsic group, then this would present a problem because we wouldn’t know if the intrinsic group did better because of the different type of motivation or because they were women. However, the researchers guarded against such a problem by randomly assigning the individuals to the motivation groups. Like flipping a coin, each individual was just as likely to be assigned to either type of motivation. Why is this helpful? Because this random assignment  tends to balance out all the variables related to creativity we can think of, and even those we don’t think of in advance, between the two groups. So we should have a similar male/female split between the two groups; we should have a similar age distribution between the two groups; we should have a similar distribution of educational background between the two groups; and so on. Random assignment should produce groups that are as similar as possible except for the type of motivation, which presumably eliminates all those other variables as possible explanations for the observed tendency for higher scores in the intrinsic group.

But does this always work? No, so by “luck of the draw” the groups may be a little different prior to answering the motivation survey. So then the question is, is it possible that an unlucky random assignment is responsible for the observed difference in creativity scores between the groups? In other words, suppose each individual’s poem was going to get the same creativity score no matter which group they were assigned to, that the type of motivation in no way impacted their score. Then how often would the random-assignment process alone lead to a difference in mean creativity scores as large (or larger) than 19.88 – 15.74 = 4.14 points?

We again want to apply to a probability model to approximate a p-value , but this time the model will be a bit different. Think of writing everyone’s creativity scores on an index card, shuffling up the index cards, and then dealing out 23 to the extrinsic motivation group and 24 to the intrinsic motivation group, and finding the difference in the group means. We (better yet, the computer) can repeat this process over and over to see how often, when the scores don’t change, random assignment leads to a difference in means at least as large as 4.41. Figure 27 shows the results from 1,000 such hypothetical random assignments for these scores.

Only 2 of the 1,000 simulated random assignments produced a difference in group means of 4.41 or larger. In other words, the approximate p-value is 2/1000 = 0.002. This small p-value indicates that it would be very surprising for the random assignment process alone to produce such a large difference in group means. Therefore, as with Example 2, we have strong evidence that focusing on intrinsic motivations tends to increase creativity scores, as compared to thinking about extrinsic motivations.

Notice that the previous statement implies a cause-and-effect relationship between motivation and creativity score; is such a strong conclusion justified? Yes, because of the random assignment used in the study. That should have balanced out any other variables between the two groups, so now that the small p-value convinces us that the higher mean in the intrinsic group wasn’t just a coincidence, the only reasonable explanation left is the difference in the type of motivation. Can we generalize this conclusion to everyone? Not necessarily—we could cautiously generalize this conclusion to individuals with extensive experience in creative writing similar the individuals in this study, but we would still want to know more about how these individuals were selected to participate.

Statistical thinking involves the careful design of a study to collect meaningful data to answer a focused research question, detailed analysis of patterns in the data, and drawing conclusions that go beyond the observed data. Random sampling is paramount to generalizing results from our sample to a larger population, and random assignment is key to drawing cause-and-effect conclusions. With both kinds of randomness, probability models help us assess how much random variation we can expect in our results, in order to determine whether our results could happen by chance alone and to estimate a margin of error.

So where does this leave us with regard to the coffee study mentioned previously (the Freedman, Park, Abnet, Hollenbeck, & Sinha, 2012 found that men who drank at least six cups of coffee a day had a 10% lower chance of dying (women 15% lower) than those who drank none)? We can answer many of the questions:

• This was a 14-year study conducted by researchers at the National Cancer Institute.
• The results were published in the June issue of the New England Journal of Medicine , a respected, peer-reviewed journal.
• The study reviewed coffee habits of more than 402,000 people ages 50 to 71 from six states and two metropolitan areas. Those with cancer, heart disease, and stroke were excluded at the start of the study. Coffee consumption was assessed once at the start of the study.
• About 52,000 people died during the course of the study.
• People who drank between two and five cups of coffee daily showed a lower risk as well, but the amount of reduction increased for those drinking six or more cups.
• The sample sizes were fairly large and so the p-values are quite small, even though percent reduction in risk was not extremely large (dropping from a 12% chance to about 10%–11%).
• Whether coffee was caffeinated or decaffeinated did not appear to affect the results.
• This was an observational study, so no cause-and-effect conclusions can be drawn between coffee drinking and increased longevity, contrary to the impression conveyed by many news headlines about this study. In particular, it’s possible that those with chronic diseases don’t tend to drink coffee.

This study needs to be reviewed in the larger context of similar studies and consistency of results across studies, with the constant caution that this was not a randomized experiment. Whereas a statistical analysis can still “adjust” for other potential confounding variables, we are not yet convinced that researchers have identified them all or completely isolated why this decrease in death risk is evident. Researchers can now take the findings of this study and develop more focused studies that address new questions.

Explore these outside resources to learn more about applied statistics:

• Video about p-values:  P-Value Extravaganza
• Interactive web applets for teaching and learning statistics
• Inter-university Consortium for Political and Social Research  where you can find and analyze data.
• The Consortium for the Advancement of Undergraduate Statistics
• Find a recent research article in your field and answer the following: What was the primary research question? How were individuals selected to participate in the study? Were summary results provided? How strong is the evidence presented in favor or against the research question? Was random assignment used? Summarize the main conclusions from the study, addressing the issues of statistical significance, statistical confidence, generalizability, and cause and effect. Do you agree with the conclusions drawn from this study, based on the study design and the results presented?
• Is it reasonable to use a random sample of 1,000 individuals to draw conclusions about all U.S. adults? Explain why or why not.

How to Read Research

In this course and throughout your academic career, you’ll be reading journal articles (meaning they were published by experts in a peer-reviewed journal) and reports that explain psychological research. It’s important to understand the format of these articles so that you can read them strategically and understand the information presented. Scientific articles vary in content or structure, depending on the type of journal to which they will be submitted. Psychological articles and many papers in the social sciences follow the writing guidelines and format dictated by the American Psychological Association (APA). In general, the structure follows: abstract, introduction, methods, results, discussion, and references.

• Abstract : the abstract is the concise summary of the article. It summarizes the most important features of the manuscript, providing the reader with a global first impression on the article. It is generally just one paragraph that explains the experiment as well as a short synopsis of the results.
• Introduction : this section provides background information about the origin and purpose of performing the experiment or study. It reviews previous research and presents existing theories on the topic.
• Method : this section covers the methodologies used to investigate the research question, including the identification of participants , procedures , and  materials  as well as a description of the actual procedure . It should be sufficiently detailed to allow for replication.
• Results : the results section presents key findings of the research, including reference to indicators of statistical significance.
• Discussion : this section provides an interpretation of the findings, states their significance for current research, and derives implications for theory and practice. Alternative interpretations for findings are also provided, particularly when it is not possible to conclude for the directionality of the effects. In the discussion, authors also acknowledge the strengths and limitations/weaknesses of the study and offer concrete directions about for future research.

Watch this 3-minute video for an explanation on how to read scholarly articles. Look closely at the example article shared just before the two minute mark.

https://digitalcommons.coastal.edu/kimbel-library-instructional-videos/9/

Practice identifying these key components in the following experiment: Food-Induced Emotional Resonance Improves Emotion Recognition.

In this chapter, you learned to

• define and apply the scientific method to psychology
• describe the strengths and weaknesses of descriptive, experimental, and correlational research
• define the basic elements of a statistical investigation

Putting It Together: Psychological Research

Psychologists use the scientific method to examine human behavior and mental processes. Some of the methods you learned about include descriptive, experimental, and correlational research designs.

Watch the CrashCourse video to review the material you learned, then read through the following examples and see if you can come up with your own design for each type of study.

You can view the transcript for “Psychological Research: Crash Course Psychology #2” here (opens in new window).

Case Study: a detailed analysis of a particular person, group, business, event, etc. This approach is commonly used to to learn more about rare examples with the goal of describing that particular thing.

• Ted Bundy was one of America’s most notorious serial killers who murdered at least 30 women and was executed in 1989. Dr. Al Carlisle evaluated Bundy when he was first arrested and conducted a psychological analysis of Bundy’s development of his sexual fantasies merging into reality (Ramsland, 2012). Carlisle believes that there was a gradual evolution of three processes that guided his actions: fantasy, dissociation, and compartmentalization (Ramsland, 2012). Read   Imagining Ted Bundy  (http://goo.gl/rGqcUv) for more information on this case study.

Naturalistic Observation : a researcher unobtrusively collects information without the participant’s awareness.

• Drain and Engelhardt (2013) observed six nonverbal children with autism’s evoked and spontaneous communicative acts. Each of the children attended a school for children with autism and were in different classes. They were observed for 30 minutes of each school day. By observing these children without them knowing, they were able to see true communicative acts without any external influences.

Survey : participants are asked to provide information or responses to questions on a survey or structure assessment.

• Educational psychologists can ask students to report their grade point average and what, if anything, they eat for breakfast on an average day. A healthy breakfast has been associated with better academic performance (Digangi’s 1999).
• Anderson (1987) tried to find the relationship between uncomfortably hot temperatures and aggressive behavior, which was then looked at with two studies done on violent and nonviolent crime. Based on previous research that had been done by Anderson and Anderson (1984), it was predicted that violent crimes would be more prevalent during the hotter time of year and the years in which it was hotter weather in general. The study confirmed this prediction.

Longitudinal Study: researchers   recruit a sample of participants and track them for an extended period of time.

• In a study of a representative sample of 856 children Eron and his colleagues (1972) found that a boy’s exposure to media violence at age eight was significantly related to his aggressive behavior ten years later, after he graduated from high school.

Cross-Sectional Study:  researchers gather participants from different groups (commonly different ages) and look for differences between the groups.

• In 1996, Russell surveyed people of varying age groups and found that people in their 20s tend to report being more lonely than people in their 70s.

Correlational Design:  two different variables are measured to determine whether there is a relationship between them.

• Thornhill et al. (2003) had people rate how physically attractive they found other people to be. They then had them separately smell t-shirts those people had worn (without knowing which clothes belonged to whom) and rate how good or bad their body oder was. They found that the more attractive someone was the more pleasant their body order was rated to be.
• Clinical psychologists can test a new pharmaceutical treatment for depression by giving some patients the new pill and others an already-tested one to see which is the more effective treatment.

American Cancer Society. (n.d.). History of the cancer prevention studies. Retrieved from http://www.cancer.org/research/researchtopreventcancer/history-cancer-prevention-study

American Psychological Association. (2009). Publication Manual of the American Psychological Association (6th ed.). Washington, DC: Author.

American Psychological Association. (n.d.). Research with animals in psychology. Retrieved from https://www.apa.org/research/responsible/research-animals.pdf

Arnett, J. (2008). The neglected 95%: Why American psychology needs to become less American. American Psychologist, 63(7), 602–614.

Barton, B. A., Eldridge, A. L., Thompson, D., Affenito, S. G., Striegel-Moore, R. H., Franko, D. L., . . . Crockett, S. J. (2005). The relationship of breakfast and cereal consumption to nutrient intake and body mass index: The national heart, lung, and blood institute growth and health study. Journal of the American Dietetic Association, 105(9), 1383–1389. Retrieved from http://dx.doi.org/10.1016/j.jada.2005.06.003

Chwalisz, K., Diener, E., & Gallagher, D. (1988). Autonomic arousal feedback and emotional experience: Evidence from the spinal cord injured. Journal of Personality and Social Psychology, 54, 820–828.

Dominus, S. (2011, May 25). Could conjoined twins share a mind? New York Times Sunday Magazine. Retrieved from http://www.nytimes.com/2011/05/29/magazine/could-conjoined-twins-share-a-mind.html?_r=5&hp&

Fanger, S. M., Frankel, L. A., & Hazen, N. (2012). Peer exclusion in preschool children’s play: Naturalistic observations in a playground setting. Merrill-Palmer Quarterly, 58, 224–254.

Fiedler, K. (2004). Illusory correlation. In R. F. Pohl (Ed.), Cognitive illusions: A handbook on fallacies and biases in thinking, judgment and memory (pp. 97–114). New York, NY: Psychology Press.

Frantzen, L. B., Treviño, R. P., Echon, R. M., Garcia-Dominic, O., & DiMarco, N. (2013). Association between frequency of ready-to-eat cereal consumption, nutrient intakes, and body mass index in fourth- to sixth-grade low-income minority children. Journal of the Academy of Nutrition and Dietetics, 113(4), 511–519.

Harper, J. (2013, July 5). Ice cream and crime: Where cold cuisine and hot disputes intersect. The Times-Picaune. Retrieved from http://www.nola.com/crime/index.ssf/2013/07/ice_cream_and_crime_where_hot.html

Jenkins, W. J., Ruppel, S. E., Kizer, J. B., Yehl, J. L., & Griffin, J. L. (2012). An examination of post 9-11 attitudes towards Arab Americans. North American Journal of Psychology, 14, 77–84.

Jones, J. M. (2013, May 13). Same-sex marriage support solidifies above 50% in U.S. Gallup Politics. Retrieved from http://www.gallup.com/poll/162398/sex-marriage-support-solidifies-above.aspx

Kobrin, J. L., Patterson, B. F., Shaw, E. J., Mattern, K. D., & Barbuti, S. M. (2008). Validity of the SAT for predicting first-year college grade point average (Research Report No. 2008-5). Retrieved from https://research.collegeboard.org/sites/default/files/publications/2012/7/researchreport-2008-5-validity-sat-predicting-first-year-college-grade-point-average.pdf

Lewin, T. (2014, March 5). A new SAT aims to realign with schoolwork. New York Times. Retreived from http://www.nytimes.com/2014/03/06/education/major-changes-in-sat-announced-by-college-board.html.

Lowry, M., Dean, K., & Manders, K. (2010). The link between sleep quantity and academic performance for the college student. Sentience: The University of Minnesota Undergraduate Journal of Psychology, 3(Spring), 16–19. Retrieved from http://www.psych.umn.edu/sentience/files/SENTIENCE_Vol3.pdf

McKie, R. (2010, June 26). Chimps with everything: Jane Goodall’s 50 years in the jungle. The Guardian. Retrieved from http://www.theguardian.com/science/2010/jun/27/jane-goodall-chimps-africa-interview

Offit, P. (2008). Autism’s false prophets: Bad science, risky medicine, and the search for a cure. New York: Columbia University Press.

Perkins, H. W., Haines, M. P., & Rice, R. (2005). Misperceiving the college drinking norm and related problems: A nationwide study of exposure to prevention information, perceived norms and student alcohol misuse. J. Stud. Alcohol, 66(4), 470–478.

Rimer, S. (2008, September 21). College panel calls for less focus on SATs. The New York Times. Retrieved from http://www.nytimes.com/2008/09/22/education/22admissions.html?_r=0

Rothstein, J. M. (2004). College performance predictions and the SAT. Journal of Econometrics, 121, 297–317.

Rotton, J., & Kelly, I. W. (1985). Much ado about the full moon: A meta-analysis of lunar-lunacy research. Psychological Bulletin, 97(2), 286–306. doi:10.1037/0033-2909.97.2.286

Santelices, M. V., & Wilson, M. (2010). Unfair treatment? The case of Freedle, the SAT, and the standardization approach to differential item functioning. Harvard Education Review, 80, 106–134.

Sears, D. O. (1986). College sophomores in the laboratory: Influences of a narrow data base on social psychology’s view of human nature. Journal of Personality and Social Psychology, 51, 515–530.

Tuskegee University. (n.d.). About the USPHS Syphilis Study. Retrieved from http://www.tuskegee.edu/about_us/centers_of_excellence/bioethics_center/about_the_usphs_syphilis_study.aspx.

CC licensed content, Original

• Psychological Research Methods. Provided by : Karenna Malavanti. License : CC BY-SA: Attribution ShareAlike

CC licensed content, Shared previously

• Psychological Research. Provided by : OpenStax College. License : CC BY: Attribution . License Terms : Download for free at https://openstax.org/books/psychology-2e/pages/1-introduction. Located at : https://openstax.org/books/psychology-2e/pages/2-introduction .
• Why It Matters: Psychological Research. Provided by : Lumen Learning. License : CC BY: Attribution   Located at: https://pressbooks.online.ucf.edu/lumenpsychology/chapter/introduction-15/
• Introduction to The Scientific Method. Provided by : Lumen Learning. License : CC BY: Attribution   Located at:   https://pressbooks.online.ucf.edu/lumenpsychology/chapter/outcome-the-scientific-method/
• Research picture. Authored by : Mediterranean Center of Medical Sciences. Provided by : Flickr. License : CC BY: Attribution   Located at : https://www.flickr.com/photos/mcmscience/17664002728 .
• The Scientific Process. Provided by : Lumen Learning. License : CC BY-SA: Attribution ShareAlike   Located at:  https://pressbooks.online.ucf.edu/lumenpsychology/chapter/reading-the-scientific-process/
• Ethics in Research. Provided by : Lumen Learning. License : CC BY: Attribution   Located at:  https://pressbooks.online.ucf.edu/lumenpsychology/chapter/ethics/
• Ethics. Authored by : OpenStax College. Located at : https://openstax.org/books/psychology-2e/pages/2-4-ethics . License : CC BY: Attribution . License Terms : Download for free at https://openstax.org/books/psychology-2e/pages/1-introduction .
• Introduction to Approaches to Research. Provided by : Lumen Learning. License : CC BY-NC-SA: Attribution NonCommercial ShareAlike   Located at:   https://pressbooks.online.ucf.edu/lumenpsychology/chapter/outcome-approaches-to-research/
• Lec 2 | MIT 9.00SC Introduction to Psychology, Spring 2011. Authored by : John Gabrieli. Provided by : MIT OpenCourseWare. License : CC BY-NC-SA: Attribution-NonCommercial-ShareAlike Located at : https://www.youtube.com/watch?v=syXplPKQb_o .
• Paragraph on correlation. Authored by : Christie Napa Scollon. Provided by : Singapore Management University. License : CC BY-NC-SA: Attribution-NonCommercial-ShareAlike Located at : http://nobaproject.com/modules/research-designs?r=MTc0ODYsMjMzNjQ%3D . Project : The Noba Project.
• Descriptive Research. Provided by : Lumen Learning. License : CC BY-SA: Attribution ShareAlike   Located at: https://pressbooks.online.ucf.edu/lumenpsychology/chapter/reading-clinical-or-case-studies/
• Approaches to Research. Authored by : OpenStax College.  License : CC BY: Attribution . License Terms : Download for free at https://openstax.org/books/psychology-2e/pages/1-introduction. Located at : https://openstax.org/books/psychology-2e/pages/2-2-approaches-to-research
• Analyzing Findings. Authored by : OpenStax College. Located at : https://openstax.org/books/psychology-2e/pages/2-3-analyzing-findings . License : CC BY: Attribution . License Terms : Download for free at https://openstax.org/books/psychology-2e/pages/1-introduction.
• Experiments. Provided by : Lumen Learning. License : CC BY: Attribution   Located at:  https://pressbooks.online.ucf.edu/lumenpsychology/chapter/reading-conducting-experiments/
• Research Review. Authored by : Jessica Traylor for Lumen Learning. License : CC BY: Attribution Located at:  https://pressbooks.online.ucf.edu/lumenpsychology/chapter/reading-conducting-experiments/
• Introduction to Statistics. Provided by : Lumen Learning. License : CC BY: Attribution   Located at:  https://pressbooks.online.ucf.edu/lumenpsychology/chapter/outcome-statistical-thinking/
• histogram. Authored by : Fisher’s Iris flower data set. Provided by : Wikipedia.
• License : CC BY-SA: Attribution-ShareAlike   Located at : https://en.wikipedia.org/wiki/Wikipedia:Meetup/DC/Statistics_Edit-a-thon#/media/File:Fisher_iris_versicolor_sepalwidth.svg .
• Statistical Thinking. Authored by : Beth Chance and Allan Rossman . Provided by : California Polytechnic State University, San Luis Obispo.  
• License : CC BY-NC-SA: Attribution-NonCommerci al-S hareAlike .  License Terms : http://nobaproject.com/license-agreement   Located at : http://nobaproject.com/modules/statistical-thinking . Project : The Noba Project.
• Drawing Conclusions from Statistics. Authored by: Pat Carroll and Lumen Learning. Provided by : Lumen Learning. License : CC BY: Attribution   Located at: https://pressbooks.online.ucf.edu/lumenpsychology/chapter/reading-drawing-conclusions-from-statistics/
• Statistical Thinking. Authored by : Beth Chance and Allan Rossman, California Polytechnic State University, San Luis Obispo. Provided by : Noba. License: CC BY-NC-SA: Attribution-NonCommercial-ShareAlike Located at : http://nobaproject.com/modules/statistical-thinking .
• The Replication Crisis. Authored by : Colin Thomas William. Provided by : Ivy Tech Community College. License: CC BY: Attribution
• How to Read Research. Provided by : Lumen Learning. License : CC BY: Attribution   Located at:  https://pressbooks.online.ucf.edu/lumenpsychology/chapter/how-to-read-research/
• What is a Scholarly Article? Kimbel Library First Year Experience Instructional Videos. 9. Authored by:  Joshua Vossler, John Watts, and Tim Hodge.  Provided by : Coastal Carolina University  License :  CC BY NC ND:  Attribution-NonCommercial-NoDerivatives Located at :  https://digitalcommons.coastal.edu/kimbel-library-instructional-videos/9/
• Putting It Together: Psychological Research. Provided by : Lumen Learning. License : CC BY: Attribution   Located at:  https://pressbooks.online.ucf.edu/lumenpsychology/chapter/putting-it-together-psychological-research/
• Research. Provided by : Lumen Learning. License : CC BY: Attribution   Located at:

All rights reserved content

• Understanding Driver Distraction. Provided by : American Psychological Association. License : Other. License Terms: Standard YouTube License Located at : https://www.youtube.com/watch?v=XToWVxS_9lA&list=PLxf85IzktYWJ9MrXwt5GGX3W-16XgrwPW&index=9 .
• Correlation vs. Causality: Freakonomics Movie. License : Other. License Terms : Standard YouTube License Located at : https://www.youtube.com/watch?v=lbODqslc4Tg.
• Psychological Research – Crash Course Psychology #2. Authored by : Hank Green. Provided by : Crash Course. License : Other. License Terms : Standard YouTube License Located at : https://www.youtube.com/watch?v=hFV71QPvX2I .

Public domain content

• Researchers review documents. Authored by : National Cancer Institute. Provided by : Wikimedia. Located at : https://commons.wikimedia.org/wiki/File:Researchers_review_documents.jpg . License : Public Domain: No Known Copyright

grounded in objective, tangible evidence that can be observed time and time again, regardless of who is observing

well-developed set of ideas that propose an explanation for observed phenomena

(plural: hypotheses) tentative and testable statement about the relationship between two or more variables

an experiment must be replicable by another researcher

implies that a theory should enable us to make predictions about future events

able to be disproven by experimental results

implies that all data must be considered when evaluating a hypothesis

committee of administrators, scientists, and community members that reviews proposals for research involving human participants

process of informing a research participant about what to expect during an experiment, any risks involved, and the implications of the research, and then obtaining the person’s consent to participate

purposely misleading experiment participants in order to maintain the integrity of the experiment

when an experiment involved deception, participants are told complete and truthful information about the experiment at its conclusion

committee of administrators, scientists, veterinarians, and community members that reviews proposals for research involving non-human animals

research studies that do not test specific relationships between variables

research investigating the relationship between two or more variables

research method that uses hypothesis testing to make inferences about how one variable impacts and causes another

observation of behavior in its natural setting

inferring that the results for a sample apply to the larger population

when observations may be skewed to align with observer expectations

measure of agreement among observers on how they record and classify a particular event

observational research study focusing on one or a few people

list of questions to be answered by research participants—given as paper-and-pencil questionnaires, administered electronically, or conducted verbally—allowing researchers to collect data from a large number of people

subset of individuals selected from the larger population

overall group of individuals that the researchers are interested in

method of research using past records or data sets to answer various research questions, or to search for interesting patterns or relationships

studies in which the same group of individuals is surveyed or measured repeatedly over an extended period of time

compares multiple segments of a population at a single time

reduction in number of research participants as some drop out of the study over time

relationship between two or more variables; when two variables are correlated, one variable changes as the other does

number from -1 to +1, indicating the strength and direction of the relationship between variables, and usually represented by r

two variables change in the same direction, both becoming either larger or smaller

two variables change in different directions, with one becoming larger as the other becomes smaller; a negative correlation is not the same thing as no correlation

changes in one variable cause the changes in the other variable; can be determined only through an experimental research design

unanticipated outside factor that affects both variables of interest, often giving the false impression that changes in one variable causes changes in the other variable, when, in actuality, the outside factor causes changes in both variables

seeing relationships between two things when in reality no such relationship exists

tendency to ignore evidence that disproves ideas or beliefs

group designed to answer the research question; experimental manipulation is the only difference between the experimental and control groups, so any differences between the two are due to experimental manipulation rather than chance

serves as a basis for comparison and controls for chance factors that might influence the results of the study—by holding such factors constant across groups so that the experimental manipulation is the only difference between groups

description of what actions and operations will be used to measure the dependent variables and manipulate the independent variables

researcher expectations skew the results of the study

experiment in which the researcher knows which participants are in the experimental group and which are in the control group

experiment in which both the researchers and the participants are blind to group assignments

people's expectations or beliefs influencing or determining their experience in a given situation

variable that is influenced or controlled by the experimenter; in a sound experimental study, the independent variable is the only important difference between the experimental and control group

variable that the researcher measures to see how much effect the independent variable had

subjects of psychological research

subset of a larger population in which every member of the population has an equal chance of being selected

method of experimental group assignment in which all participants have an equal chance of being assigned to either group

consistency and reproducibility of a given result

accuracy of a given result in measuring what it is designed to measure

determines how likely any difference between experimental groups is due to chance

statistical probability that represents the likelihood that experimental results happened by chance

Psychological Science is the scientific study of mind, brain, and behavior. We will explore what it means to be human in this class. It has never been more important for us to understand what makes people tick, how to evaluate information critically, and the importance of history. Psychology can also help you in your future career; indeed, there are very little jobs out there with no human interaction!

Because psychology is a science, we analyze human behavior through the scientific method. There are several ways to investigate human phenomena, such as observation, experiments, and more. We will discuss the basics, pros and cons of each! We will also dig deeper into the important ethical guidelines that psychologists must follow in order to do research. Lastly, we will briefly introduce ourselves to statistics, the language of scientific research. While reading the content in these chapters, try to find examples of material that can fit with the themes of the course.

To get us started:

• The study of the mind moved away Introspection to reaction time studies as we learned more about empiricism
• Psychologists work in careers outside of the typical "clinician" role. We advise in human factors, education, policy, and more!
• While completing an observation study, psychologists will work to aggregate common themes to explain the behavior of the group (sample) as a whole. In doing so, we still allow for normal variation from the group!
• The IRB and IACUC are important in ensuring ethics are maintained for both human and animal subjects

Psychological Science: Understanding Human Behavior Copyright © by Karenna Malavanti is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License , except where otherwise noted.

Share This Book

The newest release in the APA Handbooks in Psychology ® series

750 First Street NE Washington, DC 20002 www.apa.org | [email protected]

Terms of Use | Privacy Statement ©2023 American Psychological Association. All Rights Reserved.

APA Handbook of Research Methods in Psychology

Please select the collection(s) you would like to receive more information on.

A one-time purchase of any collection provides perpetual access to DRM-free titles to best meet the needs of your institution and users.

Table of Contents

Volume 1 — Foundations, Planning, Measures, and Psychometrics

Part I. Philosophical, Ethical, and Societal Underpinnings of Psychological Research (Chapters 1 – 6) Part II. Planning Research (Chapters 7 – 12) Part III. Measurement Methods (Chapters 13 – 32) Part IV. Psychometrics (Chapters 33 – 38)

Volume 2 — Research Designs: Quantitative, Qualitative, Neuropsychological, and Biological

Part I. Qualitative Research Methods (Chapters 1 – 11) Part II. Working Across Epistemologies, Methodologies, and Methods (Chapters 12 – 15) Part III. Sampling Across People and Time (Chapters 16 – 19) Part IV. Building and Testing Methods (Chapters 20 – 26) Part V. Designs Involving Experimental Manipulations (Chapters 27 – 32) Part VI. Quantitative Research Designs Involving Single Participants or Units (Chapters 33 – 34) Part VII. Designs in Neuropsychology and Biological Psychology (Chapters 35 – 38)

Volume 3 — Data Analysis and Research Publication

Part I. Quantitative Data Analysis (Chapters 1 – 24) Part II. Publishing and the Publication Process (Chapters 25 – 27)

This resource serves as an ideal reference for many different courses, including:

Please complete the form and an APA representative will follow up with access options.

By submitting your information, you agree to receive information about American Psychological Association (APA) products and services. You may unsubscribe at any time. Please review the APA Privacy Policy for more information.

With significant new and updated content across dozens of chapters, the second edition of the APA Handbook of Research Methods in Psychology presents the most exhaustive treatment available of the techniques psychologists and others have developed to help them pursue a shared understanding of why humans think, feel, and behave the way they do. Across three volumes, the chapters in this indispensable handbook address broad, crosscutting issues faced by researchers: the philosophical, ethical, and societal underpinnings of psychological research. Newly written chapters cover topics such as:

• Literature searching
• Workflow and reproducibility
• Research funding
• Neuroimaging
• Data analysis methods
• Navigating the publishing process
• Ethics in scholarly authorship
• Research data management and sharing
• Applied Psychology 
• Clinical Psychology
• Cognitive Psychology
• Developmental Psychology
• Education Psychology
• Human Development
• Neuroscience
• Public health

Harris Cooper, 

Duke University

Marc N. Coutanche, 

University of Pittsburgh

Linda M. McMullen, 

University of Saskatchewan (Canada) A.T. Panter, 

University of North Carolina 

at Chapel Hill ISBN: 978-1-4338-4123-1

• Subject List
• Take a Tour
• For Authors
• Subscriber Services
• Publications
• African American Studies
• African Studies
• American Literature
• Anthropology
• Architecture Planning and Preservation
• Art History
• Atlantic History
• Biblical Studies
• British and Irish Literature
• Childhood Studies
• Chinese Studies
• Cinema and Media Studies
• Communication
• Criminology
• Environmental Science
• Evolutionary Biology
• International Law
• International Relations
• Islamic Studies
• Jewish Studies
• Latin American Studies
• Latino Studies
• Linguistics
• Literary and Critical Theory
• Medieval Studies
• Military History
• Political Science
• Public Health
• Renaissance and Reformation
• Social Work
• Urban Studies
• Victorian Literature
• Browse All Subjects

How to Subscribe

• Free Trials

In This Article Expand or collapse the "in this article" section Research Methods

Introduction, general overviews.

• Developmental Psychology
• Social Psychology
• Experimental Psychology
• Pedagogical Textbooks
• Personality Psychology
• Research Design
• Archival Research
• Naturalistic
• Participant Observer
• Facial Coding
• Protocol Analysis
• Case Studies
• Narrative Research
• Survey and Questionnaire Research
• Artifacts and Experimenter Bias
• Quasi-Experimental Research
• Applied Research
• Experience Sampling
• Internet-Based Research
• Meta-Analytic Research
• Qualitative Research
• Animal Research
• Human Research

Related Articles Expand or collapse the "related articles" section about

About related articles close popup.

Lorem Ipsum Sit Dolor Amet

Vestibulum ante ipsum primis in faucibus orci luctus et ultrices posuere cubilia Curae; Aliquam ligula odio, euismod ut aliquam et, vestibulum nec risus. Nulla viverra, arcu et iaculis consequat, justo diam ornare tellus, semper ultrices tellus nunc eu tellus.

• Action Research
• Ambulatory Assessment in Behavioral Science
• Behavioral Economics
• Data Science Methods for Psychology
• Effect Size
• Exploratory Data Analysis
• Factor Analysis
• Item Response Theory
• Mediation Analysis
• Nonparametric Statistical Analysis in Psychology
• Observational (Non-Randomized) Studies
• Path Models
• Placebo Effects in Psychology
• Prisoner's Dilemma
• Replication Initiatives in Psychology
• Research Methods for Studying Daily Life
• Signal Detection Theory and its Applications
• Sleep and Dreaming
• Testing and Assessment
• Time Perception

Other Subject Areas

Forthcoming articles expand or collapse the "forthcoming articles" section.

• Data Visualization
• Remote Work
• Workforce Training Evaluation
• Find more forthcoming articles...
• Export Citations
• Share This Facebook LinkedIn Twitter

Research Methods by Dana S. Dunn LAST REVIEWED: 29 November 2011 LAST MODIFIED: 29 November 2011 DOI: 10.1093/obo/9780199828340-0049

Psychology is an empirical science, one dealing with the prediction of behavior in humans and animals. Conducting empirical research focused on predicting behavior requires the use of research methods. Research methods are the practical tools and techniques psychologists employ to scientifically investigate research questions. Once a hypothesis is formulated, research methodology allows a researcher to execute a study designed to answer such testable questions through manipulating and measuring relevant variables. Research methods in psychology are broad and varied, and their use allows psychologists to appropriately test theories in search of demonstrable cause and effect relationships. These methods lie along a continuum from more passive approaches (e.g., observation) to active interventions (e.g., experimentation) designed to explain why organisms behave as they do. In general, research methods help investigators act ethically, reduce sources of bias that can affect interpretation, rule out alternative explanations for results, demonstrate that findings are valid and reliable, and advance theory development. Research methods are distinguishable by approach (qualitative or quantitative), how the data are sampled, and the type of equipment, if any, relied on for data collection. Although all psychologists are likely to possess a shared understanding of basic research methodology (particularly, for example, the need for randomization), different subfields within psychology are apt to rely on distinct methods designed to examine different levels of behavior. Traditionally, research methods in psychology have relied as much as possible on objective or quantitative approaches, where a favored hypothesis is pitted against some alternative account. Relevant designs incorporate control groups in order to verify predicted relationships by comparing them against competing possible outcomes. Increasingly, however, psychologists are becoming open to exploring more subjective or qualitative approaches where participants’ own perspectives, beliefs, and reports constitute acceptable data. Many psychologists now employ a mix of quantitative and qualitative methods in their research efforts. The first section of this bibliography introduces general overviews, textbooks, and reference works detailing research methods used in experimental, developmental, social, and personality psychology. Attention is also paid to works examining teaching research methods, selective journals that publish articles presenting novel methods, as well as methodological controversies. The bibliography’s remaining sections examine particular methodological approaches, many of which include studies illustrating innovative or modified methods. This selective review highlights issues pertaining to data (collection methods, interpretation, and research design). The bibliography concludes with coverage of ethical debates and issues linked to human as well as animal behavior.

At one level, research methods in psychology all seem to share similar features. At another level, where subareas of the field emerge, these methods take on particular features, theoretical perspectives, and additional terminology. Before exploring the breadth of the methods psychologist use—including considering newer techniques advanced by neuroscience, for example—a reader should gain some perspective on how approaches to asking, testing, and evaluating research questions have evolved. McGuire 2000 offers a cogent account of how research methods in psychology have developed across the discipline’s relatively short history. Recognition that choice of method is also driven by the topic of inquiry is discussed by Fiske 2000 . A broad and accessible overview of research methods is provided by the Research Methods Knowledge Base website.

Fiske, D. W. 2000. Research methods: Concepts and practices. In Encyclopedia of psychology . Vol. 7. Edited by A. J. Kazdin, 84–87. Washington, DC: American Psychological Association.

This article focuses on how research in psychology is conducted, highlighting the idea that the nature of particular psychological phenomena necessarily drive the choice of method for their exploration and explication.

McGuire, W. J. 2000. Research methods: History of the field. In Encyclopedia of psychology . Vol. 7. Edited by A. J. Kazdin, 80–84. Washington, DC: American Psychological Association.

An overview of how methodological developments in psychology have influenced the nature of empirical discovery and the research process as well as the critical evaluation of these two products.

Research Methods Knowledge Base .

A website that provides a general overview of issues in research methodology for both undergraduate and graduate students. Contains a variety of hyperlinks allowing novice and expert researchers to easily browse.

back to top

Users without a subscription are not able to see the full content on this page. Please subscribe or login .

Oxford Bibliographies Online is available by subscription and perpetual access to institutions. For more information or to contact an Oxford Sales Representative click here .

• About Psychology »
• Meet the Editorial Board »
• Abnormal Psychology
• Academic Assessment
• Acculturation and Health
• Action Regulation Theory
• Addictive Behavior
• Adolescence
• Adoption, Social, Psychological, and Evolutionary Perspect...
• Advanced Theory of Mind
• Affective Forecasting
• Affirmative Action
• Ageism at Work
• Allport, Gordon
• Alzheimer’s Disease
• Analysis of Covariance (ANCOVA)
• Animal Behavior
• Animal Learning
• Anxiety Disorders
• Art and Aesthetics, Psychology of
• Artificial Intelligence, Machine Learning, and Psychology
• Assessment and Clinical Applications of Individual Differe...
• Attachment in Social and Emotional Development across the ...
• Attention-Deficit/Hyperactivity Disorder (ADHD) in Adults
• Attention-Deficit/Hyperactivity Disorder (ADHD) in Childre...
• Attitudinal Ambivalence
• Attraction in Close Relationships
• Attribution Theory
• Authoritarian Personality
• Bayesian Statistical Methods in Psychology
• Behavior Therapy, Rational Emotive
• Behavioral Genetics
• Belief Perseverance
• Bereavement and Grief
• Biological Psychology
• Birth Order
• Body Image in Men and Women
• Bystander Effect
• Categorical Data Analysis in Psychology
• Childhood and Adolescence, Peer Victimization and Bullying...
• Clark, Mamie Phipps
• Clinical Neuropsychology
• Clinical Psychology
• Cognitive Consistency Theories
• Cognitive Dissonance Theory
• Cognitive Neuroscience
• Communication, Nonverbal Cues and
• Comparative Psychology
• Competence to Stand Trial: Restoration Services
• Competency to Stand Trial
• Computational Psychology
• Conflict Management in the Workplace
• Conformity, Compliance, and Obedience
• Consciousness
• Coping Processes
• Correspondence Analysis in Psychology
• Counseling Psychology
• Creativity at Work
• Critical Thinking
• Cross-Cultural Psychology
• Cultural Psychology
• Daily Life, Research Methods for Studying
• Data Sharing in Psychology
• Death and Dying
• Deceiving and Detecting Deceit
• Defensive Processes
• Depressive Disorders
• Development, Prenatal
• Developmental Psychology (Cognitive)
• Developmental Psychology (Social)
• Diagnostic and Statistical Manual of Mental Disorders (DSM...
• Discrimination
• Dissociative Disorders
• Drugs and Behavior
• Eating Disorders
• Ecological Psychology
• Educational Settings, Assessment of Thinking in
• Embodiment and Embodied Cognition
• Emerging Adulthood
• Emotional Intelligence
• Empathy and Altruism
• Employee Stress and Well-Being
• Environmental Neuroscience and Environmental Psychology
• Ethics in Psychological Practice
• Event Perception
• Evolutionary Psychology
• Expansive Posture
• Experimental Existential Psychology
• Eyewitness Testimony
• Eysenck, Hans
• Festinger, Leon
• Five-Factor Model of Personality
• Flynn Effect, The
• Forensic Psychology
• Forgiveness
• Friendships, Children's
• Fundamental Attribution Error/Correspondence Bias
• Gambler's Fallacy
• Game Theory and Psychology
• Geropsychology, Clinical
• Global Mental Health
• Habit Formation and Behavior Change
• Health Psychology
• Health Psychology Research and Practice, Measurement in
• Heider, Fritz
• Heuristics and Biases
• History of Psychology
• Human Factors
• Humanistic Psychology
• Implicit Association Test (IAT)
• Industrial and Organizational Psychology
• Inferential Statistics in Psychology
• Insanity Defense, The
• Intelligence
• Intelligence, Crystallized and Fluid
• Intercultural Psychology
• Intergroup Conflict
• International Classification of Diseases and Related Healt...
• International Psychology
• Interviewing in Forensic Settings
• Intimate Partner Violence, Psychological Perspectives on
• Introversion–Extraversion
• Law, Psychology and
• Lazarus, Richard
• Learned Helplessness
• Learning Theory
• Learning versus Performance
• LGBTQ+ Romantic Relationships
• Lie Detection in a Forensic Context
• Life-Span Development
• Locus of Control
• Loneliness and Health
• Mathematical Psychology
• Meaning in Life
• Mechanisms and Processes of Peer Contagion
• Media Violence, Psychological Perspectives on
• Memories, Autobiographical
• Memories, Flashbulb
• Memories, Repressed and Recovered
• Memory, False
• Memory, Human
• Memory, Implicit versus Explicit
• Memory in Educational Settings
• Memory, Semantic
• Meta-Analysis
• Metacognition
• Metaphor, Psychological Perspectives on
• Microaggressions
• Military Psychology
• Mindfulness
• Mindfulness and Education
• Minnesota Multiphasic Personality Inventory (MMPI)
• Money, Psychology of
• Moral Conviction
• Moral Development
• Moral Psychology
• Moral Reasoning
• Nature versus Nurture Debate in Psychology
• Neuroscience of Associative Learning
• Nonergodicity in Psychology and Neuroscience
• Obsessive-Complusive Disorder (OCD)
• Occupational Health Psychology
• Olfaction, Human
• Operant Conditioning
• Optimism and Pessimism
• Organizational Justice
• Parenting Stress
• Parenting Styles
• Parents' Beliefs about Children
• Peace Psychology
• Perception, Person
• Performance Appraisal
• Personality and Health
• Personality Disorders
• Person-Centered and Experiential Psychotherapies: From Car...
• Phenomenological Psychology
• Play Behavior
• Positive Psychological Capital (PsyCap)
• Positive Psychology
• Posttraumatic Stress Disorder (PTSD)
• Prejudice and Stereotyping
• Pretrial Publicity
• Problem Solving and Decision Making
• Procrastination
• Prosocial Behavior
• Prosocial Spending and Well-Being
• Psycholinguistics
• Psychological Literacy
• Psychological Perspectives on Food and Eating
• Psychology, Political
• Psychoneuroimmunology
• Psychophysics, Visual
• Psychotherapy
• Psychotic Disorders
• Publication Bias in Psychology
• Reasoning, Counterfactual
• Rehabilitation Psychology
• Relationships
• Reliability–Contemporary Psychometric Conceptions
• Religion, Psychology and
• Research Methods
• Risk Taking
• Role of the Expert Witness in Forensic Psychology, The
• Sample Size Planning for Statistical Power and Accurate Es...
• Schizophrenic Disorders
• School Psychology
• School Psychology, Counseling Services in
• Self, Gender and
• Self, Psychology of the
• Self-Construal
• Self-Control
• Self-Deception
• Self-Determination Theory
• Self-Efficacy
• Self-Esteem
• Self-Monitoring
• Self-Regulation in Educational Settings
• Self-Report Tests, Measures, and Inventories in Clinical P...
• Sensation Seeking
• Sex and Gender
• Sexual Minority Parenting
• Sexual Orientation
• Simpson's Paradox in Psychology
• Single People
• Single-Case Experimental Designs
• Skinner, B.F.
• Small Groups
• Social Class and Social Status
• Social Cognition
• Social Neuroscience
• Social Support
• Social Touch and Massage Therapy Research
• Somatoform Disorders
• Spatial Attention
• Sports Psychology
• Stanford Prison Experiment (SPE): Icon and Controversy
• Stereotype Threat
• Stereotypes
• Stress and Coping, Psychology of
• Student Success in College
• Subjective Wellbeing Homeostasis
• Taste, Psychological Perspectives on
• Teaching of Psychology
• Terror Management Theory
• The Concept of Validity in Psychological Assessment
• The Neuroscience of Emotion Regulation
• The Reasoned Action Approach and the Theories of Reasoned ...
• The Weapon Focus Effect in Eyewitness Memory
• Theory of Mind
• Therapy, Cognitive-Behavioral
• Thinking Skills in Educational Settings
• Trait Perspective
• Trauma Psychology
• Twin Studies
• Type A Behavior Pattern (Coronary Prone Personality)
• Unconscious Processes
• Video Games and Violent Content
• Virtues and Character Strengths
• Women and Science, Technology, Engineering, and Math (STEM...
• Women, Psychology of
• Work Well-Being
• Wundt, Wilhelm
• Privacy Policy
• Cookie Policy
• Legal Notice
• Accessibility

Powered by:

• [66.249.64.20|81.177.182.154]
• 81.177.182.154

Research Methods in Psychology - 4th American Edition

(40 reviews)

Carrie Cuttler, Washington State University

Rajiv S. Jhangiani, Kwantlen Polytechnic University

Dana C. Leighton, Texas A&M University, Texarkana

Copyright Year: 2019

ISBN 13: 9781999198107

Publisher: Kwantlen Polytechnic University

Language: English

Formats Available

Conditions of use.

Learn more about reviews.

Reviewed by Beth Mechlin, Associate Professor of Psychology & Neuroscience, Earlham College on 3/19/24

This is an extremely comprehensive text for an undergraduate psychology course about research methods. It does an excellent job covering the basics of a variety of types of research design. It also includes important topics related to research... read more

Comprehensiveness rating: 5 see less

This is an extremely comprehensive text for an undergraduate psychology course about research methods. It does an excellent job covering the basics of a variety of types of research design. It also includes important topics related to research such as ethics, finding journal articles, and writing reports in APA format.

Content Accuracy rating: 5

I did not notice any errors in this text.

Relevance/Longevity rating: 5

The content is very relevant. It will likely need to be updated over time in order to keep research examples relevant. Additionally, APA formatting guidelines may need to be updated when a new publication manual is released. However, these should be easy updates for the authors to make when the time comes.

Clarity rating: 5

This text is very clear and easy to follow. The explanations are easy for college students to understand. The authors use a lot of examples to help illustrate specific concepts. They also incorporate a variety of relevant outside sources (such as videos) to provide additional examples.

Consistency rating: 5

The text is consistent and flows well from one section to the next. At the end of each large section (similar to a chapter) the authors provide key takeaways and exercises.

Modularity rating: 5

This text is very modular. It is easy to pick and choose which sections you want to use in your course when. Each section can stand alone fairly easily.

Organization/Structure/Flow rating: 5

The text is very well organized. Information flows smoothly from one topic to the next.

Interface rating: 5

The interface is great. The text is easy to navigate and the images display well (I only noticed 1 image in which the formatting was a tad off).

Grammatical Errors rating: 5

I did not notice any grammatical errors.

Cultural Relevance rating: 5

The text is culturally relevant.

This is an excellent text for an undergraduate research methods course in the field of Psychology. I have been using the text for my Research Methods and Statistics course for a few years now. This text focuses on research methods, so I do use another text to cover statistical information. I do highly recommend this text for research methods. It is comprehensive, clear, and easy for students to use.

Reviewed by William Johnson, Lecturer, Old Dominion University on 1/12/24

This textbook covers every topic that I teach in my Research Methods course aside from psychology careers (which I would not really expect it to cover). read more

This textbook covers every topic that I teach in my Research Methods course aside from psychology careers (which I would not really expect it to cover).

I have not noticed any inaccurate information (other than directed students to read Malcolm Gladwell). I appreciate that the textbook includes information on research errors that have not been supported by replication efforts, such as embodied cognition.

Many of the basic concepts of research methods are rather timeless, but I appreciate that the text includes newer research as examples while also including "classic" studies that exemplify different methods.

The writing is clear and simple. The keywords are bolded and reveal a definition when clicked, which students often find very helpful. Many of the figures are very helpful in helping students understand various methods (I really like the ones in the single-subject design subchapter).

The book is very consistent in its terminology and writing style, which I see as a positive compared to other open psychology textbooks where each chapter is written by subject matter experts (such as the NOBA intro textbook).

Modularity rating: 4

I teach this textbook almost entirely in order (except for moving chapters 12 & 13 earlier in the semester to aid students in writing Results sections in their final papers). I think that the organization and consistency of the book reduces its modularity, in that earlier chapters are genuinely helpful for later chapters.

Organization/Structure/Flow rating: 4

I preferred the organization of previous editions, which had "Theory in Research" as its own chapter. If I were organizing the textbook, I am not sure that I would have out descriptive or inferential statistics as the final two chapters (I would have likely put Chapter 11: Presenting Your Research as the final chapter). I also would not have put information about replicability and open science in the inferential statistics section.

The text is easy to read and the formatting is attractive. My only minor complaint is that some of the longer subchapters can be a pretty long scroll, but I understand the desire for their only to be one page per subchapter/topic.

I have not noticed any grammatical errors.

Cultural Relevance rating: 3

I do not think the textbook is insensitive, but there is not much thought given to adapting research instruments across cultures. For instance, talking about how different constructs might have different underlying distributions in different cultures would be useful for students. In the survey methods section, a discussion of back translation or emic personality trait measurement/development for example might be a nice addition.

I choose to use this textbook in my methods classes, but I do miss the organization of the previous American editions. Overall, I recommend this textbook to my colleagues.

Reviewed by Brianna Ewert, Psychology Instructor, Salish Kootenai College on 12/30/22

This text includes the majority of content included in our undergraduate Research Methods in Psychology course. The glossary provides concise definitions of key terms. This text includes most of the background knowledge we expect our students to... read more

Comprehensiveness rating: 4 see less

This text includes the majority of content included in our undergraduate Research Methods in Psychology course. The glossary provides concise definitions of key terms. This text includes most of the background knowledge we expect our students to have as well as skill-based sections that will support them in developing their own research projects.

The content I have read is accurate and error-free.

The content is relevant and up-to-date.

The text is clear and concise. I find it pleasantly readable and anticipate undergraduate students will find it readable and understandable as well.

The terminology appears to be consistent throughout the text.

The modular sections stand alone and lend themselves to alignment with the syllabus of a particular course. I anticipate readily selecting relevant modules to assign in my course.

The book is logically organized with clear and section headings and subheadings. Content on a particular topic is easy to locate.

The text is easy to navigate and the format/design are clean and clear. There are not interface issues, distortions or distracting format in the pdf or online versions.

The text is grammatically correct.

Cultural Relevance rating: 4

I have not found culturally insensitive and offensive language or content in the text. For my courses, I would add examples and supplemental materials that are relevant for students at a Tribal College.

This textbook includes supplemental instructor materials, included slides and worksheets. I plan to adopt this text this year in our Research Methods in Psychology course. I expect it to be a benefit to the course and students.

Reviewed by Sara Peters, Associate Professor of Psychology, Newberry College on 11/3/22

This text serves as an excellent resource for introducing survey research methods topics to undergraduate students. It begins with a background of the science of psychology, the scientific method, and research ethics, before moving into the main... read more

This text serves as an excellent resource for introducing survey research methods topics to undergraduate students. It begins with a background of the science of psychology, the scientific method, and research ethics, before moving into the main types of research. This text covers experimental, non-experimental, survey, and quasi-experimental approaches, among others. It extends to factorial and single subject research, and within each topic is a subset (such as observational research, field studies, etc.) depending on the section.

I could find no accuracy issues with the text, and appreciated the discussions of research and cited studies.

There are revised editions of this textbook (this being the 4th), and the examples are up to date and clear. The inclusion of exercises at the end of each chapter offer potential for students to continue working with material in meaningful ways as they move through the book and (and course).

The prose for this text is well aimed at the undergraduate population. This book can easily be utilized for freshman/sophomore level students. It introduces the scientific terminology surrounding research methods and experimental design in a clear way, and the authors provide extensive examples of different studies and applications.

Terminology is consistent throughout the text. Aligns well with other research methods and statistics sources, so the vocabulary is transferrable beyond the text itself.

Navigating this book is a breeze. There are 13 chapters, and each have subsections that can be assigned. Within each chapter subsection, there is a set of learning objectives, and paragraphs are mixed in with tables and figures for students to have different visuals. Different application assignments within each chapter are highlighted with boxes, so students can think more deeply given a set of constructs as they consider different information. The last subsection in each chapter has key summaries and exercises.

The sections and topics in this text are very straightforward. The authors begin with an introduction of psychology as a science, and move into the scientific method, research ethics, and psychological measurement. They then present multiple different research methodologies that are well known and heavily utilized within the social sciences, before concluding with information on how to present your research, and also analyze your data. The text even provides links throughout to other free resources for a reader.

This book can be navigated either online (using a drop-down menu), or as a pdf download, so students can have an electronic copy if needed. All pictures and text display properly on screen, with no distortions. Very easy to use.

There were no grammatical errors, and nothing distracting within the text.

This book includes inclusive material in the discussion of research ethics, as well as when giving examples of the different types of research approaches. While there is always room for improvement in terms of examples, I was satisfied with the breadth of research the authors presented.

This text provides an overview of both research methods, and a nice introduction to statistics for a social science student. It would be a good choice for a survey research methods class, and if looking to change a statistics class into an open resource class, could also serve as a great resource.

Reviewed by Sharlene Fedorowicz, Adjunct Professor, Bridgewater State University on 6/23/21

The comprehensiveness of this book was appropriate for an introductory undergraduate psychology course. Critical topics are covered that are necessary for psychology students to obtain foundational learning concepts for research. Sections within... read more

The comprehensiveness of this book was appropriate for an introductory undergraduate psychology course. Critical topics are covered that are necessary for psychology students to obtain foundational learning concepts for research. Sections within the text and each chapter provide areas for class discussion with students to dive deeper into key concepts for better learning comprehension. The text covered APA format along with examples of research studies to supplement the learning. The text segues appropriately by introducing the science of psychology, followed by scientific method and ethics before getting into the core of scientific research in the field of psychology. Details are provided in quantitative and qualitative research, correlations, surveys, and research design. Overall, the text is fully comprehensive and necessary introductory research concepts.

The text appears to be accurate with no issues related to content.

Relevance/Longevity rating: 4

The text provided relevant research information to support the learning. The content was up-to-date with a variety of different examples related to the different fields of psychology. However, some topics such as in the pseudoscience section were not very relevant and bordered the line of beliefs. Here, more current or relevant solid examples would provide more relevancy in this part of the text. Bringing in more solid or concrete examples that are more current for students may have been more appropriate such as lack of connection between information found on social media versus real science.

The language and flow of the chapters accompanied by the terms, concepts, and examples of applied research allows for clarity of learning content. Terms were introduced at the appropriate time with the support of concepts and current or classic research. The writing style flows nicely and segues easily from concept to concept. The text is easy for students to understand and grasp the details related to psychological research and science.

The text provides consistency in the outline of each chapter. The beginning section chapter starts objectives as an overview to help students unpack the learning content. Key terms are consistently bolded followed by concept or definition and relevant examples. Research examples are pertinent and provide students with an opportunity to understand application of the contents. Practice exercises are provided with in the chapter and at the and in order for students to integrate learning concepts from within the text.

Sections and subsections are clearly organized and divided appropriately for ease-of-use. The topics are easily discernible and follow the flow of ideal learning routines for students. The sections and subsections are consistently outlined for each concept module. The modularity provides consistency allowing for students to focus on content rather than trying to discern how to pull out the information differently from each chapter or section. In addition, each section and subsection allow for flexibility in learning or expanding concepts within the content area.

The organization of the textbook was easy to follow and each major topic was outlined clearly. However, the chapter on presenting research may be more appropriately placed toward the end of the book rather than in the middle of the chapters related to research and research design. In addition, more information could have been provided upfront around APA format so that students could identify the format of citations within the text as practice for students throughout the book.

The interface of the book lends itself to a nice layout with appropriate examples and links to break up the different sections in the chapters. Examples where appropriate and provided engagement opportunities for the students for each learning module. Images and QR codes or easily viewed and used. Key terms are highlighted in relevant figures, graphs, and tables were appropriately placed. Overall, the interface of the text assisted with the organization and flow of learning material.

No grammatical errors were detected in this book.

The text appears to be culturally sensitive and not offensive. A variety of current and classic research examples are relevant. However, more examples of research from women, minorities, and ethnicities would strengthen the culture of this textbook. Instructors may need to supplement some research in this area to provide additional inclusivity.

Overall, I was impressed by the layout of the textbook and the ease of use. The layout provides a set of expectations for students related to the routine of how the book is laid out and how students will be able to unpack the information. Research examples were relevant, although I see areas where I will supplement information. The book provides opportunities for students to dive deeper into the learning and have rich conversations in the classroom. I plan to start using the psychology textbook for my students starting next year.

Reviewed by Anna Behler, Assistant Professo, North Carolina State University on 6/1/21

The text is very thorough and covers all of the necessary topics for an undergraduate psychology research methods course. There is even coverage of qualitative research, case studies, and the replication crisis which I have not seen in some other... read more

The text is very thorough and covers all of the necessary topics for an undergraduate psychology research methods course. There is even coverage of qualitative research, case studies, and the replication crisis which I have not seen in some other texts.

There were no issues with the accuracy of the text.

The content is very up to date and relevant for a research methods course. The only updates that will likely be necessary in the coming years are updates to examples and modifications to the section on APA formatting.

The clarity of the writing was good, and the chapters were written in a way that was accessible and easy to follow.

I did not note any issues with consistency.

Each chapter is divided into multiple subsections. This makes the chapters even easier to read, as they are broken down into short and easy to navigate sections. These sections make it easy to assign readings as needed depending on which topics are being covered in class.

Organization/Structure/Flow rating: 3

The organization was one of the few areas of weakness, and I felt that the chapters were ordered somewhat oddly. However, this is something that is easily fixed, as chapters (and even subsections) can be assigned in whatever order is needed.

There were no issues of note with the interface, and the PDF of the text was easy to navigate.

The text was well written and there were no grammatical/writing errors of note.

Overall, the book did not contain any notable instances of bias. However, it would probably be appropriate to offer a more thorough discussion of the WEIRD problem in psychology research.

Reviewed by Seth Surgan, Professor, Worcester State University on 5/24/21

Pitched very well for a 200-level Research Methods course. This text provided students with solid basis for class discussion and the further development of their understanding of fundamental concepts. read more

Pitched very well for a 200-level Research Methods course. This text provided students with solid basis for class discussion and the further development of their understanding of fundamental concepts.

No issues with accuracy.

Coverage was on target, relevant, and applicable, with good examples from a variety of subfields within Psychology.

Clearly written -- students often struggle with the dry, technical nature of concepts in Research Methods. Part of the reason I chose this text in the first place was how favorably it compared to other options in terms of clarity.

No problems with inconsistent of shifting language. This is extremely important in Research Methods, where there are many closely related terms. Language was consistent and compatible with other textbook options that were available to my students.

Chapters are broken down into sections that are reasonably sized and conceptually appropriate.

The organization of this textbook fit perfectly with the syllabus I've been using (in one form or another) for 15+ years.

This textbook was easy to navigate and available in a variety of formats.

No problems at all.

Examples show an eye toward inclusivity. I did not detect any insensitive or offensive examples or undertones.

I have used this textbook for a 200-level Research Methods course run over a single summer session. This was my first experience using an OER textbook and I don't plan on going back.

Reviewed by Laura Getz, Assistant Professor, University of San Diego on 4/29/21

The topics covered seemed to be at an appropriate level for beginner undergraduate psychology students; the learning objectives for each subsection and the key takeaways and exercises for each chapter are also very helpful in guiding students’... read more

The topics covered seemed to be at an appropriate level for beginner undergraduate psychology students; the learning objectives for each subsection and the key takeaways and exercises for each chapter are also very helpful in guiding students’ attention to what is most relevant. The glossary is also thorough and a good resource for clear definitions. I would like to see a final chapter on a “big picture” or integrating key ideas of replication, meta-analysis, and open science.

Content Accuracy rating: 4

For the most part, I like the way information is presented. I had a few specific issues with definitions for ordinal variables being quantitative (1st, 2nd, 3rd aren’t really numbers as much as ranked categories), the lack of specificity about different forms of validity (face, content, criterion, and discriminant all just labeled “validity” whereas internal and external validity appear in different sections), and the lack of clear distinction between correlational and quasi-experimental variables (e.g., in some places, country of origin is listed as making a design quasi-experimental, but in other chapters it is defined as correlational).

Some of the specific studies/experiments mentioned do not seem like the best or most relevant for students to learn about the topics, but for the most part, content is up-to-date and can definitely be updated with new studies to illustrate concepts with relative ease.

Besides the few concepts I listed above in “accuracy”, I feel the text was very accessible, provides clear definitions, and many examples to illustrate any potential technical/jargon terms.

I did not notice any issues with inconsistent terms except for terms that do have more than one way of describing the same concept (e.g., 2-sample vs. independent samples t-test)

I assigned the chapters out of order with relative ease, and students did not comment about it being burdensome to navigate.

The order of chapters sometimes did not make sense to me (e.g., Experimental before Non-experimental designs, Quasi-experimental designs separate from other non-experimental designs, waiting until Chapter 11 to talk about writing), but for the most part, the chapter subsections were logical and clear.

Interface rating: 4

I had no issues navigating the online version of the textbook other than taking a while to figure out how to move forward and back within the text itself rather than going back to the table of contents (this might just be a browser issue, but is still worth considering).

No grammatical errors of note.

There was nothing explicitly insensitive or offensive about the text, but there were many places where I felt like more focus on diversity and individual differences could be helpful. For example, ethics and history of psychological testing would definitely be a place to bring in issues of systemic racism and/or sexism and a focus on WEIRD samples (which is mentioned briefly at another point).

I was very satisfied with this free resource overall, and I recommend it for beginning level undergraduate psychology research methods courses.

Reviewed by Laura Stull, Associate Professor, Anderson University on 4/23/21

This book covers essential topics and areas related to conducting introductory psychological research. It covers all critical topics, including the scientific method, research ethics, research designs, and basic descriptive and inferential... read more

This book covers essential topics and areas related to conducting introductory psychological research. It covers all critical topics, including the scientific method, research ethics, research designs, and basic descriptive and inferential statistics. It even goes beyond other texts in terms of offering specific guidance in areas like how to conduct research literature searches and psychological measurement development. The only area that appears slightly lacking is detailed guidance in the mechanics of writing in APA style (though excellent basic information is provided in chapter 11).

All content appears accurate. For example, experimental designs discussed, descriptive and inferential statistical guidance, and critical ethical issues are all accurately addressed, See comment on relevance below regarding some outdated information.

Relevance/Longevity rating: 3

Chapter 11 on APA style does not appear to cover the most current version of the APA style guide (7th edition). While much of the information in Chapter 11 is still current, there are specifics that did change from 6th to 7th edition of the APA manual and so, in order to be current, this information would have to be supplemented with external sources.

The book is extremely well organized, written in language and terms that should be easily understood by undergraduate freshmen, and explains all necessary technical jargon.

The text is consistent throughout in terms of terminology and the organizational framework (which aids in the readability of the text).

The text is divided into intuitive and common units based on basic psychological research methodology. It is clear and easy to follow and is divided in a way that would allow omission of some information if necessary (such as "single subject research") or reorganization of information (such as presenting survey research before experimental research) without disruption to the course as a whole.

As stated previously, the book is organized in a clear and logical fashion. Not only are the chapters presented in a logical order (starting with basic and critical information like overviews of the scientific method and research ethics and progressing to more complex topics like statistical analyses).

No issues with interface were noted. Helpful images/charts/web resources (e.g., Youtube videos) are embedded throughout and are even easy to follow in a print version of the text.

No grammatical issues were noted.

No issues with cultural bias are noted. Examples are included that address topics that are culturally sensitive in nature.

I ordered a print version of the text so that I could also view it as students would who prefer a print version. I am extremely impressed with what is offered. It covers all of the key content that I am currently covering with a (non-open source) textbook in an introduction to research methods course. The only concern I have is that APA style is not completely current and would need to be supplemented with a style guide. However, I consider this a minimal issue given all of the many strengths of the book.

Reviewed by Anika Gearhart, Instructor (TT), Leeward Community College on 4/22/21

Includes the majority of elements you expect from a textbook covering research methods. Some topics that could have been covered in a bit more depth were factorial research designs (no coverage of 3 or more independent variables) and external... read more

Includes the majority of elements you expect from a textbook covering research methods. Some topics that could have been covered in a bit more depth were factorial research designs (no coverage of 3 or more independent variables) and external validity (or the validities in general).

Nothing found that was inaccurate.

Looks like a few updates could be made to chapter 11 to bring it up to date with APA 7. Otherwise, most examples are current.

Very clear, a great fit for those very new to the topic.

The framework is clear and logical, and the learning objectives are very helpful for orienting the reader immediately to the main goals of each section.

Subsections are well-organized and clear. Titles for sections and subsections are clear.

Though I think the flow of this textbook for the most part is excellent, I would make two changes: move chapter 5 down with the other chapters on experimental research and move chapter 11 to the very end. I feel that this would allow for a more logical presentation of content.

The webpage navigation is easy to use and intuitive, the ebook download works as designed, and the page can be embedded directly into a variety of LMS sites or used with a variety of devices.

I found no grammatical errors in this book.

While there were some examples of studies that included participants from several cultures, the book does not touch on ecological validity, an important external validity issue tied to cultural psychology, and there is no mention of the WEIRD culture issue in psychology, which seems somewhat necessary when orienting new psychology students to research methods today.

I currently use and enjoy this textbook in my research methods class. Overall, it has been a great addition to the course, and I am easily able to supplement any areas that I feel aren't covered with enough breadth.

Reviewed by Amy Foley, Instructor/Field & Clinical Placement Coordinator, University of Indianapolis on 3/11/21

This text provides a comprehensive overview of the research process from ideation to proposal. It covers research designs common to psychology and related fields. read more

This text provides a comprehensive overview of the research process from ideation to proposal. It covers research designs common to psychology and related fields.

Accurate information!

This book is current and lines up well with the music therapy research course I teach as a supplemental text for students to understand research designs.

Clear language for psychology and related fields.

The format of the text is consistent. I appreciate the examples, different colored boxes, questions, and links to external sources such as video clips.

It is easy to navigate this text by chapters and smaller units within each chapter. The only confusion that has come from using this text includes the fact that the larger units have roman numerals and the individual chapters have numbers. I have told students to "read unit six" and they only read the small chapter 6, not the entire unit for example.

Flows well!

I have not experienced any interface issues.

I have not found any grammar errors.

Book appears culturally relevant.

This is a great resource for research methods courses in psychology or related fields. I am glad to have used several chapters of this text within the music therapy research course I teach where students learn about research design and then create their own research proposal.

Reviewed by Veronica Howard, Associate Professor, University of Alaska Anchorage on 1/11/21, updated 1/11/21

VERY impressed by the coverage of single subject designs. I would recommend this content to colleagues. read more

VERY impressed by the coverage of single subject designs. I would recommend this content to colleagues.

Content appears accurate.

By expanding to include more contemporary research perspectives, the authors have created a wonderful dynamic that permits the text to be the foundation for many courses as well as revision and remixing for other authors.

Book easy to read, follow.

Consistency rating: 4

Content overall consistent. Only mild inconsistency in writing style between chapters.

Exceptionally modular. All content neatly divided into units with smaller portions. This would be a great book to use in a course that meets bi-weekly, or adapted into other formats.

Content organized in a clear and logical fashion, and would guide students through a semester-long course on research methods, starting with review content, broad overview of procedures (including limitations), then highlighting less common (though relevant) procedures.

Rich variety of formats for use.

No errors found.

I would appreciate more cultural examples.

Reviewed by Greg Mullin, Associate Professor, Bunker Hill Community College on 12/30/20, updated 1/6/21

I was VERY pleased with the comprehensiveness of the text. I believe it actually has an edge over the publisher-based text that I've been using for years. Each major topic was thoroughly covered with more than enough detail on individual concepts. read more

I was VERY pleased with the comprehensiveness of the text. I believe it actually has an edge over the publisher-based text that I've been using for years. Each major topic was thoroughly covered with more than enough detail on individual concepts.

I did not find any errors within the text. The authors provided an unbiased representation of research methods in psychology.

The content connects to classic, timeless examples in the field, but also mixes in a fair amount of more current, relatable examples. I feel like I'll be able to use this version of the text for many years without its age showing.

The authors present a clear and efficient writing style throughout that is rich with relatable examples. The only area that may be a bit much for undergraduate-level student understanding is the topic of statistics. I personally scale back my discussion of statistics in my Intro to Research Methods course, but for those that prefer a deeper dive, the higher-level elements are there.

I did not notice any shifts with the use of terminology or with the structural framework of the text. The text is very consistent and organized in an easily digestible way.

The authors do a fantastic job breaking complex topics down into manageable chunks both as a whole and within chapters. As I was reading, I could easily see how I could align my current approach of teaching Intro to Research Methods with their modulated presentation of the material.

I effortlessly moved through the text given the structural organization. All topics are presented in a logical fashion that allowed each message to be delivered to the reader with ease.

I read the text through the PDF version and found no issue with the interface. All image and text-based material was presented clearly.

I cannot recall coming across any grammatical errors. The text is very well written.

I did not find the text to be culturally insensitive in any way. The authors use inclusive language and even encourage that style of writing in the chapter on Presenting Your Research. I would have liked to see more cross-cultural research examples and more of an extended effort to include the theme of diversity throughout, but at no point did I find the text to be offensive.

This is a fantastic text and I look forward to adopting it for my Intro to Research Methods course in the Spring. :)

Reviewed by Maureen O'Connell, Adjunct Professor, Bunker Hill Community College on 12/15/20, updated 12/18/20

This text edition has covered all ideas and areas of research methods in psychology. It has provided a glossary of terms, sample APA format, and sample research papers.  read more

This text edition has covered all ideas and areas of research methods in psychology. It has provided a glossary of terms, sample APA format, and sample research papers. 

The content is unbiased, accurate, and I did not find any errors in the text. 

The content is current and up-to-date. I found that the text can be added to should material change, the arrangement of the text/content makes it easily accessible to add material, if necessary. 

The text is clear, easy to understand, simplistic writing at times, but I find this text easy for students to comprehend. All text is relevant to the content of behavioral research. 

The text and terminology is consistent. 

The text is organized well and sectioned appropriately. The information is presented in an easy-to-read format, with sections that can be assigned at various points during the semester and the reader can easily locate this. 

The topics in the text are organized in a logical and clear manner. It flows really well. 

The text is presented well, including charts, diagrams, and images. There did not appear to be any confusion with this text. 

The text contains no grammatical errors.

The text was culturally appropriate and not offensive. Clear examples of potential biases were outlined in this text which I found quite helpful for the reader. 

Overall, I found this to be a great edition. Much of the time I spend researching outside material for students has been included in this text. I enjoyed the format, easier to navigate, helpful to students by providing an updated version of discussions and practice assignments, and visually more appealing. 

Reviewed by Brittany Jeye, Assistant Professor of Psychology, Worcester State University on 6/26/20

All of the main topics in a Research Methods course are covered in this textbook (e.g., scientific method, ethics, measurement, experimental design, hypothesis testing, APA style, etc.). Some of these topics are not covered as in-depth as in other... read more

All of the main topics in a Research Methods course are covered in this textbook (e.g., scientific method, ethics, measurement, experimental design, hypothesis testing, APA style, etc.). Some of these topics are not covered as in-depth as in other Research Method textbooks I have used previously, but this actually may be a positive depending on the students and course level (that is, students may only need a solid overview of certain topics without getting overwhelmed with too many details). It also gives the instructor the ability to add content as needed, which helps with flexibility in course design.

I did not note any errors or inaccurate/biasing statements in the text.

For the most part, everything was up to date. There was a good mix of classic research and newer studies presented and/or used as examples, which kept the chapters interesting, topical and relevant. I only noted the section on APA Style in the chapter “Presenting Your Research” which may need some updating to be in line with the new APA 7th edition. However, there should be only minor edits needed (the chapter itself was great overview and introduction to the main points of APA style) and it looks like they should be relatively easy to implement.

The text was very well-written and was presented at an accessible level for undergraduates new to Research Methods. Terms were well-defined with a helpful glossary at the end of the textbook.

The consistent structure of the textbook is huge positive. Each chapter begins with learning objectives and ends with bulleted key takeaways. There are also good exercises and learning activities for students at the end of each chapter. Instructors may need to add their own activities for chapters that do not go into a lot of depth (there are also instructor resources online, which may have more options available).

This is one of the biggest strengths of this textbook, in my opinion. I appreciate how each chapter is broken down into clearly defined subsections. The chapters and the subsections, in particular, are not lengthy, which is great for students’ learning. These subsections could be reorganized and used in a variety of ways to suit the needs of a particular course (or even as standalone subsections).

The topics were presented in a logical manner. As mentioned above, since the textbook is very modular, I feel that you could easily rearrange the chapters to fit your needs (for example, presenting survey design before experimental research or making the presenting your research section a standalone unit).

I downloaded the textbook as an ebook, which was very easy to use/navigate. There were no problems reading any of the text or figures/tables. I also appreciated that you could open the ebook using a variety of apps (Kindle, iBook, etc.) depending on your preference (and this is good for students who have a variety of technical needs).

There were no grammatical errors noted.

The examples were inclusive of races, ethnicity and background and there were not any examples that were culturally insensitive or offensive in any way. In future iterations of the replicability section, it may be beneficial to touch upon the “weird” phenomena in psychology research (that many studies use participants who are western, educated and from industrialized, rich and democratic countries) as a point to engage students in improving psychological practices.

I will definitely consider switching to this textbook in the future for Research Methods.

Reviewed by Alice Frye, Associate Teaching Professor, University of Massachusetts Lowell on 6/22/20

Hits all the necessary marks from ways of knowing to measurement, research designs, and presentation. Comparable in detail and content to other Research Methods texts I have used for teaching. read more

Hits all the necessary marks from ways of knowing to measurement, research designs, and presentation. Comparable in detail and content to other Research Methods texts I have used for teaching.

Correct and to the point. Complex ideas such as internal consistency reliability and discriminant validity are well handled--correct descriptions that are also succinct and articulated simply and with clear examples that are easy for a student reader to grasp.

Seems likely to have good staying power. One area that has changed quickly in the past is the usefulness of various research data bases. So it is possible that portion could become more quickly outdated, but there is no predicting that. The current descriptions are useful.

Very clearly written without being condescending, overly casual or clunky.

Excellent consistency throughout in terms of organization, language usage, level of detail and tone.

Imho this is one of the particular strengths of the text. Chapters are well divided into discrete parts, which seems likely to be a benefit in cohorts of students who are increasingly accustomed to digesting small amounts of information.

Well organized, straightforward structure that is maintained throughout.

No problems with the interface.

The grammar level is another notable strength. Ideas are articulated clearly, and with sophistication, but in a syntactically very straightforward manner.

The text isn't biased or offensive. I wish that to illustrate various points and research designs it had drawn more frequently on research studies that incorporate a specific focus on race and ethnicity.

This is a very good text. As good as any for profit text I have used to teach a research methods course, if not better.

Reviewed by Lauren Mathieu-Frasier, Adjunct Instructor, University of Indianapolis on 1/13/20

As other reviews have mentioned, this textbook provides a comprehensive look at multiple concepts for an introductory course in research methods in psychology. Some of the concepts (i.e., variables, external validity) are briefly described and... read more

As other reviews have mentioned, this textbook provides a comprehensive look at multiple concepts for an introductory course in research methods in psychology. Some of the concepts (i.e., variables, external validity) are briefly described and glossed over that it will take additional information, examples, and reinforcement from instructors in the classroom. Other sections and concepts, like ethics or reporting of research were well-described and thorough.

It appeared that the information was accurate, error-free, and unbiased.

The information is up-to-date. In the section on APA presentation, it looks like the minor adjustments to the APA Publication Manual 7th Edition would need to be included. However, this section gives a good foundation and the instructor can easily implement the changes.

Clarity rating: 4

The text is clearly written written and provides an appropriate context when terminology is used.

There aren't any issues with consistency in the textbook.

The division of smaller sections can be beneficial when reading it and assigning it to classes. The sections are clearly organized based on learning objectives.

The textbook is organized in a logical, clear manner. There may be topics that instructors choose to present in a different manner (non-experimental and survey research prior to experimental). However, this doesn't generally impact the organization and flow of the book.

While reading and utilizing the book, there weren't any navigation issues that could impact the readability of the book. Students could find this textbook easy to use.

Grammatical errors were not noted.

There weren't any issues with cultural sensitivity in the examples of studies used in the textbook.

Reviewed by Tiffany Kindratt, Assistant Professor, University of Texas at Arlington on 1/1/20

The text is comprehensive with an effective glossary of terms at the end. It would be beneficial to include additional examples and exercises for students to better understand concepts covered in Chapter II, Overview of the Scientific Method,... read more

The text is comprehensive with an effective glossary of terms at the end. It would be beneficial to include additional examples and exercises for students to better understand concepts covered in Chapter II, Overview of the Scientific Method, Chapter IV, Psychological Measurement, and Chapter XII Descriptive Statistics.

The text is accurate and there are minimal type/grammatical errors throughout. The verbiage is written in an unbiased manner consistently throughout the textbook.

The content is up-to-date, and examples can be easily updated for future versions. As a public health instructor, I would be interested in seeing examples of community-based examples in future versions. The current examples provided are relevant for undergraduate public health students as well as psychology students.

The text is written in a clear manner. The studies used can be easily understood by undergraduate students in other social science fields, such as public health. More examples and exercises using inferential statistics would be helpful for students to better grasp the concepts.

The framework for each chapter and terminology used are consistent. It is helpful that each section within each chapter begins with learning objectives and the chapter ends with key takeaways and exercises.

The text is clearly divided into sections within each chapter. When I first started reviewing this textbook, I thought each section was actually a very short chapter. I would recommend including a listing of all of the objectives covered in each chapter at the beginning to improve the modularity of the text.

Some of the topics do not follow a logical order. For example, it would be more appropriate to discuss ethics before providing the overview of the scientific method. It would be better to discuss statistics used to determine results before describing how to write manuscripts. However, the text is written in a way that that the chapters could be assigned to students in a different order without impacting the students’ comprehension of the concepts.

I did not encounter any interface issues when reviewing this text. All links worked and there were no distortions of the images or charts that may confuse the reader. There are several data tables throughout the text which are left-aligned and there is a large amount of empty white space next it. I would rearrange the text in future versions to make better use of this space.

The text contains minimal grammatical errors.

The examples are culturally relevant. I did not see any examples that may be considered culturally insensitive or offensive in any way.

As an instructor for an undergraduate public health sciences and methods course, I will consider using some of the content in this text to supplement the current textbook in the future.

Reviewed by Mickey White, Assistant Professor, East Tennessee State University on 10/23/19

The table of contents is well-formatted and comprehensive. Easy to navigate and find exactly what is needed, students would be able to quickly find needed subjects. read more

The table of contents is well-formatted and comprehensive. Easy to navigate and find exactly what is needed, students would be able to quickly find needed subjects.

Content appears to be accurate and up-to-date.

This text is useful and relevant, particularly with regard to expressing and reporting descriptive statistics and results. As APA updates, the text will be easy to edit, as the sections are separated.

Easy to read and engaging.

Chapters were laid out in a consistent manner, which allows readers to know what is coming. The subsections contained a brief overview and terminology was consistent throughout. The glossary added additional information.

Sections and subsections are delineated in a usable format.

The key takeaways were useful, including the exercises at the end of each chapter.

Reading the book online is a little difficult to navigate page-by-page, but e-pub and PDF formats are easy to navigate.

No errors noted.

Would be helpful to have a clearer exploration of cultural factors impacting research, including historical bias in assessment and research outside of research ethics.

Reviewed by Robert Michael, Assistant Professor, University of Louisiana at Lafayette on 10/14/19

Successfully spans the gamut of topics expected in a Research Methods textbook. Some topics are covered in-depth, while others are addressed only at a surface level. Instructors may therefore need to carefully arrange class material for topics in... read more

Successfully spans the gamut of topics expected in a Research Methods textbook. Some topics are covered in-depth, while others are addressed only at a surface level. Instructors may therefore need to carefully arrange class material for topics in which depth of knowledge is an important learning outcome.

The factual content was error-free, according to my reading. I did spot a few grammatical and typographical errors, but they were infrequent and minor.

Great to see nuanced—although limited—discussion of issues with Null Hypothesis Significance Testing, Reproducibility in Psychological Science, and so forth. I expect that these areas are likely to grow in future editions, perhaps supplementing or even replacing more traditional material.

Extremely easy to read with multiple examples throughout to illustrate the principles being covered. Many of these examples are "classics" that students can easily relate to. Plus, who doesn't like XKCD comics?

The textbook is structured sensibly. At times, certain authors' "voices" seemed apparent in the writing, but I suspect this variability is unlikely to be noticed by or even bothersome to the vast majority of readers.

The topics are easily divisible and seem to follow routine expectations. Instructors might find it beneficial and/or necessary to incorporate some of the statistical thinking and learning into various earlier chapters to facilitate student understanding in-the-moment, rather than trying to leave all the statistics to the end.

Sensible and easy-to-follow structure. As per "Modularity", the Statistical sections may benefit from instructors folding in such learning throughout, rather than only at the end.

Beautifully presented, crisp, easy-to-read and navigate. Caveat: I read this online, in a web-browser, on only one device. I haven't tested across multiple platforms.

High quality writing throughout. Only a few minor slip-ups that could be easily fixed.

Includes limited culturally relevant material where appropriate.

Reviewed by Matthew DeCarlo, Assistant Professor, Radford University on 6/26/19

The authors do a great job of simplifying the concepts of research methods and presenting them in a way that is understandable. There is a tradeoff between brevity and depth here. Faculty who adopt this textbook may need to spend more time in... read more

The authors do a great job of simplifying the concepts of research methods and presenting them in a way that is understandable. There is a tradeoff between brevity and depth here. Faculty who adopt this textbook may need to spend more time in class going in depth into concepts, rather than relying on the textbook for all of the information related to key concepts. The text does not cover qualitative methods in detail.

The textbook provides an accurate picture of research methods. The tone is objective and without bias.

The textbook is highly relevant and up to date. Examples are drawn from modern theories and articles.

The writing is a fantastic mix of objective and authoritative while also being approachable.

The book coheres well together. Each chapter and section are uniform.

This book fits very well within a traditional 16 week semester, covering roughly a chapter per week. One could take out specific chapters and assign them individually if research methods is taught in a different way from a standard research textbook.

Content is very well organized. The table of contents is easy to navigate and each chapter is presented in a clear and consistent manner. The use of a two-tier table of contents is particularly helpful.

Standard pressbooks interface, which is great. Uses all of the standard components of Pressbooks well, though the lack of H5P and interactive content is a drawback.

I did not notice any grammar errors.

Cultural Relevance rating: 2

The book does not deal with cultural competence and humility in the research process. Integration of action research and decolonization perspectives would be helpful.

Reviewed by Christopher Garris, Associate Professor, Metropolitan State University of Denver on 5/24/19

Most content areas in this textbook were covered appropriately extensively. Notably, this textbook included some content that is commonly missing in other textbooks (e.g. presenting your research). There were some areas where more elaboration... read more

Most content areas in this textbook were covered appropriately extensively. Notably, this textbook included some content that is commonly missing in other textbooks (e.g. presenting your research). There were some areas where more elaboration and more examples were needed. For example, the section covering measurement validities included all the important concepts, but needed more guidance for student comprehension. Also, the beginning chapters on 'common sense' reasoning and pseudoscience seemed a little too brief.

Overall, this textbook appeared to be free from glaring errors. There were a couple of instances of concern, but were not errors, per se. For example, the cut-off for Cronbach's alpha was stated definitively at .80, while this value likely would be debated among researchers.

This textbook was presented in such a way that seemed protect it from becoming obsolete within the next few years. This is important for continued, consistent use of the book. The authors have revised this book, and those revisions are clearly summarized in the text. Importantly, the APA section of the textbook appears to be up-to-date. Also, the use of QR codes throughout the text is a nice touch that students may appreciate.

Connected to comprehensiveness, there are some important content areas that I felt were lacking in elaboration and examples (e.g. testing the validity of measurement; introduction of experimental design), which inhibits clarity. Overall, however, the topics seemed to be presented in a straightforward, accessible manner. The textbook includes links to informative videos and walk-throughs where appropriate, which seem to be potentially beneficial for student comprehension. The textbook includes tools designed to aid learning, namely "Key Takeaways" and "Exercises" sections at the end of most modules, but not all. "Key Takeaways" seemed valuable, as they were a nice bookend to the learning objectives stated at the beginning of each module. "Exercises" did not appear to be as valuable, especially for the less-motivated student. On their face, these seemed to be more designed for instructors to use as class activities/active learning. Lastly, many modules of the textbook were text-heavy and visually unappealing. While this is superficial, the inclusion of additional graphics, example boxes, or figures in these text-heavy modules might be beneficial.

The textbook appeared to be internally consistent with its approach and use of terminology.

The textbook had a tendency to 'throw out' big concepts very briefly in earlier modules (e.g. sampling, experimental/non-experimental design), and then cover them in more detail in later modules. This would have been less problematic if the text would explicitly inform the student that these concepts would be elaborated upon later. Beyond this issue, the textbook seems to lend itself to being divided up and used on module-by-module basis.

The organization of the chapters did not make intuitive sense to me. The fact that correlation followed experimental research, and that descriptive research was the second-to-last module in the sequence was confusing. That said, textbook is written in such a way that an instructor easily assign the modules in the order that works best for their class.

Overall, the interface worked smoothly and there were few technical issues. Where there were issues (e.g. inconsistent spacing between lines and words), they were negligible.

The text seemed to be free from glaring grammatical problems.

Because this is a methodology textbook, it does not lend itself to too much cultural criticism. That said, the book did not rely on overly controversial examples, but also didn't shy away from important cultural topics (e.g. gender stereotypes, vaccines).

Reviewed by Michel Heijnen, Assistant Professor, University of North Carolina Wilmington on 3/27/18

The book covers all areas related to research methods, not only for the field of psychology, but also to other related fields like exercise science. Topics include ethics, developing a research questions, experimental designs, non-experimental... read more

The book covers all areas related to research methods, not only for the field of psychology, but also to other related fields like exercise science. Topics include ethics, developing a research questions, experimental designs, non-experimental designs, and basic statistics, making this book a great resource for undergraduate research methods classes.

Reviewed content is accurate and seems free of any personal bias.

The topic of research methods in general is not expected to change quickly. It is not expected that this text will become obsolete in the near future. Furthermore, for both the field of psychology as well as other related fields, the examples will continue to have an application to explain certain concepts and will not be outdated soon, even with new research emerging every day.

The text is written so an undergraduate student should be able to understand the concepts. The examples provided in the text greatly contribute to the understanding of the topics and the proposed exercises at the end of each chapter will further apply the knowledge.

The layout and writing style are consistent throughout the text.

Layout of the text is clear, with multiple subsection within each chapter. Each chapter can easily be split into multiple subsection to assign to students. No evidence of self-refers was observed, and individual chapters could be assigned to students without needed to read all preceding chapters. For example, Chapter 4 may not be particularly useful to students outside of psychology, but an instructor can easily reorganize the text and skip this chapter while students can still understand following chapters.

Topics are addressed in a logical manner. Overall, an introduction to research is provided first (including ethics to research), which is followed by different types of research, and concludes with types of analysis.

No images or tables are distorted, making the text easy to read.

No grammatical errors observed in text.

Text is not offensive and does not appear to be culturally insensitive.

I believe that this book is a great resource and, as mentioned previously, can be used for a wider audience than just psychology as the basics of research methods can be applied to various fields, including exercise science.

Reviewed by Chris Koch, Professor of Psychology, George Fox University on 3/27/18

All appropriate areas and topics are covered in the text. In that sense, this book is equivalent to other top texts dealing with research methods in psychology. The appeal of this book is the brevity and clarity. Therefore, some may find that,... read more

All appropriate areas and topics are covered in the text. In that sense, this book is equivalent to other top texts dealing with research methods in psychology. The appeal of this book is the brevity and clarity. Therefore, some may find that, although the topics are covered, topics may not be covered as thoroughly they might like. Overall, the coverage is solid for an introductory course in research methods.

In terms of presentation, this book could be more comprehensive. Each chapter does start with a set of learning objectives and ends with "takeaways" and a short set of exercises. However, it lacks detailed chapter outlines, summaries, and glossaries. Furthermore, an index does not accompany the text.

I found the book to be accurate with content being fairly presented. There was no underlying bias throughout the book.

This is an introductory text for research methods. The basics of research methods have been consistent for some time. The examples used in the text fit the concepts well. Therefore, it should not be quickly dated. It is organized in such a way that sections could be easily modified with more current examples as needed.

The text is easy to read. It is succinct yet engaging. Examples are clear and terminology is adequately defined.

New terms and concepts are dealt with chapter by chapter. However, those things which go across chapters are consistently presented.

The material for each chapter is presented in subsections with each subsection being tied to a particular learning objective. It is possible to use the book by subsection instead of by chapter. In fact, I did that during class by discussing the majority of one chapter, discussing another chapter, and then covering what I previously skipped,

In general, the book follows a "traditional" organization, matching the organization of many competing books. As mentioned in regard to modularity, I did not follow the organization of the book exactly as it was laid out. This may not necessarily reflect poorly on the book, however, since I have never followed the order of any research methods book. My three exams covered chapter 1 through 4, chapters 5, 6, part of 8, and chapters 7, the remainder of 8, 9, and 10. Once we collected data I covered chapters 11 through 13.

Interface rating: 3

The text and images are clear and distortion free. The text is available in several formats including epub, pdf, mobi, odt, and wxr. Unfortunately, the electronic format is not taken full advantage of. The text could be more interactive. As it is, it is just text and images. Therefore, the interface could be improved.

The book appeared to be well written and edited.

I did not find anything in the book that was culturally insensitive or offensive. However, more examples of cross-cultural research could be included.

I was, honestly, surprised by how much I liked the text. The material was presented in easy to follow format that is consistent with how I think about research methods. That made the text extremely easy to use. Students also thought the book was highly accessible Each chapter was relatively short but informative and easy to read.

Reviewed by Kevin White, Assistant Professor, East Carolina University on 2/1/18

This book covers all relevant topics for an introduction to research methods course in the social sciences, including measurement, sampling, basic research design, and ethics. The chapters were long enough to be somewhat comprehensive, but short... read more

This book covers all relevant topics for an introduction to research methods course in the social sciences, including measurement, sampling, basic research design, and ethics. The chapters were long enough to be somewhat comprehensive, but short enough to be digestible for students in an introductory-level class. Student reviews of the book have so far been very positive. The only section of the text for which more detail may be helpful is 2.3 (Reviewing the Research Literature), in which more specific instructions related to literature searches may be helpful to students.

I did not notice any issues related to accuracy. Content appeared to be accurate, error-free, and unbiased.

One advantage of this book is that it is relevant to other applied fields outside of psychology (e.g., social work, counseling, etc.). Also, the exercises at the end of chapter sections are helpful.

The clarity of the text provides students with succinct definitions for research-related concepts, without unnecessary discipline-specific jargon. One suggestion for future editions would be to make the distinctions between different types of non-experimental research a bit more clear for students in introductory classes (e.g., "Correlational Research" in Section 7.2).

Formatting and terminology was consistent throughout this text.

A nice feature of this book is that instructors can select individual sections within chapters, or even jump between sections within chapters. For example, Section 1.4 may not fit for a class that is less clinically-oriented in nature.

The flow of the text was appropriate, with ethics close to the beginning of the book (and an entire chapter devoted to it), and descriptive/inferential statistics at the end.

I did not notice any problems related to interface. I had no trouble accessing or reading the text, and the images were clear.

The text contained no discernible grammatical errors.

The book does not appear to be culturally insensitive in any discernible way, and explicitly addresses prejudice in research (e.g., Section 5.2). However, I think that continuing to add more examples that relate to specific marginalized groups would help improve the text (and especially exercises).

Overall, this book is very useful for an introductory research methods course in psychology or social work, and I highly recommend.

Reviewed by Elizabeth Do, Instructor, Virginia Commonwealth University on 2/1/18

Although this textbook does provide good information regarding introductory concepts necessary for the understanding of correlational designs, and is presented in a logical order. It does not, however, cover qualitative methodologies, or research... read more

Although this textbook does provide good information regarding introductory concepts necessary for the understanding of correlational designs, and is presented in a logical order. It does not, however, cover qualitative methodologies, or research ethics as it relates to other countries outside of the US.

There does not seem to be any errors within the text.

Since this textbook covers a topic that is unlikely to change over the years and it's content is up-to-date, it remains relevant to the field.

The textbook is written at an appropriate level for undergraduate students and is useful in that it does explain important terminology.

There does not seem to be any major inconsistencies within the text.

Overall, the text is very well organized - it is separated into chapters that are divided up into modules and within each module, there are clear learning objectives. It is also helpful that the textbook includes useful exercises for students to practice what they've read about from the text.

The topics covered by this textbook are presented in an order that is logical. The writing is clear and the examples are very useful. However, more information could be provided in some of the chapters and it would be useful to include a table of contents that links to the different chapters within the PDF copy, for reader's ease in navigation when looking for specific terms and/or topics.

Overall, the PDF copy of the textbook made it easy to read; however, there did seem to be a few links that were missing. Additionally, it would be helpful to have some of the graphs printed in color to help with ease of following explanations provided by the text. The inclusion of a table of contents would also be useful for greater ease with navigation.

There does not seem to be any grammatical errors in the textbook. Also, the textbook is written in a clear way, and the information flows nicely.

This textbook focuses primarily on examples from the United States. It does not seem to be culturally insensitive or offensive in anyway and I liked that it included content regarding the avoidance of biased language (chapter 11).

This textbook makes the material very accessible, and it is easy to read/follow examples.

Reviewed by Eric Lindsey, Professor, Penn State University Berks Campus on 2/1/18

The content of the Research Methods in Psychology textbook was very thorough and covered what I would consider to be the important concepts and issues pertaining to research methods. I would judge that the textbook has a comparable coverage of... read more

The content of the Research Methods in Psychology textbook was very thorough and covered what I would consider to be the important concepts and issues pertaining to research methods. I would judge that the textbook has a comparable coverage of information to other textbooks I have reviewed, including the current textbook I am using. The range of scholarly sources included in the textbook was good, with an appropriate balance between older and classic research examples and newer more cutting edge research information. Overall, the textbook provides substantive coverage of the science of conducting research in the field of psychology, supported by good examples, and thoughtful questions.

The textbook adopts a coherent and student-friendly format, and offers a precise introduction to psychological research methodology that includes consideration of a broad range of qualitative and quantitative methods to help students identify and evaluate the best approach for their research needs. The textbook offers a detailed review of the way that psychological researchers approach their craft. The author guides the reader through all aspects of the research process including formulating objectives, choosing research methods, securing research participants, as well as advice on how to effectively collect, analyze and interpret data and disseminate those findings to others through a variety of presentation and publication venues. The textbook offers relevant supplemental information in textboxes that is highly relevant to the material in the accompanying text and should prove helpful to learners. Likewise the graphics and figures that are included are highly relevant and clearly linked to the material presented in the text. The information covered by the textbook reflects an accurate summary of current techniques and methods used in research in the field of psychology. The presentation of information addresses the pros and cons of different research strategies in an objective and evenhanded way.

The range of scholarly sources included in the textbook was good, with an appropriate balance between older, classic research evidence and newer, cutting edge research. Overall, the textbook provides substantive coverage of the science on most topics in research methods of psychology, supported by good case studies, and thoughtful questions. The book is generally up to date, with adequate coverage of basic data collection methods and statistical techniques. Likewise the review of APA style guidelines is reflects the current manual and I like the way the author summarizes changes from the older version of the APA manual. The organization of the textbook does appear to lend itself to editing and adding new information with updates in the future.

I found the textbook chapters to be well written, in a straightforward yet conversational manner. It gives the reader an impression of being taught by a knowledgeable yet approachable expert. The writing style gives the learner a feeling of being guided through the lessons and supported in a very conversational approach. The experience of reading the textbook is less like being taught and more like a colleague sharing information. Furthermore, the style keeps the reader engaged but doesn't detract from its educational purpose. I also appreciate that the writing is appropriately concise. No explanations are so wordy as to overwhelm or lull the reader to sleep, but at the same time the information is not so vague that the reader can't understand the point at all.

The book’s main aim is to enable students to develop their own skills as researchers, so they can generate and advance common knowledge on a variety of psychological topics. The book achieves this objective by introducing its readers, step-by-step, to psychological research design, while maintaining an excellent balance between substance and attention grabbing examples that is uncommon in other research methods textbooks. Its accessible language and easy-to-follow structure and examples lend themselves to encouraging readers to move away from the mere memorization of facts, formulas and techniques towards a more critical evaluation of their own ideas and work – both inside and outside the classroom. The content of the chapters have a very good flow that help the reader to connect information in a progressive manner as they proceed through the textbook.

Each chapter goes into adequate depth in reviewing both past and current research related to the topic that it covers for an undergraduate textbook on research methods in psychology. The information within each chapter flows well from point-to-point, so that the reader comes away feeling like there is a progression in the information presented. The only limitation that I see is that I felt the author could do a little more to let the reader know how information is connected from chapter to chapter. Rather than just drawing the reader’s attention to things that were mentioned in previous chapters, it would be nice to have brief comments about how issues in one chapter relate to topics covered in previous chapters.

In my opinion the chapters are arranged in easily digestible units that are manageable in 30-40 minute reading sessions. In fact, the author designed the chapters of the textbook in a way to make it easy to chunk information, and start and stop to easily pick up where one leaves off from one reading session to another. I also found the flow of information to be appropriate, with chapters containing just the right amount of detail for use in my introductory course in research methods in psychology.

The book is organized into thirteen chapters. The order of the chapters offers a logical progression from a broad overview of information about the principles and theory behind research in psychology, to more specific issues concerning the techniques and mechanics of conducting research. Each chapter ends with a summary of key takeaways from the chapter and exercises that do more than ask for content regurgitation. I find the organization of the textbook to be effective, and matches my approach to the course very well. I would not make any changes to the overall format with the exception of moving chapter 11 on presenting research to the end of the textbook, after the chapters on statistical analysis and interpretation.

I found the quality of the appearance of the textbook to be very good. The textbook features appropriate text and section/header font sizes that allow for an adequate zooming level to read large or smalls sections of text, that will give readers flexibility to match their personal preference. There are learning objectives at the start of each chapter to help students know what to expect. Key terms are highlighted in a separate color that are easily distinguishable in the body of the page. There are very useful visuals in every chapter, including tables, figures, and graphs. Relevant supplemental information is also highlighted in well formatted text boxes that are color coded to indicate what type of information is included. My only criticism is that the photographs included in the text are of low quality, and there are so few in the textbook that I feel it would have been better to just leave them out.

I found no grammatical errors in my review of the textbook. The textbook is generally well written, and the style of writing is at a level that is appropriate for an undergraduate class.

Although the textbook contains no instances of presenting information that is cultural insensitive or offensive, it does not offer an culturally inclusive review of information pertaining to research methods in psychology. I found no inclusion of examples of research conducting with non European American samples included in the summary of studies. Likewise the authors do place much attention on the issue of cultural sensitivity when conducing research. If there is one major weakness of the textbook I would say it is in this area, but based on my experience it is not an uncommon characteristic of textbooks on research methods in psychology.

Reviewed by zehra peynircioglu, Professor, American University on 2/1/18

Short and sweet in most areas. Covers the basic concepts, not very comprehensively but definitely adequately so for a general beginning-level research methods course. For instance, I would liked to have seen a "separate" chapter on correlational... read more

Comprehensiveness rating: 3 see less

Short and sweet in most areas. Covers the basic concepts, not very comprehensively but definitely adequately so for a general beginning-level research methods course. For instance, I would liked to have seen a "separate" chapter on correlational research (there is one on single subject research and one on survey research), a discussion of the importance of providing a theoretical rationale for "getting an idea" (most students are fine with finding interesting and feasible project ideas but cannot give a theoretical rationale) before or after Chapter 4 on Theory, or a chapter on neuroscientific methods, which are becoming more and more popular. Nevertheless, it touches on most traditional areas that are in other books.

I did not find any errors or biases

This is one area where there is not much danger of going obsolete any time soon. The examples might need to be updated periodically (my students tend to not like dated materials, however relevant), but that should be easy.

Very clear and accessible prose. Despite the brevity, the concepts are put forth quite clearly. I like the "not much fluff" mentality. There is also adequate explanations of jargon and technical terminology.

I could not find any inconsistencies. The style and exposition frameworks are also quite consistent.

Yes, the modularity is fine. The chapters follow a logical pattern, so there should not be too much of a need for jumping around. And even if jumping around is needed depending on teaching style, the sections are solid in terms of being able to stand alone (or as an accompaniment to lectures).

Yes, the contents is ordered logically and the high modularity helps with any reorganization that an instructor may favor. In my case, for instance, Ch. 1 is fine, but I would skip it because it's mostly a repetition of what most introductory psychology books also say. I would also discuss non-experimental methods before going into experimental design. But such changes are easy to do, and if someone followed the book's own organization, there would also be a logical flow.

As far as I could see, the text is free of significant interface issues, at least in the pdf version

I could not find any errors.

As far as I could see, the book was culturally relevant.

I loved the short and sweet learning objectives, key takeaway sections, and the exercises. They are not overwhelming and can be used in class discussions, too.

Reviewed by George Woodbury, Graduate Student, Miami University, Ohio on 6/20/17

This text covers the typical areas for an undergraduate psychology course in research design. There is no table of contents included with the downloadable version, although there is a table of contents on the website (which excludes sub-sections... read more

This text covers the typical areas for an undergraduate psychology course in research design. There is no table of contents included with the downloadable version, although there is a table of contents on the website (which excludes sub-sections of chapters). The sections on statistics are not extensive enough to be useful in and of themselves, but they are useful for transitions to a follow-up statistics course. There does not seem to be a glossary of terms, which made it difficult at times for my read through and I assume later for students who decide to print the text. The text is comprehensive without being wordy or tedious.

Relatively minor errors; There does not seem to be explicit cultural or methodological bias in the text.

The content is up-to-date, and examples from the psychology literature are generally within the last 25 years. Barring extensive restructuring in the fundamentals of methodology and design in psychology, any updates will be very easy to implement.

Text will be very clear and easy to read for students fluent in English. There is little jargon/technical terminology used, and the vocabulary that is provided in the text is contemporary

There do not seem to be obvious shifts in the terminology or the framework. The text is internally consistent in that regard.

The text is well divided into chapter and subsections. Each chapter is relatively self-contained, so there are little issues with referring to past material that may have been skipped. The learning objectives at the beginning of the chapter are very useful. Blocks of text are well divided with headings.

As mentioned above, the topics of the text follow the well-established trajectory of undergraduate psychology courses. This makes it very logical and clear.

The lack of a good table of contents made it difficult to navigate the text for my read through. There were links to an outside photo-hosting website (flickr) for some of the stock photos, which contained the photos of the original creators of the photos. This may be distracting or confusing to readers. However, the hyperlinks in general helped with navigation with the PDF.

No more grammatical errors than a standard, edited textbook.

Very few examples explicitly include other races, ethnicities, or backgrounds, however the examples seem to intentionally avoid cultural bias. Overall, the writing seems to be appropriately focused on avoiding culturally insensitive or offensive content.

After having examined several textbooks on research design and methodology related to psychology, this book stands out as superior.

Reviewed by Angela Curl, Assistant Professor, Miami University (Ohio) on 6/20/17

"Research Methods in Psychology" covers most research method topics comprehensively. The author does an excellent job explaining main concepts. The chapter on causation is very detailed and well-written as well as the chapter on research ethics.... read more

"Research Methods in Psychology" covers most research method topics comprehensively. The author does an excellent job explaining main concepts. The chapter on causation is very detailed and well-written as well as the chapter on research ethics. However, the explanations of data analysis seem to address upper level students rather than beginners. For example, in the “Describing Statistical Relationships” chapter, the author does not give detailed enough explanations for key terms. A reader who is not versed in research terminology, in my opinion, would struggle to understand the process. While most topics are covered, there are some large gaps. For example, this textbook has very little content related to qualitative research methods (five pages).

The content appears to be accurate and unbias.

The majority of the content will not become obsolete within a short time period-- many of the information can be used for the coming years, as the information provided is, overall, general in nature. The notably exceptions are the content on APA Code of Ethics and the APA Publication Manual, which both rely heavily on outdated versions, which limits the usefulness of these sections. In addition, it would be helpful to incorporate research studies that have been published after 2011.

The majority of the text is clear, with content that is easy for undergraduate students to read and understand. The key points included in the chapters are helpful, but some chapters seem to be missing key points (i.e., the key points do not accurately represent the overall chapter).

The text seems to be internally consistent in its terminology and organization.

Each chapter is broken into subsections that can be used alone. For example, section 5.2 covers reliability and validity of measurement. This could be extremely helpful for educators to select specific content for assigned readings.

The topics are presented in a logical matter for the most part. However, the PDF version of the book does not include a table of contents, and none of the formats has a glossary or index. This can make it difficult to quickly navigate to specific topics or terms, especially when explanations do not appear where expected. For example, the definitions of independent and dependent variables is provided under the heading “Correlation Does Not Imply Causation” (p. 22).

The text is consistent but needs more visual representations throughout the book, rather than heavily in some chapters and none at all in other chapters. Similarly, the text within the chapters is not easily readable due to the large sections of text with little to no graphics or breaks.

The interface of the text is adequate. However, the formatting of the PDF is sometimes weak. For example, the textbook has a number of pages with large blank spaces and other pages are taken up with large photos or graphics. The number of pages (and cost of printing) could have been reduced, or more graphics added to maximize utility.

I found no grammatical errors.

Text appears to be culturally sensitive. I appreciated the inclusion of the content about avoiding biased language (chapter 11).

Instructors who adopt this book would likely benefit from either selecting certain chapters/modules and/or integrating multiple texts together to address the shortcomings of this text. Further, the sole focus on psychology limits the use of this textbook for introductory research methods for other disciplines (e.g., social work, sociology).

Reviewed by Pramit Nadpara, Assistant Professor, Virginia Commonwealth University on 4/11/17

The text book provides good information in certain areas, while not comprehensive information in other areas. The text provides practical information, especially the section on survey development was good. Additional information on sampling... read more

The text book provides good information in certain areas, while not comprehensive information in other areas. The text provides practical information, especially the section on survey development was good. Additional information on sampling strategies would have been beneficial for the readers.

There are no errors.

Research method is a common topic and the fundamentals of it will not change over the years. Therefore, the book is relevant and will not become obsolete.

Clarity rating: 3

The text in the book is clear. Certain aspects of the text could have been presented more clearly. For example, the section on main effects and interactions are some concepts that students may have difficulty understanding. Those areas could be explained more clearly with an example.

Consistency rating: 3

Graphs in the book lacks titles and variable names. Also, the format of chapter title page needs to be consistent.

At times there were related topics spread across several chapters. This could be corrected for a better read by the audience..

The book text is very clear, and the flow from one topic to the next was adequate. However, having a outline would help the reader.

The PDF copy of the book was a easy read. There were few links that were missing though.

There were no grammatical errors.

The text is not offensive and examples in it are mostly based on historical US based experiments.

I would start of by saying that I am a supporter of the Open Textbook concept. In this day and age, there are a variety of Research Methods book/text available on the market. While this book covers research methods basics, it cannot be recommended in its current form as an acceptable alternative to the standard text. Modifications to the text as recommended by myself and other reviewers might improve the quality of this book in the future.

Reviewed by Meghan Babcock, Instructor, University of Texas at Arlington on 4/11/17

This text includes all important areas that are featured in other Research Methods textbooks and are presented in a logical order. The text includes great examples and provides the references which can be assigned as supplemental readings. In... read more

This text includes all important areas that are featured in other Research Methods textbooks and are presented in a logical order. The text includes great examples and provides the references which can be assigned as supplemental readings. In addition, the chapters end with exercises that can be completed in class or as part of a laboratory assignment. This text would be a great addition to a Research Methods course or an Introductory Statistics course for Psychology majors.

The content is accurate. I did not find any errors and the material is unbiased.

Yes - the content is up to date and would be easy to update if/when necessary.

The text is written at an appropriate level for undergraduate students and explains important terminology. The research studies that the author references are ones that undergraduate psychology majors should be familiar with. The only section that was questionable to me was that on multiple regression in section 8.3 (Complex Correlational Designs). I am unaware of other introductory Research Methods textbooks that cover this analysis, especially without describing simple regression first.

The text is consistent in terms of terminology. The framework is also consistent - the chapters begin with Learning Objectives and ends with Key Takeaways and Exercises.

The text is divisible into smaller reading sections - possibly too many. The sections are brief, and in some instances too brief (e.g., the section on qualitative research). I think that the section headers are helpful for instructors who plan on using this text in conjunction with another text in their course.

The topics were presented in a logical fashion and are similar to other published Research Methods texts. The writing is very clear and great examples are provided. I think that some of the sections are rather brief and more information and examples could be provided.

I did not see any interface issues. All of the links worked properly and the tables and figures were accurate and free of errors. I particularly liked the figures in section 5.2 on reliability of measurement.

There are three comments that I have about the interface, however. First, I was expecting the keywords in blue font to be linked to a glossary, but they were not. I would have appreciated this feature. Second, I read this text as a PDF on an iPad and this version lacking was the Table of Contents (TOC) feature. Although I was able to view the TOC in different versions, I would have appreciated it in the PDF version. Also, it would be nice if the TOC was clickable (i.e., you could click on a section and it automatically directed you to that section). Third, I think the reader of this text would benefit from a glossary at the end of each chapter and/or an index at the end of the text. The "Key Takeaways" sections at the end of each chapter were helpful, but I think that a glossary would be a nice addition as well.

I did not notice any grammatical errors of any kind. The text was easy to read and I think that undergraduate students would agree.

The text was not insensitive or offensive to any races, ethnicities, or backgrounds. I appreciated the section on avoiding biased language when writing manuscripts (e.g., using 'children with learning disabilities' instead of 'special children' or using 'African American' instead of 'minority').

I think that this text would be a nice addition to a Research Methods & Statistics course in psychology. There are some sections that I found particularly helpful: (1) 2.2 and 2.3 - the author gives detailed information about generating research questions and reviewing the literature; (2) 9.2 - this section focuses on constructing survey questionnaires; (3) 11.2 and 11.3 - the author talks about writing a research report and about presenting at conferences. These sections will be great additions to an undergraduate Research Methods course. The brief introduction to APA style was also helpful, but should be supplemented with the most recent APA style manual.

Reviewed by Shannon Layman, Lecturer, University of Texas at Arlington on 4/11/17

The sections in this textbook are overall more brief than in previous Methods texts that I have used. Sometimes this brevity is helpful in terms of getting to the point of the text and moving on. In other cases, some topics could use a bit more... read more

The sections in this textbook are overall more brief than in previous Methods texts that I have used. Sometimes this brevity is helpful in terms of getting to the point of the text and moving on. In other cases, some topics could use a bit more detail to establish a better foundation of the content before moving on to examples and/or the next topic.

I did not find any incorrect information or gross language issues.

Basic statistical and/or methodological texts tend to stay current and up-to-date because the topics in this field have not changed over the decades. Any updated methodologies would be found in a more advanced methods text.

The text is very clear and the ideas are easy to follow/ presented in a logical manner. The most helpful thing about this textbook is that the author arrives at the point of the topic very quickly. Another helpful point about this textbook is the relevancy of the examples used. The examples appear to be accessible to a wide audience and do not require specialization or previous knowledge of other fields of psychology.

I feel this text is very consistent throughout. The ideas build on each other and no terms are discussed in later chapters without being established in previous chapters.

Each chapter had multiple subsections which would allow for smaller reading sections throughout the course. The amount of content in each section and chapter appeared to be less than what I have encountered in other Methods texts.

The organization of the topics in this textbook follows the same or similar organization that I see in other textbooks. As I mentioned previously, the ideas build very well throughout the text.

I did not find any issues with navigation or distortion of the figures in the text.

There were not any obvious and/or egregious grammatical errors that I encountered in this text.

This topic is not really an issue with a Methods textbook as the topics are more so conceptual as opposed to topical. That being said, I did not see an issue with any examples used.

I have no other comments than what I addressed previously.

Reviewed by Sarah Allred, Associate Professor, Rutgers University, Camden on 2/8/17

Mixed. For some topics, there is more (and more practical) information than in most textbooks. I appreciated the very practical advice to students about how to plot data (in statistics chapters). Similarly, there is practical advice about how... read more

Mixed. For some topics, there is more (and more practical) information than in most textbooks. I appreciated the very practical advice to students about how to plot data (in statistics chapters). Similarly, there is practical advice about how to comply with ethical guidelines. The section on item development in surveys was very good.

On the other hand, there is far too little information about some subjects. For example, independent and dependent variables are introduced in passing in an early chapter and then referred to only much later in the text. In my experience, students have a surprisingly difficult time grasping this concept. Another important example is sampling; I would have preferred much more information on types of samples and sampling techniques, and the problems that arise from poor sampling. A third example is the introduction to basic experimental design. Variables, measurement, validity, and reliability are all introduced in one chapter.

I did not see an index or glossary.

I found no errors.

The fundamentals of research methods do not change much. Given the current replication crisis in psychology, it might be helpful to have something about replicability.

Mixed. The text itself is spare and clear. The style of the book is to explain a concept in very few words. There are some excellent aspects of this, but on the other hand, there are some concepts that students have a very difficult time undersatnding if they are not embedded in concrete examples. For example, the section on main effects and interactions shows bar graphs of interactions, but this is presented without variable names or axis titles, and separate from any specific experiment.

Sometimes the chapter stucture is laid out on the title page, and other times it is not. Some graphs lack titles and variable names.

The chapters can be stand alone, but sometimes I found conceptually similar pieces spread across several chapters, and conceptually different pieces in the same chapters.

The individual sentences and paragraphs are always very clear. However, I felt that more tables/outlines of major concepts would have been helpful. For example, perhaps a flow chart of different kinds of experimental designs would be useful. (See section on comprehensiveness for more about organization).

The flow from one topic to the next was adequate.

I read the pdf. Perhaps the interface is more pleasant on other devices, but I found the different formats and fonts in image/captions/main text/figure labels distracting. Many if the instances of apparently hyperlinked (blue) text to do not link to anything.

I found no grammatical errors, and prose is standard academic English.

Like most psychology textbooks available in the US, examples are focused on important experiments in US history.

I really wanted to be happy with this text. I am a supporter of the Open Textbook concept, and I wanted to find this book an acceptable alternative to the variety of Research Methods texts I’ve used. Unfortunately, I cannot recommend this book as superior in quality.

Reviewed by Joel Malin, Assistant Professor, Miami University on 8/21/16

This textbook covers all or nearly all of what I believe are important topics to provide an introduction to research methods in psychology. One minor issue is that the pdf version, which I reviewed, does not include an index or a glossary. As... read more

This textbook covers all or nearly all of what I believe are important topics to provide an introduction to research methods in psychology. One minor issue is that the pdf version, which I reviewed, does not include an index or a glossary. As such, it may be difficult for readers to zero in on material that they need, and/or to get a full sense of what will be covered and in what order.

I did not notice errors.

The book provides a solid overview of key issues related to introductory research methods, many of which are nearly timeless.

The writing is clear and accessible. It was easy and pleasing to read.

Terms are clearly defined and build upon each other as the book progresses.

I believe the text is organized in such a way that it could be easily divided into smaller sections.

The order in which material is presented seems to be well thought out and sensible.

I did not notice any issues with the interface. I reviewed the pdf version and thought the images were very helpful.

The book is written in a culturally relevant manner.

Reviewed by Abbey Dvorak, Assistant Professor, University of Kansas on 8/21/16

The text includes basic, essential information needed for students in an introductory research methods course. In addition, the text includes three chapters (i.e., research ethics, theory, and APA style) that are typically absent from or... read more

The text includes basic, essential information needed for students in an introductory research methods course. In addition, the text includes three chapters (i.e., research ethics, theory, and APA style) that are typically absent from or inadequately covered in similar texts. However, I did have some areas of concern regarding the coverage of qualitative and mixed methods approaches, and nonparametric tests. Although the author advocates for the research question to guide the choice of approach and design, minimal attention is given to the various qualitative designs (e.g., phenomenology, narrative, participatory action, etc.) beyond grounded theory and case studies, with no mention of the different types of mixed methods designs (e.g., concurrent, explanatory, exploratory) that are prevalent today. In addition, common nonparametric tests (e.g., Wilcoxon, Mann-Whitney, etc.) and parametric tests for categorical data (e.g., chi-square, Fisher’s exact, etc.) are not mentioned.

The text overall is accurate and free of errors. I noticed in the qualitative research sub-section, the author describes qualitative research in general, but does not mention common practices associated with qualitative research, such as transcribing interviews, coding data (e.g., different approaches to coding, different types of codes), and data analysis procedures. The information that is included appears accurate.

The text appears up-to-date and includes basic research information and classic examples that rarely change, which may allow the text to be used for many years. However, the author may want to add information about mixed methods research, a growing research approach, in order for the text to stay relevant across time.

The text includes clear, accessible, straightforward language with minimal jargon. When the author introduces a new term, the term is immediately defined and described. The author also provides interesting examples to clarify and expand understanding of terms and concepts throughout the text.

The text is internally consistent and uses similar language and vocabulary throughout. The author uses real-life examples across chapters in order to provide depth and insight into the information. In addition, the vocabulary, concepts, and organization are consistent with other research methods textbooks.

The modules are short, concise, and manageable for students; the material within each module is logically focused and related to each other. I may move the modules and the sub-topics within them into a slightly different order for my class, and add the information mentioned above, but overall, this is very good.

The author presents topics and structures chapters in a logical and organized manner. The epub and online version do not include page numbers in the text, but the pdf does; this may be confusing when referencing the text or answering student questions. The book ends somewhat abruptly after the chapter on inferential statistics; the text may benefit from a concluding chapter to bring everything together, perhaps with a culminating example that walks the reader through creating the research question, choosing a research approach/design, etc., all the way to writing the research report.

I used and compared the pdf, epub, and online versions of the text. The epub and online versions include a clickable table of contents, but the pdf does not. The table format is inconsistent across the three versions; in the epub version (viewed through ibooks), the table data does not always line up correctly, making it difficult to interpret quickly. In the pdf and online versions, the table format looks different, but the data are lined up. No index made it difficult to quickly find areas of interest in the text; however, I could use the Find/Search functions in all three versions to search and find needed items.

As I read through this text, I did not detect any glaring grammatical errors. Overall, I think the text is written quite well in a style that is accessible to students.

The author uses inclusive, person-first language, and the text does not seem to be offensive or insensitive. As I read, I did notice that topics such as diversity and cultural competency are absent.

I enjoyed reading this text and am very excited to have a free research methods text for my students that I may supplement as needed. I wish there was a test question bank and/or flashcards for my students to help them study, but perhaps that could be added in the future. Overall, this is a great resource!

Reviewed by Karen Pikula, Psychology Instructor PhD, Central Lakes College on 1/7/16

The text covers all the areas and ideas of the subject of research methods in psychology for the learner that is just entering the field. The authors cover all of the content of an introductory research methods textbook and use exemplary examples... read more

The text covers all the areas and ideas of the subject of research methods in psychology for the learner that is just entering the field. The authors cover all of the content of an introductory research methods textbook and use exemplary examples that make those concepts relevent to a beginning researcher. As the authors state, the material is presented in such a manner as to encourage learners to not only be effective consumers of current research but also engage as critical thinkers in the many diverse situations one encounters in everyday life.

The content is accurate, error free, and unbiased. It explains both quantiative and qualitative methods in an unbiased manner. It is a bit slim on qualitative. It would be nice to have a bit more information on, for example, creating interview questions, coding, and qualitative data anaylisis.

The text is up to date, having just been revised. This revision was authored by Rajiv Jhangiani (Capilano University, North Vancouver) and includes the addition of a table of contents and cover page that the original text did not have, changes to Chapter 3 (Research Ethics) to include a contemporary example of an ethical breach and to reflect Canadian ethical guidelines and privacy laws, additional information regarding online data collection in Chapter 9 (Survey Research). Jhangiani has correcte of errors in the text and formulae, as well as changing spelling from US to Canadian conventions. The text is also now available in a inexpensive hard copy which students can purchase online or college bookstores can stock. This makes the text current and updates should be minimal.

The text is very easy to read and also very interesting as the authors supplement content with amazing real life examples.

The text is internally consistent in terms of terminology and framework.

This text is easily and readily divisible into smaller reading sections that can be assigned at different points within a course. I am going to use this text in conjunction with the OER OpenStax Psychology text for my Honors Psychology course. I currently use the OER Openstax Psychology textbook for my Positive Psychology course as well as my General Psychology course,

The topics in the text are presented in logical and clear fashion. The way they are presented allows the text to be used in conjuction with other textbooks as a secondary resource.

The text is free of significant interface issues. It is written in a manner that follows the natural process of doing research.

The text contained no noted grammatical errors.

The text is not culturally insensitive or offensive and actually has been revised to accomodate Canadian ethical guidelines as well as those of the APA.

I have to say that I am excited to have found this revised edition. My students will be so happy that there is also a reasonable priced hard coopy for them to purchase. They love the OpenStax Psychology text with the hard copy available from our bookstore. I do wish there were PowerPoints available for the text as well as a test bank. That is always a bonus!

Reviewed by Alyssa Gibbons, Instructor, Colorado State University on 1/7/16

This text covers everything I would consider essential for a first course in research methods, including some areas that are not consistently found in introductory texts (e.g., qualitative research, criticisms of null hypothesis significance... read more

This text covers everything I would consider essential for a first course in research methods, including some areas that are not consistently found in introductory texts (e.g., qualitative research, criticisms of null hypothesis significance testing). The chapters on ethics (Ch. 3) and theory (Ch. 4) are more comprehensive than most I have seen at this level, but not to the extent of information overload; rather, they anticipate and address many questions that undergraduates often have about these issues.

There is no index or table of contents provided in the PDF, and the table of contents on the website is very broad, but the material is well organized and it would not be hard for an instructor to create such a table. Chapter 2.1 is intended to be an introduction to several key terms and ideas (e.g., variable, correlation) that could serve as a sort of glossary.

I found the text to be highly accurate throughout; terms are defined precisely and correctly.

Where there are controversies or differences of opinion in the field, the author presents both sides of the argument in a respectful and unbiased manner. He explicitly discourages students from dismissing any one approach as inherently flawed, discussing not only the advantages and disadvantages of all methods (including nonexperimental ones) but also ways researchers address the disadvantages.

In several places, the textbook explicitly addresses the history and development of various methods (e.g., qualitative research, null hypothesis significance testing) and the ways in which researchers' views have changed. This allows the author to present current thinking and debate in these areas yet still expose students to older ideas they are likely to encounter as they read the research literature. I think this approach sets students up well to encounter future methodological advances; as a field, we refine our methods over time. I think the author could easily integrate new developments in future editions, or instructors could introduce such developments as supplementary material without creating confusion by contradicting the test.

The examples are generally drawn from classic psychological studies that have held up well over time; I think they will appeal to students for some time to come and not appear dated.

The only area in which I did not feel the content was entirely up to date was in the area of psychological measurement; Chapter 5.2 is based on the traditional view and not the more comprehensive modern or holistic view as presented in the 1999 AERA/APA Standards for Educational and Psychological Measurement. However, a comprehensive treatment of measurement validity is probably not necessary for most undergraduates at this stage, and they will certainly encounter the older framework in the research literature.

The textbook does an excellent job of presenting concepts in simple, accessible language without introducing error by oversimplification. The author consistently anticipates common points of confusion, clarifies terms, and even suggests ways for students to remember key distinctions. Terms are clearly and concretely defined when they are introduced. In contrast to many texts I have used, the terms that are highlighted in the text are actually the terms I would want my students to remember and study; the author refrains from using psychological jargon that is not central to the concepts he is discussing.

I noticed no major inconsistencies or gaps.

The division of sections within each chapter is useful; although I liked the overall organization of the text, there were points at which I would likely assign sections in a slightly different order and I felt I could do this easily without loss of continuity. The one place I would have liked more modularity was in the discussion of inferential statistics: t-tests, ANOVA, and Pearson's r are all covered within Chapter 13.2. On the one hand, this enables students to see the relationships and similarities among these tests, but on the other, this is a lot for students to take in at once.

I found the overall organization of the book to be quite logical, mirroring the sequence of steps a researcher would use to develop a research question, design a study, etc. As discussed above, the modularity of the book makes it easy to reorder sections to suit the structure of a particular class (for example, I might have students read the section on APA writing earlier in the semester as they begin drafting their own research proposals). I like the inclusion of ethics very early on in the text, establishing the importance of this topic for all research design choices.

One organizational feature I particularly appreciated was the consistent integration of conceptual and practical ideas; for example, in the discussion of psychological measurement, reliability and validity are discussed alongside the importance of giving clear instructions and making sure participants cannot be identified by their writing implements. This gives students an accurate and honest picture of the research process - some of the choices we make are driven by scientific ideals and some are driven by practical lessons learned. Students often have questions related to these mundane aspects of conducting research and it is helpful to have them so clearly addressed.

Although I didn't encounter any problems per se with the interface, I do think it could be made more user-friendly. For example, references to figures and tables are highlighted in blue, appearing to be hyperlinks, but they were not. Having such links, as well as a linked, easily-navigable and detailed table of contents, would also be helpful (and useful to students who use assistive technology).

I noticed no grammatical errors.

Where necessary, the author uses inclusive language and there is nothing that seems clearly offensive. The examples generally reflect American psychology research, but the focus is on the methods used and not the participants or cultural context. The text could be more intentionally or proactively inclusive, but it is not insensitive or exclusive.

I am generally hard to please when it comes to textbooks, but I found very little to quibble with in this one. It is a very well-written and accessible introduction to research methods that meets students where they are, addressing their common questions, misconceptions, and concerns. Although it's not flashy, the figures, graphics, and extra resources provided are clear, helpful, and relevant.

Reviewed by Moin Syed, Assistant Professor, University of Minnesota on 6/10/15

The text is thorough in terms of covering introductory concepts that are central to experimental and correlational/association designs. I find the general exclusion of qualitative and mixed methods designs hard to defend (despite some researchers’... read more

The text is thorough in terms of covering introductory concepts that are central to experimental and correlational/association designs. I find the general exclusion of qualitative and mixed methods designs hard to defend (despite some researchers’ distaste for the methods). While these approaches were less commonly used in the recent past, they are prevalent in the early years of psychology and are ascending once again. It strikes me as odd to just ignore two whole families of methods that are used within the practice of psychology—definitely not a sustainable approach.

I do very much appreciate the emphasis on those who will both practice and consume psychology, given the wide variety of undergraduate career paths.

One glaring omission is a Table of Contents within the PDF. It would be nice to make this a linked PDF, so that clicking on the entry in a TOC (or cross-references) would jump the reader to the relevant section.

I did not see an errors. The chapter on theory is not as clear as it could be. The section “what is theory” is not very clear, and these are difficulte concepts (difference between theory, hypothesis, etc.). A bit more time spent here could have been good. Also, the discussion of functional, mechanistic, and typological theories leaves out the fourth of Pepper’s metaphors: contextualism. I’m not sure that was intentional and accidental, but it is noticeable!

This is a research methods text focused on experimental and association designs. The basics of these designs do not change a whole lot over time, so there is little likelihood that the main content will become obsolete anytime soon. Some of the examples used are a bit dated, but then again most of them are considered “classics” in the field, which I think are important to retain (and there is at least one “new classic” included in the ethics section, namely the fraudulent research linking autism to the MMR vaccine).

The text is extremely clear and accessible. In fact, it may even be *too* simple for undergraduate use. Then again, students often struggle with methods, so simplicity is good, and the simplicity can also make the book marketable to high school courses (although I doubt many high schools have methods courses).

Yes, quite consistent throughout. Carrying through the same examples into different chapters is a major strength of the text.

I don’ anticipate any problems here.

The book flows well, with brief sections. I do wonder if maybe the sections are too brief? Perhaps too many check-ins? The “key take-aways” usually come after only a few pages. As mentioned above, the book is written at a very basic level, so this brevity is consistent with that approach. It is not a problem, per se, but those considering adopting the text should be aware of this aspect.

No problems here.

I did not detect any grammatical errors. The text flows very well.

The book is fairly typical of American research methods books in that it only focuses on the U.S. context and draws its examples from “mainstream” psychology (e.g., little inclusion of ethnic minority or cross-cultural psychology). However, the text is certainly not insensitive or offensive in any way.

Nice book, thanks for writing it!

Reviewed by Rajiv Jhangiani, Instructor, Capilano University on 10/9/13

The text is well organized and written, integrates excellent pedagogical features, and covers all of the traditional areas of the topic admirably. The final two chapters provide a good bridge between the research methods course and the follow-up... read more

The text is well organized and written, integrates excellent pedagogical features, and covers all of the traditional areas of the topic admirably. The final two chapters provide a good bridge between the research methods course and the follow-up course on behavioural statistics. The text integrates real psychological measures, harnesses students' existing knowledge from introductory psychology, includes well-chosen examples from real life and research, and even includes a very practical chapter on the use of APA style for writing and referencing. On the other hand, it does not include a table of contents or an index, both of which are highly desirable. The one chapter that requires significant revision is Chapter 3 (Research Ethics), which is based on the US codes of ethics (e.g., Federal policy & APA code) and does not include any mention of the Canadian Tri-Council Policy Statement.

The very few errors I found include the following: 1. The text should read "The fact that his F score…" instead of "The fact that his t score…" on page 364 2. Some formulae are missing the line that separates the numerator from the denominator. See pages 306, 311, 315, and 361 3. Table 12.3 on page 310 lists the variance as 288 when it is 28.8

The text is up-to-date and will not soon lose relevance. The only things I would add are a brief discussion of the contemporary case of Diederik Stapel's research fraud in the chapter on Research Ethics, as well as some research concerning the external validity of web-based studies (e.g., Gosling et al.'s 2004 article in American Psychologist).

Overall, the style of writing makes this text highly accessible. The writing flows well, is well organized, and includes excellent, detailed, and clear examples and explanations for concepts. The examples often build on concepts or theories students would have covered in their introductory psychology course. Some constructive criticism: 1. When discussing z scores on page 311 it might have been helpful to point out that the mean and SD for a set of calculated z scores are 0 and 1 respectively. Good students will come to this realization themselves, but it is not a bad thing to point it out nonetheless. 2. The introduction of the concept of multiple regression might be difficult for some students to grasp. 3. The only place where I felt short of an explanation was in the use of a research example to demonstrate the use of a line graph on page 318. In this case the explanation in question does not pertain to the line graph itself but the result of the study used, which is so fascinating that students will wish for the researchers' explanation for it.

The text is internally consistent.

The text is organized very well into chapters, modules within each chapter, and learning objectives within each module. Each module also includes useful exercises that help consolidate learning.

As mentioned earlier, the style of writing makes this text highly accessible. The writing flows well, is well organized, and includes excellent, detailed, and clear examples and explanations for concepts. The examples often build on concepts or theories students would have covered in their introductory psychology course. Only rarely did I feel that the author could have assisted the student by demonstrating the set-by-step calculation of a statistic (e.g., on page 322 for the calculation of Pearson's r)

The images, graphs, and charts are clear. The only serious issues that hamper navigation are the lack of a table of contents and an index. Many of the graphs will need to be printed in colour (or otherwise modified) for the students to follow the explanations provided in the text.

The text is written rather well and is free from grammatical errors. Of course, spellings are in the US convention.

The text is not culturally insensitive or offensive. Of course, it is not a Canadian edition and so many of the examples (all of which are easy to comprehend) come from a US context.

I have covered most of these issues in my earlier comments. The only things left to mention are that the author should have clearly distinguished between mundane and psychological realism, and that, in my opinion, the threats to internal validity could have been grouped together and might have been closer to an exhaustive list. This review originated in the BC Open Textbook Collection and is licensed under CC BY-ND.

Table of Contents

• Chapter 1: The Science of Psychology
• Chapter 2: Overview of the Scientific Method
• Chapter 3: Research Ethics
• Chapter 4: Psychological Measurement
• Chapter 5: Experimental Research
• Chapter 6: Non-experimental Research
• Chapter 7: Survey Research
• Chapter 8: Quasi-Experimental Research
• Chapter 9: Factorial Designs
• Chapter 10: Single-Subject Research
• Chapter 11: Presenting Your Research
• Chapter 12: Descriptive Statistics
• Chapter 13: Inferential Statistics

Ancillary Material

• Kwantlen Polytechnic University

About the Book

This fourth edition (published in 2019) was co-authored by Rajiv S. Jhangiani (Kwantlen Polytechnic University), Carrie Cuttler (Washington State University), and Dana C. Leighton (Texas A&M University—Texarkana) and is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License. Revisions throughout the current edition include changing the chapter and section numbering system to better accommodate adaptions that remove or reorder chapters; continued reversion from the Canadian edition; general grammatical edits; replacement of “he/she” to “they” and “his/her” to “their”; removal or update of dead links; embedded videos that were not embedded; moved key takeaways and exercises from the end of each chapter section to the end of each chapter; a new cover design.

About the Contributors

Dr. Carrie Cuttler received her Ph.D. in Psychology from the University of British Columbia. She has been teaching research methods and statistics for over a decade. She is currently an Assistant Professor in the Department of Psychology at Washington State University, where she primarily studies the acute and chronic effects of cannabis on cognition, mental health, and physical health. Dr. Cuttler was also an OER Research Fellow with the Center for Open Education and she conducts research on open educational resources. She has over 50 publications including the following two published books:  A Student Guide for SPSS (1st and 2nd edition)  and  Research Methods in Psychology: Student Lab Guide.  Finally, she edited another OER entitled  Essentials of Abnormal Psychology. In her spare time, she likes to travel, hike, bike, run, and watch movies with her husband and son. You can find her online at @carriecuttler or carriecuttler.com.

Dr. Rajiv Jhangiani is the Associate Vice Provost, Open Education at Kwantlen Polytechnic University in British Columbia. He is an internationally known advocate for open education whose research and practice focuses on open educational resources, student-centered pedagogies, and the scholarship of teaching and learning. Rajiv is a co-founder of the Open Pedagogy Notebook, an Ambassador for the Center for Open Science, and serves on the BC Open Education Advisory Committee. He formerly served as an Open Education Advisor and Senior Open Education Research & Advocacy Fellow with BCcampus, an OER Research Fellow with the Open Education Group, a Faculty Workshop Facilitator with the Open Textbook Network, and a Faculty Fellow with the BC Open Textbook Project. A co-author of three open textbooks in Psychology, his most recent book is  Open: The Philosophy and Practices that are Revolutionizing Education and Science (2017). You can find him online at @thatpsychprof or thatpsychprof.com.

Dr. Dana C. Leighton is Assistant Professor of Psychology in the College of Arts, Science, and Education at Texas A&M University—Texarkana. He earned his Ph.D. from the University of Arkansas, and has 15 years experience teaching across the psychology curriculum at community colleges, liberal arts colleges, and research universities. Dr. Leighton’s social psychology research lab studies intergroup relations, and routinely includes undergraduate students as researchers. He is also Chair of the university’s Institutional Review Board. Recently he has been researching and writing about the use of open science research practices by undergraduate researchers to increase diversity, justice, and sustainability in psychological science. He has published on his teaching methods in eBooks from the Society for the Teaching of Psychology, presented his methods at regional and national conferences, and received grants to develop new teaching methods. His teaching interests are in undergraduate research, writing skills, and online student engagement. For more about Dr. Leighton see http://www.danaleighton.net and http://danaleighton.edublogs.org

Contribute to this Page

Psychological Research Methods: Types and Tips

Categories Research Methods

Psychological research methods are the techniques used by scientists and researchers to study human behavior and mental processes. These methods are used to gather empirical evidence.

The goal of psychological research methods is to obtain objective and verifiable data collected through scientific experimentation and observation. 

The research methods that are used in psychology are crucial for understanding how and why people behave the way they do, as well as for developing and testing theories about human behavior.

Table of Contents

Reasons to Learn More About Psychological Research Methods

One of the key goals of psychological research is to make sure that the data collected is reliable and valid.

• Reliability means that the data is consistent and can be replicated
• Validity refers to the accuracy of the data collected

Researchers must take great care to ensure that their research methods are reliable and valid, as this is essential for drawing accurate conclusions and making valid claims about human behavior.

High school and college students who are interested in psychology can benefit greatly from learning about research methods. Understanding how psychologists study human behavior and mental processes can help students develop critical thinking skills and a deeper appreciation for the complexity of human behavior.

Having an understanding of these research methods can prepare students for future coursework in psychology, as well as for potential careers in the field.

Quantitative vs. Qualitative Psychological Research Methods

Psychological research methods can be broadly divided into two main types: quantitative and qualitative. These two methods differ in their approach to data collection and analysis.

Quantitative Research Methods

Quantitative research methods involve collecting numerical data through controlled experiments, surveys, and other objective measures.

The goal of quantitative research is to identify patterns and relationships in the data that can be analyzed statistically.

Researchers use statistical methods to test hypotheses, identify significant differences between groups, and make predictions about future behavior.

Qualitative Research Methods

Qualitative research methods, on the other hand, involve collecting non-numerical data through open-ended interviews, observations, and other subjective measures.

Qualitative research aims to understand the subjective experiences and perspectives of individuals and groups.

Researchers use methods such as content analysis and thematic analysis to identify themes and patterns in the data and to develop rich descriptions of the phenomenon under study.

How Quantitative and Qualitative Methods Are Used

While quantitative and qualitative research methods differ in their approach to data collection and analysis, they are often used together to gain a more complete understanding of complex phenomena.

For example, a researcher studying the impact of social media on mental health might use a quantitative survey to gather numerical data on social media use and a qualitative interview to gain insight into participants’ subjective experiences with social media.

Types of Psychological Research Methods

There are several types of research methods used in psychology, including experiments, surveys, case studies, and observational studies. Each method has its strengths and weaknesses, and researchers must choose the most appropriate method based on their research question and the data they hope to collect.

Case Studies

A case study is a research method used in psychology to investigate an individual, group, or event in great detail. In a case study, the researcher gathers information from a variety of sources, including:

• Observation
• Document analysis

These methods allow researchers to gain an in-depth understanding of the case being studied.

Case studies are particularly useful when the phenomenon under investigation is rare or complex, and when it is difficult to replicate in a laboratory setting.

Surveys are a commonly used research method in psychology that involve gathering data from a large number of people about their thoughts, feelings, behaviors, and attitudes.

Surveys can be conducted in a variety of ways, including:

• In-person interviews
• Online questionnaires
• Paper-and-pencil surveys

Surveys are particularly useful when researchers want to study attitudes or behaviors that are difficult to observe directly or when they want to generalize their findings to a larger population.

Experimental Psychological Research Methods

Experimental studies are a research method commonly used in psychology to investigate cause-and-effect relationships between variables. In an experimental study, the researcher manipulates one or more variables to see how they affect another variable, while controlling for other factors that may influence the outcome.

Experimental studies are considered the gold standard for establishing cause-and-effect relationships, as they allow researchers to control for potential confounding variables and to manipulate variables in a systematic way.

Correlational Psychological Research Methods

Correlational research is a research method used in psychology to investigate the relationship between two or more variables without manipulating them. The goal of correlational research is to determine the extent to which changes in one variable are associated with changes in another variable.

In other words, correlational research aims to establish the direction and strength of the relationship between two or more variables.

Naturalistic Observation

Naturalistic observation is a research method used in psychology to study behavior in natural settings, without any interference or manipulation from the researcher.

The goal of naturalistic observation is to gain insight into how people or animals behave in their natural environment without the influence of laboratory conditions.

Meta-Analysis

A meta-analysis is a research method commonly used in psychology to combine and analyze the results of multiple studies on a particular topic.

The goal of a meta-analysis is to provide a comprehensive and quantitative summary of the existing research on a topic, in order to identify patterns and relationships that may not be apparent in individual studies.

Tips for Using Psychological Research Methods

Here are some tips for high school and college students who are interested in using psychological research methods:

Understand the different types of research methods: 

Before conducting any research, it is important to understand the different types of research methods that are available, such as surveys, case studies, experiments, and naturalistic observation.

Each method has its strengths and limitations, and selecting the appropriate method depends on the research question and variables being investigated.

Develop a clear research question: 

A good research question is essential for guiding the research process. It should be specific, clear, and relevant to the field of psychology. It is also important to consider ethical considerations when developing a research question.

Use proper sampling techniques: 

Sampling is the process of selecting participants for a study. It is important to use proper sampling techniques to ensure that the sample is representative of the population being studied.

Random sampling is considered the gold standard for sampling, but other techniques, such as convenience sampling, may also be used depending on the research question.

Use reliable and valid measures:

It is important to use reliable and valid measures to ensure the data collected is accurate and meaningful. This may involve using established measures or developing new measures and testing their reliability and validity.

Consider ethical issues:

It is important to consider ethical considerations when conducting psychological research, such as obtaining informed consent from participants, maintaining confidentiality, and minimizing any potential harm to participants.

In many cases, you will need to submit your study proposal to your school’s institutional review board for approval.

Analyze and interpret the data appropriately : 

After collecting the data, it is important to analyze and interpret the data appropriately. This may involve using statistical techniques to identify patterns and relationships between variables, and using appropriate software tools for analysis.

Communicate findings clearly: 

Finally, it is important to communicate the findings clearly in a way that is understandable to others. This may involve writing a research report, giving a presentation, or publishing a paper in a scholarly journal.

Clear communication is essential for advancing the field of psychology and informing future research.

Frequently Asked Questions

What are the 5 methods of psychological research.

The five main methods of psychological research are:

• Experimental research : This method involves manipulating one or more independent variables to observe their effect on one or more dependent variables while controlling for other variables. The goal is to establish cause-and-effect relationships between variables.
• Correlational research : This method involves examining the relationship between two or more variables, without manipulating them. The goal is to determine whether there is a relationship between the variables and the strength and direction of that relationship.
• Survey research : This method involves gathering information from a sample of participants using questionnaires or interviews. The goal is to collect data on attitudes, opinions, behaviors, or other variables of interest.
• Case study research : This method involves an in-depth analysis of a single individual, group, or event. The goal is to gain insight into specific behaviors, attitudes, or phenomena.
• Naturalistic observation research : This method involves observing and recording behavior in natural settings without any manipulation or interference from the researcher. The goal is to gain insight into how people or animals behave in their natural environment.

What is the most commonly used psychological research method?

The most common research method used in psychology varies depending on the research question and the variables being investigated. However, correlational research is one of the most frequently used methods in psychology.

This is likely because correlational research is useful in studying a wide range of psychological phenomena, and it can be used to examine the relationships between variables that cannot be manipulated or controlled, such as age, gender, and personality traits. 

Experimental research is also a widely used method in psychology, particularly in the areas of cognitive psychology , social psychology , and developmental psychology .

Other methods, such as survey research, case study research, and naturalistic observation, are also commonly used in psychology research, depending on the research question and the variables being studied.

How do you know which research method to use?

Deciding which type of research method to use depends on the research question, the variables being studied, and the practical considerations involved. Here are some general guidelines to help students decide which research method to use:

• Identify the research question : The first step is to clearly define the research question. What are you trying to study? What is the hypothesis you want to test? Answering these questions will help you determine which research method is best suited for your study.
• Choose your variables : Identify the independent and dependent variables involved in your research question. This will help you determine whether an experimental or correlational research method is most appropriate.
• Consider your resources : Think about the time, resources, and ethical considerations involved in conducting the research. For example, if you are working on a tight budget, a survey or correlational research method may be more feasible than an experimental study.
• Review existing literature : Conducting a literature review of previous studies on the topic can help you identify the most appropriate research method. This can also help you identify gaps in the literature that your study can fill.
• Consult with a mentor or advisor : If you are still unsure which research method to use, consult with a mentor or advisor who has experience in conducting research in your area of interest. They can provide guidance and help you make an informed decision.

Scholtz SE, de Klerk W, de Beer LT. The use of research methods in psychological research: A systematised review . Front Res Metr Anal . 2020;5:1. doi:10.3389/frma.2020.00001

Palinkas LA. Qualitative and mixed methods in mental health services and implementation research . J Clin Child Adolesc Psychol . 2014;43(6):851-861. doi:10.1080/15374416.2014.910791

Crowe S, Cresswell K, Robertson A, Huby G, Avery A, Sheikh A. The case study approach . BMC Med Res Methodol . 2011;11(1):100. doi:10.1186/1471-2288-11-100

5 Most Popular Research Methods in Psychology

Ready to find the perfect college degree.

• Make descriptions
• Predict outcomes
• Test an independent variable
• Communities
• Individuals
• Assist patients with psychological ailments
• Diagnose patients
• Understand problems

How to Use Case Study Research Method

Content Analysis

Close reading, summative analysis, ground theory, stages in ground theory.

Categorizing

Conceptualizing.

• Consistency
• Control group
• Control of variables
• Showing cause and effect

3 Main Types of Experiments

• Field experiments
• Lab experiments
• Natural experiments
• Human behavior studies
• Human development
• Sleep studies

Observational Study

• Social constructs

Guidelines to Follow for Observational Study

• Individuals must remain anonymous
• Observations must happen in public contexts
• You must not expect private observations

Survey Method

Communication channels for survey data collection studies.

• The internet
• Gender inequality
• Substance abuse

Other Types of Research Methods Used in Psychology

• Correlational research
• Dependent variable
• Independent variable
• Experimental task design
• Positive correlation (also correlational research)
• Structured observation
• Random sampling in experimental design
• Statistical estimation

Final Thoughts

By BDP Staff

Related Resources:

5 Career Options with a Bachelor’s in Psychology

5 Careers in Sociology That You Can Feel Good About

30 Best Bachelor’s in Psychology Degrees Online: Small Colleges

Top 10 Best Majors for Indecisive Students

Ultimate Guide to Psychology and Counseling Degrees and Careers

This concludes our article on the various research methods in psychology.

Brenda Rufener Author

Julie McCaulley Expert

Carrie Sealey-Morris Editor-in-Chief

JCU Online Blog

5 types of psychological research that everyone should know.

Psychology is a varied field. At any time, there is a range of psychology research methods that can be used in a variety of circumstances. 

Which method to use depends on the research conducted and the research subjects involved. Often, more than one psychology research method will be used, especially when validating previous research.

Here are five popular psychology research methods and some of their most successful applications.

Naturalistic observation

As the name suggests, this psychology research method involves observing something in its natural environment. 

Naturalistic observation is often used when the research subject’s environment can’t be recreated in a lab setting. So, this research method is commonly used when the subjects being studied are in classrooms or workplaces. Another common use of naturalistic observation is to support the validity of other psychology research methods.

One of the major disadvantages of naturalistic observation is that people tend to behave differently when being observed. This drawback was highlighted by the Hawthorne studies which set out to determine whether workers were more productive in brighter light. 

Using naturalistic observation, the researchers found that workers more productive as the light got brighter – until the study stopped. Even though the lights stayed up, without the attention of the researchers, workers went back to their old, low production ways.

If the first question on a survey was, ‘have you ever answered a survey?’, chances are we would get 100 per cent positive results. Surveys are one of the most popular ways to find out what people think and one of the most common research methods in psychology.

The key to lifting the survey from a marketing tool to psychology research method is the random sample . This is a subset of the entire population being studied, chosen at random, to represent the general population better.

A random sample needs the best chance of demonstrating the entire population. To do that, it must be weighted to have the same characteristics of that population. For example, if you wanted to research postgraduate students who read blog posts, you wouldn’t include postgraduate students who don’t read blog posts in your random sample.

Experimental methods

Experimental psychology research methods start with a hypothesis that the researcher hopes to prove, attained  by manipulating one independent variable while measuring the result on another dependent variable. 

Ideally, these experiments will be conducted in a lab, where other variables are controlled. If that’s possible, then the experiment can be reproduced in other labs for validation. 

Both naturalistic observation and surveys, as well as other psychology research methods, can be used as part of an experimental method.

Experimental research can also be conducted in the field, with a limited ability to control other variables. The Good Samaritan experiment of 1973 used this method to determine how likely people are to stop and help when they pass an injured person. 

To control outside variables, they told the volunteers in their random sample that the study was about religious education and vocations. They gave them a survey then asked them to walk to another building to deliver a talk. It was on their way that they encountered an injured person – where only 40 per cent of them stopped to help.

Correlational Studies

When it’s not possible to run an experiment, correlational studies can be an effective psychology research method. Correlational studies also make use of naturalistic observation and surveys, as well as archival research. The idea here is to look at two or more variables to identify a relationship between them.

The most important thing to remember is that correlation does not always equal causation. Correlational studies make it possible to study variables that we can’t control, but they don’t provide enough information to establish a cause-and-effect relationship. For this reason, correlational studies are often used in the early stages of a research project.

Correlational studies had a massive impact on every kitchen in the United Kingdom during the 1960s. In the decade prior, ‘town gas’ for cooking was produced locally from coal and delivered by regional gas companies. At the same time, the suicide rate was rising, and it was increasing faster for women than men.

A researcher by the name of Sainsbury identified a relationship between the suicides and ‘town gas’ which contained poisonous carbon monoxide. In this case, correlation was found to be causation.

Throughout the 1960s a massive operation was undertaken to replace ‘town gas’ with natural gas across the United Kingdom. Natural gas has no poisonous carbon monoxide. 

In ten years, the suicide rate from carbon monoxide poisoning dropped by around 80 per cent, while the overall suicide rate dropped by about 30 per cent.

All of these psychology research methods can be used as part of a case study , which focuses on one individual or a group – usually over a long period of time. Because only one case is involved, it’s difficult to extrapolate this type of research to broader populations. It also raises ethical issues around the long-term participation of those involved.

When Henry Molaison lost the ability to create new memories after a botched operation to cure epilepsy, he became a case study for over 100 psychologists and neurologists. Suzanne Corkin was one neurologist who spent 46 years working with Molaison until his death in 2008. When Henry died, he donated his brain to research. Corkin describes viewing the ‘tofu-like’ object for the first time with a mix of fascination and human loss for a dear friend.

Before her death in 2016, Corkin was accused of unethical practices during her case study that included shredding source material and not revealing Henry’s pre-existing conditions. This highlights the risk of bias with case study research. Researchers are at risk of bias as they come to know their research subjects – and because they invest so much of their time and effort into the project.

To help you avoid such a predicament, JCU’s Graduate Diploma of Psychology (Bridging) provides a deep understanding of the ethical issues around this and other study methods.

Learn more about our online postgraduate courses . Get in touch with our Enrolment team on 1300 535 919.

• Previous post How to get a job in data science
• Next post How to write a business case: Tips, resources and examples

Find out more about JCU’s online Graduate Diploma of Psychology (Bridging) .

Get in touch with our Enrolment team on 1300 535 919

Related study options

Jan, Mar, May, Jul, Sep, Oct

20 months part-time

8 months part-time

Ready to get started?

Download a course guide.

For more detailed and up-to-date information about your degree, including:

• Information about the course
• Course duration
• Course descriptions
• What to expect from the course

Speak with an Enrolment Advisor

Investing in the right course for you is important to us and we’re here to help. Simply request a call back and will assist you with:

• Entry requirements
• Choosing right course
• How to apply and enrol
• How online study works
• Course duration and fees

By submitting this form, you agree that a representative of James Cook University may contact you by email, phone and SMS in relation to your enquiry and to provide you with further information about its programs. You may opt out at any time. For more information on how your personal information will be collected, stored and used, please see our Privacy Statement .

Speak with a advisor

Find out more about:

• Application guide

*All fields required

You must be a Registered Nurse (Division 1) or Registered Midwife with AHPRA to be eligible for this course.

If you’re not currently a Registered Nurse, you may be interested in our on-campus Bachelor of Nursing Science course.

We acknowledge Australian Aboriginal People and Torres Strait Islander People as the first inhabitants of the nation, and acknowledge Traditional Owners of the lands where our staff and students live, learn and work.

• © James Cook University 1995 to 2021
• CRICOS Provider Code 00117J
• ABN 46253211955
• Terms of use
• Right to Information and Privacy
• CRICOS Provider Code: 00117J

people downloaded a course guide in the last 24 hours .

You must have a bachelor’s degree, a postgraduate degree or an equivalent qualification to be eligible for this course.

If you do not have one of these qualifications, you may still be eligible for one of our on-campus psychology courses.

• Bipolar Disorder
• Therapy Center
• When To See a Therapist
• Types of Therapy
• Best Online Therapy
• Best Couples Therapy
• Best Family Therapy
• Managing Stress
• Sleep and Dreaming
• Understanding Emotions
• Self-Improvement
• Healthy Relationships
• Student Resources
• Personality Types
• Guided Meditations
• Verywell Mind Insights
• 2024 Verywell Mind 25
• Mental Health in the Classroom
• Editorial Process
• Meet Our Review Board
• Crisis Support

Scientific Method Steps in Psychology Research

Steps, Uses, and Key Terms

Kendra Cherry, MS, is a psychosocial rehabilitation specialist, psychology educator, and author of the "Everything Psychology Book."

Emily is a board-certified science editor who has worked with top digital publishing brands like Voices for Biodiversity, Study.com, GoodTherapy, Vox, and Verywell.

Verywell / Theresa Chiechi

How do researchers investigate psychological phenomena? They utilize a process known as the scientific method to study different aspects of how people think and behave.

When conducting research, the scientific method steps to follow are:

• Observe what you want to investigate
• Ask a research question and make predictions
• Test the hypothesis and collect data
• Examine the results and draw conclusions
• Report and share the results 

This process not only allows scientists to investigate and understand different psychological phenomena but also provides researchers and others a way to share and discuss the results of their studies.

Generally, there are five main steps in the scientific method, although some may break down this process into six or seven steps. An additional step in the process can also include developing new research questions based on your findings.

What Is the Scientific Method?

What is the scientific method and how is it used in psychology?

The scientific method consists of five steps. It is essentially a step-by-step process that researchers can follow to determine if there is some type of relationship between two or more variables.

By knowing the steps of the scientific method, you can better understand the process researchers go through to arrive at conclusions about human behavior.

Scientific Method Steps

While research studies can vary, these are the basic steps that psychologists and scientists use when investigating human behavior.

The following are the scientific method steps:

Step 1. Make an Observation

Before a researcher can begin, they must choose a topic to study. Once an area of interest has been chosen, the researchers must then conduct a thorough review of the existing literature on the subject. This review will provide valuable information about what has already been learned about the topic and what questions remain to be answered.

A literature review might involve looking at a considerable amount of written material from both books and academic journals dating back decades.

The relevant information collected by the researcher will be presented in the introduction section of the final published study results. This background material will also help the researcher with the first major step in conducting a psychology study: formulating a hypothesis.

Step 2. Ask a Question

Once a researcher has observed something and gained some background information on the topic, the next step is to ask a question. The researcher will form a hypothesis, which is an educated guess about the relationship between two or more variables

For example, a researcher might ask a question about the relationship between sleep and academic performance: Do students who get more sleep perform better on tests at school?

In order to formulate a good hypothesis, it is important to think about different questions you might have about a particular topic.

You should also consider how you could investigate the causes. Falsifiability is an important part of any valid hypothesis. In other words, if a hypothesis was false, there needs to be a way for scientists to demonstrate that it is false.

Step 3. Test Your Hypothesis and Collect Data

Once you have a solid hypothesis, the next step of the scientific method is to put this hunch to the test by collecting data. The exact methods used to investigate a hypothesis depend on exactly what is being studied. There are two basic forms of research that a psychologist might utilize: descriptive research or experimental research.

Descriptive research is typically used when it would be difficult or even impossible to manipulate the variables in question. Examples of descriptive research include case studies, naturalistic observation , and correlation studies. Phone surveys that are often used by marketers are one example of descriptive research.

Correlational studies are quite common in psychology research. While they do not allow researchers to determine cause-and-effect, they do make it possible to spot relationships between different variables and to measure the strength of those relationships. 

Experimental research is used to explore cause-and-effect relationships between two or more variables. This type of research involves systematically manipulating an independent variable and then measuring the effect that it has on a defined dependent variable .

One of the major advantages of this method is that it allows researchers to actually determine if changes in one variable actually cause changes in another.

While psychology experiments are often quite complex, a simple experiment is fairly basic but does allow researchers to determine cause-and-effect relationships between variables. Most simple experiments use a control group (those who do not receive the treatment) and an experimental group (those who do receive the treatment).

Step 4. Examine the Results and Draw Conclusions

Once a researcher has designed the study and collected the data, it is time to examine this information and draw conclusions about what has been found.  Using statistics , researchers can summarize the data, analyze the results, and draw conclusions based on this evidence.

So how does a researcher decide what the results of a study mean? Not only can statistical analysis support (or refute) the researcher’s hypothesis; it can also be used to determine if the findings are statistically significant.

When results are said to be statistically significant, it means that it is unlikely that these results are due to chance.

Based on these observations, researchers must then determine what the results mean. In some cases, an experiment will support a hypothesis, but in other cases, it will fail to support the hypothesis.

So what happens if the results of a psychology experiment do not support the researcher's hypothesis? Does this mean that the study was worthless?

Just because the findings fail to support the hypothesis does not mean that the research is not useful or informative. In fact, such research plays an important role in helping scientists develop new questions and hypotheses to explore in the future.

After conclusions have been drawn, the next step is to share the results with the rest of the scientific community. This is an important part of the process because it contributes to the overall knowledge base and can help other scientists find new research avenues to explore.

Step 5. Report the Results

The final step in a psychology study is to report the findings. This is often done by writing up a description of the study and publishing the article in an academic or professional journal. The results of psychological studies can be seen in peer-reviewed journals such as  Psychological Bulletin , the  Journal of Social Psychology ,  Developmental Psychology , and many others.

The structure of a journal article follows a specified format that has been outlined by the  American Psychological Association (APA) . In these articles, researchers:

• Provide a brief history and background on previous research
• Present their hypothesis
• Identify who participated in the study and how they were selected
• Provide operational definitions for each variable
• Describe the measures and procedures that were used to collect data
• Explain how the information collected was analyzed
• Discuss what the results mean

Why is such a detailed record of a psychological study so important? By clearly explaining the steps and procedures used throughout the study, other researchers can then replicate the results. The editorial process employed by academic and professional journals ensures that each article that is submitted undergoes a thorough peer review, which helps ensure that the study is scientifically sound.

Once published, the study becomes another piece of the existing puzzle of our knowledge base on that topic.

Before you begin exploring the scientific method steps, here's a review of some key terms and definitions that you should be familiar with:

• Falsifiable : The variables can be measured so that if a hypothesis is false, it can be proven false
• Hypothesis : An educated guess about the possible relationship between two or more variables
• Variable : A factor or element that can change in observable and measurable ways
• Operational definition : A full description of exactly how variables are defined, how they will be manipulated, and how they will be measured

Uses for the Scientific Method

The  goals of psychological studies  are to describe, explain, predict and perhaps influence mental processes or behaviors. In order to do this, psychologists utilize the scientific method to conduct psychological research. The scientific method is a set of principles and procedures that are used by researchers to develop questions, collect data, and reach conclusions.

Goals of Scientific Research in Psychology

Researchers seek not only to describe behaviors and explain why these behaviors occur; they also strive to create research that can be used to predict and even change human behavior.

Psychologists and other social scientists regularly propose explanations for human behavior. On a more informal level, people make judgments about the intentions, motivations , and actions of others on a daily basis.

While the everyday judgments we make about human behavior are subjective and anecdotal, researchers use the scientific method to study psychology in an objective and systematic way. The results of these studies are often reported in popular media, which leads many to wonder just how or why researchers arrived at the conclusions they did.

Examples of the Scientific Method

Now that you're familiar with the scientific method steps, it's useful to see how each step could work with a real-life example.

Say, for instance, that researchers set out to discover what the relationship is between psychotherapy and anxiety .

• Step 1. Make an observation : The researchers choose to focus their study on adults ages 25 to 40 with generalized anxiety disorder.
• Step 2. Ask a question : The question they want to answer in their study is: Do weekly psychotherapy sessions reduce symptoms in adults ages 25 to 40 with generalized anxiety disorder?
• Step 3. Test your hypothesis : Researchers collect data on participants' anxiety symptoms . They work with therapists to create a consistent program that all participants undergo. Group 1 may attend therapy once per week, whereas group 2 does not attend therapy.
• Step 4. Examine the results : Participants record their symptoms and any changes over a period of three months. After this period, people in group 1 report significant improvements in their anxiety symptoms, whereas those in group 2 report no significant changes.
• Step 5. Report the results : Researchers write a report that includes their hypothesis, information on participants, variables, procedure, and conclusions drawn from the study. In this case, they say that "Weekly therapy sessions are shown to reduce anxiety symptoms in adults ages 25 to 40."

Of course, there are many details that go into planning and executing a study such as this. But this general outline gives you an idea of how an idea is formulated and tested, and how researchers arrive at results using the scientific method.

Erol A. How to conduct scientific research ? Noro Psikiyatr Ars . 2017;54(2):97-98. doi:10.5152/npa.2017.0120102

University of Minnesota. Psychologists use the scientific method to guide their research .

Shaughnessy, JJ, Zechmeister, EB, & Zechmeister, JS. Research Methods In Psychology . New York: McGraw Hill Education; 2015.

By Kendra Cherry, MSEd Kendra Cherry, MS, is a psychosocial rehabilitation specialist, psychology educator, and author of the "Everything Psychology Book."

Pay Your Deposit

Have you been admitted and need to lock in your decision? Click the link below to pay your deposit now!

Deposit Today

Exploring Research Methods in Psychology

Reviewed by Jacob Imm

Aug 11, 2023

Each day, more than 100,000 licensed psychologists in the United States work to unearth the mysteries of the human mind so that we may all better understand our behaviors and ourselves. A primary avenue to that understanding is psychological research.

Research allows psychologists the opportunity to ask questions about the innermost workings of the human psyche, interpret the responses they exhibit, and arrive at conclusions that enable them to improve people’s everyday lives. To do such important work efficiently and effectively, they rely on a range of research methods.

The research methods in psychology are commonly grouped into three primary classifications: correlational research, descriptive research, and experimental research. Each one is suited to a unique field of study, accounts for human complexities, and zeroes in on acute details of the brain’s inner workings. 

The Scientific Method in Psychology

Many of us learned about the scientific method—the process of developing, researching, and proving a hypothesis—early on in our education. And that’s because it is chiefly important to advancing scientific knowledge worldwide. 

Each of the three research methods in psychology is grounded in the scientific method. It allows psychology researchers to advance and improve existing notions of human psychology and build tools and strategies that help improve the lives of many. 

Psychologists rely on the standards of the scientific method to ensure: 

• Historical data and background research is collected before experimentation
• The initial research question is defined, testable, and measurable
• The hypothesis is grounded in data-backed, reasonable information 
• The experiment is designed to answer the specific question and hypothesis
• The final data can be organized into theories that help people and psychologists

Understanding Correlational Studies 

One of the research methods in psychology that is most commonly employed is the correlational method or correlational studies. This is a statistics-based, non-experimental method in which scientists seek to determine whether there is a relationship between two variables and the extent of the relationship, if it exists, without interfering with other variables. 

The correlational method leads to three possible outcomes :

• Positive correlation – The relationship between variables is considered positive when both variables move in the same direction at the same time. The variables may increase or decrease.
• Negative correlation – When the value of one variable increases as the other variable decreases, the correlation is considered negative.
• No correlation – An outcome of “no correlation” suggests that the study presented no observable relationship between the two variables. 

In many cases, the results of correlational studies are documented using what’s known as the correlation coefficient . This is a numerical value between -1.00 and +1.00 that indicates the strength of the correlation between variables. When there is no correlation between variables, the correlation coefficient is assigned a value of zero. 

Correlational research methods in psychology are often used as a baseline of understanding to gain further insight into human behavior. Many researchers start with broad correlational studies to gather information and draw connections. Then, they build upon those connections with more specific studies, as correlational studies alone do not prove causation in either direction. 

Types of Correlational Studies 

There are three distinct research methods that are often used in the service of correlational studies. 

Naturalistic Observation

Naturalistic observation involves passive observational research and documentation of the variables in their natural setting. Scientists exert no influence over the variables and don’t manipulate them in any way, which provides insight into how the variables act without intervention. 

However, there are factors that researchers must watch out for in this method, like: 

• Behavior modification by participants who are aware of being observed 
• Potential biases of the researchers involved 

Under the survey method, a random sample of participants is selected to fill out a poll, answer a questionnaire, or complete a test that reflects the subject of the study. 

Surveys are among the most common types of research methods in psychology, prized for their easy, quick, and relatively inexpensive accessibility and their ability to collect large amounts of data. Depending on the study, survey research may be conducted in person, over the phone, or online.

Regardless of the medium, however, the most effective surveys share the following characteristics: 

• A randomized group of participants 
• Clear, well-written questions
• Intuitive design and delivery   

Archival Research

When performing archival research, scientists look at a range of materials, including historical records, past studies, and case study reports related to their own research. In doing so, psychologists must understand how to interpret studies that may not adhere to the ethical standards of the present day. 

Often, psychologists must navigate studies that are incomplete or irrelevant based on modern information.

Understanding Descriptive Studies

Descriptive studies are unique among research methods in psychology because, rather than focusing on questions of why and how, they tune into questions of who, what, and where.  

In other words, descriptive studies seek to describe certain human behaviors or psychological traits and patterns without drawing conclusions about their causes. 

Descriptive studies are often conducted without a hypothesis. Instead, like some correlation studies, the results of descriptive studies often lead researchers to form a hypothesis that inspires an additional study, such as an experimental study.

Types of Descriptive Studies 

Descriptive studies may take the form of surveys, observations, or case studies.  

In studies that rely on observations or surveys, the procedures are much the same as in correlational studies. For example, observational descriptive methods in psychology strive to observe participants in their natural setting without influencing any of the variables or introducing new variables. 

Likewise, survey research methods in descriptive research use a list of randomized respondents who are interviewed or asked to respond to a series of questions in writing. 

Case Studies 

In a case study, a researcher provides a description of a subject in a certain setting over a given period of time. The details of the description may be gleaned from observation, subject interviews, and the subject’s own reports.

Case studies also require a natural setting free from researcher interference. However, unlike surveys and observation, case studies are often centralized on single subject research–a single person, small groups of subjects, or singular events.

Consider these benefits and drawbacks of case studies: 

• Glean more detailed information – Case studies in descriptive research enable psychologists to present highly detailed information about very specific subjects.      
• May not apply to a larger, general population – That small sample size often makes it difficult for researchers to generalize too greatly about their findings, which can limit the applicability of the results to large groups of people. 

See related: The Benefits of Studying Psychology

Understanding Experimental Design Studies 

The last of the three main types of research methods in psychology is the experimental method. Unlike descriptive and correlational methods, the experimental method intentionally interferes with the test subjects, making adjustments to at least one variable to determine a casual relationship with another variable.

In general, experimental research methods in psychology are conducted according to the following procedure : 

• Step 1 – Researchers define the study’s key variables, known as the “dependent variable” (which isn’t manipulated) and the “independent variable” (which is manipulated). 
• Step 2 – Researchers hypothesize the relationship between the dependent variable and the independent variable (or variables). 
• Step 3 – Researchers manipulate the relevant variable and observe the results, collecting and documenting data. 

There are several planning stages that an experimental study goes through before it’s formally conducted. In addition to defining variables and forming a hypothesis, researchers must also devise a research protocol, including how they will manipulate the independent variable and which type of experimental design they’ll use. 

Types of Experimental Design Studies 

Within the experimental design, psychologists tend to employ three primary research methods at their disposal. Those include: 

• Independent measures – Also known as “between groups,” independent measures call for a different participant or set of participants for each variable condition.
• Repeated measures – Also known as “within groups,” this type of experimental design features participants who are exposed to each of the study’s variable conditions. 
• Counterbalanced – In counterbalanced designs, all participants experience each variable condition, but they experience them in different orders. This is to account for order effects, or the idea that the order in which variable conditions are experienced potentially impacts subject behavior. 

Hone Your Research Skills with Hands-On Psychology Education

If research methods in psychology turn your wheels and appeal to your innate curiosity, research psychology could be an excellent professional field for you. Every psychology researcher starts as a student in a degree program to acquaint them with the knowledge, skills, and research practice they need to break through to new understanding. 

For aspiring research psychologists, the best programs offer coursework in ethics in psychology, research design and experimentation, plus a range of experiences that take you beyond the classroom, like internships and co-ops. That’s the kind of real-world experience that shapes the formative research psychologists of the future. 

Jacob Imm is the associate director of communication in the North Central College Office of Institutional Communication. He has 13 years of collegiate communications experience and has worked with hundreds of college students. He has a bachelor’s degree from the University of Notre Dame and a master’s degree from Northern Illinois University.

American Psychological Association. (n.d.). Apa Dictionary of Psychology . American Psychological Association. Retrieved May 5, 2023, from https://dictionary.apa.org/correlational-research  

Mcleod, S. (2023, April 20). Correlation definitions, examples & interpretation . Simply Psychology. Retrieved May 5, 2023, from https://www.simplypsychology.org/correlation.html  

Mcleod, S. (2023, March 7). Observation methods: Naturalistic, participant and controlled . Simply Psychology. Retrieved May 5, 2023, from https://www.simplypsychology.org/observation.html  

Ponto, J. (2015). Understanding and evaluating survey research . Journal of the advanced practitioner in oncology. Retrieved May 5, 2023, from https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4601897/  

American Psychological Association. (n.d.). Apa Dictionary of Psychology . American Psychological Association. Retrieved May 5, 2023, from https://dictionary.apa.org/archival-research  

Mcleod, S. (2023, March 30). Case study research method in psychology . Simply Psychology. Retrieved May 5, 2023, from https://www.simplypsychology.org/case-study.html

Moore, L. (2022, May 6). The 3 Descriptive Research Methods of Psychology . Psych Central. Retrieved May 5, 2023, from https://psychcentral.com/health/types-of-descriptive-research-methods  

Mcleod, S. (2023, March 7). Experimental design: Types, examples & methods . Simply Psychology. Retrieved May 5, 2023, from https://www.simplypsychology.org/experimental-designs.html  

Simkus, J. (2023, March 8). What are the steps in the scientific method? Simply Psychology. Retrieved May 8, 2023, from https://www.simplypsychology.org/steps-of-the-scientific-method.html

More North Central News & Stories

• school Campus Bookshelves
• menu_book Bookshelves
• perm_media Learning Objects
• login Login
• how_to_reg Request Instructor Account
• hub Instructor Commons
• Download Page (PDF)
• Download Full Book (PDF)
• Periodic Table
• Physics Constants
• Scientific Calculator
• Reference & Cite
• Tools expand_more
• Readability

selected template will load here

This action is not available.

1.5: Research Methods in Psychopathology

• Last updated
• Save as PDF
• Page ID 161403

• Alexis Bridley and Lee W. Daffin Jr.
• Washington State University

Learning Objectives

• Define the scientific method.
• Outline and describe the steps of the scientific method, defining all key terms.
• Identify and clarify the importance of the three cardinal features of science.
• List the five main research methods used in psychology.
• Describe observational research, listing its advantages and disadvantages.
• Describe case study research, listing its advantages and disadvantages.
• Describe survey research, listing its advantages and disadvantages.
• Describe correlational research, listing its advantages and disadvantages.
• Describe experimental research, listing its advantages and disadvantages.
• State the utility and need for multimethod research.

The Scientific Method

Psychology is the “scientific study of behavior and mental processes.” We will spend quite a lot of time on the behavior and mental processes part throughout this book and in relation to mental disorders. Still, before we proceed, it is prudent to further elaborate on what makes psychology scientific. It is safe to say that most people outside of our discipline or a sister science would be surprised to learn that psychology utilizes the scientific method at all. That may be even truer of clinical psychology, especially in light of the plethora of self-help books found at any bookstore. But yes, the treatment methods used by mental health professionals are based on empirical research and the scientific method.

As a starting point, we should expand on what the scientific method is.

The keyword here is systematic , meaning there is a set way to use it. What is that way? Well, depending on what source you look at, it can include a varying number of steps. I like to use the following:

Science has at its root three cardinal features that we will see play out time and time again throughout this book. They are:

• Observation – To know about the world around us, we have to be able to see it firsthand. When a mental disorder afflicts an individual, we can see it through their overt behavior. An individual with depression may withdraw from activities he/she enjoys, those with social anxiety disorder will avoid social situations, people with schizophrenia may express concern over being watched by the government, and individuals with dependent personality disorder may leave major decisions to trusted companions. In these examples and numerous others, the behaviors that lead us to a diagnosis of a specific disorder can easily be observed by the clinician, the patient, and/or family and friends.
• Experimentation – To be able to make causal or cause and effect statements, we must isolate variables. We must manipulate one variable and see the effect of doing so on another variable. Let’s say we want to know if a new treatment for bipolar disorder is as effective as existing treatments, or more importantly, better. We could design a study with three groups of bipolar patients. One group would receive no treatment and serve as a control group. A second group would receive an existing and proven treatment and would also be considered a control group. Finally, the third group would receive the new treatment and be the experimental group. What we are manipulating is what treatment the groups get – no treatment, the older treatment, and the newer treatment. The first two groups serve as controls since we already know what to expect from their results. There should be no change in bipolar disorder symptoms in the no-treatment group, a general reduction in symptoms for the older treatment group, and the same or better performance for the newer treatment group. As long as patients in the newer treatment group do not perform worse than their older treatment counterparts, we can say the new drug is a success. You might wonder why we would get excited about the performance of the new drug being the same as the old drug. Does it really offer any added benefit? In terms of a reduction of symptoms, maybe not, but it could cost less money than the older drug and that would be of value to patients.
• Measurement – How do we know that the new drug has worked? Simply, we can measure the person’s bipolar disorder symptoms before any treatment was implemented, and then again once the treatment has run its course. This pre-post test design is typical in drug studies.

Research Methods

Step 3 called on the scientist to test his or her hypothesis. Psychology as a discipline uses five main research designs. They are:

1.5.2.1. Naturalistic and laboratory observation . In terms of naturalistic observation , the scientist studies human or animal behavior in its natural environment, which could include the home, school, or a forest. The researcher counts, measures, and rates behavior in a systematic way and, at times, uses multiple judges to ensure accuracy in how the behavior is being measured. The advantage of this method is that you see behavior as it happens, and the experimenter does not taint the data. The disadvantage is that it could take a long time for the behavior to occur, and if the researcher is detected, then this may influence the behavior of those being observed.

Laboratory observation involves observing people or animals in a laboratory setting. The researcher might want to know more about parent-child interactions, and so, brings a mother and her child into the lab to engage in preplanned tasks such as playing with toys, eating a meal, or the mother leaving the room for a short time. The advantage of this method over the naturalistic method is that the experimenter can use sophisticated equipment to record the session and examine it later. The problem is that since the subjects know the experimenter is watching them, their behavior could become artificial. Clinical observation is a commonly employed research method to study psychopathology; we will talk about it more throughout this book.

1.5.2.2. Case studies. Psychology can also utilize a detailed description of one person or a small group based on careful observation. This was the approach the founder of psychoanalysis, Sigmund Freud, took to develop his theories. The advantage of this method is that you arrive at a detailed description of the investigated behavior, but the disadvantage is that the findings may be unrepresentative of the larger population, and thus, lacking generalizability . Again, bear in mind that you are studying one person or a tiny group. Can you possibly make conclusions about all people from just one person, or even five or ten? The other issue is that the case study is subject to researcher bias in terms of what is included in the final narrative and what is left out. Despite these limitations, case studies can lead us to novel ideas about the cause of abnormal behavior and help us to study unusual conditions that occur too infrequently to analyze with large sample sizes and in a systematic way.

1.5.2.3. Surveys/Self-Report data. This is a questionnaire consisting of at least one scale with some questions used to assess a psychological construct of interest such as parenting style, depression, locus of control, or sensation-seeking behavior. It may be administered by paper and pencil or computer. Surveys allow for the collection of large amounts of data quickly, but the actual survey could be tedious for the participant and social desirability , when a participant answers questions dishonestly so that they are seen in a more favorable light, could be an issue. For instance, if you are asking high school students about their sexual activity, they may not give genuine answers for fear that their parents will find out. You could alternatively gather this information via an interview in a structured or unstructured fashion.

1.5.2.4. Correlational research. This research method examines the relationship between two variables or two groups of variables. A numerical measure of the strength of this relationship is derived, called the correlation coefficient . It can range from -1.00, a perfect inverse relationship in which one variable goes up as the other goes down, to 0 indicating no relationship at all, to +1.00 or a perfect relationship in which as one variable goes up or down so does the other. In terms of a negative correlation, we might say that as a parent becomes more rigid, controlling, and cold, the attachment of the child to parent goes down. In contrast, as a parent becomes warmer, more loving, and provides structure, the child becomes more attached. The advantage of correlational research is that you can correlate anything. The disadvantage is that you can correlate anything, including variables that do not have any relationship with one another. Yes, this is both an advantage and a disadvantage. For instance, we might correlate instances of making peanut butter and jelly sandwiches with someone we are attracted to sitting near us at lunch. Are the two related? Not likely, unless you make a really good PB&J, but then the person is probably only interested in you for food and not companionship. The main issue here is that correlation does not allow you to make a causal statement.

A special form of correlational research is the epidemiological study in which the prevalence and incidence of a disorder in a specific population are measured (See Section 1.2 for definitions).

1.5.2.5. Experiments. This is a controlled test of a hypothesis in which a researcher manipulates one variable and measures its effect on another variable. The manipulated variable is called the independent variable (IV) , and the one that is measured is called the dependent variable (DV) . In the example under Experimentation in Section 1.5.1, the treatment for bipolar disorder was the IV, while the actual intensity or number of symptoms serve as the DV. A common feature of experiments is a control group that does not receive the treatment or is not manipulated and an experimental group that does receive the treatment or manipulation. If the experiment includes random assignment , participants have an equal chance of being placed in the control or experimental group. The control group allows the researcher (or teacher) to make a comparison to the experimental group and make a causal statement possible, and stronger. In our experiment, the new treatment should show a marked reduction in the intensity of bipolar symptoms compared to the group receiving no treatment, and perform either at the same level as, or better than, the older treatment. This would be the initial hypothesis made before starting the experiment.

In a drug study, to ensure the participants’ expectations do not affect the final results by giving the researcher what he/she is looking for (in our example, symptoms improve whether the participant is receiving treatment or not), we might use what is called a placebo , or a sugar pill made to look exactly like the pill given to the experimental group. This way, participants all are given something, but cannot figure out what exactly it is. You might say this keeps them honest and allows the results to speak for themselves.

Finally, the study of mental illness does not always afford us a large sample of participants to study, so we have to focus on one individual using a single-subject experimental design . This differs from a case study in the sheer number of strategies available to reduce potential confounding variables , or variables not originally part of the research design but contribute to the results in a meaningful way. One type of single-subject experimental design is the reversal or ABAB design . Kuttler, Myles, and Carson (1998) used social stories to reduce tantrum behavior in two social environments in a 12-year old student diagnosed with autism, Fragile-X syndrome, and intermittent explosive disorder. Using an ABAB design, they found that precursors to tantrum behavior decreased when the social stories were available (B) and increased when the intervention was withdrawn (A). A more recent study (Balakrishnan & Alias, 2017) also established the utility of social stories as a social learning tool for children with autism spectrum disorder (ASD) using an ABAB design. During the baseline phase (A), the four student participants were observed, and data recorded on an observation form. During the treatment phase (B), they listened to the social story and data was recorded in the same manner. Upon completion of the first B, the students returned to A, which was followed one more time by B and the reading of the social story. Once the second treatment phase ended, the participation was monitored again to obtain the outcome. All students showed improvement during the treatment phases in terms of the number of positive peer interactions, but the number of interactions reduced in the absence of social stories. From this, the researchers concluded that the social story led to the increase in positive peer interactions of children with ASD.

1.5.2.6. Multi-method research. As you have seen above, no single method alone is perfect. All have strengths and limitations. As such, for the psychologist to provide the most precise picture of what is affecting behavior or mental processes, several of these approaches are typically employed at different stages of the research study. This is called multi-method research.

Key Takeaways

You should have learned the following in this section:

• The scientific method is a systematic method for gathering knowledge about the world around us.
• A systematic explanation of a phenomenon is a theory and our specific, testable prediction is the hypothesis .
• Replication is when we repeat the study to confirm its results.
• Psychology’s five main research designs are observation, case studies, surveys, correlation, and experimentation.
• No single research method alone is perfect – all have strengths and limitations.

Review Questions

• What is the scientific method and what steps make it up?
• Differentiate theory and hypothesis.
• What are the three cardinal features of science and how do they relate to the study of mental disorders?
• What are the five main research designs used by psychologists? Define each and then state its strengths and limitations.
• What is the advantage of multi-method research?

Psychology Discussion

Top 5 methods used in psychology | methods | psychology.

ADVERTISEMENTS:

Some of the methods are: 1. Observation Method 2. Experimental Method or Experimental Observation 3. Psychological Experiment 4. Variables – Independent – Dependent and Intervening 5. Control 6. The Case Method 7. Survey Method.

Method # 1. Observation Method:

The basic method of psychology, as is the case with any science, is observation. Early psychologists tried to study and explain behaviour by just observing the behaviour and activities of organisms. On the basis of their observation, they tried to find explanations.

This type of observation is called natural observation or non-controlled observation. This term means that the observation was made in natural settings, as and when the behaviour occurred. On the basis of repeated observations, the psychologists attempted to formulate general laws and principles.

An outstanding example of laws based on such natural observations is the laws of association formulated by Locke, Berkeley, Brown and other British philosophers. At a still deeper level philosophers tried to combine observation with logic and tried to develop psychological theories. Natural observation was employed for a long time for psychological study.

This method had its advantages as well as disadvantages. Some of the advantages are as follows:

(a) It is easy to collect data and no special arrangements or gadgets are necessary.

(b) By observing behaviour in natural situations, we are really observing behaviour in life situations.

If the aim of psychology is to understand and predict behaviour in real life situations then the natural thing to do will be to study behaviour in life situations. Whereas in the case of physics or chemistry, observations made in a laboratory can hold good even outside, the same cannot be said about behaviour. Life situations are different from laboratory situations. Hence natural observation would be more ideal and meaningful.

However, there are also some very serious disadvantages and difficulties in employing the method of natural observations. Some of these are as follows:

(a) It is not possible to observe all types of behaviour in a natural setting. Some aspects of behaviour are implicit and are not open to observation. Feelings and other internal processes cannot be observed.

(b) It is difficult to convert data from natural observation into quantitative terms.

(c) Different observers observing the same behaviour may conclude differently.

For example, if one finds a friend in a not very communicative mood, one may conclude that he is angry. But another person meeting him may conclude that he is sad. Thus, the same behaviour on the part of an individual may convey different meanings to different observers.

(d) Many instances of behaviour do not repeat themselves. An important requisite of scientific observation is repeatability. This is often impossible in natural observation. Thus, if the psychologist is interested in studying how people react when a close relative is involved in an accident, it is obvious that he cannot either expect or even wish for many such instances. Thus, one may see that the method of natural observation imposes severe limitations. It involves a lot of time and effort. Imagine a chemist who wants to study the effect of heat on some chemical and cannot wait for the solar heat to increase to 600° C.

The best thing for him to do would be to take the chemical into a laboratory, heat it and watch the changes. So natural observation has its limitations and psychology like other sciences has also turned to what is called experimental observation or the experimental method.

Method # 2. Experimental Method or Experimental Observation :

As indicated just above, an experiment is a procedure by which certain conditions, events etc. which occur in nature are artificially created and reproduced in the laboratory. The chemist who studies the effect of heat on a chemical in the laboratory, is actually creating and reproducing a phenomenon that can be expected to occur in nature under certain circumstances.

In fact, this is called simulation. Once the psychologists accepted the idea of experimentation then it became possible to create in the laboratory different types of conditions that can produce or simulate any type of behaviour the psychologist may desire to study. In short, the experimental method involves the creation of certain stimulating conditions or the presentation of certain stimuli that would evoke or produce a certain response.

The experimental psychologist, therefore, essentially produces certain stimuli and studies the reaction or response. Through repeated observations on a number of people, he arrives at certain generalisations about the relationships or the connections between stimuli and responses.

Let us take an example. A psychologist wants to study how people react if they hear a very loud noise. The experimental procedure is very simple. He invites some of his friends and other volunteers to his room or his laboratory and arranges to produce a very loud noise without the people being aware of it. Then he observes the behaviour and finds that most of his friends jump from their chairs, a few of them actually fall down, but one or two are relatively undisturbed.

Then he tries to find out why one or two were undisturbed. He comes to know that these two friends had served in the army and were used to loud explosions. He now comes to two conclusions.

First, in general people get disturbed when they hear a very loud noise suddenly.

Second, people who were earlier used to hearing loud noises are not disturbed much. This actually takes us to a second important feature of the experimental method. The psychologist now conducts the experiment a second time. This time he takes the background of all his volunteers and asks them for their previous experience; whether they have served in the army or whether they were used to loud noises.

He excludes those who reported familiarity with loud noise. His experiments show that all his friends are disturbed but one or two of them very significantly. He enquires of them why they were disturbed so much. The answer comes that they were afraid not only of the loud noise but also because of the fact that the room was closed.

He now conducts a third experiment keeping half of the friends in a closed room and the other half in an open room. His experiments show people in the closed room were disturbed much more than the others. Now, what has the experiment shown? It has shown that the disturbance which occurs is caused by not only a loud noise but also by the closed room.

Now compare this with natural observation. The experimenter psychologist goes on varying the conditions of his observation. He can change the people he observes. He can change the nature of stimulus. He can also change the conditions of the experiments. Obviously, such things cannot be done if we depend only on natural observation.

For example, a teacher finds that four of his good students appear very sad after an examination. He may conclude that these four students are disappointed with their performance in their examination. But on enquiring he may find that the two of them are sad because they had lost some money while travelling by the bus and one of them is sad because somebody in his home had fallen ill.

In view of this, perhaps, they did not do as well in the examinations as they were capable of. But it is difficult to say how much of their sadness is due to the examination and how much due to the other factors. This possibility of changing the various aspects of the observation gives a distinct advantage to the experimental method.

This is called establishment of control. The term control means taking all necessary steps to see that conditions and factors which affect the relationship between stimuli and responses are isolated, eliminated or neutralized. It is characteristic of human behaviour that at any time the organism is exposed to a variety of stimuli and not a single stimulus. In view of this, controls are very important in experimental psychology.

Over the years experimental psychologists have developed very fine techniques and methods of establishing control in their experiments. They can manipulate the people who are being subjected to the experiments or the conditions of the experiment or the stimuli themselves. Very often control involves the changing or manipulation of all these.

The experimental method has another advantage, in that observations can be made much more accurate. The degree of disturbance can be measured in terms of heartbeat, blood pressure, etc. Suitable gadgets or measuring instruments can be made use of to arrive at a precise and accurate observation of the levels of disturbance. This is not possible in natural observation.

In the early stages, experiments in psychology were very simple and not sophisticated. Many of the gadgets and instruments available today were not available then. In view of this, early experimental psychologists depended on what is called introspection.

After producing a stimulus, they would ask the subject or the person to report or state all the psychological changes, events and experiences occurring in them. This method was known as introspection. The term introspection means looking within. Actually it was the subject who made the observations and reported the same to the experimenter.

But the method of introspection soon came in for criticism on the following grounds:

(a) The subject may not be able to observe all the experiences.

(b) They may not be able to report or express correctly all their experiences.

(c) The same experience may be reported differently by different people.

(d) Comparison and quantification of different experiences would be erroneous.

In view of these objections, the method of introspection gradually fell out of favour. The psychologist began to develop different types of apparatus and psychological tests for observation and measurement. Some of these are mechanical and electrical gadgets while many of them are paper and pencil tests or requiring the subject to carry out some specific tasks.

One may go on at length about the experimental method but this is neither possible nor necessary here. It is sufficient to say that in the past hundred years or so psychologists have developed the experimental method to a very high degree of perfection comparable to experiments in other sciences.

However, the experimental method also has its disadvantages. Firstly, no matter how much the methods of experimentation may improve, there are still certain aspects of behaviour or categories of behaviour which cannot be studied experimentally. Secondly, generalization and prediction made from laboratory experiments may not be very true in real life situations.

It is not possible to control all the conditions of life in laboratory conditions. Thirdly, the experimental method involves the use of gadgets, apparatus and unnatural elements which may themselves vitiate the control in an experiment. Finally, it is impossible to study complex behaviour in an experimental situation.

These limitations notwithstanding, experimental psychology has made tremendous advances and contributed a lot to the development of psychology. Generalisations and predictions based on experiments have been found to be very reasonably accurate and true. In recent years, psychologists have developed the experimental method to include the study of not only individuals but of whole groups; not only of normal people but also of abnormal people.

Experiments in psychology often appear to be simple, but this is not so. Psychological experiments call for a lot of thinking, planning and preparation. The different aspects of the experiment like the stimuli, the subjects and the conditions in the laboratory have to be designed and selected very carefully.

Measurements have to be accurate. In spite of these the psychologist should be aware that his prediction and generalization may not always be found to occur in non-laboratory situations. This gap between the findings of the experiment and actual life behaviour can be bridged only by conducting more and more experiments, identifying the reasons for the gap and the failure of the prediction.

Thus, we can say, no experiment in psychology can be said to be complete at any time. There is always a scope, and more than that, a need to go on extending the experiment. This, perhaps, is peculiar to psychology unlike other sciences. To overcome some of these difficulties, psychologists have resorted to non-laboratory experiments like field experiments.

Participant Observation:

Another form of the observation method employed by psychologists is known as participant observation. The method was adopted by psychologists from anthropology. Anthropologists who were interested in studying the customs and practices of different societies very often went and lived as members of these communities adopting the ways and customs of the people whom they were studying.

This method gave them the advantage of being able to understand very intimately the practices. They were able to appreciate the meaning of different aspects in the total context of life. Encouraged by the success of the anthropologists, psychologists also began to adopt this method. This method is today extensively used in psychology.

Psychologists who are interested in the study of groups like committees, work-groups, etc., very often become actual members of such groups, participate in their activities and at the same time make scientific observations. This method has been found to be very useful and helpful. Very often participant observation is employed to validate the findings and interpretations arrived at through other methods.

Method # 3. Psychological Experiment :

Most laypersons and perhaps even beginners in psychology often wonder what a psychological experiment can be like; they are even baffled that the psychologist claims to be an experimental scientist.

Comparing a Psychological Experiment with an Experiment in Chemistry or Physics:

Let us take, for example, a student in a chemistry laboratory who comes across some solid substance. He wants to know what happens if this substance is heated.

He puts some of the powdered bits in a crucible and heats it. After some time the solid disappears and becomes a liquid. On further heating it becomes gaseous, and begins to give a smell. Here, the student finds that the property (behaviour) of the substance changes when heated.

He then proceeds to repeat the experiment to find out at what temperature the solid becomes a liquid and the liquid becomes a gas. Proceeding further he tries to compare the colour, smell, and even other chemical properties and studies how they change. Let us now compare a psychological experiment with this. In the place of the solid substance of the chemist, the psychologist tries to study a human organism.

This organism is the subject. The chemist applies heat. The psychologist also applies some type of force, or changes the state of existence of the organism. This is called the stimulus variable. The chemist observes the change in colour and other properties.

The psychologist studies the changes in appearance, action, emotion, feeling etc. These are the responses. Now, just as the chemist wants to determine the exact temperature of melting, the psychologist also tries to determine the exact stimulating conditions that produce specific changes in response.

The analogy looks simple and neat. In actuality, however, there are certain differences which complicate a psychological experiment. Some of these are:

1. The human organism responds to a number of stimuli at the same time. In the case of the chemical, all other conditions except temperature can be held constant. This is not possible in the case of the human organism, who without the knowledge of this experimenter and perhaps without his own knowledge may be responding to certain stimuli.

The changes in behaviour may be produced by these stimuli and not the one studied by the investigator. Secondly, the human organism responds not only to stimuli from outside but also to forces from inside (like the needs of the organism).

2. Similarly all the responses of the human organism cannot be seen from outside. Some of the changes may be internal. Hence, special observational techniques are necessary.

3. In the case of the chemical, if you take different pieces they are alike and react in the same way. But this is not the case with human beings. Individuals differ from each other in responding to the same stimuli. A delicate college girl may swoon at the sight of blood, but another girl, a nurse of the same age, will not.

These differences make the psychological experiment more complicated and this will become clearer as we proceed. Presently it may be useful to consider some of the terms common to the experimental method in general and psychological experiments in particular.

Method # 4. Variables – Independent – Dependent and Intervening :

The term ‘variable’ means that which can be varied or changed or that which changes or varies itself. Let us go back again to the chemistry student with his experiment. Here, when heat is applied, the nature, colour and properties of the material change. The stimulus is changed and the responses change. The former represents one type and the latter another type of variable.

The first variable can be changed by the experimenter at will and is deliberately and systematically varied to find out how this is accompanied by changes in the second set of variables. Thus, the variation of the one is known and the other unknown. But the variation in the second variable is known to follow changes in the first variable. However, there is no such definite relationship in the reverse direction.

We now go to define the two types of variables Independent and Dependent. The Independent Variable is the one which is systematically and independently varied by the experimenter while the Dependent Variable is the change he expects to occur as a result of the changes he has produced in the Independent Variable. An example may make this clearer.

Let us imagine that a psychologist wants to study experimentally the effect of sleeplessness on accuracy of hearing. He may proceed to conduct the experiment as follows. He takes a group of subjects. He makes a series of sounds from very low intensity to high intensity. Then he makes a note of the lowest sound which this subject is able to hear. After this he keeps the subject busy not allowing them to sleep.

After an hour he again makes a note of the lowest audible sound. The procedure is repeated at the end of 2 hours, 4 hours etc. After a number of trials, he finds that with increasing sleep-deprivation the intensity of the lowest audible sound increases. In this experiment, the amount of sleep-deprivation is the Independent Variable and the ability to hear is the Dependent Variable.

In any experiment, it is not necessary that there should be only one Independent Variable and one Dependent Variable. For example, if the same psychologist, in addition, wants to know not only the effect of sleep-deprivation but also the effect of age, he can take two subjects, one being a young subject and the other being an old subject. Here, age will be the second Independent Variable.

Again, in addition to accuracy of hearing he may study accuracy of vision also. In certain experiments the number of variables may be very large. Such experiments are called multivariate experiments. Where there is only one independent variable and dependent variable, it is called a Uni-variate Experiment.

Sometimes one may come across a third term Intervening Variable. Intervening variables are in fact, a type of independent variables. But they differ, in that they are not deliberately introduced or varied by the experimenter. But nonetheless, on observing the results, they are also found to have influenced the responses of the dependent variables.

Their effect may be in the same direction as that of the main independent variables or in another direction. In the experiment on sleep-deprivation, let us suppose the subjects do not show any fall in auditory acuity. On enquiry the experimenter finds that these people have taken a cup of coffee, or they were listening to the music playing in the next room or that they are used to sleep-deprivation being night shift workers.

Now, these factors or variables have intervened between the independent variable and the dependent variable and altered the relationship between the two. In most instances, these intervening variables are purely internal or subjective in nature like feelings, needs, practice etc. In any experiment care must be taken to eliminate the operation of these intervening variables. This aspect is called establishing control and is discussed below.

Method # 5. Control :

A chemist before he arrives at a conclusion about the property of a chemical repeats the observation a number of times. The psychologist also has to do the same. He has to make repeated observations on the same individual and also on different individuals before arriving at a conclusion.

Here the chemist is at an advantage. Fortunately for him all samples of the same substance drawn from the same source are to a very large extent similar. But this is not true of human beings who differ very much from each other. So, as far as possible, the psychologist also has to select people who do not differ from each other much. Otherwise, the results of his experiment may not be as expected.

In the experiment on the effect of sleep-deprivation, for the two subjects – one who was active throughout the day and straightaway comes to the laboratory to serve as a subject at 8.30 p.m. and the other who was sleeping till 8 p.m. and comes to the laboratory at 8.30 p.m. – the results will be different.

Here it becomes necessary for the experimenter to ensure that both the subjects have been spending the day in more or less the same way before he starts the experiment. Thus ensuring of homogeneity becomes necessary for all psychological experiments. This is one type of control, which the experimenter has to establish viz., homogeneity in the subjects. He has to select the subjects carefully.

Yet another type of control also becomes necessary in psychological experiments. The human subject differs from the chemical substance in another way. When a chemical is being heated, it is affected by the heat. The chemist can see to it that no other factor affects it.

He can have a control over the atmospheric pressure and other forces which might affect the substance. But with the human being this is not the case. At the same time he is influenced by a number of factors. In the experiment on sleep-deprivation it is possible that some subjects may become hungry also and the fall in accuracy of perception may be due to this.

Again, some people may feel the deprivation less if they are given some interesting games or reading material. All these factors are bound to affect the results of the experiment. Hence, the experimenter has to maintain these experimental conditions uniform. He has to see to it that no independent variable other than the one chosen (e.g.. sleep-deprivation) is at work.

In addition, he has also to ensure that experimental conditions are uniform. Thus, here also controls have to be exercised. This is very important. It is here that most psychological experiments face difficulty. As a result, several methods of establishing controls have been arrived at. These methods are devices to establish maximum possible control to prevent irrelevant variables vitiating the results and to ensure homogeneity of the subjects experimented upon.

Experimental and Control Groups:

The psychologist uses groups of subjects. This is necessary for the reason, viz. the need in any scientific experiment to make repeated observation. These repeated observations can be made in two ways, one method is by carrying out the experiment on the same individual many times.

This may not be possible for many reasons:

First, the same individual may not be available or willing to take part in the experiment on many occasions.

The second and more serious is in the nature of psychological experiments themselves. Most psychological experiments require the subject to do something. If he does it once, he learns it and his performance in the subsequent experiments will be affected by this practice. This is not the case with the chemical or physical objects employed by other scientists.

Thirdly, the human beings differ from each other unlike the different samples of a substance studied by the chemist.

Hence, to make a study of some behaviour, we must include different types of human subjects and therefore psychological experiments almost always involve groups of subjects. It is also possible that the individual develops certain habitual ways of responding and perhaps is also able to expect or anticipate experimental stimuli. These result in errors of habituation and anticipation.

In a typical psychological experiment we have two types of groups. There may be only one group in some experiments and more than two in others; the two groups are called ‘Control group’ and ‘Experimental group’. Now both these groups are matched in all respects excepting the independent variables which are proposed to be studied in the particular experiment.

Let us now discuss the experiment on the effect of sleep-deprivation on auditory acuity. The experimenter could take the same group and study the auditory acuity after different degrees of sleep-deprivation.

Now if the experimenter finds it difficult to study the same group of subjects on repeated occasions, he can as well start the experiment, with two or three groups; one group with no deprivation, a second group with one hour deprivation, a third group, with two hours deprivation etc. Here you will find that in the first group, the independent variable, namely ‘sleep-deprivation’ does not operate. It is controlled.

Hence this is a ‘control group’. In the other two groups the experimental independent variable has been introduced. So, these are then called experimental groups. An experimental group is that in which some independent variable is introduced or altered for the purpose of the experiment.

It must be pointed out, however, that the alteration or introduction of the experimental variables need not always be of an artificial type. If, for example, a psychologist wants to study the amount of self-confidence in children with fathers and children without fathers, he selects a group of children whose fathers are alive and another group whose fathers are not alive.

Here the independent variable is the presence or absence of the father. But both the control and experimental groups are available in nature. In some experiments there can be more than one experimental group. In the experiment quoted above the psychologist may study father absent and mother present children, father present and mother absent, both absent etc. Here there can be many experimental groups.

It must be borne in mind however, that great care must be exercised in selecting the two groups. The two groups must be matched to make them similar in all relevant variables except the specific independent variables under experimentation. The relevant variables on which matching has to be done vary from experiment to experiment.

In experiments where only one group is used for entire experiment, the same group is put under varying conditions, e.g. no sleep-deprivation, one hour’s deprivation etc. The independent variable is varied instead of experimental and control groups. Here we have Experimental Conditions and Control Conditions.

In the latter no variation of the independent variable is introduced while in the former, the projected variations in conditions are introduced. Here also care must be taken to keep other factors, like subjects’ moods, physiological conditions etc., similar under both the conditions.

Hypothesis:

We will discuss the term which is very frequently used in experimental psychology. The main aim in any experiment is to study the effect of some stimulus or condition on some response or behaviour. That is, an attempt is made to study the relationship between an Independent Variable and a Dependent Variable.

Now taking the experiment on sleep-deprivation and auditory acuity, an experimenter can proceed in two ways. He can start without any preconceived idea, go on experimenting with different individuals and, based on the findings, come to the conclusion that sleep-deprivation lowers auditory acuity.

On the other hand, if he already knows something about the physiological aspects of sleep, and also the physiology and psychology of hearing he can start the experiment in another way. From the knowledge of sleep physiology and psychology, he can conclude that sleep-deprivation produces fatigue. From the knowledge of psychology of hearing he knows that auditory acuity depends on a healthy body and mind.

Putting the two together he can have some idea of the relationship between sleep-deprivation and auditory acuity, i.e. sleep-deprivation brings down auditory acuity. Now he can start his experiment with this preliminary idea, and proceed to confirm or reject his preliminary idea.

Most psychological experiments start with such hypothesis. The practice of starting an experiment with a hypothesis has some advantage. It helps the experimenter to be more definite about the specific Dependent Variables he has to study, so that he can measure them more accurately.

Also, if his results are not in the expected direction, it is easy for him to know whether it is due to some defects in the experiment or due to the real nature of the phenomenon. The latter is not possible in the first method, because we do not know what is the expected result and what is not. Thirdly, if one were to adopt the first approach he may, theoretically speaking, never know when to end his experiment.

However, the method of hypothesis formation and verification poses some problems. First of all hypothesis formation implies the knowledge of previous experiments on the related areas or practical experience and observations. A hypothesis can be formulated only if there are some known facts about some variables common between the Independent Variable and the Dependent Variable.

For example, in the above illustration the formation of hypothesis implies the knowledge of previous experiments on the related areas of practical experience and observations. A hypothesis can be formulated only if there are some known facts about some variables common between the Independent Variable and the Dependent Variable.

For example, in the above illustration the formation of the hypothesis involves knowledge of origin of fatigue and the effect of fatigue on sensory behaviour. When such knowledge is absent it may not be correct to form a hypothesis. A hypothesis when it is formed must be precise, clear and specific.

Otherwise, it is not likely to be very useful. If it is vague it approaches a theory and if it is specific it is useless. For example, in the above experiment, if an experimenter starts with a hypothesis that fatigue affects sensory capacities, this tells us nothing definite about sleep-deprivation and auditory acuity.

It is very vague. On the other hand if he states that sleep-deprivation affects capacity to hear bell sounds this becomes very specific and psychologically not very meaningful. Hence, a hypothesis has to be precise and specific and at the same time wide enough to be psychologically meaningful and scientifically useful.

Method # 6. The Case Method:

The case method is a gift to psychology from the field of medicine. Clinical psychology uses this as a main method. Subsequently other branches of psychology also found it useful to employ this method. Social psychologists studying certain problems, employ the case method.

Social psychologists employ the case method at different levels. At the first level, the case method is employed to study and understand the various factors related to the occurrence of a particular event, e.g., a few years ago there was a sudden panic in Hyderabad city. People from certain areas started leaving their homes and almost travelling by whatever mode of transport was available.

Later on it came to be ‘known’, that the river Moosi in the city of Hyderabad had overflown and that several areas were being inundated. This wild rumor had spread. Actually there was not a drop of water in the river and the river certainly could not have overflown.

Some drainage pipes had broken the previous night, and there was a scare in the public and there was no question of any place being inundated. But the previous night’s fear scared them enough to fly away like crows. This is certainly an interesting event or phenomenon for social psychologists in particular to study. In such an instance, the case method would be the most suitable.

The social psychologists can collect all the necessary information, meet the people, talk to them, study how the rumor originated, how it was transmitted and finally what were’ the different kinds of consequential behaviour. This may help not only to understand the course of events in the situation, but perhaps also help in dealing with an actual disaster in the future.

A second level of application of the case method is at the level of organisations. Organisational psychologists make use of this method extensively. Let us imagine that there are a number of similar industrial units comparable in all respects like resources, technology etc. But one of them is faring badly in terms of performance and output.

The problem before the organisational psychologist is to understand why one unit alone should fare badly. Here again, the case method is probably the most helpful. The investigator tries to collect all possible information about the various factors, employs different types of sources like documented information, questionnaires, interviews and tries to understand what has gone wrong. Perhaps, it is the style of leadership, or some other motivational factors.

Such case studies can help us to understand ‘idiosyncratic’ behaviour. Similarly the case method can also be employed to understand organisations which do very well under even serious resource constraints. Such knowledge will help us to improve the performance of organisations, by creating suitable conditions and evolving appropriate behavioural systems. An outstanding example of such a type of research is the one carried out by Peterman and Water on excellence in successful leading American corporations.

On certain occasions social psychologists have also been facing the need to study whole communities. For example, we have had the experiences of large groups of refugees who have been displaced from their traditional habitation, and moved to different places necessitating radical changes in their adjustment.

The social psychologist is definitely interested in studying the process by which a whole group of people learn to readjust themselves to totally new surroundings. These people often have to change their attitudes and behavioural patterns. Probably they are shifted to surroundings which are totally strange or alien.

A similar picture can be seen if a programme like ‘Family Planning’ is to be introduced to a remote rural community which has never thought in terms of family planning; where the belief has been that the greater the number of children, the greater is the security or that children are gifts of God.

Social psychologists usually make a study of the various beliefs, practices, attitudes and behaviour of the whole community, so that such conditions can be created, wherein positive futuristic attitudes can be introduced, without meeting with much of a resistance. Here again, questionnaires, rating scales, interviews and a variety of techniques can be used.

Thus, it can be seen that the case study method can be used at different levels and for different purposes. In fact a number of such cases can often help generate ideas or more controlled, laboratory and field studies. Used carefully the method can help us get lot of insight into the nature of different kinds of behaviour.

Method # 7. Survey Method :

Another major method employed in psychology is the survey method. This method is commonly employed in social psychology though other branches of psychology also employ it. The survey method is employed whenever we are interested in knowing how a particular behaviour is distributed among a group of people.

For example, if we want to understand the study habits of college students, then a survey is undertaken. Similarly, if we want to understand the opinions of workers on a certain legislation then a survey is undertaken. Surveys can be general, relating to the people at large or to specific groups like students or workers or housewives.

Surveys can be of two types. In some instances we can study all the people belonging to a particular community that we are interested in. Thus, if we want to study the reading habits of high school students in Hyderabad city, we can visit all the schools and collect information from all the students.

This type of survey is known as population survey or a census. On the other hand if we do not have the time and the facilities, we can just visit some of the schools and meet only some of the students. We can then arrive at our conclusion, assuming that these findings will not differ very much from the findings of a population survey had we undertaken one.

This type is called a sample survey and is a very common method. We have studied a sample (or one part) of the population. Manufacturing industries undertake consumer surveys to study the likes and dislikes of people on the basis of samples.

While the sample survey is much easier, great care has to be exercised in selecting the sample. Otherwise the findings of sample survey may not be true of a population. A number of techniques have been developed for selecting the right type of samples.

The reader will learn more about this if and when he studies psychology at a more advanced level. Sample surveys have been found to yield very accurate findings and predictions when carried out carefully. An instance is the forecast of the election results based on sample surveys.

In many researches, however, more than one method is employed. There are researches where the survey method, the case study method and the experimental method can be used together. The choice depends on the purpose of the research, the resources available and the time available.

The choice of the right method is very crucial in determining the quality of research. An outstanding example of this type are the Hawthorne Studies carried out by Elton Mayo and his colleagues where a variety of methods were employed.

Related Articles:

• 7 Methods of Studying Human Behaviour
• Studying Abnormal Behaviour: 4 Methods | Psychology
• 4 Main Methods of Studying Maladaptive Behaviour
• Statistical Methods and Psychology

Methods , Methods of Psychology , Psychology