approach to problem solving research

Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

• View all journals
• My Account Login
• Explore content
• About the journal
• Publish with us
• Sign up for alerts
• Review Article
• Open access
• Published: 11 January 2023

The effectiveness of collaborative problem solving in promoting students’ critical thinking: A meta-analysis based on empirical literature

• Enwei Xu   ORCID: orcid.org/0000-0001-6424-8169 1 ,
• Wei Wang 1 &
• Qingxia Wang 1  

Humanities and Social Sciences Communications volume  10 , Article number:  16 ( 2023 ) Cite this article

15k Accesses

15 Citations

3 Altmetric

Metrics details

• Science, technology and society

Collaborative problem-solving has been widely embraced in the classroom instruction of critical thinking, which is regarded as the core of curriculum reform based on key competencies in the field of education as well as a key competence for learners in the 21st century. However, the effectiveness of collaborative problem-solving in promoting students’ critical thinking remains uncertain. This current research presents the major findings of a meta-analysis of 36 pieces of the literature revealed in worldwide educational periodicals during the 21st century to identify the effectiveness of collaborative problem-solving in promoting students’ critical thinking and to determine, based on evidence, whether and to what extent collaborative problem solving can result in a rise or decrease in critical thinking. The findings show that (1) collaborative problem solving is an effective teaching approach to foster students’ critical thinking, with a significant overall effect size (ES = 0.82, z  = 12.78, P  < 0.01, 95% CI [0.69, 0.95]); (2) in respect to the dimensions of critical thinking, collaborative problem solving can significantly and successfully enhance students’ attitudinal tendencies (ES = 1.17, z  = 7.62, P  < 0.01, 95% CI[0.87, 1.47]); nevertheless, it falls short in terms of improving students’ cognitive skills, having only an upper-middle impact (ES = 0.70, z  = 11.55, P  < 0.01, 95% CI[0.58, 0.82]); and (3) the teaching type (chi 2  = 7.20, P  < 0.05), intervention duration (chi 2  = 12.18, P  < 0.01), subject area (chi 2  = 13.36, P  < 0.05), group size (chi 2  = 8.77, P  < 0.05), and learning scaffold (chi 2  = 9.03, P  < 0.01) all have an impact on critical thinking, and they can be viewed as important moderating factors that affect how critical thinking develops. On the basis of these results, recommendations are made for further study and instruction to better support students’ critical thinking in the context of collaborative problem-solving.

Similar content being viewed by others

Fostering twenty-first century skills among primary school students through math project-based learning

A meta-analysis to gauge the impact of pedagogies employed in mixed-ability high school biology classrooms

A guide to critical thinking: implications for dental education

Introduction.

Although critical thinking has a long history in research, the concept of critical thinking, which is regarded as an essential competence for learners in the 21st century, has recently attracted more attention from researchers and teaching practitioners (National Research Council, 2012 ). Critical thinking should be the core of curriculum reform based on key competencies in the field of education (Peng and Deng, 2017 ) because students with critical thinking can not only understand the meaning of knowledge but also effectively solve practical problems in real life even after knowledge is forgotten (Kek and Huijser, 2011 ). The definition of critical thinking is not universal (Ennis, 1989 ; Castle, 2009 ; Niu et al., 2013 ). In general, the definition of critical thinking is a self-aware and self-regulated thought process (Facione, 1990 ; Niu et al., 2013 ). It refers to the cognitive skills needed to interpret, analyze, synthesize, reason, and evaluate information as well as the attitudinal tendency to apply these abilities (Halpern, 2001 ). The view that critical thinking can be taught and learned through curriculum teaching has been widely supported by many researchers (e.g., Kuncel, 2011 ; Leng and Lu, 2020 ), leading to educators’ efforts to foster it among students. In the field of teaching practice, there are three types of courses for teaching critical thinking (Ennis, 1989 ). The first is an independent curriculum in which critical thinking is taught and cultivated without involving the knowledge of specific disciplines; the second is an integrated curriculum in which critical thinking is integrated into the teaching of other disciplines as a clear teaching goal; and the third is a mixed curriculum in which critical thinking is taught in parallel to the teaching of other disciplines for mixed teaching training. Furthermore, numerous measuring tools have been developed by researchers and educators to measure critical thinking in the context of teaching practice. These include standardized measurement tools, such as WGCTA, CCTST, CCTT, and CCTDI, which have been verified by repeated experiments and are considered effective and reliable by international scholars (Facione and Facione, 1992 ). In short, descriptions of critical thinking, including its two dimensions of attitudinal tendency and cognitive skills, different types of teaching courses, and standardized measurement tools provide a complex normative framework for understanding, teaching, and evaluating critical thinking.

Cultivating critical thinking in curriculum teaching can start with a problem, and one of the most popular critical thinking instructional approaches is problem-based learning (Liu et al., 2020 ). Duch et al. ( 2001 ) noted that problem-based learning in group collaboration is progressive active learning, which can improve students’ critical thinking and problem-solving skills. Collaborative problem-solving is the organic integration of collaborative learning and problem-based learning, which takes learners as the center of the learning process and uses problems with poor structure in real-world situations as the starting point for the learning process (Liang et al., 2017 ). Students learn the knowledge needed to solve problems in a collaborative group, reach a consensus on problems in the field, and form solutions through social cooperation methods, such as dialogue, interpretation, questioning, debate, negotiation, and reflection, thus promoting the development of learners’ domain knowledge and critical thinking (Cindy, 2004 ; Liang et al., 2017 ).

Collaborative problem-solving has been widely used in the teaching practice of critical thinking, and several studies have attempted to conduct a systematic review and meta-analysis of the empirical literature on critical thinking from various perspectives. However, little attention has been paid to the impact of collaborative problem-solving on critical thinking. Therefore, the best approach for developing and enhancing critical thinking throughout collaborative problem-solving is to examine how to implement critical thinking instruction; however, this issue is still unexplored, which means that many teachers are incapable of better instructing critical thinking (Leng and Lu, 2020 ; Niu et al., 2013 ). For example, Huber ( 2016 ) provided the meta-analysis findings of 71 publications on gaining critical thinking over various time frames in college with the aim of determining whether critical thinking was truly teachable. These authors found that learners significantly improve their critical thinking while in college and that critical thinking differs with factors such as teaching strategies, intervention duration, subject area, and teaching type. The usefulness of collaborative problem-solving in fostering students’ critical thinking, however, was not determined by this study, nor did it reveal whether there existed significant variations among the different elements. A meta-analysis of 31 pieces of educational literature was conducted by Liu et al. ( 2020 ) to assess the impact of problem-solving on college students’ critical thinking. These authors found that problem-solving could promote the development of critical thinking among college students and proposed establishing a reasonable group structure for problem-solving in a follow-up study to improve students’ critical thinking. Additionally, previous empirical studies have reached inconclusive and even contradictory conclusions about whether and to what extent collaborative problem-solving increases or decreases critical thinking levels. As an illustration, Yang et al. ( 2008 ) carried out an experiment on the integrated curriculum teaching of college students based on a web bulletin board with the goal of fostering participants’ critical thinking in the context of collaborative problem-solving. These authors’ research revealed that through sharing, debating, examining, and reflecting on various experiences and ideas, collaborative problem-solving can considerably enhance students’ critical thinking in real-life problem situations. In contrast, collaborative problem-solving had a positive impact on learners’ interaction and could improve learning interest and motivation but could not significantly improve students’ critical thinking when compared to traditional classroom teaching, according to research by Naber and Wyatt ( 2014 ) and Sendag and Odabasi ( 2009 ) on undergraduate and high school students, respectively.

The above studies show that there is inconsistency regarding the effectiveness of collaborative problem-solving in promoting students’ critical thinking. Therefore, it is essential to conduct a thorough and trustworthy review to detect and decide whether and to what degree collaborative problem-solving can result in a rise or decrease in critical thinking. Meta-analysis is a quantitative analysis approach that is utilized to examine quantitative data from various separate studies that are all focused on the same research topic. This approach characterizes the effectiveness of its impact by averaging the effect sizes of numerous qualitative studies in an effort to reduce the uncertainty brought on by independent research and produce more conclusive findings (Lipsey and Wilson, 2001 ).

This paper used a meta-analytic approach and carried out a meta-analysis to examine the effectiveness of collaborative problem-solving in promoting students’ critical thinking in order to make a contribution to both research and practice. The following research questions were addressed by this meta-analysis:

What is the overall effect size of collaborative problem-solving in promoting students’ critical thinking and its impact on the two dimensions of critical thinking (i.e., attitudinal tendency and cognitive skills)?

How are the disparities between the study conclusions impacted by various moderating variables if the impacts of various experimental designs in the included studies are heterogeneous?

This research followed the strict procedures (e.g., database searching, identification, screening, eligibility, merging, duplicate removal, and analysis of included studies) of Cooper’s ( 2010 ) proposed meta-analysis approach for examining quantitative data from various separate studies that are all focused on the same research topic. The relevant empirical research that appeared in worldwide educational periodicals within the 21st century was subjected to this meta-analysis using Rev-Man 5.4. The consistency of the data extracted separately by two researchers was tested using Cohen’s kappa coefficient, and a publication bias test and a heterogeneity test were run on the sample data to ascertain the quality of this meta-analysis.

Data sources and search strategies

There were three stages to the data collection process for this meta-analysis, as shown in Fig. 1 , which shows the number of articles included and eliminated during the selection process based on the statement and study eligibility criteria.

This flowchart shows the number of records identified, included and excluded in the article.

First, the databases used to systematically search for relevant articles were the journal papers of the Web of Science Core Collection and the Chinese Core source journal, as well as the Chinese Social Science Citation Index (CSSCI) source journal papers included in CNKI. These databases were selected because they are credible platforms that are sources of scholarly and peer-reviewed information with advanced search tools and contain literature relevant to the subject of our topic from reliable researchers and experts. The search string with the Boolean operator used in the Web of Science was “TS = (((“critical thinking” or “ct” and “pretest” or “posttest”) or (“critical thinking” or “ct” and “control group” or “quasi experiment” or “experiment”)) and (“collaboration” or “collaborative learning” or “CSCL”) and (“problem solving” or “problem-based learning” or “PBL”))”. The research area was “Education Educational Research”, and the search period was “January 1, 2000, to December 30, 2021”. A total of 412 papers were obtained. The search string with the Boolean operator used in the CNKI was “SU = (‘critical thinking’*‘collaboration’ + ‘critical thinking’*‘collaborative learning’ + ‘critical thinking’*‘CSCL’ + ‘critical thinking’*‘problem solving’ + ‘critical thinking’*‘problem-based learning’ + ‘critical thinking’*‘PBL’ + ‘critical thinking’*‘problem oriented’) AND FT = (‘experiment’ + ‘quasi experiment’ + ‘pretest’ + ‘posttest’ + ‘empirical study’)” (translated into Chinese when searching). A total of 56 studies were found throughout the search period of “January 2000 to December 2021”. From the databases, all duplicates and retractions were eliminated before exporting the references into Endnote, a program for managing bibliographic references. In all, 466 studies were found.

Second, the studies that matched the inclusion and exclusion criteria for the meta-analysis were chosen by two researchers after they had reviewed the abstracts and titles of the gathered articles, yielding a total of 126 studies.

Third, two researchers thoroughly reviewed each included article’s whole text in accordance with the inclusion and exclusion criteria. Meanwhile, a snowball search was performed using the references and citations of the included articles to ensure complete coverage of the articles. Ultimately, 36 articles were kept.

Two researchers worked together to carry out this entire process, and a consensus rate of almost 94.7% was reached after discussion and negotiation to clarify any emerging differences.

Eligibility criteria

Since not all the retrieved studies matched the criteria for this meta-analysis, eligibility criteria for both inclusion and exclusion were developed as follows:

The publication language of the included studies was limited to English and Chinese, and the full text could be obtained. Articles that did not meet the publication language and articles not published between 2000 and 2021 were excluded.

The research design of the included studies must be empirical and quantitative studies that can assess the effect of collaborative problem-solving on the development of critical thinking. Articles that could not identify the causal mechanisms by which collaborative problem-solving affects critical thinking, such as review articles and theoretical articles, were excluded.

The research method of the included studies must feature a randomized control experiment or a quasi-experiment, or a natural experiment, which have a higher degree of internal validity with strong experimental designs and can all plausibly provide evidence that critical thinking and collaborative problem-solving are causally related. Articles with non-experimental research methods, such as purely correlational or observational studies, were excluded.

The participants of the included studies were only students in school, including K-12 students and college students. Articles in which the participants were non-school students, such as social workers or adult learners, were excluded.

The research results of the included studies must mention definite signs that may be utilized to gauge critical thinking’s impact (e.g., sample size, mean value, or standard deviation). Articles that lacked specific measurement indicators for critical thinking and could not calculate the effect size were excluded.

Data coding design

In order to perform a meta-analysis, it is necessary to collect the most important information from the articles, codify that information’s properties, and convert descriptive data into quantitative data. Therefore, this study designed a data coding template (see Table 1 ). Ultimately, 16 coding fields were retained.

The designed data-coding template consisted of three pieces of information. Basic information about the papers was included in the descriptive information: the publishing year, author, serial number, and title of the paper.

The variable information for the experimental design had three variables: the independent variable (instruction method), the dependent variable (critical thinking), and the moderating variable (learning stage, teaching type, intervention duration, learning scaffold, group size, measuring tool, and subject area). Depending on the topic of this study, the intervention strategy, as the independent variable, was coded into collaborative and non-collaborative problem-solving. The dependent variable, critical thinking, was coded as a cognitive skill and an attitudinal tendency. And seven moderating variables were created by grouping and combining the experimental design variables discovered within the 36 studies (see Table 1 ), where learning stages were encoded as higher education, high school, middle school, and primary school or lower; teaching types were encoded as mixed courses, integrated courses, and independent courses; intervention durations were encoded as 0–1 weeks, 1–4 weeks, 4–12 weeks, and more than 12 weeks; group sizes were encoded as 2–3 persons, 4–6 persons, 7–10 persons, and more than 10 persons; learning scaffolds were encoded as teacher-supported learning scaffold, technique-supported learning scaffold, and resource-supported learning scaffold; measuring tools were encoded as standardized measurement tools (e.g., WGCTA, CCTT, CCTST, and CCTDI) and self-adapting measurement tools (e.g., modified or made by researchers); and subject areas were encoded according to the specific subjects used in the 36 included studies.

The data information contained three metrics for measuring critical thinking: sample size, average value, and standard deviation. It is vital to remember that studies with various experimental designs frequently adopt various formulas to determine the effect size. And this paper used Morris’ proposed standardized mean difference (SMD) calculation formula ( 2008 , p. 369; see Supplementary Table S3 ).

Procedure for extracting and coding data

According to the data coding template (see Table 1 ), the 36 papers’ information was retrieved by two researchers, who then entered them into Excel (see Supplementary Table S1 ). The results of each study were extracted separately in the data extraction procedure if an article contained numerous studies on critical thinking, or if a study assessed different critical thinking dimensions. For instance, Tiwari et al. ( 2010 ) used four time points, which were viewed as numerous different studies, to examine the outcomes of critical thinking, and Chen ( 2013 ) included the two outcome variables of attitudinal tendency and cognitive skills, which were regarded as two studies. After discussion and negotiation during data extraction, the two researchers’ consistency test coefficients were roughly 93.27%. Supplementary Table S2 details the key characteristics of the 36 included articles with 79 effect quantities, including descriptive information (e.g., the publishing year, author, serial number, and title of the paper), variable information (e.g., independent variables, dependent variables, and moderating variables), and data information (e.g., mean values, standard deviations, and sample size). Following that, testing for publication bias and heterogeneity was done on the sample data using the Rev-Man 5.4 software, and then the test results were used to conduct a meta-analysis.

Publication bias test

When the sample of studies included in a meta-analysis does not accurately reflect the general status of research on the relevant subject, publication bias is said to be exhibited in this research. The reliability and accuracy of the meta-analysis may be impacted by publication bias. Due to this, the meta-analysis needs to check the sample data for publication bias (Stewart et al., 2006 ). A popular method to check for publication bias is the funnel plot; and it is unlikely that there will be publishing bias when the data are equally dispersed on either side of the average effect size and targeted within the higher region. The data are equally dispersed within the higher portion of the efficient zone, consistent with the funnel plot connected with this analysis (see Fig. 2 ), indicating that publication bias is unlikely in this situation.

This funnel plot shows the result of publication bias of 79 effect quantities across 36 studies.

Heterogeneity test

To select the appropriate effect models for the meta-analysis, one might use the results of a heterogeneity test on the data effect sizes. In a meta-analysis, it is common practice to gauge the degree of data heterogeneity using the I 2 value, and I 2  ≥ 50% is typically understood to denote medium-high heterogeneity, which calls for the adoption of a random effect model; if not, a fixed effect model ought to be applied (Lipsey and Wilson, 2001 ). The findings of the heterogeneity test in this paper (see Table 2 ) revealed that I 2 was 86% and displayed significant heterogeneity ( P  < 0.01). To ensure accuracy and reliability, the overall effect size ought to be calculated utilizing the random effect model.

The analysis of the overall effect size

This meta-analysis utilized a random effect model to examine 79 effect quantities from 36 studies after eliminating heterogeneity. In accordance with Cohen’s criterion (Cohen, 1992 ), it is abundantly clear from the analysis results, which are shown in the forest plot of the overall effect (see Fig. 3 ), that the cumulative impact size of cooperative problem-solving is 0.82, which is statistically significant ( z  = 12.78, P  < 0.01, 95% CI [0.69, 0.95]), and can encourage learners to practice critical thinking.

This forest plot shows the analysis result of the overall effect size across 36 studies.

In addition, this study examined two distinct dimensions of critical thinking to better understand the precise contributions that collaborative problem-solving makes to the growth of critical thinking. The findings (see Table 3 ) indicate that collaborative problem-solving improves cognitive skills (ES = 0.70) and attitudinal tendency (ES = 1.17), with significant intergroup differences (chi 2  = 7.95, P  < 0.01). Although collaborative problem-solving improves both dimensions of critical thinking, it is essential to point out that the improvements in students’ attitudinal tendency are much more pronounced and have a significant comprehensive effect (ES = 1.17, z  = 7.62, P  < 0.01, 95% CI [0.87, 1.47]), whereas gains in learners’ cognitive skill are slightly improved and are just above average. (ES = 0.70, z  = 11.55, P  < 0.01, 95% CI [0.58, 0.82]).

The analysis of moderator effect size

The whole forest plot’s 79 effect quantities underwent a two-tailed test, which revealed significant heterogeneity ( I 2  = 86%, z  = 12.78, P  < 0.01), indicating differences between various effect sizes that may have been influenced by moderating factors other than sampling error. Therefore, exploring possible moderating factors that might produce considerable heterogeneity was done using subgroup analysis, such as the learning stage, learning scaffold, teaching type, group size, duration of the intervention, measuring tool, and the subject area included in the 36 experimental designs, in order to further explore the key factors that influence critical thinking. The findings (see Table 4 ) indicate that various moderating factors have advantageous effects on critical thinking. In this situation, the subject area (chi 2  = 13.36, P  < 0.05), group size (chi 2  = 8.77, P  < 0.05), intervention duration (chi 2  = 12.18, P  < 0.01), learning scaffold (chi 2  = 9.03, P  < 0.01), and teaching type (chi 2  = 7.20, P  < 0.05) are all significant moderators that can be applied to support the cultivation of critical thinking. However, since the learning stage and the measuring tools did not significantly differ among intergroup (chi 2  = 3.15, P  = 0.21 > 0.05, and chi 2  = 0.08, P  = 0.78 > 0.05), we are unable to explain why these two factors are crucial in supporting the cultivation of critical thinking in the context of collaborative problem-solving. These are the precise outcomes, as follows:

Various learning stages influenced critical thinking positively, without significant intergroup differences (chi 2  = 3.15, P  = 0.21 > 0.05). High school was first on the list of effect sizes (ES = 1.36, P  < 0.01), then higher education (ES = 0.78, P  < 0.01), and middle school (ES = 0.73, P  < 0.01). These results show that, despite the learning stage’s beneficial influence on cultivating learners’ critical thinking, we are unable to explain why it is essential for cultivating critical thinking in the context of collaborative problem-solving.

Different teaching types had varying degrees of positive impact on critical thinking, with significant intergroup differences (chi 2  = 7.20, P  < 0.05). The effect size was ranked as follows: mixed courses (ES = 1.34, P  < 0.01), integrated courses (ES = 0.81, P  < 0.01), and independent courses (ES = 0.27, P  < 0.01). These results indicate that the most effective approach to cultivate critical thinking utilizing collaborative problem solving is through the teaching type of mixed courses.

Various intervention durations significantly improved critical thinking, and there were significant intergroup differences (chi 2  = 12.18, P  < 0.01). The effect sizes related to this variable showed a tendency to increase with longer intervention durations. The improvement in critical thinking reached a significant level (ES = 0.85, P  < 0.01) after more than 12 weeks of training. These findings indicate that the intervention duration and critical thinking’s impact are positively correlated, with a longer intervention duration having a greater effect.

Different learning scaffolds influenced critical thinking positively, with significant intergroup differences (chi 2  = 9.03, P  < 0.01). The resource-supported learning scaffold (ES = 0.69, P  < 0.01) acquired a medium-to-higher level of impact, the technique-supported learning scaffold (ES = 0.63, P  < 0.01) also attained a medium-to-higher level of impact, and the teacher-supported learning scaffold (ES = 0.92, P  < 0.01) displayed a high level of significant impact. These results show that the learning scaffold with teacher support has the greatest impact on cultivating critical thinking.

Various group sizes influenced critical thinking positively, and the intergroup differences were statistically significant (chi 2  = 8.77, P  < 0.05). Critical thinking showed a general declining trend with increasing group size. The overall effect size of 2–3 people in this situation was the biggest (ES = 0.99, P  < 0.01), and when the group size was greater than 7 people, the improvement in critical thinking was at the lower-middle level (ES < 0.5, P  < 0.01). These results show that the impact on critical thinking is positively connected with group size, and as group size grows, so does the overall impact.

Various measuring tools influenced critical thinking positively, with significant intergroup differences (chi 2  = 0.08, P  = 0.78 > 0.05). In this situation, the self-adapting measurement tools obtained an upper-medium level of effect (ES = 0.78), whereas the complete effect size of the standardized measurement tools was the largest, achieving a significant level of effect (ES = 0.84, P  < 0.01). These results show that, despite the beneficial influence of the measuring tool on cultivating critical thinking, we are unable to explain why it is crucial in fostering the growth of critical thinking by utilizing the approach of collaborative problem-solving.

Different subject areas had a greater impact on critical thinking, and the intergroup differences were statistically significant (chi 2  = 13.36, P  < 0.05). Mathematics had the greatest overall impact, achieving a significant level of effect (ES = 1.68, P  < 0.01), followed by science (ES = 1.25, P  < 0.01) and medical science (ES = 0.87, P  < 0.01), both of which also achieved a significant level of effect. Programming technology was the least effective (ES = 0.39, P  < 0.01), only having a medium-low degree of effect compared to education (ES = 0.72, P  < 0.01) and other fields (such as language, art, and social sciences) (ES = 0.58, P  < 0.01). These results suggest that scientific fields (e.g., mathematics, science) may be the most effective subject areas for cultivating critical thinking utilizing the approach of collaborative problem-solving.

The effectiveness of collaborative problem solving with regard to teaching critical thinking

According to this meta-analysis, using collaborative problem-solving as an intervention strategy in critical thinking teaching has a considerable amount of impact on cultivating learners’ critical thinking as a whole and has a favorable promotional effect on the two dimensions of critical thinking. According to certain studies, collaborative problem solving, the most frequently used critical thinking teaching strategy in curriculum instruction can considerably enhance students’ critical thinking (e.g., Liang et al., 2017 ; Liu et al., 2020 ; Cindy, 2004 ). This meta-analysis provides convergent data support for the above research views. Thus, the findings of this meta-analysis not only effectively address the first research query regarding the overall effect of cultivating critical thinking and its impact on the two dimensions of critical thinking (i.e., attitudinal tendency and cognitive skills) utilizing the approach of collaborative problem-solving, but also enhance our confidence in cultivating critical thinking by using collaborative problem-solving intervention approach in the context of classroom teaching.

Furthermore, the associated improvements in attitudinal tendency are much stronger, but the corresponding improvements in cognitive skill are only marginally better. According to certain studies, cognitive skill differs from the attitudinal tendency in classroom instruction; the cultivation and development of the former as a key ability is a process of gradual accumulation, while the latter as an attitude is affected by the context of the teaching situation (e.g., a novel and exciting teaching approach, challenging and rewarding tasks) (Halpern, 2001 ; Wei and Hong, 2022 ). Collaborative problem-solving as a teaching approach is exciting and interesting, as well as rewarding and challenging; because it takes the learners as the focus and examines problems with poor structure in real situations, and it can inspire students to fully realize their potential for problem-solving, which will significantly improve their attitudinal tendency toward solving problems (Liu et al., 2020 ). Similar to how collaborative problem-solving influences attitudinal tendency, attitudinal tendency impacts cognitive skill when attempting to solve a problem (Liu et al., 2020 ; Zhang et al., 2022 ), and stronger attitudinal tendencies are associated with improved learning achievement and cognitive ability in students (Sison, 2008 ; Zhang et al., 2022 ). It can be seen that the two specific dimensions of critical thinking as well as critical thinking as a whole are affected by collaborative problem-solving, and this study illuminates the nuanced links between cognitive skills and attitudinal tendencies with regard to these two dimensions of critical thinking. To fully develop students’ capacity for critical thinking, future empirical research should pay closer attention to cognitive skills.

The moderating effects of collaborative problem solving with regard to teaching critical thinking

In order to further explore the key factors that influence critical thinking, exploring possible moderating effects that might produce considerable heterogeneity was done using subgroup analysis. The findings show that the moderating factors, such as the teaching type, learning stage, group size, learning scaffold, duration of the intervention, measuring tool, and the subject area included in the 36 experimental designs, could all support the cultivation of collaborative problem-solving in critical thinking. Among them, the effect size differences between the learning stage and measuring tool are not significant, which does not explain why these two factors are crucial in supporting the cultivation of critical thinking utilizing the approach of collaborative problem-solving.

In terms of the learning stage, various learning stages influenced critical thinking positively without significant intergroup differences, indicating that we are unable to explain why it is crucial in fostering the growth of critical thinking.

Although high education accounts for 70.89% of all empirical studies performed by researchers, high school may be the appropriate learning stage to foster students’ critical thinking by utilizing the approach of collaborative problem-solving since it has the largest overall effect size. This phenomenon may be related to student’s cognitive development, which needs to be further studied in follow-up research.

With regard to teaching type, mixed course teaching may be the best teaching method to cultivate students’ critical thinking. Relevant studies have shown that in the actual teaching process if students are trained in thinking methods alone, the methods they learn are isolated and divorced from subject knowledge, which is not conducive to their transfer of thinking methods; therefore, if students’ thinking is trained only in subject teaching without systematic method training, it is challenging to apply to real-world circumstances (Ruggiero, 2012 ; Hu and Liu, 2015 ). Teaching critical thinking as mixed course teaching in parallel to other subject teachings can achieve the best effect on learners’ critical thinking, and explicit critical thinking instruction is more effective than less explicit critical thinking instruction (Bensley and Spero, 2014 ).

In terms of the intervention duration, with longer intervention times, the overall effect size shows an upward tendency. Thus, the intervention duration and critical thinking’s impact are positively correlated. Critical thinking, as a key competency for students in the 21st century, is difficult to get a meaningful improvement in a brief intervention duration. Instead, it could be developed over a lengthy period of time through consistent teaching and the progressive accumulation of knowledge (Halpern, 2001 ; Hu and Liu, 2015 ). Therefore, future empirical studies ought to take these restrictions into account throughout a longer period of critical thinking instruction.

With regard to group size, a group size of 2–3 persons has the highest effect size, and the comprehensive effect size decreases with increasing group size in general. This outcome is in line with some research findings; as an example, a group composed of two to four members is most appropriate for collaborative learning (Schellens and Valcke, 2006 ). However, the meta-analysis results also indicate that once the group size exceeds 7 people, small groups cannot produce better interaction and performance than large groups. This may be because the learning scaffolds of technique support, resource support, and teacher support improve the frequency and effectiveness of interaction among group members, and a collaborative group with more members may increase the diversity of views, which is helpful to cultivate critical thinking utilizing the approach of collaborative problem-solving.

With regard to the learning scaffold, the three different kinds of learning scaffolds can all enhance critical thinking. Among them, the teacher-supported learning scaffold has the largest overall effect size, demonstrating the interdependence of effective learning scaffolds and collaborative problem-solving. This outcome is in line with some research findings; as an example, a successful strategy is to encourage learners to collaborate, come up with solutions, and develop critical thinking skills by using learning scaffolds (Reiser, 2004 ; Xu et al., 2022 ); learning scaffolds can lower task complexity and unpleasant feelings while also enticing students to engage in learning activities (Wood et al., 2006 ); learning scaffolds are designed to assist students in using learning approaches more successfully to adapt the collaborative problem-solving process, and the teacher-supported learning scaffolds have the greatest influence on critical thinking in this process because they are more targeted, informative, and timely (Xu et al., 2022 ).

With respect to the measuring tool, despite the fact that standardized measurement tools (such as the WGCTA, CCTT, and CCTST) have been acknowledged as trustworthy and effective by worldwide experts, only 54.43% of the research included in this meta-analysis adopted them for assessment, and the results indicated no intergroup differences. These results suggest that not all teaching circumstances are appropriate for measuring critical thinking using standardized measurement tools. “The measuring tools for measuring thinking ability have limits in assessing learners in educational situations and should be adapted appropriately to accurately assess the changes in learners’ critical thinking.”, according to Simpson and Courtney ( 2002 , p. 91). As a result, in order to more fully and precisely gauge how learners’ critical thinking has evolved, we must properly modify standardized measuring tools based on collaborative problem-solving learning contexts.

With regard to the subject area, the comprehensive effect size of science departments (e.g., mathematics, science, medical science) is larger than that of language arts and social sciences. Some recent international education reforms have noted that critical thinking is a basic part of scientific literacy. Students with scientific literacy can prove the rationality of their judgment according to accurate evidence and reasonable standards when they face challenges or poorly structured problems (Kyndt et al., 2013 ), which makes critical thinking crucial for developing scientific understanding and applying this understanding to practical problem solving for problems related to science, technology, and society (Yore et al., 2007 ).

Suggestions for critical thinking teaching

Other than those stated in the discussion above, the following suggestions are offered for critical thinking instruction utilizing the approach of collaborative problem-solving.

First, teachers should put a special emphasis on the two core elements, which are collaboration and problem-solving, to design real problems based on collaborative situations. This meta-analysis provides evidence to support the view that collaborative problem-solving has a strong synergistic effect on promoting students’ critical thinking. Asking questions about real situations and allowing learners to take part in critical discussions on real problems during class instruction are key ways to teach critical thinking rather than simply reading speculative articles without practice (Mulnix, 2012 ). Furthermore, the improvement of students’ critical thinking is realized through cognitive conflict with other learners in the problem situation (Yang et al., 2008 ). Consequently, it is essential for teachers to put a special emphasis on the two core elements, which are collaboration and problem-solving, and design real problems and encourage students to discuss, negotiate, and argue based on collaborative problem-solving situations.

Second, teachers should design and implement mixed courses to cultivate learners’ critical thinking, utilizing the approach of collaborative problem-solving. Critical thinking can be taught through curriculum instruction (Kuncel, 2011 ; Leng and Lu, 2020 ), with the goal of cultivating learners’ critical thinking for flexible transfer and application in real problem-solving situations. This meta-analysis shows that mixed course teaching has a highly substantial impact on the cultivation and promotion of learners’ critical thinking. Therefore, teachers should design and implement mixed course teaching with real collaborative problem-solving situations in combination with the knowledge content of specific disciplines in conventional teaching, teach methods and strategies of critical thinking based on poorly structured problems to help students master critical thinking, and provide practical activities in which students can interact with each other to develop knowledge construction and critical thinking utilizing the approach of collaborative problem-solving.

Third, teachers should be more trained in critical thinking, particularly preservice teachers, and they also should be conscious of the ways in which teachers’ support for learning scaffolds can promote critical thinking. The learning scaffold supported by teachers had the greatest impact on learners’ critical thinking, in addition to being more directive, targeted, and timely (Wood et al., 2006 ). Critical thinking can only be effectively taught when teachers recognize the significance of critical thinking for students’ growth and use the proper approaches while designing instructional activities (Forawi, 2016 ). Therefore, with the intention of enabling teachers to create learning scaffolds to cultivate learners’ critical thinking utilizing the approach of collaborative problem solving, it is essential to concentrate on the teacher-supported learning scaffolds and enhance the instruction for teaching critical thinking to teachers, especially preservice teachers.

Implications and limitations

There are certain limitations in this meta-analysis, but future research can correct them. First, the search languages were restricted to English and Chinese, so it is possible that pertinent studies that were written in other languages were overlooked, resulting in an inadequate number of articles for review. Second, these data provided by the included studies are partially missing, such as whether teachers were trained in the theory and practice of critical thinking, the average age and gender of learners, and the differences in critical thinking among learners of various ages and genders. Third, as is typical for review articles, more studies were released while this meta-analysis was being done; therefore, it had a time limit. With the development of relevant research, future studies focusing on these issues are highly relevant and needed.

Conclusions

The subject of the magnitude of collaborative problem-solving’s impact on fostering students’ critical thinking, which received scant attention from other studies, was successfully addressed by this study. The question of the effectiveness of collaborative problem-solving in promoting students’ critical thinking was addressed in this study, which addressed a topic that had gotten little attention in earlier research. The following conclusions can be made:

Regarding the results obtained, collaborative problem solving is an effective teaching approach to foster learners’ critical thinking, with a significant overall effect size (ES = 0.82, z  = 12.78, P  < 0.01, 95% CI [0.69, 0.95]). With respect to the dimensions of critical thinking, collaborative problem-solving can significantly and effectively improve students’ attitudinal tendency, and the comprehensive effect is significant (ES = 1.17, z  = 7.62, P  < 0.01, 95% CI [0.87, 1.47]); nevertheless, it falls short in terms of improving students’ cognitive skills, having only an upper-middle impact (ES = 0.70, z  = 11.55, P  < 0.01, 95% CI [0.58, 0.82]).

As demonstrated by both the results and the discussion, there are varying degrees of beneficial effects on students’ critical thinking from all seven moderating factors, which were found across 36 studies. In this context, the teaching type (chi 2  = 7.20, P  < 0.05), intervention duration (chi 2  = 12.18, P  < 0.01), subject area (chi 2  = 13.36, P  < 0.05), group size (chi 2  = 8.77, P  < 0.05), and learning scaffold (chi 2  = 9.03, P  < 0.01) all have a positive impact on critical thinking, and they can be viewed as important moderating factors that affect how critical thinking develops. Since the learning stage (chi 2  = 3.15, P  = 0.21 > 0.05) and measuring tools (chi 2  = 0.08, P  = 0.78 > 0.05) did not demonstrate any significant intergroup differences, we are unable to explain why these two factors are crucial in supporting the cultivation of critical thinking in the context of collaborative problem-solving.

Data availability

All data generated or analyzed during this study are included within the article and its supplementary information files, and the supplementary information files are available in the Dataverse repository: https://doi.org/10.7910/DVN/IPFJO6 .

Bensley DA, Spero RA (2014) Improving critical thinking skills and meta-cognitive monitoring through direct infusion. Think Skills Creat 12:55–68. https://doi.org/10.1016/j.tsc.2014.02.001

Article   Google Scholar  

Castle A (2009) Defining and assessing critical thinking skills for student radiographers. Radiography 15(1):70–76. https://doi.org/10.1016/j.radi.2007.10.007

Chen XD (2013) An empirical study on the influence of PBL teaching model on critical thinking ability of non-English majors. J PLA Foreign Lang College 36 (04):68–72

Google Scholar  

Cohen A (1992) Antecedents of organizational commitment across occupational groups: a meta-analysis. J Organ Behav. https://doi.org/10.1002/job.4030130602

Cooper H (2010) Research synthesis and meta-analysis: a step-by-step approach, 4th edn. Sage, London, England

Cindy HS (2004) Problem-based learning: what and how do students learn? Educ Psychol Rev 51(1):31–39

Duch BJ, Gron SD, Allen DE (2001) The power of problem-based learning: a practical “how to” for teaching undergraduate courses in any discipline. Stylus Educ Sci 2:190–198

Ennis RH (1989) Critical thinking and subject specificity: clarification and needed research. Educ Res 18(3):4–10. https://doi.org/10.3102/0013189x018003004

Facione PA (1990) Critical thinking: a statement of expert consensus for purposes of educational assessment and instruction. Research findings and recommendations. Eric document reproduction service. https://eric.ed.gov/?id=ed315423

Facione PA, Facione NC (1992) The California Critical Thinking Dispositions Inventory (CCTDI) and the CCTDI test manual. California Academic Press, Millbrae, CA

Forawi SA (2016) Standard-based science education and critical thinking. Think Skills Creat 20:52–62. https://doi.org/10.1016/j.tsc.2016.02.005

Halpern DF (2001) Assessing the effectiveness of critical thinking instruction. J Gen Educ 50(4):270–286. https://doi.org/10.2307/27797889

Hu WP, Liu J (2015) Cultivation of pupils’ thinking ability: a five-year follow-up study. Psychol Behav Res 13(05):648–654. https://doi.org/10.3969/j.issn.1672-0628.2015.05.010

Huber K (2016) Does college teach critical thinking? A meta-analysis. Rev Educ Res 86(2):431–468. https://doi.org/10.3102/0034654315605917

Kek MYCA, Huijser H (2011) The power of problem-based learning in developing critical thinking skills: preparing students for tomorrow’s digital futures in today’s classrooms. High Educ Res Dev 30(3):329–341. https://doi.org/10.1080/07294360.2010.501074

Kuncel NR (2011) Measurement and meaning of critical thinking (Research report for the NRC 21st Century Skills Workshop). National Research Council, Washington, DC

Kyndt E, Raes E, Lismont B, Timmers F, Cascallar E, Dochy F (2013) A meta-analysis of the effects of face-to-face cooperative learning. Do recent studies falsify or verify earlier findings? Educ Res Rev 10(2):133–149. https://doi.org/10.1016/j.edurev.2013.02.002

Leng J, Lu XX (2020) Is critical thinking really teachable?—A meta-analysis based on 79 experimental or quasi experimental studies. Open Educ Res 26(06):110–118. https://doi.org/10.13966/j.cnki.kfjyyj.2020.06.011

Liang YZ, Zhu K, Zhao CL (2017) An empirical study on the depth of interaction promoted by collaborative problem solving learning activities. J E-educ Res 38(10):87–92. https://doi.org/10.13811/j.cnki.eer.2017.10.014

Lipsey M, Wilson D (2001) Practical meta-analysis. International Educational and Professional, London, pp. 92–160

Liu Z, Wu W, Jiang Q (2020) A study on the influence of problem based learning on college students’ critical thinking-based on a meta-analysis of 31 studies. Explor High Educ 03:43–49

Morris SB (2008) Estimating effect sizes from pretest-posttest-control group designs. Organ Res Methods 11(2):364–386. https://doi.org/10.1177/1094428106291059

Article   ADS   Google Scholar  

Mulnix JW (2012) Thinking critically about critical thinking. Educ Philos Theory 44(5):464–479. https://doi.org/10.1111/j.1469-5812.2010.00673.x

Naber J, Wyatt TH (2014) The effect of reflective writing interventions on the critical thinking skills and dispositions of baccalaureate nursing students. Nurse Educ Today 34(1):67–72. https://doi.org/10.1016/j.nedt.2013.04.002

National Research Council (2012) Education for life and work: developing transferable knowledge and skills in the 21st century. The National Academies Press, Washington, DC

Niu L, Behar HLS, Garvan CW (2013) Do instructional interventions influence college students’ critical thinking skills? A meta-analysis. Educ Res Rev 9(12):114–128. https://doi.org/10.1016/j.edurev.2012.12.002

Peng ZM, Deng L (2017) Towards the core of education reform: cultivating critical thinking skills as the core of skills in the 21st century. Res Educ Dev 24:57–63. https://doi.org/10.14121/j.cnki.1008-3855.2017.24.011

Reiser BJ (2004) Scaffolding complex learning: the mechanisms of structuring and problematizing student work. J Learn Sci 13(3):273–304. https://doi.org/10.1207/s15327809jls1303_2

Ruggiero VR (2012) The art of thinking: a guide to critical and creative thought, 4th edn. Harper Collins College Publishers, New York

Schellens T, Valcke M (2006) Fostering knowledge construction in university students through asynchronous discussion groups. Comput Educ 46(4):349–370. https://doi.org/10.1016/j.compedu.2004.07.010

Sendag S, Odabasi HF (2009) Effects of an online problem based learning course on content knowledge acquisition and critical thinking skills. Comput Educ 53(1):132–141. https://doi.org/10.1016/j.compedu.2009.01.008

Sison R (2008) Investigating Pair Programming in a Software Engineering Course in an Asian Setting. 2008 15th Asia-Pacific Software Engineering Conference, pp. 325–331. https://doi.org/10.1109/APSEC.2008.61

Simpson E, Courtney M (2002) Critical thinking in nursing education: literature review. Mary Courtney 8(2):89–98

Stewart L, Tierney J, Burdett S (2006) Do systematic reviews based on individual patient data offer a means of circumventing biases associated with trial publications? Publication bias in meta-analysis. John Wiley and Sons Inc, New York, pp. 261–286

Tiwari A, Lai P, So M, Yuen K (2010) A comparison of the effects of problem-based learning and lecturing on the development of students’ critical thinking. Med Educ 40(6):547–554. https://doi.org/10.1111/j.1365-2929.2006.02481.x

Wood D, Bruner JS, Ross G (2006) The role of tutoring in problem solving. J Child Psychol Psychiatry 17(2):89–100. https://doi.org/10.1111/j.1469-7610.1976.tb00381.x

Wei T, Hong S (2022) The meaning and realization of teachable critical thinking. Educ Theory Practice 10:51–57

Xu EW, Wang W, Wang QX (2022) A meta-analysis of the effectiveness of programming teaching in promoting K-12 students’ computational thinking. Educ Inf Technol. https://doi.org/10.1007/s10639-022-11445-2

Yang YC, Newby T, Bill R (2008) Facilitating interactions through structured web-based bulletin boards: a quasi-experimental study on promoting learners’ critical thinking skills. Comput Educ 50(4):1572–1585. https://doi.org/10.1016/j.compedu.2007.04.006

Yore LD, Pimm D, Tuan HL (2007) The literacy component of mathematical and scientific literacy. Int J Sci Math Educ 5(4):559–589. https://doi.org/10.1007/s10763-007-9089-4

Zhang T, Zhang S, Gao QQ, Wang JH (2022) Research on the development of learners’ critical thinking in online peer review. Audio Visual Educ Res 6:53–60. https://doi.org/10.13811/j.cnki.eer.2022.06.08

Download references

Acknowledgements

This research was supported by the graduate scientific research and innovation project of Xinjiang Uygur Autonomous Region named “Research on in-depth learning of high school information technology courses for the cultivation of computing thinking” (No. XJ2022G190) and the independent innovation fund project for doctoral students of the College of Educational Science of Xinjiang Normal University named “Research on project-based teaching of high school information technology courses from the perspective of discipline core literacy” (No. XJNUJKYA2003).

Author information

Authors and affiliations.

College of Educational Science, Xinjiang Normal University, 830017, Urumqi, Xinjiang, China

Enwei Xu, Wei Wang & Qingxia Wang

You can also search for this author in PubMed   Google Scholar

Corresponding authors

Correspondence to Enwei Xu or Wei Wang .

Ethics declarations

Competing interests.

The authors declare no competing interests.

Ethical approval

This article does not contain any studies with human participants performed by any of the authors.

Informed consent

Additional information.

Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary information

Supplementary tables, rights and permissions.

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/ .

Reprints and permissions

About this article

Cite this article.

Xu, E., Wang, W. & Wang, Q. The effectiveness of collaborative problem solving in promoting students’ critical thinking: A meta-analysis based on empirical literature. Humanit Soc Sci Commun 10 , 16 (2023). https://doi.org/10.1057/s41599-023-01508-1

Download citation

Received : 07 August 2022

Accepted : 04 January 2023

Published : 11 January 2023

DOI : https://doi.org/10.1057/s41599-023-01508-1

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

This article is cited by

Impacts of online collaborative learning on students’ intercultural communication apprehension and intercultural communicative competence.

• Hoa Thi Hoang Chau
• Hung Phu Bui
• Quynh Thi Huong Dinh

Education and Information Technologies (2024)

Exploring the effects of digital technology on deep learning: a meta-analysis

Sustainable electricity generation and farm-grid utilization from photovoltaic aquaculture: a bibliometric analysis.

• A. A. Amusa
• M. Alhassan

International Journal of Environmental Science and Technology (2024)

Quick links

• Explore articles by subject
• Guide to authors
• Editorial policies

• Utility Menu

Google Fonts

Creativity & problem-solving.

The Laboratory for Innovation Science at Harvard (LISH) is conducting research and creating evidence-based approaches to problem-solving. Researchers at LISH are identifying the best way to approach a problem, starting with problem formulation, and experimenting with solvers on the best way to find solutions.

Key Questions

How does the nature of the problem to be solved impact the most optimal problem-solving approaches to be used?

How can problems be best formulated so that outsiders can help solve them, how does diversity in knowledge and skills impact problem-solving, can creativity be enhanced through teams and/or exposure to peers, these four research questions frame projects in this track, pushing the boundaries of medical imaging and computational biology through artificial intelligence and algorithm development, extensive crowdsourcing work with nasa and other federal agencies, and using data science to help create a history of the partition of british india. see below for more information on each of the individual projects in this research track., nasa tournament lab.

The NASA Tournament Lab was originally established in 2010 as a joint initiative between NASA’s Center of Excellence for Collaborative Innovation (CoECI), Harvard Business School, and the Institute for Quantitative Social Science, to design and field challenges and contests... Read more about NASA Tournament Lab

Computational Biology Algorithms

Drivers of medical imaging diagnoses, integrating crowds into academic labs, advanced analytics challenges.

With the digital transformation in business and academia, the demand for advanced data analytics is increasing. LISH partners with foundations, government agencies, and research labs to access data analytics solutions through the crowd.... Read more about Advanced Analytics Challenges

Crowdsourcing for Social Good

Crowdsourcing memories from the 1947 partition of british india.

Working with the Lakshmi Mittal and Family South Asia Institute at Harvard University, this project aims to collect and analyze oral histories and memories of the 1947 Partition of British India with a focus on minority voices. Aspects of this project include gathering discrete historical data such as locations and descriptions of refugee camps; mapping geographical locations... Read more about Crowdsourcing Memories from the 1947 Partition of British India

Developing a Process to Foster Co-creation by Patients and Caretakers and our Research Communities

A joint project with Harvard Catalyst — Reactor , this initiative aims to pair patient- and caregiver-derived solutions with research labs at Boston-area medical schools to develop innovative tools to benefit the patients, their disease communities, and others with similar needs.... Read more about Developing a Process to Foster Co-creation by Patients and Caretakers and our Research Communities

City Challenges

LISH researchers are designing experiments wrapped around NYU GovLab’s City Challenges. The City Challenges program aims to use competitions and coaching to solve urban problems. See here for information on a prior challenge.

Related Publications

Free and Open Source Software (FOSS) has become a critical part of the modern economy. There are tens of millions of FOSS projects, many of which are built into software and products we use every day. However, it is difficult to fully understand the health, economic value, and security of FOSS because it is produced in a decentralized and distributed manner. This distributed development approach makes it unclear how much FOSS, and precisely what FOSS projects, are most widely used. This lack of understanding is a critical problem faced by those who want to help enhance the security of FOSS (e.g., companies, governments, individuals), yet do not know what projects to start with. This problem has garnered widespread attention with the Heartbleed and log4shell vulnerabilities that resulted in the susceptibility of hundreds of millions of devices to exploitation.

This report, Census II, is the second investigation into the widespread use of FOSS and aggregates data from over half a million observations of FOSS libraries used in production applications at thousands of companies, which aims to shed light on the most commonly used FOSS packages at the application library level. This effort builds on the Census I report that focused on the lower level critical operating system libraries and utilities, improving our understanding of the FOSS packages that software applications rely on. Such insights will help to identify critical FOSS packages to allow for resource prioritization to address security issues in this widely used software.

The Census II effort utilizes data from partner Software Composition Analysis (SCA) companies including Snyk, the Synopsys Cybersecurity Research Center (CyRC), and FOSSA, which partnered with Harvard to advance the state of open source research. Our goal is to not only identify the most widely used FOSS, but to also provide an example of how the distributed nature of FOSS requires a multi-party effort to fully understand the value and security of the FOSS ecosystem. Only through data-sharing, coordination, and investment will the value of this critical component of the digital economy be preserved for generations to come.

In addition to the detailed results on FOSS usage provided in the report, we identified five high-level findings: 1) the need for a standardized naming schema for software components, 2) the complexities associated with package versions, 3) much of the most widely used FOSS is developed by only a handful of contributors, 4) the increasing importance of individual developer account security, and 5) the persistence of legacy software in the open source space.

Karim R. Lakhani, Anne-Laure Fayard, Manos Gkeredakis, and Jin Hyun Paik . 10/5/2020. “ OpenIDEO (B) ”. Publisher's Version Abstract In the midst of 2020, as the coronavirus pandemic was unfolding, OpenIDEO - an online open innovation platform focused on design-driven solutions to social issues - rapidly launched a new challenge to improve access to health information, empower communities to stay safe during the COVID-19 crisis, and inspire global leaders to communicate effectively. OpenIDEO was particularly suited to challenges which required cross-system or sector-wide collaboration due to its focus on social impact and ecosystem design, but its leadership pondered how they could continue to improve virtual collaboration and to share their insights from nearly a decade of running online challenges. Conceived as an exercise of disruptive digital innovation, OpenIDEO successfully created a strong open innovation community, but how could they sustain - or even improve - their support to community members and increase the social impact of their online challenges in the coming years?

This paper presents NASA’s experience using a Center of Excellence (CoE) to scale and sustain an open innovation program as an effective problem-solving tool and includes strategic management recommendations for other organizations based on lessons learned.

This paper defines four phases of implementing an open innovation program: Learn, Pilot, Scale and Sustain. It provides guidance on the time required for each phase and recommendations for how to utilize a CoE to succeed. Recommendations are based upon the experience of NASA’s Human Health and Performance Directorate, and experience at the Laboratory for Innovation Science at Harvard running hundreds of challenges with research and development organizations.

Lessons learned include the importance of grounding innovation initiatives in the business strategy, assessing the portfolio of work to select problems most amenable to solving via crowdsourcing methodology, framing problems that external parties can solve, thinking strategically about early wins, selecting the right platforms, developing criteria for evaluation, and advancing a culture of innovation. Establishing a CoE provides an effective infrastructure to address both technical and cultural issues.

The NASA experience spanned more than seven years from initial learnings about open innovation concepts to the successful scaling and sustaining of an open innovation program; this paper provides recommendations on how to decrease this timeline to three years.

Tomohiro Ishibashi (Bashi), chief executive officer for B to S, and Julia Foote LeStage, chief innovation officer of Weathernews Inc., were addressing a panel at the HBS Digital Summit on creative uses of big data. They told the summit attendees about how the Sakura (cherry blossoms) Project, where the company asked users in Japan to report about how cherry blossoms were blooming near them day by day, had opened up opportunities for the company's consumer business in Japan. The project ultimately garnered positive publicity and became a foothold to building the company's crowdsourcing weather-forecasting service in Japan. It changed the face of weather forecasting in Japan. Bashi and LeStage wondered whether the experience could be applied to the U.S. market.

BACKGROUND: The association of differing genotypes with disease-related phenotypic traits offers great potential to both help identify new therapeutic targets and support stratification of patients who would gain the greatest benefit from specific drug classes. Development of low-cost genotyping and sequencing has made collecting large-scale genotyping data routine in population and therapeutic intervention studies. In addition, a range of new technologies is being used to capture numerous new and complex phenotypic descriptors. As a result, genotype and phenotype datasets have grown exponentially. Genome-wide association studies associate genotypes and phenotypes using methods such as logistic regression. As existing tools for association analysis limit the efficiency by which value can be extracted from increasing volumes of data, there is a pressing need for new software tools that can accelerate association analyses on large genotype-phenotype datasets.

RESULTS: Using open innovation (OI) and contest-based crowdsourcing, the logistic regression analysis in a leading, community-standard genetics software package (PLINK 1.07) was substantially accelerated. OI allowed us to do this in <6 months by providing rapid access to highly skilled programmers with specialized, difficult-to-find skill sets. Through a crowd-based contest a combination of computational, numeric, and algorithmic approaches was identified that accelerated the logistic regression in PLINK 1.07 by 18- to 45-fold. Combining contest-derived logistic regression code with coarse-grained parallelization, multithreading, and associated changes to data initialization code further developed through distributed innovation, we achieved an end-to-end speedup of 591-fold for a data set size of 6678 subjects by 645 863 variants, compared to PLINK 1.07's logistic regression. This represents a reduction in run time from 4.8 hours to 29 seconds. Accelerated logistic regression code developed in this project has been incorporated into the PLINK2 project.

CONCLUSIONS: Using iterative competition-based OI, we have developed a new, faster implementation of logistic regression for genome-wide association studies analysis. We present lessons learned and recommendations on running a successful OI process for bioinformatics.

Most United States Patent and Trademark Office (USPTO) patent documents contain drawing pages which describe inventions graphically. By convention and by rule, these drawings contain figures and parts that are annotated with numbered labels but not with text. As a result, readers must scan the document to find the description of a given part label. To make progress toward automatic creation of ‘tool-tips’ and hyperlinks from part labels to their associated descriptions, the USPTO hosted a monthlong online competition in which participants developed algorithms to detect figures and diagram part labels. The challenge drew 232 teams of two, of which 70 teams (30 %) submitted solutions. An unusual feature was that each patent was represented by a 300-dpi page scan along with an HTML file containing patent text, allowing integration of text processing and graphics recognition in participant algorithms. The design and performance of the top-5 systems are presented along with a system developed after the competition, illustrating that the winning teams produced near state-of-the-art results under strict time and computation constraints. The first place system used the provided HTML text, obtaining a harmonic mean of recall and precision (F-measure) of 88.57 % for figure region detection, 78.81 % for figure regions with correctly recognized figure titles, and 70.98 % for part label detection and recognition. Data and source code for the top-5 systems are available through the online UCI Machine Learning Repository to support follow-on work by others in the document recognition community.

• SUGGESTED TOPICS
• The Magazine
• Newsletters
• Managing Yourself
• Managing Teams
• Work-life Balance
• The Big Idea
• Data & Visuals
• Reading Lists
• Case Selections
• HBR Learning
• Topic Feeds
• Account Settings
• Email Preferences

How to Solve Problems

• Laura Amico

To bring the best ideas forward, teams must build psychological safety.

Teams today aren’t just asked to execute tasks: They’re called upon to solve problems. You’d think that many brains working together would mean better solutions, but the reality is that too often problem-solving teams fall victim to inefficiency, conflict, and cautious conclusions. The two charts below will help your team think about how to collaborate better and come up with the best solutions for the thorniest challenges.

• Laura Amico is a former senior editor at Harvard Business Review.

Partner Center

An official website of the United States government

The .gov means it’s official. Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

The site is secure. The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

• Publications
• Account settings

Preview improvements coming to the PMC website in October 2024. Learn More or Try it out now .

• Advanced Search
• Journal List
• Elsevier - PMC COVID-19 Collection

Problem solving through values: A challenge for thinking and capability development

• • This paper introduces the 4W framework of consistent problem solving through values.
• • The 4W suggests when, how and why the explication of values helps to solve a problem.
• • The 4W is significant to teach students to cope with problems having crucial consequences.
• • The paper considers challenges using such framework of thinking in different fields of education.

The paper aims to introduce the conceptual framework of problem solving through values. The framework consists of problem analysis, selection of value(s) as a background for the solution, the search for alternative ways of the solution, and the rationale for the solution. This framework reveals when, how, and why is important to think about values when solving problems. A consistent process fosters cohesive and creative value-based thinking during problem solving rather than teaching specific values. Therefore, the framework discloses the possibility for enabling the development of value-grounded problem solving capability.The application of this framework highlights the importance of responsibility for the chosen values that are the basis for the alternatives which determine actions. The 4W framework is meaningful for the people’s lives and their professional work. It is particularly important in the process of future professionals’ education. Critical issues concerning the development of problem solving through values are discussed when considering and examining options for the implementation of the 4W framework in educational institutions.

1. Introduction

The core competencies necessary for future professionals include problem solving based on complexity and collaborative approaches ( OECD, 2018 ). Currently, the emphasis is put on the development of technical, technological skills as well as system thinking and other cognitive abilities (e.g., Barber, 2018 ; Blanco, Schirmbeck, & Costa, 2018 ). Hence, education prepares learners with high qualifications yet lacking in moral values ( Nadda, 2017 ). Educational researchers (e.g., Barnett, 2007 ; Harland & Pickering, 2010 ) stress that such skills and abilities ( the how? ), as well as knowledge ( the what? ), are insufficient to educate a person for society and the world. The philosophy of education underlines both the epistemological and ontological dimensions of learning. Barnett (2007) points out that the ontological dimension has to be above the epistemological one. The ontological dimension encompasses the issues related to values that education should foster ( Harland & Pickering, 2010 ). In addition, values are closely related to the enablement of learners in educational environments ( Jucevičienė et al., 2010 ). For these reasons, ‘ the why ?’ based on values is required in the learning process. The question arises as to what values and how it makes sense to educate them. Value-based education seeks to address these issues and concentrates on values transfer due to their integration into the curriculum. Yazdani and Akbarilakeh (2017) discussed that value-based education could only convey factual knowledge of values and ethics. However, such education does not guarantee the internalization of values. Nevertheless, value-based education indicates problem solving as one of the possibilities to develop values.

Values guide and affect personal behavior encompassing the ethical aspects of solutions ( Roccas, Sagiv, & Navon, 2017 ; Schwartz, 1992 , 2012 ; Verplanken & Holland, 2002 ). Therefore, they represent the essential foundation for solving a problem. Growing evidence indicates the creative potential of values ( Dollinger, Burke, & Gump, 2007 ; Kasof, Chen, Himsel, & Greenberger, 2007 ; Lebedeva et al., 2019) and emphasizes their significance for problem solving. Meanwhile, research in problem solving pays little attention to values. Most of the problem solving models (e.g., Newell & Simon, 1972 ; Jonassen, 1997 ) utilize a rational economic approach. Principally, the research on the mechanisms of problem solving have been conducted under laboratory conditions performing simple tasks ( Csapó & Funke, 2017 ). Moreover, some of the decision-making models share the same steps as problem solving (c.f., Donovan, Guss, & Naslund, 2015 ). This explains why these terms are sometimes used interchangeably ( Huitt, 1992 ). Indeed, decision-making is a part of problem solving, which emerges while choosing between alternatives. Yet, values, moral, and ethical issues are more common in decision-making research (e.g., Keeney, 1994 ; Verplanken & Holland, 2002 ; Hall & Davis, 2007 ; Sheehan & Schmidt, 2015 ). Though, research by Shepherd, Patzelt, and Baron (2013) , Baron, Zhao, and Miao (2015) has affirmed that contemporary business decision makers rather often leave aside ethical issues and moral values. Thus, ‘ethical disengagement fallacy’ ( Sternberg, 2017, p.7 ) occurs as people think that ethics is more relevant to others. In the face of such disengagement, ethical issues lose their prominence.

The analysis of the literature revealed a wide field of problem solving research presenting a range of more theoretical insights rather empirical evidence. Despite this, to date, a comprehensive model that reveals how to solve problems emphasizing thinking about values is lacking. This underlines the relevance of the chosen topic, i.e. a challenge for thinking and for the development of capabilities addressing problems through values. To address this gap, the following issues need to be investigated: When, how, and why a problem solver should take into account values during problem solving? What challenges may occur for using such framework of thinking in different fields of education? Aiming this, the authors of the paper substantiated the conceptual framework of problem solving grounded in consistent thinking about values. The substantiation consists of several parts. First, different approaches to solving problems were examined. Second, searching to reveal the possibilities of values integration into problem solving, value-based approaches significant for problem solving were critically analyzed. Third, drawing on the effect of values when solving a problem and their creative potential, the authors of this paper claim that the identification of values and their choice for a solution need to be specified in the process of problem solving. As a synthesis of conclusions coming from the literature review and conceptual extensions regarding values, the authors of the paper created the coherent framework of problem solving through values (so called 4W).

The novelty of the 4W framework is exposed by several contributions. First, the clear design of overall problem solving process with attention on integrated thinking about values is used. Unlike in most models of problem solving, the first stage encompass the identification of a problem, an analysis of a context and the perspectives that influence the whole process, i.e. ‘What?’. The stage ‘What is the basis for a solution?’ focus on values identification and their choice. The stage ‘Ways how?’ encourages to create alternatives considering values. The stage ‘Why?’ represent justification of a chosen alternative according particular issues. Above-mentioned stages including specific steps are not found in any other model of problem solving. Second, even two key stages nurture thinking about values. The specificity of the 4W framework allows expecting its successful practical application. It may help to solve a problem more informed revealing when and how the explication of values helps to reach the desired value-based solution. The particular significance is that the 4W framework can be used to develop capabilities to solve problems through values. The challenges to use the 4W framework in education are discussed.

2. Methodology

To create the 4W framework, the integrative literature review was chosen. According to Snyder (2019) , this review is ‘useful when the purpose of the review is not to cover all articles ever published on the topic but rather to combine perspectives to create new theoretical models’ (p.334). The scope of this review focused on research disclosing problem solving process that paid attention on values. The following databases were used for relevant information search: EBSCO/Hostdatabases (ERIC, Education Source), Emerald, Google Scholar. The first step of this search was conducted using integrated keywords problem solving model , problem solving process, problem solving steps . These keywords were combined with the Boolean operator AND with the second keywords values approach, value-based . The inclusion criteria were used to identify research that: presents theoretical backgrounds and/or empirical evidences; performed within the last 5 years; within an educational context; availability of full text. The sources appropriate for this review was very limited in scope (N = 2).

We implemented the second search only with the same set of the integrated keywords. The inclusion criteria were the same except the date; this criterion was extended up to 10 years. This search presented 85 different sources. After reading the summaries, introductions and conclusions of the sources found, the sources that do not explicitly provide the process/models/steps of problem solving for teaching/learning purposes and eliminates values were excluded. Aiming to see a more accurate picture of the chosen topic, we selected secondary sources from these initial sources.

Several important issues were determined as well. First, most researchers ground their studies on existing problem solving models, however, not based on values. Second, some of them conducted empirical research in order to identify the process of studies participants’ problem solving. Therefore, we included sources without date restrictions trying to identify the principal sources that reveal the process/models/steps of problem solving. Third, decision-making is a part of problem solving process. Accordingly, we performed a search with the additional keywords decision-making AND values approach, value-based decision-making . We used such inclusion criteria: presents theoretical background and/or empirical evidence; no date restriction; within an educational context; availability of full text. These all searches resulted in a total of 16 (9 theoretical and 7 empirical) sources for inclusion. They were the main sources that contributed most fruitfully for the background. We used other sources for the justification the wholeness of the 4W framework. We present the principal results of the conducted literature review in the part ‘The background of the conceptual framework’.

3. The background of the conceptual framework

3.1. different approaches of how to solve a problem.

Researchers from different fields focus on problem solving. As a result, there still seems to be a lack of a conventional definition of problem solving. Regardless of some differences, there is an agreement that problem solving is a cognitive process and one of the meaningful and significant ways of learning ( Funke, 2014 ; Jonassen, 1997 ; Mayer & Wittrock, 2006 ). Differing in approaches to solving a problem, researchers ( Collins, Sibthorp, & Gookin, 2016 ; Jonassen, 1997 ; Litzinger et al., 2010 ; Mayer & Wittrock, 2006 ; O’Loughlin & McFadzean, 1999 ; ect.) present a variety of models that differ in the number of distinct steps. What is similar in these models is that they stress the procedural process of problem solving with the focus on the development of specific skills and competences.

For the sake of this paper, we have focused on those models of problem solving that clarify the process and draw attention to values, specifically, on Huitt (1992) , Basadur, Ellspermann, and Evans (1994) , and Morton (1997) . Integrating the creative approach to problem solving, Newell and Simon (1972) presents six phases: phase 1 - identifying the problem, phase 2 - understanding the problem, phase 3 - posing solutions, phase 4 - choosing solutions, phase 5 - implementing solutions, and phase 6 - final analysis. The weakness of this model is that these phases do not necessarily follow one another, and several can coincide. However, coping with simultaneously occurring phases could be a challenge, especially if these are, for instance, phases five and six. Certainly, it may be necessary to return to the previous phases for further analysis. According to Basadur et al. (1994) , problem solving consists of problem generation, problem formulation, problem solving, and solution implementation stages. Huitt (1992) distinguishes four stages in problem solving: input, processing, output, and review. Both Huitt (1992) and Basadur et al. (1994) four-stage models emphasize a sequential process of problem solving. Thus, problem solving includes four stages that are used in education. For example, problem-based learning employs such stages as introduction of the problem, problem analysis and learning issues, discovery and reporting, solution presentation and evaluation ( Chua, Tan, & Liu, 2016 ). Even PISA 2012 framework for problem solving composes four stages: exploring and understanding, representing and formulating, planning and executing, monitoring and reflecting ( OECD, 2013 ).

Drawing on various approaches to problem solving, it is possible to notice that although each stage is named differently, it is possible to reveal some general steps. These steps reflect the essential idea of problem solving: a search for the solution from the initial state to the desirable state. The identification of a problem and its contextual elements, the generation of alternatives to a problem solution, the evaluation of these alternatives according to specific criteria, the choice of an alternative for a solution, the implementation, and monitoring of the solution are the main proceeding steps in problem solving.

3.2. Value-based approaches relevant for problem solving

Huitt (1992) suggests that important values are among the criteria for the evaluation of alternatives and the effectiveness of a chosen solution. Basadur et al. (1994) point out to visible values in the problem formulation. Morton (1997) underlines that interests, investigation, prevention, and values of all types, which may influence the process, inspire every phase of problem solving. However, the aforementioned authors do not go deeper and do not seek to disclose the significance of values for problem solving.

Decision-making research shows more possibilities for problem solving and values integration. Sheehan and Schmidt (2015) model of ethical decision-making includes moral sensitivity, moral judgment, moral motivation, and moral action where values are presented in the component of moral motivation. Another useful approach concerned with values comes from decision-making in management. It is the concept of Value-Focused Thinking (VFT) proposed by Keeney (1994) . The author argues that the goals often are merely means of achieving results in traditional models of problem solving. Such models frequently do not help to identify logical links between the problem solving goals, values, and alternatives. Thus, according to Keeney (1994) , the decision-making starts with values as they are stated in the goals and objectives of decision-makers. VFT emphasizes the core values of decision-makers that are in a specific context as well as how to find a way to achieve them by using means-ends analysis. The weakness of VFT is its restriction to this means-ends analysis. According to Shin, Jonassen, and McGee (2003) , in searching for a solution, such analysis is weak as the problem solver focuses simply on removing inadequacies between the current state and the goal state. The strengths of this approach underline that values are included in the decision before alternatives are created. Besides, values help to find creative and meaningful alternatives and to assess them. Further, they include the forthcoming consequences of the decision. As VFT emphasizes the significant function of values and clarifies the possibilities of their integration into problem solving, we adapt this approach in the current paper.

3.3. The effect of values when solving a problem

In a broader sense, values provide a direction to a person’s life. Whereas the importance of values is relatively stable over time and across situations, Roccas et al. (2017) argue that values differ in their importance to a person. Verplanken and Holland (2002) investigated the relationship between values and choices or behavior. The research revealed that the activation of a value and the centrality of a value to the self, are the essential elements for value-guided behavior. The activation of values could happen in such cases: when values are the primary focus of attention; if the situation or the information a person is confronted with implies values; when the self is activated. The centrality of a particular value is ‘the degree to which an individual has incorporated this value as part of the self’ ( Verplanken & Holland, 2002, p.436 ). Thus, the perceived importance of values and attention to them determine value-guided behavior.

According to Argandoña (2003) , values can change due to external (changing values in the people around, in society, changes in situations, etc.) and internal (internalization by learning) factors affecting the person. The research by Hall and Davis (2007) indicates that the decision-makers’ applied value profile temporarily changed as they analyzed the issue from multiple perspectives and revealed the existence of a broader set of values. The study by Kirkman (2017) reveal that participants noticed the relevance of moral values to situations they encountered in various contexts.

Values are tightly related to personal integrity and identity and guide an individual’s perception, judgment, and behavior ( Halstead, 1996 ; Schwartz, 1992 ). Sheehan and Schmidt (2015) found that values influenced ethical decision-making of accounting study programme students when they uncovered their own values and grounded in them their individual codes of conduct for future jobs. Hence, the effect of values discloses by observing the problem solver’s decision-making. The latter observations could explain the abundance of ethics-laden research in decision-making rather than in problem solving.

Contemporary researchers emphasize the creative potential of values. Dollinger et al. (2007) , Kasof et al. (2007) , Lebedeva, Schwartz, Plucker, & Van De Vijver, 2019 present to some extent similar findings as they all used Schwartz Value Survey (respectively: Schwartz, 1992 ; ( Schwartz, 1994 ), Schwartz, 2012 ). These studies disclosed that such values as self-direction, stimulation and universalism foster creativity. Kasof et al. (2007) focused their research on identified motivation. Stressing that identified motivation is the only fully autonomous type of external motivation, authors define it as ‘the desire to commence an activity as a means to some end that one greatly values’ (p.106). While identified motivation toward specific values (italic in original) fosters the search for outcomes that express those specific values, this research demonstrated that it could also inhibit creative behavior. Thus, inhibition is necessary, especially in the case where reckless creativity could have painful consequences, for example, when an architect creates a beautiful staircase without a handrail. Consequently, creativity needs to be balanced.

Ultimately, values affect human beings’ lives as they express the motivational goals ( Schwartz, 1992 ). These motivational goals are the comprehensive criteria for a person’s choices when solving problems. Whereas some problem solving models only mention values as possible evaluation criteria, but they do not give any significant suggestions when and how the problem solver could think about the values coming to the understanding that his/her values direct the decision how to solve the problem. The authors of this paper claim that the identification of personal values and their choice for a solution need to be specified in the process of problem solving. This position is clearly reflected in humanistic philosophy and psychology ( Maslow, 2011 ; Rogers, 1995 ) that emphasize personal responsibility for discovering personal values through critical questioning, honest self-esteem, self-discovery, and open-mindedness in the constant pursuit of the truth in the path of individual life. However, fundamental (of humankind) and societal values should be taken into account. McLaughlin (1997) argues that a clear boundary between societal and personal values is difficult to set as they are intertwined due to their existence in complex cultural, social, and political contexts at a particular time. A person is related to time and context when choosing values. As a result, a person assumes existing values as implicit knowledge without as much as a consideration. This is particularly evident in the current consumer society.

Moreover, McLaughlin (1997) stresses that if a particular action should be tolerated and legitimated by society, it does not mean that this action is ultimately morally acceptable in all respects. Education has possibilities to reveal this. One such possibility is to turn to the capability approach ( Sen, 1990 ), which emphasizes what people are effectively able to do and to be. Capability, according to Sen (1990) , reflects a person’s freedom to choose between various ways of living, i.e., the focus is on the development of a person’s capability to choose the life he/she has a reason to value. According to Webster (2017) , ‘in order for people to value certain aspects of life, they need to appreciate the reasons and purposes – the whys – for certain valuing’ (italic in original; p.75). As values reflect and foster these whys, education should supplement the development of capability with attention to values ( Saito, 2003 ). In order to attain this possibility, a person has to be aware of and be able to understand two facets of values. Argandoña (2003) defines them as rationality and virtuality . Rationality refers to values as the ideal of conduct and involves the development of a person’s understanding of what values and why he/she should choose them when solving a problem. Virtuality approaches values as virtues and includes learning to enable a person to live according to his/her values. However, according to McLaughlin (1997) , some people may have specific values that are deep or self-evidently essential. These values are based on fundamental beliefs about the nature and purpose of the human being. Other values can be more or less superficial as they are based on giving priority to one or the other. Thus, virtuality highlights the depth of life harmonized to fundamentally rather than superficially laden values. These approaches inform the rationale for the framework of problem solving through values.

4. The 4W framework of problem solving through values

Similar to the above-presented stages of the problem solving processes, the introduced framework by the authors of this paper revisits them (see Fig. 1 ). The framework is titled 4W as its four stages respond to such questions: Analyzing the Problem: W hat ? → Choice of the value(s): W hat is the background for the solution? → Search for the alternative w ays of the solution: How ? → The rationale for problem solution: W hy is this alternative significant ? The stages of this framework cover seven steps that reveal the logical sequence of problem solving through values.

The 4 W framework: problem solving through values.

Though systematic problem solving models are criticized for being linear and inflexible (e.g., Treffinger & Isaksen, 2005 ), the authors of this paper assume a structural view of the problem solving process due to several reasons. First, the framework enables problem solvers to understand the thorough process of problem solving through values. Second, this framework reveals the depth of each stage and step. Third, problem solving through values encourages tackling problems that have crucial consequences. Only by understanding and mastering the coherence of how problems those require a value-based approach need to be addressed, a problem solver will be able to cope with them in the future. Finally, this framework aims at helping to recognize, to underline personal values, to solve problems through thinking about values, and to take responsibility for choices, even value-based. The feedback supports a direct interrelation between stages. It shapes a dynamic process of problem solving through values.

The first stage of problem solving through values - ‘ The analysis of the problem: What? ’- consists of three steps (see Fig. 1 ). The first step is ‘ Recognizing the problematic situation and naming the problem ’. This step is performed in the following sequence. First, the problem solver should perceive the problematic situation he/she faces in order to understand it. Dostál (2015) argues that the problematic situation has the potential to become the problem necessary to be addressed. Although each problem is limited by its context, not every problematic situation turns into a problem. This is related to the problem solver’s capability and the perception of reality: a person may not ‘see’ the problem if his/her capability to perceive it is not developed ( Dorst, 2006 ; Dostál, 2015 ). Second, after the problem solver recognizes the existence of the problematic situation, the problem solver has to identify the presence or absence of the problem itself, i.e. to name the problem. This is especially important in the case of the ill-structured problems since they cannot be directly visible to the problem solver ( Jonassen, 1997 ). Consequently, this step allows to determine whether the problem solver developed or has acquired the capability to perceive the problematic situation and the problem (naming the problem).

The second step is ‘ Analysing the context of the problem as a reason for its rise ’. At this step, the problem solver aims to analyse the context of the problem. The latter is one of the external issues, and it determines the solution ( Jonassen, 2011 ). However, if more attention is paid to the solution of the problem, it diverts attention from the context ( Fields, 2006 ). The problem solver has to take into account both the conveyed and implied contextual elements in the problematic situation ( Dostál, 2015 ). In other words, the problem solver has to examine it through his/her ‘contextual lenses’ ( Hester & MacG, 2017 , p.208). Thus, during this step the problem solver needs to identify the elements that shape the problem - reasons and circumstances that cause the problem, the factors that can be changed, and stakeholders that are involved in the problematic situation. Whereas the elements of the context mentioned above are within the problematic situation, the problem solver can control many of them. Such control can provide unique ways for a solution.

Although the problem solver tries to predict the undesirable results, some criteria remain underestimated. For that reason, it is necessary to highlight values underlying the various possible goals during the analysis ( Fields, 2006 ). According to Hester and MacG (2017) , values express one of the main features of the context and direct the attention of the problem solver to a given problematic situation. Hence, the problem solver should explore the value-based positions that emerge in the context of the problem.

The analysis of these contextual elements focus not only on a specific problematic situation but also on the problem that has emerged. This requires setting boundaries of attention for an in-depth understanding ( Fields, 2006 ; Hester & MacG, 2017 ). Such understanding influences several actions: (a) the recognition of inappropriate aspects of the problematic situation; (b) the emergence of paths in which identified aspects are expected to change. These actions ensure consistency and safeguard against distractions. Thus, the problem solver can now recognize and identify the factors that influence the problem although they are outside of the problematic situation. However, the problem solver possesses no control over them. With the help of such context analysis, the problem solver constructs a thorough understanding of the problem. Moreover, the problem solver becomes ready to look at the problem from different perspectives.

The third step is ‘ Perspectives emerging in the problem ’. Ims and Zsolnai (2009) argue that problem solving usually contains a ‘problematic search’. Such a search is a pragmatic activity as the problem itself induces it. Thus, the problem solver searches for a superficial solution. As a result, the focus is on control over the problem rather than a deeper understanding of the problem itself. The analysis of the problem, especially including value-based approaches, reveals the necessity to consider the problem from a variety of perspectives. Mitroff (2000) builds on Linstone (1989) ideas and claims that a sound foundation of both naming and solving any problem lays in such perspectives: the technical/scientific, the interpersonal/social, the existential, and the systemic (see Table 1 ).

The main characteristics of four perspectives for problem solving

Whereas all problems have significant aspects of each perspective, disregarding one or another may lead to the wrong way of solving the problem. While analysing all four perspectives is essential, this does not mean that they all are equally important. Therefore, it is necessary to justify why one or another perspective is more relevant and significant in a particular case. Such analysis, according to Linstone (1989) , ‘forces us to distinguish how we are looking from what we are looking at’ (p.312; italic in original). Hence, the problem solver broadens the understanding of various perspectives and develops the capability to see the bigger picture ( Hall & Davis, 2007 ).

The problem solver aims to identify and describe four perspectives that have emerged in the problem during this step. In order to identify perspectives, the problem solver search answers to the following questions. First, regarding the technical/scientific perspective: What technical/scientific reasons are brought out in the problem? How and to what extent do they influence a problem and its context? Second, regarding the interpersonal/social perspective: What is the impact of the problem on stakeholders? How does it influence their attitudes, living conditions, interests, needs? Third, regarding the existential perspective: How does the problem affect human feelings, experiences, perception, and/or discovery of meaning? Fourth, regarding the systemic perspective: What is the effect of the problem on the person → community → society → the world? Based on the analysis of this step, the problem solver obtains a comprehensive picture of the problem. The next stage is to choose the value(s) that will address the problem.

The second stage - ‘ The choice of value(s): What is the background for the solution?’ - includes the fourth and the fifth steps. The fourth step is ‘ The identification of value(s) as a base for the solution ’. During this step, the problem solver should activate his/her value(s) making it (them) explicit. In order to do this, the problem solver proceeds several sub-steps. First, the problem solver reflects taking into account the analysis done in previous steps. He/she raises up questions revealing values that lay in the background of this analysis: What values does this analyzed context allow me to notice? What values do different perspectives of the problem ‘offer’? Such questioning is important as values are deeply hidden ( Verplanken & Holland, 2002 ) and they form a bias, which restricts the development of the capability to see from various points of view ( Hall & Paradice, 2007 ). In the 4W framework, this bias is relatively eliminated due to the analysis of the context and exploration of the perspectives of a problem. As a result, the problem solver discovers distinct value-based positions and gets an opportunity to identify the ‘value uncaptured’ ( Yang, Evans, Vladimirova, & Rana, 2017, p.1796 ) within the problem analyzed. The problem solver observes that some values exist in the context (the second step) and the disclosed perspectives (the third step). Some of the identified values do not affect the current situation as they are not required, or their potential is not exploited. Thus, looking through various value-based lenses, the problem solver can identify and discover a congruence between the opportunities offered by the values in the problem’s context, disclosed perspectives and his/her value(s). Consequently, the problem solver decides what values he/she chooses as a basis for the desired solution. Since problems usually call for a list of values, it is important to find out their order of priority. Thus, the last sub-step requires the problem solver to choose between fundamentally and superficially laden values.

In some cases, the problem solver identifies that a set of values (more than one value) can lead to the desired solution. If a person chooses this multiple value-based position, two options emerge. The first option is concerned with the analysis of each value-based position separately (from the fifth to the seventh step). In the second option, a person has to uncover which of his/her chosen values are fundamentally laden and which are superficially chosen, considering the desired outcome in the current situation. Such clarification could act as a strategy where the path for the desired solution is possible going from superficially chosen value(s) to fundamentally laden one. When a basis for the solution is established, the problem solver formulates the goal for the desired solution.

The fifth step is ‘ The formulation of the goal for the solution ’. Problem solving highlights essential points that reveal the structure of a person’s goals; thus, a goal is the core element of problem solving ( Funke, 2014 ). Meantime, values reflect the motivational content of the goals ( Schwartz, 1992 ). The attention on the chosen value not only activates it, but also motivates the problem solver. The motivation directs the formulation of the goal. In such a way, values explicitly become a basis of the goal for the solution. Thus, this step involves the problem solver in formulating the goal for the solution as the desired outcome.

The way how to take into account value(s) when formulating the goal is the integration of value(s) chosen by the problem solver in the formulation of the goal ( Keeney, 1994 ). For this purpose the conjunction of a context for a solution (it is analyzed during the second step) and a direction of preference (the chosen value reveals it) serves for the formulation of the goal (that represents the desired solution). In other words, a value should be directly included into the formulation of the goal. The goal could lose value, if value is not included into the goal formulation and remains only in the context of the goal. Let’s take the actual example concerning COVID-19 situation. Naturally, many countries governments’ preference represents such value as human life (‘it is important of every individual’s life’). Thus, most likely the particular country government’s goal of solving the COVID situation could be to save the lifes of the country people. The named problem is a complex where the goal of its solution is also complex, although it sounds simple. However, if the goal as desired outcome is formulated without the chosen value, this value remains in the context and its meaning becomes tacit. In the case of above presented example - the goal could be formulated ‘to provide hospitals with the necessary equipment and facilities’. Such goal has the value ‘human’s life’ in the context, but eliminates the complexity of the problem that leads to a partial solution of the problem. Thus, this step from the problem solver requires caution when formulating the goal as the desired outcome. For this reason, maintaining value is very important when formulating the goal’s text. To avoid the loss of values and maintain their proposed direction, is necessary to take into account values again when creating alternatives.

The third stage - ‘ Search for the alternative ways for a solution: How? ’ - encompasses the sixth step, which is called ‘ Creation of value-based alternatives ’. Frequently problem solver invokes a traditional view of problem identification, generation of alternatives, and selection of criteria for evaluating findings. Keeney (1994) ; Ims and Zsolnai (2009) criticize this rational approach as it supports a search for a partial solution where an active search for alternatives is neglected. Moreover, a problematic situation, according to Perkins (2009) , can create the illusion of a fully framed problem with some apparent weighting and some variations of choices. In this case, essential and distinct alternatives to the solution frequently become unnoticeable. Therefore, Perkins (2009) suggest to replace the focus on the attempts to comprehend the problem itself. Thinking through the ‘value lenses’ offers such opportunities. The deep understanding of the problem leads to the search for the alternative ways of a solution.

Thus, the aim of this step is for the problem solver to reveal the possible alternative ways for searching a desired solution. Most people think they know how to create alternatives, but often without delving into the situation. First of all, the problem solver based on the reflection of (but not limited to) the analysis of the context and the perspectives of the problem generates a range of alternatives. Some of these alternatives represent anchored thinking as he/she accepts the assumptions implicit in generated alternatives and with too little focus on values.

The chosen value with the formulated goal indicates direction and encourages a broader and more creative search for a solution. Hence, the problem solver should consider some of the initial alternatives that could best support the achievement of the desired solution. Values are the principles for evaluating the desirability of any alternative or outcome ( Keeney, 1994 ). Thus, planned actions should reveal the desirable mode of conduct. After such consideration, he/she should draw up a plan setting out the actions required to implement each of considered alternatives.

Lastly, after a thorough examination of each considered alternative and a plan of its implementation, the problem solver chooses one of them. If the problem solver does not see an appropriate alternative, he/she develops new alternatives. However, the problem solver may notice (and usually does) that more than one alternative can help him/her to achieve the desired solution. In this case, he/she indicates which alternative is the main one and has to be implemented in the first place, and what other alternatives and in what sequence will contribute in searching for the desired solution.

The fourth stage - ‘ The rationale for the solution: Why ’ - leads to the seventh step: ‘ The justification of the chosen alternative ’. Keeney (1994) emphasizes the compatibility of alternatives in question with the values that guide the action. This underlines the importance of justifying the choices a person makes where the focus is on taking responsibility. According to Zsolnai (2008) , responsibility means a choice, i.e., the perceived responsibility essentially determines its choice. Responsible justification allows for discovering optimal balance when choosing between distinct value-based alternatives. It also refers to the alternative solution that best reflects responsibility in a particular value context, choice, and implementation.

At this stage, the problem solver revisits the chosen solution and revises it. The problem solver justifies his/her choice based on the following questions: Why did you choose this? Why is this alternative significant looking from the technical/scientific, the interpersonal/social, the existential, and the systemic perspectives? Could you take full responsibility for the implementation of this alternative? Why? How clearly do envisaged actions reflect the goal of the desired solution? Whatever interests and for what reasons do this alternative satisfies in principle? What else do you see in the chosen alternative?

As mentioned above, each person gives priority to one aspect or another. The problem solver has to provide solid arguments for the justification of the chosen alternative. The quality of arguments, according to Jonassen (2011) , should be judged based on the quality of the evidence supporting the chosen alternative and opposing arguments that can reject solutions. Besides, the pursuit of value-based goals reflects the interests of the individual or collective interests. Therefore, it becomes critical for the problem solver to justify the level of responsibility he/she takes in assessing the chosen alternative. Such a complex evaluation of the chosen alternative ensures the acceptance of an integral rather than unilateral solution, as ‘recognizing that, in the end, people benefit most when they act for the common good’ ( Sternberg, 2012, p.46 ).

5. Discussion

The constant emphasis on thinking about values as explicit reasoning in the 4W framework (especially from the choice of the value(s) to the rationale for problem solution) reflects the pursuit of virtues. Virtues form the features of the character that are related to the choice ( Argandoña, 2003 ; McLaughlin, 2005 ). Hence, the problem solver develops value-grounded problem solving capability as the virtuality instead of employing rationality for problem solving.

Argandoña (2003) suggests that, in order to make a sound valuation process of any action, extrinsic, transcendent, and intrinsic types of motives need to be considered. They cover the respective types of values. The 4W framework meets these requirements. An extrinsic motive as ‘attaining the anticipated or expected satisfaction’ ( Argandoña, 2003, p.17 ) is reflected in the formulation of the goal of the solution, the creation of alternatives and especially in the justification of the chosen alternative way when the problem solver revisits the external effect of his/her possible action. Transcendent motive as ‘generating certain effects in others’ ( Argandoña, 2003, p.17 ) is revealed within the analysis of the context, perspectives, and creating alternatives. When the learner considers the creation of alternatives and revisits the chosen alternative, he/she pays more attention to these motives. Two types of motives mentioned so far are closely related to an intrinsic motive that emphasizes learning development within the problem solver. These motives confirm that problem solving is, in fact, lifelong learning. In light of these findings, the 4W framework is concerned with some features of value internalization as it is ‘a psychological outcome of conscious mind reasoning about values’ ( Yazdani & Akbarilakeh, 2017, p.1 ).

The 4W framework is complicated enough in terms of learning. One issue is concerned with the educational environments ( Jucevičienė, 2008 ) required to enable the 4W framework. First, the learning paradigm, rather than direct instruction, lies at the foundation of such environments. Second, such educational environments include the following dimensions: (1) educational goal; (2) learning capacity of the learners; (3) educational content relevant to the educational goal: ways and means of communicating educational content as information presented in advance (they may be real, people among them, as well as virtual); (5) methods and means of developing educational content in the process of learners’ performance; (6) physical environment relevant to the educational goal and conditions of its implementation as well as different items in the environment; (7) individuals involved in the implementation of the educational goal.

Another issue is related to exercising this framework in practice. Despite being aware of the 4W framework, a person may still not want to practice problem solving through values, since most of the solutions are going to be complicated, or may even be painful. One idea worth looking into is to reveal the extent to which problem solving through values can become a habit of mind. Profound focus on personal values, context analysis, and highlighting various perspectives can involve changes in the problem solver’s habit of mind. The constant practice of problem solving through values could first become ‘the epistemic habit of mind’ ( Mezirow, 2009, p.93 ), which means a personal way of knowing things and how to use that knowledge. This echoes Kirkman (2017) findings. The developed capability to notice moral values in situations that students encountered changed some students’ habit of mind as ‘for having “ruined” things by making it impossible not to attend to values in such situations!’ (the feedback from one student; Kirkman, 2017, p.12 ). However, this is not enough, as only those problems that require a value-based approach are addressed. Inevitably, the problem solver eventually encounters the challenges of nurturing ‘the moral-ethical habit of mind’ ( Mezirow, 2009, p.93 ). In pursuance to develop such habits of mind, the curriculum should include the necessity of the practising of the 4W framework.

Thinking based on values when solving problems enables the problem solver to engage in thoughtful reflection in contrast to pragmatic and superficial thinking supported by the consumer society. Reflection begins from the first stage of the 4W framework. As personal values are the basis for the desired solution, the problem solver is also involved in self-reflection. The conscious and continuous reflection on himself/herself and the problematic situation reinforce each step of the 4W framework. Moreover, the fourth stage (‘The rationale for the solution: Why’) involves the problem solver in critical reflection as it concerned with justification of ‘the why , the reasons for and the consequences of what we do’ (italic, bold in original; Mezirow, 1990, p.8 ). Exercising the 4W framework in practice could foster reflective practice. Empirical evidence shows that reflective practice directly impacts knowledge, skills and may lead to changes in personal belief systems and world views ( Slade, Burnham, Catalana, & Waters, 2019 ). Thus, with the help of reflective practice it is possible to identify in more detail how and to what extent the 4W framework has been mastered, what knowledge gained, capabilities developed, how point of views changed, and what influence the change process.

Critical issues related to the development of problem solving through values need to be distinguished when considering and examining options for the implementation of the 4W framework at educational institutions. First, the question to what extent can the 4W framework be incorporated into various subjects needs to be answered. Researchers could focus on applying the 4W framework to specific subjects in the humanities and social sciences. The case is with STEM subjects. Though value issues of sustainable development and ecology are of great importance, in reality STEM teaching is often restricted to the development of knowledge and skills, leaving aside the thinking about values. The special task of the researchers is to help practitioners to apply the 4W framework in STEM subjects. Considering this, researchers could employ the concept of ‘dialogic space’ ( Wegerif, 2011, p.3 ) which places particular importance of dialogue in the process of education emphasizing both the voices of teachers and students, and materials. In addition, the dimensions of educational environments could be useful aligning the 4W framework with STEM subjects. As STEM teaching is more based on solving various special tasks and/or integrating problem-based learning, the 4W framework could be a meaningful tool through which content is mastered, skills are developed, knowledge is acquired by solving pre-prepared specific tasks. In this case, the 4W framework could act as a mean addressing values in STEM teaching.

Second is the question of how to enable the process of problem solving through values. In the current paper, the concept of enabling is understood as an integral component of the empowerment. Juceviciene et al. (2010) specify that at least two perspectives can be employed to explain empowerment : a) through the power of legitimacy (according to Freire, 1996 ); and b) through the perspective of conditions for the acquisition of the required knowledge, capabilities, and competence, i.e., enabling. In this paper the 4W framework does not entail the issue of legitimacy. This issue may occur, for example, when a teacher in economics is expected to provide students with subject knowledge only, rather than adding tasks that involve problem solving through values. Yet, the issue of legitimacy is often implicit. A widespread phenomenon exists that teaching is limited to certain periods that do not have enough time for problem solving through values. The issue of legitimacy as an organizational task that supports/or not the implementation of the 4W framework in any curriculum is a question that calls for further discussion.

Third (if not the first), the issue of an educator’s competence to apply such a framework needs to be addressed. In order for a teacher to be a successful enabler, he/she should have the necessary competence. This is related to the specific pedagogical knowledge and skills, which are highly dependent on the peculiarities of the subject being taught. Nowadays actualities are encouraging to pay attention to STEM subjects and their teacher training. For researchers and teacher training institutions, who will be interested in implementing the 4W framework in STEM subjects, it would be useful to draw attention to ‘a material-dialogic approach to pedagogy’ ( Hetherington & Wegerif, 2018, p.27 ). This approach creates the conditions for a deep learning of STEM subjects revealing additional opportunities for problem solving through values in teaching. Highlighting these opportunities is a task for further research.

In contrast to traditional problem solving models, the 4W framework is more concerned with educational purposes. The prescriptive approach to teaching ( Thorne, 1994 ) is applied to the 4W framework. This approach focuses on providing guidelines that enable students to make sound decisions by making explicit value judgements. The limitation is that the 4W framework is focused on thinking but not executing. It does not include the fifth stage, which would focus on the execution of the decision how to solve the problem. This stage may contain some deviation from the predefined process of the solution of the problem.

6. Conclusions

The current paper focuses on revealing the essence of the 4W framework, which is based on enabling the problem solver to draw attention to when, how, and why it is essential to think about values during the problem solving process from the perspective of it’s design. Accordingly, the 4W framework advocates the coherent approach when solving a problem by using a creative potential of values.

The 4W framework allows the problem solver to look through the lens of his/her values twice. The first time, while formulating the problem solving goal as the desired outcome. The second time is when the problem solver looks deeper into his/her values while exploring alternative ways to solve problems. The problem solver is encouraged to reason about, find, accept, reject, compare values, and become responsible for the consequences of the choices grounded on his/her values. Thus, the problem solver could benefit from the 4W framework especially when dealing with issues having crucial consequences.

An educational approach reveals that the 4W framework could enable the development of value-grounded problem solving capability. As problem solving encourages the development of higher-order thinking skills, the consistent inclusion of values enriches them.

The 4W framework requires the educational environments for its enablement. The enablement process of problem solving through values could be based on the perspective of conditions for the acquisition of the required knowledge and capability. Continuous practice of this framework not only encourages reflection, but can also contribute to the creation of the epistemic habit of mind. Applying the 4W framework to specific subjects in the humanities and social sciences might face less challenge than STEM ones. The issue of an educator’s competence to apply such a framework is highly important. The discussed issues present significant challenges for researchers and educators. Caring that the curriculum of different courses should foresee problem solving through values, both practicing and empirical research are necessary.

Declaration of interests

This research did not receive any specific grant from funding agencies in the public, commercial, or not-for-profit sectors.

Both authors have approved the final article.

• Argandoña A. Fostering values in organizations. Journal of Business Ethics. 2003; 45 (1–2):15–28. https://link.springer.com/content/pdf/10.1023/A:1024164210743.pdf [ Google Scholar ]
• Barber S. A truly “Transformative” MBA: Executive education for the fourth industrial revolution. Journal of Pedagogic Development. 2018; 8 (2):44–55. [ Google Scholar ]
• Barnett R. McGraw-Hill Education; UK): 2007. Will to learn: Being a student in an age of uncertainty. [ Google Scholar ]
• Baron R.A., Zhao H., Miao Q. Personal motives, moral disengagement, and unethical decisions by entrepreneurs: Cognitive mechanisms on the “slippery slope” Journal of Business Ethics. 2015; 128 (1):107–118. doi: 10.1007/s10551-014-2078-y. [ CrossRef ] [ Google Scholar ]
• Basadur M., Ellspermann S.J., Evans G.W. A new methodology for formulating ill-structured problems. Omega. 1994; 22 (6):627–645. doi: 10.1016/0305-0483(94)90053-1. [ CrossRef ] [ Google Scholar ]
• Blanco E., Schirmbeck F., Costa C. International Conference on Remote Engineering and Virtual Instrumentation . Springer; Cham: 2018. Vocational Education for the Industrial Revolution; pp. 649–658. [ Google Scholar ]
• Chua B.L., Tan O.S., Liu W.C. Journey into the problem-solving process: Cognitive functions in a PBL environment. Innovations in Education and Teaching International. 2016; 53 (2):191–202. doi: 10.1080/14703297.2014.961502. [ CrossRef ] [ Google Scholar ]
• Collins R.H., Sibthorp J., Gookin J. Developing ill-structured problem-solving skills through wilderness education. Journal of Experiential Education. 2016; 39 (2):179–195. doi: 10.1177/1053825916639611. [ CrossRef ] [ Google Scholar ]
• Csapó B., Funke J., editors. The nature of problem solving: Using research to inspire 21st century learning. OECD Publishing; 2017. The development and assessment of problem solving in 21st-century schools. (Chapter 1). [ CrossRef ] [ Google Scholar ]
• Dollinger S.J., Burke P.A., Gump N.W. Creativity and values. Creativity Research Journal. 2007; 19 (2-3):91–103. doi: 10.1080/10400410701395028. [ CrossRef ] [ Google Scholar ]
• Donovan S.J., Guss C.D., Naslund D. Improving dynamic decision making through training and self-reflection. Judgment and Decision Making. 2015; 10 (4):284–295. http://digitalcommons.unf.edu/apsy_facpub/2 [ Google Scholar ]
• Dorst K. Design problems and design paradoxes. Design Issues. 2006; 22 (3):4–17. doi: 10.1162/desi.2006.22.3.4. [ CrossRef ] [ Google Scholar ]
• Dostál J. Theory of problem solving. Procedia-Social and Behavioral Sciences. 2015; 174 :2798–2805. doi: 10.1016/j.sbspro.2015.01.970. [ CrossRef ] [ Google Scholar ]
• Fields A.M. Ill-structured problems and the reference consultation: The librarian’s role in developing student expertise. Reference Services Review. 2006; 34 (3):405–420. doi: 10.1108/00907320610701554. [ CrossRef ] [ Google Scholar ]
• Freire P. Continuum; New York: 1996. Pedagogy of the oppressed (revised) [ Google Scholar ]
• Funke J. Problem solving: What are the important questions?. Proceedings of the 36th Annual Conference of the Cognitive Science Society; Austin, TX: Cognitive Science Society; 2014. pp. 493–498. [ Google Scholar ]
• Hall D.J., Davis R.A. Engaging multiple perspectives: A value-based decision-making model. Decision Support Systems. 2007; 43 (4):1588–1604. doi: 10.1016/j.dss.2006.03.004. [ CrossRef ] [ Google Scholar ]
• Hall D.J., Paradice D. Investigating value-based decision bias and mediation: do you do as you think? Communications of the ACM. 2007; 50 (4):81–85. [ Google Scholar ]
• Halstead J.M. Values and values education in schools. In: Halstead J.M., Taylor M.J., editors. Values in education and education in values. The Falmer Press; London: 1996. pp. 3–14. [ Google Scholar ]
• Harland T., Pickering N. Routledge; 2010. Values in higher education teaching. [ Google Scholar ]
• Hester P.T., MacG K. Springer; New York: 2017. Systemic decision making: Fundamentals for addressing problems and messes. [ Google Scholar ]
• Hetherington L., Wegerif R. Developing a material-dialogic approach to pedagogy to guide science teacher education. Journal of Education for Teaching. 2018; 44 (1):27–43. doi: 10.1080/02607476.2018.1422611. [ CrossRef ] [ Google Scholar ]
• Huitt W. Problem solving and decision making: Consideration of individual differences using the Myers-Briggs type indicator. Journal of Psychological Type. 1992; 24 (1):33–44. [ Google Scholar ]
• Ims K.J., Zsolnai L. The future international manager. Palgrave Macmillan; London: 2009. Holistic problem solving; pp. 116–129. [ Google Scholar ]
• Jonassen D. Supporting problem solving in PBL. Interdisciplinary Journal of Problem-based Learning. 2011; 5 (2):95–119. doi: 10.7771/1541-5015.1256. [ CrossRef ] [ Google Scholar ]
• Jonassen D.H. Instructional design models for well-structured and III-structured problem-solving learning outcomes. Educational Technology Research and Development. 1997; 45 (1):65–94. doi: 10.1007/BF02299613. [ CrossRef ] [ Google Scholar ]
• Jucevičienė P. Educational and learning environments as a factor for socioeducational empowering of innovation. Socialiniai mokslai. 2008; 1 :58–70. [ Google Scholar ]
• Jucevičienė P., Gudaitytė D., Karenauskaitė V., Lipinskienė D., Stanikūnienė B., Tautkevičienė G. Technologija; Kaunas: 2010. Universiteto edukacinė galia: Atsakas XXI amžiaus iššūkiams [The educational power of university: the response to the challenges of the 21st century] [ Google Scholar ]
• Kasof J., Chen C., Himsel A., Greenberger E. Values and creativity. Creativity Research Journal. 2007; 19 (2–3):105–122. doi: 10.1080/10400410701397164. [ CrossRef ] [ Google Scholar ]
• Keeney R.L. Creativity in decision making with value-focused thinking. MIT Sloan Management Review. 1994; 35 (4):33–41. [ Google Scholar ]
• Kirkman R. Problem-based learning in engineering ethics courses. Interdisciplinary Journal of Problem-based Learning. 2017; 11 (1) doi: 10.7771/1541-5015.1610. [ CrossRef ] [ Google Scholar ]
• Lebedeva N., Schwartz S., Plucker J., Van De Vijver F. Domains of everyday creativity and personal values. Frontiers in Psychology. 2019; 9 :1–16. doi: 10.3389/fpsyg.2018.02681. [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Linstone H.A. Multiple perspectives: Concept, applications, and user guidelines. Systems Practice. 1989; 2 (3):307–331. [ Google Scholar ]
• Litzinger T.A., Meter P.V., Firetto C.M., Passmore L.J., Masters C.B., Turns S.R.…Zappe S.E. A cognitive study of problem solving in statics. Journal of Engineering Education. 2010; 99 (4):337–353. [ Google Scholar ]
• Maslow A.H. Vaga; Vilnius: 2011. Būties psichologija. [Psychology of Being] [ Google Scholar ]
• Mayer R., Wittrock M. Problem solving. In: Alexander P., Winne P., editors. Handbook of educational psychology. Psychology Press; New York, NY: 2006. pp. 287–303. [ Google Scholar ]
• McLaughlin T. The educative importance of ethos. British Journal of Educational Studies. 2005; 53 (3):306–325. doi: 10.1111/j.1467-8527.2005.00297.x. [ CrossRef ] [ Google Scholar ]
• McLaughlin T.H. Technologija; Kaunas: 1997. Šiuolaikinė ugdymo filosofija: demokratiškumas, vertybės, įvairovė [Contemporary philosophy of education: democracy, values, diversity] [ Google Scholar ]
• Mezirow J. Jossey-Bass Publishers; San Francisco: 1990. Fostering critical reflection in adulthood; pp. 1–12. https://my.liberatedleaders.com.au/wp-content/uploads/2017/02/How-Critical-Reflection-triggers-Transformative-Learning-Mezirow.pdf [ Google Scholar ]
• Mezirow J. Contemporary theories of learning. Routledge; 2009. An overview on transformative learning; pp. 90–105. (Chapter 6) [ Google Scholar ]
• Mitroff I. Šviesa; Kaunas: 2000. Kaip neklysti šiais beprotiškais laikais: ar mokame spręsti esmines problemas. [How not to get lost in these crazy times: do we know how to solve essential problems] [ Google Scholar ]
• Morton L. Teaching creative problem solving: A paradigmatic approach. Cal. WL Rev. 1997; 34 :375. [ Google Scholar ]
• Nadda P. Need for value based education. International Education and Research Journal. 2017; 3 (2) http://ierj.in/journal/index.php/ierj/article/view/690/659 [ Google Scholar ]
• Newell A., Simon H.A. Prentice-Hall; Englewood Cliffs, NJ: 1972. Human problem solving. [ Google Scholar ]
• OECD . PISA, OECD Publishing; Paris: 2013. PISA 2012 assessment and analytical framework: Mathematics, reading, science, problem solving and financial literacy . https://www.oecd.org/pisa/pisaproducts/PISA%202012%20framework%20e-book_final.pdf [ Google Scholar ]
• OECD . PISA, OECD Publishing; 2018. PISA 2015 results in focus . https://www.oecd.org/pisa/pisa-2015-results-in-focus.pdf [ Google Scholar ]
• O’Loughlin A., McFadzean E. Toward a holistic theory of strategic problem solving. Team Performance Management: An International Journal. 1999; 5 (3):103–120. [ Google Scholar ]
• Perkins D.N. Decision making and its development. In: Callan E., Grotzer T., Kagan J., Nisbett R.E., Perkins D.N., Shulman L.S., editors. Education and a civil society: Teaching evidence-based decision making. American Academy of Arts and Sciences; Cambridge, MA: 2009. pp. 1–28. (Chapter 1) [ Google Scholar ]
• Roccas S., Sagiv L., Navon M. Values and behavior. Cham: Springer; 2017. Methodological issues in studying personal values; pp. 15–50. [ Google Scholar ]
• Rogers C.R. Houghton Mifflin Harcourt; Boston: 1995. On becoming a person: A therapist’s view of psychotherapy. [ Google Scholar ]
• Saito M. Amartya Sen’s capability approach to education: A critical exploration. Journal of Philosophy of Education. 2003; 37 (1):17–33. doi: 10.1111/1467-9752.3701002. [ CrossRef ] [ Google Scholar ]
• Schwartz S.H. Universals in the content and structure of values: Theoretical advances and empirical tests in 20 countries. In: Zanna M.P., editor. Vol. 25. Academic Press; 1992. pp. 1–65. (Advances in experimental social psychology). [ Google Scholar ]
• Schwartz S.H. Are there universal aspects in the structure and contents of human values? Journal of social issues. 1994; 50 (4):19–45. [ Google Scholar ]
• Schwartz S.H. An overview of the Schwartz theory of basic values. Online Readings in Psychology and Culture. 2012; 2 (1):1–20. doi: 10.9707/2307-0919.1116. [ CrossRef ] [ Google Scholar ]
• Sen A. Development as capability expansion. The community development reader. 1990:41–58. http://www.masterhdfs.org/masterHDFS/wp-content/uploads/2014/05/Sen-development.pdf [ Google Scholar ]
• Sheehan N.T., Schmidt J.A. Preparing accounting students for ethical decision making: Developing individual codes of conduct based on personal values. Journal of Accounting Education. 2015; 33 (3):183–197. doi: 10.1016/j.jaccedu.2015.06.001. [ CrossRef ] [ Google Scholar ]
• Shepherd D.A., Patzelt H., Baron R.A. “I care about nature, but…”: Disengaging values in assessing opportunities that cause harm. The Academy of Management Journal. 2013; 56 (5):1251–1273. doi: 10.5465/amj.2011.0776. [ CrossRef ] [ Google Scholar ]
• Shin N., Jonassen D.H., McGee S. Predictors of well‐structured and ill‐structured problem solving in an astronomy simulation. Journal of Research in Science Teaching. 2003; 40 (1):6–33. doi: 10.1002/tea.10058. [ CrossRef ] [ Google Scholar ]
• Slade M.L., Burnham T.J., Catalana S.M., Waters T. The impact of reflective practice on teacher candidates’ learning. International Journal for the Scholarship of Teaching and Learning. 2019; 13 (2):15. doi: 10.20429/ijsotl.2019.130215. [ CrossRef ] [ Google Scholar ]
• Snyder H. Literature review as a research methodology: An overview and guidelines. Journal of Business Research. 2019; 104 :333–339. doi: 10.1016/j.jbusres.2019.07.039. [ CrossRef ] [ Google Scholar ]
• Sternberg R. Teaching for ethical reasoning. International Journal of Educational Psychology. 2012; 1 (1):35–50. doi: 10.4471/ijep.2012.03. [ CrossRef ] [ Google Scholar ]
• Sternberg R. Speculations on the role of successful intelligence in solving contemporary world problems. Journal of Intelligence. 2017; 6 (1):4. doi: 10.3390/jintelligence6010004. [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Thorne D.M. Environmental ethics in international business education: Descriptive and prescriptive dimensions. Journal of Teaching in International Business. 1994; 5 (1–2):109–122. doi: 10.1300/J066v05n01_08. [ CrossRef ] [ Google Scholar ]
• Treffinger D.J., Isaksen S.G. Creative problem solving: The history, development, and implications for gifted education and talent development. The Gifted Child Quarterly. 2005; 49 (4):342–353. doi: 10.1177/001698620504900407. [ CrossRef ] [ Google Scholar ]
• Verplanken B., Holland R.W. Motivated decision making: Effects of activation and self-centrality of values on choices and behavior. Journal of Personality and Social Psychology. 2002; 82 (3):434–447. doi: 10.1037/0022-3514.82.3.434. [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Webster R.S. Re-enchanting education and spiritual wellbeing. Routledge; 2017. Being spiritually educated; pp. 73–85. [ Google Scholar ]
• Wegerif R. Towards a dialogic theory of how children learn to think. Thinking Skills and Creativity. 2011; 6 (3):179–190. doi: 10.1016/j.tsc.2011.08.002. [ CrossRef ] [ Google Scholar ]
• Yang M., Evans S., Vladimirova D., Rana P. Value uncaptured perspective for sustainable business model innovation. Journal of Cleaner Production. 2017; 140 :1794–1804. doi: 10.1016/j.jclepro.2016.07.102. [ CrossRef ] [ Google Scholar ]
• Yazdani S., Akbarilakeh M. The model of value-based curriculum for medicine and surgery education in Iran. Journal of Minimally Invasive Surgical Sciences. 2017; 6 (3) doi: 10.5812/minsurgery.14053. [ CrossRef ] [ Google Scholar ]
• Zsolnai L. Transaction Publishers; New Brunswick and London: 2008. Responsible decision making. [ Google Scholar ]

• Bipolar Disorder
• Therapy Center
• When To See a Therapist
• Types of Therapy
• Best Online Therapy
• Best Couples Therapy
• Best Family Therapy
• Managing Stress
• Sleep and Dreaming
• Understanding Emotions
• Self-Improvement
• Healthy Relationships
• Student Resources
• Personality Types
• Guided Meditations
• Verywell Mind Insights
• 2024 Verywell Mind 25
• Mental Health in the Classroom
• Editorial Process
• Meet Our Review Board
• Crisis Support

Problem-Solving Strategies and Obstacles

Kendra Cherry, MS, is a psychosocial rehabilitation specialist, psychology educator, and author of the "Everything Psychology Book."

Sean is a fact-checker and researcher with experience in sociology, field research, and data analytics.

JGI / Jamie Grill / Getty Images

• Application
• Improvement

From deciding what to eat for dinner to considering whether it's the right time to buy a house, problem-solving is a large part of our daily lives. Learn some of the problem-solving strategies that exist and how to use them in real life, along with ways to overcome obstacles that are making it harder to resolve the issues you face.

What Is Problem-Solving?

In cognitive psychology , the term 'problem-solving' refers to the mental process that people go through to discover, analyze, and solve problems.

A problem exists when there is a goal that we want to achieve but the process by which we will achieve it is not obvious to us. Put another way, there is something that we want to occur in our life, yet we are not immediately certain how to make it happen.

Maybe you want a better relationship with your spouse or another family member but you're not sure how to improve it. Or you want to start a business but are unsure what steps to take. Problem-solving helps you figure out how to achieve these desires.

The problem-solving process involves:

• Discovery of the problem
• Deciding to tackle the issue
• Seeking to understand the problem more fully
• Researching available options or solutions
• Taking action to resolve the issue

Before problem-solving can occur, it is important to first understand the exact nature of the problem itself. If your understanding of the issue is faulty, your attempts to resolve it will also be incorrect or flawed.

Problem-Solving Mental Processes

Several mental processes are at work during problem-solving. Among them are:

• Perceptually recognizing the problem
• Representing the problem in memory
• Considering relevant information that applies to the problem
• Identifying different aspects of the problem
• Labeling and describing the problem

Problem-Solving Strategies

There are many ways to go about solving a problem. Some of these strategies might be used on their own, or you may decide to employ multiple approaches when working to figure out and fix a problem.

An algorithm is a step-by-step procedure that, by following certain "rules" produces a solution. Algorithms are commonly used in mathematics to solve division or multiplication problems. But they can be used in other fields as well.

In psychology, algorithms can be used to help identify individuals with a greater risk of mental health issues. For instance, research suggests that certain algorithms might help us recognize children with an elevated risk of suicide or self-harm.

One benefit of algorithms is that they guarantee an accurate answer. However, they aren't always the best approach to problem-solving, in part because detecting patterns can be incredibly time-consuming.

There are also concerns when machine learning is involved—also known as artificial intelligence (AI)—such as whether they can accurately predict human behaviors.

Heuristics are shortcut strategies that people can use to solve a problem at hand. These "rule of thumb" approaches allow you to simplify complex problems, reducing the total number of possible solutions to a more manageable set.

If you find yourself sitting in a traffic jam, for example, you may quickly consider other routes, taking one to get moving once again. When shopping for a new car, you might think back to a prior experience when negotiating got you a lower price, then employ the same tactics.

While heuristics may be helpful when facing smaller issues, major decisions shouldn't necessarily be made using a shortcut approach. Heuristics also don't guarantee an effective solution, such as when trying to drive around a traffic jam only to find yourself on an equally crowded route.

Trial and Error

A trial-and-error approach to problem-solving involves trying a number of potential solutions to a particular issue, then ruling out those that do not work. If you're not sure whether to buy a shirt in blue or green, for instance, you may try on each before deciding which one to purchase.

This can be a good strategy to use if you have a limited number of solutions available. But if there are many different choices available, narrowing down the possible options using another problem-solving technique can be helpful before attempting trial and error.

In some cases, the solution to a problem can appear as a sudden insight. You are facing an issue in a relationship or your career when, out of nowhere, the solution appears in your mind and you know exactly what to do.

Insight can occur when the problem in front of you is similar to an issue that you've dealt with in the past. Although, you may not recognize what is occurring since the underlying mental processes that lead to insight often happen outside of conscious awareness .

Research indicates that insight is most likely to occur during times when you are alone—such as when going on a walk by yourself, when you're in the shower, or when lying in bed after waking up.

How to Apply Problem-Solving Strategies in Real Life

If you're facing a problem, you can implement one or more of these strategies to find a potential solution. Here's how to use them in real life:

• Create a flow chart . If you have time, you can take advantage of the algorithm approach to problem-solving by sitting down and making a flow chart of each potential solution, its consequences, and what happens next.
• Recall your past experiences . When a problem needs to be solved fairly quickly, heuristics may be a better approach. Think back to when you faced a similar issue, then use your knowledge and experience to choose the best option possible.
• Start trying potential solutions . If your options are limited, start trying them one by one to see which solution is best for achieving your desired goal. If a particular solution doesn't work, move on to the next.
• Take some time alone . Since insight is often achieved when you're alone, carve out time to be by yourself for a while. The answer to your problem may come to you, seemingly out of the blue, if you spend some time away from others.

Obstacles to Problem-Solving

Problem-solving is not a flawless process as there are a number of obstacles that can interfere with our ability to solve a problem quickly and efficiently. These obstacles include:

• Assumptions: When dealing with a problem, people can make assumptions about the constraints and obstacles that prevent certain solutions. Thus, they may not even try some potential options.
• Functional fixedness : This term refers to the tendency to view problems only in their customary manner. Functional fixedness prevents people from fully seeing all of the different options that might be available to find a solution.
• Irrelevant or misleading information: When trying to solve a problem, it's important to distinguish between information that is relevant to the issue and irrelevant data that can lead to faulty solutions. The more complex the problem, the easier it is to focus on misleading or irrelevant information.
• Mental set: A mental set is a tendency to only use solutions that have worked in the past rather than looking for alternative ideas. A mental set can work as a heuristic, making it a useful problem-solving tool. However, mental sets can also lead to inflexibility, making it more difficult to find effective solutions.

How to Improve Your Problem-Solving Skills

In the end, if your goal is to become a better problem-solver, it's helpful to remember that this is a process. Thus, if you want to improve your problem-solving skills, following these steps can help lead you to your solution:

• Recognize that a problem exists . If you are facing a problem, there are generally signs. For instance, if you have a mental illness , you may experience excessive fear or sadness, mood changes, and changes in sleeping or eating habits. Recognizing these signs can help you realize that an issue exists.
• Decide to solve the problem . Make a conscious decision to solve the issue at hand. Commit to yourself that you will go through the steps necessary to find a solution.
• Seek to fully understand the issue . Analyze the problem you face, looking at it from all sides. If your problem is relationship-related, for instance, ask yourself how the other person may be interpreting the issue. You might also consider how your actions might be contributing to the situation.
• Research potential options . Using the problem-solving strategies mentioned, research potential solutions. Make a list of options, then consider each one individually. What are some pros and cons of taking the available routes? What would you need to do to make them happen?
• Take action . Select the best solution possible and take action. Action is one of the steps required for change . So, go through the motions needed to resolve the issue.
• Try another option, if needed . If the solution you chose didn't work, don't give up. Either go through the problem-solving process again or simply try another option.

You can find a way to solve your problems as long as you keep working toward this goal—even if the best solution is simply to let go because no other good solution exists.

Sarathy V. Real world problem-solving .  Front Hum Neurosci . 2018;12:261. doi:10.3389/fnhum.2018.00261

Dunbar K. Problem solving . A Companion to Cognitive Science . 2017. doi:10.1002/9781405164535.ch20

Stewart SL, Celebre A, Hirdes JP, Poss JW. Risk of suicide and self-harm in kids: The development of an algorithm to identify high-risk individuals within the children's mental health system . Child Psychiat Human Develop . 2020;51:913-924. doi:10.1007/s10578-020-00968-9

Rosenbusch H, Soldner F, Evans AM, Zeelenberg M. Supervised machine learning methods in psychology: A practical introduction with annotated R code . Soc Personal Psychol Compass . 2021;15(2):e12579. doi:10.1111/spc3.12579

Mishra S. Decision-making under risk: Integrating perspectives from biology, economics, and psychology . Personal Soc Psychol Rev . 2014;18(3):280-307. doi:10.1177/1088868314530517

Csikszentmihalyi M, Sawyer K. Creative insight: The social dimension of a solitary moment . In: The Systems Model of Creativity . 2015:73-98. doi:10.1007/978-94-017-9085-7_7

Chrysikou EG, Motyka K, Nigro C, Yang SI, Thompson-Schill SL. Functional fixedness in creative thinking tasks depends on stimulus modality .  Psychol Aesthet Creat Arts . 2016;10(4):425‐435. doi:10.1037/aca0000050

Huang F, Tang S, Hu Z. Unconditional perseveration of the short-term mental set in chunk decomposition .  Front Psychol . 2018;9:2568. doi:10.3389/fpsyg.2018.02568

National Alliance on Mental Illness. Warning signs and symptoms .

Mayer RE. Thinking, problem solving, cognition, 2nd ed .

Schooler JW, Ohlsson S, Brooks K. Thoughts beyond words: When language overshadows insight. J Experiment Psychol: General . 1993;122:166-183. doi:10.1037/0096-3445.2.166

By Kendra Cherry, MSEd Kendra Cherry, MS, is a psychosocial rehabilitation specialist, psychology educator, and author of the "Everything Psychology Book."

35 problem-solving techniques and methods for solving complex problems

Design your next session with SessionLab

Join the 150,000+ facilitators 
using SessionLab.

Recommended Articles

A step-by-step guide to planning a workshop, how to create an unforgettable training session in 8 simple steps, 47 useful online tools for workshop planning and meeting facilitation.

All teams and organizations encounter challenges as they grow. There are problems that might occur for teams when it comes to miscommunication or resolving business-critical issues . You may face challenges around growth , design , user engagement, and even team culture and happiness. In short, problem-solving techniques should be part of every team’s skillset.

Problem-solving methods are primarily designed to help a group or team through a process of first identifying problems and challenges , ideating possible solutions , and then evaluating the most suitable .

Finding effective solutions to complex problems isn’t easy, but by using the right process and techniques, you can help your team be more efficient in the process.

So how do you develop strategies that are engaging, and empower your team to solve problems effectively?

In this blog post, we share a series of problem-solving tools you can use in your next workshop or team meeting. You’ll also find some tips for facilitating the process and how to enable others to solve complex problems.

Let’s get started! 

How do you identify problems?

How do you identify the right solution.

• Tips for more effective problem-solving

Complete problem-solving methods

• Problem-solving techniques to identify and analyze problems
• Problem-solving techniques for developing solutions

Problem-solving warm-up activities

Closing activities for a problem-solving process.

Before you can move towards finding the right solution for a given problem, you first need to identify and define the problem you wish to solve. 

Here, you want to clearly articulate what the problem is and allow your group to do the same. Remember that everyone in a group is likely to have differing perspectives and alignment is necessary in order to help the group move forward. 

Identifying a problem accurately also requires that all members of a group are able to contribute their views in an open and safe manner. It can be scary for people to stand up and contribute, especially if the problems or challenges are emotive or personal in nature. Be sure to try and create a psychologically safe space for these kinds of discussions.

Remember that problem analysis and further discussion are also important. Not taking the time to fully analyze and discuss a challenge can result in the development of solutions that are not fit for purpose or do not address the underlying issue.

Successfully identifying and then analyzing a problem means facilitating a group through activities designed to help them clearly and honestly articulate their thoughts and produce usable insight.

With this data, you might then produce a problem statement that clearly describes the problem you wish to be addressed and also state the goal of any process you undertake to tackle this issue.  

Finding solutions is the end goal of any process. Complex organizational challenges can only be solved with an appropriate solution but discovering them requires using the right problem-solving tool.

After you’ve explored a problem and discussed ideas, you need to help a team discuss and choose the right solution. Consensus tools and methods such as those below help a group explore possible solutions before then voting for the best. They’re a great way to tap into the collective intelligence of the group for great results!

Remember that the process is often iterative. Great problem solvers often roadtest a viable solution in a measured way to see what works too. While you might not get the right solution on your first try, the methods below help teams land on the most likely to succeed solution while also holding space for improvement.

Every effective problem solving process begins with an agenda . A well-structured workshop is one of the best methods for successfully guiding a group from exploring a problem to implementing a solution.

In SessionLab, it’s easy to go from an idea to a complete agenda . Start by dragging and dropping your core problem solving activities into place . Add timings, breaks and necessary materials before sharing your agenda with your colleagues.

The resulting agenda will be your guide to an effective and productive problem solving session that will also help you stay organized on the day!

Tips for more effective problem solving

Problem-solving activities are only one part of the puzzle. While a great method can help unlock your team’s ability to solve problems, without a thoughtful approach and strong facilitation the solutions may not be fit for purpose.

Let’s take a look at some problem-solving tips you can apply to any process to help it be a success!

Clearly define the problem

Jumping straight to solutions can be tempting, though without first clearly articulating a problem, the solution might not be the right one. Many of the problem-solving activities below include sections where the problem is explored and clearly defined before moving on.

This is a vital part of the problem-solving process and taking the time to fully define an issue can save time and effort later. A clear definition helps identify irrelevant information and it also ensures that your team sets off on the right track.

Don’t jump to conclusions

It’s easy for groups to exhibit cognitive bias or have preconceived ideas about both problems and potential solutions. Be sure to back up any problem statements or potential solutions with facts, research, and adequate forethought.

The best techniques ask participants to be methodical and challenge preconceived notions. Make sure you give the group enough time and space to collect relevant information and consider the problem in a new way. By approaching the process with a clear, rational mindset, you’ll often find that better solutions are more forthcoming.  

Try different approaches  

Problems come in all shapes and sizes and so too should the methods you use to solve them. If you find that one approach isn’t yielding results and your team isn’t finding different solutions, try mixing it up. You’ll be surprised at how using a new creative activity can unblock your team and generate great solutions.

Don’t take it personally 

Depending on the nature of your team or organizational problems, it’s easy for conversations to get heated. While it’s good for participants to be engaged in the discussions, ensure that emotions don’t run too high and that blame isn’t thrown around while finding solutions.

You’re all in it together, and even if your team or area is seeing problems, that isn’t necessarily a disparagement of you personally. Using facilitation skills to manage group dynamics is one effective method of helping conversations be more constructive.

Get the right people in the room

Your problem-solving method is often only as effective as the group using it. Getting the right people on the job and managing the number of people present is important too!

If the group is too small, you may not get enough different perspectives to effectively solve a problem. If the group is too large, you can go round and round during the ideation stages.

Creating the right group makeup is also important in ensuring you have the necessary expertise and skillset to both identify and follow up on potential solutions. Carefully consider who to include at each stage to help ensure your problem-solving method is followed and positioned for success.

Document everything

The best solutions can take refinement, iteration, and reflection to come out. Get into a habit of documenting your process in order to keep all the learnings from the session and to allow ideas to mature and develop. Many of the methods below involve the creation of documents or shared resources. Be sure to keep and share these so everyone can benefit from the work done!

Bring a facilitator 

Facilitation is all about making group processes easier. With a subject as potentially emotive and important as problem-solving, having an impartial third party in the form of a facilitator can make all the difference in finding great solutions and keeping the process moving. Consider bringing a facilitator to your problem-solving session to get better results and generate meaningful solutions!

Develop your problem-solving skills

It takes time and practice to be an effective problem solver. While some roles or participants might more naturally gravitate towards problem-solving, it can take development and planning to help everyone create better solutions.

You might develop a training program, run a problem-solving workshop or simply ask your team to practice using the techniques below. Check out our post on problem-solving skills to see how you and your group can develop the right mental process and be more resilient to issues too!

Design a great agenda

Workshops are a great format for solving problems. With the right approach, you can focus a group and help them find the solutions to their own problems. But designing a process can be time-consuming and finding the right activities can be difficult.

Check out our workshop planning guide to level-up your agenda design and start running more effective workshops. Need inspiration? Check out templates designed by expert facilitators to help you kickstart your process!

In this section, we’ll look at in-depth problem-solving methods that provide a complete end-to-end process for developing effective solutions. These will help guide your team from the discovery and definition of a problem through to delivering the right solution.

If you’re looking for an all-encompassing method or problem-solving model, these processes are a great place to start. They’ll ask your team to challenge preconceived ideas and adopt a mindset for solving problems more effectively.

• Six Thinking Hats
• Lightning Decision Jam
• Problem Definition Process
• Discovery & Action Dialogue

Design Sprint 2.0

• Open Space Technology

1. Six Thinking Hats

Individual approaches to solving a problem can be very different based on what team or role an individual holds. It can be easy for existing biases or perspectives to find their way into the mix, or for internal politics to direct a conversation.

Six Thinking Hats is a classic method for identifying the problems that need to be solved and enables your team to consider them from different angles, whether that is by focusing on facts and data, creative solutions, or by considering why a particular solution might not work.

Like all problem-solving frameworks, Six Thinking Hats is effective at helping teams remove roadblocks from a conversation or discussion and come to terms with all the aspects necessary to solve complex problems.

2. Lightning Decision Jam

Featured courtesy of Jonathan Courtney of AJ&Smart Berlin, Lightning Decision Jam is one of those strategies that should be in every facilitation toolbox. Exploring problems and finding solutions is often creative in nature, though as with any creative process, there is the potential to lose focus and get lost.

Unstructured discussions might get you there in the end, but it’s much more effective to use a method that creates a clear process and team focus.

In Lightning Decision Jam, participants are invited to begin by writing challenges, concerns, or mistakes on post-its without discussing them before then being invited by the moderator to present them to the group.

From there, the team vote on which problems to solve and are guided through steps that will allow them to reframe those problems, create solutions and then decide what to execute on. 

By deciding the problems that need to be solved as a team before moving on, this group process is great for ensuring the whole team is aligned and can take ownership over the next stages. 

Lightning Decision Jam (LDJ)   #action   #decision making   #problem solving   #issue analysis   #innovation   #design   #remote-friendly   The problem with anything that requires creative thinking is that it’s easy to get lost—lose focus and fall into the trap of having useless, open-ended, unstructured discussions. Here’s the most effective solution I’ve found: Replace all open, unstructured discussion with a clear process. What to use this exercise for: Anything which requires a group of people to make decisions, solve problems or discuss challenges. It’s always good to frame an LDJ session with a broad topic, here are some examples: The conversion flow of our checkout Our internal design process How we organise events Keeping up with our competition Improving sales flow

3. Problem Definition Process

While problems can be complex, the problem-solving methods you use to identify and solve those problems can often be simple in design. 

By taking the time to truly identify and define a problem before asking the group to reframe the challenge as an opportunity, this method is a great way to enable change.

Begin by identifying a focus question and exploring the ways in which it manifests before splitting into five teams who will each consider the problem using a different method: escape, reversal, exaggeration, distortion or wishful. Teams develop a problem objective and create ideas in line with their method before then feeding them back to the group.

This method is great for enabling in-depth discussions while also creating space for finding creative solutions too!

Problem Definition   #problem solving   #idea generation   #creativity   #online   #remote-friendly   A problem solving technique to define a problem, challenge or opportunity and to generate ideas.

4. The 5 Whys 

Sometimes, a group needs to go further with their strategies and analyze the root cause at the heart of organizational issues. An RCA or root cause analysis is the process of identifying what is at the heart of business problems or recurring challenges. 

The 5 Whys is a simple and effective method of helping a group go find the root cause of any problem or challenge and conduct analysis that will deliver results. 

By beginning with the creation of a problem statement and going through five stages to refine it, The 5 Whys provides everything you need to truly discover the cause of an issue.

The 5 Whys   #hyperisland   #innovation   This simple and powerful method is useful for getting to the core of a problem or challenge. As the title suggests, the group defines a problems, then asks the question “why” five times, often using the resulting explanation as a starting point for creative problem solving.

5. World Cafe

World Cafe is a simple but powerful facilitation technique to help bigger groups to focus their energy and attention on solving complex problems.

World Cafe enables this approach by creating a relaxed atmosphere where participants are able to self-organize and explore topics relevant and important to them which are themed around a central problem-solving purpose. Create the right atmosphere by modeling your space after a cafe and after guiding the group through the method, let them take the lead!

Making problem-solving a part of your organization’s culture in the long term can be a difficult undertaking. More approachable formats like World Cafe can be especially effective in bringing people unfamiliar with workshops into the fold. 

World Cafe   #hyperisland   #innovation   #issue analysis   World Café is a simple yet powerful method, originated by Juanita Brown, for enabling meaningful conversations driven completely by participants and the topics that are relevant and important to them. Facilitators create a cafe-style space and provide simple guidelines. Participants then self-organize and explore a set of relevant topics or questions for conversation.

6. Discovery & Action Dialogue (DAD)

One of the best approaches is to create a safe space for a group to share and discover practices and behaviors that can help them find their own solutions.

With DAD, you can help a group choose which problems they wish to solve and which approaches they will take to do so. It’s great at helping remove resistance to change and can help get buy-in at every level too!

This process of enabling frontline ownership is great in ensuring follow-through and is one of the methods you will want in your toolbox as a facilitator.

Discovery & Action Dialogue (DAD)   #idea generation   #liberating structures   #action   #issue analysis   #remote-friendly   DADs make it easy for a group or community to discover practices and behaviors that enable some individuals (without access to special resources and facing the same constraints) to find better solutions than their peers to common problems. These are called positive deviant (PD) behaviors and practices. DADs make it possible for people in the group, unit, or community to discover by themselves these PD practices. DADs also create favorable conditions for stimulating participants’ creativity in spaces where they can feel safe to invent new and more effective practices. Resistance to change evaporates as participants are unleashed to choose freely which practices they will adopt or try and which problems they will tackle. DADs make it possible to achieve frontline ownership of solutions.

7. Design Sprint 2.0

Want to see how a team can solve big problems and move forward with prototyping and testing solutions in a few days? The Design Sprint 2.0 template from Jake Knapp, author of Sprint, is a complete agenda for a with proven results.

Developing the right agenda can involve difficult but necessary planning. Ensuring all the correct steps are followed can also be stressful or time-consuming depending on your level of experience.

Use this complete 4-day workshop template if you are finding there is no obvious solution to your challenge and want to focus your team around a specific problem that might require a shortcut to launching a minimum viable product or waiting for the organization-wide implementation of a solution.

8. Open space technology

Open space technology- developed by Harrison Owen – creates a space where large groups are invited to take ownership of their problem solving and lead individual sessions. Open space technology is a great format when you have a great deal of expertise and insight in the room and want to allow for different takes and approaches on a particular theme or problem you need to be solved.

Start by bringing your participants together to align around a central theme and focus their efforts. Explain the ground rules to help guide the problem-solving process and then invite members to identify any issue connecting to the central theme that they are interested in and are prepared to take responsibility for.

Once participants have decided on their approach to the core theme, they write their issue on a piece of paper, announce it to the group, pick a session time and place, and post the paper on the wall. As the wall fills up with sessions, the group is then invited to join the sessions that interest them the most and which they can contribute to, then you’re ready to begin!

Everyone joins the problem-solving group they’ve signed up to, record the discussion and if appropriate, findings can then be shared with the rest of the group afterward.

Open Space Technology   #action plan   #idea generation   #problem solving   #issue analysis   #large group   #online   #remote-friendly   Open Space is a methodology for large groups to create their agenda discerning important topics for discussion, suitable for conferences, community gatherings and whole system facilitation

Techniques to identify and analyze problems

Using a problem-solving method to help a team identify and analyze a problem can be a quick and effective addition to any workshop or meeting.

While further actions are always necessary, you can generate momentum and alignment easily, and these activities are a great place to get started.

We’ve put together this list of techniques to help you and your team with problem identification, analysis, and discussion that sets the foundation for developing effective solutions.

Let’s take a look!

• The Creativity Dice
• Fishbone Analysis
• Problem Tree
• SWOT Analysis
• Agreement-Certainty Matrix
• The Journalistic Six
• LEGO Challenge
• What, So What, Now What?
• Journalists

Individual and group perspectives are incredibly important, but what happens if people are set in their minds and need a change of perspective in order to approach a problem more effectively?

Flip It is a method we love because it is both simple to understand and run, and allows groups to understand how their perspectives and biases are formed. 

Participants in Flip It are first invited to consider concerns, issues, or problems from a perspective of fear and write them on a flip chart. Then, the group is asked to consider those same issues from a perspective of hope and flip their understanding.  

No problem and solution is free from existing bias and by changing perspectives with Flip It, you can then develop a problem solving model quickly and effectively.

Flip It!   #gamestorming   #problem solving   #action   Often, a change in a problem or situation comes simply from a change in our perspectives. Flip It! is a quick game designed to show players that perspectives are made, not born.

10. The Creativity Dice

One of the most useful problem solving skills you can teach your team is of approaching challenges with creativity, flexibility, and openness. Games like The Creativity Dice allow teams to overcome the potential hurdle of too much linear thinking and approach the process with a sense of fun and speed. 

In The Creativity Dice, participants are organized around a topic and roll a dice to determine what they will work on for a period of 3 minutes at a time. They might roll a 3 and work on investigating factual information on the chosen topic. They might roll a 1 and work on identifying the specific goals, standards, or criteria for the session.

Encouraging rapid work and iteration while asking participants to be flexible are great skills to cultivate. Having a stage for idea incubation in this game is also important. Moments of pause can help ensure the ideas that are put forward are the most suitable. 

The Creativity Dice   #creativity   #problem solving   #thiagi   #issue analysis   Too much linear thinking is hazardous to creative problem solving. To be creative, you should approach the problem (or the opportunity) from different points of view. You should leave a thought hanging in mid-air and move to another. This skipping around prevents premature closure and lets your brain incubate one line of thought while you consciously pursue another.

11. Fishbone Analysis

Organizational or team challenges are rarely simple, and it’s important to remember that one problem can be an indication of something that goes deeper and may require further consideration to be solved.

Fishbone Analysis helps groups to dig deeper and understand the origins of a problem. It’s a great example of a root cause analysis method that is simple for everyone on a team to get their head around. 

Participants in this activity are asked to annotate a diagram of a fish, first adding the problem or issue to be worked on at the head of a fish before then brainstorming the root causes of the problem and adding them as bones on the fish. 

Using abstractions such as a diagram of a fish can really help a team break out of their regular thinking and develop a creative approach.

Fishbone Analysis   #problem solving   ##root cause analysis   #decision making   #online facilitation   A process to help identify and understand the origins of problems, issues or observations.

12. Problem Tree 

Encouraging visual thinking can be an essential part of many strategies. By simply reframing and clarifying problems, a group can move towards developing a problem solving model that works for them. 

In Problem Tree, groups are asked to first brainstorm a list of problems – these can be design problems, team problems or larger business problems – and then organize them into a hierarchy. The hierarchy could be from most important to least important or abstract to practical, though the key thing with problem solving games that involve this aspect is that your group has some way of managing and sorting all the issues that are raised.

Once you have a list of problems that need to be solved and have organized them accordingly, you’re then well-positioned for the next problem solving steps.

Problem tree   #define intentions   #create   #design   #issue analysis   A problem tree is a tool to clarify the hierarchy of problems addressed by the team within a design project; it represents high level problems or related sublevel problems.

13. SWOT Analysis

Chances are you’ve heard of the SWOT Analysis before. This problem-solving method focuses on identifying strengths, weaknesses, opportunities, and threats is a tried and tested method for both individuals and teams.

Start by creating a desired end state or outcome and bare this in mind – any process solving model is made more effective by knowing what you are moving towards. Create a quadrant made up of the four categories of a SWOT analysis and ask participants to generate ideas based on each of those quadrants.

Once you have those ideas assembled in their quadrants, cluster them together based on their affinity with other ideas. These clusters are then used to facilitate group conversations and move things forward. 

SWOT analysis   #gamestorming   #problem solving   #action   #meeting facilitation   The SWOT Analysis is a long-standing technique of looking at what we have, with respect to the desired end state, as well as what we could improve on. It gives us an opportunity to gauge approaching opportunities and dangers, and assess the seriousness of the conditions that affect our future. When we understand those conditions, we can influence what comes next.

14. Agreement-Certainty Matrix

Not every problem-solving approach is right for every challenge, and deciding on the right method for the challenge at hand is a key part of being an effective team.

The Agreement Certainty matrix helps teams align on the nature of the challenges facing them. By sorting problems from simple to chaotic, your team can understand what methods are suitable for each problem and what they can do to ensure effective results. 

If you are already using Liberating Structures techniques as part of your problem-solving strategy, the Agreement-Certainty Matrix can be an invaluable addition to your process. We’ve found it particularly if you are having issues with recurring problems in your organization and want to go deeper in understanding the root cause. 

Agreement-Certainty Matrix   #issue analysis   #liberating structures   #problem solving   You can help individuals or groups avoid the frequent mistake of trying to solve a problem with methods that are not adapted to the nature of their challenge. The combination of two questions makes it possible to easily sort challenges into four categories: simple, complicated, complex , and chaotic .  A problem is simple when it can be solved reliably with practices that are easy to duplicate.  It is complicated when experts are required to devise a sophisticated solution that will yield the desired results predictably.  A problem is complex when there are several valid ways to proceed but outcomes are not predictable in detail.  Chaotic is when the context is too turbulent to identify a path forward.  A loose analogy may be used to describe these differences: simple is like following a recipe, complicated like sending a rocket to the moon, complex like raising a child, and chaotic is like the game “Pin the Tail on the Donkey.”  The Liberating Structures Matching Matrix in Chapter 5 can be used as the first step to clarify the nature of a challenge and avoid the mismatches between problems and solutions that are frequently at the root of chronic, recurring problems.

Organizing and charting a team’s progress can be important in ensuring its success. SQUID (Sequential Question and Insight Diagram) is a great model that allows a team to effectively switch between giving questions and answers and develop the skills they need to stay on track throughout the process. 

Begin with two different colored sticky notes – one for questions and one for answers – and with your central topic (the head of the squid) on the board. Ask the group to first come up with a series of questions connected to their best guess of how to approach the topic. Ask the group to come up with answers to those questions, fix them to the board and connect them with a line. After some discussion, go back to question mode by responding to the generated answers or other points on the board.

It’s rewarding to see a diagram grow throughout the exercise, and a completed SQUID can provide a visual resource for future effort and as an example for other teams.

SQUID   #gamestorming   #project planning   #issue analysis   #problem solving   When exploring an information space, it’s important for a group to know where they are at any given time. By using SQUID, a group charts out the territory as they go and can navigate accordingly. SQUID stands for Sequential Question and Insight Diagram.

16. Speed Boat

To continue with our nautical theme, Speed Boat is a short and sweet activity that can help a team quickly identify what employees, clients or service users might have a problem with and analyze what might be standing in the way of achieving a solution.

Methods that allow for a group to make observations, have insights and obtain those eureka moments quickly are invaluable when trying to solve complex problems.

In Speed Boat, the approach is to first consider what anchors and challenges might be holding an organization (or boat) back. Bonus points if you are able to identify any sharks in the water and develop ideas that can also deal with competitors!   

Speed Boat   #gamestorming   #problem solving   #action   Speedboat is a short and sweet way to identify what your employees or clients don’t like about your product/service or what’s standing in the way of a desired goal.

17. The Journalistic Six

Some of the most effective ways of solving problems is by encouraging teams to be more inclusive and diverse in their thinking.

Based on the six key questions journalism students are taught to answer in articles and news stories, The Journalistic Six helps create teams to see the whole picture. By using who, what, when, where, why, and how to facilitate the conversation and encourage creative thinking, your team can make sure that the problem identification and problem analysis stages of the are covered exhaustively and thoughtfully. Reporter’s notebook and dictaphone optional.

The Journalistic Six – Who What When Where Why How   #idea generation   #issue analysis   #problem solving   #online   #creative thinking   #remote-friendly   A questioning method for generating, explaining, investigating ideas.

18. LEGO Challenge

Now for an activity that is a little out of the (toy) box. LEGO Serious Play is a facilitation methodology that can be used to improve creative thinking and problem-solving skills. 

The LEGO Challenge includes giving each member of the team an assignment that is hidden from the rest of the group while they create a structure without speaking.

What the LEGO challenge brings to the table is a fun working example of working with stakeholders who might not be on the same page to solve problems. Also, it’s LEGO! Who doesn’t love LEGO! 

LEGO Challenge   #hyperisland   #team   A team-building activity in which groups must work together to build a structure out of LEGO, but each individual has a secret “assignment” which makes the collaborative process more challenging. It emphasizes group communication, leadership dynamics, conflict, cooperation, patience and problem solving strategy.

19. What, So What, Now What?

If not carefully managed, the problem identification and problem analysis stages of the problem-solving process can actually create more problems and misunderstandings.

The What, So What, Now What? problem-solving activity is designed to help collect insights and move forward while also eliminating the possibility of disagreement when it comes to identifying, clarifying, and analyzing organizational or work problems. 

Facilitation is all about bringing groups together so that might work on a shared goal and the best problem-solving strategies ensure that teams are aligned in purpose, if not initially in opinion or insight.

Throughout the three steps of this game, you give everyone on a team to reflect on a problem by asking what happened, why it is important, and what actions should then be taken. 

This can be a great activity for bringing our individual perceptions about a problem or challenge and contextualizing it in a larger group setting. This is one of the most important problem-solving skills you can bring to your organization.

W³ – What, So What, Now What?   #issue analysis   #innovation   #liberating structures   You can help groups reflect on a shared experience in a way that builds understanding and spurs coordinated action while avoiding unproductive conflict. It is possible for every voice to be heard while simultaneously sifting for insights and shaping new direction. Progressing in stages makes this practical—from collecting facts about What Happened to making sense of these facts with So What and finally to what actions logically follow with Now What . The shared progression eliminates most of the misunderstandings that otherwise fuel disagreements about what to do. Voila!

20. Journalists  

Problem analysis can be one of the most important and decisive stages of all problem-solving tools. Sometimes, a team can become bogged down in the details and are unable to move forward.

Journalists is an activity that can avoid a group from getting stuck in the problem identification or problem analysis stages of the process.

In Journalists, the group is invited to draft the front page of a fictional newspaper and figure out what stories deserve to be on the cover and what headlines those stories will have. By reframing how your problems and challenges are approached, you can help a team move productively through the process and be better prepared for the steps to follow.

Journalists   #vision   #big picture   #issue analysis   #remote-friendly   This is an exercise to use when the group gets stuck in details and struggles to see the big picture. Also good for defining a vision.

Problem-solving techniques for developing solutions 

The success of any problem-solving process can be measured by the solutions it produces. After you’ve defined the issue, explored existing ideas, and ideated, it’s time to narrow down to the correct solution.

Use these problem-solving techniques when you want to help your team find consensus, compare possible solutions, and move towards taking action on a particular problem.

• Improved Solutions
• Four-Step Sketch
• 15% Solutions
• How-Now-Wow matrix
• Impact Effort Matrix

21. Mindspin  

Brainstorming is part of the bread and butter of the problem-solving process and all problem-solving strategies benefit from getting ideas out and challenging a team to generate solutions quickly. 

With Mindspin, participants are encouraged not only to generate ideas but to do so under time constraints and by slamming down cards and passing them on. By doing multiple rounds, your team can begin with a free generation of possible solutions before moving on to developing those solutions and encouraging further ideation. 

This is one of our favorite problem-solving activities and can be great for keeping the energy up throughout the workshop. Remember the importance of helping people become engaged in the process – energizing problem-solving techniques like Mindspin can help ensure your team stays engaged and happy, even when the problems they’re coming together to solve are complex. 

MindSpin   #teampedia   #idea generation   #problem solving   #action   A fast and loud method to enhance brainstorming within a team. Since this activity has more than round ideas that are repetitive can be ruled out leaving more creative and innovative answers to the challenge.

22. Improved Solutions

After a team has successfully identified a problem and come up with a few solutions, it can be tempting to call the work of the problem-solving process complete. That said, the first solution is not necessarily the best, and by including a further review and reflection activity into your problem-solving model, you can ensure your group reaches the best possible result. 

One of a number of problem-solving games from Thiagi Group, Improved Solutions helps you go the extra mile and develop suggested solutions with close consideration and peer review. By supporting the discussion of several problems at once and by shifting team roles throughout, this problem-solving technique is a dynamic way of finding the best solution. 

Improved Solutions   #creativity   #thiagi   #problem solving   #action   #team   You can improve any solution by objectively reviewing its strengths and weaknesses and making suitable adjustments. In this creativity framegame, you improve the solutions to several problems. To maintain objective detachment, you deal with a different problem during each of six rounds and assume different roles (problem owner, consultant, basher, booster, enhancer, and evaluator) during each round. At the conclusion of the activity, each player ends up with two solutions to her problem.

23. Four Step Sketch

Creative thinking and visual ideation does not need to be confined to the opening stages of your problem-solving strategies. Exercises that include sketching and prototyping on paper can be effective at the solution finding and development stage of the process, and can be great for keeping a team engaged. 

By going from simple notes to a crazy 8s round that involves rapidly sketching 8 variations on their ideas before then producing a final solution sketch, the group is able to iterate quickly and visually. Problem-solving techniques like Four-Step Sketch are great if you have a group of different thinkers and want to change things up from a more textual or discussion-based approach.

Four-Step Sketch   #design sprint   #innovation   #idea generation   #remote-friendly   The four-step sketch is an exercise that helps people to create well-formed concepts through a structured process that includes: Review key information Start design work on paper,  Consider multiple variations , Create a detailed solution . This exercise is preceded by a set of other activities allowing the group to clarify the challenge they want to solve. See how the Four Step Sketch exercise fits into a Design Sprint

24. 15% Solutions

Some problems are simpler than others and with the right problem-solving activities, you can empower people to take immediate actions that can help create organizational change. 

Part of the liberating structures toolkit, 15% solutions is a problem-solving technique that focuses on finding and implementing solutions quickly. A process of iterating and making small changes quickly can help generate momentum and an appetite for solving complex problems.

Problem-solving strategies can live and die on whether people are onboard. Getting some quick wins is a great way of getting people behind the process.   

It can be extremely empowering for a team to realize that problem-solving techniques can be deployed quickly and easily and delineate between things they can positively impact and those things they cannot change. 

15% Solutions   #action   #liberating structures   #remote-friendly   You can reveal the actions, however small, that everyone can do immediately. At a minimum, these will create momentum, and that may make a BIG difference.  15% Solutions show that there is no reason to wait around, feel powerless, or fearful. They help people pick it up a level. They get individuals and the group to focus on what is within their discretion instead of what they cannot change.  With a very simple question, you can flip the conversation to what can be done and find solutions to big problems that are often distributed widely in places not known in advance. Shifting a few grains of sand may trigger a landslide and change the whole landscape.

25. How-Now-Wow Matrix

The problem-solving process is often creative, as complex problems usually require a change of thinking and creative response in order to find the best solutions. While it’s common for the first stages to encourage creative thinking, groups can often gravitate to familiar solutions when it comes to the end of the process. 

When selecting solutions, you don’t want to lose your creative energy! The How-Now-Wow Matrix from Gamestorming is a great problem-solving activity that enables a group to stay creative and think out of the box when it comes to selecting the right solution for a given problem.

Problem-solving techniques that encourage creative thinking and the ideation and selection of new solutions can be the most effective in organisational change. Give the How-Now-Wow Matrix a go, and not just for how pleasant it is to say out loud. 

How-Now-Wow Matrix   #gamestorming   #idea generation   #remote-friendly   When people want to develop new ideas, they most often think out of the box in the brainstorming or divergent phase. However, when it comes to convergence, people often end up picking ideas that are most familiar to them. This is called a ‘creative paradox’ or a ‘creadox’. The How-Now-Wow matrix is an idea selection tool that breaks the creadox by forcing people to weigh each idea on 2 parameters.

26. Impact and Effort Matrix

All problem-solving techniques hope to not only find solutions to a given problem or challenge but to find the best solution. When it comes to finding a solution, groups are invited to put on their decision-making hats and really think about how a proposed idea would work in practice. 

The Impact and Effort Matrix is one of the problem-solving techniques that fall into this camp, empowering participants to first generate ideas and then categorize them into a 2×2 matrix based on impact and effort.

Activities that invite critical thinking while remaining simple are invaluable. Use the Impact and Effort Matrix to move from ideation and towards evaluating potential solutions before then committing to them. 

Impact and Effort Matrix   #gamestorming   #decision making   #action   #remote-friendly   In this decision-making exercise, possible actions are mapped based on two factors: effort required to implement and potential impact. Categorizing ideas along these lines is a useful technique in decision making, as it obliges contributors to balance and evaluate suggested actions before committing to them.

27. Dotmocracy

If you’ve followed each of the problem-solving steps with your group successfully, you should move towards the end of your process with heaps of possible solutions developed with a specific problem in mind. But how do you help a group go from ideation to putting a solution into action? 

Dotmocracy – or Dot Voting -is a tried and tested method of helping a team in the problem-solving process make decisions and put actions in place with a degree of oversight and consensus. 

One of the problem-solving techniques that should be in every facilitator’s toolbox, Dot Voting is fast and effective and can help identify the most popular and best solutions and help bring a group to a decision effectively. 

Dotmocracy   #action   #decision making   #group prioritization   #hyperisland   #remote-friendly   Dotmocracy is a simple method for group prioritization or decision-making. It is not an activity on its own, but a method to use in processes where prioritization or decision-making is the aim. The method supports a group to quickly see which options are most popular or relevant. The options or ideas are written on post-its and stuck up on a wall for the whole group to see. Each person votes for the options they think are the strongest, and that information is used to inform a decision.

All facilitators know that warm-ups and icebreakers are useful for any workshop or group process. Problem-solving workshops are no different.

Use these problem-solving techniques to warm up a group and prepare them for the rest of the process. Activating your group by tapping into some of the top problem-solving skills can be one of the best ways to see great outcomes from your session.

• Check-in/Check-out
• Doodling Together
• Show and Tell
• Constellations
• Draw a Tree

28. Check-in / Check-out

Solid processes are planned from beginning to end, and the best facilitators know that setting the tone and establishing a safe, open environment can be integral to a successful problem-solving process.

Check-in / Check-out is a great way to begin and/or bookend a problem-solving workshop. Checking in to a session emphasizes that everyone will be seen, heard, and expected to contribute. 

If you are running a series of meetings, setting a consistent pattern of checking in and checking out can really help your team get into a groove. We recommend this opening-closing activity for small to medium-sized groups though it can work with large groups if they’re disciplined!

Check-in / Check-out   #team   #opening   #closing   #hyperisland   #remote-friendly   Either checking-in or checking-out is a simple way for a team to open or close a process, symbolically and in a collaborative way. Checking-in/out invites each member in a group to be present, seen and heard, and to express a reflection or a feeling. Checking-in emphasizes presence, focus and group commitment; checking-out emphasizes reflection and symbolic closure.

29. Doodling Together  

Thinking creatively and not being afraid to make suggestions are important problem-solving skills for any group or team, and warming up by encouraging these behaviors is a great way to start. 

Doodling Together is one of our favorite creative ice breaker games – it’s quick, effective, and fun and can make all following problem-solving steps easier by encouraging a group to collaborate visually. By passing cards and adding additional items as they go, the workshop group gets into a groove of co-creation and idea development that is crucial to finding solutions to problems. 

Doodling Together   #collaboration   #creativity   #teamwork   #fun   #team   #visual methods   #energiser   #icebreaker   #remote-friendly   Create wild, weird and often funny postcards together & establish a group’s creative confidence.

30. Show and Tell

You might remember some version of Show and Tell from being a kid in school and it’s a great problem-solving activity to kick off a session.

Asking participants to prepare a little something before a workshop by bringing an object for show and tell can help them warm up before the session has even begun! Games that include a physical object can also help encourage early engagement before moving onto more big-picture thinking.

By asking your participants to tell stories about why they chose to bring a particular item to the group, you can help teams see things from new perspectives and see both differences and similarities in the way they approach a topic. Great groundwork for approaching a problem-solving process as a team! 

Show and Tell   #gamestorming   #action   #opening   #meeting facilitation   Show and Tell taps into the power of metaphors to reveal players’ underlying assumptions and associations around a topic The aim of the game is to get a deeper understanding of stakeholders’ perspectives on anything—a new project, an organizational restructuring, a shift in the company’s vision or team dynamic.

31. Constellations

Who doesn’t love stars? Constellations is a great warm-up activity for any workshop as it gets people up off their feet, energized, and ready to engage in new ways with established topics. It’s also great for showing existing beliefs, biases, and patterns that can come into play as part of your session.

Using warm-up games that help build trust and connection while also allowing for non-verbal responses can be great for easing people into the problem-solving process and encouraging engagement from everyone in the group. Constellations is great in large spaces that allow for movement and is definitely a practical exercise to allow the group to see patterns that are otherwise invisible. 

Constellations   #trust   #connection   #opening   #coaching   #patterns   #system   Individuals express their response to a statement or idea by standing closer or further from a central object. Used with teams to reveal system, hidden patterns, perspectives.

32. Draw a Tree

Problem-solving games that help raise group awareness through a central, unifying metaphor can be effective ways to warm-up a group in any problem-solving model.

Draw a Tree is a simple warm-up activity you can use in any group and which can provide a quick jolt of energy. Start by asking your participants to draw a tree in just 45 seconds – they can choose whether it will be abstract or realistic. 

Once the timer is up, ask the group how many people included the roots of the tree and use this as a means to discuss how we can ignore important parts of any system simply because they are not visible.

All problem-solving strategies are made more effective by thinking of problems critically and by exposing things that may not normally come to light. Warm-up games like Draw a Tree are great in that they quickly demonstrate some key problem-solving skills in an accessible and effective way.

Draw a Tree   #thiagi   #opening   #perspectives   #remote-friendly   With this game you can raise awarness about being more mindful, and aware of the environment we live in.

Each step of the problem-solving workshop benefits from an intelligent deployment of activities, games, and techniques. Bringing your session to an effective close helps ensure that solutions are followed through on and that you also celebrate what has been achieved.

Here are some problem-solving activities you can use to effectively close a workshop or meeting and ensure the great work you’ve done can continue afterward.

• One Breath Feedback
• Who What When Matrix
• Response Cards

How do I conclude a problem-solving process?

All good things must come to an end. With the bulk of the work done, it can be tempting to conclude your workshop swiftly and without a moment to debrief and align. This can be problematic in that it doesn’t allow your team to fully process the results or reflect on the process.

At the end of an effective session, your team will have gone through a process that, while productive, can be exhausting. It’s important to give your group a moment to take a breath, ensure that they are clear on future actions, and provide short feedback before leaving the space. 

The primary purpose of any problem-solving method is to generate solutions and then implement them. Be sure to take the opportunity to ensure everyone is aligned and ready to effectively implement the solutions you produced in the workshop.

Remember that every process can be improved and by giving a short moment to collect feedback in the session, you can further refine your problem-solving methods and see further success in the future too.

33. One Breath Feedback

Maintaining attention and focus during the closing stages of a problem-solving workshop can be tricky and so being concise when giving feedback can be important. It’s easy to incur “death by feedback” should some team members go on for too long sharing their perspectives in a quick feedback round. 

One Breath Feedback is a great closing activity for workshops. You give everyone an opportunity to provide feedback on what they’ve done but only in the space of a single breath. This keeps feedback short and to the point and means that everyone is encouraged to provide the most important piece of feedback to them. 

One breath feedback   #closing   #feedback   #action   This is a feedback round in just one breath that excels in maintaining attention: each participants is able to speak during just one breath … for most people that’s around 20 to 25 seconds … unless of course you’ve been a deep sea diver in which case you’ll be able to do it for longer.

34. Who What When Matrix 

Matrices feature as part of many effective problem-solving strategies and with good reason. They are easily recognizable, simple to use, and generate results.

The Who What When Matrix is a great tool to use when closing your problem-solving session by attributing a who, what and when to the actions and solutions you have decided upon. The resulting matrix is a simple, easy-to-follow way of ensuring your team can move forward. 

Great solutions can’t be enacted without action and ownership. Your problem-solving process should include a stage for allocating tasks to individuals or teams and creating a realistic timeframe for those solutions to be implemented or checked out. Use this method to keep the solution implementation process clear and simple for all involved. 

Who/What/When Matrix   #gamestorming   #action   #project planning   With Who/What/When matrix, you can connect people with clear actions they have defined and have committed to.

35. Response cards

Group discussion can comprise the bulk of most problem-solving activities and by the end of the process, you might find that your team is talked out! 

Providing a means for your team to give feedback with short written notes can ensure everyone is head and can contribute without the need to stand up and talk. Depending on the needs of the group, giving an alternative can help ensure everyone can contribute to your problem-solving model in the way that makes the most sense for them.

Response Cards is a great way to close a workshop if you are looking for a gentle warm-down and want to get some swift discussion around some of the feedback that is raised. 

Response Cards   #debriefing   #closing   #structured sharing   #questions and answers   #thiagi   #action   It can be hard to involve everyone during a closing of a session. Some might stay in the background or get unheard because of louder participants. However, with the use of Response Cards, everyone will be involved in providing feedback or clarify questions at the end of a session.

Save time and effort discovering the right solutions

A structured problem solving process is a surefire way of solving tough problems, discovering creative solutions and driving organizational change. But how can you design for successful outcomes?

With SessionLab, it’s easy to design engaging workshops that deliver results. Drag, drop and reorder blocks  to build your agenda. When you make changes or update your agenda, your session  timing   adjusts automatically , saving you time on manual adjustments.

Collaborating with stakeholders or clients? Share your agenda with a single click and collaborate in real-time. No more sending documents back and forth over email.

Explore  how to use SessionLab  to design effective problem solving workshops or  watch this five minute video  to see the planner in action!

Over to you

The problem-solving process can often be as complicated and multifaceted as the problems they are set-up to solve. With the right problem-solving techniques and a mix of creative exercises designed to guide discussion and generate purposeful ideas, we hope we’ve given you the tools to find the best solutions as simply and easily as possible.

Is there a problem-solving technique that you are missing here? Do you have a favorite activity or method you use when facilitating? Let us know in the comments below, we’d love to hear from you! 

thank you very much for these excellent techniques

Certainly wonderful article, very detailed. Shared!

Your list of techniques for problem solving can be helpfully extended by adding TRIZ to the list of techniques. TRIZ has 40 problem solving techniques derived from methods inventros and patent holders used to get new patents. About 10-12 are general approaches. many organization sponsor classes in TRIZ that are used to solve business problems or general organiztational problems. You can take a look at TRIZ and dwonload a free internet booklet to see if you feel it shound be included per your selection process.

Leave a Comment Cancel reply

Your email address will not be published. Required fields are marked *

Going from a mere idea to a workshop that delivers results for your clients can feel like a daunting task. In this piece, we will shine a light on all the work behind the scenes and help you learn how to plan a workshop from start to finish. On a good day, facilitation can feel like effortless magic, but that is mostly the result of backstage work, foresight, and a lot of careful planning. Read on to learn a step-by-step approach to breaking the process of planning a workshop into small, manageable chunks.  The flow starts with the first meeting with a client to define the purposes of a workshop.…

How does learning work? A clever 9-year-old once told me: “I know I am learning something new when I am surprised.” The science of adult learning tells us that, in order to learn new skills (which, unsurprisingly, is harder for adults to do than kids) grown-ups need to first get into a specific headspace.  In a business, this approach is often employed in a training session where employees learn new skills or work on professional development. But how do you ensure your training is effective? In this guide, we'll explore how to create an effective training session plan and run engaging training sessions. As team leader, project manager, or consultant,…

Effective online tools are a necessity for smooth and engaging virtual workshops and meetings. But how do you choose the right ones? Do you sometimes feel that the good old pen and paper or MS Office toolkit and email leaves you struggling to stay on top of managing and delivering your workshop? Fortunately, there are plenty of online tools to make your life easier when you need to facilitate a meeting and lead workshops. In this post, we’ll share our favorite online tools you can use to make your job as a facilitator easier. In fact, there are plenty of free online workshop tools and meeting facilitation software you can…

Design your next workshop with SessionLab

Join the 150,000 facilitators using SessionLab

Sign up for free

• Business Essentials
• Leadership & Management
• Credential of Leadership, Impact, and Management in Business (CLIMB)
• Entrepreneurship & Innovation
• Digital Transformation
• Finance & Accounting
• Business in Society
• For Organizations
• Support Portal
• Media Coverage
• Founding Donors
• Leadership Team

• Harvard Business School →
• HBS Online →
• Business Insights →

Business Insights

Harvard Business School Online's Business Insights Blog provides the career insights you need to achieve your goals and gain confidence in your business skills.

• Career Development
• Communication
• Decision-Making
• Earning Your MBA
• Negotiation
• News & Events
• Productivity
• Staff Spotlight
• Student Profiles
• Work-Life Balance
• AI Essentials for Business
• Alternative Investments
• Business Analytics
• Business Strategy
• Business and Climate Change
• Design Thinking and Innovation
• Digital Marketing Strategy
• Disruptive Strategy
• Economics for Managers
• Entrepreneurship Essentials
• Financial Accounting
• Global Business
• Launching Tech Ventures
• Leadership Principles
• Leadership, Ethics, and Corporate Accountability
• Leading with Finance
• Management Essentials
• Negotiation Mastery
• Organizational Leadership
• Power and Influence for Positive Impact
• Strategy Execution
• Sustainable Business Strategy
• Sustainable Investing
• Winning with Digital Platforms

What Is Creative Problem-Solving & Why Is It Important?

• 01 Feb 2022

One of the biggest hindrances to innovation is complacency—it can be more comfortable to do what you know than venture into the unknown. Business leaders can overcome this barrier by mobilizing creative team members and providing space to innovate.

There are several tools you can use to encourage creativity in the workplace. Creative problem-solving is one of them, which facilitates the development of innovative solutions to difficult problems.

Here’s an overview of creative problem-solving and why it’s important in business.

Access your free e-book today.

What Is Creative Problem-Solving?

Research is necessary when solving a problem. But there are situations where a problem’s specific cause is difficult to pinpoint. This can occur when there’s not enough time to narrow down the problem’s source or there are differing opinions about its root cause.

In such cases, you can use creative problem-solving , which allows you to explore potential solutions regardless of whether a problem has been defined.

Creative problem-solving is less structured than other innovation processes and encourages exploring open-ended solutions. It also focuses on developing new perspectives and fostering creativity in the workplace . Its benefits include:

• Finding creative solutions to complex problems : User research can insufficiently illustrate a situation’s complexity. While other innovation processes rely on this information, creative problem-solving can yield solutions without it.
• Adapting to change : Business is constantly changing, and business leaders need to adapt. Creative problem-solving helps overcome unforeseen challenges and find solutions to unconventional problems.
• Fueling innovation and growth : In addition to solutions, creative problem-solving can spark innovative ideas that drive company growth. These ideas can lead to new product lines, services, or a modified operations structure that improves efficiency.

Creative problem-solving is traditionally based on the following key principles :

1. Balance Divergent and Convergent Thinking

Creative problem-solving uses two primary tools to find solutions: divergence and convergence. Divergence generates ideas in response to a problem, while convergence narrows them down to a shortlist. It balances these two practices and turns ideas into concrete solutions.

2. Reframe Problems as Questions

By framing problems as questions, you shift from focusing on obstacles to solutions. This provides the freedom to brainstorm potential ideas.

3. Defer Judgment of Ideas

When brainstorming, it can be natural to reject or accept ideas right away. Yet, immediate judgments interfere with the idea generation process. Even ideas that seem implausible can turn into outstanding innovations upon further exploration and development.

4. Focus on "Yes, And" Instead of "No, But"

Using negative words like "no" discourages creative thinking. Instead, use positive language to build and maintain an environment that fosters the development of creative and innovative ideas.

Creative Problem-Solving and Design Thinking

Whereas creative problem-solving facilitates developing innovative ideas through a less structured workflow, design thinking takes a far more organized approach.

Design thinking is a human-centered, solutions-based process that fosters the ideation and development of solutions. In the online course Design Thinking and Innovation , Harvard Business School Dean Srikant Datar leverages a four-phase framework to explain design thinking.

The four stages are:

• Clarify: The clarification stage allows you to empathize with the user and identify problems. Observations and insights are informed by thorough research. Findings are then reframed as problem statements or questions.
• Ideate: Ideation is the process of coming up with innovative ideas. The divergence of ideas involved with creative problem-solving is a major focus.
• Develop: In the development stage, ideas evolve into experiments and tests. Ideas converge and are explored through prototyping and open critique.
• Implement: Implementation involves continuing to test and experiment to refine the solution and encourage its adoption.

Creative problem-solving primarily operates in the ideate phase of design thinking but can be applied to others. This is because design thinking is an iterative process that moves between the stages as ideas are generated and pursued. This is normal and encouraged, as innovation requires exploring multiple ideas.

Creative Problem-Solving Tools

While there are many useful tools in the creative problem-solving process, here are three you should know:

Creating a Problem Story

One way to innovate is by creating a story about a problem to understand how it affects users and what solutions best fit their needs. Here are the steps you need to take to use this tool properly.

1. Identify a UDP

Create a problem story to identify the undesired phenomena (UDP). For example, consider a company that produces printers that overheat. In this case, the UDP is "our printers overheat."

2. Move Forward in Time

To move forward in time, ask: “Why is this a problem?” For example, minor damage could be one result of the machines overheating. In more extreme cases, printers may catch fire. Don't be afraid to create multiple problem stories if you think of more than one UDP.

3. Move Backward in Time

To move backward in time, ask: “What caused this UDP?” If you can't identify the root problem, think about what typically causes the UDP to occur. For the overheating printers, overuse could be a cause.

Following the three-step framework above helps illustrate a clear problem story:

• The printer is overused.
• The printer overheats.
• The printer breaks down.

You can extend the problem story in either direction if you think of additional cause-and-effect relationships.

4. Break the Chains

By this point, you’ll have multiple UDP storylines. Take two that are similar and focus on breaking the chains connecting them. This can be accomplished through inversion or neutralization.

• Inversion: Inversion changes the relationship between two UDPs so the cause is the same but the effect is the opposite. For example, if the UDP is "the more X happens, the more likely Y is to happen," inversion changes the equation to "the more X happens, the less likely Y is to happen." Using the printer example, inversion would consider: "What if the more a printer is used, the less likely it’s going to overheat?" Innovation requires an open mind. Just because a solution initially seems unlikely doesn't mean it can't be pursued further or spark additional ideas.
• Neutralization: Neutralization completely eliminates the cause-and-effect relationship between X and Y. This changes the above equation to "the more or less X happens has no effect on Y." In the case of the printers, neutralization would rephrase the relationship to "the more or less a printer is used has no effect on whether it overheats."

Even if creating a problem story doesn't provide a solution, it can offer useful context to users’ problems and additional ideas to be explored. Given that divergence is one of the fundamental practices of creative problem-solving, it’s a good idea to incorporate it into each tool you use.

Brainstorming

Brainstorming is a tool that can be highly effective when guided by the iterative qualities of the design thinking process. It involves openly discussing and debating ideas and topics in a group setting. This facilitates idea generation and exploration as different team members consider the same concept from multiple perspectives.

Hosting brainstorming sessions can result in problems, such as groupthink or social loafing. To combat this, leverage a three-step brainstorming method involving divergence and convergence :

• Have each group member come up with as many ideas as possible and write them down to ensure the brainstorming session is productive.
• Continue the divergence of ideas by collectively sharing and exploring each idea as a group. The goal is to create a setting where new ideas are inspired by open discussion.
• Begin the convergence of ideas by narrowing them down to a few explorable options. There’s no "right number of ideas." Don't be afraid to consider exploring all of them, as long as you have the resources to do so.

Alternate Worlds

The alternate worlds tool is an empathetic approach to creative problem-solving. It encourages you to consider how someone in another world would approach your situation.

For example, if you’re concerned that the printers you produce overheat and catch fire, consider how a different industry would approach the problem. How would an automotive expert solve it? How would a firefighter?

Be creative as you consider and research alternate worlds. The purpose is not to nail down a solution right away but to continue the ideation process through diverging and exploring ideas.

Continue Developing Your Skills

Whether you’re an entrepreneur, marketer, or business leader, learning the ropes of design thinking can be an effective way to build your skills and foster creativity and innovation in any setting.

If you're ready to develop your design thinking and creative problem-solving skills, explore Design Thinking and Innovation , one of our online entrepreneurship and innovation courses. If you aren't sure which course is the right fit, download our free course flowchart to determine which best aligns with your goals.

About the Author

Into all problem-solving, a little dissent must fall

Events of the past several years have reiterated for executives the importance of collaboration and of welcoming diverse perspectives when trying to solve complicated workplace problems. Companies weren’t fully prepared for the onset of a global pandemic, for instance, and all that it engendered—including supply chain snarls and the resulting Great Attrition  and shift to remote (and now hybrid) work, which required employers to fundamentally rethink their talent strategies . But in most cases leaders have been able to collaborate their way through the uncertainty, engage in rigorous debate and analyses about the best steps to take, and work with employees, suppliers, partners, and other critical stakeholders to react and, ultimately, recover.

And It’s not just COVID-19: many organisations have had to rethink their business strategies and practices in the wake of environmental concerns, the war in Ukraine, and social movements sparked by racial injustice, sexual misconduct, and widespread economic inequity . Ours are fast-moving, complex times, rich not just in worrisome challenges but also in exciting potential—organisations that enable innovation will find ample opportunities to thrive. So now more than ever, decision makers can’t act alone; they must bring diverse perspectives to the table and ensure that those voices are fully heard . 1 Sundiatu Dixon-Fyle, Kevin Dolan, Vivian Hunt, and Sara Prince, “ Diversity wins: How inclusion matters ,” McKinsey, May 19, 2020.

But while many leaders say they welcome dissent, their reactions often change when they actually get some. They may feel defensive. They may question their own judgment. They may resent having to take time to revisit the decision-making process. These are natural responses, of course; employees’ loyalty and affirmation are more reassuring to leaders than robust challenges from the group. There is discomfort, too, for potential dissenters; it is much safer to keep your thoughts to yourself and conform  than to risk expulsion from the group. 2 Derived from this work on the evolutionary origins of social and political behavior: Christopher Boehm, Hierarchy in the Forest: The Evolution of Egalitarian Behavior , Cambridge, Massachusetts: Harvard University Press, 2001.

What’s missing in many companies, in our experience, is the use of “contributory dissent” or the capabilities required to engage in healthy if divergent discussions about critical business problems. Contributory dissent allows individuals and groups to air their differences in a way that moves the discussion toward a positive outcome and doesn’t undermine leadership or group cohesion . 3 McKinsey itself has established obligation to dissent as one of its core values alongside those focused on client service and talent development. For more, see Bill Taylor, “True leaders believe dissent is an obligation,” Harvard Business Review , January 12, 2017.

McKinsey’s research and experience in the field point to several steps leaders can take to engage in healthy dissent and build a culture where constructive feedback is expected and where communication is forthright. These include modeling “open” behaviors, embedding psychological safety  and robust debate into decision-making processes, and equipping employees with the communication skills that will allow them to contribute dissenting opinions effectively.

In this article we outline the steps leaders can take to encourage healthy dissent, and the actions teams and individuals can take to share their voices and perspectives most effectively. It takes both sides, after all, to engage in robust debate, find the right solutions, and enable lasting, positive change.

How leaders can encourage contributory dissent

Senior leaders in an organisation play a central role in ensuring that individuals and teams see contributory dissent as a normal part of any discussion. They can signal the importance of dissent by taking a series of steps to institutionalise the practice within an organisation and empower employees to share their ideas freely and productively. Specifically, senior leaders should strive to inspire rather than direct employees to collaborate, explicitly demand dissent and, taking that one step further, actively engage with naysayers (see sidebar “How to encourage healthy dissent”). 4 Leaders can also draw on McKinsey’s “influence model” for changing mindsets and behaviors: role modeling, fostering understanding and conviction, reinforcing with formal mechanisms, and developing talent and skills. For more, see Tessa Basford and Bill Schaninger, “ The four building blocks of change ,” McKinsey Quarterly , April 11, 2016.

Inspire, don’t direct

How to encourage healthy dissent.

To encourage dissent through personal leadership:

Lead to inspire, not to direct:

• Empower the group to come up with ideas: “None of us knows the answer yet, but we can work it out together if we harness the best of everyone’s thinking.”

Foster dissent by actively seeking it:

• Explicitly seek dissent; give people permission and encouragement.
• Consider including dissent as a stated organisational value.
• Make provision for open discussion in the buildup to decisions.

Welcome open discussion when it comes:

• Listen to dissenters and naysayers, and thank them for their insights.
• Recognise this as a usefully unfiltered channel for understanding the organisation’s perceptions on issues.
• Seek to bring dissenters along the decision journey, so they become positive influencers later during implementation.
• Employ deliberate techniques such as red teaming and pre-mortems to widen the debate and mitigate groupthink.

As the inspirational speaker Simon Sinek put it, “The role of a leader is not to come up with all the great ideas. The role of a leader is to create an environment in which great ideas can happen.” 5 Simon Sinek, Start with Why: How Great Leaders Inspire Everyone to Take Action , New York, NY: Portfolio, 2009. That is especially important for fostering an atmosphere of collaboration and contributory dissent. Rather than immediately jump into a discussion about solutions, one senior leader in an international organisation addressed his team’s anxiety in the wake of a crisis. “Let me guess,” he said, “you’re all feeling confused and uncertain about the way ahead. Terrific. I’m so glad we are of one mind and that we all understand our situation correctly! I’m sure that we can work it out together, but it’s going to require the best of everyone’s thinking. Let’s get started.” His authenticity and understated humor allowed him to connect with the group and inspired them to keep calm, carry on, and generate solutions that the leader alone couldn’t have come up with. Harvard professor Ron Heifetz describes this as creating a holding environment, a key element of adaptive leadership. 6 Ronald A. Heifetz and Mary Linksy, Leadership on the Line: Staying Alive through the Dangers of Leading , Boston, MA: Harvard Business School Press, 2002; Ronald Heifetz, Alexander Grashow, and Marty Linksy, The Practice of Adaptive Leadership: Tools and Tactics for Changing Your Organization and the World , Boston, MA: Harvard Business Press, 2009.

Explicitly demand dissent

It’s not enough for leaders to give people permission to dissent; they must demand it of people. In many companies, individuals and teams may (understandably) default to collegiality, not realizing that there are ways to challenge ideas while still respecting colleagues’ roles and intellect. It’s on senior leaders, then, to help employees understand where the boundaries are. In World War 1, Australia’s General Sir John Monash was determined to develop better tactics to overcome the catastrophic impasse of trench warfare. He knew there were answers to be found from the experience of soldiers in the trenches, but he needed to loosen the military discipline of blind obedience: “I don’t care a damn for your loyal service when you think I am right; when I really want it most is when you think I am wrong.” Monash scheduled open battle planning sessions and pulled in advice from whoever offered it. In doing so, he built ownership of and confidence in his plans among all ranks. The resulting orchestration of tanks, artillery, aircraft, and troops led to rapid advances along the Somme Valley, and Monash garnered respect and appreciation from his troops, whose chances of survival and ultimate victory had increased markedly.

Actively engage with naysayers

Taking the demand imperative one step further, it’s beneficial for leaders to actively seek out the views of vocal naysayers , who can turn into influential champions just by being part of the conversation. They can immediately improve the nature of business debate and may boost the quality of the final decision, although engaging with naysayers can be tough. Some dissenting opinions can be ill-informed or uncomfortable to hear. The objective for senior leaders, then, is to put their discomfort aside and listen for signs of cognitive dissonance within an organisation. As an example, front-line employees may say things like “We’re not considered strategic thinkers,” or “The company doesn’t put people first,” while senior management may actually feel as though they have made strides in both of those areas. Still, leaders need to absorb such comments, treat them as useful data points, assess their validity, and engage in what may be a challenging discussion. They may want to use red teams  and premortems , in which teams at the outset anticipate all the ways a project could fail, to frame up dissenting opinions, mitigate groupthink, and find a positive resolution. These behaviours also serve to enhance organizational agility and resilience .

How leaders can establish psychological safety

Senior leaders need to establish a work environment in which it is safe to offer dissenting views. The McKinsey Health Institute’s work on employee well-being points to a strong correlation between leadership behaviors, collaborative culture, and resistance to mental health problems and burnout : only 15 percent of employees in environments with low inclusivity and low support for personal growth are highly engaged, compared with 38 percent in high-scoring environments. 7 “ Addressing employee burnout: Are you solving the right problem? ,” McKinsey, May 27, 2022. Leaders can build psychological safety (where team members feel they can take interpersonal risks and remain respected and accepted) and set the conditions for contributory dissent by rethinking how they engage in debate—both the dynamics and the choreography of it.

The dynamics of debate

The poet and playwright Oscar Wilde described a healthy debating culture as one in which people are “playing gracefully with ideas”— listening to, and even nourishing, opposing points of view in a measured and respectful way. 8 The Complete Works of Oscar Wilde, Volume 2: De Profundis, “Epistola: In Carcere et Vinculis,” Oxford, United Kingdom: Clarendon Press, 2005. Indeed, the best ideas can emerge at the intersection of cultures and opinions. In 15th century Florence, for instance, the Medici family attracted and funded creators from across the arts and sciences to establish an epicenter of innovative thinking that sparked the Renaissance. 9 Frans Johansson, The Medici Effect: Breakthrough Insights at the Intersection of Ideas, Concepts, and Culture , Boston, MA: Harvard Business School Press, 2004. Closer to this century, we have seen cross-discipline innovations like the application of biologists’ research on ant colonies to solve problems in telecommunications routing. And in the business world, extraordinary innovations have been achieved by open-minded leaders bringing together smart people and creating the conditions for playful exploration.

To achieve a state of “graceful play,” senior leaders must carefully manage group dynamics during debates. Rather than lead with their own opinions, for instance, which might immediately carry outsize weight in the group and stifle discussion, senior leaders can hold back and let others lead the discussion . They can lean in to show genuine curiosity or to explicitly recognise when a dissenting view has changed their thinking. But by letting other, more junior voices carry the agenda and work through ideas, however imperfect, senior leaders can establish a climate of psychological safety—and garner more respect from colleagues long term. 10 Amy C. Edmondson, The Fearless Organization: Creating Psychological Safety in the Workplace for Learning, Innovation, and Growth , Hoboken, NJ: John Wiley & Sons, 2019.

Leaders will also need to be aware of cultural differences that may crop up during debates. For example, many Australians speak candidly and are happy to address issues squarely. By contrast, the concept of “face” is so important in many Asian cultures that a more circumspect approach is taken. And the Pacific and Maori cultures emphasize displays of both strength and respect. 11 Erin Meyer, The Culture Map: Breaking through the Invisible Boundaries of Global Business , Philadelphia, PA: PublicAffairs, 2014. These differences in debate dynamics really matter. They can be a great source of hybrid vigour, 12 “Heterosis, also called hybrid vigour: the increase in such characteristics as size, growth rate, fertility, and yield of a hybrid organism over those of its parents. The first-generation offspring generally show, in greater measure, the desired characteristics of both parents.” Encyclopedia Britannica , accessed September 19, 2022. if sensitively managed, or a source of conflict and disenfranchisement if not. To approach these differences in a positive way, senior leaders could undertake a mapping exercise that identifies the different styles of the cultures present, thereby providing validation and enabling pragmatic measures to integrate them.

Choreographing debate

Beyond just managing debate dynamics, business leaders must take a hand in choreographing the debate and, specifically, in helping to design collective-thinking processes  so people know how best to play their part. Business leaders may adopt a structured approach  to brainstorming, for instance, or plan strategic off-site schedules that combine deliberate thinking with “distracted” thinking—taking time to engage in a social activity, for instance—to take advantage of employees’ deep-thinking processes.

How deliberate choices by the leader can optimise a decision-making process

A leader must consciously assess each new situation and design the collective-thinking process accordingly, then articulate this so that people know how best to play their part.

In doing so, the leader should consider an array of questions, the answers to which will determine the context, for example:

• What does success look like?
• Will the organisation underwrite initial failures in the interests of agility and innovation?
• How broad and freethinking an analysis is required?
• What are the explicit expectations for contributory dissent?
• Are any topics and behaviours out of bounds?
• Who will lead the discussion, and how will comments be captured?
• Does urgency mean that it’s better to be directive?
• Who will be consulted?
• Which decisions can be delegated, and to whom?
• Whose support needs to be built?
• What parameters and boundaries exist?
• Are there interim decisions and communications required?
• What form should the deliverable outcomes take?
• When are the deliverables required?
• Direction setting on these parameters by the leader focuses the team, while also creating space for creativity and iterative learning.

To create a sustainable structure for debate, business leaders will need to consider questions relating to team structure and rules of engagement: What does success look like when it comes to contributory dissent? What topics and behaviors are out of bounds? Who will lead the discussion, and how will comments be captured? Who has the final say on decisions, or which decisions can be delegated, and to whom? (For a more comprehensive explanation, see sidebar “How deliberate choices by the leader can optimise a decision-making process.”)

Having these parameters in place can free up the team to think more creatively about the issue at hand. Establishing such protocols can also make it easier to raise dissenting opinions. At one company, people are asked to call out their underlying values or potential biases when expressing a dissenting view. During meetings of the promotion committee, for instance, a statement like “I think we are making the wrong decision” would be rephrased as “I am someone who values experience over collaboration, and this decision would risk losing too much institutional knowledge.”

How individuals and teams can engage and dissent

As we’ve shared, senior leaders can take steps to set conditions for robust discussion and problem-solving, but individuals and teams themselves must also have the right mindsets and skills for contributory dissent to work well (see sidebar “How teams and individuals can dissent effectively”). In particular, they must embrace the obligation to dissent, actively make space to analyse ideas that are different from their own, and then find ways to either iterate on others’ ideas or respectfully agree to disagree.

Embrace the obligation to dissent

How teams and individuals can dissent effectively.

For dissent to be effective, its delivery requires courage and tactical skills underpinned by sincere respect and grace. Speaking up with respect is the right thing to do, and the responsibility to do so exists, even if there is uncertainty. The following guidelines are useful in enabling effective dissent:

Prepare a welcome for dissenting views:

• Understand the context and motivations of others, appreciate their views, and syndicate your own.
• Stop and strategise before wading into the conversations, establish a solid platform for agreement, and explicitly seek permission to dissent.

Play the long game:

• Be open minded and iterative. Don’t expect to succeed on the first try.
• Listen to others for what their views might add rather than to defend your own.

Withhold assent if you need to, but do it carefully:

• Withholding assent is a legitimate option if done judiciously.
• Minimise offense to and loss of face for the decision maker.
• If principles or legality is at stake, document your dissent.

Individuals and teams need to exhibit a certain amount of humility and confidence in order to speak truth to power with respect; they must be sure for themselves that doing so is the right thing to do. To build this confidence, individuals and teams should remember that the very act of dissent can be valuable, even if the contribution itself isn’t 100 percent baked. Others can react or build on the dissenting view—which, in itself, can be a satisfying process for a dissenter. If the ultimate decision isn’t what they proposed, they still helped shape it by offering and testing a worthy possibility.

Make space to analyse different views

Individuals and teams may need time to determine their positions on an issue. During this period, it’s important to be (and seen to be) open-minded and respectful of others’ views. That means asking lots of questions, gathering information, assessing others’ motivations, and acknowledging their views before syndicating alternatives of your own. Much of this fact gathering can be done one-on-one, in a nonconfrontational way, in offline conversations rather than in a tension-filled meeting room. In these conversations, individuals could start by reaffirming a shared commitment to finding a solution to the issue at hand, their respect for the decision-making process and the group, and areas of broad agreement. They could also signal their possible intention to dissent and seek permission to do so rather than confronting people head-on. People will find it harder to refuse that permission, and will be less likely to get defensive, when approached with statements like “This is a great discussion, and I love the vision of where we are headed, but would it be OK for us to explore some alternatives for how to get there?”

Agree to iterate …

Individuals and teams that decide to offer dissenting views should agree to iterate on other solutions, rather than digging in. Their dissenting opinions should be cogent, persuasive, and open-minded—but dissenters shouldn’t expect to change hearts and minds on the first try. They should plant seeds gently and bide their time; they might even see their idea come back as someone else’s. The critical skill required here is active, open listening: dissenters should listen carefully for others’ additive insights and find ways to build on them. In their contributory dissent, individuals and teams can take a moment to summarize what others have said and then use statements like “Can I offer another take?” and then allow the momentum of the conversation to take over.

… or agree to disagree

But what happens if, after all the considered and tactful input, the dissenter still believes a decision is heading in the wrong direction? In our experience, withholding assent then becomes a legitimate option: people shouldn’t agree if they don’t agree. This is where all the careful, respectful groundwork the dissenter has done can pay dividends. In fact, a dissenting view gains even more power when an individual can say something like, “I still believe in my alternate solution, but I’m grateful for the opportunity to contribute to this process, and I respect that you have the final say.” In this case, the dissenter is supporting the leader while flagging that the open debate hasn’t convinced them to change their initial view.

Of course, withholding assent should be a relatively rare action, taken only after an individual or team has shown that they can accommodate other views and have aligned with the consensus when they believe it’s right to do so. Think of US Supreme Court associate justice Ruth Bader Ginsburg, who joined the consensus view on many decisions but who is especially celebrated for the positive changes that arose from her highly influential dissenting opinions on issues such as gender equity, human rights, and religious freedom.

Contributory dissent can help strengthen employee engagement, unlock hidden insights, and help organisations solve tough challenges. But putting it into practice takes courage and humility, and it won’t just happen by accident. Leaders need to be intentional about welcoming challenges to their plans and opinions, even when it’s uncomfortable to do so. They need to establish cultures and structures where respectful debate can occur and where individuals and teams feel free to bring innovative—and often better—alternative solutions to the table.

Ben Fletcher is a senior partner in McKinsey’s Sydney office, Chris Hartley is a partner in the Melbourne office, Rupe Hoskin is a senior expert in the Canberra office, and Dana Maor is a senior partner in the Tel Aviv office.

The authors wish to thank Jacqueline Brassey, Nikki Dines, Richard Fitzgerald, Sam Hemphill, Ayush Jain, Jemma King, and Martin Nimmo for their contributions to this article.

Explore a career with us

Related articles.

Psychological safety and the critical role of leadership development

How to demonstrate calm and optimism in a crisis

The four building blocks of change

Along with Stanford news and stories, show me:

• Student information
• Faculty/Staff information

We want to provide announcements, events, leadership messages and resources that are relevant to you. Your selection is stored in a browser cookie which you can remove at any time using “Clear all personalization” below.

Stanford Impact Labs is applying insights gleaned from the social and data sciences to address real-world problems. (Image credit: Getty Images)

A carefully worded letter to help a youth reentering school from the justice system. A text message reminding a released defendant about an upcoming court appearance. A publicly available SMS course showing people how to spot misleading information online.

These are some of the promising interventions Stanford scholars, working in collaboration with local government agencies, nonprofit organizations, and community groups, are testing to address social problems such as recidivism, incarceration, and misinformation in new and innovative ways.

These projects – along with dozens of others – have been funded and supported by Stanford Impact Labs (SIL), an initiative that launched in the 2019-20 academic year as part of the university’s Long-range Vision to help researchers who want their scholarships to serve the public good by using data-driven, social science research to develop actionable ways to address pernicious and pervasive social problems.

“The mission of Stanford Impact Labs is to put social science to work for society through deep and engaged partnerships with leaders in government, nonprofits, and business,” said Jeremy Weinstein , SIL’s founder and faculty director.

Since launching, SIL has provided dozens of fellowships , hosted workshops and forums – including one with the White House – and co-launched a new major to prepare students with the technical skills and practical know-how to tackle these challenges. Another major component of SIL’s work has been investing in a wide range of collaborative research projects at key stages to develop evidence-based solutions that realize individual and social potential. Over four years, SIL has already allocated $20.2M to 32 impact labs working with partners at the local, state, national, and international levels.

“What SIL represents is an ecosystem that supports the path from science to impact beyond the university,” said Weinstein, a professor of political science in the School of Humanities and Sciences. “What we, and a set of our peer institutions, are trying to figure out is what it means to support innovations around social problems with the same intentionality we bring to R&D in life sciences and engineering.”

Working closely with the problem solvers

At the center of SIL’s mission is collaboration: Scholars work closely with practitioners from the public, private, or social sectors who deal with problems firsthand yet may lack the necessary time, resources, or research tools to generate evidence and insights that could help a potential solution gain traction.

SIL recognizes that tangible solutions to stubborn social problems require collaboration across sectors and thus commits to funding and supporting projects that bridge research and practice.

For example, one collaboration SIL first funded in 2020 was between the Computational Policy Lab (CPL) and the Santa Clara County Office of the Public Defender (SCCPDO). The SCCPDO connected with CPL after hearing Sharad Goel speak about how technology can be used to address social problems.

Goel, along with his colleagues at Stanford and the nonprofit group The Bail Project , were developing a tool the SCCPDO wanted to implement: a mobile app that could send reminder messages to public defender clients about their court hearing dates.

Missing a court hearing can come with devastating consequences for a defendant: In some cases, it can lead judges to issue a warrant for the defendant’s arrest, which can lead to added jail time.

If court appearances could be increased, would incarcerations decrease?

SCCPDO and researchers from Stanford and Harvard, where Goel is now a professor of public policy, put the question to the test in a randomized control trial. They discovered that a simple text reminder does make a difference: They were able to reduce arrest warrants for missed court dates by approximately 20% and incarceration resulting from missed hearings dropped from 6.2% in the control group to 4.8% in the treatment condition. Across the roughly 20,000 clients that SCCPDO serves every year, this would translate to several hundred fewer people in jail each year.

In addition, their intervention was a cost-effective way to prevent incarceration: Each text message they sent cost less than a penny; and across the many reminders and responses they received from clients, it cost about 60¢ per case to send reminders.

These findings, which have not yet been peer-reviewed, are detailed in a working paper available on the pre-publication print website, ArXiv .

By collaborating with scholars, the SCCPDO was able to rigorously test one way to lower incarceration rates, measuring impact in a way a technology vendor would likely not provide, said Alex Chohlas-Wood , PhD ’22, the executive director of CPL.

For Chohlas-Wood, whose own research focuses on using technology and data science to support criminal justice reform, working with SCCPDO is an opportunity to make tangible change.

“To be able to connect the dots between the work that we’re doing and seeing actual improvement in outcomes really matters to me,” Chohlas-Wood said.

Realities of implementation

Sometimes, the biggest challenges facing problem-solvers are practical ones. Elegantly designed solutions to a problem might exist but there are obstacles that make them difficult, if not near impossible, to implement.

Scalability is something Carey Courtney, the re-entry coordinator for Milwaukee Public Schools (MPS), carefully considers in her work helping students transition out of the juvenile justice system and to school.

Some interventions to help the students Courtney works with can take weeks, if not months, to complete. For example, the Dialectical Behavioral Therapy program that MPS offers to some students has around 30 sessions to it. While effective, solutions like these take a lot of time, as well as lengthy training, to implement.

Moreover, many of the children Courtney works with have lives that are sometimes unstable and often unpredictable, making it hard to deliver consistent care.

Having something widely accessible to implement appealed to Courtney, who was eager to work with Stanford psychologist Greg Walton and his team after learning about his Lifting the Bar (LTB) work through a colleague.

“Sometimes, when we get a new intervention, they are very time-consuming,” Courtney said. “Then we saw this, I thought, ‘Oh! We could actually do this.’”

Unlike some school programs which need to be administered by a licensed professional, the intervention developed by the LBT team requires no special training or skills to implement.

The premise is straightforward: Over one hour, reentering students read and answer questions about what it is like to transition from detention to school, sharing advice for future students. Then they identify a teacher who could be an important source of support for them, and what they would like that person to know about them, their values and goals and schools and challenges they face the teacher might help with. Their responses are then populated into a personalized letter that is sent to that teacher.

As the result of a Stage 2 SIL investment in the LTB team and their partnership with MPS, Courtney has been able to roll out the intervention in her school district. What also appealed to Courtney was how the intervention focuses on the student-teacher relationship.

“It sets up this relationship early on,” Courtney said. “When [a] student feels connected to school and safe adults, they’re less likely to make negative choices, which can lead them back into the juvenile justice system – or at a minimum, keep them out longer.”

Different approaches to have impact

Also central to SIL’s vision is cultivating a community for both scholars and problem solvers to share issues they encounter while implementing solutions-oriented research.

Having a purpose-driven mission towards research is what led Susan Athey , the Economics of Technology Professor at the Graduate Business School (GSB) and founder of the Golub Capital Social Impact Lab to want to become involved with SIL.

Athey recently received Stage 2 funding to build out a project her students helped get off the ground at the start of the COVID-19 pandemic to better understand the spread of health-related misinformation. Athey hopes her team’s findings can be expanded into a tool that can be used across different contexts and settings.

“There’s a lot of different ways to have an impact as an academic,” said Athey. “For me, one form of impact is to create case studies that establish the potential for a novel intervention to have meaningful effect.”

Athey has found that her colleagues involved at SIL also share an orientation towards developing research-informed tools that are both scalable and generalizable.

“SIL is a community of people who are really thinking about how to combine research with impact so that you get this multiple-level impact – not just the impact on the people you’re helping, but also the thought leadership and broader impact on how people are approaching these problems,” said Athey.

Small steps leading to big changes

While there have been major advancements across health, science, and policy that have made the world a better place, there are still many issues facing society. Solving social problems is undoubtedly complex, and scholars recognize there is no single, technical fix. Issues are multifaceted and different approaches are needed.

“We have to figure out how to take these complex problems and break them down into tractable pieces and figure out where and how we can make progress and help inspire people that progress is possible,” Weinstein said.

SIL continues to grow. A new set of Stage 2 labs has just been funded, and it is launching a fellowship this year for nonprofit leaders and for local policymakers to come to Stanford and learn new ways to gather data and insights that can be used to meet their social change goals.

Earlier this month, SIL announced the first of two Stage 3 investments it will make this year, the initiative’s biggest and boldest grants yet.

“Social problems exist for many different reasons, and often because there are powerful interests aligned behind the status quo. But I’m unwilling to accept, as are most of my colleagues, the status quo. We believe research can help us find actionable solutions,” Weinstein said.

Stanford Impact Labs is a university-wide initiative established in the School of Humanities and Sciences.

A Robot-assisted real case-handling approach to improving students’ learning performances in vocational training

• Published: 14 May 2024

Cite this article

• Chun-Chun Chang 1 &
• Gwo-Jen Hwang   ORCID: orcid.org/0000-0001-5155-276X 2 , 3  

In vocational education, cultivating students’ ability to deal with real cases is a crucial training objective. The BSFE (i.e., Brainstorming, Screening, Formation, Examination) model is a commonly adopted training procedure. Each stage is designed for guiding students to analyze and find solutions to handle real cases. However, as one teacher is generally responsible for several dozen students, it becomes challenging for the teacher to adequately address each student’s questions and individual needs. Therefore, this study proposed the robot teaching assistant-supported learning (RTAL) mode following the BSFE model to cope with this problem. This investigation assessed its efficacy through an experiment within an Acute Asthma Attack curriculum. The research involved 103 nursing students in their third year from two distinct classes at a vocational university. Fifty-three students from a class constituted the experimental group that implemented the RTAL approach, whereas the other class, comprising 50 students, was the control group utilizing the standard technology-supported learning (CTL) approach. Findings indicated that the experimental group surpassed the control group in various aspects, including learning outcomes, learning attitudes, problem-solving tedencies, critical thinking awareness, acceptance of technology, and satisfaction with the learning experience. The interview findings also revealed that the RTAL mode could cater to individualized learning needs, facilitate interaction, and serve as an auxiliary instructional tool.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price includes VAT (Russian Federation)

Instant access to the full article PDF.

Rent this article via DeepDyve

Institutional subscriptions

Data availability

The data and materials are available upon request to the corresponding author.

Code availability

Not applicable.

Aralihond, A., Shanta, Z., Pullattayil, A., & Powell, C. V. E. (2020). Treating acute severe asthma attacks in children: Using aminophylline. Breathe , 16 (4). https://doi.org/10.1183/20734735.0081-2020 .

Banaeian, H., & Gilanlioglu, I. (2021). Influence of the NAO robot as a teaching assistant on university students’ vocabulary learning and attitudes. Australasian Journal of Educational Technology , 37 (3), 71–87. https://doi.org/10.14742/ajet.6130 .

Article   Google Scholar  

Bell, D. (1996). The formation of concepts and the structure of thoughts. Philosophy and Phenomenological Research , 56 (3), 583–596.

Belpaeme, T., Kennedy, J., Ramachandran, A., Scassellati, B., & Tanaka, F. (2018). Social robots for education: A review. Science Robotics , 3 (21), eaat5954. https://doi.org/10.1126/scirobotics.aat5954 .

Chen, H., Park, H. W., & Breazeal, C. (2020). Teaching and learning with children: Impact of reciprocal peer learning with a social robot on children’s learning and emotive engagement. Computers & Education , 150 , 103836. https://doi.org/10.1016/j.compedu.2020.103836 .

Chen, B., Hwang, G. H., & Wang, S. H. (2021). Gender differences in cognitive load when applying game-based learning with Intelligent Robots. Educational Technology & Society , 24 (3), 102–115.

Google Scholar  

Chen, X., Cheng, G., Zou, D., Zhong, B., & Xie, H. (2023). Artificial intelligent robots for precision education. Educational Technology & Society , 26 (1), 171–186.

Chookaew, S., & Panjaburee, P. (2022). Implementation of a robotic-transformed five-phase inquiry learning to foster students’ computational thinking and engagement: A mobile learning perspective. International Journal of Mobile Learning and Organisation , 16 (2), 198–220.

Chu, H. C., Hwang, G. J., Tsai, C. C., & Tseng, J. C. R. (2010). A two-tier test approach to developing location-aware mobile learning systems for natural science courses. Computers & Education , 55 (4), 1618–1627. https://doi.org/10.1016/j.compedu.2010.07.004 .

Dubovi, I., Levy, S. T., & Dagan, E. (2017). Now I know how! The learning process of medication administration among nursing students with non-immersive desktop virtual reality simulation. Computers & Education , 113 , 16–27. https://doi.org/10.1016/j.compedu.2017.05.009 .

Engwall, O., & Lopes, J. (2020). Interaction and collaboration in robot-assisted language learning for adults. Computer Assisted Language Learning , 1–37. https://doi.org/10.1080/09588221.2020.1799821 .

Fildes, E. E., Campell, N. J., & Garcia, R. (2021). International nursing collaboration to establish the Philippine quit line using a conceptual model for partnership and sustainability in global health. Journal of Addictions Nursing , 32 (1), 27–31. https://doi.org/10.1097/JAN.0000000000000382 .

Galvão, E. C. F., & Püschel, V. A. A. (2012). Multimedia application in mobile platform for teaching the measurement of central venous pressure. Revista da Escola de Enfermagem da Usp, 46 , 107–115. https://doi.org/10.1590/S0080-62342012000700016 .

Hong, Z. W., Huang, Y. M., Hsu, M., & Shen, W. W. (2016). Authoring robot-assisted instructional materials for improving learning performance and motivation in EFL classrooms. Educational Technology & Society , 19 (1), 337–349.

Hsieh, J. C., & Lee, J. S. (2021). Digital storytelling outcomes, emotions, grit, and perceptions among EFL middle school learners: Robot-assisted versus Power Point-assisted presentations. Computer Assisted Language Learning . https://doi.org/10.1080/09588221.2021.1969410 .

Hwang, G. J., Yang, T. C., Tsai, C. C., & Yang, S. J. H. (2009). A context-aware ubiquitous learning environment for conducting complex science experiments. Computers & Education , 53 (2), 402–413. https://doi.org/10.1016/j.compedu.2009.02.016 .

Hwang, G. J., Yang, L. H., & Wang, S. Y. (2013). A concept map-embedded educational computer game for improving students’ learning performance in natural science courses. Computers & Education , 69 , 121–130. https://doi.org/10.1016/j.compedu.2013.07.008 .

Jahan, A., Ismail, M. Y., Sapuan, S. M., & Mustapha, F. (2010). Material screening and choosing methods–a review. Materials & Design , 31 (2), 696–705. https://doi.org/10.1016/j.matdes.2009.08.013 .

Johnson, D. W., & Johnson, R. T. (2018). Cooperative learning: The foundation for active learning. IntechOpen , 1–12. https://doi.org/10.5772/intechopen.81086 .

Jones, H., Lawton, A., & Gupta, A. (2022). Asthma attacks in children—challenges and opportunities. Indian Journal of Pediatrics , 89 (4), 373–377.

Kanero, J., et al. (2018). Social robots for early language learning: Current evidence and future directions. Child Development Perspectives , 12 (3), 146–151. https://doi.org/10.1111/cdep.12277 .

Kennedy, J., Baxter, P., Senft, E., & Belpaeme, T. (2016, March). Social robot tutoring for child second language learning. 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI) (pp. 231–238). IEEE.

Kim, R. H., & Mellinger, J. D. (2020). Educational strategies to foster bedside teaching. Surgery , 167 (3), 532–534. https://doi.org/10.1016/j.surg.2019.06.007 .

Konijn, E. A., & Hoorn, J. F. (2020). Robot tutor and pupils’ educational ability: Teaching the times tables. Computers & Education , 157 , 103970. https://doi.org/10.1016/j.compedu.2020.103970 .

Kubilinskiene, S., Zilinskiene, I., Dagiene, V., & Sinkevicius, V. (2017). Applying robotics in school education: A systematic review. Baltic Journal of Modern Computing , 5 (1), 50–69. https://doi.org/10.22364/bjmc.2017.5.1.04 .

Lai, C. L., & Hwang, G. J. (2014). Effects of mobile learning time on students’ conception of collaboration, communication, complex problem-solving, meta-cognitive awareness and creativity. International Journal of Mobile Learning and Organization , 8 (3), 276–291. https://doi.org/10.1504/IJMLO.2014.067029 .

Article   MathSciNet   Google Scholar  

Lei, X., & Rau, P. L. P. (2021). Effect of Robot Tutor’s feedback Valence and Attributional Style on Learners. International Journal of Social Robotics , 1–19.

Li, D., & Chen, X. (2020). Study on the Application and Challenges of Educational Robots in Future Education Paper presented at the 2020 International Conference on Artificial Intelligence and Education (ICAIE). Lin, C. Y., & Wang, T. H. (2017). Implementation of personalized e-assessment for remedial teaching in an e-learning environment. Eurasia Journal of Mathematics, Science and Technology Education, 13 (4), 1045–1058. https://doi.org/10.12973/eurasia.2017.00657a .

Liao, Y. J., Jao, Y. L., Boltz, M., Adekeye, O. T., Berish, D., Yuan, F., & Zhao, X. (2023). Use of a Humanoid Robot in supporting Dementia Care: A qualitative analysis. SAGE Open Nursing , 9 , 23779608231179528.

Lin, H. C., Hwang, G. J., & Hsu, Y. D. (2019). Effects of ASQ-based flipped learning on nurse practitioner learners’ nursing skills, learning achievement and learning perceptions. Computers & Education , 139 , 207–221. https://doi.org/10.1016/j.compedu.2019.05.014 .

Mater, E. A. M., Ahmed, E. I., ElSayed, A. A., Shaikh, M. A. E., & Farag, M. K. (2014). The impact of the objective structured clinical examination approach for clinical evaluation skills on the student’s performance in nursing college. World Journal of Medical Sciences , 11 (4), 609–613. https://doi.org/10.5829/idosi.wjms.2014.11.4.91139 .

Mazzoni, E., & Benvenuti, M. (2015). A robot-partner for preschool children learning English using socio-cognitive conflict. Educational Technology & Society , 18 (4), 474–485.

Obafemi, K. E. (2024). Enhancing pupils’ academic performance in mathematics using brainstorming instructional strategy. ASEAN Journal of Science and Engineering Education , 4 (2), 99–106.

Papadopoulos, I., Lazzarino, R., Miah, S., & Weaver, T. (2020). A systematic review of the literature regarding socially assistive robots in pre-tertiary education. Computers & Education , 155 , 103924. https://doi.org/10.1016/j.compedu.2020.103924 .

Park, H. W., Grover, I., Spaulding, S., Gomez, L., & Breazeal, C. (2019, July). A model-free affective reinforcement learning approach to personalization of an autonomous social robot companion for early literacy education. In Proceedings of the AAAI Conference on Artificial Intelligence, 33 (l), 687–694. https://doi.org/10.1609/aaai.v33i01.3301687 .

Pfadenhauer, M., & Dukat, C. (2015). Robot caregiver or robot-supported caregiving? The performative deployment of the social robot PARO in dementia care. International Journal of Social Robotics , 7 , 393–406.

Pueyo-Garrigues, M., Whitehead, D., Pardavila-Belio, M. I., Canga-Armayor, A., Pueyo-Garrigues, S., & Canga-Armayor, N. (2019). Health education: A rogerian concept analysis. International Journal of Nursing Studies , 94 , 131–138. https://doi.org/10.1016/j.ijnurstu.2019.03.005 .

Randall, N. (2019). A Survey of Robot-assisted Language Learning (RALL). ACM transactions on Human-Robot Interaction , ( 9 ) 1.7:1–736. https://doi.org/10.1145/3345506 .

Rezasoltani, A., Saffari, E., Konjani, S., Ramezanian, H., & Zam, M. (2022). Exploring the viability of robot-supported flipped classes in English for medical purposes reading com-prehension. arXiv Preprint arXiv:2208 07442 . https://doi.org/10.48550/arXiv.2208.07442 .

Richert, A., Schiffmann, M., & Yuan, C. (2020). A nursing robot for social interactions and health assessment. In Advances in Human Factors in Robots and Unmanned Systems: Proceedings of the AHFE 2019 International Conference on Human Factors in Robots and Unmanned Systems, July 24–28, 2019, Washington DC, USA 10 (pp. 83–91). Springer International Publishing.

Rowe, B. H., Sevcik, W., & Villa-Roe, C. (2011). Management of severe acute asthma in the emergency department. Current Opinion in Critical Care , 17 (4), 335–341. https://doi.org/10.1097/MCC.0b013e328348bf09 .

Shimada, M., Kanda, T., & Koizumi, S. (2012). How can a social robot facilitate children’s collaboration? In Social Robotics: 4th International Conference, ICSR 2012, Chengdu, China, October 29–31, 2012. Proceedings 4 (pp. 98–107). Springer Berlin Heidelberg. https://doi.org/10.1007/978-3642-34103-810 .

Su, C. H., He, Y. H., & Peng, Y. H. (2012). Respiratory care for a patient undergoing extracorporeal life support for Status Asthmaticus. Journal of Respiratory Therapy , 11 (1), 45–55. https://doi.org/10.6269/JRT.2012.11.1.05 .

Trollvik, A., Nordbach, R., Silen, C., & Ringsberg, K. C. (2011). Children’s experiences of living with asthma: Fear of exacerbations and being ostracized. Journal of Pediatric Nursing , 26 (4), 295–303. https://doi.org/10.1016/j.pedn.2010.05.003 .

Varney, M. W., Janoudi, A., Aslam, D. M., & Graham, D. (2012). Building young engineers: TASEM for third graders in woodcreek magnet elementary school. IEEE Transactions on Education , 55 (1), 78–82. https://doi.org/10.1109/TE.2011.2131143 .

Yang, K. H., & Lu, B. C. (2021). Towards the successful game-based learning: Detection and feedback to misconceptions is the key. Computers & Education , 160 , 104033. https://doi.org/10.1016/j.compedu.2020.104033 .

Yueka, L. (2019). Current situation, d ynamic and problems of AI + t eacher education . Journal of Modern Education Technology , 29 (11), 114–120. Zhong, S.

Download references

This study is supported in part by the National Science and Technology Council of Taiwan under contract numbers NSTC 112-2410-H-011-012-MY3 and MOST 111-2410-H-011 -007 -MY3. The study is also supported by the “Empower Vocational Education Research Center” of National Taiwan University of Science and Technology (NTUST) from the Featured Areas Research Center Program within the framework of the Higher Education Sprout Project by the Ministry of Education (MOE) in Taiwan.

Author information

Authors and affiliations.

Department of Nursing, Chang Gung University of Science and Technology, Taoyuan City, Taiwan

Chun-Chun Chang

Graduate Institute of Educational Information and Measurement, National Taichung University of Education, Taichung City, Taiwan

Gwo-Jen Hwang

Graduate Institute of Digital Learning and Education, National Taiwan University of Science and Technology, Taipei City, Taiwan

You can also search for this author in PubMed   Google Scholar

Contributions

The authors contributed to the conceptualization and design of the study. Material preparation, data collection, analysis, project management and methodology were performed by Chun-Chun Chang. Methodology and supervision were performed Gwo-Jen Hwang.

Corresponding author

Correspondence to Gwo-Jen Hwang .

Ethics declarations

Ethical approval.

The study has been evaluated and approved by the research ethics committee of Chang Gung with the IRB number 202300304B0C101.

Consent to participate

The participants all agreed to take part in this study.

Consent for publication

The publication of this study has been approved by all authors.

Conflicts of interest

There is no potential conflict of interest in this study.

Additional information

Publisher’s note.

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Chang, CC., Hwang, GJ. A Robot-assisted real case-handling approach to improving students’ learning performances in vocational training. Educ Inf Technol (2024). https://doi.org/10.1007/s10639-024-12778-w

Download citation

Received : 13 March 2024

Accepted : 07 May 2024

Published : 14 May 2024

DOI : https://doi.org/10.1007/s10639-024-12778-w

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

• Vocational education
• Nursing education
• Professional training
• Find a journal
• Publish with us
• Track your research