Distance Learning

Using technology to develop students’ critical thinking skills.

by Jessica Mansbach

What Is Critical Thinking?

Critical thinking is a higher-order cognitive skill that is indispensable to students, readying them to respond to a variety of complex problems that are sure to arise in their personal and professional lives. The  cognitive skills at the foundation of critical thinking are  analysis, interpretation, evaluation, explanation, inference, and self-regulation.  

When students think critically, they actively engage in these processes:

  • Communication
  • Problem-solving

To create environments that engage students in these processes, instructors need to ask questions, encourage the expression of diverse opinions, and involve students in a variety of hands-on activities that force them to be involved in their learning.

Types of Critical Thinking Skills

Instructors should select activities based on the level of thinking they want students to do and the learning objectives for the course or assignment. The chart below describes questions to ask in order to show that students can demonstrate different levels of critical thinking.

Level of critical thinking  Skills students demonstrate Questions to ask
Lower levels
Remembering recognize, describe, list, identify, retrieve
Understanding explain, generalize, estimate, predict, describe
Higher levels
Applying carry out, use, implement, show, solve
Analyzing compare, organize, deconstruct
Evaluating check, judge, critique, conclude, explain
Creating construct, plan, design, produce

*Adapted from Brown University’s Harriet W Sheridan Center for Teaching and Learning

Using Online Tools to Teach Critical Thinking Skills

Online instructors can use technology tools to create activities that help students develop both lower-level and higher-level critical thinking skills.

  • Example: Use Google Doc, a collaboration feature in Canvas, and tell students to keep a journal in which they reflect on what they are learning, describe the progress they are making in the class, and cite course materials that have been most relevant to their progress. Students can share the Google Doc with you, and instructors can comment on their work.
  • Example: Use the peer review assignment feature in Canvas and manually or automatically form peer review groups. These groups can be anonymous or display students’ names. Tell students to give feedback to two of their peers on the first draft of a research paper. Use the rubric feature in Canvas to create a rubric for students to use. Show students the rubric along with the assignment instructions so that students know what they will be evaluated on and how to evaluate their peers.
  • Example: Use the discussions feature in Canvas and tell students to have a debate about a video they watched. Pose the debate questions in the discussion forum, and give students instructions to take a side of the debate and cite course readings to support their arguments.  
  • Example: Us e goreact , a tool for creating and commenting on online presentations, and tell students to design a presentation that summarizes and raises questions about a reading. Tell students to comment on the strengths and weaknesses of the author’s argument. Students can post the links to their goreact presentations in a discussion forum or an assignment using the insert link feature in Canvas.
  • Example:  Use goreact, a narrated Powerpoint, or a Google Doc and instruct students to tell a story that informs readers and listeners about how the course content they are learning is useful in their professional lives. In the story, tell students to offer specific examples of readings and class activities that they are finding most relevant to their professional work. Links to the goreact presentation and Google doc can be submitted via a discussion forum or an assignment in Canvas. The Powerpoint file can be submitted via a discussion or submitted in an assignment.

Pulling it All Together

Critical thinking is an invaluable skill that students need to be successful in their professional and personal lives. Instructors can be thoughtful and purposeful about creating learning objectives that promote lower and higher-level critical thinking skills, and about using technology to implement activities that support these learning objectives. Below are some additional resources about critical thinking.

Additional Resources

Carmichael, E., & Farrell, H. (2012). Evaluation of the Effectiveness of Online Resources in Developing Student Critical Thinking: Review of Literature and Case Study of a Critical Thinking Online Site.  Journal of University Teaching and Learning Practice ,  9 (1), 4.

Lai, E. R. (2011). Critical thinking: A literature review.  Pearson’s Research Reports ,  6 , 40-41.

Landers, H (n.d.). Using Peer Teaching In The Classroom. Retrieved electronically from https://tilt.colostate.edu/TipsAndGuides/Tip/180

Lynch, C. L., & Wolcott, S. K. (2001). Helping your students develop critical thinking skills (IDEA Paper# 37. In  Manhattan, KS: The IDEA Center.

Mandernach, B. J. (2006). Thinking critically about critical thinking: Integrating online tools to Promote Critical Thinking. Insight: A collection of faculty scholarship , 1 , 41-50.

Yang, Y. T. C., & Wu, W. C. I. (2012). Digital storytelling for enhancing student academic achievement, critical thinking, and learning motivation: A year-long experimental study. Computers & Education , 59 (2), 339-352.

Insight Assessment: Measuring Thinking Worldwide

http://www.insightassessment.com/

Michigan State University’s Office of Faculty  & Organizational Development, Critical Thinking: http://fod.msu.edu/oir/critical-thinking

The Critical Thinking Community

http://www.criticalthinking.org/pages/defining-critical-thinking/766

Related Posts

Maximizing Your Synchronous Sessions – Part 1: Technology

Enter to Win an iRig Lavalier Microphone (by IK Multimedia)

All You Need is an Oven and a Knife

Maximizing Your Synchronous Sessions – Part II: Agenda

9 responses to “ Using Technology To Develop Students’ Critical Thinking Skills ”

This is a great site for my students to learn how to develop critical thinking skills, especially in the STEM fields.

Great tools to help all learners at all levels… not everyone learns at the same rate.

Thanks for sharing the article. Is there any way to find tools which help in developing critical thinking skills to students?

Technology needs to be advance to develop the below factors:

Understand the links between ideas. Determine the importance and relevance of arguments and ideas. Recognize, build and appraise arguments.

Excellent share! Can I know few tools which help in developing critical thinking skills to students? Any help will be appreciated. Thanks!

  • Pingback: EDTC 6431 – Module 4 – Designing Lessons That Use Critical Thinking | Mr.Reed Teaches Math
  • Pingback: Homepage
  • Pingback: Magacus | Pearltrees

Brilliant post. Will be sharing this on our Twitter (@refthinking). I would love to chat to you about our tool, the Thinking Kit. It has been specifically designed to help students develop critical thinking skills whilst they also learn about the topics they ‘need’ to.

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Save my name, email, and website in this browser for the next time I comment.

Insert/edit link

Enter the destination URL

Or link to existing content

  • For Individuals
  • For Businesses
  • For Universities
  • For Governments
  • Online Degrees
  • Find your New Career
  • Join for Free

What Are Critical Thinking Skills and Why Are They Important?

Learn what critical thinking skills are, why they’re important, and how to develop and apply them in your workplace and everyday life.

[Featured Image]:  Project Manager, approaching  and analyzing the latest project with a team member,

We often use critical thinking skills without even realizing it. When you make a decision, such as which cereal to eat for breakfast, you're using critical thinking to determine the best option for you that day.

Critical thinking is like a muscle that can be exercised and built over time. It is a skill that can help propel your career to new heights. You'll be able to solve workplace issues, use trial and error to troubleshoot ideas, and more.

We'll take you through what it is and some examples so you can begin your journey in mastering this skill.

What is critical thinking?

Critical thinking is the ability to interpret, evaluate, and analyze facts and information that are available, to form a judgment or decide if something is right or wrong.

More than just being curious about the world around you, critical thinkers make connections between logical ideas to see the bigger picture. Building your critical thinking skills means being able to advocate your ideas and opinions, present them in a logical fashion, and make decisions for improvement.

Coursera Plus

Build job-ready skills with a Coursera Plus subscription

  • Get access to 7,000+ learning programs from world-class universities and companies, including Google, Yale, Salesforce, and more
  • Try different courses and find your best fit at no additional cost
  • Earn certificates for learning programs you complete
  • A subscription price of $59/month, cancel anytime

Why is critical thinking important?

Critical thinking is useful in many areas of your life, including your career. It makes you a well-rounded individual, one who has looked at all of their options and possible solutions before making a choice.

According to the University of the People in California, having critical thinking skills is important because they are [ 1 ]:

Crucial for the economy

Essential for improving language and presentation skills

Very helpful in promoting creativity

Important for self-reflection

The basis of science and democracy 

Critical thinking skills are used every day in a myriad of ways and can be applied to situations such as a CEO approaching a group project or a nurse deciding in which order to treat their patients.

Examples of common critical thinking skills

Critical thinking skills differ from individual to individual and are utilized in various ways. Examples of common critical thinking skills include:

Identification of biases: Identifying biases means knowing there are certain people or things that may have an unfair prejudice or influence on the situation at hand. Pointing out these biases helps to remove them from contention when it comes to solving the problem and allows you to see things from a different perspective.

Research: Researching details and facts allows you to be prepared when presenting your information to people. You’ll know exactly what you’re talking about due to the time you’ve spent with the subject material, and you’ll be well-spoken and know what questions to ask to gain more knowledge. When researching, always use credible sources and factual information.

Open-mindedness: Being open-minded when having a conversation or participating in a group activity is crucial to success. Dismissing someone else’s ideas before you’ve heard them will inhibit you from progressing to a solution, and will often create animosity. If you truly want to solve a problem, you need to be willing to hear everyone’s opinions and ideas if you want them to hear yours.

Analysis: Analyzing your research will lead to you having a better understanding of the things you’ve heard and read. As a true critical thinker, you’ll want to seek out the truth and get to the source of issues. It’s important to avoid taking things at face value and always dig deeper.

Problem-solving: Problem-solving is perhaps the most important skill that critical thinkers can possess. The ability to solve issues and bounce back from conflict is what helps you succeed, be a leader, and effect change. One way to properly solve problems is to first recognize there’s a problem that needs solving. By determining the issue at hand, you can then analyze it and come up with several potential solutions.

How to develop critical thinking skills

You can develop critical thinking skills every day if you approach problems in a logical manner. Here are a few ways you can start your path to improvement:

1. Ask questions.

Be inquisitive about everything. Maintain a neutral perspective and develop a natural curiosity, so you can ask questions that develop your understanding of the situation or task at hand. The more details, facts, and information you have, the better informed you are to make decisions.

2. Practice active listening.

Utilize active listening techniques, which are founded in empathy, to really listen to what the other person is saying. Critical thinking, in part, is the cognitive process of reading the situation: the words coming out of their mouth, their body language, their reactions to your own words. Then, you might paraphrase to clarify what they're saying, so both of you agree you're on the same page.

3. Develop your logic and reasoning.

This is perhaps a more abstract task that requires practice and long-term development. However, think of a schoolteacher assessing the classroom to determine how to energize the lesson. There's options such as playing a game, watching a video, or challenging the students with a reward system. Using logic, you might decide that the reward system will take up too much time and is not an immediate fix. A video is not exactly relevant at this time. So, the teacher decides to play a simple word association game.

Scenarios like this happen every day, so next time, you can be more aware of what will work and what won't. Over time, developing your logic and reasoning will strengthen your critical thinking skills.

Learn tips and tricks on how to become a better critical thinker and problem solver through online courses from notable educational institutions on Coursera. Start with Introduction to Logic and Critical Thinking from Duke University or Mindware: Critical Thinking for the Information Age from the University of Michigan.

Article sources

University of the People, “ Why is Critical Thinking Important?: A Survival Guide , https://www.uopeople.edu/blog/why-is-critical-thinking-important/.” Accessed May 18, 2023.

Keep reading

Coursera staff.

Editorial Team

Coursera’s editorial team is comprised of highly experienced professional editors, writers, and fact...

This content has been made available for informational purposes only. Learners are advised to conduct additional research to ensure that courses and other credentials pursued meet their personal, professional, and financial goals.

Developing Critical Thinking

  • Posted January 10, 2018
  • By Iman Rastegari

Critical Thinking

In a time where deliberately false information is continually introduced into public discourse, and quickly spread through social media shares and likes, it is more important than ever for young people to develop their critical thinking. That skill, says Georgetown professor William T. Gormley, consists of three elements: a capacity to spot weakness in other arguments, a passion for good evidence, and a capacity to reflect on your own views and values with an eye to possibly change them. But are educators making the development of these skills a priority?

"Some teachers embrace critical thinking pedagogy with enthusiasm and they make it a high priority in their classrooms; other teachers do not," says Gormley, author of the recent Harvard Education Press release The Critical Advantage: Developing Critical Thinking Skills in School . "So if you are to assess the extent of critical-thinking instruction in U.S. classrooms, you’d find some very wide variations." Which is unfortunate, he says, since developing critical-thinking skills is vital not only to students' readiness for college and career, but to their civic readiness, as well.

"It's important to recognize that critical thinking is not just something that takes place in the classroom or in the workplace, it's something that takes place — and should take place — in our daily lives," says Gormley.

In this edition of the Harvard EdCast, Gormley looks at the value of teaching critical thinking, and explores how it can be an important solution to some of the problems that we face, including "fake news."

About the Harvard EdCast

The Harvard EdCast is a weekly series of podcasts, available on the Harvard University iT unes U page, that features a 15-20 minute conversation with thought leaders in the field of education from across the country and around the world. Hosted by Matt Weber and co-produced by Jill Anderson, the Harvard EdCast is a space for educational discourse and openness, focusing on the myriad issues and current events related to the field.

EdCast logo

An education podcast that keeps the focus simple: what makes a difference for learners, educators, parents, and communities

Related Articles

HGSE shield on blue background

Helping Children Succeed

Reading and the common core, roots of the school gardening movement.

7 year-old applying critical thinking strategies while dragging his finger across a row of animals in a Sequencing app.

Using Tech to Develop Critical Thinking Skills

It's all about the teaching method simple apps can be used to support critical thinking skills.

  • Share on Twitter
  • Share on Facebook
  • Share on LinkedIn
  • Share on Pinterest

Critical thinking goes beyond memorization, encouraging students to connect the dots between concepts, solve problems, think creatively, and apply knowledge in new ways. ( 7 Ways to Teach Critical Thinking in Elementary Education ) We use critical thinking skills every day, to make good decisions and to solve problems. In 21 st  century classrooms, students are given opportunities to build critical thinking skills and educators are using teaching methods to intentionally build students’ critical thinking skills. Critical thinking is vital for success in all subject areas – and everyday life! 

Who Should be Introduced to Critical Thinking Skills?

Every  student should learn critical thinking skills. Toddlers begin by building foundational critical thinking skills through simple problem-solving; critical thinking is a life-long skill! Students who are visually impaired will need strong problem-solving skills – not just for academic situations, but also how to problem-solve different strategies to complete tasks that might be easily completed with the use of vision.

How can TVIs Support Critical Thinking Skills When Introducing Technology to Young Students?

  • Provide opportunities to explore and to be curious
  • Pause and Wait
  • Do not intervene immediately
  • Use  general directions  (not step-by-step directions) after initial introduction to a tech skill or app
  • Ask open-ended questions
  • Listen to the student and observe the student’s thinking process
  • Try a different way

Jeanne has participated in a 12-week Perkins eLearning course, ABC’s of iOS, an introduction to VoiceOver on the iPad for students ages 3 – 8. Throughout the course, Jeanne worked with her 7 year-old student, Ian. Jeanne shares, “We are making huge progress. We have went from a student who wouldn’t touch the iPad or if he had to couldn’t perform any tasks with it at all to a student who actually enjoys some of the activities and is independent in turning VO on and off, reading books, knowing how to pause and start again, continuing to perfect his basic gestures, and can play a few games independently. We continue to make progress on spatial learning, grids, fine-motor manipulation, etc. Even though, we are moving very slowly, the changes have been amazing. I can’t wait to see what happens. . .” Ian is in first grade and has some developmental delays.

Through her weekly videos, it was fascinating to watch how Ian’s tech skills progressed, and how his independence blossomed. Initially he always required step-by-step instruction. The apps used were simple cause-and-effect apps that only required a tap to make something happen. He began listening to the auditory information in simple self-voicing apps and when introduced to VoiceOver, he began to truly listen and began to process the auditory information. As Ian’s listening skills improved, Jeanne was able to back away, providing Ian opportunities to fill in the gaps. With decreased intervention, Ian started to complete tasks with more independence. Ian was given opportunities to try a gesture and to problem-solve when it did not work as anticipated. 

Initially, it was challenging for Ian to drag his finger in a straight line – an important tech skill to be able to move across a row of apps on the iPad’s Home screen or across a row of items in an app. Jeanne used tactile graphics to help teach him the concept of a row (and column) and how to drag in a straight line. As Ian’s tech skills advanced, he transitioned to the next level of apps which require the drag and double tap (or split tap) gestures, navigating within the app and thinking in order to select the correct choice. The Math Melodies app, an accessible math app, has several math games appropriate for Ian, which can be used to build critical thinking skills. In the video below, Ian is introduced to the Sequencing game in the Math Melodies app.

In the ABC’s of iOS Course, Ian has already been introduced to the basic gestures, spatial layout of the app and spatial terms (top, middle, bottom, etc.), concept of rows, listening skills, etc. In the video below, he is learning to apply these skills to this game. The video is Ian’s introduction to the Sequencing app. Pay particular attention to how Jeanne set him up for success and Ian’s thinking process as he learns strategies to complete the game.

Video 1 Seven year-old Ian being introduced to Math Melodies’ Sequencing game.

Critical Teaching Strategies (review)

Jeanne’s critical thinking teaching methods.

Jeanne did a great job of balancing between giving Ian time to explore and to problem-solve while teaching a new game.

  • Had Ian find the two animal choices at the bottom of the page before exploring the sequence.
  • Used general directions. Example: “Go up and look at your sequencing.” (Did not give specific directions on what gesture to use, etc.)
  • Gave opportunities for Ian to explore
  • Waited; did not intervene
  • Gave praise while correcting. Example: “You went a little high (when dragging). You’ve been doing a really good job of staying straight!”
  • Listened to student and observed: Ian did not identify the names of the animals or did not know how to sequence?
  • Tried a different way by saying names of animals aloud while Ian dragged his finger.

In the second video, Ian is given the opportunity to practice what he just learned. 

Video 2: Ian practicing and perfecting his critical thinking skills with the Sequence game.

Look at Ian go! He quickly dragged his finger across the row twice and then verbalized what was first and second. Verbalizing what he was thinking is so helpful, as was thinking what was first and second, not what came next in the sequence. He did not need prompts on how to navigate or play the game, only with the strategy of how to come up with the correct answer!

Are you embedding opportunities to build critical thinking skills during your assistive tech lessons?

By Diane Brauner

Keep reading

3 year old boy with 3-fingers touching the top section on an iPad.

Spatial Tech Standards 1: Directional Terms

7 Year old making two-finger double tap gesture on Kids Listen podcast app. Text

Kids Listen Podcast: Practicing Tech Skills

Seesaw logo and text

Remote Instruction using Seesaw for Dual Media Learner

AIP Publishing Logo

The trend of ICT in education for critical thinking skills: A systematic literature review

[email protected]

  • Article contents
  • Figures & tables
  • Supplementary Data
  • Peer Review
  • Reprints and Permissions
  • Cite Icon Cite
  • Search Site

Iik Nurhikmayati , Darhim Darhim; The trend of ICT in education for critical thinking skills: A systematic literature review. AIP Conf. Proc. 28 November 2023; 2909 (1): 040002. https://doi.org/10.1063/5.0182604

Download citation file:

  • Ris (Zotero)
  • Reference Manager

ICT in education is gaining acceptance as a learning method that helps teachers and students achieve optimal learning objectives. ICT is believed to motivate and facilitate the learning process. Critical thinking skills, as one of the 21st-century skills, are known to be improved through ICT-based education. This article presents a systematic review of the literature published in the last five years and an indexed database of Springer and Eric. The results showed a total of 27 articles that met the criteria. Research findings on ICT trends in education for critical thinking skills are structured under three reports: (1) ICT trends in education include android, VR, AR, and coding; (2) the best strategy with ICT monitoring is distance learning, programming teaching, and STEM; and (3) other skills that are enhanced along with critical thinking skills are cognitive and affective skills, which are problem-solving, creativity and innovation, collaboration skills and communication skills. Based on this evidence, we make recommendations for future research to consider other types of ICT for enhancing critical thinking skills. In addition, using other learning strategies, such as problem-based learning and inquiry, can be considered to improve critical thinking skills.

Sign in via your Institution

Citing articles via, publish with us - request a quote.

developing critical thinking technologies include

Sign up for alerts

  • Online ISSN 1551-7616
  • Print ISSN 0094-243X
  • For Researchers
  • For Librarians
  • For Advertisers
  • Our Publishing Partners  
  • Physics Today
  • Conference Proceedings
  • Special Topics

pubs.aip.org

  • Privacy Policy
  • Terms of Use

Connect with AIP Publishing

This feature is available to subscribers only.

Sign In or Create an Account

loading

Developing Critical Thinking: A Review of Past Efforts as a Framework for a New Approach for Childhood Learning

  • Living reference work entry
  • Later version available View entry history
  • First Online: 14 January 2020
  • Cite this living reference work entry

developing critical thinking technologies include

  • Shanshan Ma 4 ,
  • Kaushal Kumar Bhagat 5 ,
  • J. Michael Spector 4 ,
  • Lin Lin 4 ,
  • Dejian Liu 6 ,
  • Jing Leng 7 ,
  • Dawit T. Tiruneh 8 &
  • Jonah Mancini 9  

346 Accesses

1 Citations

The purpose of this paper is to establish a theoretically grounded and research-based framework to support the development of inquiry and critical thinking skills in children. As a first step in developing the framework, a review of the research literature on critical thinking and inquiry learning was conducted. Noteworthy efforts were found primarily in science domains, such as “The Adventures of Jasper Woodbury” and WISE (Web-based Inquiry Science Environment). Earlier attempts to use the Internet to promote inquiry and critical thinking involved such methodologies as webquests and computer-supported intentional learning environments (e.g., CSILE). One approach not involving modern technologies was the effort of Matthew Lipman to teach logic to young children (e.g., Harry Stottlemeier’s Discovery ). Given a growing emphasis on twenty-first-century skills (e.g., communication, collaboration, critical thinking, and creativity), and the evidence from prior work that it is possible to support inquiry learning and critical thinking with and without advanced technologies, an effort was made to see how curricula were changing to embrace those skills, especially at a middle school level when abstract reasoning and habits of mind are developing. We found very few examples of systemic or large-scale changes in curricula, although some organizations (e.g., The Critical Thinking Company) offer support materials. Very little empirical research has been done with young children or with the use of interactive technologies across multiple subject areas. Further, we found no efforts to create a sustained developmental path for the relevant skills and subskills, which are clearly emphasized in the literature on twenty-first-century skills, although rarely implemented on a sustained basic across multiple subjects and school years. As a consequence, we decided that it would be worthwhile to consolidate our findings in the form of a theoretically grounded and research-based framework that could be used to guide efforts to support the early development of inquiry and critical thinking skills in young children.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Institutional subscriptions

Similar content being viewed by others

developing critical thinking technologies include

Complexity, Inquiry Critical Thinking, and Technology: A Holistic and Developmental Approach

developing critical thinking technologies include

Smart Learning in Support of Critical Thinking: Lessons Learned and a Theoretically and Research-Based Framework

What happens when you push the button analyzing the functional dynamics of concept development in computer supported science inquiry.

Abrami, P. C., Bernard, R. M., Borokhovski, E., Wade, A., Surkes, M. A., Tamim, R., & Zhang, D. (2008). Instructional interventions affecting critical thinking skills and dispositions: A stage 1 meta-analysis. Review of Educational Research, 78 (4), 1102–1134. https://doi.org/10.3102/0034654308326084

Article   Google Scholar  

Asyari, M., Al Muhdhar, M. H. I., Susilo, H., & Ibrohim. (2016). Improving critical thinking skills through the integration of problem based learning and group investigation. International Journal for Lesson and Learning Studies, 5 (1), 36–44.

Barrows, H. S., & Tamblyn, R. (1980). Problem-based learning: An approach to medical education . New York, NY: Springer.

Google Scholar  

Bensley, D. A., Rainey, C., Murtagh, M. P., Flinn, J. A., Maschiocchi, C., Bernhardt, P. C., & Kuehne, S. (2016). Closing the assessment loop on critical thinking: The challenges of multidimensional testing and low test-taking motivation. Thinking Skills and Creativity, 21 , 158–168. https://doi.org/10.1016/j.tsc.2016.06.006

Bhagat, K. K., & Spector, J. M. (2017). Formative assessment in complex problem-solving domains: The emerging role of assessment technologies. Journal of Educational Technology & Society, 20 (4), 312–317.

Bowen, C. W. (2000). A quantitative literature review of cooperative learning effects on high school and college chemistry achievement. Journal of Chemical Education, 77 (1), 116–119. https://doi.org/10.1021/ed077p116

Bransford, J. D., Brown, A. L., & Cocking, R. R. (Eds.) (2000). How people learn: Brain, mind, experience and school (expanded edition). Washington, DC.: National Academy Press. Retrieved from https://www.nap.edu/catalog/9853/how-people-learn-brain-mind-experience-and-school-expanded-edition

Butler, H., Dwyer, C., Hogan, M., Franco, A., & Almeida, L. (2012). Extending the validity of Halpern critical thinking assessments: Cross-national applications. Thinking Skills and Creativity, 7 , 112–121.

CAAP (Collegiate Assessment of Academic Proficiency) (2011–2012). ACT CAAP technical handbook. Retrieved from http://www.aum.edu/docs/default-source/OIE/student-achievement/caap-technical-handbook.pdf

Carter, A. G., Creedy, D. K., & Sidebotham, M. (2015). Evaluation of tools used to measure critical thinking development in nursing and midwifery undergraduate students: A systematic review. Nurse Education Today, 35 (7), 864–874.

Carter, A. G., Creedy, D. K., & Sidebotham, M. (2016). Efficacy of teaching methods used to develop critical thinking in nursing and midwifery undergraduate students: a systematic review of the literature. Nurse Education Today, 40 , 209–218.

Carter, A. G., Creedy, D. K., & Sidebotham, M. (2017). Critical thinking skills in midwifery practice: Development of a self-assessment tool for students. Midwifery, 50 , 184–192.

Carvalho, D. P., Azevedo, I. C., Cruz, G. K., Mafra, G. A., Rego, A. L., Vitor, A. F., … Júnior, M. A. F. (2017). Strategies used for the promotion of critical thinking in nursing undergraduate education: A systematic review. Nurse Education Today, 57 , 103–107.

Catchings, G. (2015). A practical coaching model for critical thinking skill and leadership development (C/CTSLD). Management and Organizational Studies, 2 (4), 42.

Craig, A. B., Brown, E. R., Upright, J., & DeRosier, M. E. (2016). Enhancing children’s social emotional functioning through virtual game-based delivery of social skills training. Journal of Child and Family Studies, 25 (3), 959–968.

Daly, W. M. (2001). The development of an alternative method in the assessment of critical thinking as an outcome of nursing education. Journal of Advanced Nursing, 36 , 120–130. https://doi.org/10.1046/j.1365-2648.2001.01949.x

Danczak, S., Thompson, C., & Overton, T. (2017, August). Development of a chemistry critical thinking test: Initial reliability and validity studies. In Proceedings of the Australian conference on science and mathematics education (formerly UniServe Science conference) The University of Queensland, Australia (p. 38).

Darmawan, E., Zubaidah, S., Susilo, H., & Suwono, H. (2016). Simas Eric model to improve students’ critical thinking skills. Journal of Education & Social Policy, 3 (6), 45–53.

DeRosier, M. E., & Thomas, J. M. (2018). Establishing the criterion validity of zoo U’s game-based social emotional skills assessment for school-based outcomes. Journal of Applied Developmental Psychology, 55 , 52–61. https://doi.org/10.1016/j.appdev.2017.03.001

Dewey, J. (1938). Experience and education . New York, NY: Kappa Delta Pi.

Duron, R., Limbach, B., & Waugh, W. (2006). Critical thinking framework for any discipline. International Journal of Teaching and Learning in Higher Education, 17 (2), 160–166.

Dwyer, C. P., Hogan, M. J., & Stewart, I. (2014). An integrated critical thinking framework for the 21st century. Thinking Skills and Creativity, 12 , 43–52.

Eftekhari, M., Sotoudehnama, E., & Marandi, S. S. (2016). Computer-aided argument mapping in an EFL setting: Does technology precede traditional paper and pencil approach in developing critical thinking? Educational Technology Research and Development, 64 (2), 339–357.

Elder, J. P., Lytle, L., Sallis, J. F., Young, D. R., Steckler, A., Lohman, T., et al. (2007). A description of the social-ecological framework used in the trial of activity for adolescent girls (TAAG). Health Education Research, 22 , 155–165.

Ennis, R. H. (1987). A taxonomy of critical thinking dispositions and abilities. In J. B. Baron & R. J. Sternberg (Eds.), Teaching thinking skills: Theory and practice (pp. 9–26). New York, NY: Freeman & Co..

Ennis, R. H. (1989). Critical thinking and subject specificity: Clarification and needed research. Educational Researcher, 18 (3), 4–10.

Ennis, R. H. (1991). Critical thinking: A streamlined conception. Teaching Philosophy, 14 (1), 5–24. Retrieved from http://faculty.education.illinois.edu/rhennis/documents/EnnisStreamlinedConception_002.pdf

Ennis, R. H. (1993). Critical thinking assessment. Theory Into Practice, 32 (3), 179–186.

Ennis, R. H., Millman, J., & Tomko, T. N. (1985). Cornell critical thinking tests (3rd ed.). Pacific Grove, CA: Midwest Publications.

Facione, N. C., & Facione, P. A. (2008). Critical thinking and clinical judgement. In N. C. Facione & P. A. Facione, (Critical thinking and clinical reasoning in the health sciences: An international multidisciplinary teaching anthology (pp. 1–13). Millbrae, CA: California Academic Press

Finley, A. (2019). A comprehensive approach to assessment of high-impact practices. (AAC&U Occasional Paper #41). Urbana, IL: National Institute for Learning Outcomes Assessment. Retrieved from https://www.aacu.org/sites/default/files/files/publications/accu_niloa_hips_pub_2019.pdf

Fuad, N. M., Zubaidah, S., Mahanal, S., & Suarsini, E. (2017). Improving junior high schools’ critical thinking skills based on test three different models of learning. International Journal of Instruction, 10 (1), 101–116.

Gelerstein, D., del Río, R., Nussbaum, M., Chiuminatto, P., & López, X. (2016). Designing and implementing a test for measuring critical thinking in primary school. Thinking Skills and Creativity, 20 , 40–49. https://doi.org/10.1016/j.tsc.2016.02.002

Gholami, M., Moghadam, P. K., Mohammadipoor, F., Tarahi, M. J., Sak, M., Toulabi, T., & Pour, A. H. H. (2016). Comparing the effects of problem-based learning and the traditional lecture method on critical thinking skills and metacognitive awareness in nursing students in a critical care nursing course. Nurse Education Today, 45 , 16–21.

Hadi, S. A., Susantini, E., & Agustini, R. (2018, January). Training of students’ critical thinking skills through the implementation of a modified free inquiry model. Journal of Physics: Conference Series, 947 (1), 012063. IOP Publishing.

Halpern, D. F. (2010). The Halpern critical thinking assessment (HCTA): Manual . Modling, Austria: Schuhfried GmbH.

Halpern, D. F. (2014). Thought and knowledge: An introduction to critical thinking (5th ed.). New York, NY: Psychology Press.

Harris, D. M., Schuster, A., Kay, D., & Kibble, J. D. (2016). The use of high fidelity patient simulations to improve critical thinking skills in first year medical students. The Federation of American Societies for Experimental Biology Journal, 30 (1 Supplement), 553–522.

Hawthorne, K. A., Bol, L., Pribesh, S., & Suh, Y. (2015). Effects of motivational prompts on motivation, effort, and performance on a low-stakes standardized test. Research & Practice in Assessment, 10 , 30–38.

Hee-Ok, P., & Insook, L. (2016). Enhancing critical thinking through simulation problem based learning in nursing education. Indian Journal of Science and Technology, 9 (37). Retrieved from http://www.indjst.org/index.php/indjst/article/view/101758

Herring, M. C., Koehler, M. J., & Mishra, P. (Eds.). (2016). Handbook of technological pedagogical content knowledge (TPACK) for educators (2nd ed.). New York, NY: Routledge.

Hooshyar, D., Ahmad, R. B., Yousefi, M., Fathi, M., Horng, S., & Lim, H. (2016). Applying an online game-based formative assessment in a flowchart-based intelligent tutoring system for improving problem-solving skills. Computers & Education, 94 , 18–36. https://doi.org/10.1016/j.compedu.2015.10.013

Huang, L. Y., & Yeh, Y. C. (2018). Meaningful gamification for journalism dtudents to enhance their critical thinking skills. In Online course management: Concepts, methodologies, tools, and applications (pp. 1335–1351). Hershey, PA: IGI Global.

Chapter   Google Scholar  

Inhelder, B., & Piaget, J. (1958). The growth of logical thinking from childhood to adolescence: An essay on the construction of formal operational structures . New York, NY: Routledge. Retrieved from https://www.uea.ac.uk/documents/4059364/4994243/Stenhouse-1958-The+Growth+of+Logical+Thinking+from+Childhood+to+Adolescence.pdf/2db5f95a-9b9f-48dc-8e4f-bf30d1b79dd4

Book   Google Scholar  

Insight Assessment. (2013). California measure of mental motivation (CM3). https://www.insightassessment.com/Products/Products-Summary/Critical-Thinking-Attributes-Tests/California-Measure-of-Mental-Motivation-Level-III/(language)/eng-US

Insight Assessment. (n.d.). Educate-insight reasoning skills grades 3–5. https://www.insightassessment.com/Products/Products-Summary/Critical-Thinking-Skills-Tests/EDUCATE-INSIGHT-Reasoning-Skills-Grades-3-5/(language)/eng-US

Isbister, K., Karlesky, M., Frye, J., & Rao, R. (2012, May). Scoop!: A movement-based math game designed to reduce math anxiety. In CHI’12 extended abstracts on human factors in computing systems (pp. 1075–1078). New York, NY: ACM.

Jacob, E., Duffield, C., & Jacob, D. (2017). A protocol for the development of a critical thinking assessment tool for nurses using a Delphi technique. Journal of Advanced Nursing, 73 (8), 1982–1988.

James, D., Hartzler, M. L., & Chen, A. M. (2016). Assessment of critical thinking skills progression in a pre-pharmacy curriculum. Currents in Pharmacy Teaching & Learning, 8 (6), 767–773.

Jariyah, I. A. (2017). The effect of inquiry combined science-technology-society (STS) learning to enhance critical thinking skills on science. Indonesian Journal of Biology Education, 3 (1), 1–9.

Jatmiko, B., & Supardi, Z. A. I. (2017). The model “Orientasi IPA” to improve the critical thinking skills of senior high school students. Advanced Science Letters, 23 (12), 11933–11937.

Jones, M. (2008). Developing clinically savvy nursing students: An evaluation of problem based learning in an associate degree program. Nursing Education Perspectives, 29 (5), 278–283.

Kanirawati, K. (2017). Implementation of problem based learning model with Newspaper media to improve students critical thinking In social science learning viii-a grade. International Journal Pedagogy of Social Studies, 2 (1), 32–42.

Kiili, K., & Ketamo, H. (2018). Evaluating cognitive and affective outcomes of a digital game-based math test. IEEE Transactions on Learning Technologies, 11 (2), 255–263.

Kim, E. (2018). Effect of simulation-based emergency cardiac arrest education on nursing students’ self-efficacy and critical thinking skills: Roleplay versus lecture. Nurse Education Today, 61 , 258–263. https://doi.org/10.1016/j.nedt.2017.12.003

Kong, L. N., Qin, B., Zhou, Y. Q., Mou, S. Y., & Gao, H. M. (2014). The effectiveness of problem-based learning on development of nursing students’ critical thinking: A systematic review and meta-analysis. International Journal of Nursing Studies, 51 (3), 458–469.

Ku, K. Y. (2009). Assessing students’ critical thinking performance: Urging for measurements using multi-response format. Thinking Skills and Creativity, 4 (1), 70–76.

Ku, K. Y. L., & Ho, I. T. (2010). Metacognitive strategies that enhance critical thinking. Metacognition and Learning, 5 , 251–267.

Lai, E. R. (2011). Critical thinking: A literature review. Pearson’s Research Reports, 6 , 40–41. Retrieved from http://images.pearsonassessments.com/images/tmrs/CriticalThinkingReviewFINAL.pdf

Lee, H., Parsons, D., Kwon, G., Kim, J., Petrova, K., Jeong, E., & Ryu, H. (2016). Cooperation begins: Encouraging critical thinking skills through cooperative reciprocity using a mobile learning game. Computers & Education, 97 , 97–115. https://doi.org/10.1016/j.compedu.2016.03.006

Lehman, B., Hebert, D., Jackson, G. T., & Grace, L. (2017, May). Affect and experience: Case studies in games and test-taking. In Proceedings of the 2017 CHI conference extended abstracts on human factors in computing systems (pp. 917–924). New York, NY: ACM.

Liu, O. L., Bridgeman, B., & Adler, R. M. (2012). Measuring learning outcomes in higher education: Motivation matters. Educational Researcher, 41 (9), 352–362.

Liu, O. L., Frankel, L., & Roohr, K. C. (2014). Assessing critical thinking in higher education: Current state and directions for next-generation assessment. ETS Research Report Series, 2014 (1), 1–23.

Liu, O. L., Mao, L., Frankel, L., & Xu, J. (2016). Assessing critical thinking in higher education: The HEIghten™ approach and preliminary validity evidence. Assessment & Evaluation in Higher Education, 41 (5), 677–694. https://doi.org/10.1080/02602938.2016.1168358

Lookadoo, K. L., Bostwick, E. N., Ralston, R., Elizondo, F. J., Wilson, S., Shaw, T. J., & Jensen, M. L. (2017). “I forgot I wasn’t saving the world”: The use of formative and summative assessment in instructional video games for undergraduate biology. Journal of Science Education and Technology, 26 (6), 597–612.

Mai, J. A., Pilcher, R. L., & Frommelt-Kuhle, M. (2018). Fostering interprofessional collaboration and critical thinking between nursing and physical therapy students using high-fidelity simulation. Journal of Interprofessional Education and Practice, 10 , 37–40. https://doi.org/10.1016/j.xjep.2017.11.002

Marzano, R. J. (1998). A theory-based meta-analysis of research on instruction . Aurora, CO: Mid-Continent Regional Education Lab. Retrieved from https://files.eric.ed.gov/fulltext/ED427087.pdf

Mavridis, A., & Tsiatsos, T. (2017). Game-based assessment: Investigating the impact on test anxiety and exam performance. Journal of Computer Assisted Learning, 33 (2), 137–150.

McDonald, S. D. (2017). Enhanced critical thinking skills through problem-solving games in secondary schools. Interdisciplinary Journal of E-Learning & Learning Objects, 13 , 79.

Merrill, M. D. (2013). First principles of instruction: Identifying and designing effective, efficient, and engaging instruction . San Francisco, CA: Wiley.

Milrad, M., Spector, J. M., & Davidsen, P. I. (2003). Model facilitated learning. In S. Naidu (Ed.), Learning and teaching with technology: Principles and practices (pp. 13–27). London, England: Kogan Page.

Morey, D. J. (2012). Development and evaluation of web-based animated pedagogical agents for facilitating critical thinking in nursing. Nursing Education Perspectives, 33 (2), 116.

Naber, J., & Wyatt, T. H. (2014). The effect of reflective writing interventions on the critical thinking skills and dispositions of baccalaureate nursing students. Nurse Education Today, 34 (1), 67–72.

Nair, G. G., & Stamler, L. L. (2013). A conceptual framework for developing a critical thinking self-assessment scale. Journal of Nursing Education, 52 , 131.

Negrete, J., Hanna, R., & García, M. G. (2017). The use of problem-solving tasks to promote critical thinking skills in intermediate English level students. Revista Digital Palabra, 5 (1), 48–55.

Norris, S. P. (2003). The meaning of critical thinking test performance: The effects of abilities and dispositions on scores. In D. Fasko (Ed.), Critical thinking and reasoning: Current research, theory and practice . Cresskill, NJ: Hampton Press.

Paul, R., & Elder, L. (2006). The miniature guide to critical thinking: Concepts and tools (4th ed.). Retrieved from https://www.criticalthinking.org/files/Concepts_Tools.pdf

Paul, R. & Elder, L. (2013). International critical thinking essay test. http://www.criticalthinking.org/store/products/international-critical-thinking-essay-test/185 . Accessed on 18 Jan 2019.

Qian, M., & Clark, K. R. (2016). Game-based Learning and 21st century skills: A review of recent research. Computers in Human Behavior, 63 , 50–58.

Quine, W. V. O., & Ullian, J. S. (1978). The web of belief (2nd ed.). New York, NY: McGraw Hill.

Reed, J. H., & Kromrey, J. D. (2001). Teaching critical thinking in a community college history course: Emprical evidence from infusing Paul’s model. College Student Journal, 35 (2), 201.

Reza, M., Ibrahim, M., & Rahayu, Y. S. (2018, January). Development of problem-based learning oriented teaching learning materials to facilitate students’ mastery of concept and critical thinking skill. Journal of Physics: Conference Series, 947 (1), 012062. IOP Publishing.

Rosen, Y., & Tager, M. (2013, April). Evidence-centered concept map as a thinking tool in critical thinking computer-based assessment. In The 39th annual international association for educational assessment conference (IAEA), the National Institute for Testing and Evaluation (NITE) (pp. 20–25), Tel Aviv, Israel

Schroder, H. S., Fisher, M. E., Lin, Y., Lo, S. L., Danovitch, J. H., & Moser, J. S. (2017). Neural evidence for enhanced attention to mistakes among school-aged children with a growth mindset. Developmental Cognitive Neuroscience, 24 , 42–50.

Setiawan, A., Malik, A., Suhandi, A., & Permanasari, A. (2018, February). ffect of higher order thinking laboratory on the improvement of critical and creative thinking skills. IOP Conference Series: Materials Science and Engineering, 306 (1), 012008. IOP Publishing.

Shaaban, K. A. (2014). Assessment of critical thinking skills through reading comprehension. International Journal of Language Studies, 8 (2), 117.

Shute, V. J. (2011). Stealth assessment in computer-based games to support learning. In S. Tobias & J. D. fletcher (Eds.), Computer games and instruction (pp. 503–623). Charlotte, NC: Information Age Publishing

Shute, V. L., Wang, L., Greiff, S., Zhao, W., & Moore, G. (2016). Measuring problem solving skills via stealth assessment in an engaging video game. Computers in Human Behavior, 63 , 107–117. https://doi.org/10.1016/j.chb.2016.05.047

Sipiyaruk, K., Gallagher, J. E., Hatzipanagos, S., & Reynolds, P. A. (2017). Acquiring critical thinking and decision-making skills: An evaluation of a serious game used by undergraduate dental students in dental public health. Technology, Knowledge and Learning . https://doi.org/10.1007/s10758-016-9296-6

Spector, J. M. (2016). Foundations of educational technology: Integrative approaches and interdisciplinary perspectives (2nd ed.). New York, NY: Routledge.

Spector, J. M. (2018, July). Thinking and learning in the Anthropocene: The new 3 Rs. Discussion paper presented at the International Big History Association conference, Philadelphia, PA, July 29, 2018. Retrieved from http://learndev.org/dl/HLA-IBHA2018/Spector%2C%20J.%20M.%20(2018).%20Thinking%20and%20Learning%20in%20the%20Anthropocene.pdf

Spector, J. M., & Koszalka, T. A. (2004). The DEEP methodology for assessing learning in complex domains (Final report to the National Science Foundation Evaluative Research and Evaluation Capacity Building). Syracuse, NY: Syracuse University.

Stein, B., Haynes, A., Redding, M., Ennis, T., & Cecil, M. (2007). Assessing critical thinking in STEM and beyond. In Innovations in e-learning, instruction technology, assessment, and engineering education (pp. 79–82). Dordrecht, Netherlands: Springer.

Sternberg, R. J., Roediger, H. L. I. I. I., & Halpern, D. F. (Eds.). (2007). Critical thinking in psychology . Cambridge, UK: Cambridge University Press.

Sundararajan, N., Adesope, O., & Cavagnetto, A. (2018). The process of collaborative concept mapping in kindergarten and the effect on critical thinking skills. Journal of STEM Education, 19 (1), 5.

Sundre, D. L., & Wise, S. L. (2003, April). Motivation filtering’: An exploration of the impact of low examinee motivation on the psychometric quality of tests. In Annual meeting of the National Council on Measurement in Education , Chicago, IL.

Tiruneh, D. T., De Cock, M., Spector, J. M., Gu, X., & Elen, J. (2017). Toward a systematic and model-based approach to design learning environments for critical thinking. In Learning, design, and technology: An international compendium of theory, research, practice, and policy New York: Springer (pp. 1–37).

Tiruneh, D. T., Gu, X., De Cock, M., & Elen, J. (2018). Systematic design of domain-specific instruction on near and far transfer of critical thinking skills. International Journal of Educational Research, 87 , 1–11.

Tiruneh, D. T., Weldeslassie, A., De Cock, M., Elen, J., & Janssen, R. (2017). Measuring critical thinking in physics: Development and validation of a critical thinking test in electricity and magnetism. International Journal of Science and Mathematics Education, 15 , 663–682.

U.S. Department of Education. (2010). Transforming American education – Learning powered by technology: National Education Technology Plan 2010 . Washington, DC: Office of Educational Technology, U.S. Department of Education. Retrieved from http://www.ed.gov/sites/default/files/netp2010.pdf

Ulger, K. (2018). The effect of problem-based learning on the creative thinking and critical thinking disposition of students in visual arts education. Interdisciplinary Journal of Problem-Based Learning, 12 (1), 10.

Watson, G., & Glaser, E. M. (1980). Watson–Glaser critical thinking appraisal . Cleveland, OH: Psychological Corporation.

Weaver, M. G., Samoshin, A. V., Lewis, R. B., & Gainer, M. J. (2016). Developing students’ critical thinking, problem solving, and analysis skills in an inquiry-based synthetic organic laboratory course. Journal of Chemical Education, 93 (5), 847–851.

Wittgenstein, L. (1922). Tractatus logico-philosophicus . (Trans. C. K. Ogden). London: Kegan Paul. Retrieved from https://www.gutenberg.org/files/5740/5740-pdf.pdf

Yazidah, I., Irawan, E. B., & Sulandra, I. M. (2017, May). The development of inquiry-based teaching model to enhance critical thinking abilities on circles in junior high school. In International conference on education (pp. 440–448).

Zahner, D. (2013). Reliability and validity–CLA+. New York, NY: CAE. Retrieved from: http://cae.org/images/ uploads/pdf/Reliability_and_Validity_of_CLA_Plus.pdf

Zuriguel Pérez, E., Lluch Canut, M. T., Falco Pegueroles, A., Puig Llobet, M., Moreno Arroyo, C., & Roldan Merino, J. (2015). Critical thinking in nursing: Scoping review of the literature. International Journal of Nursing Practice, 21 (6), 820–830.

Download references

Author information

Authors and affiliations.

Department of Learning Technologies, University of North Texas, Denton, TX, USA

Shanshan Ma, J. Michael Spector & Lin Lin

Centre for Educational Technology, Indian Institute of Technology, Kharagpur, India

Kaushal Kumar Bhagat

NetDragon, Fujian, China

East China Normal University, Shanghai, China

University of Cambridge, Cambridge, UK

Dawit T. Tiruneh

Private Consultant, Round Rock, Texas, US

Jonah Mancini

You can also search for this author in PubMed   Google Scholar

Corresponding author

Correspondence to J. Michael Spector .

Editor information

Editors and affiliations.

College of Info, Ste G150, Univ of North Texas, Denton, TX, USA

Michael J Spector

School of Education, Virginia Tech, Blacksburg, VA, USA

Barbara B Lockee

School of Education, Baker University, Overland Park, KS, USA

Marcus D. Childress

Section Editor information

Distance Education Center, Ankara University, Ankara, Turkey

Instituto Tecnológico de Saltillo, Saltillo, Mexico

Gloria Natividad

Hacettepe University, Ankara, Turkey

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this entry

Cite this entry.

Ma, S. et al. (2020). Developing Critical Thinking: A Review of Past Efforts as a Framework for a New Approach for Childhood Learning. In: Spector, M., Lockee, B., Childress, M. (eds) Learning, Design, and Technology. Springer, Cham. https://doi.org/10.1007/978-3-319-17727-4_161-1

Download citation

DOI : https://doi.org/10.1007/978-3-319-17727-4_161-1

Received : 23 April 2019

Accepted : 02 December 2019

Published : 14 January 2020

Publisher Name : Springer, Cham

Print ISBN : 978-3-319-17727-4

Online ISBN : 978-3-319-17727-4

eBook Packages : Springer Reference Education Reference Module Humanities and Social Sciences Reference Module Education

  • Publish with us

Policies and ethics

Chapter history

DOI: https://doi.org/10.1007/978-3-319-17727-4_161-2

DOI: https://doi.org/10.1007/978-3-319-17727-4_161-1

  • Find a journal
  • Track your research

Focus blog logo

5 Tech Tools to Encourage Critical Thinking

Critical thinking is an important aspect of learning. Understanding something is more than repeating facts, it’s being able to apply what you know in different forms . The practice of getting students to do this requires a shift from learning by receiving information to turning that information into something else , like a diagram or a storybook.

5 Tech Tools to Encourage Critical Thinking

These five simple tools allow you to inspire critical thinking in your students. Encourage them to take the information you’re giving them, and show what they know with mind maps, puzzles and more!

Discovery Education: Puzzlemaker

Students can use Discovery’s Puzzlemaker suite of tools to make customized word searches, letter tile puzzles, hidden message games and more. Use this as a v ocabulary activity station . Students pair up and create a puzzle for their teammate to solve using the words they’re learning that week.

This gives both students a chance to work with vocabulary in a new and fun way that requires extra thinking and problem solving.

Puzzlemaker

MindMeister

Mind mapping is a valuable tool to facilitate critical thinking, and technology has made it easier than ever to bring this into your classroom.

Use MindMeister, a simple and easy to implement mind mapping tool, to encourage students to think about a topic, lesson, problem or subject from every angle . This activity helps them look at the whole picture with a critical eye, rather than just studying the facts that are being taught in the curriculum.

Check out this compilation of inspiring educational mind maps , which cover topics like grammar, geography and reading comprehension.

developing critical thinking technologies include

Whooo’s Reading  

Answering open-ended questions is a simple way to facilitate critical thinking with students. However, many reading comprehension tools only allow students to answer multiple-choice questions, rather than requiring them to formulate their own answer.

Whooo’s Reading, an online reading log, not only requires students to answer open-ended questions, but every automatically prompted question is Common Core-aligned, so you can be sure your students are thinking about the text in terms of the various reading and writing anchors.

Learn more about how this tool has helped more than 10,000 teachers improve their students’ reading comprehension at the Learn2Earn teacher blog .

Whooo's Reading

Neo K12: Flow Chart Games

While this tool only has pre-defined flow chart games, in a variety of categories ranging from life sciences to the human body, you can use them to inspire critical thinking where appropriate.

For example, use flow chart games when exploring photosynthesis . Students have to drag and drop the various stages in the right part of the cycle. Require each student to write what each part of the cycle is about for a complete interactive thinking activity. Note that use of this this tool requires a monthly subscription.

developing critical thinking technologies include

This online business tool was not made for the classroom; however, students can use it to map out the visual representation of a process, adding notes, colors and details to show their knowledge of the topic. All diagrams are saved in your “Online Diagram Library” so students can access this content when studying for an exam or to show their parents.

You also have access to a large database of pre-made diagrams . Use these as supplementary materials for a lesson you’ve already written or as examples of what you expect from students with their own diagram.

developing critical thinking technologies include

  • Campus Life
  • ...a student.
  • ...a veteran.
  • ...an alum.
  • ...a parent.
  • ...faculty or staff.
  • UTC Learn (Canvas)
  • Class Schedule
  • Crisis Resources
  • People Finder
  • Change Password

UTC RAVE Alert

Critical thinking and problem-solving, jump to: , what is critical thinking, characteristics of critical thinking, why teach critical thinking.

  • Teaching Strategies to Help Promote Critical Thinking Skills

References and Resources

When examining the vast literature on critical thinking, various definitions of critical thinking emerge. Here are some samples:

  • "Critical thinking is the intellectually disciplined process of actively and skillfully conceptualizing, applying, analyzing, synthesizing, and/or evaluating information gathered from, or generated by, observation, experience, reflection, reasoning, or communication, as a guide to belief and action" (Scriven, 1996).
  • "Most formal definitions characterize critical thinking as the intentional application of rational, higher order thinking skills, such as analysis, synthesis, problem recognition and problem solving, inference, and evaluation" (Angelo, 1995, p. 6).
  • "Critical thinking is thinking that assesses itself" (Center for Critical Thinking, 1996b).
  • "Critical thinking is the ability to think about one's thinking in such a way as 1. To recognize its strengths and weaknesses and, as a result, 2. To recast the thinking in improved form" (Center for Critical Thinking, 1996c).

Perhaps the simplest definition is offered by Beyer (1995) : "Critical thinking... means making reasoned judgments" (p. 8). Basically, Beyer sees critical thinking as using criteria to judge the quality of something, from cooking to a conclusion of a research paper. In essence, critical thinking is a disciplined manner of thought that a person uses to assess the validity of something (statements, news stories, arguments, research, etc.).

Back        

Wade (1995) identifies eight characteristics of critical thinking. Critical thinking involves asking questions, defining a problem, examining evidence, analyzing assumptions and biases, avoiding emotional reasoning, avoiding oversimplification, considering other interpretations, and tolerating ambiguity. Dealing with ambiguity is also seen by Strohm & Baukus (1995) as an essential part of critical thinking, "Ambiguity and doubt serve a critical-thinking function and are a necessary and even a productive part of the process" (p. 56).

Another characteristic of critical thinking identified by many sources is metacognition. Metacognition is thinking about one's own thinking. More specifically, "metacognition is being aware of one's thinking as one performs specific tasks and then using this awareness to control what one is doing" (Jones & Ratcliff, 1993, p. 10 ).

In the book, Critical Thinking, Beyer elaborately explains what he sees as essential aspects of critical thinking. These are:

  • Dispositions: Critical thinkers are skeptical, open-minded, value fair-mindedness, respect evidence and reasoning, respect clarity and precision, look at different points of view, and will change positions when reason leads them to do so.
  • Criteria: To think critically, must apply criteria. Need to have conditions that must be met for something to be judged as believable. Although the argument can be made that each subject area has different criteria, some standards apply to all subjects. "... an assertion must... be based on relevant, accurate facts; based on credible sources; precise; unbiased; free from logical fallacies; logically consistent; and strongly reasoned" (p. 12).
  • Argument: Is a statement or proposition with supporting evidence. Critical thinking involves identifying, evaluating, and constructing arguments.
  • Reasoning: The ability to infer a conclusion from one or multiple premises. To do so requires examining logical relationships among statements or data.
  • Point of View: The way one views the world, which shapes one's construction of meaning. In a search for understanding, critical thinkers view phenomena from many different points of view.
  • Procedures for Applying Criteria: Other types of thinking use a general procedure. Critical thinking makes use of many procedures. These procedures include asking questions, making judgments, and identifying assumptions.

Oliver & Utermohlen (1995) see students as too often being passive receptors of information. Through technology, the amount of information available today is massive. This information explosion is likely to continue in the future. Students need a guide to weed through the information and not just passively accept it. Students need to "develop and effectively apply critical thinking skills to their academic studies, to the complex problems that they will face, and to the critical choices they will be forced to make as a result of the information explosion and other rapid technological changes" (Oliver & Utermohlen, p. 1 ).

As mentioned in the section, Characteristics of Critical Thinking , critical thinking involves questioning. It is important to teach students how to ask good questions, to think critically, in order to continue the advancement of the very fields we are teaching. "Every field stays alive only to the extent that fresh questions are generated and taken seriously" (Center for Critical Thinking, 1996a ).

Beyer sees the teaching of critical thinking as important to the very state of our nation. He argues that to live successfully in a democracy, people must be able to think critically in order to make sound decisions about personal and civic affairs. If students learn to think critically, then they can use good thinking as the guide by which they live their lives.

Teaching Strategies to Help Promote Critical Thinking

The 1995, Volume 22, issue 1, of the journal, Teaching of Psychology , is devoted to the teaching critical thinking. Most of the strategies included in this section come from the various articles that compose this issue.

  • CATS (Classroom Assessment Techniques): Angelo stresses the use of ongoing classroom assessment as a way to monitor and facilitate students' critical thinking. An example of a CAT is to ask students to write a "Minute Paper" responding to questions such as "What was the most important thing you learned in today's class? What question related to this session remains uppermost in your mind?" The teacher selects some of the papers and prepares responses for the next class meeting.
  • Cooperative Learning Strategies: Cooper (1995) argues that putting students in group learning situations is the best way to foster critical thinking. "In properly structured cooperative learning environments, students perform more of the active, critical thinking with continuous support and feedback from other students and the teacher" (p. 8).
  • Case Study /Discussion Method: McDade (1995) describes this method as the teacher presenting a case (or story) to the class without a conclusion. Using prepared questions, the teacher then leads students through a discussion, allowing students to construct a conclusion for the case.
  • Using Questions: King (1995) identifies ways of using questions in the classroom:
  • Reciprocal Peer Questioning: Following lecture, the teacher displays a list of question stems (such as, "What are the strengths and weaknesses of...). Students must write questions about the lecture material. In small groups, the students ask each other the questions. Then, the whole class discusses some of the questions from each small group.
  • Reader's Questions: Require students to write questions on assigned reading and turn them in at the beginning of class. Select a few of the questions as the impetus for class discussion.
  • Conference Style Learning: The teacher does not "teach" the class in the sense of lecturing. The teacher is a facilitator of a conference. Students must thoroughly read all required material before class. Assigned readings should be in the zone of proximal development. That is, readings should be able to be understood by students, but also challenging. The class consists of the students asking questions of each other and discussing these questions. The teacher does not remain passive, but rather, helps "direct and mold discussions by posing strategic questions and helping students build on each others' ideas" (Underwood & Wald, 1995, p. 18 ).
  • Use Writing Assignments: Wade sees the use of writing as fundamental to developing critical thinking skills. "With written assignments, an instructor can encourage the development of dialectic reasoning by requiring students to argue both [or more] sides of an issue" (p. 24).
  • Written dialogues: Give students written dialogues to analyze. In small groups, students must identify the different viewpoints of each participant in the dialogue. Must look for biases, presence or exclusion of important evidence, alternative interpretations, misstatement of facts, and errors in reasoning. Each group must decide which view is the most reasonable. After coming to a conclusion, each group acts out their dialogue and explains their analysis of it.
  • Spontaneous Group Dialogue: One group of students are assigned roles to play in a discussion (such as leader, information giver, opinion seeker, and disagreer). Four observer groups are formed with the functions of determining what roles are being played by whom, identifying biases and errors in thinking, evaluating reasoning skills, and examining ethical implications of the content.
  • Ambiguity: Strohm & Baukus advocate producing much ambiguity in the classroom. Don't give students clear cut material. Give them conflicting information that they must think their way through.
  • Angelo, T. A. (1995). Beginning the dialogue: Thoughts on promoting critical thinking: Classroom assessment for critical thinking. Teaching of Psychology, 22(1), 6-7.
  • Beyer, B. K. (1995). Critical thinking. Bloomington, IN: Phi Delta Kappa Educational Foundation.
  • Center for Critical Thinking (1996a). The role of questions in thinking, teaching, and learning. [On-line]. Available HTTP: http://www.criticalthinking.org/University/univlibrary/library.nclk
  • Center for Critical Thinking (1996b). Structures for student self-assessment. [On-line]. Available HTTP: http://www.criticalthinking.org/University/univclass/trc.nclk
  • Center for Critical Thinking (1996c). Three definitions of critical thinking [On-line]. Available HTTP: http://www.criticalthinking.org/University/univlibrary/library.nclk
  • Cooper, J. L. (1995). Cooperative learning and critical thinking. Teaching of Psychology, 22(1), 7-8.
  • Jones, E. A. & Ratcliff, G. (1993). Critical thinking skills for college students. National Center on Postsecondary Teaching, Learning, and Assessment, University Park, PA. (Eric Document Reproduction Services No. ED 358 772)
  • King, A. (1995). Designing the instructional process to enhance critical thinking across the curriculum: Inquiring minds really do want to know: Using questioning to teach critical thinking. Teaching of Psychology, 22 (1) , 13-17.
  • McDade, S. A. (1995). Case study pedagogy to advance critical thinking. Teaching Psychology, 22(1), 9-10.
  • Oliver, H. & Utermohlen, R. (1995). An innovative teaching strategy: Using critical thinking to give students a guide to the future.(Eric Document Reproduction Services No. 389 702)
  • Robertson, J. F. & Rane-Szostak, D. (1996). Using dialogues to develop critical thinking skills: A practical approach. Journal of Adolescent & Adult Literacy, 39(7), 552-556.
  • Scriven, M. & Paul, R. (1996). Defining critical thinking: A draft statement for the National Council for Excellence in Critical Thinking. [On-line]. Available HTTP: http://www.criticalthinking.org/University/univlibrary/library.nclk
  • Strohm, S. M., & Baukus, R. A. (1995). Strategies for fostering critical thinking skills. Journalism and Mass Communication Educator, 50 (1), 55-62.
  • Underwood, M. K., & Wald, R. L. (1995). Conference-style learning: A method for fostering critical thinking with heart. Teaching Psychology, 22(1), 17-21.
  • Wade, C. (1995). Using writing to develop and assess critical thinking. Teaching of Psychology, 22(1), 24-28.

Other Reading

  • Bean, J. C. (1996). Engaging ideas: The professor's guide to integrating writing, critical thinking, & active learning in the classroom. Jossey-Bass.
  • Bernstein, D. A. (1995). A negotiation model for teaching critical thinking. Teaching of Psychology, 22(1), 22-24.
  • Carlson, E. R. (1995). Evaluating the credibility of sources. A missing link in the teaching of critical thinking. Teaching of Psychology, 22(1), 39-41.
  • Facione, P. A., Sanchez, C. A., Facione, N. C., & Gainen, J. (1995). The disposition toward critical thinking. The Journal of General Education, 44(1), 1-25.
  • Halpern, D. F., & Nummedal, S. G. (1995). Closing thoughts about helping students improve how they think. Teaching of Psychology, 22(1), 82-83.
  • Isbell, D. (1995). Teaching writing and research as inseparable: A faculty-librarian teaching team. Reference Services Review, 23(4), 51-62.
  • Jones, J. M. & Safrit, R. D. (1994). Developing critical thinking skills in adult learners through innovative distance learning. Paper presented at the International Conference on the practice of adult education and social development. Jinan, China. (Eric Document Reproduction Services No. ED 373 159)
  • Sanchez, M. A. (1995). Using critical-thinking principles as a guide to college-level instruction. Teaching of Psychology, 22(1), 72-74.
  • Spicer, K. L. & Hanks, W. E. (1995). Multiple measures of critical thinking skills and predisposition in assessment of critical thinking. Paper presented at the annual meeting of the Speech Communication Association, San Antonio, TX. (Eric Document Reproduction Services No. ED 391 185)
  • Terenzini, P. T., Springer, L., Pascarella, E. T., & Nora, A. (1995). Influences affecting the development of students' critical thinking skills. Research in Higher Education, 36(1), 23-39.

On the Internet

  • Carr, K. S. (1990). How can we teach critical thinking. Eric Digest. [On-line]. Available HTTP: http://ericps.ed.uiuc.edu/eece/pubs/digests/1990/carr90.html
  • The Center for Critical Thinking (1996). Home Page. Available HTTP: http://www.criticalthinking.org/University/
  • Ennis, Bob (No date). Critical thinking. [On-line], April 4, 1997. Available HTTP: http://www.cof.orst.edu/cof/teach/for442/ct.htm
  • Montclair State University (1995). Curriculum resource center. Critical thinking resources: An annotated bibliography. [On-line]. Available HTTP: http://www.montclair.edu/Pages/CRC/Bibliographies/CriticalThinking.html
  • No author, No date. Critical Thinking is ... [On-line], April 4, 1997. Available HTTP: http://library.usask.ca/ustudy/critical/
  • Sheridan, Marcia (No date). Internet education topics hotlink page. [On-line], April 4, 1997. Available HTTP: http://sun1.iusb.edu/~msherida/topics/critical.html

Walker Center for Teaching and Learning

  • 433 Library
  • Dept 4354
  • 615 McCallie Ave
  •   423-425-4188

Read more

How it works

Transform your enterprise with the scalable mindsets, skills, & behavior change that drive performance.

Explore how BetterUp connects to your core business systems.

We pair AI with the latest in human-centered coaching to drive powerful, lasting learning and behavior change.

Build leaders that accelerate team performance and engagement.

Unlock performance potential at scale with AI-powered curated growth journeys.

Build resilience, well-being and agility to drive performance across your entire enterprise.

Transform your business, starting with your sales leaders.

Unlock business impact from the top with executive coaching.

Foster a culture of inclusion and belonging.

Accelerate the performance and potential of your agencies and employees.

See how innovative organizations use BetterUp to build a thriving workforce.

Discover how BetterUp measurably impacts key business outcomes for organizations like yours.

A demo is the first step to transforming your business. Meet with us to develop a plan for attaining your goals.

Request a demo

  • What is coaching?

Learn how 1:1 coaching works, who its for, and if it's right for you.

Accelerate your personal and professional growth with the expert guidance of a BetterUp Coach.

Types of Coaching

Navigate career transitions, accelerate your professional growth, and achieve your career goals with expert coaching.

Enhance your communication skills for better personal and professional relationships, with tailored coaching that focuses on your needs.

Find balance, resilience, and well-being in all areas of your life with holistic coaching designed to empower you.

Discover your perfect match : Take our 5-minute assessment and let us pair you with one of our top Coaches tailored just for you.

Find your Coach

Research, expert insights, and resources to develop courageous leaders within your organization.

Best practices, research, and tools to fuel individual and business growth.

View on-demand BetterUp events and learn about upcoming live discussions.

The latest insights and ideas for building a high-performing workplace.

  • BetterUp Briefing

The online magazine that helps you understand tomorrow's workforce trends, today.

Innovative research featured in peer-reviewed journals, press, and more.

Founded in 2022 to deepen the understanding of the intersection of well-being, purpose, and performance

We're on a mission to help everyone live with clarity, purpose, and passion.

Join us and create impactful change.

Read the buzz about BetterUp.

Meet the leadership that's passionate about empowering your workforce.

Find your Coach

For Business

For Individuals

How to develop critical thinking skills

man-thinking-while-holding-pen-and-looking-at-computer-how-to-develop-critical-thinking-skills

Jump to section

What are critical thinking skills?

How to develop critical thinking skills: 12 tips, how to practice critical thinking skills at work, become your own best critic.

A client requests a tight deadline on an intense project. Your childcare provider calls in sick on a day full of meetings. Payment from a contract gig is a month behind. 

Your day-to-day will always have challenges, big and small. And no matter the size and urgency, they all ask you to use critical thinking to analyze the situation and arrive at the right solution. 

Critical thinking includes a wide set of soft skills that encourage continuous learning, resilience , and self-reflection. The more you add to your professional toolbelt, the more equipped you’ll be to tackle whatever challenge presents itself. Here’s how to develop critical thinking, with examples explaining how to use it.

Critical thinking skills are the skills you use to analyze information, imagine scenarios holistically, and create rational solutions. It’s a type of emotional intelligence that stimulates effective problem-solving and decision-making . 

When you fine-tune your critical thinking skills, you seek beyond face-value observations and knee-jerk reactions. Instead, you harvest deeper insights and string together ideas and concepts in logical, sometimes out-of-the-box , ways. 

Imagine a team working on a marketing strategy for a new set of services. That team might use critical thinking to balance goals and key performance indicators , like new customer acquisition costs, average monthly sales, and net profit margins. They understand the connections between overlapping factors to build a strategy that stays within budget and attracts new sales. 

Looking for ways to improve critical thinking skills? Start by brushing up on the following soft skills that fall under this umbrella: 

  • Analytical thinking: Approaching problems with an analytical eye includes breaking down complex issues into small chunks and examining their significance. An example could be organizing customer feedback to identify trends and improve your product offerings. 
  • Open-mindedness: Push past cognitive biases and be receptive to different points of view and constructive feedback . Managers and team members who keep an open mind position themselves to hear new ideas that foster innovation . 
  • Creative thinking: With creative thinking , you can develop several ideas to address a single problem, like brainstorming more efficient workflow best practices to boost productivity and employee morale . 
  • Self-reflection: Self-reflection lets you examine your thinking and assumptions to stimulate healthier collaboration and thought processes. Maybe a bad first impression created a negative anchoring bias with a new coworker. Reflecting on your own behavior stirs up empathy and improves the relationship. 
  • Evaluation: With evaluation skills, you tackle the pros and cons of a situation based on logic rather than emotion. When prioritizing tasks , you might be tempted to do the fun or easy ones first, but evaluating their urgency and importance can help you make better decisions. 

There’s no magic method to change your thinking processes. Improvement happens with small, intentional changes to your everyday habits until a more critical approach to thinking is automatic. 

Here are 12 tips for building stronger self-awareness and learning how to improve critical thinking: 

1. Be cautious

There’s nothing wrong with a little bit of skepticism. One of the core principles of critical thinking is asking questions and dissecting the available information. You might surprise yourself at what you find when you stop to think before taking action. 

Before making a decision, use evidence, logic, and deductive reasoning to support your own opinions or challenge ideas. It helps you and your team avoid falling prey to bad information or resistance to change .

2. Ask open-ended questions

“Yes” or “no” questions invite agreement rather than reflection. Instead, ask open-ended questions that force you to engage in analysis and rumination. Digging deeper can help you identify potential biases, uncover assumptions, and arrive at new hypotheses and possible solutions. 

3. Do your research

No matter your proficiency, you can always learn more. Turning to different points of view and information is a great way to develop a comprehensive understanding of a topic and make informed decisions. You’ll prioritize reliable information rather than fall into emotional or automatic decision-making. 

close-up-of-mans-hands-opening-a-dictionary-with-notebook-on-the-side-how-to-develop-critical-thinking-skills

4. Consider several opinions

You might spend so much time on your work that it’s easy to get stuck in your own perspective, especially if you work independently on a remote team . Make an effort to reach out to colleagues to hear different ideas and thought patterns. Their input might surprise you.

If or when you disagree, remember that you and your team share a common goal. Divergent opinions are constructive, so shift the focus to finding solutions rather than defending disagreements. 

5. Learn to be quiet

Active listening is the intentional practice of concentrating on a conversation partner instead of your own thoughts. It’s about paying attention to detail and letting people know you value their opinions, which can open your mind to new perspectives and thought processes.

If you’re brainstorming with your team or having a 1:1 with a coworker , listen, ask clarifying questions, and work to understand other peoples’ viewpoints. Listening to your team will help you find fallacies in arguments to improve possible solutions.

6. Schedule reflection

Whether waking up at 5 am or using a procrastination hack, scheduling time to think puts you in a growth mindset . Your mind has natural cognitive biases to help you simplify decision-making, but squashing them is key to thinking critically and finding new solutions besides the ones you might gravitate toward. Creating time and calm space in your day gives you the chance to step back and visualize the biases that impact your decision-making. 

7. Cultivate curiosity

With so many demands and job responsibilities, it’s easy to seek solace in routine. But getting out of your comfort zone helps spark critical thinking and find more solutions than you usually might.

If curiosity doesn’t come naturally to you, cultivate a thirst for knowledge by reskilling and upskilling . Not only will you add a new skill to your resume , but expanding the limits of your professional knowledge might motivate you to ask more questions. 

You don’t have to develop critical thinking skills exclusively in the office. Whether on your break or finding a hobby to do after work, playing strategic games or filling out crosswords can prime your brain for problem-solving. 

woman-solving-puzzle-at-home-how-to-develop-critical-thinking-skills

9. Write it down

Recording your thoughts with pen and paper can lead to stronger brain activity than typing them out on a keyboard. If you’re stuck and want to think more critically about a problem, writing your ideas can help you process information more deeply.

The act of recording ideas on paper can also improve your memory . Ideas are more likely to linger in the background of your mind, leading to deeper thinking that informs your decision-making process. 

10. Speak up

Take opportunities to share your opinion, even if it intimidates you. Whether at a networking event with new people or a meeting with close colleagues, try to engage with people who challenge or help you develop your ideas. Having conversations that force you to support your position encourages you to refine your argument and think critically. 

11. Stay humble

Ideas and concepts aren’t the same as real-life actions. There may be such a thing as negative outcomes, but there’s no such thing as a bad idea. At the brainstorming stage , don’t be afraid to make mistakes.

Sometimes the best solutions come from off-the-wall, unorthodox decisions. Sit in your creativity , let ideas flow, and don’t be afraid to share them with your colleagues. Putting yourself in a creative mindset helps you see situations from new perspectives and arrive at innovative conclusions. 

12. Embrace discomfort

Get comfortable feeling uncomfortable . It isn’t easy when others challenge your ideas, but sometimes, it’s the only way to see new perspectives and think critically.

By willingly stepping into unfamiliar territory, you foster the resilience and flexibility you need to become a better thinker. You’ll learn how to pick yourself up from failure and approach problems from fresh angles. 

man-looking-down-to-something-while-thinking-how-to-develop-critical-thinking-skills

Thinking critically is easier said than done. To help you understand its impact (and how to use it), here are two scenarios that require critical thinking skills and provide teachable moments. 

Scenario #1: Unexpected delays and budget

Imagine your team is working on producing an event. Unexpectedly, a vendor explains they’ll be a week behind on delivering materials. Then another vendor sends a quote that’s more than you can afford. Unless you develop a creative solution, the team will have to push back deadlines and go over budget, potentially costing the client’s trust. 

Here’s how you could approach the situation with creative thinking:

  • Analyze the situation holistically: Determine how the delayed materials and over-budget quote will impact the rest of your timeline and financial resources . That way, you can identify whether you need to build an entirely new plan with new vendors, or if it’s worth it to readjust time and resources. 
  • Identify your alternative options: With careful assessment, your team decides that another vendor can’t provide the same materials in a quicker time frame. You’ll need to rearrange assignment schedules to complete everything on time. 
  • Collaborate and adapt: Your team has an emergency meeting to rearrange your project schedule. You write down each deliverable and determine which ones you can and can’t complete by the deadline. To compensate for lost time, you rearrange your task schedule to complete everything that doesn’t need the delayed materials first, then advance as far as you can on the tasks that do. 
  • Check different resources: In the meantime, you scour through your contact sheet to find alternative vendors that fit your budget. Accounting helps by providing old invoices to determine which vendors have quoted less for previous jobs. After pulling all your sources, you find a vendor that fits your budget. 
  • Maintain open communication: You create a special Slack channel to keep everyone up to date on changes, challenges, and additional delays. Keeping an open line encourages transparency on the team’s progress and boosts everyone’s confidence. 

coworkers-at-meeting-looking-together-the-screen-how-to-develop-critical-thinking-skills

Scenario #2: Differing opinions 

A conflict arises between two team members on the best approach for a new strategy for a gaming app. One believes that small tweaks to the current content are necessary to maintain user engagement and stay within budget. The other believes a bold revamp is needed to encourage new followers and stronger sales revenue. 

Here’s how critical thinking could help this conflict:

  • Listen actively: Give both team members the opportunity to present their ideas free of interruption. Encourage the entire team to ask open-ended questions to more fully understand and develop each argument. 
  • Flex your analytical skills: After learning more about both ideas, everyone should objectively assess the benefits and drawbacks of each approach. Analyze each idea's risk, merits, and feasibility based on available data and the app’s goals and objectives. 
  • Identify common ground: The team discusses similarities between each approach and brainstorms ways to integrate both idea s, like making small but eye-catching modifications to existing content or using the same visual design in new media formats. 
  • Test new strategy: To test out the potential of a bolder strategy, the team decides to A/B test both approaches. You create a set of criteria to evenly distribute users by different demographics to analyze engagement, revenue, and customer turnover. 
  • Monitor and adapt: After implementing the A/B test, the team closely monitors the results of each strategy. You regroup and optimize the changes that provide stronger results after the testing. That way, all team members understand why you’re making the changes you decide to make.

You can’t think your problems away. But you can equip yourself with skills that help you move through your biggest challenges and find innovative solutions. Learning how to develop critical thinking is the start of honing an adaptable growth mindset. 

Now that you have resources to increase critical thinking skills in your professional development, you can identify whether you embrace change or routine, are open or resistant to feedback, or turn to research or emotion will build self-awareness. From there, tweak and incorporate techniques to be a critical thinker when life presents you with a problem.

Cultivate your creativity

Foster creativity and continuous learning with guidance from our certified Coaches.

Elizabeth Perry, ACC

Elizabeth Perry is a Coach Community Manager at BetterUp. She uses strategic engagement strategies to cultivate a learning community across a global network of Coaches through in-person and virtual experiences, technology-enabled platforms, and strategic coaching industry partnerships. With over 3 years of coaching experience and a certification in transformative leadership and life coaching from Sofia University, Elizabeth leverages transpersonal psychology expertise to help coaches and clients gain awareness of their behavioral and thought patterns, discover their purpose and passions, and elevate their potential. She is a lifelong student of psychology, personal growth, and human potential as well as an ICF-certified ACC transpersonal life and leadership Coach.

How divergent thinking can drive your creativity

What’s convergent thinking how to be a better problem-solver, how emotions affect learning: the impact of emotions, 8 creative solutions to your most challenging problems, critical thinking is the one skillset you can't afford not to master, can dreams help you solve problems 6 ways to try, how to improve your creative skills and supercharge your resume, how different learning styles make a difference at work, self directed learning is the key to new skills and knowledge, similar articles, what is lateral thinking 7 techniques to encourage creative ideas, 7 critical teamwork skills and how to develop them, what is creative thinking and how can i improve, discover the 7 essential types of life skills you need, 6 big picture thinking strategies that you'll actually use, what are analytical skills examples and how to level up, stay connected with betterup, get our newsletter, event invites, plus product insights and research..

3100 E 5th Street, Suite 350 Austin, TX 78702

  • Platform Overview
  • Integrations
  • Powered by AI
  • BetterUp Lead™
  • BetterUp Manage™
  • BetterUp Care®
  • Sales Performance
  • Diversity & Inclusion
  • Case Studies
  • Why BetterUp?
  • About Coaching
  • Find your Coach
  • Career Coaching
  • Communication Coaching
  • Life Coaching
  • News and Press
  • Leadership Team
  • Become a BetterUp Coach
  • BetterUp Labs
  • Center for Purpose & Performance
  • Leadership Training
  • Business Coaching
  • Contact Support
  • Contact Sales
  • Privacy Policy
  • Acceptable Use Policy
  • Trust & Security
  • Cookie Preferences
  • Critical Thinking

Critical Thinking and Digital Technologies: Concepts, Methodologies, Tools, and Applications

  • January 2019
  • In book: Rapid Automation (pp.1407-1433)

Şahin Gökçearslan at Gazi University

  • Gazi University

Ebru Solmaz at Gazi University

  • Kastamonu Üniversitesi

Abstract and Figures

Distribution of the Publications by Year

Discover the world's research

  • 25+ million members
  • 160+ million publication pages
  • 2.3+ billion citations
  • Richard Mendoza Bañez
  • Pamella Mercy Papilaya

Alison Mackenzie

  • Lesley Gourlay
  • Karima Toumi Sayari

Gonul Sakiz

  • Özgür Şimşek

Diane F Halpern

  • Juliet Webster

Steven Hoffman

  • Stella Cottrell

Andrew Murphie

  • M. Blankenship
  • D.H. Jonassen
  • A.M. McKillop
  • Arş.Grv.Vildan Donmuş

Mehmet Gürol

  • Recruit researchers
  • Join for free
  • Login Email Tip: Most researchers use their institutional email address as their ResearchGate login Password Forgot password? Keep me logged in Log in or Continue with Google Welcome back! Please log in. Email · Hint Tip: Most researchers use their institutional email address as their ResearchGate login Password Forgot password? Keep me logged in Log in or Continue with Google No account? Sign up

developing critical thinking technologies include

  • Seller Dashboard

developing critical thinking technologies include

Shopping Cart

No products in the cart.

  • Dance Dance is an expressive movement with purpose and form. Through dance, students represent, question and celebrate human experience, using the body as the instrument and movement as the medium for personal, social, emotional, spiritual and physical communication. Making in Dance involves improvising, choreographing, comparing and contrasting, refining, interpreting, practising, rehearsing and performing. Responding in Dance involves students appreciating their own and others’ dance works by viewing, describing, reflecting on, analysing, appreciating and evaluating.
  • Drama Drama is the expression and exploration of personal, cultural and social worlds through role and situation that engages, entertains and challenges. Students create meaning as drama makers, performers and audiences as they enjoy and analyse their own and others’ stories and points of view. Like all art forms, drama has the capacity to engage, inspire and enrich all students, excite the imagination and encourage students to reach their creative and expressive potential. Drama enables students to imagine and participate in exploration of their worlds, individually and collaboratively. Students actively use body, gesture, movement, voice and language, taking on roles to explore and depict real and imagined worlds. They create, rehearse, perform and respond using the elements and conventions of drama and emerging and existing technologies available to them.
  • Music Music is uniquely an aural art form. The essential nature of music is abstract. Music encompasses existing sounds that are selected and shaped, new sounds created by composers and performers, and the placement of sounds in time and space. Composers, performers and listeners perceive and define these sounds as music. Music exists distinctively in every culture and is a basic expression of human experience. Students’ active participation in Music fosters understanding of other times, places, cultures and contexts. Through continuous and sequential music learning, students listen to, compose and perform with increasing depth and complexity. Through performing, composing and listening with intent to music, students have access to knowledge, skills and understanding which can be gained in no other way. Learning in Music is aurally based and can be understood without any recourse to notation. Learning to read and write music in traditional and graphic forms enables students to access a wide range of music as independent learners. Music has the capacity to engage, inspire and enrich all students, exciting the imagination and encouraging students to reach their creative and expressive potential. Skills and techniques developed through participation in music learning allow students to manipulate, express and share sound as…
  • Photographic and Digital Media Photographic and digital media powerfully communicates ideas, identity, values and culture through images. The study of photographic and digital media enables young people to develop an interest in and enjoyment of investigating the rapidly evolving ideas, practices and technologies of this art form. Through critical reflection and acquiring understanding, knowledge and skills, students respond to the ideas, art and arts practice of others, through creatively developing their own ideas and photographic and digital artworks. The Photographic and Digital Media Years 7–10 syllabus includes Life Skills outcomes and content for students with special education needs.
  • Visual Arts Visual arts includes the fields of art, craft and design. Learning in and through these fields, students create visual representations that communicate, challenge and express their own and others’ ideas as artist and audience. They develop perceptual and conceptual understanding, critical reasoning and practical skills through exploring and expanding their understanding of their world and other worlds. They learn about the role of the artist, craftsperson and designer, their contribution to society, and the significance of the creative industries. Similarly with the other art forms, the visual arts has the capacity to engage, inspire and enrich the lives of students, encouraging them to reach their creative and intellectual potential by igniting informed, imaginative and innovative thinking. Through Visual Arts, students make and respond using visual arts knowledge, understanding and skills to represent meaning associated with personal and global views, and intrinsic and extrinsic worlds. Visual Arts engages students in a journey of discovery, experimentation and problem-solving relevant to visual perception and visual language. Students undertake this journey by using visual techniques, technologies, practices and processes. Learning in the Visual Arts, students become increasingly confident and proficient in achieving their personal visual aesthetic, and appreciate and value that of others. Visual…
  • Visual Design This course provides students with opportunities to exploit the links between art and design by designing and making images and objects in which aesthetic qualities and symbolic meanings are as important as utilitarian function. It encourages students to explore the practices of graphic, wearable, product, and interior/exterior designers in contemporary societies and promotes imaginative and innovative approaches to design within the context of the Australian environment and culture. Through the critical and historical study of designed images and objects students are able to analyse and make informed judgements about the designed works that surround them – works which reflect and construct the image they have of themselves, others and their world. The course is designed to enable students to gain an increasing accomplishment and independence in their representation of ideas in different fields of design and to understand and value how graphic design, wearable design, product design, and interior/exterior design, invite different interpretations and explanations. Students develop knowledge, understanding and skills through the making of works in design that lead to and demonstrate conceptual and technical accomplishment. They also develop knowledge, understanding and skills that lead to increasingly accomplished critical and historical investigations of design.
  • Community & Family Studies (CAFS) Community and Family Studies Stage 6 syllabus is designed to develop in each student an understanding of the diverse nature and interdependence of families and communities within Australian society. The course enables students to plan and manage resources effectively in order to address contemporary issues facing families and communities. The Preliminary course consists of three mandatory modules and the indicative course time allocated to their study. The HSC course consists of three mandatory modules representing 75 per cent of course time. An options component representing 25 per cent of course time includes three modules of which students are to study only one. Students are required to complete an Independent Research Project (IRP) in the context of the HSC core module – Research Methodology – and forms part of the HSC internal assessment. The focus of the IRP should be related to the course content of one or more of the following areas: individuals, groups, families, communities, resource management.
  • Child & Early Childhood Studies Child Studies aims to develop in students the knowledge, understanding and skills to positively influence the wellbeing and development of children in the critical early years in a range of settings and contexts. The Child Studies CEC Years 7–10 course includes Life Skills outcomes and content for students with disability. The syllabus includes a range of modules that provide flexibility for schools to design and deliver a course in Child Studies that meets the needs and interests of their students. Modules should be between 15 and 30 hours’ duration. The syllabus modules are: Preparing for parenthood Conception to birth Family interactions Newborn care Growth and development Play and the developing child Health and safety in childhood Food and nutrition in childhood Children and culture Media and technology in childhood Aboriginal cultures and childhood The diverse needs of children Childcare services and career opportunities Throughout the course, students will develop skills that enhance their ability to: support a child’s development from pre-conception through to and including the early years positively influence the growth, development and wellbeing of children consider the external factors that support the growth, development and wellbeing of children research, communicate and evaluate issues related to child development.
  • Health and Physical Education The Australian Curriculum: Health and Physical Education. Personal Development, Health and Physical Education (PDHPE) In an increasingly complex, sedentary and rapidly changing world it is critical for every young Australian to not only be able to cope with life’s challenges but also to flourish as healthy, safe and active citizens in the 21st century. This is a strong investment in the future of the Australian population. Technology and media will continue to transform our lives and change the way we communicate. Some health issues will endure while new ones will emerge. New forms of physical activity will become available. Students need critical inquiry skills to research and analyse knowledge and to understand the influences on their own and others’ health, safety, wellbeing and physical activity participation. They also need to be resilient, to develop empathy and to be actively engaged in their own and others’ wellbeing, using health, safety and physical activity resources for the benefit of themselves and their communities. In Health and Physical Education, students develop the skills, knowledge, and understanding to strengthen their sense of self, and build and manage satisfying, respectful relationships. They learn to build on personal and community strengths and assets to enhance safety…
  • Aboriginal Studies The Preliminary course focuses on Aboriginal Peoples’ relationship to the Land, Aboriginal heritage and identity, and an historical examination of colonialism, racism and prejudice from pre-contact times to the 1960s. The course also includes the development of skills in culturally appropriate research and inquiry methods. It involves case studies. The HSC course provides for in-depth study of legislation, policy, judicial processes and current events from the 1960s. During the course, students undertake consultation with Aboriginal communities and study the course through the experiences of national and international Indigenous communities. Students apply research and inquiry methods through the completion of a major project.
  • Economics and Business Studies As mass global flows of people, resources, finances and information produce social, economic, political and environmental complexities and challenges, Australia needs enterprising individuals who can make informed decisions and actively participate in society and the economy as individuals and more broadly as global citizens. Young Australians will also face a number of social, economic and moral challenges in their lifetimes that will impact on their lives and choices. It is critical that students are equipped with the knowledge, understanding and skills that will empower them in the face of such challenges. The Australian Curriculum: Economics and Business empowers students to shape their social and economic futures and to contribute to the development of prosperous, sustainable and equitable Australian and global economies. The study of economics and business develops the knowledge, understanding and skills that will equip students to secure their financial futures and to participate in and contribute to the wellbeing and sustainability of the economy, the environment and society. Through studying economics and business, students learn to make informed decisions and to appreciate the interdependence of decisions made within economic systems, including the effects of these decisions on consumers, businesses, governments and other economies, and on environmental and social…
  • Geography In a world of increasing global integration and international mobility, it is critical to the wellbeing and sustainability of the environment and society that young Australians develop a holistic understanding of the world. This requires deep knowledge and understanding of why the world is the way it is and the interconnections between people, places and environments over place and time. Geography empowers students to shape change for a socially just and sustainable future. Geography inspires curiosity and wonder about the diversity of the world’s places, peoples, cultures and environments. Through a structured way of exploring, analysing and understanding the characteristics of the places that make up our world, Geography enables students to question why the world is the way it is, and reflect on their relationships with and responsibilities for that world. Geography teaches students to respond to questions in a geographically distinctive way; plan inquiries; collect, evaluate, analyse and interpret information; and suggest responses to what they have learnt. Geography provides students with opportunities to develop a wide range of general skills, capabilities and dispositions that can be applied in everyday life and at work. The subject helps students to develop information and communication technology skills; an appreciation and…
  • History History is a disciplined process of inquiry into the past that develops students’ curiosity and imagination. Awareness of history is an essential characteristic of any society, and historical knowledge is fundamental to understanding ourselves and others. History promotes the understanding of societies, events, movements and developments that have shaped humanity from earliest times. It helps students appreciate how the world and its people have changed, as well as the significant continuities that exist to the present day. History, as a discipline, has its own methods and procedures which make it different from other ways of understanding human experience. The study of history is based on evidence derived from remains of the past. It is interpretative by nature, promotes debate and encourages thinking about human values, including present and future challenges. The process of historical inquiry develops transferable skills such as the ability to ask relevant questions; critically analyse and interpret sources; consider context; respect and explain different perspectives; develop and substantiate interpretations, and communicate effectively.
  • Legal Studies Legal Studies provides students with opportunities to develop their knowledge and understanding of the nature and functions of law and law-making, the development of Australian and international legal systems, the Australian constitution and law reform. Students investigate the key areas of law, justice and human rights through a variety of focus studies which consider how changes in societies influence law reform.
  • Religion Religion provides students with opportunities to develop their understanding and critical awareness of the nature and significance of religion and the influence of belief systems and religious traditions on individuals and within society.
  • Society and Culture Society and Culture is a conceptually based course that promotes students’ awareness of the cultural continuities and changes within societies and cultures. It provides them with skills to critically analyse social theories and complementary and contrasting viewpoints about people, societies and cultures. Society and Culture promotes an awareness of individuals, groups and institutions and facilitates intercultural understanding and communication. Society and Culture encourages students to manage their own learning, including opportunities to experience working within teams. In allowing students to study in areas of direct relevance to their lives, Society and Culture contributes greatly to the promotion of lifelong learning, providing opportunities for students to acquire a range of skills to support such learning.
  • English The study of English is central to the learning and development of all young Australians. It helps create confident communicators, imaginative thinkers and informed citizens. It is through the study of English that individuals learn to analyse, understand, communicate and build relationships with others and with the world around them. The study of English plays a key role in the development of reading and literacy skills which help young people develop the knowledge and skills needed for education, training and the workplace. It helps them become ethical, thoughtful, informed and active members of society.
  • Holiday/Seasonal
  • Math Mathematics is used to identify, describe and apply patterns and relationships. It provides a precise means of communication and is a powerful tool for solving problems both within and beyond mathematics. Mathematical ideas are constantly developing, and mathematics is integral to scientific and technological advances in many fields of endeavour. Digital technologies provide access to new tools for continuing mathematical exploration and invention. In addition to its practical applications, the study of mathematics is a valuable pursuit in its own right, providing opportunities for originality, challenge and leisure. Mathematics focuses on developing increasingly sophisticated and refined mathematical understanding, fluency, communication, logical reasoning, analytical thought and problem-solving skills. These capabilities enable students to respond to familiar and unfamiliar situations by employing strategies to make informed decisions and solve problems relevant to their further education and everyday lives.
  • Life Skills Syllabus
  • Products for Sellers
  • Quality Teaching
  • STEM and STEAM STEM – Science, technology, engineering, and mathematics. STEAM – Science, technology, engineering, Art, and mathematics Science, Technology, Engineering and Mathematics (STEM) are essential areas of study that foster students’ skills and prepare them to participate in a rapidly changing world and contribute to Australia’s future development and prosperity. Through STEM, students develop key skills including: problem-solving creativity critical analysis teamwork independent thinking initiative communication digital literacy
  • Biology Biology is the study of the fascinating diversity of life as it has evolved and as it interacts and functions. Investigation of biological systems and their interactions, from cellular processes to ecosystem dynamics, has led to biological knowledge and understanding that enable us to explore and explain everyday observations, find solutions to biological issues, and understand the processes of biological continuity and change over time. Living systems are all interconnected and interact at a variety of spatial and temporal scales, from the molecular level to the ecosystem level. Investigation of living systems involves classification of key components within the system, and analysis of how those components interact, particularly with regard to the movement of matter and the transfer and transformation of energy within and between systems. Analysis of the ways living systems change over time involves understanding of the factors that impact the system, and investigation of system mechanisms to respond to internal and external changes and ensure continuity of the system. The theory of evolution by natural selection is critical to explaining these patterns and processes in biology, and underpins the study of all living systems. Australian, regional and global communities rely on the biological sciences to understand, address…
  • Chemistry Chemistry is the study of materials and substances, and the transformations they undergo through interactions and the transfer of energy. Chemists can use an understanding of chemical structures and processes to adapt, control and manipulate systems to meet particular economic, environmental and social needs. This includes addressing the global challenges of climate change and security of water, food and energy supplies, and designing processes to maximise the efficient use of Earth’s finite resources. Chemistry develops students’ understanding of the key chemical concepts and models of structure, bonding, and chemical change, including the role of chemical, electrical and thermal energy. Students learn how models of structure and bonding enable chemists to predict properties and reactions and to adapt these for particular purposes. Students explore key concepts and models through active inquiry into phenomena and through contexts that exemplify the role of chemistry and chemists in society. Students design and conduct qualitative and quantitative investigations both individually and collaboratively. They investigate questions and hypotheses, manipulate variables, analyse data, evaluate claims, solve problems and develop and communicate evidence-based arguments and models. Thinking in chemistry involves using differing scales including macro-, micro- and nano-scales; using specialised representations such as chemical symbols and equations; and…
  • Earth and Environmental Science Earth and Environmental Science is a multifaceted field of inquiry that focuses on interactions between the solid Earth, its water, its air and its living organisms, and on dynamic, interdependent relationships that have developed between these four components. Earth and environmental scientists consider how these interrelationships produce environmental change at a variety of timescales. To do this, they integrate knowledge, concepts, models and methods drawn from geology, biology, physics and chemistry in the study of Earth’s ancient and modern environments. Earth and environmental scientists strive to understand past and present processes so that reliable and scientifically-defensible predictions can be made about the future. Earth and Environmental Science builds on the content in the Biological and Earth and Space Sciences sub-strands of the Foundation to Year 10 Australian Curriculum: Science. In particular, the subject provides students with opportunities to explore the theories and evidence that frame our understanding of Earth’s origins and history; the dynamic and interdependent nature of Earth’s processes, environments and resources; and the ways in which these processes, environments and resources respond to change across a range of temporal and spatial scales. In this subject, the term ‘environment’ encompasses terrestrial, marine and atmospheric settings and includes Earth’s interior.…
  • Physics Physics is a fundamental science that endeavours to explain all the natural phenomena that occur in the universe. Its power lies in the use of a comparatively small number of assumptions, models, laws and theories to explain a wide range of phenomena, from the incredibly small to the incredibly large. Physics has helped to unlock the mysteries of the universe and provides the foundation of understanding upon which modern technologies and all other sciences are based. Physics uses qualitative and quantitative models and theories based on physical laws to visualise, explain and predict physical phenomena. Models, laws and theories are developed from, and their predictions are tested by making, observations and quantitative measurements. In this subject, students gather, analyse and interpret primary and secondary data to investigate a range of phenomena and technologies using some of the most important models, laws and theories of physics, including the kinetic particle model, the atomic model, electromagnetic theory, and the laws of classical mechanics. Students investigate how the unifying concept of energy explains diverse phenomena and provides a powerful tool for analysing how systems interact throughout the universe on multiple scales. Students learn how more sophisticated theories, including quantum theory, the theory of…
  • Science K-12 Science provides an empirical way of answering interesting and important questions about the biological, physical and technological world. The knowledge it produces has proved to be a reliable basis for action in our personal, social and economic lives. Science is a dynamic, collaborative and creative human endeavour arising from our desire to make sense of our world through exploring the unknown, investigating universal mysteries, making predictions and solving problems. Science aims to understand a large number of observations in terms of a much smaller number of broad principles. Science knowledge is contestable and is revised, refined and extended as new evidence arises.
  • Agriculture The Preliminary course incorporates the study of the interactions between the components of agricultural production, marketing and management, while giving consideration to the issue of sustainability of the farming system. This is an ‘on-farm’, environment-oriented course. The HSC course builds upon the Preliminary course. It examines the complexity and scientific principles of the components of agricultural production. It places greater emphasis on farm management to maximise productivity and environmental sustainability. The Farm Product Study is used as a basis for analysing and addressing social, environmental and economic issues as they relate to sustainability.
  • Computers Information & Software Technology (IST) Information Communication Technology (ICT) provides the essential skills necessary to operate effectively in the 21st century while providing a learning environment that is interesting and engaging. Software Design and Development (SDD). For the purposes of the Software Design and Development Stage 6 Syllabus, software design and development refers to the creativity, knowledge, values and communication skills required to develop computer programs. The subject provides students with a systematic approach to problem-solving, an opportunity to be creative, excellent career prospects and interesting content.
  • Cooking Cooking is a skill that teaches children about nutrition and food safety, as well as building math, science, literacy and fine motor skills.
  • Design and Technology Design and Technology involves the study of design theory and practice, design processes, environmental and social issues, communication, research, technologies, and the manipulation of materials, tools and techniques. It involves hands-on practical activities which develop knowledge and skills in designing and producing. The course involves the development, realisation and documentation of design projects. The Major Design Project and supporting folio requires students to select and apply appropriate design, production and evaluation skills to a product, system or environment that satisfies an identified need or opportunity.
  • Digital Technologies and ICT Digital Technologies comprises two related strands: Digital Technologies knowledge and understanding – the information system components of data, and digital systems (hardware, software and networks) Computational thinking is the thought processes involved in formulating a problem and expressing its solution(s) in such a way that a computer – human or machine – can effectively carry out. Informally, computational thinking describes the mental activity in formulating a problem to admit a computational solution.  The solution can be carried out by a human or machine. This latter point is important.  First, humans compute.  Second, people can learn computational thinking without a machine.
  • Engineering Engineering studies are directed towards the development and application of mathematical, scientific and technological skills and their integration with business and management. It provides students with skills, knowledge and understanding associated with a study of engineering, its practices and associated methodologies. The subject promotes environmental, economic and global awareness, problem-solving ability, engagement with information technology, self-directed learning, communication, management and skills in working as a team.
  • Food Technology The study of Food Technology provides students with a broad knowledge of food properties, processing, preparation, nutritional considerations and consumption patterns. It addresses the importance of hygiene and safe working practices and legislation in relation to the production of food. Students develop food-specific skills, which can be applied in a range of contexts enabling students to produce quality food products. The course also provides students with contexts through which to explore the richness, pleasure and variety food adds to life and how it contributes to both vocational and general life experiences.
  • Graphics Technology The study of Graphics Technology provides students with knowledge of the techniques and technologies used to graphically convey technical and non-technical ideas and information. Students are introduced to the significance of graphical communication as a universal language and develop the ability to read, interpret and produce graphical presentations that communicate information using a variety of techniques and media.
  • Industrial Technology Students develop knowledge and understanding of materials and processes. Related knowledge and skills are developed through a specialised approach to the tools, materials, equipment and techniques employed in the planning, development, construction and evaluation of quality practical projects and processes. Critical thinking skills are developed through engagement with creative practical problem-solving activities.
  • Marine and Aquaculture Technology The study of Marine and Aquaculture Technology develops the capacity of students to design, produce, evaluate, use and sustainably manage marine and water-related environments.
  • Technology Mandatory Technology Mandatory engages students in design and production activities as they develop solutions to identified needs and opportunities. Through the practical application of knowledge and understanding they learn about Agriculture and Food Technologies, Digital Technologies, Engineered Systems and Material Technologies.
  • Textiles The study of Textiles Technology provides students with knowledge of the properties, performance and uses of textiles. They explore fabrics, yarns, fibres and colouration. Students examine the historical, cultural and contemporary perspectives on textile design and develop an appreciation of the factors affecting them as textile consumers. Students investigate the work of textile designers and make judgements about the appropriateness of design ideas, the selection of materials and tools, and the quality of textile items. Textile projects give students the opportunity to be creative, independent learners and to explore functional and aesthetic aspects of textiles. The Preliminary course involves the study of design, communication techniques, manufacturing methods, fibres, yarns, fabrics and the Australian Textile, Clothing, Footwear and Allied Industries. Practical experiences, experimenting and product manufacturing are integrated throughout the content areas and include the completion of two preliminary textile projects. These projects develop each student’s creative abilities and skills in designing, manipulating, experimenting and selecting appropriate fabrics for an end use. The HSC course builds upon the Preliminary course and involves the study of fabric colouration and decoration, historical design development, cultural factors that influence design and designers, contemporary designers, end-use applications of textiles, innovations and emerging textile technologies, appropriate…
  • Business Services - VET The course is designed to provide students with appropriate learning opportunities that will enable them to acquire a range of technical, personal and interpersonal skills specifically related to business services but applicable to other service industries and careers. Business services focuses on sectors including, but not exclusive to management and administration; human resource management; sales marketing and advertising; and accounting and finance. 
  • Construction - VET The course is designed to provide students with appropriate learning opportunities that will enable them to acquire a range of technical, personal and interpersonal skills specifically related to the building and construction industry but applicable to other service industries and careers.
  • Hospitality - VET The Hospitality Curriculum Framework is based on qualifications and units of competency contained in the nationally endorsed SIT Tourism, Travel and Hospitality Training Package. The AQF VET qualifications available in the Hospitality Curriculum Framework are: SIT20316 Certificate II in Hospitality SIT20416 Certificate II in Kitchen Operations SIT30816 Certificate III in Commercial Cookery – Statement of Attainment only SIT30916 Certificate III in Catering Operations – Statement of Attainment only.
  • Retail Services - VET The Retail Services – VET course provides students with the opportunity to learn skills to work in a diverse range of retail settings including speciality retailers, supermarkets, department stores and quick service restaurants. Students will learn a range of skills including product and service advice, selling products, stock levels, maintaining work areas and displays, operating registers, finance and payment options, special orders, WHS, stocktaking and damaged goods procedures.
  • Tourism, Travel and Events - VET The Tourism, Travel and Events – VET course provides students with the operational skills and knowledge to manage itineraries, research industry trends and develop professional relationships with clients, colleagues and external partners. This course provides a solid foundation for a career in the retail and wholesale tourism and event sectors, including tour operators, visitor information centres, attractions, cultural and heritage sites, event management companies and event venues.
  • Other - VET Electrotechnology is an informative and practical vocational education and training (VET) subject that introduces students to the exciting world of electrical and electronic systems. This subject provides students with hands-on experiences and essential skills in the field of electrotechnology, preparing them for a variety of career pathways in the electrical industry. In Electrotechnology, students explore the principles and applications of electrical and electronic systems. They learn about circuits, electrical components, wiring regulations, electrical safety, and the principles of energy conversion. Through practical activities, students develop skills in electrical installation, maintenance, troubleshooting, and repair. The study of Electrotechnology equips students with the technical knowledge and practical skills required for entry-level positions in the electrical industry. Students learn to interpret electrical diagrams, use electrical tools and equipment, and apply electrical theories to solve real-world problems. They gain an understanding of the importance of electrical safety practices and regulations, preparing them for safe and responsible work practices in the industry. Electrotechnology also emphasises the integration of technology and sustainability. Students explore renewable energy systems, energy efficiency, and the impact of electrical systems on the environment. They develop an understanding of emerging technologies and the role of electrotechnology in building a sustainable future. Electrotechnology…
  • Assessments
  • Lesson Plans
  • Units/Programs
  • Browse All Resources
  • School Term Planner
  • Key Terms Mastery Bundle
  • Stage 6 Food Technology
  • Online Courses
  • Sell With Us
  • Seller Guide Page
  • Request a Quote/Purchase Order

Home » Blog » Building Critical Thinking Skills in Students

Building critical thinking skills in students

  • February 20, 2024
  • No Comments

Building Critical Thinking Skills in Students

Picture of Shashank Dubey

Shashank Dubey

Critical thinking is the process of actively and skillfully analyzing , synthesizing, and evaluating information, ideas, or arguments to make reasoned and well-informed decisions. It involves the ability to think logically, consider multiple perspectives, and engage in reflective and independent thinking. Critical thinking goes beyond simply accepting or memorizing information; it requires individuals to question assumptions, assess evidence, and draw thoughtful conclusions. This cognitive skill is essential for effective problem-solving, decision-making, and intellectual growth.

Importance of Critical Thinking Skills in Education

Quick links.

Critical thinking skills are crucial in education for several reasons:

  • Enhanced Learning: Students who develop critical thinking skills are better equipped to comprehend complex concepts and engage with academic material more deeply.
  • Problem-Solving: Critical thinking fosters the ability to approach problems systematically, break them down, and develop effective solutions. This skill is valuable in various academic subjects and real-world situations.
  • Analytical Skills: Critical thinking hones analytical skills, allowing students to evaluate information, identify patterns, and draw meaningful connections between ideas.
  • Preparation for the Future: In a rapidly changing world, students need to be adaptable and capable of learning new information independently. Critical thinking enables them to navigate unfamiliar situations and acquire new knowledge effectively.
  • Effective Communication: Critical thinking helps students articulate their thoughts, ideas, and arguments coherently, fostering better communication skills.
  • Informed Decision-Making: The ability to critically assess information and arguments empowers students to make informed decisions, both academically and in their personal lives.

Purpose of Developing Critical Thinking Skills in Students

The development of critical thinking skills in students serves multiple purposes, including:

Empowering Independent Thinkers: Cultivating critical thinking encourages students to think independently, question assumptions, and develop their own perspectives.

Lifelong Learning: Critical thinking is a foundation for lifelong learning, as it equips individuals with the skills needed to continuously acquire new knowledge and adapt to changing circumstances.

Citizenship and Civic Engagement: Critical thinking fosters informed and responsible citizenship by enabling individuals to critically evaluate information, media, and societal issues. It encourages active participation in democratic processes.

Career Readiness: Employers value critical thinking skills because they are essential for problem-solving, decision-making, and innovation in the workplace. Students with strong critical thinking skills are better prepared for the demands of various careers.

Intellectual and Personal Growth: Developing critical thinking skills contributes to intellectual and personal growth by expanding one’s capacity for analysis, reflection, and intellectual curiosity. It enhances a person’s ability to engage with the world in a meaningful way.

Also Read : Emotional Intelligence in Teaching 

Components of Critical Thinking

Analyzing information through these components helps individuals develop a comprehensive understanding of a subject, enabling them to make informed decisions, solve problems, and engage in thoughtful and effective reasoning.

Breaking Down Information

It Involves the ability to break down complex information or problems into simpler parts or elements. Individuals with strong analytical skills can dissect information into its constituent elements to better understand the structure and relationships among different components. For example, Breaking down a scientific experiment into its methods, variables, and outcomes to better comprehend the overall study.

Identifying Key Components

This Entails recognizing the most important and relevant elements within a body of information or a situation. This involves recognizing the central ideas, concepts, or factors that have the most significant impact on the overall understanding or resolution of a problem. For instance, Identifying the main themes in a piece of literature or the key variables in a mathematical equation.

Recognizing Patterns and Relationships

The Recognition of Patterns involves identifying elements, connections, and relationships between different pieces of information. This skill helps individuals see how various elements interact or relate to one another, enabling them to draw meaningful conclusions or predictions. For instance, Recognizing a cause-and-effect relationship in a historical event or identifying trends in data sets through statistical analysis.

developing critical thinking technologies include

Evaluating information through these components is essential for making informed decisions, avoiding misinformation, and developing a well-rounded and evidence-based understanding of complex issues.

  • Involves the critical examination of the credibility and trustworthiness of information sources.
  • Individuals assess the validity and accuracy of data, considering factors such as the author’s expertise, the publication’s reputation, and the methods used to gather information.
  • Entails considering multiple viewpoints or angles on a given issue or topic.
  • Critical thinkers actively seek out diverse opinions and interpretations, fostering a broader understanding of the subject and promoting open-mindedness.
  • Involves drawing conclusions or forming opinions after carefully analyzing relevant evidence.
  • Critical thinkers base their judgments on facts, data, and logical reasoning rather than personal biases or unsupported assumptions.

Inference, as a component of critical thinking, enables individuals to go beyond the explicit information available and draw meaningful conclusions, make informed predictions, and generate innovative ideas.

Drawing Logical Conclusions

  • Involves deriving reasonable and well-founded outcomes from available information.
  • Critical thinkers use deductive or inductive reasoning to make logical connections between premises and conclusions.
  • Entails anticipating future outcomes or events based on existing information and trends.
  • Critical thinkers use their understanding of patterns and relationships to forecast potential developments or consequences.

Connecting Information to Reach New Insights

  • Involves synthesizing disparate pieces of information to form novel understandings or perspectives.
  • Critical thinkers combine existing knowledge in creative ways, leading to the discovery of new insights or solutions to problems.

Problem-solving

Effective problem-solving, a key aspect of critical thinking, requires a combination of analytical skills, creativity, and the ability to evaluate and refine solutions in real-world contexts.

Identifying Problems

  • Involves recognizing and defining issues or challenges that need resolution.
  • Critical thinkers are adept at identifying problems, framing them accurately, and understanding their underlying causes.

Developing Effective Solutions

  • Entails generating viable and well-thought-out strategies to address identified problems.
  • Critical thinkers employ creativity, analysis, and evaluation to come up with solutions that are practical, feasible, and likely to yield positive outcomes.

Implementing and Evaluating Solutions

  • Involves putting the chosen solution into action and assessing its effectiveness.
  • Critical thinkers actively participate in the execution of solutions, monitor progress, and make adjustments as needed to ensure optimal results.

Strategies for Building Critical Thinking Skills

Strategies for Building Critical Thinking Skills

In educational settings, several effective strategies can be employed to cultivate and enhance critical thinking skills among students. One such approach is the implementation of Socratic questioning, a method that encourages thoughtful and reflective inquiry.

By posing open-ended questions, instructors prompt students to delve deeply into a subject, fostering the development of analytical and evaluative thinking. This technique not only stimulates active engagement but also cultivates the ability to question assumptions and consider multiple perspectives.

Another valuable strategy is the incorporation of case studies into the curriculum. By presenting real-world scenarios or complex situations, students are challenged to analyze details, identify key issues, and propose well-reasoned solutions.

This approach not only sharpens analytical and problem-solving skills but also provides a practical application of theoretical knowledge, bridging the gap between academic concepts and real-world challenges.

Additionally, debates and discussions serve as dynamic platforms for honing critical thinking abilities. Engaging in structured debates compels students to articulate and defend their viewpoints, consider opposing arguments, and critically evaluate information. This not only fosters effective communication but also encourages students to approach issues with a comprehensive and discerning mindset.

These classroom activities collectively contribute to the development of critical thinking skills by actively involving students in the learning process. By providing opportunities for independent thinking, analysis, and evaluation, these strategies empower students to navigate complexities, make informed decisions, and approach challenges with a nuanced and thoughtful perspective.

Integration into Curriculum

Efficiently integrating critical thinking into the curriculum involves strategic planning and creative implementation to ensure its seamless incorporation across various subjects. One effective method is through the intentional inclusion of critical thinking elements in lesson plans. Educators can design lessons that explicitly highlight the development of analytical and evaluative skills. This may include structured activities, discussions, or assignments that prompt students to question assumptions, analyze information, and draw reasoned conclusions.

Cross-disciplinary approaches provide another avenue for embedding critical thinking into the curriculum. By emphasizing connections between different subjects, educators can demonstrate the universality of critical thinking skills. For instance, a history lesson might incorporate elements of scientific inquiry, encouraging students to critically evaluate historical evidence.

Real-world applications of concepts further enhance the integration of critical thinking into the curriculum. By presenting students with scenarios that mirror actual challenges in society or professional settings, educators can demonstrate the practical relevance of critical thinking. This approach not only engages students by making learning more meaningful but also prepares them to apply their analytical and problem-solving skills beyond the classroom.

developing critical thinking technologies include

Technology Integration

The incorporation of technology into educational settings offers valuable opportunities to enhance critical thinking skills among students. Here are three effective strategies for integrating technology into the curriculum to foster critical thinking.

Utilizing simulation and interactive learning tools provides students with immersive and engaging experiences that necessitate critical thinking. Virtual simulations allow students to explore complex concepts in a risk-free environment, encouraging them to analyze scenarios, make decisions, and observe the consequences of their choices.

Interactive tools, such as educational games or virtual laboratories, promote active problem-solving and decision-making, fostering the application of critical thinking skills in dynamic and interactive ways.

Integrating collaborative online platforms, such as discussion forums or virtual classrooms, facilitates meaningful interactions among students. These platforms encourage thoughtful discussion, where students can articulate their ideas, respond to diverse perspectives, and collectively explore complex topics.

This collaborative approach not only enhances communication skills but also requires students to think critically about the viewpoints of their peers, fostering a deeper understanding of the subject matter.

Also Read: Healthy Habits for Teachers

Encouraging Divergent Thinking

Divergent thinking involves the generation of a variety of possible solutions or ideas, emphasizing creativity and exploration. Here are three strategies to encourage divergent thinking in educational settings:

Brainstorming Sessions

Creative problem-solving exercises.

Incorporating exercises that require creative problem-solving challenges students to approach issues from various angles. These exercises might involve presenting students with hypothetical scenarios or real-world problems that lack straightforward solutions.

With Engagement in activities that encourage experimentation and exploration, students are prompted to think divergently and consider unconventional approaches to problem-solving.

Open-ended Projects and Assignments

Assigning open-ended projects or tasks allows students the freedom to explore topics in depth and approach them from different perspectives. Instead of providing strict guidelines, educators can encourage students to define their own goals and methods, fostering autonomy and creativity.

Open-ended projects provide the space for students to express original ideas, solutions, or interpretations, cultivating a mindset of divergent thinking.

developing critical thinking technologies include

Assessing Critical Thinking Skills

To effectively evaluate and nurture critical thinking skills, educators often employ formative assessment strategies that provide ongoing feedback and insight into students’ thought processes. Class discussions serve as a dynamic form of assessment, offering opportunities for students to articulate their ideas, engage with diverse perspectives, and think critically in real-time.

These discussions not only gauge students’ comprehension but also assess their ability to analyze, evaluate, and contribute meaningfully to the conversation.

Group activities represent another form of formative assessment, enabling educators to observe how students collaborate, share ideas, and collectively problem-solve. By participating in group tasks, students showcase their ability to think critically within a collaborative setting, demonstrating skills such as communication, teamwork, and the integration of diverse perspectives.

Written reflections provide a reflective avenue for students to articulate their thoughts, analyze their learning experiences, and express their understanding of a subject matter.

This form of formative assessment allows educators to gain insight into students’ individual thought processes, their capacity for self-assessment, and their ability to connect information to form reasoned conclusions.

Incorporating class discussions, group activities, and written reflections into the formative assessment process offers a comprehensive view of students’ critical thinking skills. These strategies not only evaluate cognitive abilities but also contribute to the ongoing development of these skills, fostering a learning environment that prioritizes analytical thinking, effective communication, and collaborative problem-solving.

Common Challenges and Solutions

Common Challenges and Solutions

By acknowledging these challenges and implementing targeted solutions, educators and institutions can work towards creating an environment that fosters the development of critical thinking skills, ultimately preparing students for success in a rapidly changing and complex world. Here are some of the commonly faced issues when it comes to developing critical thinking skills in your students

Resistance to Critical Thinking

One common challenge in promoting critical thinking is the resistance students may exhibit. Some students may be accustomed to rote memorization or may find critical thinking demands unfamiliar and uncomfortable. Additionally, educators may face resistance from traditional teaching methods or institutional expectations that prioritize standardized testing over critical thinking development.

Lack of Resources

Insufficient resources, both in terms of materials and professional development opportunities, can hinder the effective integration of critical thinking into the curriculum. Limited access to updated educational materials, technology, and training for educators may impede efforts to implement innovative and engaging teaching strategies that foster critical thinking skills.

Time Constraints

Time constraints within the academic schedule can pose a significant challenge. Traditional curricula often prioritize content coverage over the development of critical thinking skills. Educators may feel pressure to adhere to tight schedules, leaving little room for the exploration and in-depth analysis required for robust critical thinking activities.

Potential Solutions

Addressing resistance involves creating a positive and supportive learning environment that emphasizes the value and relevance of critical thinking skills. Educators can gradually introduce critical thinking concepts, providing clear explanations and examples. Additionally, incorporating interactive and engaging activities can help make critical thinking more accessible and enjoyable for students.

Overcoming resource limitations requires a multi-faceted approach. Educators and institutions can seek grants or funding opportunities to invest in updated materials and technology. Professional development programs can empower teachers with the skills and knowledge needed to effectively integrate critical thinking into their lessons. Collaborative efforts among educators and institutions can also help share resources and best practices.

Integrating critical thinking into the curriculum may require a reevaluation of priorities. Educators can collaborate to identify key concepts that lend themselves to critical thinking activities and find ways to seamlessly incorporate them into existing lessons. Additionally, schools can explore flexible scheduling options, allowing for dedicated time for critical thinking activities or projects.

Also Read: Flexible Teaching : Adapting Strategies for Well Being

Final Words

In a nutshell critical thinking abilities are vital for students because they go beyond passive recall and promote active interaction with the material, which develops analytical, evaluative, and problem-solving skills. The elements of critical thinking—analysis, assessment, speculation, and problem-solving—advance learning, facilitate clear communication, and help students make well-informed decisions that will prepare them for both current and future challenges.

Teachers can use a variety of techniques, such as Socratic questioning and technological integration, to foster these abilities in the classroom.

Critical thinking exercises and group conversations are two effective ways to assess students’ critical thinking skills. A proactive and cooperative strategy can create an environment that prioritizes the development of critical thinking, ultimately equipping students for success in a world that is changing quickly, even in the face of obstacles like opposition and resource limitations.

Interesting Reads

Innovative Teaching Strategies for Digital Age

Integrating Project Based Learning in your Curriculum

The Role of Sleep in Teacher Well Being

Feeling Triggered: What it means and how to deal with it 

Related Posts

Checking vs. Savings Accounts

Checking vs. Savings Accounts

Types Of Dyslexia

What Are The Types Of Dyslexia?

Scholastic Dollar Books

Best Scholastic Dollar Books Of 2024

Paraprofessional

Who Is Paraprofessional?

TPD_LOGO_White_RGB-01-e1620969807811.png

ABN 83 169 689 187 Edconnect Vendor No: 0100340524

developing critical thinking technologies include

  • Request a Quote for a PO
  • My Subscriptions

About tpd edu

  • Seller Guide
  • PayPal Pay in 4
  • Privacy Policy
  • Terms and Conditions

Login to your account

developing critical thinking technologies include

Information

  • Author Services

Initiatives

You are accessing a machine-readable page. In order to be human-readable, please install an RSS reader.

All articles published by MDPI are made immediately available worldwide under an open access license. No special permission is required to reuse all or part of the article published by MDPI, including figures and tables. For articles published under an open access Creative Common CC BY license, any part of the article may be reused without permission provided that the original article is clearly cited. For more information, please refer to https://www.mdpi.com/openaccess .

Feature papers represent the most advanced research with significant potential for high impact in the field. A Feature Paper should be a substantial original Article that involves several techniques or approaches, provides an outlook for future research directions and describes possible research applications.

Feature papers are submitted upon individual invitation or recommendation by the scientific editors and must receive positive feedback from the reviewers.

Editor’s Choice articles are based on recommendations by the scientific editors of MDPI journals from around the world. Editors select a small number of articles recently published in the journal that they believe will be particularly interesting to readers, or important in the respective research area. The aim is to provide a snapshot of some of the most exciting work published in the various research areas of the journal.

Original Submission Date Received: .

  • Active Journals
  • Find a Journal
  • Proceedings Series
  • For Authors
  • For Reviewers
  • For Editors
  • For Librarians
  • For Publishers
  • For Societies
  • For Conference Organizers
  • Open Access Policy
  • Institutional Open Access Program
  • Special Issues Guidelines
  • Editorial Process
  • Research and Publication Ethics
  • Article Processing Charges
  • Testimonials
  • Preprints.org
  • SciProfiles
  • Encyclopedia

education-logo

Article Menu

developing critical thinking technologies include

  • Subscribe SciFeed
  • Recommended Articles
  • Google Scholar
  • on Google Scholar
  • Table of Contents

Find support for a specific problem in the support section of our website.

Please let us know what you think of our products and services.

Visit our dedicated information section to learn more about MDPI.

JSmol Viewer

Developing critical thinking in technical and vocational education and training.

developing critical thinking technologies include

1. Introduction

2. materials and methods, 2.1. operationalization of definition of critical thinking, 2.2. experimental design, 2.3. creating a methodology for developing critical thinking.

  • Use of multimedia in class: Allow students to work with different types of discourse, whether text, videos, images, audio, animations, or others. These are tools that help students develop concepts, analytical reasoning, creative thinking, problem solving and critical thinking [ 47 ]. Such resources should be brief and concrete so that the students do not become distracted.
  • Working with controversial or real-world topics: To boost student interest and engagement, there must be strong social relationships between the teacher and students, as well as suitable rules for interaction and the facilitation of debate [ 48 ]. This relationship can be strengthened in class by addressing topics that are controversial or from real-life situations, as there is evidence suggesting that a real-world connection can be an effective methodology for developing critical thinking [ 26 ]. Controversial topics were proposed because exposing students to opportunities for dialogue is also an effective way of developing critical thinking [ 34 ]. Even though it can polarize students, it is also an opportunity for them to consider alternative perspectives [ 49 ], which may also be directly related to the evaluation sub-skill in or definition of critical thinking.
  • Introducing peer discussion routines: Peer discussion promotes the development of critical thinking [ 50 ].
  • Reflective questions and higher-order thinking: There is a need for reflective questions, which go beyond basic recall and instead promote metacognition on current topics [ 51 ].
  • Using low-cost technology: Simple, open-access technology was used to promote student participation. The class poll system Plickers was used [ 52 ], where students answer using a preprinted QR code that is scanned by the teacher’s cellphone.
  • Icebreaker or “Do it now!”: A short activity to introduce the main topic of the class in no more than 5 min. Icebreakers are an effective way of boosting student engagement [ 53 ] as they improve enthusiasm and help get the attention of the class [ 54 ].
  • Sharing the lesson objective: A short activity of no more than 2 min to explain the expected learning outcomes for the lesson.
  • Presentation of content: In no more than 5 min, the content is presented to the class.
  • Practice: Practical exercises to consolidate the newly-acquired knowledge and relate it to one of the sub-skills of critical thinking based on different texts, images, or videos, in groups or individually. After each practice, a Plickers activity is performed based on the content and the aforementioned sub-skill.
  • Focus on grammar: A short section of no longer than 8 min focusing on grammar. The main aim is to measure the sub-skill of evaluation and provide space for teaching grammar, a core element of the course.
  • Turn and discuss: A section for talking about a controversial point from the class. The students are asked an open-ended question and must then reflect on it both individually and with a peer.
  • Metacognitive routine: A concluding section in which the students go through a metacognitive routine based on an activity or item of content from the class.

2.4. Instruments for Measuring Critical Thinking and Learning

2.5. teacher surveys, 2.6. data analysis, 2.6.1. quantitative analysis, 2.6.2. qualitative analysis, 3.1. instrument validation, 3.2. differences between pre- and post-tests, 3.3. teacher survey results, 4. discussion, 5. conclusions, supplementary materials, author contributions, institutional review board statement, informed consent statement, data availability statement, acknowledgments, conflicts of interest, appendix a. comprehensive list of critical thinking assessment instruments.

California Critical Thinking Disposition Inventory (CCTDI)This test contains seven scales of critical thinking: (a) truth-seeking, (b) open-mindedness, (c) analyticity, (d) systematicity, (e) confidence in reasoning, (f) inquisitiveness, and (g) maturity of judgment.[ ]
California Critical Thinking Skills Test (CCTST)The CCTST returns scores on the following scales: (a) analysis, (b) evaluation, (c) inference, (d) deduction, (e) induction, and (f) overall reasoning skills [ ][ ]
California Measure of Mental Motivation (CM3)This assessment measures and reports scores on the following areas: (a) learning orientation, (b) creative problem solving, (c) cognitive integrity, (d) scholarly rigor, and (e) technological orientation (Insight Assessment, 2013).[ ]
Collegiate Assessment of Academic Proficiency (CAAP) Critical ThinkingThe CAAP Critical Thinking measures students’ skills in analyzing elements of an argument, evaluating an argument, and extending arguments.[ ]
Collegiate Learning Assessment+ (CLA+)The CLA+PTs measure higher order skills including: (a) analysis and problem solving, (b) writing effectiveness, and (c) writing mechanics. The MC items assess (a) scientific and quantitative reasoning, (b) critical reading and evaluation, and (c) critiquing an argument.[ ]
Ennis–Weir Critical Thinking Essay TestThis assessment measures the following areas of the critical thinking competence: (a) getting the point, (b) seeing reasons and assumptions, (c) stating one’s point, (d) offering good reasons, (e) seeing other possibilities, and (f) responding appropriately to and/or avoiding argument weaknesses.[ ]
ETS Proficiency Profile (EPP) Critical ThinkingThe Critical Thinking sub-skill of this test measures a student’s ability to: (a) distinguish between rhetoric and argumentation in a piece of nonfiction prose, (b) recognize assumptions and the best hypothesis to account for information presented, (c) infer and interpret a relationship between variables, and (d) draw valid conclusions based on information presented (ETS, 2010).[ ]
Halpern Critical Thinking Assessment (HCTA)This test measures five critical thinking subskills: (a) verbal reasoning skills, (b) argument and analysis skills, (c) skills in thinking as hypothesis testing, (d) using likelihood and uncertainty, and (e) decision-making and problem-solving skills.[ ]
Watson–Glaser Critical Thinking Appraisal tool (WGCTA) StandardThe WGCTA is composed of five tests: (a) inference, (b) recognition of assumptions, (c) deduction, (d) interpretation, and (e) evaluation of arguments. Each test contains both neutral and controversial reading passages and scenarios encountered at work, in the classroom, and in the media. Although there are five tests, only the total score is reported.[ ]
WGCTA Short Form and WGCTA IIMeasures and provides interpretable subscores for three critical thinking skill domains that are both contemporary and business relevant, including the ability to: (a) recognize assumptions, (b) evaluate arguments, and (c) draw conclusions.[ ]
Critical thinking test in electricity and magnetism (CTEM) In the context of Electricity and Magnetism, the student will be able to conduct reasoning, argument analysis, hypothesis testing, likelihood and uncertainty analysis, and decision-making and problem-solving.[ ]
HEIghtenTM critical thinking assessment
(HE)
Two central aspects: [ ]
Danczak–Overton–Thompson Chemistry Critical Thinking Test (DOT)The core principles of critical thinking divided into five sections: inference, assumption identification, deduction, interpreting information, and evaluation of arguments (based on Watson-Glaser Critical Thinking Appraisal (WGCTA).[ ]
Critical and Creative Thinking Test for Portuguese young adults [Teste do Pensamento Crítico e Criativo (TPCC)]For critical thinking, a combination of what is proposed in Bloom and Facione’s taxonomies is used. In specific, the questions are constructed from these skills: interpretation, analysis, explanation, evaluation, summarize, and to produce/create.[ ]
Australian nursing critical thinking tool
(ANCTT)
Different real-life scenarios (in a nursing context), where questions are made based on reasoning and analysis. There’s no further information about the critical thinking construct used in this assessment.[ ]
The Critical Thinking Assessment Test (CAT)Four core domains: (a) evaluation of information, (b) evaluation of ideas and other points of view, (c) learning and problem solving, and (d) communication of ideas.[ ]
Physics Critical Thinking Skill Test (PhysCriTS)Related to critical thinking, several abilities are mentioned: (1) recognizing the problem; (2) finding ways that can be used to solve problems; (3) collecting and compiling necessary information; (4) understanding and using appropriate language, analyzing data, assessing facts, and evaluating statements; (5) recognizing a logical relationship between problems; (6) drawing the necessary conclusions and similarities; (7) examining the similarities and conclusions.[ ]
PAL task “Wind Turbine”Evaluating and using information according to trustworthiness, relevance, and judgmental error or bias proneness of sources.
Recognizing, evaluating, integrating, and structuring arguments and their sub-skills (such as claims, support, beliefs, assumptions, or facts) in response.
Recognizing and evaluating consequences of decision-making and actions.
Taking communicative action appropriate to deliver results in line with the task prompt, i.e., making an evaluative judgment, explaining a decision, recommending a course of action, suggesting a problem solution, etc.
[ ]
Critical thinking instrument of electricityThe test considers six indicators of critical thinking: (1) focus on the question, (2) analyze arguments, (3) consider whether the source is reliable or not, (4) induce and consider the results of induction, (5) identify assumptions, and (6) take action.[ ]
Statistics Critical
Thinking Test (SCTT)
In the context of Basic Statistics, the instrument consists of two subtests consisting of interpretation and evaluation. [ ]

Appendix B. Detailed Description of the Pre and Post-Test and Their Items Characteristics

Pre-TestMC04_1MetacognitionConstructed ResponseAutomatic Scoring30 s Publicity Advertisement
Pre-TestMC04_2MetacognitionConstructed ResponseShort Constructed Response30 s Publicity Advertisement
Pre-TestMC05MetacognitionConstructed ResponseShort Constructed Response30 s Publicity Advertisement
Pre-TestMC06MetacognitionConstructed ResponseShort Constructed Response30 s Publicity Advertisement
Pre-TestMC07MetacognitionConstructed ResponseAutomatic Scoring30 s Publicity Advertisement
Pre-TestMC08MetacognitionConstructed ResponseShort Constructed Response30 s Publicity Advertisement
Pre-TestAD09AnalysisMultiple ChoiceShort Constructed ResponseInformative Text
Pre-TestIA10InferenceMultiple ChoiceMultiple ChoiceInformative Text
Pre-TestIR11InterpretationMultiple ChoiceMultiple ChoiceInformative Text
Pre-TestIR12InterpretationMultiple ChoiceMultiple ChoiceInformative Text
Pre-TestAD13AnalysisMultiple ChoiceMultiple ChoiceInformative Text
Pre-TestAR14_IIArgumentationConstructed ResponseMultiple ChoiceInformative Text
Pre-TestAR14_IIIArgumentationConstructed ResponseShort EssayInformative Text
Pre-TestAR14_IVArgumentationConstructed ResponseShort EssayInformative Text
Pre-TestAR14_VArgumentationConstructed ResponseShort EssayInformative Text
Pre-TestIC15InferenceMultiple ChoiceShort EssayShort Story
Pre-TestEV16EvaluationMultiple ChoiceMultiple ChoiceShort Story
Pre-TestIA17InferenceMultiple ChoiceMultiple ChoiceShort Story
Pre-TestIC18InferenceMultiple ChoiceMultiple ChoiceShort Story
Pre-TestAA19AnalysisMultiple ChoiceMultiple ChoiceShort Story
Pre-TestAAIC20InferenceMultiple ChoiceMultiple ChoiceShort Story
Pre-TestAA21AnalysisMultiple ChoiceMultiple ChoiceShort Story
Pre-TestECO22EvaluationMultiple ChoiceMultiple ChoiceShort Story
Pre-TestECR23EvaluationMultiple ChoiceMultiple ChoiceShort Story
Pre-TestECO24EvaluationMultiple ChoiceMultiple ChoiceShort Story
Pre-TestIT26InterpretationMultiple ChoiceMultiple ChoiceInfographic
Pre-TestAOIT27AnalysisMultiple ChoiceMultiple ChoiceInfographic
Pre-TestECOIT28EvaluationConstructed ResponseMultiple ChoiceInfographic
Pre-TestECO29EvaluationMultiple ChoiceShort Constructed ResponseInfographic
Pre-TestIA30InferenceMultiple ChoiceMultiple ChoiceInfographic
Pre-TestEOIA31EvaluationMultiple ChoiceMultiple ChoiceInfographic
Post-TestMC03MetacognitionConstructed ResponseMultiple Choice30 s Publicity Advertisement
Post-TestMC04MetacognitionConstructed ResponseShort Constructed Response30 s Publicity Advertisement
Post-TestMC05_1MetacognitionConstructed ResponseAutomatic Scoring30 s Publicity Advertisement
Post-TestMC05_2MetacognitionConstructed ResponseShort Constructed Response30 s Publicity Advertisement
Post-TestMC06MetacognitionConstructed ResponseShort Constructed Response30 s Publicity Advertisement
Post-TestMC07MetacognitionConstructed ResponseShort Constructed Response30 s Publicity Advertisement
Post-TestMC08_1MetacognitionConstructed ResponseAutomatic Scoring30 s Publicity Advertisement
Post-TestMC08_2MetacognitionConstructed ResponseShort Constructed Response30 s Publicity Advertisement
Post-TestIR09InterpretationMultiple ChoiceMultiple ChoiceInformative Text
Post-TestIR10InterpretationMultiple ChoiceMultiple ChoiceInformative Text
Post-TestIR11InterpretationMultiple ChoiceMultiple ChoiceInformative Text
Post-TestIT12InterpretationMultiple ChoiceMultiple ChoiceInfographic
Post-TestIT13InterpretationMultiple ChoiceMultiple ChoiceInfographic
Post-TestIT14InterpretationMultiple ChoiceMultiple ChoiceInfographic
Post-TestAR15_IArgumentationConstructed ResponseShort EssayInformative Text and Infographic
Post-TestAR15_IIArgumentationConstructed ResponseShort EssayInformative Text and Infographic
Post-TestAR15_IIIArgumentationConstructed ResponseShort EssayInformative Text and Infographic
Post-TestAR15_IVArgumentationConstructed ResponseShort EssayInformative Text and Infographic
Post-TestAR15_VArgumentationConstructed ResponseShort EssayInformative Text and Infographic
Post-TestIC16InferenceMultiple ChoiceMultiple ChoiceShort Story
Post-TestIC17InferenceMultiple ChoiceMultiple ChoiceShort Story
Post-TestIC18InferenceMultiple ChoiceMultiple ChoiceShort Story
Post-TestIC19InferenceMultiple ChoiceMultiple ChoiceShort Story
Post-TestIC20InferenceMultiple ChoiceMultiple ChoiceShort Story
Post-TestIC21InferenceMultiple ChoiceMultiple ChoiceShort Story
Post-TestAD23AnalysisMultiple ChoiceMultiple ChoiceOpinion Column
Post-TestAD24AnalysisMultiple ChoiceMultiple ChoiceOpinion Column
Post-TestAD25AnalysisMultiple ChoiceMultiple ChoiceOpinion Column
Post-TestAD26AnalysisMultiple ChoiceMultiple ChoiceOpinion Column
Post-TestAD27AnalysisMultiple ChoiceMultiple ChoiceOpinion Column
Post-TestAD28AnalysisMultiple ChoiceMultiple ChoiceOpinion Column
Post-TestAD29AnalysisMultiple ChoiceMultiple ChoiceOpinion Column
Post-TestEV30EvaluationMultiple ChoiceMultiple ChoiceGrammar
Post-TestEV31EvaluationMultiple ChoiceMultiple ChoiceGrammar
Pre-TestMC04_10.700.40Not eliminated
Pre-TestMC04_20.620.35Not eliminated
Pre-TestMC050.600.36Not eliminated
Pre-TestMC060.210.24Not eliminated
Pre-TestMC07_10.360.23Not eliminated
Pre-TestMC07_20.550.44Not eliminated
Pre-TestMC080.580.36Not eliminated
Pre-TestAD090.800.27Not eliminated
Pre-TestIA100.810.25Not eliminated
Pre-TestIR110.940.25Eliminated for having a difficulty that is not in the 0.1–0.9 range
Pre-TestIR120.920.30Eliminated for having a difficulty that is not in the 0.1–0.9 range
Pre-TestAD130.720.26Not eliminated
Pre-TestAR14_II0.710.33Not eliminated
Pre-TestAR14_III0.670.41Not eliminated
Pre-TestAR14_IV0.380.42Not eliminated
Pre-TestAR14_V0.240.44Not eliminated
Pre-TestIC150.590.27Not eliminated
Pre-TestEV160.620.22Not eliminated
Pre-TestIA170.810.30Not eliminated
Pre-TestIC180.780.21Not eliminated
Pre-TestAA190.880.23Not eliminated
Pre-TestAAIC200.450.27Not eliminated
Pre-TestAA210.610.28Not eliminated
Pre-TestECO220.420.26Not eliminated
Pre-TestECR230.560.34Not eliminated
Pre-TestECO240.700.19Not eliminated
Pre-TestIT260.850.32Not eliminated
Pre-TestAOIT270.440.37Not eliminated
Pre-TestECOIT280.220.28Not eliminated
Pre-TestECO290.640.28Not eliminated
Pre-TestIA300.410.09Eliminated for having discrimination lower than 0.1
Pre-TestEOIA310.420.33Not eliminated
Post-TestMC040.450.29Not eliminated
Post-TestMC05_10.720.21Not eliminated
Post-TestMC05_20.500.27Not eliminated
Post-TestMC060.270.25Not eliminated
Post-TestMC070.500.19Not eliminated
Post-TestMC08_10.710.42Not eliminated
Post-TestMC08_20.080.13Eliminated for having a difficulty that is not in the 0.1–0.9 range
Post-TestIR090.720.39Not eliminated
Post-TestIR100.920.31Eliminated for having a difficulty that is not in the 0.1–0.9 range
Post-TestIR110.670.39Not eliminated
Post-TestIT120.860.27Not eliminated
Post-TestIT130.850.47Not eliminated
Post-TestIT140.870.38Not eliminated
Post-TestAR15_I0.710.49Eliminated for being a Heywood case (factor loading greater than 1)
Post-TestAR15_II0.610.50Not eliminated
Post-TestAR15_III0.540.49Not eliminated
Post-TestAR15_IV0.330.49Not eliminated
Post-TestAR15_V0.280.48Not eliminated
Post-TestIC160.640.28Not eliminated
Post-TestIC170.670.27Not eliminated
Post-TestIC180.560.32Not eliminated
Post-TestIC190.630.48Not eliminated
Post-TestIC200.890.38Not eliminated
Post-TestIC210.950.36Eliminated for having a difficulty that is not in the 0.1–0.9 range
Post-TestAD230.370.14Not eliminated
Post-TestAD240.660.33Not eliminated
Post-TestAD250.510.34Not eliminated
Post-TestAD260.550.26Not eliminated
Post-TestAD270.860.38Not eliminated
Post-TestAD280.790.35Not eliminated
Post-TestAD290.720.32Not eliminated
Post-TestEV300.940.29Eliminated for having a difficulty that is not in the 0.1–0.9 range
Post-TestEV310.730.22Not eliminated
Post-TestEV320.930.37Eliminated for having a difficulty that is not in the 0.1–0.9 range
  • UNESCO-UNEVOC. Technical and vocational education and training (TVET). TVETipedia Glossary. 2023. Available online: https://unevoc.unesco.org/home/TVETipedia+Glossary/lang=en/filt=all/id=474 (accessed on 12 February 2023).
  • Schröder, T. A regional approach for the development of TVET systems in the light of the 4th industrial revolution: The regional association of vocational and technical education in Asia. Int. J. Train. Res. 2019 , 17 , 83–95. [ Google Scholar ] [ CrossRef ] [ Green Version ]
  • de Otero, G.; Paul, J. Innovation in TVET: UNESCO-UNEVOC Trends Mapping. UNESCO-UNEVOC International Centre for Technical and Vocational Education and Training. 2019. Available online: https://files.eric.ed.gov/fulltext/ED599543.pdf (accessed on 12 February 2023).
  • Lambriex-Schmitz, P.; Van der Klink, M.R.; Beausaert, S.; Bijker, M.; Segers, M. Towards successful innovations in education: Development and validation of a multi-dimensional Innovative Work Behaviour Instrument. Vocat. Learn. 2020 , 13 , 313–340. [ Google Scholar ] [ CrossRef ] [ Green Version ]
  • González-Pérez, L.I.; Ramírez-Montoya, M.S. Components of Education 4.0 in 21st Century Skills Frameworks: Systematic Review. Sustainability 2022 , 14 , 1493. [ Google Scholar ] [ CrossRef ]
  • Giacomazzi, M.; Fontana, M.; Trujillo, C.C. Contextualization of critical thinking in sub-Saharan Africa: A systematic integrative review. Think. Ski. Creat. 2022 , 43 , 100978. [ Google Scholar ] [ CrossRef ]
  • Nugraha, H.D.; Kencanasari, R.A.V.; Komari, R.N.; Kasda, K. Employability Skills in Technical Vocational Education and Training (TVET). Innov. Vocat. Technol. Educ. 2020 , 16 , 1–10. [ Google Scholar ] [ CrossRef ]
  • Rönnlund, M.; Ledman, K.; Nylund, M.; Rosvall, P. Life skills for ‘real life’: How critical thinking is contextualised across vocational programmes. Educ. Res. 2019 , 61 , 302–318. [ Google Scholar ] [ CrossRef ]
  • Salleh, K.M.; Sulaiman, N.L. Reforming Technical and Vocational Education and Training (TVET) on Workplace Learning and Skills Development. Int. J. Recent Technol. Eng. 2020 , 8 , 2964–2967. [ Google Scholar ] [ CrossRef ]
  • E Ismail, M.; Sa’adan, N.; A Samsudin, M.; Hamzah, N.; Razali, N.; I Mahazir, I. Implementation of The Gamification Concept Using KAHOOT! Among TVET Students: An Observation. J. Phys. Conf. Ser. 2018 , 1140 , 012013. [ Google Scholar ] [ CrossRef ]
  • Sulaiman, N.L.; Salleh, K.M.; Mohamad, M.M.; Sern, L.C. Strengthening the usage of useful critical thinking and problem solving in knowledge dissemination among tvet educators in malaysia. In ICERI2015 Proceedings, Proceedings of the 8th International Conference of Education, Research and Innovation, Seville, Spain, 16–18 November 2015 ; IATED: Seville, Spain, 2015; pp. 7603–7610. [ Google Scholar ]
  • Okolie, U.C.; Ogwu, E.N.; Osuji, C.U.; Ogba, F.N.; Igwe, P.A.; Obih, S.O. A critical perspective on TVET teachers’ pedagogical practices: Insights into the guiding pedagogical principles in practice. J. Vocat. Educ. Train. 2021 , 1–20. [ Google Scholar ] [ CrossRef ]
  • Paul, R.; Elder, L. The Miniature Guide to Critical Thinking Concepts and Tools ; Rowman & Littlefield: Lanham, MD, USA, 2019. [ Google Scholar ]
  • Aktoprak, A.; Hursen, C. A bibliometric and content analysis of critical thinking in primary education. Think. Ski. Creat. 2022 , 44 , 101029. [ Google Scholar ] [ CrossRef ]
  • Facione, P.A. Critical Thinking: A Statement of Expert Consensus for Purposes of Educational Assessment and Instruction ; The California Academic Press: Millbrae, CA, USA, 1990; Volume 423, pp. 1–19. [ Google Scholar ] [ CrossRef ]
  • O’Reilly, C.; Devitt, A.; Hayes, N. Critical thinking in the preschool classroom—A systematic literature review. Think. Ski. Creat. 2022 , 46 , 101110. [ Google Scholar ] [ CrossRef ]
  • Brečka, P.; Valentová, M.; Lančarič, D. The implementation of critical thinking development strategies into technology education: The evidence from Slovakia. Teach. Teach. Educ. 2022 , 109 , 103555. [ Google Scholar ] [ CrossRef ]
  • Tommasi, F.; Ceschi, A.; Sartori, R.; Gostimir, M.; Passaia, G.; Genero, S.; Belotto, S. Enhancing critical thinking and media literacy in the context of IVET: A systematic scoping review. Eur. J. Train. Dev. 2021 , 47 , 85–104. [ Google Scholar ] [ CrossRef ]
  • Ivancu, O.; Kriaučiūnienė, R.; Poštič, S. Implementation of the Critical Thinking Blended Apprenticeship Curricula and Findings per Discipline: Foreign Language Teaching. Educ. Sci. 2023 , 13 , 208. [ Google Scholar ] [ CrossRef ]
  • Zuurmond, A.; Guérin, L.; van der Ploeg, P.; van Riet, D. Learning to question the status quo. Critical thinking, citizenship education and Bildung in vocational education. J. Vocat. Educ. Train. 2023 , 1–20. [ Google Scholar ] [ CrossRef ]
  • Tiruneh, D.T.; De Cock, M.; Elen, J. Designing Learning Environments for Critical Thinking: Examining Effective Instructional Approaches. Int. J. Sci. Math. Educ. 2017 , 16 , 1065–1089. [ Google Scholar ] [ CrossRef ] [ Green Version ]
  • Okolie, U.C.; Igwe, P.A.; Mong, I.K.; Nwosu, H.E.; Kanu, C.; Ojemuyide, C.C. Enhancing students’ critical thinking skills through engagement with innovative pedagogical practices in Global South. High. Educ. Res. Dev. 2021 , 41 , 1184–1198. [ Google Scholar ] [ CrossRef ]
  • Dimitru, D.; Bigu, D.; Elen, J.; Ahern, A.; McNally, C.; O’Sullivan, J. A European review on Critical Thinking Educational Practices in Higher Education Institutions. 2018. Available online: https://researchrepository.ucd.ie/entities/publication/46eee7d1-5389-46e5-b005-0632229d3f24/details (accessed on 12 February 2023).
  • Kusumoto, Y. Enhancing critical thinking through active learning. Lang. Learn. High. Educ. 2018 , 8 , 45–63. [ Google Scholar ] [ CrossRef ]
  • Snyder, S.; Edwards, L.; Sanders, A. An Empirical Model for Infusing Critical Thinking into Higher Education. J. Excell. Coll. Teach 2019 , 30 , 127–156. [ Google Scholar ]
  • Bezanilla, M.J.; Fernández-Nogueira, D.; Poblete, M.; Galindo-Domínguez, H. Methodologies for teaching-learning critical thinking in higher education: The teacher’s view. Think. Ski. Creat. 2019 , 33 , 100584. [ Google Scholar ] [ CrossRef ]
  • Bonnes, C.; Hochholdinger, S. Approaches to Teaching in Professional Training: A Qualitative Study. Vocat. Learn. 2020 , 13 , 459–477. [ Google Scholar ] [ CrossRef ] [ Green Version ]
  • Jossberger, H.; Brand-Gruwel, S.; van de Wiel, M.W.J.; Boshuizen, H. Learning in Workplace Simulations in Vocational Education: A Student Perspective. Vocat. Learn. 2017 , 11 , 179–204. [ Google Scholar ] [ CrossRef ]
  • Pilz, M.; Wiemann, K. Does Dual Training Make the World Go Round? Training Models in German Companies in China, India and Mexico. Vocat. Learn. 2020 , 14 , 95–114. [ Google Scholar ] [ CrossRef ]
  • Akour, M.; Alenezi, M. Higher Education Future in the Era of Digital Transformation. Educ. Sci. 2022 , 12 , 784. [ Google Scholar ] [ CrossRef ]
  • Bex, F.; Walton, D. Combining explanation and argumentation in dialogue. Argum. Comput. 2016 , 7 , 55–68. [ Google Scholar ] [ CrossRef ] [ Green Version ]
  • Garrison, D.; Akyol, Z. Toward the development of a metacognition construct for communities of inquiry. Internet High. Educ. 2015 , 24 , 66–71. [ Google Scholar ] [ CrossRef ]
  • Roebers, C.M.; Roebers, C.M. Executive function and metacognition: Towards a unifying framework of cognitive self-regulation. Dev. Rev. 2017 , 45 , 31–51. [ Google Scholar ] [ CrossRef ]
  • Abrami, P.C.; Bernard, R.M.; Borokhovski, E.; Waddington, D.I.; Wade, C.A.; Persson, T. Strategies for Teaching Students to Think Critically. Rev. Educ. Res. 2015 , 85 , 275–314. [ Google Scholar ] [ CrossRef ]
  • Dumitru, D. Creating meaning. The importance of Arts, Humanities and Culture for critical thinking development. Stud. High. Educ. 2019 , 44 , 870–879. [ Google Scholar ] [ CrossRef ]
  • Parkinson, J.; Mackay, J.; Demecheleer, M. Situated Learning in Acquisition of a Workplace Genre. Vocat. Learn. 2017 , 11 , 289–315. [ Google Scholar ] [ CrossRef ]
  • van Laar, E.; van Deursen, A.J.A.M.; van Dijk, J.A.G.M.; de Haan, J. Determinants of 21st-Century Skills and 21st-Century Digital Skills for Workers: A Systematic Literature Review. Sage Open 2020 , 10 , 2158244019900176. [ Google Scholar ] [ CrossRef ] [ Green Version ]
  • Rear, D. Critical Thinking and Problem-Solving in Foreign Language Teaching. In Advancing English Language Education ; Zayed University Press: Dubai, United Arab Emirates, 2020; p. 263. [ Google Scholar ]
  • Ennis, R.H. Critical Thinking and Subject Specificity: Clarification and Needed Research. Educ. Res. 1989 , 18 , 4–10. [ Google Scholar ] [ CrossRef ]
  • Merrill, D. First principles of instruction. Educ. Technol. Res. Dev. 2002 , 50 , 43–59. [ Google Scholar ] [ CrossRef ]
  • Nguyen, H.C. Factors Influencing Student Engagement In Higher Education Context. In Proceedings of the EDULEARN 2019, 11th International Conference on Education and New Learning Technologies, Palma, Spain, 1–3 July 2019; pp. 1089–1096. [ Google Scholar ] [ CrossRef ]
  • Yim, S.; Yoon, M.; Kim, H. The Relationships of Grit, Critical Thinking Disposition, Self-Efficacy, and Communication Competency among Nursing Students. Int. J. Pure Appl. Math. 2018 , 118 , 701–708. [ Google Scholar ]
  • Quintero, V.L.; Palet, J.E.A.; Olivares, D.S.L.O. Desarrollo del pensamiento crítico mediante la aplicación del Aprendizaje Basado en Problemas. Psicol. Esc. E Educ. 2017 , 21 , 65–77. [ Google Scholar ] [ CrossRef ]
  • Barkley, E.F.; Major, C.H. Student Engagement Techniques: A Handbook for College Faculty ; John Wiley & Sons: Hoboken, NJ, USA, 2020. [ Google Scholar ]
  • Heflin, H.; Shewmaker, J.; Nguyen, J. Impact of mobile technology on student attitudes, engagement, and learning. Comput. Educ. 2017 , 107 , 91–99. [ Google Scholar ] [ CrossRef ]
  • Vong, S.A.; Kaewurai, W. Instructional model development to enhance critical thinking and critical thinking teaching ability of trainee students at regional teaching training center in Takeo province, Cambodia. Kasetsart J. Soc. Sci. 2017 , 38 , 88–95. [ Google Scholar ] [ CrossRef ]
  • Kamran, M. ICTs in Learning: Multimedia Learning in Classroom. Glob. Media J.-Pak. Ed. 2019 , 12 , 77–94. [ Google Scholar ]
  • Sætra, E. Discussing Controversial Issues in the Classroom: Elements of Good Practice. Scand. J. Educ. Res. 2020 , 65 , 345–357. [ Google Scholar ] [ CrossRef ]
  • Verducci, S. Critical Thinking and Open-Mindedness in Polarized Times. Encount. Theory Hist. Educ. 2019 , 20 , 6–23. [ Google Scholar ] [ CrossRef ]
  • Kuhn, D. Critical Thinking as Discourse. Hum. Dev. 2019 , 62 , 146–164. [ Google Scholar ] [ CrossRef ]
  • Nappi, J.S. The Importance of Questioning in Developing Critical Thinking Skills. Delta Kappa Gamma Bull. Int. J. Prof. Educ. 2017 , 84 , 30–41. [ Google Scholar ]
  • Mshayisa, V.V. Students’ perceptions of Plickers and crossword puzzles in undergraduate studies. J. Food Sci. Educ. 2020 , 19 , 49–58. [ Google Scholar ] [ CrossRef ]
  • Annisa, A.; Syahrizal, T. The Implementation of Ice Breakers Toward Improvement Students’ Motivation in Learning English at Software Engineering in SMK TI Garuda Nusantara Cimahi. PROJECT (Prof. J. Engl. Educ.) 2019 , 2 , 913–918. [ Google Scholar ] [ CrossRef ]
  • Rahmayanti, P.; Saraswati, P.A.; Bhuana, G.P. The Use of Ice Breaker to Improve Students’ Motivation in Learning English at the Tenth Grade Students of Smk Ypkkp. PROJECT (Prof. J. Engl. Educ.) 2019 , 2 , 594–600. [ Google Scholar ] [ CrossRef ]
  • Liu, O.L.; Shaw, A.; Gu, L.; Li, G.; Hu, S.; Yu, N.; Ma, L.; Xu, C.; Guo, F.; Su, Q.; et al. Assessing college critical thinking: Preliminary results from the Chinese HEIghten ® Critical Thinking assessment. High. Educ. Res. Dev. 2018 , 37 , 999–1014. [ Google Scholar ] [ CrossRef ]
  • Gelerstein, D.; Nussbaum, M.; López, X.; Cortés, A.; Castillo, C.; Chiuminatto, P.; Ovalle, F. Designing and implementing a test for measuring cultural dimensions in primary school. Learn. Cult. Soc. Interact. 2018 , 18 , 46–59. [ Google Scholar ] [ CrossRef ]
  • Danczak, S.M.; Thompson, C.D.; Overton, T.L. Development and validation of an instrument to measure undergraduate chemistry students’ critical thinking skills. Chem. Educ. Res. Pract. 2019 , 21 , 62–78. [ Google Scholar ] [ CrossRef ]
  • Marsden, E.; Torgerson, C.J. Single group, pre- and post-test research designs: Some methodological concerns. Oxf. Rev. Educ. 2012 , 38 , 583–616. [ Google Scholar ] [ CrossRef ]
  • Fukuzawa, S.; Debraga, M. Graded Response Method: Does Question Type Influence the Assessment of Critical Thinking? J. Curric. Teach. 2019 , 8 , 1. [ Google Scholar ] [ CrossRef ]
  • Jacob, E.; Duffield, C.; Jacob, D. Development of an Australian nursing critical thinking tool using a Delphi process. J. Adv. Nurs. 2018 , 74 , 2241–2247. [ Google Scholar ] [ CrossRef ] [ PubMed ] [ Green Version ]
  • Shavelson, R.J.; Zlatkin-Troitschanskaia, O.; Beck, K.; Schmidt, S.; Marino, J.P. Assessment of University Students’ Critical Thinking: Next Generation Performance Assessment. Int. J. Test. 2019 , 19 , 337–362. [ Google Scholar ] [ CrossRef ]
  • Shaw, A.; Liu, O.L.; Gu, L.; Kardonova, E.; Chirikov, I.; Li, G.; Hu, S.; Yu, N.; Ma, L.; Guo, F.; et al. Thinking critically about critical thinking: Validating the Russian HEIghten ® critical thinking assessment. Stud. High. Educ. 2019 , 45 , 1933–1948. [ Google Scholar ] [ CrossRef ]
  • Ghanizadeh, A. The interplay between reflective thinking, critical thinking, self-monitoring, and academic achievement in higher education. High. Educ. 2016 , 74 , 101–114. [ Google Scholar ] [ CrossRef ]
  • DeVellis, R.F. Classical Test Theory. Med. Care 2006 , 44 , 50–59. Available online: https://www.jstor.org/stable/41219505 (accessed on 12 February 2023). [ CrossRef ]
  • Frongillo, E.A.; Baranowski, T.; Subar, A.F.; Tooze, J.A.; Kirkpatrick, S.I. Establishing Validity and Cross-Context Equivalence of Measures and Indicators. J. Acad. Nutr. Diet. 2018 , 119 , 1817–1830. [ Google Scholar ] [ CrossRef ]
  • An, X.; Yung, Y. Item Response Theory: What It Is and How You Can Use the IRT Procedure to Apply It ; SAS Institute Inc.: Cary, NC, USA, 2014; pp. 1–14. Available online: https://support.sas.com/resources/papers/proceedings14/SAS364-2014.pdf (accessed on 12 February 2023).
  • Guelmami, N.; Chalghaf, N.; Tannoubi, A.; Puce, L.; Azaiez, F.; Bragazzi, N.L. Initial Development and Psychometric Evidence of Physical Education Grit Scale (PE-Grit). Front. Public Health 2022 , 10 , 818749. [ Google Scholar ] [ CrossRef ]
  • Chan, L.L.; Idris, N. Validity and Reliability of The Instrument Using Exploratory Factor Analysis and Cronbach alpha. Int. J. Acad. Res. Bus. Soc. Sci. 2017 , 7 , 400–410. [ Google Scholar ] [ CrossRef ]
  • Gelman, A.; Carlin, J.B.; Stern, H.S.; Dunson, D.B.; Vehtari, A.; Rubin, D.B. Bayesian Data Analysis ; CRC Press: Boca Raton, FL, USA, 2013. [ Google Scholar ]
  • Inoue, L.Y.; A Berry, D.; Parmigiani, G. Relationship Between Bayesian and Frequentist Sample Size Determination. Am. Stat. 2005 , 59 , 79–87. [ Google Scholar ] [ CrossRef ]
  • Hackenberger, B.K. Bayes or not Bayes, is this the question? Croat. Med. J. 2019 , 60 , 50–52. [ Google Scholar ] [ CrossRef ]
  • Bürkner, P.-C. Advanced Bayesian Multilevel Modeling with the R Package brms. R J. 2018 , 10 , 395–411. [ Google Scholar ] [ CrossRef ]
  • R Core Team. R: A Language and Environment for Statistical Computing ; R Foundation for Statistical Computing: Vienna, Austria, 2020; Available online: https://www.R-project.org/ (accessed on 12 February 2023).
  • Delacre, M.; Lakens, D.D.; Leys, C. Why Psychologists Should by Default Use Welch’s t -test Instead of Student’s t -test. Int. Rev. Soc. Psychol. 2017 , 30 , 92. [ Google Scholar ] [ CrossRef ] [ Green Version ]
  • Ghio, E.; Fernández, M.D. Antecedentes y fundamentos de la LSF. In Lingüística Sistémico Funcional. Aplicaciones a la Lengua Española ; Ediciones UNL: Santa Fe, Argentina, 2008; pp. 1–29. [ Google Scholar ]
  • Franco, A.; Costa, P.; Almeida, L.D.S. Translation, adaptation, and validation of the Halpern Critical Thinking Assessment to Portugal: Effect of disciplinary area and academic level on critical thinking. An. Psicol. 2018 , 34 , 292–298. [ Google Scholar ] [ CrossRef ]
  • Ferrando, P.J.; Lorenzo-Seva, U. A note on improving EAP trait estimation in oblique factor-analytic and item response theory models. Psicologica 2016 , 37 , 235–247. [ Google Scholar ]
  • López, X.; Valenzuela, J.; Nussbaum, M.; Tsai, C.-C. Some recommendations for the reporting of quantitative studies. Comput. Educ. 2015 , 91 , 106–110. [ Google Scholar ] [ CrossRef ]
  • Martin, J.R.; White, P.R. The Language of Evaluation ; Springer: Berlin/Heidelberg, Germany, 2003; Volume 2. [ Google Scholar ]
  • Roohr, K.; Burkander, K. Exploring Critical Thinking as an Outcome for Students Enrolled in Community Colleges. Community Coll. Rev. 2020 , 48 , 330–351. [ Google Scholar ] [ CrossRef ]
  • Cohen, J. Statistical Power Analysis for the Behavioral Sciences ; Academic press: Cambridge, MA, USA, 2013. [ Google Scholar ]
  • Dean, B.A.; Sykes, C. How Students Learn on Placement: Transitioning Placement Practices in Work-Integrated Learning. Vocat. Learn. 2020 , 14 , 147–164. [ Google Scholar ] [ CrossRef ]
  • Espey, M. Enhancing critical thinking using team-based learning. High. Educ. Res. Dev. 2017 , 37 , 15–29. [ Google Scholar ] [ CrossRef ]
  • Rohanai, R.; Othman, H.; Daud, K.A.M.; Omar, N.H.; Ahmad, M.; Ismail, M.E.; Sulaiman, A.; Sulaiman, J.K.S.M. Concept of Correlation between Active Learning and Employability Skills in TVET. Online J. TVET Pract. 2020 , 5 , 15–22. [ Google Scholar ] [ CrossRef ]
  • Campo, L.; Galindo-Domínguez, H.; Bezanilla, M.-J.; Fernández-Nogueira, D.; Poblete, M. Methodologies for Fostering Critical Thinking Skills from University Students’ Points of View. Educ. Sci. 2023 , 13 , 132. [ Google Scholar ] [ CrossRef ]
  • Liu, O.L.; Frankel, L.; Roohr, K.C. Assessing Critical Thinking in Higher Education: Current State and Directions for Next-Generation Assessment. ETS Res. Rep. Ser. 2014 , 2014 , 1–23. [ Google Scholar ] [ CrossRef ]
  • Tiruneh, D.T.; De Cock, M.; Weldeslassie, A.G.; Elen, J.; Janssen, R. Measuring Critical Thinking in Physics: Development and Validation of a Critical Thinking Test in Electricity and Magnetism. Int. J. Sci. Math. Educ. 2016 , 15 , 663–682. [ Google Scholar ] [ CrossRef ] [ Green Version ]
  • Liu, O.L.; Mao, L.; Frankel, L.; Xu, J. Assessing critical thinking in higher education: The HEIghten™ approach and preliminary validity evidence. Assess. Eval. High. Educ. 2016 , 41 , 677–694. [ Google Scholar ] [ CrossRef ]
  • Lopes, J.; Silva, H.; Morais, E. Universidade de Trás-os-Montes e Alto Douro (UTAD) Teste do Pensamento Crítico e Criativo para estudantes do ensino superior. Rev. Lusofona De Educ. 2019 , 44 , 173–189. [ Google Scholar ] [ CrossRef ]
  • Basha, S.; Drane, D.; Light, G. Adapting the Critical Thinking Assessment Test for Palestinian Universities. J. Educ. Learn. 2016 , 5 , 60. [ Google Scholar ] [ CrossRef ] [ Green Version ]
  • Istiyono, E.; Dwandaru, W.S.B.; Lede, Y.A.; Rahayu, F.; Nadapdap, A. Developing IRT-Based Physics Critical Thinking Skill Test: A CAT to Answer 21st Century Challenge. Int. J. Instr. 2019 , 12 , 267–280. [ Google Scholar ] [ CrossRef ]
  • Yanti, T.D.; Suana, W.; Maharta, N.; Herlina, K.; Distrik, I.W. Development of critical thinking instrument of electricity for senior high school students. J. Phys. Conf. Ser. 2019 , 1157 , 032007. [ Google Scholar ] [ CrossRef ]
  • Setambah, M.A.B.; Tajudin, N.M.; Adnan, M. Basics Statistics Critical Thinking Test: Reliability and Validity Issues. J. Didakt. Mat. 2018 , 5 , 1–15. [ Google Scholar ] [ CrossRef ] [ Green Version ]
GroupNumber of Students
Control70
Experimental79
Sub-Skill of Critical ThinkingExpected Learning Outcome
InterpretationObjectives associated with the extraction of literal information from written and spoken texts.
Analysis Objectives associated with summarizing ideas and organizing information from written and spoken texts hierarchically.
InferenceObjectives associated with extracting non-literal information from written and spoken discourse.
EvaluationObjectives associated with grammar (accent marks, punctuation, and connectors, among others) and the structure of a text.
ArgumentationObjectives associated with identifying an author or speaker’s point of view and their reasoning.
MetacognitionObjectives associated with self-regulation and monitoring during the process of speaking, writing, and listening/reading comprehension.
CoefficientReferenceDescription
InterceptAttributable to the regression model
Pre-TestDecimal number between 0 and 100, representing the student’s score on the pre-test
GroupStudent’s group. 0 for control and 1 for experimental
Course scoreStudent’s final grade for the course, expressed as a decimal number between 0 and 100
InstrumentKMOBarttlet’s Test of SphericityLog-LikelihoodM2p-ValuedfRMSEA 5% *RMSEARMSEA 95% **
Pre-Test0.65p < 0.001−8.507810<0.013480.0470.0510.056
Post-Test0.67p < 0.001−5.038888<0.014320.0560.0620.068
TestCronbach’s AlphaMarginal Reliability
Pre-Test0.670.76
Post-Test0.720.87
GroupTypeNMeanStd. Dev.MedianMinMaxSkewKurtosisStd. Error
ControlPre-Test7060.2514.555928930.1−0.571.74
Post-Test7055.1915.43551888−0.12−0.381.84
Course Score7071.747.71735588−0.14−0.540.92
ExperimentalPre-Test7955.9113.235517900.10.191.49
Post-Test7957.0414.15827910−0.291.59
Course Score7972.907.31745590−0.31−0.060.82
TotalPre-Test14957.9513.995517930.14−0.161.15
Post-Test14956.1714.72551891−0.08−0.261.21
Course Score14972.367.49735590−0.23−0.280.61
ParameterReferenceMeanStd. Dev.2.5%97.5%p (>0|Data)
Intercept−11.1210.26−31.178.980.14
Pre-Test0.220.090.050.390.99
Group1.972.17−2.306.190.82
Course score0.740.160.421.061.00
Control GroupExperimental GroupTotalWelch t-TestCohen’s d (Effect Size)
ItemMeanStd. DevMeanStd. DevMeanStd. Devd5% CI95% CI
193.386.395.553.5294.474.94t(6.27) = −0.67, p = 0.52
295.144.795.553.5295.353.92t(7.41) = −0.15, p = 0.87
392.635.995.593.3994.114.79t(6.38) = −0.97, p = 0.37
493.366.5394.883.9394.125.14t(6.56) = −0.45, p = 0.67
592.226.494.513.6293.375.05t(6.32) = −0.7, p = 0.51
691.166.7794.884.393.025.7t(6.78) = −1.04, p = 0.33
792.137.1495.623.8693.875.72t(6.16) = −0.96, p = 0.37
890.867.0694.883.9392.875.79t(6.26) = −1.11, p = 0.31
986.196.0894.863.5290.536.55t(6.41) = −2.76, p = 0.032.180.194.07
1091.175.2894.924.1793.054.9t(7.6) = −1.26, p = 0.25
1192.185.9395.623.8693.95.05t(6.88) = −1.09, p = 0.31
1292.635.995.593.3994.114.79t(6.38) = −0.98, p = 0.37
1380.3820.5783.223.1181.813.95t(4.18) = −0.31, p = 0.77
1466.7317.0474.964.6670.8512.55t(4.59) = −1.04, p = 0.35
1568.7118.4473.994.2271.3512.92t(4.42) = −0.62, p = 0.56
1689.934.3296.253.0993.094.86t(7.25) = −2.66, p = 0.031.980.173.7
The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

López, F.; Contreras, M.; Nussbaum, M.; Paredes, R.; Gelerstein, D.; Alvares, D.; Chiuminatto, P. Developing Critical Thinking in Technical and Vocational Education and Training. Educ. Sci. 2023 , 13 , 590. https://doi.org/10.3390/educsci13060590

López F, Contreras M, Nussbaum M, Paredes R, Gelerstein D, Alvares D, Chiuminatto P. Developing Critical Thinking in Technical and Vocational Education and Training. Education Sciences . 2023; 13(6):590. https://doi.org/10.3390/educsci13060590

López, Felipe, Mayra Contreras, Miguel Nussbaum, Ricardo Paredes, Damian Gelerstein, Danilo Alvares, and Pablo Chiuminatto. 2023. "Developing Critical Thinking in Technical and Vocational Education and Training" Education Sciences 13, no. 6: 590. https://doi.org/10.3390/educsci13060590

Article Metrics

Article access statistics, supplementary material.

ZIP-Document (ZIP, 823 KiB)

Further Information

Mdpi initiatives, follow mdpi.

MDPI

Subscribe to receive issue release notifications and newsletters from MDPI journals

U.S. flag

An official website of the United States government

The .gov means it’s official. Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

The site is secure. The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

  • Publications
  • Account settings

Preview improvements coming to the PMC website in October 2024. Learn More or Try it out now .

  • Advanced Search
  • Journal List
  • PMC10054602

Logo of jintell

Creativity, Critical Thinking, Communication, and Collaboration: Assessment, Certification, and Promotion of 21st Century Skills for the Future of Work and Education

Branden thornhill-miller.

1 Faculty of Philosophy, University of Oxford, Oxford OX2 6GG, UK

2 International Institute for Competency Development, 75001 Paris, France

Anaëlle Camarda

3 LaPEA, Université Paris Cité and Univ Gustave Eiffel, 92100 Boulogne-Billancourt, France

4 Institut Supérieur Maria Montessori, 94130 Nogent-Sur-Marne, France

Maxence Mercier

Jean-marie burkhardt.

5 LaPEA, Univ Gustave Eiffel and Université Paris Cité, CEDEX, 78008 Versailles, France

Tiffany Morisseau

6 Strane Innovation, 91190 Gif-sur-Yvette, France

Samira Bourgeois-Bougrine

Florent vinchon, stephanie el hayek.

7 AFNOR International, 93210 Saint-Denis, France

Myriam Augereau-Landais

Florence mourey, cyrille feybesse.

8 Centre Hospitalier Guillaume Regnier, Université de Rennes 1, 35200 Rennes, France

Daniel Sundquist

Todd lubart, associated data.

Not Applicable.

This article addresses educational challenges posed by the future of work, examining “21st century skills”, their conception, assessment, and valorization. It focuses in particular on key soft skill competencies known as the “4Cs”: creativity, critical thinking, collaboration, and communication. In a section on each C, we provide an overview of assessment at the level of individual performance, before focusing on the less common assessment of systemic support for the development of the 4Cs that can be measured at the institutional level (i.e., in schools, universities, professional training programs, etc.). We then present the process of official assessment and certification known as “labelization”, suggesting it as a solution both for establishing a publicly trusted assessment of the 4Cs and for promoting their cultural valorization. Next, two variations of the “International Institute for Competency Development’s 21st Century Skills Framework” are presented. The first of these comprehensive systems allows for the assessment and labelization of the extent to which development of the 4Cs is supported by a formal educational program or institution. The second assesses informal educational or training experiences, such as playing a game. We discuss the overlap between the 4Cs and the challenges of teaching and institutionalizing them, both of which may be assisted by adopting a dynamic interactionist model of the 4Cs—playfully entitled “Crea-Critical-Collab-ication”—for pedagogical and policy-promotion purposes. We conclude by briefly discussing opportunities presented by future research and new technologies such as artificial intelligence and virtual reality.

1. Introduction

There are many ways of describing the massive educational challenges faced in the 21st century. With the appearance of computers and digital technologies, new means of interacting between people, and a growing competitiveness on the international level, organizations are now requiring new skills from their employees, leaving educational systems struggling to provide appropriate ongoing training. Indeed, according to the World Economic Forum’s 2020 “Future of Jobs Report”, studying 15 industries in 26 advanced and emerging countries, up to 50% of employees will need some degree of “reskilling” by 2025 ( World Economic Forum 2020 ). Although many national and international educational efforts and institutions now explicitly put the cultivation of new kinds of skills on their educational agendas, practical means of assessing such skills remains underdeveloped, thus hampering the valorization of these skills and the development of guidance for relevant pedagogy ( Care et al. 2018 ; Vincent-Lancrin et al. 2019 ; for overviews and discussion of higher education in global developmental context, see Blessinger and Anchan 2015 ; Salmi 2017 ).

This article addresses some of these challenges and related issues for the future of education and work, by focusing on so-called “21st Century Skills” and key “soft skills” known as the “4Cs” (creativity, critical thinking, communication, and collaboration), more particularly. It begins with a brief discussion of these skills, outlining their conceptual locations and potential roles in the modern educational context. A section on each “C” then follows, defining the C, summarizing research and methods for its scientific assessment at the individual level, and then outlining some means and avenues at the systemic level for fostering its development (e.g., important aspects of curriculum, institutional structure, or of the general environment, as well as pedagogical methods) that might be leveraged by an institution or program in order to promote the development of that C among its students/trainees. In the next section, the certification-like process of “labelization” is outlined and proposed as one of the best available solutions both for valorizing the 4Cs and moving them towards the center of the modern educational enterprise, as well as for benchmarking and monitoring institutions’ progress in fostering their development. The International Institute for Competency Development’s 4Cs Framework is then outlined as an example of such a comprehensive system for assessing and labelizing the extent to which educational institutions and programs support the development of the 4Cs. We further demonstrate the possibility of labelizing and promoting support for the development of the 4Cs by activities or within less formal educational settings, presenting a second framework for assessment of the 4Cs in games and similar training activities. Our discussion section begins with the challenges to implementing educational change in the direction of 21st century skills, focusing on the complex and overlapping nature of the 4Cs. Here, we propose that promoting a “Dynamic Interactionist Model of the 4Cs” not only justifies grouping them together, but it might also assist more directly with some of the challenges of pedagogy, assessment, policy promotion, and ultimately, institutionalization, faced by the 4Cs and related efforts to modernize education. We conclude by suggesting some important future work for the 4Cs individually and also as an interrelated collective of vital skills for the future of education and work.

“21st Century Skills”, “Soft Skills”, and the “4Cs”

For 40 years, so-called “21st century skills” have been promoted as those necessary for success in a modern work environment that the US Army War College ( Barber 1992 ) has accurately described as increasingly “VUCA”—“volatile, uncertain, complex and ambiguous”. Various lists of skills and competencies have been formulated on their own or as part of comprehensive overarching educational frameworks. Although a detailed overview of this background material is outside the scope of this article (see Lamri et al. 2022 ; Lucas 2022 for summaries), one of the first prominent examples of this trend was the Partnership for 21st Century Skills (P21), whose comprehensive “Framework for 21st Century Learning” is presented in Figure 1 ( Battelle for Kids 2022 ). This framework for future-oriented education originated the idea of the “4Cs”, placing them at its center and apex as “Learning and Innovation Skills” that are in need of much broader institutional support at the foundational level in the form of new standards and assessments, curriculum and instructional development, ongoing professional development, and appropriately improved learning environments ( Partnership for 21st Century Skills 2008 ). These points are also consistent with the approach and assessment frameworks presented later in this article.

An external file that holds a picture, illustration, etc.
Object name is jintelligence-11-00054-g001.jpg

The P21 Framework for 21st Century Learning. (© 2019, Battelle for Kids. All Rights Reserved. https://www.battelleforkids.org/ ; accessed on 17 January 2023).

Other important organizations such as the World Economic Forum ( 2015 ) have produced similar overarching models of “21st century skills’’ with the 4Cs at their center, but the term “21st century skills’’ has been rightly criticized for a several reasons: the skills referred to are not actually all unique to, or uniquely important to, the 21st century, and it is a term that is often used more as an advertising or promotional label for systems that sometimes conflate and confuse different kinds of skills with other concepts that users lump together ( Lucas 2019 ). Indeed, though there is no absolute consensus on the definition of a “skill”, they are often described as being multidimensional and involve the ability to solve problems in context and to perform tasks using appropriate resources at the right time and in the right combination ( Lamri and Lubart 2021 ). At its simplest, a skill is a “learned capacity to do something useful” ( Lucas and Claxton 2009 ), or an ability to perform a given task at a specified performance level, which develops through practice, experience. and training ( Lamri et al. 2022 ).

The idea of what skills “are’’, however, has also evolved to some extent over time in parallel to the nature of the abilities required to make valued contributions to society. The digital and information age, in particular, has seen the replacement by machines of much traditional work sometimes referred to as “hard skills’’—skills such as numerical calculation or driving, budget-formulating, or copyediting abilities, which entail mastery of fixed sets of knowledge and know-how of standard procedures, and which are often learned on the job. Such skills are more routine, machine-related, or technically oriented and not as likely to be centered on human interaction. In contrast, the work that has been increasingly valued in the 21st century involves the more complex, human interactive, and/or non-routine skills that Whitmore ( 1972 ) first referred to as “soft skills”.

Unfortunately, researchers, educators, and consultants have defined, redefined, regrouped, and expanded soft skills—sometimes labeling them “transversal competencies”, “generic competencies”, or even “life skills” in addition to “21st century skills”—in so many different ways within and across different domains of research and education (as well as languages and national educational systems) that much progress towards these goals has literally been “lost in translation” ( Cinque 2016 ).

Indeed, there is also a long-standing ambiguity and confusion between the terms “competency” (also competence) and “skill” due to their use across different domains (e.g., learning research, education, vocational training, personnel selection) as well as different epistemological backgrounds and cultural specificities ( Drisko 2014 ; Winterton et al. 2006 ; van Klink and Boon 2003 ). The term “competency” is, however, often used as a broader concept that encompasses skills, abilities, and attitudes, whereas, in a narrower sense, the term “skill” has been defined as “goal-directed, well-organized behavior that is acquired through practice and performed with economy of effort” ( Proctor and Dutta 1995, p. 18 ). For example, whereas the command of a spoken language or the ability to write are skills (hard skills, to be precise), the ability to communicate effectively is a competence that may draw on an individual’s knowledge of language, writing skills, practical IT skills, and emotional intelligence, as well as attitudes towards those with whom one is communicating ( Rychen and Hersch 2003 ). Providing high-quality customer service is a competency that relies on listening skills, social perception skills, and contextual knowledge of products. Beyond these potential distinctions, the term “competency” is predominant in Europe, whereas “skill” is more commonly used in the US. Yet it also frequently occurs that both are used as rough synonyms. For example, Voogt and Roblin ( 2012, p. 299 ) examine the “21st century competences and the recommended strategies for the implementation of these skills”, and Graesser et al. ( 2022, p. 568 ) state that twenty-first-century skills “include self-regulated learning, collaborative problem solving, communication (…) and other competencies”. In conclusion, the term “competencies” is often used interchangeably with “skills” (and can have a particularly large overlap with “soft skills”), but it is also often considered in a broader sense as a set of skills, knowledge, and attitudes that, together, meet a complex demand ( Ananiadoui and Claro 2009 ). From this perspective, one could argue that the 4Cs, as complex, “higher-order” soft skills, might best be labeled competencies. For ease and convenience, however, in this text, we consider the two terms interchangeable but favor the term “skills”, only using “competency” in some instances to avoid cumbersome repetition.

Even having defined soft skills as a potentially more narrow and manageable focus, we are still aware of no large-scale study that has employed a comprehensive enough range of actual psychometric measures of soft skills in a manner that might help produce a definitive empirical taxonomy. Some more recent taxonomic efforts have, however, attempted to provide additional empirical grounding for the accurate identification of key soft skills (see e.g., Joie-La Marle et al. 2022 ). Further, recent research by JobTeaser (see Lamri et al. 2022 ) surveying a large, diverse sample of young workers about a comprehensive, systematic list of soft skills as actually used in their professional roles represents a good step towards some clarification and mapping of this domain on an empirical basis. Despite the fact that both these studies necessarily involved assumptions and interpretive grouping of variables, the presence and importance of the 4Cs as higher-order skills is evident in both sets of empirical results.

Various comprehensive “21st century skills” systems proposed in the past without much empirical verification also seem to have been found too complex and cumbersome for implementation. The 4Cs, on the other hand, seem to provide a relatively simple, persuasive, targetable core that has been found to constitute a pedagogically and policy-friendly model by major organizations, and that also now seems to be gaining some additional empirical validity. Gathering support from researchers and industry alike, we suggest that the 4Cs can be seen as highest-level transversal skills—or “meta-competencies”—that allow individuals to remain competent and to develop their potential in a rapidly changing professional world. Thus, in the end, they may also be one of the most useful ways of summarizing and addressing the critical challenges faced by the future of work and education ( National Education Association 2011 ).

Taking them as our focus, we note, however, that the teaching and development of the 4Cs will require a complex intervention and mobilization of educational and socio-economic resources—both a major shift in pedagogical techniques and even more fundamental changes in institutional structures ( Ananiadoui and Claro 2009 ). One very important issue for understanding the 4Cs and their educational implementation related to this, which can simultaneously facilitate their teaching but be a challenge for their assessment, is the multidimensionality, interrelatedness, and transdisciplinary relevance of the 4Cs. Thus, we address the relationships between the Cs in the different C sections and later in our Discussion, we present a “Dynamic Interactionist Model of the 4Cs’’ that we hope will assist in their understanding, in the further development of pedagogical processes related to them, and in their public promotion and related policy. Ultimately, it is partly due to their complexity and interrelationships, we argue, that it is important and expedient that the 4Cs are taught, assessed, and promoted together.

2. The 4Cs, Assessment, and Support for Development

2.1. creativity.

In psychology, creativity is usually defined as the capacity to produce novel, original work that fits with task constraints and has value in its context (for a recent overview, see Lubart and Thornhill-Miller 2019 ). This basic definition, though useful for testing and measurement, is largely incomplete, as it does not contain any information about the individual or groups doing the creating or the nature of physical and social contexts ( Glăveanu 2014 ). Moreover, Corazza ( 2016 ) challenged this standard definition of creativity, arguing that as it focuses solely on the existence of an original and effective outcome, it misses the dynamics of the creative process, which is frequently associated with periods of creative inconclusiveness and limited occasions of creative achievements. To move away from the limitations of the standard definition of creativity, we can consider Bruner’s description of creativity as “figuring out how to use what you already know in order to go beyond what you currently think” (p. 183 in Weick 1993 ). This description echoes the notion of potential, which refers to a latent state that may be put to use if a person has the opportunity.

Creativity is a multifaceted phenomenon that can be approached from many different angles. There are three main frameworks for creativity studies: the 4Ps ( Rhodes 1961 ), the 5As ( Glăveanu 2013 ), and the 7Cs model ( Lubart 2017 ). These frameworks share at least four fundamental and measurable dimensions: the act of creating (process), the outcome of the creative process (product), the characteristics of creative actor(s) enacting the process (person), and the social and physical environment that enable or hinder the creative process (press). Contrary to many traditional beliefs, however, creativity can be trained and taught in a variety of different ways, both through direct, active teaching of creativity concepts and techniques and through more passive and indirect means such as the development of creativity-supporting contexts ( Chiu 2015 ; Thornhill-Miller and Dupont 2016 ). Alongside intelligence, with which it shares some common mechanisms, creativity is now recognized as an indispensable element for the flexibility and adaptation of individuals in challenging situations ( Sternberg 1986 ).

2.1.1. Individual Assessment of Creativity

Drawing upon previous efforts to structure creativity research, Batey ( 2012 ) proposed a taxonomic framework for creativity measurement that takes the form of a three-dimensional matrix: (a) the level at which creativity may be measured (the individual, the team, the organization, and the culture), (b) the facets of creativity that may be assessed (person/trait, process, press, and product), and (c) the measurement approach (objective, self-rating, other ratings). It is beyond the scope of this article to offer a literature review of all these dimensions, but for the purposes of this paper, we address some important aspects of individual-level and institutional-level assessment here.

Assessing creativity at an individual level encompasses two major approaches: (1) creative accomplishment based on production and (2) creative potential. Regarding the first approach focusing on creative accomplishment , there are at least four main assessment techniques (or tools representing variations of assessment techniques): (a) the historiometric approach, which applies quantitative analysis to historically available data (such as the number of prizes won or times cited) in an effort to understand eminent, field-changing creativity ( Simonton 1999 ); (b) the Consensual Assessment Technique (CAT) ( Amabile 1982 ), which offers a method for combining and validating judges’ subjective evaluations of a set of (potentially) creative productions or ideas; (c) the Creative Achievement Questionnaire ( Carson et al. 2005 ), which asks individuals to supply a self-reported assessment of their publicly recognizable achievement in ten different creative domains; and (d) the Inventory of Creative Activities and Achievements (ICAA) ( Jauk et al. 2014 ; Diedrich et al. 2018 ), which includes self-report scales assessing the frequency of engagement in creative activity and also levels of achievement in eight different domains.

The second major approach to individual assessment is based on creative potential, which measures the cognitive abilities and/or personality traits that are important for creative work. The two most popular assessments of creative potential are the Remote Associations Test (RAT) and the Alternative Uses Task (AUT). The RAT, which involves identifying the fourth word that is somehow associated with each of three given words, underscores the role that the ability to convergently associate disparate ideas plays as a key capacity for creativity. In contrast, the AUT, which requires individuals to generate a maximum number of ideas based on a prompt (e.g., different uses for a paperclip), is used to assess divergent thinking capacity. According to multivariate models of creative potential ( Lubart et al. 2013 ), there are cognitive factors (e.g., divergent thinking, mental flexibility, convergent thinking, associative thinking, selective combination), conative factors (openness, tolerance of ambiguity, intuitive thinking, risk taking, motivation to create), and environmental factors that all support creativity. Higher creative potential is predicted by having more of the ingredients for creativity. However, multiple different profiles among a similar set of these important ingredients exist, and their weighting for optimal creative potential varies according to the profession, the domain, and the task under consideration. For example, Lubart and Thornhill-Miller ( 2021 ) and Lubin et al. ( forthcoming ) have taken this creativity profiling approach, exploring the identification and training of the components of creative potential among lawyers and clinical psychologists, respectively. For a current example of this sort of comprehensive, differentiated measurement of creative potential in adults in different domains and professions, see CreativityProfiling.org. For a recent battery of tests that are relevant for children, including domain-relevant divergent-exploratory and convergent-integrative tasks, see Lubart et al. ( 2019 ). Underscoring the growing recognition of the importance of creativity assessment, measures of creative potential for students were introduced internationally for the first time in the PISA 2022 assessment ( OECD 2019a ).

2.1.2. Institutional and Environmental Support for Development of Creativity

The structural support that institutions and programs can provide to promote the development of creativity can be described as coming through three main paths: (1) through design of the physical environment in a manner that supports creativity, (2) through teaching about creativity, the creative process, and creativity techniques, and (3) through training opportunities to help students/employees develop personal habits, characteristics, and other ingredients associated with creative achievement and potential.

Given the multi-dimensionality of the notion of creativity, the environment can positively influence and help develop creative capacities. Studies have shown that the physical environment in which individuals work can enhance their positive emotions and mood and thus their creativity. For example, stimulating working environments might have unusual furniture and spaces that have natural light, windows open to nature, plants and flowers, a relaxing atmosphere and colors in the room (e.g., green and blue), or positive sounds (e.g., calm music or silence), as well as inspiring and energizing colors (e.g., yellow, pink, orange). Furthermore, the arrangement of physical space to promote interpersonal exchange rather than isolation, as well as the presence of tools, such as whiteboards, that support and show the value of exchange, are also important (for reviews, see Dul and Ceylan 2011 ; Samani et al. 2014 ).

Although it has been claimed that “creativity is intelligence having fun” ( Scialabba 1984 ; Reiman 1992 ), for most people, opportunities for fun and creativity, especially in their work environment, appear rather limited. In fact, the social and physical environment often hinders creativity. Corazza et al. ( 2021 )’s theoretical framework concerning the “Space-Time Continuum”, related to support for creativity, suggests that traditional education systems are an example of an environment that is “tight” both in the conceptual “space” it affords for creativity and in the available time allowed for creativity to happen—essentially leaving little room for original ideas to emerge. Indeed, though world-wide data suggest that neither money nor mere time spent in class correlate well with educational outcomes, both policies and pedagogy that direct the ways in which time is spent make a significant difference ( Schleicher 2022 ). Research and common sense suggest that teachers, students, and employees need more space and time to invest energy in the creative process and the development of creative potential.

Underscoring the importance of teaching the creative process and creativity techniques is the demonstration, in a number of contexts, that groups of individuals who generate ideas without a specific method are often negatively influenced by their social environment. For example, unless guarded against, the presence of others tends to reduce the number of ideas generated and to induce a fixation on a limited number of ideas conforming to those produced by others ( Camarda et al. 2021 ; Goldenberg and Wiley 2011 ; Kohn and Smith 2011 ; Paulus and Dzindolet 1993 ; Putman and Paulus 2009 ; Rietzschel et al. 2006 ). To overcome these cognitive and social biases, different variants of brainstorming techniques have shown positive effects (for reviews of methods, see Al-Samarraie and Hurmuzan 2018 ; Paulus and Brown 2007 ). These include: using ( Osborn 1953 ) initial brainstorming rules (which aim to reduce spontaneous self-judgment of ideas and fear of this judgment by others); drawing attention to ideas generated by others by writing them down independently (e.g., the technique known as “brainwriting”); and requiring incubation periods between work sessions by forcing members of a problem-solving group to take breaks ( Paulus and Yang 2000 ; Paulus and Kenworthy 2019 ).

It is also possible to use design methods that are structured to guide the creative process and the exploration of ideas, as well as to avoid settling on uncreative solution paths ( Chulvi et al. 2012 ; Edelman et al. 2022 ; Kowaltowski et al. 2010 ; see Cotter et al. 2022 for a valuable survey of best practices for avoiding the suppression of creativity and fostering creative interaction and metacognition in the classroom). Indeed, many helpful design thinking-related programs now exist around the world and have been shown to have a substantial impact on creative outcomes ( Bourgeois-Bougrine 2022 ).

Research and experts suggest the utility of many additional creativity enhancement techniques (see, e.g., Thornhill-Miller and Dupont 2016 ), and the largest and most rapid effects are often attributed to these more method- or technique-oriented approaches ( Scott et al. 2004 ). More long-term institutional and environmental support for the development of creativity, however, should also include targeted training and understanding of personality and emotional traits associated with the “creative person” (e.g., empathy and exploratory habits that can expand knowledge, as well as increase tolerance of ambiguity, openness, and mental flexibility; see Lubart and Thornhill-Miller 2021 ). Complementing these approaches and focusing on a more systemic level, recent work conducted by the OECD exemplifies efforts aimed to foster creativity (and critical thinking) by focusing simultaneously on curriculum, educational activities, and teacher support and development at the primary, secondary, and higher education levels (see Vincent-Lancrin et al. 2019 ; Saroyan 2022 ).

2.2. Critical Thinking

Researchers, teachers, employers, and public policymakers around the world have long ranked the development of critical thinking (CT) abilities as one of the highest educational priorities and public needs in modern democratic societies ( Ahern et al. 2019 ; Dumitru et al. 2018 ; Pasquinelli et al. 2021 ). CT is central to better outcomes in daily life and general problem solving ( Hitchcock 2020 ), to intelligence and adaptability ( Halpern and Dunn 2021 ), and to academic achievement ( Ren et al. 2020 ). One needs to be aware of distorted or erroneous information in the media, of the difference between personal opinions and proven facts, and how to handle increasingly large bodies of information required to understand and evaluate information in the modern age.

Although much research has addressed both potentially related constructs, such as intelligence and wisdom, and lists of potential component aspects of human thought, such as inductive or deductive reasoning (for reviews of all of these, see Sternberg and Funke 2019 ), reaching a consensus on a definition has been difficult, because CT relies on the coordination of many different skills ( Bellaera et al. 2021 ; Dumitru et al. 2018 ) and is involved in, and sometimes described from the perspective of, many different domains ( Lewis and Smith 1993 ). Furthermore, as a transversal competency, having the skills to perform aspects of critical thinking in a given domain does not necessarily entail also having the metacognitive ability to know when to engage in which of its aspects, or having the disposition, attitude, or “mindset” that motivates one to actually engage in them—all of which are actually required to be a good critical thinker ( Facione 2011 ).

As pointed out by the American Philosophical Association’s consensus definition, the ideal “critical thinker” is someone who is inquisitive, open-minded, flexible, fair-minded, and keeps well-informed, thus understanding different points of view and perspectives ( Facione 1990b ). These characteristics, one might note, are also characteristic of the “creative individual” ( Facione 1990b ; Lai 2011 ), as is the ability to imagine alternatives, which is often cited as a component of critical thinking ability ( Facione 1990b ; Halpern 1998 ). Conversely, creative production in any domain needs to be balanced by critical appraisal and thought at each step of the creative process ( Bailin 1988 ). Indeed, it can be argued that creativity and critical thinking are inextricably linked and are often two sides of the same coin. Representing different aspects of “good thought” that are linked and develop in parallel, it seems reasonable that they should, in practice, be taught and considered together in teaching and learning ( Paul and Elder 2006 ).

Given its complexity, many definitions of critical thinking have been offered. However, some more recent work has helpfully defined critical thinking as “the capacity of assessing the epistemic quality of available information and—as a consequence of this assessment—of calibrating one’s confidence in order to act upon such information” ( Pasquinelli et al. 2021 ). This definition, unlike others proposed in the field (for a review, see: Bellaera et al. 2021 ; Liu et al. 2014 ), is specific (i.e., it limits the use of poorly defined concepts), as well as consensual and operational (i.e., it has clear and direct implications for the education and assessment of critical thinking skills; Pasquinelli et al. 2021 ; Pasquinelli and Bronner 2021 ). Thus, this approach assumes that individuals possess better or worse cognitive processes and strategies that make it possible to judge the reliability of the information received, by determining, for example, what the arguments provided actually are. Are the arguments convincing? Is the source of information identifiable and reliable? Does the information conflict with other information held by the individual?

It should also be noted that being able to apply critical thinking is necessary to detect and overcome the cognitive biases that can constrain one’s reasoning. Indeed, when solving a problem, it is widely recognized that people tend to automate the application of strategies that are usually relevant in similar and analogous situations that have already been encountered. However, these heuristics (i.e., automatisms) can be a source of errors, in particular, in tricky reasoning situations, as demonstrated in the field of reasoning, arithmetic problems ( Kahneman 2003 ) or even divergent thinking tasks ( Cassotti et al. 2016 ; for a review of biases, see Friedman 2017 ). Though some cognitive biases can even be seen as normal ways of thinking and feeling, sometimes shaping human beliefs and ideologies in ways that make it completely normal—and even definitely human— not to be objective (see Thornhill-Miller and Millican 2015 ), the mobilization of cognitive resources such as those involved in critical reasoning on logical bases usually makes it possible to overcome cognitive biases and adjust one’s reasoning ( West et al. 2008 ).

According to Pasquinelli et al. ( 2021 ), young children already possess cognitive functions underlying critical thinking, such as the ability to determine that information is false. However, until late adolescence, studies have demonstrated an underdevelopment of executive functions involved in resistance to biased reasoning ( Casey et al. 2008 ) as well as some other higher-order skills that underlie the overall critical thinking process ( Bloom 1956 ). According to Facione and the landmark American Philosophical Association’s task force on critical thinking ( Facione 1990b ; Facione 2011 ), these components of critical thinking can be organized into six measurable skills: the ability to (1) interpret information (i.e., meaning and context); (2) analyze information (i.e., make sense of why this information has been provided, identify pro and con arguments, and decide whether we can accept the conclusion of the information); (3) make inferences (i.e., determine the implications of the evidence, its reliability, the undesirable consequences); (4) evaluate the strength of the information (i.e., its credibility, determine the trust in the person who provides it); (5) provide explanations (i.e., summarize the findings, determine how the information can be interpreted, and offer verification of the reasoning); (6) self-regulate (i.e., evaluate the strength of the methods applied, determine the conflict between different conclusions, clarify the conclusions, and verify missing elements).

2.2.1. Individual Assessment of Critical Thinking

The individual assessment of critical thinking skills presents a number of challenges, because it is a multi-task ability and involves specific knowledge in the different areas in which it is applied ( Liu et al. 2014 ; Willingham 2008 ). However, the literature provides several tools with which to measure different facets of cognitive functions and skills involved in the overarching critical thinking process ( Lai 2011 ; Liu et al. 2014 ). Most assessments involve multiple-choice questions requiring reasoning within a particular situation based upon a constrained set of information provided. For example, in one of the most widely used tests, the California Critical Thinking Skills Test ( Facione 1990a ), participants are provided with everyday scenarios and have to answer multiple questions targeting the six higher-order skills described previously. Similarly, the Watson–Glaser Critical Thinking Appraisal ( Watson 1980 ; Watson and Glaser 2010 ) presents test takers with passages and scenarios measuring their competencies at recognizing assumptions, evaluating arguments, and drawing conclusions. Although the Watson–Glaser is one of the oldest and most frequently used assessments internationally for hiring and promotion in professional contexts, its construct validity, like many other measures of this challenging topic, has some limitations ( Possin 2014 ).

Less frequently, case study or experiential methods of assessment are also used. This approach may involve asking participants to reflect on past experiences, analyze the situations they faced and the way they behaved or made judgments and decisions and then took action ( Bandyopadhyay and Szostek 2019 ; Brookfield 1997 ). These methods, often employed by teachers or employers on students and employees, usually involve the analysis of qualitative data that can cast doubt on the reliability of the results. Consequently, various researchers have suggested ways to improve analytic methods, and they emphasize the need to create more advanced evaluation methods ( Brookfield 1997 ; Liu et al. 2014 ).

For example, Liu et al. ( 2014 ) reviewed current assessment methods and suggest that future work improves the operational definition of critical thinking, aiming to assess it both in different specific contexts and in different formats. Specifically, assessments could be contextualized within the major areas addressed by education programs (e.g., social sciences, humanities, and/or natural sciences), and the tasks themselves should be as practically connected to the “real world” as possible (e.g., categorizing a set of features, opinions, or facts based on whether or not they support an initial statement). Moreover, as Brookfield ( 1997 ) argues, because critical thinking is a social process that takes place in specific contexts of knowledge and culture, it should be assessed as a social process, therefore, involving a multiplicity of experiences, perceptions, and contributions. Thus, Brookfield makes three recommendations for improving the assessment of critical thinking that are still relevant today: (1) to assess critical thinking in specific situations, so one can study the process and the discourse related to it; (2) to involve students/peers in the evaluation of critical thinking abilities, so that the evaluation is not provided only by the instructor; and (3) to allow learners or participants in an experiment to document, demonstrate, and justify their engagement in critical thinking, because this learning perspective can provide insight into basic dimensions of the critical thinking process.

Finally, another more recent and less widely used form of assessment targets the specific executive functions that underlie logical reasoning and resistance to cognitive biases, as well as the ability of individuals to resist these biases. This form of assessment is usually done through specific experimental laboratory tasks that vary depending on the particular executive function and according to the domain of interest ( Houdé and Borst 2014 ; Kahneman 2011 ; West et al. 2008 ).

2.2.2. Institutional and Environmental Support for Development of Critical Thinking Skills

The executive functions underlying general critical thinking, the ability to overcome bias ( Houdé 2000 ; Houdé and Borst 2014 ), and meta-cognitive processes (i.e., meta information about our cognitive strategies) can all be trained and enhanced by educational programs ( Abrami et al. 2015 ; Ahern et al. 2019 ; Alsaleh 2020 ; Bellaera et al. 2021 ; Uribe-Enciso et al. 2017 ; Popil 2011 ; Pasquinelli and Bronner 2021 ; Yue et al. 2017 ).

Educational programs and institutions can support the development of critical thinking in several different ways. The process of developing critical thinking focuses on the interaction between personal dispositions (attitudes and habits), skills (evaluation, reasoning, self-regulation), and finally, knowledge (general and specific knowledge, as well as experience) ( Thomas and Lok 2015 ). It is specifically in regard to skills and knowledge that institutions are well suited to develop critical thinking through pedagogical elements such as rhetoric training, relevance of information evaluation (e.g., media literacy, where and how to check information on the internet, dealing with “fake news”, etc.), deductive thinking skills, and inductive reasoning ( Moore and Parker 2016 ). A few tools, such as case studies or concept mapping, can also be used in conjunction with a problem-based learning method, both in individual and team contexts and in person or online ( Abrami et al. 2015 ; Carmichael and Farrell 2012 ; Popil 2011 ; Thorndahl and Stentoft 2020 ). According to Marin and Halpern ( 2011 ), training critical thinking should include explicit instruction involving at least the four following components and objectives: (1) working on attitudes and encouraging individuals to think; (2) teaching and practicing critical thinking skills; (3) training for transfer between contexts, identifying concrete situations in which to adopt the strategies learned; and (4) suggesting metacognition through reflection on one’s thought processes. Supporting these propositions, Pasquinelli and Bronner ( 2021 ), in a French national educational report, proposed practical advice for creating workshops to stimulate critical thinking in school classrooms, which appear relevant even in non-school intervention situations. For example, the authors suggest combining concrete examples and exercises with general and abstract explanations, rules and strategies, which can be transferred to other areas beyond the one studied. They also suggest inviting learners to create examples of situations (e.g., case studies) in order to increase the opportunities to practice and for the learner to actively participate. Finally, they suggest making the process of reflection explicit by asking the learner to pay attention to the strategies adopted by others in order to stimulate the development of metacognition.

2.3. Communication

In its most basic definition, communication consists of exchanging information to change the epistemic context of others. In cooperative contexts, it aims at the smooth and efficient exchange of information contributing to the achievement of a desired outcome or goal ( Schultz 2010 ). But human communication involves multiple dimensions. Both verbal and non-verbal communication can involve large quantities of information that have to be both formulated and deciphered with a range of purposes and intentions in mind ( Jones and LeBaron 2002 ). These dimensions of communication have as much to do with the ability to express oneself, both orally and in writing and the mastering of a language (linguistic competences), as with the ability to use this communication system appropriately (pragmatic skills; see Grassmann 2014 ; Matthews 2014 ), and with social skills, based on the knowledge of how to behave in society and on the ability to connect with others, to understand the intentions and perspectives of others ( Tomasello 2005 ).

Like the other 4Cs, according to most authorities, communication skills are ranked by both students and teachers as skills of the highest priority for acquisition in order to be ready for the workforce in 2030 ( OECD 2019b ; Hanover Research 2012 ). Teaching students how to communicate efficiently and effectively in all the new modalities of information exchange is an important challenge faced by all pedagogical organizations today ( Morreale et al. 2017 ). All dimensions of communication (linguistic, pragmatic, and social) are part of what is taught in school curricula at different levels. But pragmatic and social competencies are rarely explicitly taught as such. Work on social/emotional intelligence (and on its role in students’ personal and professional success) shows that these skills are both disparate and difficult to assess ( Humphrey et al. 2007 ). Research on this issue is, however, becoming increasingly rigorous, with the potential to provide usable data for the development of science-based practice ( Keefer et al. 2018 ). Teachers and pedagogical teams also have an important, changing role to play: they also need to master new information and communication technologies and the transmission of information through them ( Zlatić et al. 2014 ).

Communication has an obvious link with the three other Cs. Starting with critical thinking, sound communication implies fostering the conditions for a communicative exchange directed towards a common goal, which is, at least in educational and professional contexts, based on a fair evaluation of reality ( Pornpitakpan 2004 ). Collaboration too has a strong link with communication, because successful collaboration is highly dependent on the quality of knowledge sharing and trust that emerges between group members. Finally, creativity involves the communication of an idea to an audience and can involve high-quality communication when creative work occurs in a team context.

2.3.1. Individual Assessment of Communication

Given the vast field of communication, an exhaustive list of its evaluation methods is difficult to establish. A number of methods have been reported in the literature to assess an individual’s ability to communicate non-verbally and verbally. But although these two aspects are intrinsically linked, they are rarely measured together with a single tool. Moreover, as Spitzberg ( 2003 ) pointed out, communication skills are supported by different abilities, classically conceptualized as motivational functions (e.g., confidence and goal-orientation), knowledge (e.g., content and procedural knowledge), or cognitive and socio-cognitive functions (e.g., theory of mind, verbal cognition, emotional intelligence, and empathy; McDonald et al. 2014 ; Rothermich 2020 ), implying different specific types of evaluations. Finally, producing vs. receiving communication involve different skills and abilities, which can also vary according to the context ( Landa 2005 ).

To overcome these challenges, Spitzberg ( 2003 ) recommends the use of different assessment criteria. These criteria include the clarity of interaction, the understanding of what was involved in the interaction, the satisfaction of having interacted (expected to be higher when communication is effective), the efficiency of the interaction (the more competent someone is, the less effort, complexity, and resources will be needed to achieve their goal), its effectiveness or appropriateness (i.e., its relevance according to the context), as well as criteria relative to the quality of the dialogue (which involves coordination, cooperation, coherence, reciprocity, and mutuality in the exchange with others). Different forms of evaluation are also called for, such as self-reported questionnaires, hetero-reported questionnaires filled out by parents, teachers, or other observers, and tasks involving exposure to role-playing games, scenarios or videos (for a review of these assessment tools, see Cömert et al. 2016 ; Landa 2005 ; Sigafoos et al. 2008 ; Spitzberg 2003 ; van der Vleuten et al. 2019 ). Results from these tools must then be associated with others assessing underlying abilities, such as theory of mind and metacognition.

2.3.2. Institutional and Environmental Support for Development of Communication Skills

Although communication appears to be a key employability skill, the proficiency acquired during studies rarely meets the expectations of employers ( Jackson 2014 ). Communication must therefore become a priority in the training of students, beyond the sectors in which it is already known as essential (e.g., in medicine, nursing, engineering, etc.; Bourke et al. 2021 ; D’Alimonte et al. 2019 ; Peddle et al. 2018 ; Riemer 2007 ), and also through professional development ( Jackson 2014 ). Training programs involving, for example, communication theory classes ( Kruijver et al. 2000 ) and self-assessment tools that can be used in specific situations ( Curtis et al. 2013 ; Rider and Keefer 2006 ) have had convincingly positive results. The literature suggests that interactive approaches in small groups, in which competencies are practiced explicitly in an open and feedback-safe environment, are more effective ( Bourke et al. 2021 ; D’Alimonte et al. 2019 ; AbuSeileek 2012 ; Fryer-Edwards et al. 2006 ). These can take different forms: project-based work, video reviews, simulation or role-play games (see Hathaway et al. 2022 for a review; Schlegel et al. 2012 ). Finally, computer-assisted learning methods can be relevant for establishing a secure framework (especially, for example, when learning another language): anonymity indeed helps to overcome anxiety or social blockages linked to fear of public speaking or showing one’s difficulties ( AbuSeileek 2012 ). Each of these methods tackles one or more dimensions of communication that must then be assessed as such, by means of tools specifically developed and adapted to the contexts in which these skills are expressed (e.g., see the two 4Cs evaluation grids for institutions and for games outlined in Section 4 and Section 5 , below).

2.4. Collaboration

Collaborative problem solving—and more generally, collaboration—has gained increasing attention in national and international assessments (e.g., PISA) as an educational priority encompassing social, emotional, and cognitive skills critical to efficiency, effectiveness, and innovation in the modern global economy ( Graesser et al. 2018 ; OECD 2017 ). Understanding what makes effective collaboration is of crucial importance for professional practice and training ( Détienne et al. 2012 ; Graesser et al. 2018 ), as evidenced by the long line of research on group or team collaboration over the past 40 years (for a review, see e.g., Salas et al. 2004 ; Mathieu et al. 2017 ). Although there is no consensus on a definition of collaboration, scholars often see it as mutual engagement in a coordinated effort to achieve a common goal that involves the sharing of goals, resources, and representations relating to the joint activity of participants; and other important aspects relate to mutual respect, trust, responsibilities, and accountability within situational rules and norms ( Détienne et al. 2012 ).

In the teamwork research literature, skills are commonly described across three classes most often labeled Knowledge, Behavior, and Attitudes (e.g., Cannon-Bowers et al. 1995 ). Knowledge competencies refer to the skills related to elaborating the knowledge content required for the group to process and successfully achieve the task/goal to which they are assigned. Behavior includes skills related to the actualization of actions, coordination, communication, and interactions within the group as well as with any other relevant interlocutors for the task at hand. Note here that effective collaboration involves skills that have also been identified elsewhere as essential competencies, including communication, creativity, and critical thinking. Finally, several attitudes have been evidenced or hypothesized as desirable competencies in the team context, for example, attitude towards teamwork, collective orientation, cohesion/team morale, etc. Another common distinction lies between teamwork and taskwork. Teamwork refers to the collaborative, communicative, or social skills required to coordinate the work within the participants in order to achieve the task, whereas taskwork refers to specific aspects related to solving the task such as using the tools and knowing the procedure, policies, and any other task-related activities ( Salas et al. 2015 ; Graesser et al. 2018 ). Furthermore, collaborative competences can have specific (to a group of people or to a task) and general dimensions (i.e., easily transferable to any group or team situation and to other tasks). For example, skills related to communication, information exchange, conflict management, maintaining attention and motivation, leadership, etc. are present and transferable to a large number of group work situations and tasks (team-generic and task-contingent skills). Other skills can, on the other hand, be more specific to a team or group, such as internal organization, motivation, knowledge of the skills distributed in the team, etc.

2.4.1. Individual Assessment of Collaboration

Assessing collaboration requires capturing the dynamic and multi-level nature of the collaboration process, which is not as easily quantifiable as group/team inputs and outputs (task performance, satisfaction, and changes at group/team and individual level). There are indeed multiple interactions between the context, the collaboration processes, the task processes, and their (various) outcomes ( Détienne et al. 2012 ). The integrative concept of “quality of collaboration” ( Burkhardt et al. 2009 ) encapsulates much of what is currently known about collaborative processes and what constitutes effective collaboration. According to this approach, collaborative processes can be grouped along several dimensions concerning communication processes such as grounding, task-related processes (e.g., exchanges of knowledge relevant for the task at hand), and organization/coordination processes ( Burkhardt et al. 2009 ). Communication processes are most important for ensuring the construction of a common referential within a group of collaborators. Task-related processes relate to how the group resolves the task at hand by sharing and co-elaborating knowledge, by confronting their various perspectives, and by converging toward negotiated solutions. Collaboration also involves group management activities such as: (a) common goal management and coordination activities, e.g., allocation and planning of tasks; (b) meeting/interaction management activities, e.g., ordering and postponing of topics in the meeting. Finally, the ability to pursue reflexive activity, in the sense of reflecting not only on the content of a problem or solution but on one’s collaboration and problem-solving strategies, is critical for the development of the team and supports them in changing and improving their practices. Graesser et al. ( 2018 ) identify collaborative skills based on the combination of these dimensions with a step in the problem-solving process.

A large body of methodology developed to assess collaboration processes and collaborative tools has been focused on quantifying a restricted subset of fine-grained interactions (e.g., number of speakers’ turns; number of words spoken; number of interruptions; amount of grounding questions). This approach has at least two limitations. First, because these categories of analysis are often ad hoc with respect to the considered situation, they are difficult to apply in all situations and make it difficult to compare between studies. Second, quantitative variations of most of these indicators are non-univocal: any increase or decrease of them could signify either an interactive–intensive collaboration or else evidence of major difficulties in establishing and/or maintaining the collaboration ( Détienne et al. 2012 ). Alternatively, qualitative approaches based on multidimensional views of collaboration provide a more elaborated or nuanced view of collaboration and are useful for identifying potential relationships between distinctive dimensions of collaboration and aspects of team performance, in order to identify processes that could be improved. Based on the method of Spada et al. ( 2005 ) in Computer-Supported Collaborative Learning (CSCL) research, Burkhardt et al. ( 2009 ) have proposed a multi-dimensional rating scheme for evaluating the quality of collaboration (QC) in technology-mediated design. QC distinguishes seven dimensions, grouped along five aspects, identified as central for collaboration in a problem-solving task such as design: communication (1, 2), task-oriented processes (3, 4), group-oriented processes (5), symmetry in interaction—an orthogonal dimension—(6), and individual task orientation (7). This method has recently been adapted for use in the context of assessing games as a support to collaborative skills learning.

2.4.2. Institutional and Environmental Support for Development of Collaboration and Collaborative Skills

Support for individuals’ development of collaborative skills provided by institutions and programs can take a variety of forms: (a) through the social impact of the physical structure of the organization, (b) the nature of the work required within the curriculum, (c) content within the curriculum focusing on collaboration and collaborative skills, and (d) the existence and promotion of extracurricular and inter-institutional opportunities for collaboration.

For instance, institutional support for collaboration has taken a variety of forms in various fields such as healthcare, engineering, public participation, and education. Training and education programs such as Interprofessional Education or Team Sciences in the health domain ( World Health Organization 2010 ; Hager et al. 2016 ; O’Carroll et al. 2021 ), Peer-Led Team Learning in chemistry and engineering domains ( Wilson and Varma-Nelson 2016 ), or Collaborative Problem Solving in education ( Peña-López 2017 ; Taddei 2009 ) are notable examples.

Contextual support recently arose from the deployment of online digital media and new mixed realities in the workplace, in the learning environments and in society at large—obviously stimulated and accentuated with the COVID-19 pandemic. This has led many organizations to invest in proposing support for synchronous and asynchronous collaboration (notably remote, between employees, between students and educators or within group members, etc.) in various ways, including the provision of communication hardware and software, computer-supported cooperative work and computer-supported collaborative learning platforms, training and practical guides, etc. Users can collaborate through heterogeneous hybrid collaborative interaction spaces that can be accessed through virtual or augmented reality, but also simple video conferencing or even a voice-only or text-only interface. These new spaces for collaboration are, however, often difficult to use and less satisfactory than face-to-face interactions, suggesting the need for more research on collaborative activities and on how to support them ( Faidley 2018 ; Karl et al. 2022 ; Kemp and Grieve 2014 ; Singh et al. 2022 ; Waizenegger et al. 2020 ).

A substantive body of literature on teams, collaborative learning, and computer-supported technologies provides evidence related to individual, contextual, and technological factors impacting the collaboration quality and efficiency. For example, teacher-based skills that are critical for enhancing collaboration are, among others, the abilities to plan, monitor, support, consolidate, and reflect upon student interaction in group work ( Kaendler et al. 2016 ). Research focuses also on investigating the most relevant tasks and evaluating the possibilities offered by technology to support, to assess (e.g., Nouri et al. 2017 ; Graesser et al. 2018 ), and/or to learn the skills involved in pursuing effective and satisfying collaboration (see e.g., Schneider et al. 2018 ; Doyle 2021 ; Ainsworth and Chounta 2021 ).

3. Labelization: Valorization of the 4Cs and Assessing Support for Their Development

Moving from the nature of the 4Cs and their individual assessment and towards the ways in which institutions can support their development in individuals, we can now address the fundamentally important question of how best to support and promote this 21st century educational mission within and among institutions themselves. This also raises the question of the systemic recognition of educational settings that are conducive to the development of the 4Cs. In response to these questions, the nature and value of labelization is now presented.

A label is “a special mark created by a trusted third party and displayed on a product intended for sale, to certify its origin, to guarantee its quality and to ensure its conformity with the standards of practices in force” ( Renard 2005 ). A label is therefore a way of informing the public about the objective properties and qualities of a product, service, or system. The label is usually easily identifiable and can be seen as a proof that a product or service, a company, or an organization complies with defined criteria. Its effectiveness is therefore closely linked to the choice of requirements set out in its specifications, as well as to the independence and rigor of the body that verifies compliance with the criteria.

3.1. Labeling as a Means of Trust and Differentiation

As a sign of recognition established by a third party, the label or certification can constitute a proof of trust aiming to reassure the final consumer. According to Sutter ( 2005 ), there are different means of signaling trust. First, the brand name of a product or service and its reputation can, in itself, constitute a label when this brand name is recognized on the market. Second, various forms of self-declaration, such as internal company charters, though not statements assessed by a third party, show an internal commitment that can provide reassurance. Finally, there is certification or labeling, which is awarded by an external body and requires a third-party assessment by a qualified expert, according to criteria set out in a specific reference framework. It is this external body, a trusted third party, which guarantees the reliability of the label and constitutes a guarantee of credibility. Its objectivity and impartiality are meant to guarantee that the company, organization, product, or service meets defined quality or reliability criteria ( Jahn et al. 2005 ).

Research on populations around the world (e.g., Amron 2018 ; Sasmita and Suki 2015 ) show that the buying decisions of consumers are heavily influenced by the trust they have in a brand. More specifically, third-party assurances and labelization have been shown to strongly influence customer buying intentions and purchasing behavior (e.g., Kimery and McCord 2002 ; Lee et al. 2004 ). Taking France as an example, research shows that quality certification is seen as “important” or “significant” by 76% of companies ( Chameroy and Veran 2014 ), and decision makers feel more confident and are more willing to invest with the support of third-party approval than if their decision is merely based on the brand’s reputation or its demonstrated level of social responsibility ( Etilé and Teyssier 2016 ). Indeed, French companies with corporate social responsibility labels have been shown to have higher than average growth rates, and the adoption of quality standards is linked with a 7% increase in the share of export turnover ( Restout 2020 ).

3.2. Influence on Choice and Adoption of Goods and Services

Studies diverge in this area, but based on the seminal work of Parkinson ( 1975 ); Chameroy and Veran ( 2014 ), in their research on the effect of labels on willingness to pay, found that in 75% of cases, products with labels are chosen and preferred to those without labels, demonstrating the impact of the label on customer confidence—provided that it is issued by a recognized third party. Thus, brands that have good reputations tend to be preferred over cheaper new brands, because they are more accepted and valued by the individual social network ( Zielke and Dobbelstein 2007 ).

3.3. Process of Labelizing Products and Services

The creation of a label may be the result of a customer or market need, a request from a private sector of activity or from the government. Creating a label involves setting up a working group including stakeholders who are experts in the field, product managers, and a certification body in order to elaborate a reference framework. This is then reviewed by a specialized committee and validated by the stakeholders. The standard includes evaluation criteria that must be clearly defined ( Mourad 2017 ). An audit system is set up by a trusted third party. It must include the drafting of an audit report, a system for making decisions on labeling, and a system for identifying qualified assessors. The validity of the assessment process is reinforced by this double evaluation: a first level of audit carried out by a team of experts according to a clearly defined set of criteria and a second level of decision making assuring that the methodology and the result of the audit are in conformity with the defined reference framework.

3.4. Labelization of 21st Century Skills

The world of education is particularly concerned by the need to develop and assess 21st century skills, because it represents the first link in the chain of skills acquisition, preparing the human resources of tomorrow. One important means of simultaneously offering a reliable, independent assessment of 21st century skills and valorizing them by making them a core target within an educational system (schools, universities, and teaching and training programs of all kinds) is labelization. Two examples of labelization processes related to 21st century skills were recently developed by the International Institute for Competency Development ( 2021 ; see iicd.net; accessed on 20 November 2022) working with international experts, teachers, and researchers from the University of Paris Cité (formerly Université Sorbonne Paris Cité), Oxford University, and AFNOR UK (an accredited certification body and part of AFNOR International, a subsidiary of the AFNOR group, the only standards body in France).

The last two or three decades has seen the simultaneous rise of international ranking systems and an interest in quality assurance and assessment in an increasingly competitive educational market ( Sursock 2021 ). The aim of these labelization frameworks is to assist in the development of “quality culture” in education by offering individual programs, institutions, and systems additional independent, reliable means of benchmarking, charting progress, and distinguishing themselves based on their capacity to support and promote the development of crucial skills. Importantly, the external perspectives provided by such assessment system should be capable of being individually adapted and applied in a manner that can resist becoming rigidly imposed external standards ( Sursock and Vettori 2017 ). Similarly, as we have seen in the literature review, the best approach to understanding and assessing a particular C is from a combination of different levels and perspectives in context. For example, important approaches to critical thinking have been made from educationally, philosophically, and psychologically focused vantage points ( Lai 2011 ). We can also argue that understandings of creativity are also results of different approaches: the major models in the literature (e.g., the “4Ps” and “7Cs” models; see Lubart and Thornhill-Miller 2019 ) explicitly result from and include the objectives of different education-focused, process-focused, and “ingredient” or component-focused approaches.

The two assessment frameworks outlined in the sections that follow were formulated with these different perspectives and objective needs in mind. Given the complexity and very different natures of their respective targets (i.e., one assessing entire formal educational contexts such as institutions or programs, whereas the other targets the less multi-dimensional, informal educational activities represented by games), the assessment of the individual Cs also represents what experts consider a target-appropriate balance of education- and curriculum-focused, process-focused, and component-focused criteria for assessing each different C.

4. The International Institute for Competency Development’s 21st Century Competencies 4Cs Assessment Framework for Institutions and Programs

One comprehensive attempt to operationalize programmatic-level and institutional-level support for the development of the 4Cs is the International Institute for Competency Development’s 4Cs Assessment Framework ( International Institute for Competency Development 2021 ). Based upon expert opinion and a review of the available literature, this evaluation grid is a practical tool that divides each of the 4Cs into three “user-friendly” but topic-covering components (see Table 1 and definitions and further discussion in the sections that follow). Each of these components is then assessed across seven dimensions (see Table 2 , below), designed to cover concisely the pedagogical process and the educational context. Examples for each point level are provided within the evaluation grid in order to offer additional clarity for educational stakeholders and expert assessors.

Three different components of each C in IICD’s 21st Century Skills 4Cs Assessment Framework.

Creative ProcessCreative EnvironmentCreative Product
Critical thinking
about the world
Critical thinking
about oneself
Critical action and
decision making
Engagement and
participation
Perspective taking
and openness
Social regulation
Message formulationMessage deliveryMessage and
communication feedback

Seven dimensions evaluated for the 3 different components of each C.

Aspects of the overall educational program teaching, emphasizing, and promoting the 4Cs
Availability and access to different means, materials, space, and expertise, digital technologies, mnemonic and heuristic methods, etc. to assist in the proper use and exercise of the 4Cs
Actual student and program use of available resources promoting the 4Cs
Critical reflection and metacognition on the process being engaged in around the 4Cs
The formal and informal training, skills, and abilities of teachers/trainers and staff and their program of development as promoters of the 4Cs
Use and integration of the full range of resources external to the institution available to enhance the 4Cs
Availability of resources for students to create and actualize products, programs, events, etc. that require the exercise, promotion, or manifestation of the 4Cs

* Educational-level dependent and potentially less available for younger students or in some contexts.

The grid itself can be used in several important and different ways by different educational stakeholders: (1) by the institution itself in its self-evaluation and possible preparation for a certification or labelization process, (2) as an explicit list of criteria for external evaluation of the institution and its 4Cs-related programs, and (3) as a potential long-term development targeting tool for the institution or the institution in dialogue with the labelization process.

4.1. Evaluation Grid for Creativity

Dropping the component of “creative person” that is not relevant at the institutional level, this evaluation grid is based on Rhodes’ ( 1961 ) classic “4P” model of creativity, which remains the most concise model today ( Lubart and Thornhill-Miller 2019 ). The three “P” components retained are: creative process , creative environment , and creative product . Creative process refers to the acquisition of a set of tools and techniques that students can use to enhance the creativity of their thinking and work. Creative environment (also called “Press” in earlier literature) is about how the physical and social surroundings of students can help them be more creative. Finally, creative product refers to the evaluation of actual “productions” (e.g., a piece of art, text, speech, etc.) generated through the creative process.

4.2. Evaluation Grid for Critical Thinking

Our evaluation grid divides critical thinking into three main components: critical thinking about the world , critical thinking about oneself (self-reflection), as well as critical action and decision making . The first component refers to having an evidence-based view of the exterior world, notably by identifying and evaluating sources of information and using them to question current understandings and solve problems. Self-reflection refers to thinking critically about one’s own life situation, values, and actions; it presupposes the autonomy of thought and a certain distance as well as the most objective observation possible with regard to one’s own knowledge (“meta-cognition”). The third and final component, critical action and decision making, is about using critical thinking skills more practically in order to make appropriate life decisions as well as to be open to different points of view. This component also addresses soft skills and attitudes such as trusting information.

Our evaluation framework for critical thinking was in part inspired by Barnett’s “curriculum for critical being” (2015), whose model distinguishes two axes: one defined by the qualitative differences in the level of criticality attained and the second comprised of three different domains of application: formal knowledge, the self, and the world. The first two components of our framework (and the seven dimensions on which they are rated) reflect and encompass these three domains. Similar to Barrett’s proposal, our third rubric moves beyond the “skills-plus-dispositions” model of competency implicit in much theorizing about critical thinking and adds the importance of “action”—not just the ability to think critically and the disposition to do so, but the central importance of training and practicing “critical doing” ( Barnett 2015 ). Critical thinking should also be exercised collectively by involving students in collective thinking, facilitating the exchange of ideas and civic engagement ( Huber and Kuncel 2016 ).

4.3. Evaluation Grid for Collaboration

The first component of collaboration skills in the IICD grid is engagement and participation , referring to the active engagement in group work. Perspective taking and openness concerns the flexibility to work with and accommodate other group members and their points of view. The final dimension— social regulation —is about being able to reach for a common goal, notably through compromise and negotiation, as well as being aware of the different types of roles that group members can hold ( Hesse et al. 2015 ; Rusdin and Ali 2019 ; Care et al. 2016 ). (These last two components include elements of leadership, character, and emotional intelligence as sometimes described in other soft-skill and competency-related systems.) Participation, social regulation, and perspective taking have been identified as central social skills in collaborative problem solving ( Hesse et al. 2015 ). Regarding social regulation in this context, recognizing and profiting from group diversity is key ( Graesser et al. 2018 ). When describing an assessment in an educational setting of collaborative problem solving (with a task in which two or more students have to collaborate in order to solve it, each using a different set of resources), two main underpinning skills were described for the assessment: the social skill of audience awareness (“how to adapt one’s own behavior to suit the needs of the task and the partner’s requirements”, Care et al. 2016, p. 258 ) and the cognitive skill of planning and executing (developing a plan to reach for a goal) ( Care et al. 2016 ). The former is included in the perspective taking and openness rubric and the latter in the social regulation component in the IICD grid. Evans ( 2020 ) identified four main collaboration skills consistently mentioned in the scientific literature that are assessed in the IICD grid: the ability to plan and make group decisions (example item from the IICD grid: teachers provide assistance to students to overcome differences and reach a common goal during group work); the ability to communicate about thinking with the group (assessed notably in the meta-reflection strand of the IICD grid); the ability to contribute resources, ideas, and efforts and support group members (included notably in the engagement and participation as well as the social regulation components); and finally, the ability to monitor, reflect, and adapt individual and group processes to benefit the group (example item from the IICD grid: students use perspective-taking tools and techniques in group activities).

4.4. Evaluation Grid for Communication

The evaluation grid for communication is also composed of three dimensions: message formulation, message delivery, and message and communication feedback . Message formulation refers to the ability to design and structure a message to be sent, such as outlining the content of an argument. Message delivery is about effectively transmitting verbal and non-verbal aspects of a message. Finally, message and communication feedback refers to the ability of students and teachers to understand their audience, analyze their social surroundings, and interpret information in context. Other components of communication skills such as theory of mind, empathy, or emotional intelligence are also relevant and included in the process of applying the grid. Thompson ( 2020 ) proposes a four-component operationalized definition of communication for its assessment in students. First, they describe a comprehension strand covering the understanding and selection of adequate information from a range of sources. Message formulation in the IICD grid captures this dimension through its focus on content analysis and generation. Second, the presentation of information and ideas is mentioned in several different modes, adjusted to the intended audience, verbally as well as non-verbally. The message delivery component of the IICD grid focuses on these points. Third, the authors note the importance of communication technology and its advanced use. The IICD grid also covers the importance of technology use in its tools and techniques category, with, for example, an item that reads: students learn to effectively use a variety of formats of communication (social media, make a video, e-mail, letter writing, creating a document). Finally, Thompson ( 2020 ) describes the recognition of cultural and other differences as an important aspect of communication. The IICD grid aims at incorporating these aspects, notably in the meta-reflection category under each of the three dimensions.

5. Assessing the 4Cs in Informal Educational Contexts: The Example of Games

5.1. the 4cs in informal educational contexts.

So far, the focus has been on rather formal ways of nurturing the 4Cs. Although institutions and training programs are perhaps the most significant and necessary avenues of education, they are not the sole context in which 4Cs’ learning and improvement can manifest. One other important potential learning context is game play. Games are activities that are present and participated in throughout human society—by those of all ages, genders, and socio-economic statuses ( Bateson and Martin 2013 ; Huizinga 1949 ; Malaby 2007 ). This informal setting can also provide favorable conditions to help improve the 4Cs ( van Rosmalen et al. 2014 ) and should not be under-appreciated. Games provide a unique environment for learning, as they can foster a space to freely explore possibilities and one’s own potential ( de Freitas 2006 ). We argue that games are a significant potential pathway for the improvement of the 4Cs, and as such, they merit the same attention as more formal ways of learning and developing competencies.

5.2. 4Cs Evaluation Framework for Games

Compared to schools and educational institutions, the focus of IICD’s evaluation framework for games (see International Institute for Competency Development 2021 ) is more narrow. Thus, it is fundamentally different from the institutional grid: games, complex and deep as they can sometimes be, cannot directly be compared to the complexity of a school curriculum and all the programs it contains. The evaluation of a game’s effectiveness for training/improving a given C rests on the following principle: if a game presents affordances conducive to exercising a given skill, engaged playing of that game should help improve that skill.

The game’s evaluation grid is scored based on two criteria. For example, as a part of a game’s rating as a tool for the development of creativity, we determine the game must first meet two conditions. First, whether or not the game allows the opportunity for creativity to manifest itself: if creativity cannot occur in the game, it is obviously not eligible to receive ratings for that C. Second, whether or not creativity is needed in order to perform well in the game: if the players can win or achieve success in the game without needing creativity, this also means it cannot receive a rating for that C. If both conditions are met, however, the game will be considered potentially effective to improve creativity through the practice of certain components of creative behavior. This basic principle applies for all four of the Cs.

As outlined in Table 3 , below, the evaluation grid for each of the four Cs is composed of five components relevant to games that are different for each of the Cs. The grid works as follows: for each of the five components of each C, we evaluate the game on a list of sub-components using two yes/no scales: one for whether it is “possible” for that subcomponent to manifest and one for whether that sub-component is “required for success” in the game. This evaluation is done for all sub-components. After this, each general component is rated on the same two indicators. If 60% (i.e., three out of five) or more sub-components are positively rated as required, the general component is considered required. Then, the game is evaluated on its effectiveness for training and improving each of the 4Cs. If 60% or more components are positively rated as required, the game will be labelized as having the potential to be effective for training and improving the corresponding C.

Five different components evaluated for each C by the 4Cs assessment framework for games.

OriginalityDivergent ThinkingConvergent ThinkingMental FlexibilityCreative Dispositions
Goal-adequate judgment/ discernmentObjective thinkingMetacognitionElaborate eeasoningUncertainty management
Collaboration fluencyWell-argued deliberation and consensus-based decisionBalance of contributionOrganization and coordinationCognitive syncing, input, and support
Social InteractionsSocial cognitionMastery of written and spoken languageVerbal communicationNon-verbal communication

The evaluation grid for creativity is based on the multivariate model of creative potential (see Section 2.1.1 and Lubart et al. 2013 for more information) and is composed of four cognitive factors and one conative factor: originality , divergent thinking , convergent thinking , mental flexibility , and creative dispositions . Originality refers to the generation of ideas that are novel or unexpected, depending on the context. Divergent thinking corresponds to the generation of multiple ideas or solutions. Convergent thinking refers to the combination of multiple ideas and the selection of the most creative idea. Mental flexibility entails changing perspectives on a given problem and breaking away from initial ideas. Finally, creative dispositions concerns multiple personality-related factors conducive to creativity, such as openness to experience or risk taking.

The evaluation grid for critical thinking echoes Halpern’s ( 1998 ) as well as Marin and Halpern’s ( 2011 ) considerations for teaching this skill, that is, taking into consideration thinking skills, metacognition, and dispositions. The five components of the critical thinking grid are: goal-adequate discernment, objective thinking, metacognition, elaborate reasoning, and uncertainty management. Goal-adequate discernment entails the formulation of inferences and the discernment of contradictions when faced with a problem. Objective thinking corresponds to the suspension of one’s own judgment and the analysis of affirmations and sources in the most objective manner possible. Metacognition, here, is about questioning and reassessing information, as well as the awareness of one’s own cognitive biases. Elaborate reasoning entails reasoning in a way that is cautious, thorough, and serious. Finally, uncertainty management refers to the dispositional propensity to tolerate ambiguity and accept doubt.

The evaluation grid for collaboration is based on the quality of collaboration (QC) method ( Burkhardt et al. 2009 ; see Section 2.4.2 for more details) and is composed of the following five components: collaboration fluidity, well-argued deliberation and consensus-based decision, balance of contribution, organization and coordination, and cognitive syncing, input, and support. Collaboration fluidity entails the absence of speech overlap and the presence of a good flow in terms of turns to speak. Well-argued deliberation and consensus-based decision is about contributing to the discussion and task at hand, as well as participating in discussions and arguments, in order to obtain a consensus. Balance of contribution refers to having equal or equivalent contributions to organization, coordination, and decision making. Organization and coordination refers to effective management of roles, time, and “deadlines”, as well as the attribution of roles depending on participants’ skills. Finally, cognitive syncing, input, and support is about bringing ideas and resources to the group, as well as supporting and reinforcing other members of the group.

The five components used to evaluate communication in games include both linguistic, pragmatic, and social aspects. Linguistic skills per se are captured by the mastery of written and spoken language component. This component assesses language comprehension and the appropriate use of vocabulary. Pragmatic skills are captured by the verbal and non-verbal communication components and refer to the efficient use of verbal and body signals in the context of the game to achieve one’s communicative goals ( Grassmann 2014 ; Matthews 2014 ). Finally, the grid also evaluates social skills with its two last components, social interactions and social cognition, which, respectively, refer to the ability to interact with others appropriately—including by complying with the rules of the game—and to the understanding of other people’ mental states ( Tomasello 2005 ).

6. Discussion and Conclusions

Each of the 4Cs is a broad, multi-faceted concept that is the subject of a tremendous amount of research and discussion by a wide range of stakeholders in different disciplines, professions, and parts of the educational establishment. The development of evaluation frameworks to allow support for the 4Cs to be assessed and publicly recognized, using a label, is an important step for promoting and fostering these skills in educational contexts. As illustrated by IICD’s 4Cs Framework for educational institutions and programs, as well as its games/activities evaluation grid, the specific criteria to detect support for each C can vary depending upon the educational context (e.g., formal and institutional level or informal and at the activity level). Yet considering the 4Cs together highlights some additional observations, current challenges, and opportunities for the future that are worthy of discussion.

6.1. Interrelationships between the 4Cs and a New Model for Use in Pedagogy and Policy Promotion

One very important issue for understanding the 4Cs and their educational implementation that can be simultaneously a help and a hindrance for teaching them—and also a challenge when assessing them—is their multidimensionality and interrelatedness. In other words, the 4Cs are not entirely separate entities but instead, as Figure 2 shows, should be seen as four interlinked basic “elements” for future-oriented education that can help individuals in their learning process and, together, synergistically “bootstrap” the development of their cognitive potentials. Lamri and Lubart ( 2021 ), for example, found a certain base level of creativity was a necessary but not sufficient condition for success in managerial tasks, but that high-level performance required a combination of all four Cs. Some thinkers have argued that one cannot be creative without critical thinking, which also requires creativity, for example, to come up with alternative arguments (see Paul and Elder 2006 ). Similarly, among many other interrelationships, there is no collaboration without communication—and even ostensibly individual creativity is a “collaboration” of sorts with the general culture and precursors in a given field. As a result, it ranges from impossible to suboptimal to teach (or teach towards) one of the 4Cs without involving one or more of the others, and this commingling also underscores the genuine need and appropriateness of assessing them together.

An external file that holds a picture, illustration, etc.
Object name is jintelligence-11-00054-g002.jpg

“‘Crea-Critical-Collab-ication’: a Dynamic Interactionist Model of the 4Cs”. (Illustration of the interplay and interpenetration of creativity, critical thinking, collaboration, and communication shown in dimensional space according to their differing cognitive/individual vs. social/interpersonal emphases; (© 2023, Branden Thornhill-Miller. All Rights Reserved. thornhill-miller.com; accessed on 20 January 2023)).

From this perspective, Thornhill-Miller ( 2021 ) proposed a “dynamic interactionist model of the 4Cs” and their interrelated contributions to the future of education and work. Presented in Figure 2 , this model is meant to serve as a visual and conceptual aid for understanding the 4Cs and their interrelationships, thereby also promoting better use and understanding of them in pedagogical and policy settings. In addition to suggesting the portmanteau of “crea-critical thinking” as a new term to describe the overlap of much of the creative and critical thinking processes, the title of this model, “Crea-Critical-Collab-ication”, is a verbal representation of the fluid four-way interrelationship between the 4Cs visually represented in Figure 2 (a title meant to playfully repackage the 4Cs for important pedagogical and policy uses). This model goes further to suggest some dimensional differences in emphases that, roughly speaking, also often exist among the 4Cs: that is to say, the frequently greater emphasis on cognitive or individual elements at play in creativity and critical thinking in comparison to the social and interpersonal aspects more central to communication and collaboration ( Thornhill-Miller 2021 ).

Similarly focused on the need to promote a phase change towards future-oriented education, Lucas ( 2019 ) and colleagues have suggested conflating creative thinking and critical thinking in order to propose “3Cs” (creative thinking, communication, and collaboration) as new “foundational literacies” to symmetrically add to the 3Rs (Reading, wRiting, and aRithmetic) of previous educational eras. Although we applaud these efforts, from our applied research perspective, we believe that the individual importance of, and distinct differences between, creative thinking and critical thinking support preserving them both as separate constructs in order to encourage the greatest development of each of them. Moreover, if only three categories were somehow required or preferable, one could argue that uniting communication and collaboration (as “collab-ication” suggests) might be preferable—particularly also given the fact that substantial aspects of communication are already covered within the 3Rs. In any case, we look forward to more such innovations and collaborations in this vibrant and important area of work at the crossroads between research, pedagogy, and policy development.

6.2. Limitations and Future Work

The rich literature in each of the 4Cs domains shows the positive effects of integrating these dimensions into educational and professional curricula. At the same time, the complexity of their definitions makes them difficult to assess, both in terms of reliability (assessment must not vary from one measurement to another) and of validity (tests must measure that which they are intended to measure). However, applied research in this area is becoming increasingly rigorous, with a growing capacity to provide the necessary tools for evidence-based practice. The development of these practices should involve interdisciplinary teams of teachers and other educational practitioners who are equipped and trained accordingly. Similarly, on the research side, further exploration and clarification of subcomponents of the 4Cs and other related skills will be important. Recent efforts to clarify the conceptual overlap and hierarchical relations of soft skills for the future of education and work, for example, have been helpful and promising (e.g., Joie-La Marle et al. 2022 ; Lamri et al. 2022 ). But the most definitive sort of taxonomy and measurement model that we are currently lacking might only be established based on the large-scale administration of a comprehensive battery of skill-measuring psychometric tests on appropriate cross sections of society.

The rapid development and integration of new technologies will also aid and change the contexts, resources, and implementation of the 4Cs. For example, the recent developments make it clear that the 4Cs will be enhanced and changed by interaction with artificially intelligence, even as 4Cs-related skills will probably, for the same reason, increasingly constitute the core of available human work in the future (see, e.g., Ross 2018 ). Similarly, research on virtual reality and creativity suggest that VR environments assist and expand individual and collaborative creativity ( Bourgeois-Bougrine et al. 2022 ). Because VR technologies offer the possibility of enhanced and materially enriched communication, collaboration, and information availability, they not only allow for the enhancement of creativity techniques but also for similar expansions and improvements on almost all forms of human activity (see Thornhill-Miller and Dupont 2016 )—including the other three Cs.

6.3. Conclusion: Labelization of the 4Cs and the Future of Education and Work

Traditional educational approaches cannot meet the educational needs of our emergent societies if they do not teach, promote, and assess in line with the new learner characteristics and contexts of the 21st century ( Sahin 2009 ). The sort of future-oriented change and development required by this shift in institutional practices, programming, and structure will likely meet with significant resistance from comfortably entrenched (and often outdated) segments of traditional educational and training establishments. Additional external evaluation and monitoring is rarely welcome by workers in any context. We believe, however, that top-down processes from the innovative and competition-conscious administrative levels will be met by bottom-up demands from students and education consumers to support these institutional changes. And we contend that efforts such as labelizing 4C processes will serve to push educators and institutions towards more relevant offerings, oriented towards the future of work and helping build a more successful future for all.

In the end, the 4Cs framework seems to be a manageable, focused model for modernizing education, and one worthy of its growing prevalence in the educational and research marketplace for a number of reasons. These reasons include the complexity and cumbersome nature of larger alternative systems and the 4Cs’ persuasive presence at the core of a number of early and industry-driven frameworks. In addition, the 4Cs have benefitted from their subsequent promotion by organizations such as the OECD and the World Economic Forum, as well as some more direct support from recent empirical research. The promotion, teaching, and assessment of the 4Cs will require a complex social intervention and mobilization of educational resources—a major shift in pedagogy and institutional structures. Yet the same evolving digital technologies that have largely caused the need for these massive, rapid changes can also assist in the implementation of solutions ( van Laar et al. 2017 ). To the extent that future research also converges on such a model (that has already been found pedagogically useful and policy-friendly by so many individuals and organizations), the 4Cs framework has the potential to become a manageable core for 21st century skills and the future of education and work—one that stakeholders with various agendas can already begin building on for a better educational and economic future together.

Funding Statement

This research received no external funding.

Author Contributions

Conceptualization, B.T.-M. and T.L.; writing—original draft preparation, B.T.-M., A.C., M.M., J.-M.B., T.M., S.B.-B., S.E.H., F.V., M.A.-L., C.F., D.S., F.M.; writing—review and editing, B.T.-M., A.C., T.L., J.-M.B., C.F.; visualization, B.T.-M.; supervision, B.T.-M., T.L.; project administration, B.T.-M., T.L. All authors have read and agreed to the published version of the manuscript.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Data availability statement, conflicts of interest.

B.T.-M. and T.L. are unpaid academic co-founder and project collaborator for the International Institute for Competency Development, whose labelization frameworks (developed in cooperation with Afnor International and the LaPEA lab of Université Paris Cité and Université Gustave Eiffel) are used as examples in this review. S.E.H. and M.A.-L. are employees of AFNOR International. No funding was received to support this research or article, which reflects the views of the scientists and researchers and not their organizations or companies.

Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

  • Abrami Philip C., Bernard Robert M., Borokhovski Eugene, Waddington David I., Wade C. Anne, Persson Tonje. Strategies for Teaching Students to Think Critically: A Meta-Analysis. Review of Educational Research. 2015; 85 :275–314. doi: 10.3102/0034654314551063. [ CrossRef ] [ Google Scholar ]
  • AbuSeileek Ali Farhan. The Effect of Computer-Assisted Cooperative Learning Methods and Group Size on the EFL Learners’ Achievement in Communication Skills. Computers & Education. 2012; 58 :231–39. doi: 10.1016/j.compedu.2011.07.011. [ CrossRef ] [ Google Scholar ]
  • Ahern Aoife, Dominguez Caroline, McNally Ciaran, O’Sullivan John J., Pedrosa Daniela. A Literature Review of Critical Thinking in Engineering Education. Studies in Higher Education. 2019; 44 :816–28. doi: 10.1080/03075079.2019.1586325. [ CrossRef ] [ Google Scholar ]
  • Ainsworth Shaaron E., Chounta Irene-Angelica. The roles of representation in computer-supported collaborative learning. In: Cress Ulrike, Rosé Carolyn, Wise Alyssa Friend, Oshima Jun., editors. International Handbook of Computer-Supported Collaborative Learning. Springer; Cham: 2021. pp. 353–69. [ CrossRef ] [ Google Scholar ]
  • Alsaleh Nada J. Teaching Critical Thinking Skills: Literature Review. [(accessed on 1 November 2022)]; The Turkish Online Journal of Educational Technology. 2020 19 :21–39. Available online: http://files.eric.ed.gov/fulltext/EJ1239945.pdf [ Google Scholar ]
  • Al-Samarraie Hosam, Hurmuzan Shuhaila. A Review of Brainstorming Techniques in Higher Education. Thinking Skills and Creativity. 2018; 27 :78–91. doi: 10.1016/j.tsc.2017.12.002. [ CrossRef ] [ Google Scholar ]
  • Amabile Teresa M. Social Psychology of Creativity: A Consensual Assessment Technique. Journal of Personality and Social Psychology. 1982; 43 :997–1013. doi: 10.1037/0022-3514.43.5.997. [ CrossRef ] [ Google Scholar ]
  • Amron Manajemen Pemasaran. The influence of brand image, brand trust, product quality, and price on the consumer’s buying decision of MPV cars. European Scientific Journal. 2018; 14 :228–39. doi: 10.19044/esj.2018.v14n13p228. [ CrossRef ] [ Google Scholar ]
  • Ananiadoui Katerina, Claro Magdalean. 21st Century Skills and Competences for New Millennium Learners in OECD Countries. OECD Publishing; Paris: 2009. OECD Education Working Papers, No. 41. [ CrossRef ] [ Google Scholar ]
  • Bailin Sharon. Achieving Extraordinary Ends: An Essay on Creativity. Springer; Dordrecht: 1988. [ CrossRef ] [ Google Scholar ]
  • Bandyopadhyay Subir, Szostek Jana. Thinking Critically about Critical Thinking: Assessing Critical Thinking of Business Students Using Multiple Measures. Journal of Education for Business. 2019; 94 :259–70. doi: 10.1080/08832323.2018.1524355. [ CrossRef ] [ Google Scholar ]
  • Barber Herbert F. Developing Strategic Leadership: The US Army War College Experience. Journal of Management Development. 1992; 11 :4–12. doi: 10.1108/02621719210018208. [ CrossRef ] [ Google Scholar ]
  • Barnett Ronald. The Palgrave Handbook of Critical Thinking in Higher Education. Palgrave Macmillan US; New York: 2015. A Curriculum for Critical Being; pp. 63–76. [ CrossRef ] [ Google Scholar ]
  • Bateson Patrick, Martin Paul. Play, Playfulness, Creativity and Innovation. Cambridge University Press; Cambridge: 2013. [ CrossRef ] [ Google Scholar ]
  • Batey Mark. The Measurement of Creativity: From Definitional Consensus to the Introduction of a New Heuristic Framework. Creativity Research Journal. 2012; 24 :55–65. doi: 10.1080/10400419.2012.649181. [ CrossRef ] [ Google Scholar ]
  • Battelle for Kids Framework for 21st Century Learning Definitions. 2022. [(accessed on 1 November 2022)]. Available online: http://static.battelleforkids.org/documents/p21/P21_Framework_DefinitionsBFK.pdf
  • Bellaera Lauren, Weinstein-Jones Yana, Ilie Sonia, Baker Sara T. Critical Thinking in Practice: The Priorities and Practices of Instructors Teaching in Higher Education. Thinking Skills and Creativity. 2021; 41 :100856. doi: 10.1016/j.tsc.2021.100856. [ CrossRef ] [ Google Scholar ]
  • Blessinger Patrick, Anchan John P. In: Democratizing Higher Education: International Comparative Perspectives. 1st ed. Blessinger Patrick, Anchan John P., editors. Routledge; London: 2015. [(accessed on 1 November 2022)]. Available online: https://www.routledge.com/Democratizing-Higher-Education-International-Comparative-Perspectives/Blessinger-Anchan/p/book/9781138020955 [ Google Scholar ]
  • Bloom Benjamin Samuel., editor. Taxonomy of Educational Objectives: The Classification of Educational Goals: Handbook I, Cognitive Domain. Longmans; New York: 1956. [ Google Scholar ]
  • Bourgeois-Bougrine Samira. The Palgrave Encyclopedia of the Possible. Springer International Publishing; Cham: 2022. Design Thinking. [ CrossRef ] [ Google Scholar ]
  • Bourgeois-Bougrine Samira, Bonnardel Nathalie, Burkhardt Jean-Marie, Thornhill-Miller Branden, Pahlavan Farzaneh, Buisine Stéphanie, Guegan Jérôme, Pichot Nicolas, Lubart Todd. Immersive Virtual Environments’ Impact on Individual and Collective Creativity: A Review of Recent Research. European Psychologist. 2022; 27 :237–53. doi: 10.1027/1016-9040/a000481. [ CrossRef ] [ Google Scholar ]
  • Bourke Sharon L., Cooper Simon, Lam Louisa, McKenna Lisa. Undergraduate Health Professional Students’ Team Communication in Simulated Emergency Settings: A Scoping Review. Clinical Simulation in Nursing. 2021; 60 :42–63. doi: 10.1016/j.ecns.2021.07.004. [ CrossRef ] [ Google Scholar ]
  • Brookfield Stephen D. Assessing Critical Thinking. New Directions for Adult and Continuing Education. 1997; 75 :17–29. doi: 10.1002/ace.7502. [ CrossRef ] [ Google Scholar ]
  • Burkhardt Jean-Marie, Détienne Françoise, Hébert Anne-Marie, Perron Laurence. Human-Computer Interaction—INTERACT 2009. Springer; Berlin/Heidelberg: 2009. Assessing the ‘Quality of Collaboration’ in Technology-Mediated Design Situations with Several Dimensions; pp. 157–60. [ CrossRef ] [ Google Scholar ]
  • Camarda Anaëlle, Bouhours Lison, Osmont Anaïs, Masson Pascal Le, Weil Benoît, Borst Grégoire, Cassotti Mathieu. Opposite Effect of Social Evaluation on Creative Idea Generation in Early and Middle Adolescents. Creativity Research Journal. 2021; 33 :399–410. doi: 10.1080/10400419.2021.1902174. [ CrossRef ] [ Google Scholar ]
  • Cannon-Bowers Janis, Tannenbaum Scott I., Salas Eduardo, Volpe Catherine E. Defining team competencies and establishing team training requirements. In: Guzzo Richard A., Salas Eduardo., editors. Team Effectiveness and Decision Making in Organizations. Jossey-Bass; San Francisco: 1995. pp. 333–80. [ Google Scholar ]
  • Care Esther, Scoular Claire, Griffin Patrick. Assessment of Collaborative Problem Solving in Education Environments. Applied Measurement in Education. 2016; 29 :250–64. doi: 10.1080/08957347.2016.1209204. [ CrossRef ] [ Google Scholar ]
  • Care Esther, Kim Helyn, Vista Alvin, Anderson Kate. Education System Alignment for 21st Century Skills: Focus on Assessment. Brookings Institution; Washington, DC: 2018. [ Google Scholar ]
  • Carmichael Erst, Farrell Helen. Evaluation of the Effectiveness of Online Resources in Developing Student Critical Thinking: Review of Literature and Case Study of a Critical Thinking Online Site. Journal of University Teaching and Learning Practice. 2012; 9 :38–55. doi: 10.53761/1.9.1.4. [ CrossRef ] [ Google Scholar ]
  • Carson Shelley H., Peterson Jordan B., Higgins Daniel M. Reliability, Validity, and Factor Structure of the Creative Achievement Questionnaire. Creativity Research Journal. 2005; 17 :37–50. doi: 10.1207/s15326934crj1701_4. [ CrossRef ] [ Google Scholar ]
  • Casey Betty J., Getz Sarah, Galvan Adriana. The Adolescent Brain. Developmental Review: DR. 2008; 28 :62–77. doi: 10.1016/j.dr.2007.08.003. [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • Cassotti Mathieu, Camarda Anaëlle, Poirel Nicolas, Houdé Olivier, Agogué Marine. Fixation Effect in Creative Ideas Generation: Opposite Impacts of Example in Children and Adults. Thinking Skills and Creativity. 2016; 19 :146–52. doi: 10.1016/j.tsc.2015.10.008. [ CrossRef ] [ Google Scholar ]
  • Chameroy Fabienne, Veran Lucien. Immatérialité de La Qualité et Effet Des Labels Sur Le Consentement à Payer. Management International. 2014; 18 :32–44. doi: 10.7202/1025088ar. [ CrossRef ] [ Google Scholar ]
  • Chiu Fa-Chung. Improving Your Creative Potential without Awareness: Overinclusive Thinking Training. Thinking Skills and Creativity. 2015; 15 :1–12. doi: 10.1016/j.tsc.2014.11.001. [ CrossRef ] [ Google Scholar ]
  • Chulvi Vicente, Mulet Elena, Chakrabarti Amaresh, López-Mesa Belinda, González-Cruz Carmen. Comparison of the Degree of Creativity in the Design Outcomes Using Different Design Methods. Journal of Engineering Design. 2012; 23 :241–69. doi: 10.1080/09544828.2011.624501. [ CrossRef ] [ Google Scholar ]
  • Cinque Maria. ‘Lost in Translation’. Soft Skills Development in European Countries. Tuning Journal for Higher Education. 2016; 3 :389–427. doi: 10.18543/tjhe-3(2)-2016pp389-427. [ CrossRef ] [ Google Scholar ]
  • Cömert Musa, Zill Jördis Maria, Christalle Eva, Dirmaier Jörg, Härter Martin, Scholl Isabelle. Assessing Communication Skills of Medical Students in Objective Structured Clinical Examinations (OSCE) - A Systematic Review of Rating Scales. PLoS ONE. 2016; 11 :e0152717. doi: 10.1371/journal.pone.0152717. [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • Corazza Giovanni Emanuele. Potential Originality and Effectiveness: The Dynamic Definition of Creativity. Creativity Research Journal. 2016; 28 :258–67. doi: 10.1080/10400419.2016.1195627. [ CrossRef ] [ Google Scholar ]
  • Corazza Giovanni Emanuele, Darbellay Frédéric, Lubart Todd, Panciroli Chiara. Developing Intelligence and Creativity in Education: Insights from the Space–Time Continuum. In: Lemmetty Soila, Collin Kaija, Glăveanu Vlad, Forsman Panu., editors. Creativity and Learning. Springer International Publishing; Cham: 2021. pp. 69–87. [ CrossRef ] [ Google Scholar ]
  • Cotter Katherine N., Beghetto Ronald A., Kaufman James C. Creativity in the Classroom: Advice for Best Practices. In: Lubart Todd, Botella Marion, Bourgeois-Bougrine Samira, Caroff Xavier, Guégan Jérôme, Mouchiroud Christohe, Nelson Julien, Zenasni Franck., editors. Homo Creativus. Springer International Publishing; Cham: 2022. pp. 249–64. [ CrossRef ] [ Google Scholar ]
  • Curtis J. Randall, Back Anthony L., Ford Dee W., Downey Lois, Shannon Sarah E., Doorenbos Ardith Z., Kross Erin K., Reinke Lynn F., Feemster Laura C., Edlund Barbara, et al. Effect of Communication Skills Training for Residents and Nurse Practitioners on Quality of Communication with Patients with Serious Illness: A Randomized Trial. JAMA: The Journal of the American Medical Association. 2013; 310 :2271. doi: 10.1001/jama.2013.282081. [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • D’Alimonte Laura, McLaney Elizabeth, Prospero Lisa Di. Best Practices on Team Communication: Interprofessional Practice in Oncology. Current Opinion in Supportive and Palliative Care. 2019; 13 :69–74. doi: 10.1097/SPC.0000000000000412. [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • de Freitas Sara. Learning in Immersive Worlds: A Review of Game-Based Learning. JISC; Bristol: 2006. [(accessed on 1 November 2022)]. Available online: http://www.jisc.ac.uk/media/documents/programmes/elearninginnovation/gamingreport_v3.pdf [ Google Scholar ]
  • Détienne Françoise, Baker Michael, Burkhardt Jean-Marie. Perspectives on Quality of Collaboration in Design. CoDesign. 2012; 8 :197–99. doi: 10.1080/15710882.2012.742350. [ CrossRef ] [ Google Scholar ]
  • Diedrich Jennifer, Jauk Emanuel, Silvia Paul J., Gredlein Jeffrey M., Neubauer Aljoscha C., Benedek Mathias. Assessment of Real-Life Creativity: The Inventory of Creative Activities and Achievements (ICAA) Psychology of Aesthetics, Creativity, and the Arts. 2018; 12 :304–16. doi: 10.1037/aca0000137. [ CrossRef ] [ Google Scholar ]
  • Doyle Denise. Creativity in the Twenty First Century. Edited by Anna Hui and Christian Wagner. Springer International Publishing; Cham: 2021. Creative and Collaborative Practices in Virtual Immersive Environments; pp. 3–19. [ CrossRef ] [ Google Scholar ]
  • Drisko James W. Competencies and Their Assessment. Journal of Social Work Education. 2014; 50 :414–26. doi: 10.1080/10437797.2014.917927. [ CrossRef ] [ Google Scholar ]
  • Dul Jan, Ceylan Canan. Work Environments for Employee Creativity. Ergonomics. 2011; 54 :12–20. doi: 10.1080/00140139.2010.542833. [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • Dumitru Daniela, Bigu Dragos, Elen Jan, Ahern Aoife, McNally Ciaran, O’Sullivan John. A European Review on Critical Thinking Educational Practices in Higher Education Institutions. UTAD; Vila Real: 2018. [(accessed on 2 November 2022)]. Available online: http://repositorio.utad.pt/handle/10348/8320 [ Google Scholar ]
  • Edelman Jonathan, Owoyele Babajide, Santuber Joaquin. Design Thinking in Education. Springer International Publishing; Cham: 2022. Beyond Brainstorming: Introducing Medgi, an Effective, Research-Based Method for Structured Concept Development; pp. 209–32. [ CrossRef ] [ Google Scholar ]
  • Etilé Fabrice, Teyssier Sabrina. Signaling Corporate Social Responsibility: Third-Party Certification versus Brands: Signaling CSR: Third-Party Certification versus Brands. The Scandinavian Journal of Economics. 2016; 118 :397–432. doi: 10.1111/sjoe.12150. [ CrossRef ] [ Google Scholar ]
  • Evans Carla. Measuring Student Success Skills: A Review of the Literature on Collaboration. National Center for the Improvement of Educational Assessment; Dover: 2020. [ Google Scholar ]
  • Facione Peter Arthur. The California Critical Thinking Skills Test–College Level. Technical Report# 1. Experimental Validation and Content Validity. [(accessed on 2 November 2022)]; 1990a Available online: https://files.eric.ed.gov/fulltext/ED327549.pdf
  • Facione Peter Arthur. Critical Thinking: A Statement of Expert Consensus for Purposes of Educational Assessment and Instruction. Research Findings and Recommendations. ERIC, Institute of Education Sciences; Washington, DC: 1990b. [(accessed on 2 November 2022)]. pp. 1–112. Available online: https://eric.ed.gov/?id=ED315423 [ Google Scholar ]
  • Facione Peter Arthur. Critical thinking: What it is and why it counts. Insight Assessment. 2011; 2007 :1–23. [ Google Scholar ]
  • Faidley Joel. Ph.D. dissertation. East Tennessee State University; Johnson City, TN, USA: 2018. Comparison of Learning Outcomes from Online and Face-to-Face Accounting Courses. [ Google Scholar ]
  • Friedman Hershey H. Cognitive Biases That Interfere with Critical Thinking and Scientific Reasoning: A Course Module. SSRN Electronic Journal. 2017:1–60. doi: 10.2139/ssrn.2958800. [ CrossRef ] [ Google Scholar ]
  • Fryer-Edwards Kelly, Arnold Robert M., Baile Walter, Tulsky James A., Petracca Frances, Back Anthony. Reflective Teaching Practices: An Approach to Teaching Communication Skills in a Small-Group Setting. Academic Medicine: Journal of the Association of American Medical Colleges. 2006; 81 :638–44. doi: 10.1097/01.ACM.0000232414.43142.45. [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • Glăveanu Vlad Petre. Rewriting the Language of Creativity: The Five A’s Framework. Review of General Psychology: Journal of Division 1, of the American Psychological Association. 2013; 17 :69–81. doi: 10.1037/a0029528. [ CrossRef ] [ Google Scholar ]
  • Glăveanu Vlad Petre. The Psychology of Creativity: A Critical Reading. Creativity Theories Research Applications. 2014; 1 :10–32. doi: 10.15290/ctra.2014.01.01.02. [ CrossRef ] [ Google Scholar ]
  • Goldenberg Olga, Wiley Jennifer. Quality, Conformity, and Conflict: Questioning the Assumptions of Osborn’s Brainstorming Technique. The Journal of Problem Solving. 2011; 3 :96–118. doi: 10.7771/1932-6246.1093. [ CrossRef ] [ Google Scholar ]
  • Graesser Arthur C., Sabatini John P., Li Haiying. Educational Psychology Is Evolving to Accommodate Technology, Multiple Disciplines, and Twenty-First-Century Skills. Annual Review of Psychology. 2022; 73 :547–74. doi: 10.1146/annurev-psych-020821-113042. [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • Graesser Arthur C., Fiore Stephen M., Greiff Samuel, Andrews-Todd Jessica, Foltz Peter W., Hesse Friedrich W. Advancing the Science of Collaborative Problem Solving. Psychological Science in the Public Interest. 2018; 19 :59–92. doi: 10.1177/1529100618808244. [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • Grassmann Susanne. The pragmatics of word learning. In: Matthews Danielle., editor. Pragmatic Development in First Language Acquisition. John Benjamins Publishing Company; Amsterdam: 2014. pp. 139–60. [ CrossRef ] [ Google Scholar ]
  • Hager Keri, St Hill Catherine, Prunuske Jacob, Swanoski Michael, Anderson Grant, Lutfiyya May Nawal. Development of an Interprofessional and Interdisciplinary Collaborative Research Practice for Clinical Faculty. Journal of Interprofessional Care. 2016; 30 :265–67. doi: 10.3109/13561820.2015.1092951. [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • Halpern Diane F. Teaching Critical Thinking for Transfer across Domains: Disposition, Skills, Structure Training, and Metacognitive Monitoring. The American Psychologist. 1998; 53 :449–55. doi: 10.1037/0003-066X.53.4.449. [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • Halpern Diane F., Dunn Dana S. Critical Thinking: A Model of Intelligence for Solving Real-World Problems. Journal of Intelligence. 2021; 9 :22. doi: 10.3390/jintelligence9020022. [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • Hanover Research A Crosswalk of 21st Century Skills. 2012. [(accessed on 15 August 2022)]. Available online: http://www.hanoverresearch.com/wp-content/uploads/2011/12/A-Crosswalk-of-21st-Century-Skills-Membership.pdf
  • Hathaway Julia R., Tarini Beth A., Banerjee Sushmita, Smolkin Caroline O., Koos Jessica A., Pati Susmita. Healthcare Team Communication Training in the United States: A Scoping Review. Health Communication. 2022:1–26. doi: 10.1080/10410236.2022.2036439. [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • Hesse Friedrich, Care Esther, Buder Juergen, Sassenberg Kai, Griffin Patrick. A Framework for Teachable Collaborative Problem Solving Skills. In: Griffin Patrick, Care Esther., editors. Assessment and Teaching of 21st Century Skills. Springer Netherlands; Dordrecht: 2015. pp. 37–56. [ Google Scholar ]
  • Hitchcock David. Critical Thinking. In: Edward Nouri Zalta., editor. The Stanford Encyclopedia of Philosophy (Fall 2020 Edition) Stanford University; Stanford: 2020. [ Google Scholar ]
  • Houdé Olivier. Inhibition and cognitive development: Object, number, categorization, and reasoning. Cognitive Development. 2000; 15 :63–73. doi: 10.1016/S0885-2014(00)00015-0. [ CrossRef ] [ Google Scholar ]
  • Houdé Olivier, Borst Grégoire. Measuring inhibitory control in children and adults: Brain imaging and mental chronometry. Frontiers in Psychology. 2014; 5 :616. doi: 10.3389/fpsyg.2014.00616. [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • Huber Christopher R., Kuncel Nathan R. Does College Teach Critical Thinking? A Meta-Analysis. Review of Educational Research. 2016; 86 :431–68. doi: 10.3102/0034654315605917. [ CrossRef ] [ Google Scholar ]
  • Huizinga Johan. Homo Ludens: A Study of the Play-Elements in Culture. Routledge; London: 1949. [ Google Scholar ]
  • Humphrey Neil, Curran Andrew, Morris Elisabeth, Farrell Peter, Woods Kevin. Emotional Intelligence and Education: A Critical Review. Educational Psychology. 2007; 27 :235–54. doi: 10.1080/01443410601066735. [ CrossRef ] [ Google Scholar ]
  • International Institute for Competency Development 21st Century Skills 4Cs Labelization. 2021. [(accessed on 2 November 2022)]. Available online: https://icd-hr21.org/offers/21st-century-competencies/
  • Jackson Denise. Business Graduate Performance in Oral Communication Skills and Strategies for Improvement. The International Journal of Management Education. 2014; 12 :22–34. doi: 10.1016/j.ijme.2013.08.001. [ CrossRef ] [ Google Scholar ]
  • Jahn Gabriele, Schramm Matthias, Spiller Achim. The Reliability of Certification: Quality Labels as a Consumer Policy Tool. Journal of Consumer Policy. 2005; 28 :53–73. doi: 10.1007/s10603-004-7298-6. [ CrossRef ] [ Google Scholar ]
  • Jauk Emanuel, Benedek Mathias, Neubauer Aljoscha C. The Road to Creative Achievement: A Latent Variable Model of Ability and Personality Predictors. European Journal of Personality. 2014; 28 :95–105. doi: 10.1002/per.1941. [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • Joie-La Marle Chantal, Parmentier François, Coltel Morgane, Lubart Todd, Borteyrou Xavier. A Systematic Review of Soft Skills Taxonomies: Descriptive and Conceptual Work. 2022. [(accessed on 2 November 2022)]. Available online: [ CrossRef ]
  • Jones Stanley E., LeBaron Curtis D. Research on the Relationship between Verbal and Nonverbal Communication: Emerging Integrations. The Journal of Communication. 2002; 52 :499–521. doi: 10.1111/j.1460-2466.2002.tb02559.x. [ CrossRef ] [ Google Scholar ]
  • Kaendler Celia, Wiedmann Michael, Leuders Timo, Rummel Nikol, Spada Hans. Monitoring Student Interaction during Collaborative Learning: Design and Evaluation of a Training Program for Pre-Service Teachers. Psychology Learning & Teaching. 2016; 15 :44–64. doi: 10.1177/1475725716638010. [ CrossRef ] [ Google Scholar ]
  • Kahneman Daniel. A Perspective on Judgment and Choice: Mapping Bounded Rationality. The American Psychologist. 2003; 58 :697–720. doi: 10.1037/0003-066X.58.9.697. [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • Kahneman Daniel. Thinking, Fast and Slow. Macmillan; New York: 2011. [ Google Scholar ]
  • Karl Katherine A., Peluchette Joy V., Aghakhani Navid. Virtual Work Meetings during the COVID-19 Pandemic: The Good, Bad, and Ugly. Small Group Research. 2022; 53 :343–65. doi: 10.1177/10464964211015286. [ CrossRef ] [ Google Scholar ]
  • Keefer Kateryna V., Parker James D. A., Saklofske Donald H. The Springer Series on Human Exceptionality. Springer International Publishing; Cham: 2018. Three Decades of Emotional Intelligence Research: Perennial Issues, Emerging Trends, and Lessons Learned in Education: Introduction to Emotional Intelligence in Education; pp. 1–19. [ Google Scholar ]
  • Kemp Nenagh, Grieve Rachel. Face-to-Face or Face-to-Screen? Undergraduates’ Opinions and Test Performance in Classroom vs. Online Learning. Frontiers in Psychology. 2014; 5 :1278. doi: 10.3389/fpsyg.2014.01278. [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • Kimery Kathryn, McCord Mary. Third-Party Assurances: Mapping the Road to Trust in E-retailing. The Journal of Information Technology Theory and Application. 2002; 4 :63–82. [ Google Scholar ]
  • Kohn Nicholas W., Smith Steven M. Collaborative Fixation: Effects of Others’ Ideas on Brainstorming. Applied Cognitive Psychology. 2011; 25 :359–71. doi: 10.1002/acp.1699. [ CrossRef ] [ Google Scholar ]
  • Kowaltowski Doris C. C. K., Bianchi Giovana, de Paiva Valéria Teixeira. Methods That May Stimulate Creativity and Their Use in Architectural Design Education. International Journal of Technology and Design Education. 2010; 20 :453–76. doi: 10.1007/s10798-009-9102-z. [ CrossRef ] [ Google Scholar ]
  • Kruijver Irma P. M., Kerkstra Ada, Francke Anneke L., Bensing Jozien M., van de Wiel Harry B. M. Evaluation of Communication Training Programs in Nursing Care: A Review of the Literature. Patient Education and Counseling. 2000; 39 :129–45. doi: 10.1016/S0738-3991(99)00096-8. [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • Lai Emily R. Critical thinking: A literature review. Pearson’s Research Reports. 2011; 6 :40–41. doi: 10.25148/lawrev.11.2.3. [ CrossRef ] [ Google Scholar ]
  • Lamri Jérémy, Lubart Todd. Creativity and Its’ Relationships with 21st Century Skills in Job Performance. Kindai Management Review. 2021; 9 :75–91. [ Google Scholar ]
  • Lamri Jérémy, Barabel Michel, Meier Olivier, Lubart Todd. Le Défi Des Soft Skills: Comment les Développer au XXIe Siècle? Dunod; Paris: 2022. [ Google Scholar ]
  • Landa Rebecca J. Assessment of Social Communication Skills in Preschoolers: Assessing Social Communication Skills in Children. Mental Retardation and Developmental Disabilities Research Reviews. 2005; 11 :247–52. doi: 10.1002/mrdd.20079. [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • Lee Sang M., Choi Jeongil, Lee Sang-Gun. The impact of a third-party assurance seal in customer purchasing intention. Journal of Internet Commerce. 2004; 3 :33–51. doi: 10.1300/J179v03n02_03. [ CrossRef ] [ Google Scholar ]
  • Lewis Arthur, Smith David. Defining Higher Order Thinking. Theory into Practice. 1993; 32 :131–37. doi: 10.1080/00405849309543588. [ CrossRef ] [ Google Scholar ]
  • Liu Ou Lydia, Frankel Lois, Roohr Katrina Crotts. Assessing Critical Thinking in Higher Education: Current State and Directions for next-Generation Assessment: Assessing Critical Thinking in Higher Education. ETS Research Report Series. 2014; 2014 :1–23. doi: 10.1002/ets2.12009. [ CrossRef ] [ Google Scholar ]
  • Lubart Todd. The 7 C’s of Creativity. The Journal of Creative Behavior. 2017; 51 :293–96. doi: 10.1002/jocb.190. [ CrossRef ] [ Google Scholar ]
  • Lubart Todd, Thornhill-Miller Branden. Creativity: An Overview of the 7C’s of Creative Thought. Heidelberg: Heidelberg University Publishing. 2019 doi: 10.17885/HEIUP.470.C6678. [ CrossRef ] [ Google Scholar ]
  • Lubart Todd, Barbot Baptiste, Besançon Maud. Creative Potential: Assessment Issues and the EPoC Battery/Potencial Creativo: Temas de Evaluación y Batería EPoC. Estudios de Psicologia. 2019; 40 :540–62. doi: 10.1080/02109395.2019.1656462. [ CrossRef ] [ Google Scholar ]
  • Lubart Todd, Zenasni Franck, Barbot Baptiste. Creative potential and its measurement. International Journal of Talent Development and Creativity. 2013; 1 :41–51. [ Google Scholar ]
  • Lubart Tubart, Thornhill-Miller Branden. Creativity in Law: Legal Professions and the Creative Profiler Approach. In: Masson Antoine, Robinson Gavin., editors. Mapping Legal Innovation: Trends and Perspectives. Springer International Publishing; Cham: 2021. pp. 1–19. [ CrossRef ] [ Google Scholar ]
  • Lubin Jeffrey, Hendrick Stephan, Thornhill-Miller Branden, Mercier Maxence, Lubart Todd. Creativity in Solution-Focused Brief Therapy Forthcoming.
  • Lucas Bill. Why We Need to Stop Talking about Twenty-First Century Skills. Centre for Strategic Education; Melbourne: 2019. [ Google Scholar ]
  • Lucas Bill. Creative Thinking in Schools across the World. The Global Institute of Creative Thinking; London: 2022. [ Google Scholar ]
  • Lucas Bill, Claxton Guy. Wider Skills for Learning: What Are They, How Can They Be Cultivated, How Could They Be Measured and Why Are They Important for Innovation? NESTA; London: 2009. [ Google Scholar ]
  • Malaby Thomas M. Beyond Play: A New Approach to Games. Games and Culture. 2007; 2 :95–113. doi: 10.1177/1555412007299434. [ CrossRef ] [ Google Scholar ]
  • Marin Lisa M., Halpern Diane F. Pedagogy for developing critical thinking in adolescents: Explicit instruction produces greatest gains. Thinking Skills and Creativity. 2011; 6 :1–13. doi: 10.1016/j.tsc.2010.08.002. [ CrossRef ] [ Google Scholar ]
  • Mathieu John E., Hollenbeck John R., van Knippenberg Daan, Ilgen Daniel R. A Century of Work Teams in the Journal of Applied Psychology. The Journal of Applied Psychology. 2017; 102 :452–67. doi: 10.1037/apl0000128. [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • Matthews Danielle. Pragmatic Development in First Language Acquisition. Amsterdam: John Benjamins Publishing Company. 2014 doi: 10.1075/tilar.10. [ CrossRef ] [ Google Scholar ]
  • McDonald Skye, Gowland Alison, Randall Rebekah, Fisher Alana, Osborne-Crowley Katie, Honan Cynthia. Cognitive Factors Underpinning Poor Expressive Communication Skills after Traumatic Brain Injury: Theory of Mind or Executive Function? Neuropsychology. 2014; 28 :801–11. doi: 10.1037/neu0000089. [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • Moore Brooke Noel, Parker Richard. Critical Thinking. 20th ed. McGraw-Hill Education; New York: 2016. [ Google Scholar ]
  • Morreale Sherwyn P., Valenzano Joseph M., Bauer Janessa A. Why Communication Education Is Important: A Third Study on the Centrality of the Discipline’s Content and Pedagogy. Communication Education. 2017; 66 :402–22. doi: 10.1080/03634523.2016.1265136. [ CrossRef ] [ Google Scholar ]
  • Mourad Maha. Quality Assurance as a Driver of Information Management Strategy: Stakeholders’ Perspectives in Higher Education. Journal of Enterprise Information Management. 2017; 30 :779–94. doi: 10.1108/JEIM-06-2016-0104. [ CrossRef ] [ Google Scholar ]
  • National Education Association . Preparing 21st Century Students for a Global Society: An Educator’s Guide to the “Four Cs”. National Education Association; Alexandria: 2011. [ Google Scholar ]
  • Nouri Jalal, Åkerfeldt Anna, Fors Uno, Selander Staffan. Assessing Collaborative Problem Solving Skills in Technology-Enhanced Learning Environments—The PISA Framework and Modes of Communication. International Journal of Emerging Technologies in Learning (IJET) 2017; 12 :163. doi: 10.3991/ijet.v12i04.6737. [ CrossRef ] [ Google Scholar ]
  • O’Carroll Veronica, Owens Melissa, Sy Michael, El-Awaisi Alla, Xyrichis Andreas, Leigh Jacqueline, Nagraj Shobhana, Huber Marion, Hutchings Maggie, McFadyen Angus. Top Tips for Interprofessional Education and Collaborative Practice Research: A Guide for Students and Early Career Researchers. Journal of Interprofessional Care. 2021; 35 :328–33. doi: 10.1080/13561820.2020.1777092. [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • OECD . PISA 2015 Assessment and Analytical Framework: Science, Reading, Mathematic, Financial Literacy and Collaborative Problem Solving. OECD Publishing; Paris: 2017. PISA 2015 collaborative problem-solving framework. [ CrossRef ] [ Google Scholar ]
  • OECD . Framework for the Assessment of Creative Thinking in PISA 2021: Third Draft. OECD; Paris: 2019a. [(accessed on 2 November 2022)]. Available online: https://www.oecd.org/pisa/publications/PISA-2021-creative-thinking-framework.pdf [ Google Scholar ]
  • OECD . Future of Education and Skills 2030: A Series of Concept Notes. OECD Learning Compass; Paris: 2019b. [(accessed on 2 November 2022)]. Available online: https://www.oecd.org/education/2030-project/teaching-and-learning/learning/learning-compass-2030/OECD_Learning_Compass_2030_Concept_Note_Series.pdf [ Google Scholar ]
  • Osborn A. F. Applied Imagination. Charles Scribner’s Sons; New York: 1953. [ Google Scholar ]
  • Parkinson Thomas L. The Role of Seals and Certifications of Approval in Consumer Decision-Making. The Journal of Consumer Affairs. 1975; 9 :1–14. doi: 10.1111/j.1745-6606.1975.tb00545.x. [ CrossRef ] [ Google Scholar ]
  • Partnership for 21st Century Skills . 21st Century Skills Education and Competitiveness: A Resource and Policy Guide. Partnership for 21st Century Skills; Tuscon: 2008. [ Google Scholar ]
  • Pasquinelli Elena, Bronner Gérald. Éduquer à l’esprit critique. Bases théoriques et indications pratiques pour l’enseignement et la formation. Ministère de l’Éducation Nationale, de la JEUNESSE et des Sports; Paris: 2021. Rapport du Conseil Scientifique de l’Éducation Nationale. [ Google Scholar ]
  • Pasquinelli Elena, Farina Mathieu, Bedel Audrey, Casati Roberto. Naturalizing Critical Thinking: Consequences for Education, Blueprint for Future Research in Cognitive Science. Mind, Brain and Education: The Official Journal of the International Mind, Brain, and Education Society. 2021; 15 :168–76. doi: 10.1111/mbe.12286. [ CrossRef ] [ Google Scholar ]
  • Paul Richard, Elder Linda. Critical thinking: The nature of critical and creative thought. Journal of Developmental Education. 2006; 30 :34–35. [ Google Scholar ]
  • Paulus Paul B., Yang Huei-Chuan. Idea Generation in Groups: A Basis for Creativity in Organizations. Organizational Behavior and Human Decision Processes. 2000; 82 :76–87. doi: 10.1006/obhd.2000.2888. [ CrossRef ] [ Google Scholar ]
  • Paulus Paul B., Kenworthy Jared B. Effective brainstorming. In: Paulus Paul B., Nijstad Bernard A., editors. The Oxford Handbook of Group Creativity and Innovation. Oxford University Press; New York: 2019. [ CrossRef ] [ Google Scholar ]
  • Paulus Paul B., Dzindolet Mary T. Social Influence Processes in Group Brainstorming. Journal of Personality and Social Psychology. 1993; 64 :575–86. doi: 10.1037/0022-3514.64.4.575. [ CrossRef ] [ Google Scholar ]
  • Paulus Paul B., Brown Vincent R. Toward More Creative and Innovative Group Idea Generation: A Cognitive-Social-Motivational Perspective of Brainstorming: Cognitive-Social-Motivational View of Brainstorming. Social and Personality Psychology Compass. 2007; 1 :248–65. doi: 10.1111/j.1751-9004.2007.00006.x. [ CrossRef ] [ Google Scholar ]
  • Peddle Monica, Bearman Margaret, Radomski Natalie, Mckenna Lisa, Nestel Debra. What Non-Technical Skills Competencies Are Addressed by Australian Standards Documents for Health Professionals Who Work in Secondary and Tertiary Clinical Settings? A Qualitative Comparative Analysis. BMJ Open. 2018; 8 :e020799. doi: 10.1136/bmjopen-2017-020799. [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • Peña-López Ismaël. PISA 2015 Results (Volume V): Collaborative Problem Solving. PISA, OECD Publishing; Paris: 2017. [ Google Scholar ]
  • Popil Inna. Promotion of Critical Thinking by Using Case Studies as Teaching Method. Nurse Education Today. 2011; 31 :204–7. doi: 10.1016/j.nedt.2010.06.002. [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • Pornpitakpan Chanthika. The Persuasiveness of Source Credibility: A Critical Review of Five Decades’ Evidence. Journal of Applied Social Psychology. 2004; 34 :243–81. doi: 10.1111/j.1559-1816.2004.tb02547.x. [ CrossRef ] [ Google Scholar ]
  • Possin Kevin. Critique of the Watson-Glaser Critical Thinking Appraisal Test: The More You Know, the Lower Your Score. Informal Logic. 2014; 34 :393–416. doi: 10.22329/il.v34i4.4141. [ CrossRef ] [ Google Scholar ]
  • Proctor Robert W., Dutta Addie. Skill Acquisition and Human Performance. Sage Publications, Inc.; Thousand Oaks: 1995. [ Google Scholar ]
  • Putman Vicky L., Paulus Paul B. Brainstorming, Brainstorming Rules and Decision Making. The Journal of Creative Behavior. 2009; 43 :29–40. doi: 10.1002/j.2162-6057.2009.tb01304.x. [ CrossRef ] [ Google Scholar ]
  • Reiman Joey. Success: The Original Handbook. Longstreet Press; Atlanta: 1992. [ Google Scholar ]
  • Ren Xuezhu, Tong Yan, Peng Peng, Wang Tengfei. Critical Thinking Predicts Academic Performance beyond General Cognitive Ability: Evidence from Adults and Children. Intelligence. 2020; 82 :101487. doi: 10.1016/j.intell.2020.101487. [ CrossRef ] [ Google Scholar ]
  • Renard Marie-Christine. Quality Certification, Regulation and Power in Fair Trade. Journal of Rural Studies. 2005; 21 :419–31. doi: 10.1016/j.jrurstud.2005.09.002. [ CrossRef ] [ Google Scholar ]
  • Restout Emilie. Labels RSE: Un décryptage des entreprises labellisées en France. Goodwill Management. 2020. [(accessed on 2 November 2022)]. Available online: https://goodwill-management.com/labels-rse-decryptage-entreprises-labellisees/
  • Rhodes Mel. An Analysis of Creativity. The Phi Delta Kappan. 1961; 42 :305–10. [ Google Scholar ]
  • Rider Elizabeth A., Keefer Constance H. Communication Skills Competencies: Definitions and a Teaching Toolbox: Communication. Medical Education. 2006; 40 :624–29. doi: 10.1111/j.1365-2929.2006.02500.x. [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • Riemer Marc J. Communication Skills for the 21st Century Engineer. Global Journal of Engineering Education. 2007; 11 :89. [ Google Scholar ]
  • Rietzschel Eric F., Nijstad Bernard A., Stroebe Wolfgang. Productivity Is Not Enough: A Comparison of Interactive and Nominal Brainstorming Groups on Idea Generation and Selection. Journal of Experimental Social Psychology. 2006; 42 :244–51. doi: 10.1016/j.jesp.2005.04.005. [ CrossRef ] [ Google Scholar ]
  • Ross David. Why the Four Cs Will Become the Foundation of Human-AI Interface. 2018. [(accessed on 2 November 2022)]. Available online: https://www.gettingsmart.com/2018/03/04/why-the-4cs-will-become-the-foundation-of-human-ai-interface/
  • Rothermich Kathrin. Social Communication Across the Lifespan: The Influence of Empathy [Preprint] SocArXiv. 2020 doi: 10.31235/osf.io/adgmy. [ CrossRef ] [ Google Scholar ]
  • Rusdin Norazlin Mohd, Ali Siti Rahaimah. Practice of Fostering 4Cs Skills in Teaching and Learning. International Journal of Academic Research in Business and Social Sciences. 2019; 9 :1021–35. doi: 10.6007/IJARBSS/v9-i6/6063. [ CrossRef ] [ Google Scholar ]
  • Rychen Dominique Simone, Hersch Salganik Laura., editors. Key Competencies for a Successful Life and a Well-Functioning Society. Hogrefe and Huber; Cambridge: 2003. [ Google Scholar ]
  • Sahin Mehmet Can. Instructional Design Principles for 21st Century Learning Skills. Procedia, Social and Behavioral Sciences. 2009; 1 :1464–68. doi: 10.1016/j.sbspro.2009.01.258. [ CrossRef ] [ Google Scholar ]
  • Salas Eduardo, Stagl Kevin C., Burke C. Shawn. International Review of Industrial and Organizational Psychology. John Wiley & Sons, Ltd.; Chichester: 2004. 25 Years of Team Effectiveness in Organizations: Research Themes and Emerging Needs; pp. 47–91. [ CrossRef ] [ Google Scholar ]
  • Salas Eduardo, Shuffler Marissa L., Thayer Amanda L., Bedwell Wendy L., Lazzara Elizabeth H. Understanding and Improving Teamwork in Organizations: A Scientifically Based Practical Guide. Human Resource Management. 2015; 54 :599–622. doi: 10.1002/hrm.21628. [ CrossRef ] [ Google Scholar ]
  • Salmi Jamil. The Tertiary Education Imperative: Knowledge, Skills and Values for Development. Springer; Cham: 2017. [ Google Scholar ]
  • Samani Sanaz Ahmadpoor, Rasid Siti Zaleha Binti Abdul, bt Sofian Saudah. A Workplace to Support Creativity. Industrial Engineering & Management Systems. 2014; 13 :414–20. doi: 10.7232/iems.2014.13.4.414. [ CrossRef ] [ Google Scholar ]
  • Saroyan Alenoush. Fostering Creativity and Critical Thinking in University Teaching and Learning: Considerations for Academics and Their Professional Learning. OECD; Paris: 2022. [ CrossRef ] [ Google Scholar ]
  • Sasmita Jumiati, Suki Norazah Mohd. Young consumers’ insights on brand equity: Effects of brand association, brand loyalty, brand awareness, and brand image. International Journal of Retail & Distribution Management. 2015; 43 :276–92. doi: 10.1108/IJRDM-02-2014-0024. [ CrossRef ] [ Google Scholar ]
  • Schlegel Claudia, Woermann Ulrich, Shaha Maya, Rethans Jan-Joost, van der Vleuten Cees. Effects of Communication Training on Real Practice Performance: A Role-Play Module versus a Standardized Patient Module. The Journal of Nursing Education. 2012; 51 :16–22. doi: 10.3928/01484834-20111116-02. [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • Schleicher Andreas. Why Creativity and Creative Teaching and Learning Matter Today and for Tomorrow’s World. GloCT in Collaboration with OECD CERI; Paris: 2022. Creativity in Education Summit 2022. [ Google Scholar ]
  • Schneider Bertrand, Sharma Kshitij, Cuendet Sebastien, Zufferey Guillaume, Dillenbourg Pierre, Pea Roy. Leveraging Mobile Eye-Trackers to Capture Joint Visual Attention in Co-Located Collaborative Learning Groups. International Journal of Computer-Supported Collaborative Learning. 2018; 13 :241–61. doi: 10.1007/s11412-018-9281-2. [ CrossRef ] [ Google Scholar ]
  • Schultz David M. Eloquent Science: A course to improve scientific and communication skills; Paper presented at the 19th Symposium on Education; Altanta, GA, USA. January 18–21; 2010. [ Google Scholar ]
  • Scialabba George. Mindplay. Harvard Magazine. 1984; 16 :19. [ Google Scholar ]
  • Scott Ginamarie, Leritz Lyle E., Mumford Michael D. The Effectiveness of Creativity Training: A Quantitative Review. Creativity Research Journal. 2004; 16 :361–88. doi: 10.1080/10400410409534549. [ CrossRef ] [ Google Scholar ]
  • Sigafoos Jeff, Schlosser Ralf W., Green Vanessa A., O’Reilly Mark, Lancioni Giulio E. Communication and Social Skills Assessment. In: Matson Johnny L., editor. Clinical Assessment and Intervention for Autism Spectrum Disorders. Elsevier; Amsterdam: 2008. pp. 165–92. [ CrossRef ] [ Google Scholar ]
  • Simonton Dean Keith. Creativity from a Historiometric Perspective. In: Sternberg Robert J., editor. Handbook of Creativity. Cambridge University Press; Cambridge: 1999. pp. 116–34. [ CrossRef ] [ Google Scholar ]
  • Singh Pallavi, Bala Hillol, Dey Bidit Lal, Filieri Raffaele. Enforced Remote Working: The Impact of Digital Platform-Induced Stress and Remote Working Experience on Technology Exhaustion and Subjective Wellbeing. Journal of Business Research. 2022; 151 :269–86. doi: 10.1016/j.jbusres.2022.07.002. [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • Spada Hans, Meier Anne, Rummel Nikol, Hauser Sabine. Proceedings of the 2005 Conference on Computer Support for Collaborative Learning Learning 2005: The next 10 Years!—CSCL’05, Taipei, Taiwan, May 30–June 4. Association for Computational Linguistics; Morristown: 2005. A New Method to Assess the Quality of Collaborative Process in CSCL. [ Google Scholar ]
  • Spitzberg Brian H. Methods of interpersonal skill assessment. In: Greene John O., Burleson Brant R., editors. The Handbook of Communication and Social Interaction Skills. Lawrence Erlbaum Associates; Mahwah: 2003. [ Google Scholar ]
  • Sternberg Robert. Intelligence, Wisdom, and Creativity: Three Is Better than One. Educational Psychologist. 1986; 21 :175–90. doi: 10.1207/s15326985ep2103_2. [ CrossRef ] [ Google Scholar ]
  • Sternberg Robert J., Funke Joachim. The Psychology of Human Thought: An Introduction. Heidelberg University Publishing (heiUP); Heidelberg: 2019. [ CrossRef ] [ Google Scholar ]
  • Sursock Andrée. Quality assurance and rankings: Some European lessons. In: Hazelkorn Ellen, Mihut Georgiana., editors. Research Handbook on University Rankings. Edward Elgar Publishing; Cheltenham: 2021. pp. 185–96. [ CrossRef ] [ Google Scholar ]
  • Sursock Andrée, Vettori Oliver. Qualitätskultur. Ein Blick in Die Gelebte Praxis der Hochschulen. Agency for Quality Assurance and Accreditation; Vienna: 2017. [(accessed on 2 November 2022)]. Quo vadis, quality culture? Theses from different perspectives; pp. 13–18. Available online: https://www.aq.ac.at/de/ueber-uns/publikationen/sonstige-publikationen.php [ Google Scholar ]
  • Sutter Éric. Certification et Labellisation: Un Problème de Confiance. Bref Panorama de La Situation Actuelle. Documentaliste-Sciences de l Information. 2005; 42 :284–90. doi: 10.3917/docsi.424.0284. [ CrossRef ] [ Google Scholar ]
  • Taddei François. Training Creative and Collaborative Knowledge-Builders: A Major Challenge for 21st Century Education. OCDE; Paris: 2009. [ Google Scholar ]
  • Thomas Keith, Lok Beatrice. Teaching Critical Thinking: An Operational Framework. In: Davies Martin, Barnett Ronald., editors. The Palgrave Handbook of Critical Thinking in Higher Education. Palgrave Macmillan US; New York: 2015. pp. 93–105. [ CrossRef ] [ Google Scholar ]
  • Thompson Jeri. Measuring Student Success Skills: A Review of the Literature on Complex Communication. National Center for the Improvement of Educational Assessment; Dover: 2020. [ Google Scholar ]
  • Thorndahl Kathrine L., Stentoft Diana. Thinking Critically about Critical Thinking and Problem-Based Learning in Higher Education: A Scoping Review. Interdisciplinary Journal of Problem-Based Learning 14. 2020 doi: 10.14434/ijpbl.v14i1.28773. [ CrossRef ] [ Google Scholar ]
  • Thornhill-Miller Branden. ‘Crea-Critical-Collab-ication’: A Dynamic Interactionist Model of the 4Cs (Creativity, Critical Thinking, Collaboration and Communication) 2021. [(accessed on 2 November 2022)]. Available online: http://thornhill-miller.com/newWordpress/index.php/current-research/
  • Thornhill-Miller Branden, Dupont Jean-Marc. Virtual Reality and the Enhancement of Creativity and Innovation: Underrecognized Potential Among Converging Technologies? Journal for Cognitive Education and Psychology. 2016; 15 :102–21. doi: 10.1891/1945-8959.15.1.102. [ CrossRef ] [ Google Scholar ]
  • Thornhill-Miller Branden, Millican Peter. The Common-Core/Diversity Dilemma: Revisions of Humean Thought, New Empirical Research, and the Limits of Rational Religious Belief. European Journal for Philosophy of Religion. 2015; 7 :1–49. doi: 10.24204/ejpr.v7i1.128. [ CrossRef ] [ Google Scholar ]
  • Tomasello Michael. Constructing a Language: A Usage-Based Theory of Language Acquisition. Harvard University Press; Cambridge: 2005. [ CrossRef ] [ Google Scholar ]
  • Uribe-Enciso Olga Lucía, Uribe-Enciso Diana Sofía, Vargas-Daza María Del Pilar. Pensamiento Crítico y Su Importancia En La Educación: Algunas Reflexiones. Rastros Rostros. 2017; 19 doi: 10.16925/ra.v19i34.2144. [ CrossRef ] [ Google Scholar ]
  • van der Vleuten Cees, van den Eertwegh Valerie, Giroldi Esther. Assessment of Communication Skills. Patient Education and Counseling. 2019; 102 :2110–13. doi: 10.1016/j.pec.2019.07.007. [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • van Klink Marcel R., Boon Jo. Competencies: The triumph of a fuzzy concept. International Journal of Human Resources Development and Management. 2003; 3 :125–37. doi: 10.1504/IJHRDM.2003.002415. [ CrossRef ] [ Google Scholar ]
  • van Laar Ester, Van Deursen Alexander J. A. M., Van Dijk Jan A. G. M., de Haan Jos. The Relation between 21st-Century Skills and Digital Skills: A Systematic Literature Review. Computers in Human Behavior. 2017; 72 :577–88. doi: 10.1016/j.chb.2017.03.010. [ CrossRef ] [ Google Scholar ]
  • van Rosmalen Peter, Boyle Elizabeth A., Nadolski Rob, van der Baaren John, Fernández-Manjón Baltasar, MacArthur Ewan, Pennanen Tiina, Manea Madalina, Star Kam. Lecture Notes in Computer Science. Springer International Publishing; Cham: 2014. Acquiring 21st Century Skills: Gaining Insight into the Design and Applicability of a Serious Game with 4C-ID; pp. 327–34. [ CrossRef ] [ Google Scholar ]
  • Vincent-Lancrin Stéphan, González-Sancho Carlos, Bouckaert Mathias, de Luca Federico, Fernández-Barrerra Meritxell, Jacotin Gwénaël, Urgel Joaquin, Vidal Quentin. Fostering Students’ Creativity and Critical Thinking: What It Means in School. OECD Publishing; Paris: 2019. [ CrossRef ] [ Google Scholar ]
  • Voogt Joke, Roblin Natalie Pareja. A Comparative Analysis of International Frameworks for 21st Century Competences: Implications for National Curriculum Policies. Journal of Curriculum Studies. 2012; 44 :299–321. doi: 10.1080/00220272.2012.668938. [ CrossRef ] [ Google Scholar ]
  • Waizenegger Lena, McKenna Brad, Cai Wenjie, Bendz Taino. An Affordance Perspective of Team Collaboration and Enforced Working from Home during COVID-19. European Journal of Information Systems: An Official Journal of the Operational Research Society. 2020; 29 :429–42. doi: 10.1080/0960085X.2020.1800417. [ CrossRef ] [ Google Scholar ]
  • Watson Goodwin. Watson-Glaser Critical Thinking Appraisal. Psychological Corporation; San Antonio: 1980. [ Google Scholar ]
  • Watson Goodwin, Glaser Edwin M. Technical Manual and User’s Guide. Pearson; Kansas City: 2010. Watson-Glaser TM II critical thinking appraisal. [ Google Scholar ]
  • Weick Karl E. The collapse of sensemaking in organizations: The Mann Gulch disaster. Administrative Science Quarterly. 1993; 38 :628–52. doi: 10.2307/2393339. [ CrossRef ] [ Google Scholar ]
  • West Richard F., Toplak Maggie E., Stanovich Keith E. Heuristics and Biases as Measures of Critical Thinking: Associations with Cognitive Ability and Thinking Dispositions. Journal of Educational Psychology. 2008; 100 :930–41. doi: 10.1037/a0012842. [ CrossRef ] [ Google Scholar ]
  • Whitmore Paul G. What are soft skills; Paper presented at the CONARC Soft Skills Conference; Fort Bliss, TX, USA. December 12–13; 1972. pp. 12–13. [ Google Scholar ]
  • Willingham Daniel T. Critical Thinking: Why Is It so Hard to Teach? Arts Education Policy Review. 2008; 109 :21–32. doi: 10.3200/AEPR.109.4.21-32. [ CrossRef ] [ Google Scholar ]
  • Wilson Sarah Beth, Varma-Nelson Pratibha. Small Groups, Significant Impact: A Review of Peer-Led Team Learning Research with Implications for STEM Education Researchers and Faculty. Journal of Chemical Education. 2016; 93 :1686–702. doi: 10.1021/acs.jchemed.5b00862. [ CrossRef ] [ Google Scholar ]
  • Winterton Jonathan, Deist Françoise Delamare-Le, Stringfellow Emma. Typology of Knowledge, Skills and Competences: Clarification of the Concept and Prototype. Office for Official Publications of the European Communities; Luxembourg: 2006. [ Google Scholar ]
  • World Economic Forum . New Vision for Education: Unlocking the Potential of Technology. World Economic Forum; Geneva: 2015. [ Google Scholar ]
  • World Economic Forum The Future of Jobs Report 2020. 2020. [(accessed on 2 November 2022)]. Available online: https://www.weforum.org/reports/the-future-of-jobs-report-2020
  • World Health Organization . Framework for Action on Interprofessional Education and Collaborative Practice. World Health Organization; Geneva: 2010. No. WHO/HRH/HPN/10.3. [ PubMed ] [ Google Scholar ]
  • Yue Meng, Zhang Meng, Zhang Chunmei, Jin Changde. The Effectiveness of Concept Mapping on Development of Critical Thinking in Nursing Education: A Systematic Review and Meta-Analysis. Nurse Education Today. 2017; 52 :87–94. doi: 10.1016/j.nedt.2017.02.018. [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • Zielke Stephan, Dobbelstein Thomas. Customers’ Willingness to Purchase New Store Brands. Journal of Product & Brand Management. 2007; 16 :112–21. doi: 10.1108/10610420710739982. [ CrossRef ] [ Google Scholar ]
  • Zlatić Lidija, Bjekić Dragana, Marinković Snežana, Bojović Milevica. Development of Teacher Communication Competence. Procedia, Social and Behavioral Sciences. 2014; 116 :606–10. doi: 10.1016/j.sbspro.2014.01.265. [ CrossRef ] [ Google Scholar ]

Nichols College

Critical Thinking & Why It’s So Important

Critical thinking is a cognitive skill with the power to unlock the full potential of your mind. In today’s rapidly evolving society, where information is abundant but discerning its validity is becoming increasingly challenging, the art of critical thinking has never been more crucial.

At Nichols College, we believe that cultivating strong critical thinking abilities is not just a pursuit for the academically inclined, but a fundamental necessity for individuals across all walks of life. Join us as we explore the significance of critical thinking and the remarkable impact it can have on your decision-making, problem-solving, and overall cognitive prowess.

Discover why our Graduate Certificate program in Advanced Critical Thinking and Decision Making is your gateway to becoming a perceptive and adept thinker, ready to tackle the complex challenges of today’s world with confidence and ingenuity.

What is critical thinking?

Critical thinking is a fundamental skill that allows individuals to analyze, evaluate, and interpret information objectively and rationally. It goes beyond merely accepting information at face value; instead, critical thinkers are equipped to delve deeper, question assumptions, and explore various perspectives before arriving at well-informed conclusions. This ability to think critically is highly valued across various domains, including education, business, and everyday life.

Benefits of using critical thinking

The countless advantages of critical thinking extend far beyond the realms of academia. For starters, critical thinking fosters superior decision-making by equipping individuals with the tools to weigh options, assess consequences, and arrive at better choices. Critical thinkers also benefit from heightened self-reflection, gaining a profound understanding of their own biases and areas for improvement.

Critical thinkers become well-informed individuals who can navigate the sea of information with discernment, adeptly identifying misinformation and unreliable sources. Furthermore, this invaluable skill enables creative problem-solving, allowing thinkers to craft innovative solutions to intricate challenges. Some of the most important benefits of using critical thinking include:

Better decision making

Critical thinkers excel at weighing pros and cons, considering alternatives, and anticipating potential consequences. This leads to more informed and effective decision-making processes, both in personal and professional realms.

Better self-reflection

By fostering a habit of introspection, critical thinkers become more self-aware, recognizing their own biases and limitations. This heightened self-awareness allows them to continually improve and adapt their thinking patterns.

Being well-informed

Critical thinkers actively seek out diverse sources of information, ensuring they have a comprehensive understanding of complex issues. This empowers them to engage in meaningful discussions and contribute constructively to their communities.

The ability to identify misinformation

In a world filled with misinformation, critical thinkers possess the skills to discern fact from fiction. They scrutinize sources, verify information, and avoid being misled by deceptive content.

Building creative problem solving skills

Critical thinking encourages innovative and outside-the-box problem-solving approaches. By considering multiple angles and challenging conventional ideas, critical thinkers arrive at inventive solutions to complex challenges.

What skills do critical thinkers have?

Critical thinkers possess a remarkable set of skills that elevate their cognitive abilities and enable them to approach complex issues with acuity. Embracing these skills empowers them to tackle challenges, unravel complexities, and make meaningful insights and well-informed decisions. Some of the most valuable skills critical thinkers have include:

Critical thinkers have a natural inclination to ask questions and explore topics in-depth. Their thirst for knowledge drives them to seek out answers and continually expand their understanding.

Proficient in conducting thorough research, critical thinkers gather information from reliable sources and assess its validity. They are skilled at distinguishing credible data from biased or unsubstantiated claims.

Pattern recognition

Critical thinkers recognize recurring patterns and connections between seemingly unrelated pieces of information. This allows them to draw meaningful insights and make well-founded predictions.

Bias identification

Having honed the ability to identify biases, critical thinkers remain open-minded and impartial in their assessments. They acknowledge their own biases and strive to approach each situation objectively.

How to use critical thinking skills in the workplace

In any work environment, critical thinking is a valuable asset that can enhance productivity and foster a more innovative and collaborative workplace. Employees with strong critical thinking skills contribute to problem-solving sessions, provide constructive feedback, and make informed decisions based on thorough analysis. By promoting critical thinking, organizations encourage employees to challenge assumptions, seek out novel solutions, and contribute to the overall growth and success of the company.

Examples of good critical thinking in action

The real-world application of critical thinking can be awe-inspiring, as it empowers individuals to approach various scenarios with astute judgment and creativity. In the business realm and with regard to project management, critical thinkers demonstrate their prowess by:

  • Analyzing Market Trends : A marketing professional employs critical thinking skills to assess market trends, consumer behavior, and competitor strategies before devising a successful marketing campaign that aligns with the target audience’s needs.
  • Problem-Solving in Project Management : A project manager utilizes critical thinking to identify potential roadblocks, consider alternative approaches, and ensure projects are executed efficiently and within budget.

Furthermore, critical thinkers shine in scientific research, meticulously evaluating data, and drawing evidence-based conclusions that contribute to groundbreaking discoveries. In everyday life, they navigate the digital landscape with discernment, identifying misinformation and making informed decisions about their health, finances, and general well-being. These examples illustrate the power of critical thinking to transform not only individual lives but also entire industries, making it an indispensable skill in the pursuit of success and progress.

Get a critical thinking graduate certificate from Nichols College

If you are eager to enhance your problem-solving abilities, decision-making processes, and overall cognitive skills, the Nichols College graduate certificate in critical thinking may be right for you. Designed to equip individuals with the necessary tools to excel in today’s complex world, this program will empower you to think critically, analyze data effectively, and approach challenges with creativity and confidence. Elevate your potential and join Nichols College in cultivating a new generation of sharp-minded leaders, ready to make a positive impact on the world. Enroll in the Advanced Critical Thinking and Decision Making certificate program today and unlock a brighter future for yourself and your community.

developing critical thinking technologies include

  • Master of Science in Counterterrorism
  • Critical Thinking Certificate
  • Career Paths
  • Financial Aid
  • Request Information

developing critical thinking technologies include

IMAGES

  1. 6 Examples of Critical Thinking Skills

    developing critical thinking technologies include

  2. Developing Critical Thinking Skills ensures success in your career

    developing critical thinking technologies include

  3. CRITICAL THINKING SKILLS

    developing critical thinking technologies include

  4. 3 critical thinking strategies to enhance your problem-solving skills

    developing critical thinking technologies include

  5. Developing Critical Thinking Skills

    developing critical thinking technologies include

  6. The benefits of critical thinking for students and how to develop it

    developing critical thinking technologies include

VIDEO

  1. Inculcating Critical Thinking at School Level

  2. Developing Critical Thinking Skill

  3. Top Critical Thinking Skills

  4. Critical Thinking: Reject False Information and Make Better Decisions! 🧠❓ #shortvideo #statssaga

  5. Empowering Future Leaders: Developing Critical Thinking at Wisdom High Group of School" #bestschool

  6. The Hidden Secret to Developing Critical Thinking

COMMENTS

  1. Using Technology To Develop Students' Critical Thinking Skills

    Critical thinking is a higher-order cognitive skill that is indispensable to students, readying them to respond to a variety of complex problems that are sure to arise in their personal and professional lives. The cognitive skills at the foundation of critical thinking are analysis, interpretation, evaluation, explanation, inference, and self ...

  2. What Are Critical Thinking Skills and Why Are They Important?

    It makes you a well-rounded individual, one who has looked at all of their options and possible solutions before making a choice. According to the University of the People in California, having critical thinking skills is important because they are [ 1 ]: Universal. Crucial for the economy. Essential for improving language and presentation skills.

  3. Developing Critical Thinking

    In a time where deliberately false information is continually introduced into public discourse, and quickly spread through social media shares and likes, it is more important than ever for young people to develop their critical thinking. That skill, says Georgetown professor William T. Gormley, consists of three elements: a capacity to spot ...

  4. Leveraging Technology to Develop Students' Critical Thinking Skills

    This article describes the nexus of the Technological Pedagogical and Content Knowledge (TPACK) framework, principles of the Backward Curriculum Design process, and the Education 1.0, 2.0, & 3.0 communication flows working together to help TK-12 educators leverage technology tools to support the development of students' critical thinking skills.

  5. Using Tech to Develop Critical Thinking Skills

    The Math Melodies app, an accessible math app, has several math games appropriate for Ian, which can be used to build critical thinking skills. In the video below, Ian is introduced to the Sequencing game in the Math Melodies app. In the ABC's of iOS Course, Ian has already been introduced to the basic gestures, spatial layout of the app and ...

  6. The trend of ICT in education for critical thinking skills: A

    Research findings on ICT trends in education for critical thinking skills are structured under three reports: (1) ICT trends in education include android, VR, AR, and coding; (2) the best strategy with ICT monitoring is distance learning, programming teaching, and STEM; and (3) other skills that are enhanced along with critical thinking skills ...

  7. Smart Learning in Support of Critical Thinking: Lessons ...

    Given the current state of critical thinking development and the gap between the innovative technology application in practice and the ideal expectations for smart learning, we argue for a smarter method that integrates and also goes beyond all the advantages of previous approaches that enable critical thinking into habits of mind (Elder & Paul ...

  8. Critical Thinking

    Critical thinking is the discipline of rigorously and skillfully using information, experience, observation, and reasoning to guide your decisions, actions, and beliefs. You'll need to actively question every step of your thinking process to do it well. Collecting, analyzing and evaluating information is an important skill in life, and a highly ...

  9. Leveraging Technology to Develop Students' Critical Thinking Skills

    teach students how to use technology as they practice the critical thinking skills selected for the lesson/unit. Now questions 1 - 4 have been answered, we turn to the Ed 1.0 - 3.0 communication

  10. Use of Technology in Developing Problem Solving/Critical Thinking Skills

    The integration of technology into standard curricula is expanding with availability of educational software and teacher recognition of the role of technology in improvement of students' problem-solving/critical thinking skills. The basic components in problem solving are a good problem statement, a research and development component, a testing of solutions component, and an evaluation component.

  11. Developing Critical Thinking: A Review of Past Efforts as a Framework

    The technologies used for critical thinking promotion include simple or easy-to-use technologies and advanced technologies. Examples of simple or easy-to-use technologies are flow charts, diagrams, sketch notes, social media, online group discussions and assessments, and advanced technologies like concept maps, digital games, virtual realities ...

  12. 5 Tech Tools to Encourage Critical Thinking

    MindMeister. Mind mapping is a valuable tool to facilitate critical thinking, and technology has made it easier than ever to bring this into your classroom. Use MindMeister, a simple and easy to implement mind mapping tool, to encourage students to think about a topic, lesson, problem or subject from every angle.

  13. Critical Thinking and Problem-Solving

    Critical thinking makes use of many procedures. These procedures include asking questions, making judgments, and identifying assumptions. ... (1995) see students as too often being passive receptors of information. Through technology, the amount of information available today is massive. ... J. M. & Safrit, R. D. (1994). Developing critical ...

  14. How to develop critical thinking skills

    Here are 12 tips for building stronger self-awareness and learning how to improve critical thinking: 1. Be cautious. There's nothing wrong with a little bit of skepticism. One of the core principles of critical thinking is asking questions and dissecting the available information.

  15. Is technology producing a decline in critical thinking and analysis

    January 27, 2009. As technology has played a bigger role in our lives, our skills in critical thinking and analysis have declined, while our visual skills have improved, according to research by Patricia Greenfield, UCLA distinguished professor of psychology and director of the Children's Digital Media Center, Los Angeles. Learners have changed ...

  16. PDF Using Critical Thinking Teaching Methods to Increase Student Success

    surprisingly, little knowledge on how to develop critical thinking skills in students. The Paul, Elder, and Bartell study found that while 89% of the sampled instructors identified critical thinking as a primary objective, only 9% included tasks in class that were clearly designed to promote critical thinking on a typical day in class. More

  17. Developing Students' Critical Thinking Skills and Argumentation

    With rapidly developing technology, ... Critical thinking skills that include the ability to evaluate arguments and counterarguments in a variety of contexts are very important, ... The development of critical thinking skills was given separately for the trend drastically changed on the day when the first skills were used by the students. All ...

  18. (PDF) Critical Thinking and Digital Technologies: Concepts

    The first part consists of the. conceptual framewor k about, technology use in education, critical thinking, the effect of technology on. critical thinking and new technologies used to develop ...

  19. 6 Chapter 4 Supporting Students' Critical Thinking

    For more information on teaching critical thinking and how technology might help, see Schwartz (2016) and the TedEd talk "Rethinking Thinking" by Trevor Maber on ed.ted.com. One recent trend in critical thinking is the development of school- and classroom-based makerspaces.

  20. Cultivating Critical Thinking Skills in Students

    Critical thinking is the process of actively and skillfully analyzing, synthesizing, and evaluating information, ideas, or arguments to make reasoned and well-informed decisions. It involves the ability to think logically, consider multiple perspectives, and engage in reflective and independent thinking. Critical thinking goes beyond simply ...

  21. Education Sciences

    Critical thinking has been difficult to develop in technical and vocational education and training, where acquiring practical skills is often the priority. This study looks at whether tried-and-tested methods for developing critical thinking in higher education are also effective in this educational context. To test this, an intervention was carried out as part of a compulsory, semester-long ...

  22. Creativity, Critical Thinking, Communication, and Collaboration

    The process of developing critical thinking focuses on the interaction between personal dispositions (attitudes and habits), ... , training critical thinking should include explicit instruction involving at least the four following components and ... Because VR technologies offer the possibility of enhanced and materially enriched ...

  23. Critical Thinking & Why It's So Important

    Some of the most important benefits of using critical thinking include: Better decision making. Critical thinkers excel at weighing pros and cons, considering alternatives, and anticipating potential consequences. This leads to more informed and effective decision-making processes, both in personal and professional realms. Better self-reflection

  24. The Development of an Assessment Scale for Computational Thinking

    Understanding barriers to school-wide computational thinking integration at the elementary grades: Lessons from three schools. In Ottenbreit-Leftwich A., Yadav A. (Eds.), Computational Thinking in PreK-5: Empirical Evidence for Integration and Future Directions (pp. 64-71). ACM and the Robin Hood Learning + Technology Fund.