research methods in psychology cognitive

• Skip to main content
• Skip to primary sidebar

IResearchNet

Cognitive Psychology

History of cognitive psychology.

The history of cognitive psychology can be parsed into four periods: philosophical, early experimental, the cognitive revolution, and modern cognitive psychology.

Philosophical Period

Ancient Egyptian hieroglyphics suggest that thoughtful people were concerned with processes such as thought, memory, and most of all the “ka”, or soul, Great energy was directed toward preserving the soul but also some theorized that knowledge was localized in the heart. Greek philosophers were obsessed with knowledge and cognitive matters and current models of cognition often have some ties to ancient Greece. Aristotle’s views on the locus of knowledge were similar to the Egyptians. However, Plato postulated that the brain was the true locus of knowledge. Renaissance scholars considered thinking, logic, and the nature of the soul and, al­though divergent views were expressed, the locus of the knowledge and rationality was thought to be in the brain.

During the eighteenth century, philosophic debate over the source of knowledge took place between the empiricist and the nativist. A British empiricist believed knowledge came from experience. However, the nativist believed knowledge was innate and based on structural characteristics and properties inherent in the brain. Modern cognitive psychologists continue to argue these matters, although usually with scientific data.

The philosophic period provided a context for un­derstanding the mind and its processes. In addition, these early thinkers identified some major theoretical issues that would later be studied empirically using scientific research methods.

Early Experimental Period

Cognition has been studied scientifically since the end of the nineteenth century. In 1879, the philosophical aspects of mental processes gave way to empirical ob­servations when Wundt founded the first psychological laboratory in Germany in 1879. Psychology began to break away from philosophy and form a discipline based on objective science rather than on speculation, logic, and conjecture. Many forces propelled the break with moral philosophy, but certainly the development of new methods that allowed for the examination of mental events changed the way cognition was studied. Intro­spection, or looking within, was one such method that allowed the observer to examine consciousness and the structure of mental representation by breaking down an experience into sensations and images. By detecting patterns within introspective reports, the mind’s con­tents were presumed to be revealed.

Theories of knowledge representation became di­vided between introspectionists who studied observable sensations, and act psychologists, led by Brentano, who studied the activities of the mind. Brentano considered internal representations meaningless to psychology and chose to study mental acts of comparing, judging, and feeling physical objects.

By the beginning of the twentieth century American psychology was beginning to take a distinctive form with a wide range of topics under investigation. Lead­ing this expanded experimental psychology was Wil­liam James, the first president of the American Psycho­logical Association. His ideas on philosophy, religion, and psychology shaped the intellectual history of these topics throughout the twentieth century. No less im­portant were his thoughts about attention and memory, and his distinction of a dichotomy memory store—pri­mary and secondary memory—led directly to experi­ments in the 1960s on that topic. Clearly, James’s ideas were important in shaping modern cognitive psychol­ogy.

During this time, American psychologists became in­terested in educational matters and were greatly influ­enced by the objective nature of act psychology. Psy­chologists such as Thorndike were concerned with the effects of reward and punishment on learning and less concerned with consciousness. The introspective tech­nique, in which a subject asks himself what sensations he might experience, for example, were considered by American psychologists as being sterile and leading to inconsistent results. There was, argued many, a need for a purely objective and scientific psychology in which mental processes, such as memory, sensations, and learning, could be reliably measured. Behaviorism, led by John Watson, was predicated on the idea that overt behavior could be objectively observed, offered an at­tractive scientific approach to psychology, and was an appropriate foil to the rapidly developing interest in psy­choanalysis.

Despite interest in overt behavior, cognitive process were not totally neglected. During the early 1900s Donders and Cattell were conducting perception experiments on imageless thought using brief visual displays to examine the time required for mental operations to take place and using reaction time data as dependent measures.

In several laboratories in America interesting re­search was being done on memory, attention, percep­tion, language, concept formation, and problem solving that was the preformal stage of cognitive psychology. In addition to these efforts within psychology, several forces outside of traditional experimental psychology helped shape cognitive psychology. Among these forces are the considerable influence of the Swiss psychologist, Jean Piaget, whose central idea was that there are dis­tinctive cognitive stages through which children de­velop. In Russia, the brilliant young savant, Lev Vygotsky, suggested a model of development psychology in which learning precedes development. Another impor­tant influence was the work of Frederic Bartlett, from England, who investigated memory from a naturalistic viewpoint and was particularly concerned with the re­membering of stories. From recall of stories, Bartlett hypothesized that memory is largely determined by schemata, or the way knowledge is organized and rep­resented in the brain. Even some animal studies were beginning to embrace cognitive themes. In 1932, Tolman, a well-known behavioral psychologist, observed that rats learned a cognitive map of their environment while learning to run a maze.

Although cognition was not the dominant school of psychological thought in America during this time, some experimental psychologists demonstrated that scientific methodology could be used in the study of men­tal events. The techniques, subject matter, procedures, and even the interpretations used by these researchers anticipated the emergence of a cognitive discipline.

Concepts such as sensation, thinking, and mental imagery were anathema under the behaviorist’s influ­ence, as they were considered subjective. Internal states were considered intervening variables and not neces­sary to understand human behavior. Psychology had been concentrated on observable behaviors and human subjects were largely replaced with rats and pigeons.

Gestalt psychology offered an alternative way to study sensory perception to the problematic method of introspection that diffused the research on cognition. Concurrently the behaviorists attempted to create a purely objective psychology by successfully attacking the cognitive psychologists and Gestaltists as well.

Cognitive Revolution

Cognitive psychology began to take form as a new way of understanding the science of the mind during the late 1950s. These formative events were spurred on by research discoveries in memory, learning, and attention as well as ideas outside of the mainstay of experimental psychology, such as communication theory , develop­mental psychology, social psychology, linguistics, and computer science, which gave cognitive psychologists additional breadth to deal with the complexity of hu­man information processing and thinking.

The reemergence of cognitive psychology during this period is commonly referred to as the Cognitive Revo­lution, emerging in 1956 with a conference on com­munication theory at Massachusetts Institute of Tech­nology (MIT) (Solso, 1998) in which seminal papers were presented by Noam Chomsky, Jerome Bruner, Al­len Newell and Herbert Simon, and George Miller. The coalescence of cognitive psychology during this period was probably not due to a single group of people (and certainly no precise date of a movement is possible) but was a reflection of a larger Zeitgeist in which psychol­ogists appreciated the complexity of the thinking hu­man. At the same time, cognitive psychologists rejected the traditional, simplistic theories of the mind, but in many cases held on to the scientific methodology as had developed in the early part of the twentieth century. The paradigm that offered a pertinent methodol­ogy and embraced a sufficiently wide latitude of intel­lectual topics was cognitive psychology, which enjoyed widespread acceptance and growth.

Research in verbal learning and semantic organi­zation led to the development of testable models of memory and cognition, providing another empirical base for the study of mental processes. George A. Miller made a distinction between short-term and long-term memory and his influential paper The Magic Number Seven, Plus or Minus Two (Miller, 1956) addressed the limited capacity of short-term memory and introduced the concept of chunking—the idea that the limits of short-term memory could be extended by grouping in­formation into larger units of information. In 1958, Pe­terson and Peterson in America and John Brown in England found a rapid loss or decay of memory after the study of nonsense syllables after a few seconds when verbal rehearsal was absent, thus promoting the idea of a separate stage of short-term memory. In 1960, Sperling showed that a very transitory memory (or in­formation storage system) held information for a very brief period of time. This discovery further advanced the notion that humans were complex information-processing creatures who processed incoming infor­mation through a series of stages. That simple idea was a perfect model for researchers and theorists interested in memory, and several models appeared about this time by Atkinson and Shiffrin, Waugh and Norman, and later by Craik and Tulving.

Prior to this period, information theory was intro­duced by Shannon and Weaver, who used box diagrams to describe how information is communicated and transformed along a series of stages. Donald Broadbent, a psychologist at Cambridge, began applying Shannon and Weaver’s ideas to selective attention processes and introduced the concept of information flow to psychol­ogy and used box diagrams to describe cognitive pro­cesses. Broadbent’s information flow referred to the se­ries of operations that analyze, transform, or change mental events such as memory encoding, forgetting, thinking, concept formation, etc. As such, Broadbent provided “a language to talk about what happened in­side a man which was not a mentalistic introspective language” (Cohen, 1986, p. 23).

Elsewhere, technological advances in computer sci­ence called for reexamination of basic postulates of cognition. In 1955, Simon and Newell developed a computer capable of solving a mathematical proof. Cogni­tive psychologists were excited that machines could simulate human thought and computers could possibly be operating according to the same rules and proce­dures as the human mind. Furthermore, since com­puters were seen as intelligent, it required us to analyze our own intelligence so that the intelligence of a ma­chine could be determined. As a result the hypothetical Turing test was devised to determine if observers could discriminate the output of a computer from that of hu­man responses.

Meanwhile, the behaviorists came under attack from Chomsky, a linguist from MIT, who developed a method of analyzing the structure of language. Chomsky ar­gued that language was too complicated to learn and produce via behavioral principles of reinforcement and postulated the existence of a cognitive structure of an innate language acquisition device.

Another influence that aided cognitive psychology’s foothold was World War II. Financial support in areas of military interest became readily available during the war. Because of the military’s interest in developing and using new technology, research in vigilance, cre­ativity, and human factors was encouraged. One out­come was a seminal report in 1954 by Tanner and Swets on signal detection demonstrating that cognitive processes can have a mediating effect on sensory thresholds. Another outcome of the war was that many soldiers suffered from brain injuries. A vast amount of clinical data in perception, memory, and language was a by-product of these victims’ afflictions.

In the 1950s, interest turned to attention, memory, pattern recognition, images, semantic organization, language processes, thinking, and even consciousness (the most dogmatically eschewed concept), as well as other cognitive topics once considered outside the boundary of experimental psychology. Behaviorism and its dogma failed to account for the richness and diver­sity of human experience. Behaviorists could not ac­count for the results found by Piaget’s and Chomsky’s developmental studies. And information theory and computer science gave psychologists new ways to con­ceptualize and discuss cognition.

Modern Cognitive Psychology

By the 1960s, cognitive psychology had experienced a renaissance. Cognitive Psychology, which systematized the new science, was written by Ulric Neisser and was published in America (1967). Neisser’s book was cen­tral to the solidification of cognitive psychology as it gave a label to the field and defined the topical areas. Neisser used the computer metaphor for selecting, stor­ing. Recovering, combining, outputting, and manipu­lating information. And in 1966 Hilgard and Bower in­troduced a chapter in their Theories of Learning (New York) that developed the idea of using computer pro­grams to serve as models on theories of cognition.

The 1970s saw the emergence of professional jour­nals devoted to cognitive psychology such as Cognitive Psychology, Cognition, Memory & Cognition, and a series of symposia volumes, including the Loyola Symposium on Cognition edited by Solso and the Carnegie-Mellon series edited by Chase and others, based on the Car­negie Symposium on Cognition. In the 1970s and 1980s cognitive laboratories were beginning to be built, symposia and conferences appeared at national and re­gional meetings, courses in cognitive psychology and related topics were being added to curricula, grants were awarded to people investigating memory, lan­guage processing, attention, and like topics, new text­books were written on the theme of cognition, and uni­versities recruited professors of cognitive psychology to replace those of traditional experimental psychology. In the 1980s and 1990s serious efforts were made to find corresponding neural components that were linked to cognitive constructs. Thus, the cerebral location for a word, like hammer, as a noun, might be far different than the location for the same word if the word were used as a verb. Furthermore, influential memory the­ories (such as Tulving’s semantic and episodic memory theory) were manifest in cerebral localization experi­ments using brain imaging technology. The science of human cognition is still undergoing transformation due to major changes in computer technology and brain science. As a result cognitive psychology has converged with computer science and neuroscience to create a new discipline called cognitive science.

Finally, with the advent of new ways to see the brain (e.g. functional magnetic resonance imaging [fMRI], positron emission tomography [PET], electroencepha­logram [EEG]) cognitive psychologists have expanded their operations to neuroscience, which promises to empirically display the parts of the brain involved in cognition that were hypothesized by twentieth-century psychologists.

• Cognitive Psychology Theories
• Cognitive Psychology Research Methods

An official website of the United States government

The .gov means it’s official. Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

The site is secure. The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

• Publications
• Account settings

Preview improvements coming to the PMC website in October 2024. Learn More or Try it out now .

• Advanced Search
• Journal List
• Front Res Metr Anal

The Use of Research Methods in Psychological Research: A Systematised Review

Salomé elizabeth scholtz.

1 Community Psychosocial Research (COMPRES), School of Psychosocial Health, North-West University, Potchefstroom, South Africa

Werner de Klerk

Leon t. de beer.

2 WorkWell Research Institute, North-West University, Potchefstroom, South Africa

Research methods play an imperative role in research quality as well as educating young researchers, however, the application thereof is unclear which can be detrimental to the field of psychology. Therefore, this systematised review aimed to determine what research methods are being used, how these methods are being used and for what topics in the field. Our review of 999 articles from five journals over a period of 5 years indicated that psychology research is conducted in 10 topics via predominantly quantitative research methods. Of these 10 topics, social psychology was the most popular. The remainder of the conducted methodology is described. It was also found that articles lacked rigour and transparency in the used methodology which has implications for replicability. In conclusion this article, provides an overview of all reported methodologies used in a sample of psychology journals. It highlights the popularity and application of methods and designs throughout the article sample as well as an unexpected lack of rigour with regard to most aspects of methodology. Possible sample bias should be considered when interpreting the results of this study. It is recommended that future research should utilise the results of this study to determine the possible impact on the field of psychology as a science and to further investigation into the use of research methods. Results should prompt the following future research into: a lack or rigour and its implication on replication, the use of certain methods above others, publication bias and choice of sampling method.

Introduction

Psychology is an ever-growing and popular field (Gough and Lyons, 2016 ; Clay, 2017 ). Due to this growth and the need for science-based research to base health decisions on (Perestelo-Pérez, 2013 ), the use of research methods in the broad field of psychology is an essential point of investigation (Stangor, 2011 ; Aanstoos, 2014 ). Research methods are therefore viewed as important tools used by researchers to collect data (Nieuwenhuis, 2016 ) and include the following: quantitative, qualitative, mixed method and multi method (Maree, 2016 ). Additionally, researchers also employ various types of literature reviews to address research questions (Grant and Booth, 2009 ). According to literature, what research method is used and why a certain research method is used is complex as it depends on various factors that may include paradigm (O'Neil and Koekemoer, 2016 ), research question (Grix, 2002 ), or the skill and exposure of the researcher (Nind et al., 2015 ). How these research methods are employed is also difficult to discern as research methods are often depicted as having fixed boundaries that are continuously crossed in research (Johnson et al., 2001 ; Sandelowski, 2011 ). Examples of this crossing include adding quantitative aspects to qualitative studies (Sandelowski et al., 2009 ), or stating that a study used a mixed-method design without the study having any characteristics of this design (Truscott et al., 2010 ).

The inappropriate use of research methods affects how students and researchers improve and utilise their research skills (Scott Jones and Goldring, 2015 ), how theories are developed (Ngulube, 2013 ), and the credibility of research results (Levitt et al., 2017 ). This, in turn, can be detrimental to the field (Nind et al., 2015 ), journal publication (Ketchen et al., 2008 ; Ezeh et al., 2010 ), and attempts to address public social issues through psychological research (Dweck, 2017 ). This is especially important given the now well-known replication crisis the field is facing (Earp and Trafimow, 2015 ; Hengartner, 2018 ).

Due to this lack of clarity on method use and the potential impact of inept use of research methods, the aim of this study was to explore the use of research methods in the field of psychology through a review of journal publications. Chaichanasakul et al. ( 2011 ) identify reviewing articles as the opportunity to examine the development, growth and progress of a research area and overall quality of a journal. Studies such as Lee et al. ( 1999 ) as well as Bluhm et al. ( 2011 ) review of qualitative methods has attempted to synthesis the use of research methods and indicated the growth of qualitative research in American and European journals. Research has also focused on the use of research methods in specific sub-disciplines of psychology, for example, in the field of Industrial and Organisational psychology Coetzee and Van Zyl ( 2014 ) found that South African publications tend to consist of cross-sectional quantitative research methods with underrepresented longitudinal studies. Qualitative studies were found to make up 21% of the articles published from 1995 to 2015 in a similar study by O'Neil and Koekemoer ( 2016 ). Other methods in health psychology, such as Mixed methods research have also been reportedly growing in popularity (O'Cathain, 2009 ).

A broad overview of the use of research methods in the field of psychology as a whole is however, not available in the literature. Therefore, our research focused on answering what research methods are being used, how these methods are being used and for what topics in practice (i.e., journal publications) in order to provide a general perspective of method used in psychology publication. We synthesised the collected data into the following format: research topic [areas of scientific discourse in a field or the current needs of a population (Bittermann and Fischer, 2018 )], method [data-gathering tools (Nieuwenhuis, 2016 )], sampling [elements chosen from a population to partake in research (Ritchie et al., 2009 )], data collection [techniques and research strategy (Maree, 2016 )], and data analysis [discovering information by examining bodies of data (Ktepi, 2016 )]. A systematised review of recent articles (2013 to 2017) collected from five different journals in the field of psychological research was conducted.

Grant and Booth ( 2009 ) describe systematised reviews as the review of choice for post-graduate studies, which is employed using some elements of a systematic review and seldom more than one or two databases to catalogue studies after a comprehensive literature search. The aspects used in this systematised review that are similar to that of a systematic review were a full search within the chosen database and data produced in tabular form (Grant and Booth, 2009 ).

Sample sizes and timelines vary in systematised reviews (see Lowe and Moore, 2014 ; Pericall and Taylor, 2014 ; Barr-Walker, 2017 ). With no clear parameters identified in the literature (see Grant and Booth, 2009 ), the sample size of this study was determined by the purpose of the sample (Strydom, 2011 ), and time and cost constraints (Maree and Pietersen, 2016 ). Thus, a non-probability purposive sample (Ritchie et al., 2009 ) of the top five psychology journals from 2013 to 2017 was included in this research study. Per Lee ( 2015 ) American Psychological Association (APA) recommends the use of the most up-to-date sources for data collection with consideration of the context of the research study. As this research study focused on the most recent trends in research methods used in the broad field of psychology, the identified time frame was deemed appropriate.

Psychology journals were only included if they formed part of the top five English journals in the miscellaneous psychology domain of the Scimago Journal and Country Rank (Scimago Journal & Country Rank, 2017 ). The Scimago Journal and Country Rank provides a yearly updated list of publicly accessible journal and country-specific indicators derived from the Scopus® database (Scopus, 2017b ) by means of the Scimago Journal Rank (SJR) indicator developed by Scimago from the algorithm Google PageRank™ (Scimago Journal & Country Rank, 2017 ). Scopus is the largest global database of abstracts and citations from peer-reviewed journals (Scopus, 2017a ). Reasons for the development of the Scimago Journal and Country Rank list was to allow researchers to assess scientific domains, compare country rankings, and compare and analyse journals (Scimago Journal & Country Rank, 2017 ), which supported the aim of this research study. Additionally, the goals of the journals had to focus on topics in psychology in general with no preference to specific research methods and have full-text access to articles.

The following list of top five journals in 2018 fell within the abovementioned inclusion criteria (1) Australian Journal of Psychology, (2) British Journal of Psychology, (3) Europe's Journal of Psychology, (4) International Journal of Psychology and lastly the (5) Journal of Psychology Applied and Interdisciplinary.

Journals were excluded from this systematised review if no full-text versions of their articles were available, if journals explicitly stated a publication preference for certain research methods, or if the journal only published articles in a specific discipline of psychological research (for example, industrial psychology, clinical psychology etc.).

The researchers followed a procedure (see Figure 1 ) adapted from that of Ferreira et al. ( 2016 ) for systematised reviews. Data collection and categorisation commenced on 4 December 2017 and continued until 30 June 2019. All the data was systematically collected and coded manually (Grant and Booth, 2009 ) with an independent person acting as co-coder. Codes of interest included the research topic, method used, the design used, sampling method, and methodology (the method used for data collection and data analysis). These codes were derived from the wording in each article. Themes were created based on the derived codes and checked by the co-coder. Lastly, these themes were catalogued into a table as per the systematised review design.

Systematised review procedure.

According to Johnston et al. ( 2019 ), “literature screening, selection, and data extraction/analyses” (p. 7) are specifically tailored to the aim of a review. Therefore, the steps followed in a systematic review must be reported in a comprehensive and transparent manner. The chosen systematised design adhered to the rigour expected from systematic reviews with regard to full search and data produced in tabular form (Grant and Booth, 2009 ). The rigorous application of the systematic review is, therefore discussed in relation to these two elements.

Firstly, to ensure a comprehensive search, this research study promoted review transparency by following a clear protocol outlined according to each review stage before collecting data (Johnston et al., 2019 ). This protocol was similar to that of Ferreira et al. ( 2016 ) and approved by three research committees/stakeholders and the researchers (Johnston et al., 2019 ). The eligibility criteria for article inclusion was based on the research question and clearly stated, and the process of inclusion was recorded on an electronic spreadsheet to create an evidence trail (Bandara et al., 2015 ; Johnston et al., 2019 ). Microsoft Excel spreadsheets are a popular tool for review studies and can increase the rigour of the review process (Bandara et al., 2015 ). Screening for appropriate articles for inclusion forms an integral part of a systematic review process (Johnston et al., 2019 ). This step was applied to two aspects of this research study: the choice of eligible journals and articles to be included. Suitable journals were selected by the first author and reviewed by the second and third authors. Initially, all articles from the chosen journals were included. Then, by process of elimination, those irrelevant to the research aim, i.e., interview articles or discussions etc., were excluded.

To ensure rigourous data extraction, data was first extracted by one reviewer, and an independent person verified the results for completeness and accuracy (Johnston et al., 2019 ). The research question served as a guide for efficient, organised data extraction (Johnston et al., 2019 ). Data was categorised according to the codes of interest, along with article identifiers for audit trails such as authors, title and aims of articles. The categorised data was based on the aim of the review (Johnston et al., 2019 ) and synthesised in tabular form under methods used, how these methods were used, and for what topics in the field of psychology.

The initial search produced a total of 1,145 articles from the 5 journals identified. Inclusion and exclusion criteria resulted in a final sample of 999 articles ( Figure 2 ). Articles were co-coded into 84 codes, from which 10 themes were derived ( Table 1 ).

Journal article frequency.

Codes used to form themes (research topics).

These 10 themes represent the topic section of our research question ( Figure 3 ). All these topics except, for the final one, psychological practice , were found to concur with the research areas in psychology as identified by Weiten ( 2010 ). These research areas were chosen to represent the derived codes as they provided broad definitions that allowed for clear, concise categorisation of the vast amount of data. Article codes were categorised under particular themes/topics if they adhered to the research area definitions created by Weiten ( 2010 ). It is important to note that these areas of research do not refer to specific disciplines in psychology, such as industrial psychology; but to broader fields that may encompass sub-interests of these disciplines.

Topic frequency (international sample).

In the case of developmental psychology , researchers conduct research into human development from childhood to old age. Social psychology includes research on behaviour governed by social drivers. Researchers in the field of educational psychology study how people learn and the best way to teach them. Health psychology aims to determine the effect of psychological factors on physiological health. Physiological psychology , on the other hand, looks at the influence of physiological aspects on behaviour. Experimental psychology is not the only theme that uses experimental research and focuses on the traditional core topics of psychology (for example, sensation). Cognitive psychology studies the higher mental processes. Psychometrics is concerned with measuring capacity or behaviour. Personality research aims to assess and describe consistency in human behaviour (Weiten, 2010 ). The final theme of psychological practice refers to the experiences, techniques, and interventions employed by practitioners, researchers, and academia in the field of psychology.

Articles under these themes were further subdivided into methodologies: method, sampling, design, data collection, and data analysis. The categorisation was based on information stated in the articles and not inferred by the researchers. Data were compiled into two sets of results presented in this article. The first set addresses the aim of this study from the perspective of the topics identified. The second set of results represents a broad overview of the results from the perspective of the methodology employed. The second set of results are discussed in this article, while the first set is presented in table format. The discussion thus provides a broad overview of methods use in psychology (across all themes), while the table format provides readers with in-depth insight into methods used in the individual themes identified. We believe that presenting the data from both perspectives allow readers a broad understanding of the results. Due a large amount of information that made up our results, we followed Cichocka and Jost ( 2014 ) in simplifying our results. Please note that the numbers indicated in the table in terms of methodology differ from the total number of articles. Some articles employed more than one method/sampling technique/design/data collection method/data analysis in their studies.

What follows is the results for what methods are used, how these methods are used, and which topics in psychology they are applied to . Percentages are reported to the second decimal in order to highlight small differences in the occurrence of methodology.

Firstly, with regard to the research methods used, our results show that researchers are more likely to use quantitative research methods (90.22%) compared to all other research methods. Qualitative research was the second most common research method but only made up about 4.79% of the general method usage. Reviews occurred almost as much as qualitative studies (3.91%), as the third most popular method. Mixed-methods research studies (0.98%) occurred across most themes, whereas multi-method research was indicated in only one study and amounted to 0.10% of the methods identified. The specific use of each method in the topics identified is shown in Table 2 and Figure 4 .

Research methods in psychology.

Research method frequency in topics.

Secondly, in the case of how these research methods are employed , our study indicated the following.

Sampling −78.34% of the studies in the collected articles did not specify a sampling method. From the remainder of the studies, 13 types of sampling methods were identified. These sampling methods included broad categorisation of a sample as, for example, a probability or non-probability sample. General samples of convenience were the methods most likely to be applied (10.34%), followed by random sampling (3.51%), snowball sampling (2.73%), and purposive (1.37%) and cluster sampling (1.27%). The remainder of the sampling methods occurred to a more limited extent (0–1.0%). See Table 3 and Figure 5 for sampling methods employed in each topic.

Sampling use in the field of psychology.

Sampling method frequency in topics.

Designs were categorised based on the articles' statement thereof. Therefore, it is important to note that, in the case of quantitative studies, non-experimental designs (25.55%) were often indicated due to a lack of experiments and any other indication of design, which, according to Laher ( 2016 ), is a reasonable categorisation. Non-experimental designs should thus be compared with experimental designs only in the description of data, as it could include the use of correlational/cross-sectional designs, which were not overtly stated by the authors. For the remainder of the research methods, “not stated” (7.12%) was assigned to articles without design types indicated.

From the 36 identified designs the most popular designs were cross-sectional (23.17%) and experimental (25.64%), which concurred with the high number of quantitative studies. Longitudinal studies (3.80%), the third most popular design, was used in both quantitative and qualitative studies. Qualitative designs consisted of ethnography (0.38%), interpretative phenomenological designs/phenomenology (0.28%), as well as narrative designs (0.28%). Studies that employed the review method were mostly categorised as “not stated,” with the most often stated review designs being systematic reviews (0.57%). The few mixed method studies employed exploratory, explanatory (0.09%), and concurrent designs (0.19%), with some studies referring to separate designs for the qualitative and quantitative methods. The one study that identified itself as a multi-method study used a longitudinal design. Please see how these designs were employed in each specific topic in Table 4 , Figure 6 .

Design use in the field of psychology.

Design frequency in topics.

Data collection and analysis —data collection included 30 methods, with the data collection method most often employed being questionnaires (57.84%). The experimental task (16.56%) was the second most preferred collection method, which included established or unique tasks designed by the researchers. Cognitive ability tests (6.84%) were also regularly used along with various forms of interviewing (7.66%). Table 5 and Figure 7 represent data collection use in the various topics. Data analysis consisted of 3,857 occurrences of data analysis categorised into ±188 various data analysis techniques shown in Table 6 and Figures 1 – 7 . Descriptive statistics were the most commonly used (23.49%) along with correlational analysis (17.19%). When using a qualitative method, researchers generally employed thematic analysis (0.52%) or different forms of analysis that led to coding and the creation of themes. Review studies presented few data analysis methods, with most studies categorising their results. Mixed method and multi-method studies followed the analysis methods identified for the qualitative and quantitative studies included.

Data collection in the field of psychology.

Data collection frequency in topics.

Data analysis in the field of psychology.

Results of the topics researched in psychology can be seen in the tables, as previously stated in this article. It is noteworthy that, of the 10 topics, social psychology accounted for 43.54% of the studies, with cognitive psychology the second most popular research topic at 16.92%. The remainder of the topics only occurred in 4.0–7.0% of the articles considered. A list of the included 999 articles is available under the section “View Articles” on the following website: https://methodgarden.xtrapolate.io/ . This website was created by Scholtz et al. ( 2019 ) to visually present a research framework based on this Article's results.

This systematised review categorised full-length articles from five international journals across the span of 5 years to provide insight into the use of research methods in the field of psychology. Results indicated what methods are used how these methods are being used and for what topics (why) in the included sample of articles. The results should be seen as providing insight into method use and by no means a comprehensive representation of the aforementioned aim due to the limited sample. To our knowledge, this is the first research study to address this topic in this manner. Our discussion attempts to promote a productive way forward in terms of the key results for method use in psychology, especially in the field of academia (Holloway, 2008 ).

With regard to the methods used, our data stayed true to literature, finding only common research methods (Grant and Booth, 2009 ; Maree, 2016 ) that varied in the degree to which they were employed. Quantitative research was found to be the most popular method, as indicated by literature (Breen and Darlaston-Jones, 2010 ; Counsell and Harlow, 2017 ) and previous studies in specific areas of psychology (see Coetzee and Van Zyl, 2014 ). Its long history as the first research method (Leech et al., 2007 ) in the field of psychology as well as researchers' current application of mathematical approaches in their studies (Toomela, 2010 ) might contribute to its popularity today. Whatever the case may be, our results show that, despite the growth in qualitative research (Demuth, 2015 ; Smith and McGannon, 2018 ), quantitative research remains the first choice for article publication in these journals. Despite the included journals indicating openness to articles that apply any research methods. This finding may be due to qualitative research still being seen as a new method (Burman and Whelan, 2011 ) or reviewers' standards being higher for qualitative studies (Bluhm et al., 2011 ). Future research is encouraged into the possible biasness in publication of research methods, additionally further investigation with a different sample into the proclaimed growth of qualitative research may also provide different results.

Review studies were found to surpass that of multi-method and mixed method studies. To this effect Grant and Booth ( 2009 ), state that the increased awareness, journal contribution calls as well as its efficiency in procuring research funds all promote the popularity of reviews. The low frequency of mixed method studies contradicts the view in literature that it's the third most utilised research method (Tashakkori and Teddlie's, 2003 ). Its' low occurrence in this sample could be due to opposing views on mixing methods (Gunasekare, 2015 ) or that authors prefer publishing in mixed method journals, when using this method, or its relative novelty (Ivankova et al., 2016 ). Despite its low occurrence, the application of the mixed methods design in articles was methodologically clear in all cases which were not the case for the remainder of research methods.

Additionally, a substantial number of studies used a combination of methodologies that are not mixed or multi-method studies. Perceived fixed boundaries are according to literature often set aside, as confirmed by this result, in order to investigate the aim of a study, which could create a new and helpful way of understanding the world (Gunasekare, 2015 ). According to Toomela ( 2010 ), this is not unheard of and could be considered a form of “structural systemic science,” as in the case of qualitative methodology (observation) applied in quantitative studies (experimental design) for example. Based on this result, further research into this phenomenon as well as its implications for research methods such as multi and mixed methods is recommended.

Discerning how these research methods were applied, presented some difficulty. In the case of sampling, most studies—regardless of method—did mention some form of inclusion and exclusion criteria, but no definite sampling method. This result, along with the fact that samples often consisted of students from the researchers' own academic institutions, can contribute to literature and debates among academics (Peterson and Merunka, 2014 ; Laher, 2016 ). Samples of convenience and students as participants especially raise questions about the generalisability and applicability of results (Peterson and Merunka, 2014 ). This is because attention to sampling is important as inappropriate sampling can debilitate the legitimacy of interpretations (Onwuegbuzie and Collins, 2017 ). Future investigation into the possible implications of this reported popular use of convenience samples for the field of psychology as well as the reason for this use could provide interesting insight, and is encouraged by this study.

Additionally, and this is indicated in Table 6 , articles seldom report the research designs used, which highlights the pressing aspect of the lack of rigour in the included sample. Rigour with regards to the applied empirical method is imperative in promoting psychology as a science (American Psychological Association, 2020 ). Omitting parts of the research process in publication when it could have been used to inform others' research skills should be questioned, and the influence on the process of replicating results should be considered. Publications are often rejected due to a lack of rigour in the applied method and designs (Fonseca, 2013 ; Laher, 2016 ), calling for increased clarity and knowledge of method application. Replication is a critical part of any field of scientific research and requires the “complete articulation” of the study methods used (Drotar, 2010 , p. 804). The lack of thorough description could be explained by the requirements of certain journals to only report on certain aspects of a research process, especially with regard to the applied design (Laher, 20). However, naming aspects such as sampling and designs, is a requirement according to the APA's Journal Article Reporting Standards (JARS-Quant) (Appelbaum et al., 2018 ). With very little information on how a study was conducted, authors lose a valuable opportunity to enhance research validity, enrich the knowledge of others, and contribute to the growth of psychology and methodology as a whole. In the case of this research study, it also restricted our results to only reported samples and designs, which indicated a preference for certain designs, such as cross-sectional designs for quantitative studies.

Data collection and analysis were for the most part clearly stated. A key result was the versatile use of questionnaires. Researchers would apply a questionnaire in various ways, for example in questionnaire interviews, online surveys, and written questionnaires across most research methods. This may highlight a trend for future research.

With regard to the topics these methods were employed for, our research study found a new field named “psychological practice.” This result may show the growing consciousness of researchers as part of the research process (Denzin and Lincoln, 2003 ), psychological practice, and knowledge generation. The most popular of these topics was social psychology, which is generously covered in journals and by learning societies, as testaments of the institutional support and richness social psychology has in the field of psychology (Chryssochoou, 2015 ). The APA's perspective on 2018 trends in psychology also identifies an increased amount of psychology focus on how social determinants are influencing people's health (Deangelis, 2017 ).

This study was not without limitations and the following should be taken into account. Firstly, this study used a sample of five specific journals to address the aim of the research study, despite general journal aims (as stated on journal websites), this inclusion signified a bias towards the research methods published in these specific journals only and limited generalisability. A broader sample of journals over a different period of time, or a single journal over a longer period of time might provide different results. A second limitation is the use of Excel spreadsheets and an electronic system to log articles, which was a manual process and therefore left room for error (Bandara et al., 2015 ). To address this potential issue, co-coding was performed to reduce error. Lastly, this article categorised data based on the information presented in the article sample; there was no interpretation of what methodology could have been applied or whether the methods stated adhered to the criteria for the methods used. Thus, a large number of articles that did not clearly indicate a research method or design could influence the results of this review. However, this in itself was also a noteworthy result. Future research could review research methods of a broader sample of journals with an interpretive review tool that increases rigour. Additionally, the authors also encourage the future use of systematised review designs as a way to promote a concise procedure in applying this design.

Our research study presented the use of research methods for published articles in the field of psychology as well as recommendations for future research based on these results. Insight into the complex questions identified in literature, regarding what methods are used how these methods are being used and for what topics (why) was gained. This sample preferred quantitative methods, used convenience sampling and presented a lack of rigorous accounts for the remaining methodologies. All methodologies that were clearly indicated in the sample were tabulated to allow researchers insight into the general use of methods and not only the most frequently used methods. The lack of rigorous account of research methods in articles was represented in-depth for each step in the research process and can be of vital importance to address the current replication crisis within the field of psychology. Recommendations for future research aimed to motivate research into the practical implications of the results for psychology, for example, publication bias and the use of convenience samples.

Ethics Statement

This study was cleared by the North-West University Health Research Ethics Committee: NWU-00115-17-S1.

Author Contributions

All authors listed have made a substantial, direct and intellectual contribution to the work, and approved it for publication.

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

• Aanstoos C. M. (2014). Psychology . Available online at: http://eds.a.ebscohost.com.nwulib.nwu.ac.za/eds/detail/detail?sid=18de6c5c-2b03-4eac-94890145eb01bc70%40sessionmgr4006&vid$=$1&hid$=$4113&bdata$=$JnNpdGU9ZWRzL~WxpdmU%3d#AN$=$93871882&db$=$ers
• American Psychological Association (2020). Science of Psychology . Available online at: https://www.apa.org/action/science/
• Appelbaum M., Cooper H., Kline R. B., Mayo-Wilson E., Nezu A. M., Rao S. M. (2018). Journal article reporting standards for quantitative research in psychology: the APA Publications and Communications Board task force report . Am. Psychol. 73 :3. 10.1037/amp0000191 [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Bandara W., Furtmueller E., Gorbacheva E., Miskon S., Beekhuyzen J. (2015). Achieving rigor in literature reviews: insights from qualitative data analysis and tool-support . Commun. Ass. Inform. Syst. 37 , 154–204. 10.17705/1CAIS.03708 [ CrossRef ] [ Google Scholar ]
• Barr-Walker J. (2017). Evidence-based information needs of public health workers: a systematized review . J. Med. Libr. Assoc. 105 , 69–79. 10.5195/JMLA.2017.109 [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Bittermann A., Fischer A. (2018). How to identify hot topics in psychology using topic modeling . Z. Psychol. 226 , 3–13. 10.1027/2151-2604/a000318 [ CrossRef ] [ Google Scholar ]
• Bluhm D. J., Harman W., Lee T. W., Mitchell T. R. (2011). Qualitative research in management: a decade of progress . J. Manage. Stud. 48 , 1866–1891. 10.1111/j.1467-6486.2010.00972.x [ CrossRef ] [ Google Scholar ]
• Breen L. J., Darlaston-Jones D. (2010). Moving beyond the enduring dominance of positivism in psychological research: implications for psychology in Australia . Aust. Psychol. 45 , 67–76. 10.1080/00050060903127481 [ CrossRef ] [ Google Scholar ]
• Burman E., Whelan P. (2011). Problems in / of Qualitative Research . Maidenhead: Open University Press/McGraw Hill. [ Google Scholar ]
• Chaichanasakul A., He Y., Chen H., Allen G. E. K., Khairallah T. S., Ramos K. (2011). Journal of Career Development: a 36-year content analysis (1972–2007) . J. Career. Dev. 38 , 440–455. 10.1177/0894845310380223 [ CrossRef ] [ Google Scholar ]
• Chryssochoou X. (2015). Social Psychology . Inter. Encycl. Soc. Behav. Sci. 22 , 532–537. 10.1016/B978-0-08-097086-8.24095-6 [ CrossRef ] [ Google Scholar ]
• Cichocka A., Jost J. T. (2014). Stripped of illusions? Exploring system justification processes in capitalist and post-Communist societies . Inter. J. Psychol. 49 , 6–29. 10.1002/ijop.12011 [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Clay R. A. (2017). Psychology is More Popular Than Ever. Monitor on Psychology: Trends Report . Available online at: https://www.apa.org/monitor/2017/11/trends-popular
• Coetzee M., Van Zyl L. E. (2014). A review of a decade's scholarly publications (2004–2013) in the South African Journal of Industrial Psychology . SA. J. Psychol . 40 , 1–16. 10.4102/sajip.v40i1.1227 [ CrossRef ] [ Google Scholar ]
• Counsell A., Harlow L. (2017). Reporting practices and use of quantitative methods in Canadian journal articles in psychology . Can. Psychol. 58 , 140–147. 10.1037/cap0000074 [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Deangelis T. (2017). Targeting Social Factors That Undermine Health. Monitor on Psychology: Trends Report . Available online at: https://www.apa.org/monitor/2017/11/trend-social-factors
• Demuth C. (2015). New directions in qualitative research in psychology . Integr. Psychol. Behav. Sci. 49 , 125–133. 10.1007/s12124-015-9303-9 [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Denzin N. K., Lincoln Y. (2003). The Landscape of Qualitative Research: Theories and Issues , 2nd Edn. London: Sage. [ Google Scholar ]
• Drotar D. (2010). A call for replications of research in pediatric psychology and guidance for authors . J. Pediatr. Psychol. 35 , 801–805. 10.1093/jpepsy/jsq049 [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Dweck C. S. (2017). Is psychology headed in the right direction? Yes, no, and maybe . Perspect. Psychol. Sci. 12 , 656–659. 10.1177/1745691616687747 [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Earp B. D., Trafimow D. (2015). Replication, falsification, and the crisis of confidence in social psychology . Front. Psychol. 6 :621. 10.3389/fpsyg.2015.00621 [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Ezeh A. C., Izugbara C. O., Kabiru C. W., Fonn S., Kahn K., Manderson L., et al.. (2010). Building capacity for public and population health research in Africa: the consortium for advanced research training in Africa (CARTA) model . Glob. Health Action 3 :5693. 10.3402/gha.v3i0.5693 [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Ferreira A. L. L., Bessa M. M. M., Drezett J., De Abreu L. C. (2016). Quality of life of the woman carrier of endometriosis: systematized review . Reprod. Clim. 31 , 48–54. 10.1016/j.recli.2015.12.002 [ CrossRef ] [ Google Scholar ]
• Fonseca M. (2013). Most Common Reasons for Journal Rejections . Available online at: http://www.editage.com/insights/most-common-reasons-for-journal-rejections
• Gough B., Lyons A. (2016). The future of qualitative research in psychology: accentuating the positive . Integr. Psychol. Behav. Sci. 50 , 234–243. 10.1007/s12124-015-9320-8 [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Grant M. J., Booth A. (2009). A typology of reviews: an analysis of 14 review types and associated methodologies . Health Info. Libr. J. 26 , 91–108. 10.1111/j.1471-1842.2009.00848.x [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Grix J. (2002). Introducing students to the generic terminology of social research . Politics 22 , 175–186. 10.1111/1467-9256.00173 [ CrossRef ] [ Google Scholar ]
• Gunasekare U. L. T. P. (2015). Mixed research method as the third research paradigm: a literature review . Int. J. Sci. Res. 4 , 361–368. Available online at: https://ssrn.com/abstract=2735996 [ Google Scholar ]
• Hengartner M. P. (2018). Raising awareness for the replication crisis in clinical psychology by focusing on inconsistencies in psychotherapy Research: how much can we rely on published findings from efficacy trials? Front. Psychol. 9 :256. 10.3389/fpsyg.2018.00256 [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Holloway W. (2008). Doing intellectual disagreement differently . Psychoanal. Cult. Soc. 13 , 385–396. 10.1057/pcs.2008.29 [ CrossRef ] [ Google Scholar ]
• Ivankova N. V., Creswell J. W., Plano Clark V. L. (2016). Foundations and Approaches to mixed methods research , in First Steps in Research , 2nd Edn. K. Maree (Pretoria: Van Schaick Publishers; ), 306–335. [ Google Scholar ]
• Johnson M., Long T., White A. (2001). Arguments for British pluralism in qualitative health research . J. Adv. Nurs. 33 , 243–249. 10.1046/j.1365-2648.2001.01659.x [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Johnston A., Kelly S. E., Hsieh S. C., Skidmore B., Wells G. A. (2019). Systematic reviews of clinical practice guidelines: a methodological guide . J. Clin. Epidemiol. 108 , 64–72. 10.1016/j.jclinepi.2018.11.030 [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Ketchen D. J., Jr., Boyd B. K., Bergh D. D. (2008). Research methodology in strategic management: past accomplishments and future challenges . Organ. Res. Methods 11 , 643–658. 10.1177/1094428108319843 [ CrossRef ] [ Google Scholar ]
• Ktepi B. (2016). Data Analytics (DA) . Available online at: https://eds-b-ebscohost-com.nwulib.nwu.ac.za/eds/detail/detail?vid=2&sid=24c978f0-6685-4ed8-ad85-fa5bb04669b9%40sessionmgr101&bdata=JnNpdGU9ZWRzLWxpdmU%3d#AN=113931286&db=ers
• Laher S. (2016). Ostinato rigore: establishing methodological rigour in quantitative research . S. Afr. J. Psychol. 46 , 316–327. 10.1177/0081246316649121 [ CrossRef ] [ Google Scholar ]
• Lee C. (2015). The Myth of the Off-Limits Source . Available online at: http://blog.apastyle.org/apastyle/research/
• Lee T. W., Mitchell T. R., Sablynski C. J. (1999). Qualitative research in organizational and vocational psychology, 1979–1999 . J. Vocat. Behav. 55 , 161–187. 10.1006/jvbe.1999.1707 [ CrossRef ] [ Google Scholar ]
• Leech N. L., Anthony J., Onwuegbuzie A. J. (2007). A typology of mixed methods research designs . Sci. Bus. Media B. V Qual. Quant 43 , 265–275. 10.1007/s11135-007-9105-3 [ CrossRef ] [ Google Scholar ]
• Levitt H. M., Motulsky S. L., Wertz F. J., Morrow S. L., Ponterotto J. G. (2017). Recommendations for designing and reviewing qualitative research in psychology: promoting methodological integrity . Qual. Psychol. 4 , 2–22. 10.1037/qup0000082 [ CrossRef ] [ Google Scholar ]
• Lowe S. M., Moore S. (2014). Social networks and female reproductive choices in the developing world: a systematized review . Rep. Health 11 :85. 10.1186/1742-4755-11-85 [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Maree K. (2016). Planning a research proposal , in First Steps in Research , 2nd Edn, ed Maree K. (Pretoria: Van Schaik Publishers; ), 49–70. [ Google Scholar ]
• Maree K., Pietersen J. (2016). Sampling , in First Steps in Research, 2nd Edn , ed Maree K. (Pretoria: Van Schaik Publishers; ), 191–202. [ Google Scholar ]
• Ngulube P. (2013). Blending qualitative and quantitative research methods in library and information science in sub-Saharan Africa . ESARBICA J. 32 , 10–23. Available online at: http://hdl.handle.net/10500/22397 . [ Google Scholar ]
• Nieuwenhuis J. (2016). Qualitative research designs and data-gathering techniques , in First Steps in Research , 2nd Edn, ed Maree K. (Pretoria: Van Schaik Publishers; ), 71–102. [ Google Scholar ]
• Nind M., Kilburn D., Wiles R. (2015). Using video and dialogue to generate pedagogic knowledge: teachers, learners and researchers reflecting together on the pedagogy of social research methods . Int. J. Soc. Res. Methodol. 18 , 561–576. 10.1080/13645579.2015.1062628 [ CrossRef ] [ Google Scholar ]
• O'Cathain A. (2009). Editorial: mixed methods research in the health sciences—a quiet revolution . J. Mix. Methods 3 , 1–6. 10.1177/1558689808326272 [ CrossRef ] [ Google Scholar ]
• O'Neil S., Koekemoer E. (2016). Two decades of qualitative research in psychology, industrial and organisational psychology and human resource management within South Africa: a critical review . SA J. Indust. Psychol. 42 , 1–16. 10.4102/sajip.v42i1.1350 [ CrossRef ] [ Google Scholar ]
• Onwuegbuzie A. J., Collins K. M. (2017). The role of sampling in mixed methods research enhancing inference quality . Köln Z Soziol. 2 , 133–156. 10.1007/s11577-017-0455-0 [ CrossRef ] [ Google Scholar ]
• Perestelo-Pérez L. (2013). Standards on how to develop and report systematic reviews in psychology and health . Int. J. Clin. Health Psychol. 13 , 49–57. 10.1016/S1697-2600(13)70007-3 [ CrossRef ] [ Google Scholar ]
• Pericall L. M. T., Taylor E. (2014). Family function and its relationship to injury severity and psychiatric outcome in children with acquired brain injury: a systematized review . Dev. Med. Child Neurol. 56 , 19–30. 10.1111/dmcn.12237 [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Peterson R. A., Merunka D. R. (2014). Convenience samples of college students and research reproducibility . J. Bus. Res. 67 , 1035–1041. 10.1016/j.jbusres.2013.08.010 [ CrossRef ] [ Google Scholar ]
• Ritchie J., Lewis J., Elam G. (2009). Designing and selecting samples , in Qualitative Research Practice: A Guide for Social Science Students and Researchers , 2nd Edn, ed Ritchie J., Lewis J. (London: Sage; ), 1–23. [ Google Scholar ]
• Sandelowski M. (2011). When a cigar is not just a cigar: alternative perspectives on data and data analysis . Res. Nurs. Health 34 , 342–352. 10.1002/nur.20437 [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Sandelowski M., Voils C. I., Knafl G. (2009). On quantitizing . J. Mix. Methods Res. 3 , 208–222. 10.1177/1558689809334210 [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Scholtz S. E., De Klerk W., De Beer L. T. (2019). A data generated research framework for conducting research methods in psychological research .
• Scimago Journal & Country Rank (2017). Available online at: http://www.scimagojr.com/journalrank.php?category=3201&year=2015
• Scopus (2017a). About Scopus . Available online at: https://www.scopus.com/home.uri (accessed February 01, 2017).
• Scopus (2017b). Document Search . Available online at: https://www.scopus.com/home.uri (accessed February 01, 2017).
• Scott Jones J., Goldring J. E. (2015). ‘I' m not a quants person'; key strategies in building competence and confidence in staff who teach quantitative research methods . Int. J. Soc. Res. Methodol. 18 , 479–494. 10.1080/13645579.2015.1062623 [ CrossRef ] [ Google Scholar ]
• Smith B., McGannon K. R. (2018). Developing rigor in quantitative research: problems and opportunities within sport and exercise psychology . Int. Rev. Sport Exerc. Psychol. 11 , 101–121. 10.1080/1750984X.2017.1317357 [ CrossRef ] [ Google Scholar ]
• Stangor C. (2011). Introduction to Psychology . Available online at: http://www.saylor.org/books/
• Strydom H. (2011). Sampling in the quantitative paradigm , in Research at Grass Roots; For the Social Sciences and Human Service Professions , 4th Edn, eds de Vos A. S., Strydom H., Fouché C. B., Delport C. S. L. (Pretoria: Van Schaik Publishers; ), 221–234. [ Google Scholar ]
• Tashakkori A., Teddlie C. (2003). Handbook of Mixed Methods in Social & Behavioural Research . Thousand Oaks, CA: SAGE publications. [ Google Scholar ]
• Toomela A. (2010). Quantitative methods in psychology: inevitable and useless . Front. Psychol. 1 :29. 10.3389/fpsyg.2010.00029 [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Truscott D. M., Swars S., Smith S., Thornton-Reid F., Zhao Y., Dooley C., et al.. (2010). A cross-disciplinary examination of the prevalence of mixed methods in educational research: 1995–2005 . Int. J. Soc. Res. Methodol. 13 , 317–328. 10.1080/13645570903097950 [ CrossRef ] [ Google Scholar ]
• Weiten W. (2010). Psychology Themes and Variations . Belmont, CA: Wadsworth. [ Google Scholar ]

Research Methods in Psychology - 4th American Edition

(40 reviews)

Carrie Cuttler, Washington State University

Rajiv S. Jhangiani, Kwantlen Polytechnic University

Dana C. Leighton, Texas A&M University, Texarkana

Copyright Year: 2019

ISBN 13: 9781999198107

Publisher: Kwantlen Polytechnic University

Language: English

Formats Available

Conditions of use.

Learn more about reviews.

Reviewed by Beth Mechlin, Associate Professor of Psychology & Neuroscience, Earlham College on 3/19/24

This is an extremely comprehensive text for an undergraduate psychology course about research methods. It does an excellent job covering the basics of a variety of types of research design. It also includes important topics related to research... read more

Comprehensiveness rating: 5 see less

This is an extremely comprehensive text for an undergraduate psychology course about research methods. It does an excellent job covering the basics of a variety of types of research design. It also includes important topics related to research such as ethics, finding journal articles, and writing reports in APA format.

Content Accuracy rating: 5

I did not notice any errors in this text.

Relevance/Longevity rating: 5

The content is very relevant. It will likely need to be updated over time in order to keep research examples relevant. Additionally, APA formatting guidelines may need to be updated when a new publication manual is released. However, these should be easy updates for the authors to make when the time comes.

Clarity rating: 5

This text is very clear and easy to follow. The explanations are easy for college students to understand. The authors use a lot of examples to help illustrate specific concepts. They also incorporate a variety of relevant outside sources (such as videos) to provide additional examples.

Consistency rating: 5

The text is consistent and flows well from one section to the next. At the end of each large section (similar to a chapter) the authors provide key takeaways and exercises.

Modularity rating: 5

This text is very modular. It is easy to pick and choose which sections you want to use in your course when. Each section can stand alone fairly easily.

Organization/Structure/Flow rating: 5

The text is very well organized. Information flows smoothly from one topic to the next.

Interface rating: 5

The interface is great. The text is easy to navigate and the images display well (I only noticed 1 image in which the formatting was a tad off).

Grammatical Errors rating: 5

I did not notice any grammatical errors.

Cultural Relevance rating: 5

The text is culturally relevant.

This is an excellent text for an undergraduate research methods course in the field of Psychology. I have been using the text for my Research Methods and Statistics course for a few years now. This text focuses on research methods, so I do use another text to cover statistical information. I do highly recommend this text for research methods. It is comprehensive, clear, and easy for students to use.

Reviewed by William Johnson, Lecturer, Old Dominion University on 1/12/24

This textbook covers every topic that I teach in my Research Methods course aside from psychology careers (which I would not really expect it to cover). read more

This textbook covers every topic that I teach in my Research Methods course aside from psychology careers (which I would not really expect it to cover).

I have not noticed any inaccurate information (other than directed students to read Malcolm Gladwell). I appreciate that the textbook includes information on research errors that have not been supported by replication efforts, such as embodied cognition.

Many of the basic concepts of research methods are rather timeless, but I appreciate that the text includes newer research as examples while also including "classic" studies that exemplify different methods.

The writing is clear and simple. The keywords are bolded and reveal a definition when clicked, which students often find very helpful. Many of the figures are very helpful in helping students understand various methods (I really like the ones in the single-subject design subchapter).

The book is very consistent in its terminology and writing style, which I see as a positive compared to other open psychology textbooks where each chapter is written by subject matter experts (such as the NOBA intro textbook).

Modularity rating: 4

I teach this textbook almost entirely in order (except for moving chapters 12 & 13 earlier in the semester to aid students in writing Results sections in their final papers). I think that the organization and consistency of the book reduces its modularity, in that earlier chapters are genuinely helpful for later chapters.

Organization/Structure/Flow rating: 4

I preferred the organization of previous editions, which had "Theory in Research" as its own chapter. If I were organizing the textbook, I am not sure that I would have out descriptive or inferential statistics as the final two chapters (I would have likely put Chapter 11: Presenting Your Research as the final chapter). I also would not have put information about replicability and open science in the inferential statistics section.

The text is easy to read and the formatting is attractive. My only minor complaint is that some of the longer subchapters can be a pretty long scroll, but I understand the desire for their only to be one page per subchapter/topic.

I have not noticed any grammatical errors.

Cultural Relevance rating: 3

I do not think the textbook is insensitive, but there is not much thought given to adapting research instruments across cultures. For instance, talking about how different constructs might have different underlying distributions in different cultures would be useful for students. In the survey methods section, a discussion of back translation or emic personality trait measurement/development for example might be a nice addition.

I choose to use this textbook in my methods classes, but I do miss the organization of the previous American editions. Overall, I recommend this textbook to my colleagues.

Reviewed by Brianna Ewert, Psychology Instructor, Salish Kootenai College on 12/30/22

This text includes the majority of content included in our undergraduate Research Methods in Psychology course. The glossary provides concise definitions of key terms. This text includes most of the background knowledge we expect our students to... read more

Comprehensiveness rating: 4 see less

This text includes the majority of content included in our undergraduate Research Methods in Psychology course. The glossary provides concise definitions of key terms. This text includes most of the background knowledge we expect our students to have as well as skill-based sections that will support them in developing their own research projects.

The content I have read is accurate and error-free.

The content is relevant and up-to-date.

The text is clear and concise. I find it pleasantly readable and anticipate undergraduate students will find it readable and understandable as well.

The terminology appears to be consistent throughout the text.

The modular sections stand alone and lend themselves to alignment with the syllabus of a particular course. I anticipate readily selecting relevant modules to assign in my course.

The book is logically organized with clear and section headings and subheadings. Content on a particular topic is easy to locate.

The text is easy to navigate and the format/design are clean and clear. There are not interface issues, distortions or distracting format in the pdf or online versions.

The text is grammatically correct.

Cultural Relevance rating: 4

I have not found culturally insensitive and offensive language or content in the text. For my courses, I would add examples and supplemental materials that are relevant for students at a Tribal College.

This textbook includes supplemental instructor materials, included slides and worksheets. I plan to adopt this text this year in our Research Methods in Psychology course. I expect it to be a benefit to the course and students.

Reviewed by Sara Peters, Associate Professor of Psychology, Newberry College on 11/3/22

This text serves as an excellent resource for introducing survey research methods topics to undergraduate students. It begins with a background of the science of psychology, the scientific method, and research ethics, before moving into the main... read more

This text serves as an excellent resource for introducing survey research methods topics to undergraduate students. It begins with a background of the science of psychology, the scientific method, and research ethics, before moving into the main types of research. This text covers experimental, non-experimental, survey, and quasi-experimental approaches, among others. It extends to factorial and single subject research, and within each topic is a subset (such as observational research, field studies, etc.) depending on the section.

I could find no accuracy issues with the text, and appreciated the discussions of research and cited studies.

There are revised editions of this textbook (this being the 4th), and the examples are up to date and clear. The inclusion of exercises at the end of each chapter offer potential for students to continue working with material in meaningful ways as they move through the book and (and course).

The prose for this text is well aimed at the undergraduate population. This book can easily be utilized for freshman/sophomore level students. It introduces the scientific terminology surrounding research methods and experimental design in a clear way, and the authors provide extensive examples of different studies and applications.

Terminology is consistent throughout the text. Aligns well with other research methods and statistics sources, so the vocabulary is transferrable beyond the text itself.

Navigating this book is a breeze. There are 13 chapters, and each have subsections that can be assigned. Within each chapter subsection, there is a set of learning objectives, and paragraphs are mixed in with tables and figures for students to have different visuals. Different application assignments within each chapter are highlighted with boxes, so students can think more deeply given a set of constructs as they consider different information. The last subsection in each chapter has key summaries and exercises.

The sections and topics in this text are very straightforward. The authors begin with an introduction of psychology as a science, and move into the scientific method, research ethics, and psychological measurement. They then present multiple different research methodologies that are well known and heavily utilized within the social sciences, before concluding with information on how to present your research, and also analyze your data. The text even provides links throughout to other free resources for a reader.

This book can be navigated either online (using a drop-down menu), or as a pdf download, so students can have an electronic copy if needed. All pictures and text display properly on screen, with no distortions. Very easy to use.

There were no grammatical errors, and nothing distracting within the text.

This book includes inclusive material in the discussion of research ethics, as well as when giving examples of the different types of research approaches. While there is always room for improvement in terms of examples, I was satisfied with the breadth of research the authors presented.

This text provides an overview of both research methods, and a nice introduction to statistics for a social science student. It would be a good choice for a survey research methods class, and if looking to change a statistics class into an open resource class, could also serve as a great resource.

Reviewed by Sharlene Fedorowicz, Adjunct Professor, Bridgewater State University on 6/23/21

The comprehensiveness of this book was appropriate for an introductory undergraduate psychology course. Critical topics are covered that are necessary for psychology students to obtain foundational learning concepts for research. Sections within... read more

The comprehensiveness of this book was appropriate for an introductory undergraduate psychology course. Critical topics are covered that are necessary for psychology students to obtain foundational learning concepts for research. Sections within the text and each chapter provide areas for class discussion with students to dive deeper into key concepts for better learning comprehension. The text covered APA format along with examples of research studies to supplement the learning. The text segues appropriately by introducing the science of psychology, followed by scientific method and ethics before getting into the core of scientific research in the field of psychology. Details are provided in quantitative and qualitative research, correlations, surveys, and research design. Overall, the text is fully comprehensive and necessary introductory research concepts.

The text appears to be accurate with no issues related to content.

Relevance/Longevity rating: 4

The text provided relevant research information to support the learning. The content was up-to-date with a variety of different examples related to the different fields of psychology. However, some topics such as in the pseudoscience section were not very relevant and bordered the line of beliefs. Here, more current or relevant solid examples would provide more relevancy in this part of the text. Bringing in more solid or concrete examples that are more current for students may have been more appropriate such as lack of connection between information found on social media versus real science.

The language and flow of the chapters accompanied by the terms, concepts, and examples of applied research allows for clarity of learning content. Terms were introduced at the appropriate time with the support of concepts and current or classic research. The writing style flows nicely and segues easily from concept to concept. The text is easy for students to understand and grasp the details related to psychological research and science.

The text provides consistency in the outline of each chapter. The beginning section chapter starts objectives as an overview to help students unpack the learning content. Key terms are consistently bolded followed by concept or definition and relevant examples. Research examples are pertinent and provide students with an opportunity to understand application of the contents. Practice exercises are provided with in the chapter and at the and in order for students to integrate learning concepts from within the text.

Sections and subsections are clearly organized and divided appropriately for ease-of-use. The topics are easily discernible and follow the flow of ideal learning routines for students. The sections and subsections are consistently outlined for each concept module. The modularity provides consistency allowing for students to focus on content rather than trying to discern how to pull out the information differently from each chapter or section. In addition, each section and subsection allow for flexibility in learning or expanding concepts within the content area.

The organization of the textbook was easy to follow and each major topic was outlined clearly. However, the chapter on presenting research may be more appropriately placed toward the end of the book rather than in the middle of the chapters related to research and research design. In addition, more information could have been provided upfront around APA format so that students could identify the format of citations within the text as practice for students throughout the book.

The interface of the book lends itself to a nice layout with appropriate examples and links to break up the different sections in the chapters. Examples where appropriate and provided engagement opportunities for the students for each learning module. Images and QR codes or easily viewed and used. Key terms are highlighted in relevant figures, graphs, and tables were appropriately placed. Overall, the interface of the text assisted with the organization and flow of learning material.

No grammatical errors were detected in this book.

The text appears to be culturally sensitive and not offensive. A variety of current and classic research examples are relevant. However, more examples of research from women, minorities, and ethnicities would strengthen the culture of this textbook. Instructors may need to supplement some research in this area to provide additional inclusivity.

Overall, I was impressed by the layout of the textbook and the ease of use. The layout provides a set of expectations for students related to the routine of how the book is laid out and how students will be able to unpack the information. Research examples were relevant, although I see areas where I will supplement information. The book provides opportunities for students to dive deeper into the learning and have rich conversations in the classroom. I plan to start using the psychology textbook for my students starting next year.

Reviewed by Anna Behler, Assistant Professo, North Carolina State University on 6/1/21

The text is very thorough and covers all of the necessary topics for an undergraduate psychology research methods course. There is even coverage of qualitative research, case studies, and the replication crisis which I have not seen in some other... read more

The text is very thorough and covers all of the necessary topics for an undergraduate psychology research methods course. There is even coverage of qualitative research, case studies, and the replication crisis which I have not seen in some other texts.

There were no issues with the accuracy of the text.

The content is very up to date and relevant for a research methods course. The only updates that will likely be necessary in the coming years are updates to examples and modifications to the section on APA formatting.

The clarity of the writing was good, and the chapters were written in a way that was accessible and easy to follow.

I did not note any issues with consistency.

Each chapter is divided into multiple subsections. This makes the chapters even easier to read, as they are broken down into short and easy to navigate sections. These sections make it easy to assign readings as needed depending on which topics are being covered in class.

Organization/Structure/Flow rating: 3

The organization was one of the few areas of weakness, and I felt that the chapters were ordered somewhat oddly. However, this is something that is easily fixed, as chapters (and even subsections) can be assigned in whatever order is needed.

There were no issues of note with the interface, and the PDF of the text was easy to navigate.

The text was well written and there were no grammatical/writing errors of note.

Overall, the book did not contain any notable instances of bias. However, it would probably be appropriate to offer a more thorough discussion of the WEIRD problem in psychology research.

Reviewed by Seth Surgan, Professor, Worcester State University on 5/24/21

Pitched very well for a 200-level Research Methods course. This text provided students with solid basis for class discussion and the further development of their understanding of fundamental concepts. read more

Pitched very well for a 200-level Research Methods course. This text provided students with solid basis for class discussion and the further development of their understanding of fundamental concepts.

No issues with accuracy.

Coverage was on target, relevant, and applicable, with good examples from a variety of subfields within Psychology.

Clearly written -- students often struggle with the dry, technical nature of concepts in Research Methods. Part of the reason I chose this text in the first place was how favorably it compared to other options in terms of clarity.

No problems with inconsistent of shifting language. This is extremely important in Research Methods, where there are many closely related terms. Language was consistent and compatible with other textbook options that were available to my students.

Chapters are broken down into sections that are reasonably sized and conceptually appropriate.

The organization of this textbook fit perfectly with the syllabus I've been using (in one form or another) for 15+ years.

This textbook was easy to navigate and available in a variety of formats.

No problems at all.

Examples show an eye toward inclusivity. I did not detect any insensitive or offensive examples or undertones.

I have used this textbook for a 200-level Research Methods course run over a single summer session. This was my first experience using an OER textbook and I don't plan on going back.

Reviewed by Laura Getz, Assistant Professor, University of San Diego on 4/29/21

The topics covered seemed to be at an appropriate level for beginner undergraduate psychology students; the learning objectives for each subsection and the key takeaways and exercises for each chapter are also very helpful in guiding students’... read more

The topics covered seemed to be at an appropriate level for beginner undergraduate psychology students; the learning objectives for each subsection and the key takeaways and exercises for each chapter are also very helpful in guiding students’ attention to what is most relevant. The glossary is also thorough and a good resource for clear definitions. I would like to see a final chapter on a “big picture” or integrating key ideas of replication, meta-analysis, and open science.

Content Accuracy rating: 4

For the most part, I like the way information is presented. I had a few specific issues with definitions for ordinal variables being quantitative (1st, 2nd, 3rd aren’t really numbers as much as ranked categories), the lack of specificity about different forms of validity (face, content, criterion, and discriminant all just labeled “validity” whereas internal and external validity appear in different sections), and the lack of clear distinction between correlational and quasi-experimental variables (e.g., in some places, country of origin is listed as making a design quasi-experimental, but in other chapters it is defined as correlational).

Some of the specific studies/experiments mentioned do not seem like the best or most relevant for students to learn about the topics, but for the most part, content is up-to-date and can definitely be updated with new studies to illustrate concepts with relative ease.

Besides the few concepts I listed above in “accuracy”, I feel the text was very accessible, provides clear definitions, and many examples to illustrate any potential technical/jargon terms.

I did not notice any issues with inconsistent terms except for terms that do have more than one way of describing the same concept (e.g., 2-sample vs. independent samples t-test)

I assigned the chapters out of order with relative ease, and students did not comment about it being burdensome to navigate.

The order of chapters sometimes did not make sense to me (e.g., Experimental before Non-experimental designs, Quasi-experimental designs separate from other non-experimental designs, waiting until Chapter 11 to talk about writing), but for the most part, the chapter subsections were logical and clear.

Interface rating: 4

I had no issues navigating the online version of the textbook other than taking a while to figure out how to move forward and back within the text itself rather than going back to the table of contents (this might just be a browser issue, but is still worth considering).

No grammatical errors of note.

There was nothing explicitly insensitive or offensive about the text, but there were many places where I felt like more focus on diversity and individual differences could be helpful. For example, ethics and history of psychological testing would definitely be a place to bring in issues of systemic racism and/or sexism and a focus on WEIRD samples (which is mentioned briefly at another point).

I was very satisfied with this free resource overall, and I recommend it for beginning level undergraduate psychology research methods courses.

Reviewed by Laura Stull, Associate Professor, Anderson University on 4/23/21

This book covers essential topics and areas related to conducting introductory psychological research. It covers all critical topics, including the scientific method, research ethics, research designs, and basic descriptive and inferential... read more

This book covers essential topics and areas related to conducting introductory psychological research. It covers all critical topics, including the scientific method, research ethics, research designs, and basic descriptive and inferential statistics. It even goes beyond other texts in terms of offering specific guidance in areas like how to conduct research literature searches and psychological measurement development. The only area that appears slightly lacking is detailed guidance in the mechanics of writing in APA style (though excellent basic information is provided in chapter 11).

All content appears accurate. For example, experimental designs discussed, descriptive and inferential statistical guidance, and critical ethical issues are all accurately addressed, See comment on relevance below regarding some outdated information.

Relevance/Longevity rating: 3

Chapter 11 on APA style does not appear to cover the most current version of the APA style guide (7th edition). While much of the information in Chapter 11 is still current, there are specifics that did change from 6th to 7th edition of the APA manual and so, in order to be current, this information would have to be supplemented with external sources.

The book is extremely well organized, written in language and terms that should be easily understood by undergraduate freshmen, and explains all necessary technical jargon.

The text is consistent throughout in terms of terminology and the organizational framework (which aids in the readability of the text).

The text is divided into intuitive and common units based on basic psychological research methodology. It is clear and easy to follow and is divided in a way that would allow omission of some information if necessary (such as "single subject research") or reorganization of information (such as presenting survey research before experimental research) without disruption to the course as a whole.

As stated previously, the book is organized in a clear and logical fashion. Not only are the chapters presented in a logical order (starting with basic and critical information like overviews of the scientific method and research ethics and progressing to more complex topics like statistical analyses).

No issues with interface were noted. Helpful images/charts/web resources (e.g., Youtube videos) are embedded throughout and are even easy to follow in a print version of the text.

No grammatical issues were noted.

No issues with cultural bias are noted. Examples are included that address topics that are culturally sensitive in nature.

I ordered a print version of the text so that I could also view it as students would who prefer a print version. I am extremely impressed with what is offered. It covers all of the key content that I am currently covering with a (non-open source) textbook in an introduction to research methods course. The only concern I have is that APA style is not completely current and would need to be supplemented with a style guide. However, I consider this a minimal issue given all of the many strengths of the book.

Reviewed by Anika Gearhart, Instructor (TT), Leeward Community College on 4/22/21

Includes the majority of elements you expect from a textbook covering research methods. Some topics that could have been covered in a bit more depth were factorial research designs (no coverage of 3 or more independent variables) and external... read more

Includes the majority of elements you expect from a textbook covering research methods. Some topics that could have been covered in a bit more depth were factorial research designs (no coverage of 3 or more independent variables) and external validity (or the validities in general).

Nothing found that was inaccurate.

Looks like a few updates could be made to chapter 11 to bring it up to date with APA 7. Otherwise, most examples are current.

Very clear, a great fit for those very new to the topic.

The framework is clear and logical, and the learning objectives are very helpful for orienting the reader immediately to the main goals of each section.

Subsections are well-organized and clear. Titles for sections and subsections are clear.

Though I think the flow of this textbook for the most part is excellent, I would make two changes: move chapter 5 down with the other chapters on experimental research and move chapter 11 to the very end. I feel that this would allow for a more logical presentation of content.

The webpage navigation is easy to use and intuitive, the ebook download works as designed, and the page can be embedded directly into a variety of LMS sites or used with a variety of devices.

I found no grammatical errors in this book.

While there were some examples of studies that included participants from several cultures, the book does not touch on ecological validity, an important external validity issue tied to cultural psychology, and there is no mention of the WEIRD culture issue in psychology, which seems somewhat necessary when orienting new psychology students to research methods today.

I currently use and enjoy this textbook in my research methods class. Overall, it has been a great addition to the course, and I am easily able to supplement any areas that I feel aren't covered with enough breadth.

Reviewed by Amy Foley, Instructor/Field & Clinical Placement Coordinator, University of Indianapolis on 3/11/21

This text provides a comprehensive overview of the research process from ideation to proposal. It covers research designs common to psychology and related fields. read more

This text provides a comprehensive overview of the research process from ideation to proposal. It covers research designs common to psychology and related fields.

Accurate information!

This book is current and lines up well with the music therapy research course I teach as a supplemental text for students to understand research designs.

Clear language for psychology and related fields.

The format of the text is consistent. I appreciate the examples, different colored boxes, questions, and links to external sources such as video clips.

It is easy to navigate this text by chapters and smaller units within each chapter. The only confusion that has come from using this text includes the fact that the larger units have roman numerals and the individual chapters have numbers. I have told students to "read unit six" and they only read the small chapter 6, not the entire unit for example.

Flows well!

I have not experienced any interface issues.

I have not found any grammar errors.

Book appears culturally relevant.

This is a great resource for research methods courses in psychology or related fields. I am glad to have used several chapters of this text within the music therapy research course I teach where students learn about research design and then create their own research proposal.

Reviewed by Veronica Howard, Associate Professor, University of Alaska Anchorage on 1/11/21, updated 1/11/21

VERY impressed by the coverage of single subject designs. I would recommend this content to colleagues. read more

VERY impressed by the coverage of single subject designs. I would recommend this content to colleagues.

Content appears accurate.

By expanding to include more contemporary research perspectives, the authors have created a wonderful dynamic that permits the text to be the foundation for many courses as well as revision and remixing for other authors.

Book easy to read, follow.

Consistency rating: 4

Content overall consistent. Only mild inconsistency in writing style between chapters.

Exceptionally modular. All content neatly divided into units with smaller portions. This would be a great book to use in a course that meets bi-weekly, or adapted into other formats.

Content organized in a clear and logical fashion, and would guide students through a semester-long course on research methods, starting with review content, broad overview of procedures (including limitations), then highlighting less common (though relevant) procedures.

Rich variety of formats for use.

No errors found.

I would appreciate more cultural examples.

Reviewed by Greg Mullin, Associate Professor, Bunker Hill Community College on 12/30/20, updated 1/6/21

I was VERY pleased with the comprehensiveness of the text. I believe it actually has an edge over the publisher-based text that I've been using for years. Each major topic was thoroughly covered with more than enough detail on individual concepts. read more

I was VERY pleased with the comprehensiveness of the text. I believe it actually has an edge over the publisher-based text that I've been using for years. Each major topic was thoroughly covered with more than enough detail on individual concepts.

I did not find any errors within the text. The authors provided an unbiased representation of research methods in psychology.

The content connects to classic, timeless examples in the field, but also mixes in a fair amount of more current, relatable examples. I feel like I'll be able to use this version of the text for many years without its age showing.

The authors present a clear and efficient writing style throughout that is rich with relatable examples. The only area that may be a bit much for undergraduate-level student understanding is the topic of statistics. I personally scale back my discussion of statistics in my Intro to Research Methods course, but for those that prefer a deeper dive, the higher-level elements are there.

I did not notice any shifts with the use of terminology or with the structural framework of the text. The text is very consistent and organized in an easily digestible way.

The authors do a fantastic job breaking complex topics down into manageable chunks both as a whole and within chapters. As I was reading, I could easily see how I could align my current approach of teaching Intro to Research Methods with their modulated presentation of the material.

I effortlessly moved through the text given the structural organization. All topics are presented in a logical fashion that allowed each message to be delivered to the reader with ease.

I read the text through the PDF version and found no issue with the interface. All image and text-based material was presented clearly.

I cannot recall coming across any grammatical errors. The text is very well written.

I did not find the text to be culturally insensitive in any way. The authors use inclusive language and even encourage that style of writing in the chapter on Presenting Your Research. I would have liked to see more cross-cultural research examples and more of an extended effort to include the theme of diversity throughout, but at no point did I find the text to be offensive.

This is a fantastic text and I look forward to adopting it for my Intro to Research Methods course in the Spring. :)

Reviewed by Maureen O'Connell, Adjunct Professor, Bunker Hill Community College on 12/15/20, updated 12/18/20

This text edition has covered all ideas and areas of research methods in psychology. It has provided a glossary of terms, sample APA format, and sample research papers.  read more

This text edition has covered all ideas and areas of research methods in psychology. It has provided a glossary of terms, sample APA format, and sample research papers. 

The content is unbiased, accurate, and I did not find any errors in the text. 

The content is current and up-to-date. I found that the text can be added to should material change, the arrangement of the text/content makes it easily accessible to add material, if necessary. 

The text is clear, easy to understand, simplistic writing at times, but I find this text easy for students to comprehend. All text is relevant to the content of behavioral research. 

The text and terminology is consistent. 

The text is organized well and sectioned appropriately. The information is presented in an easy-to-read format, with sections that can be assigned at various points during the semester and the reader can easily locate this. 

The topics in the text are organized in a logical and clear manner. It flows really well. 

The text is presented well, including charts, diagrams, and images. There did not appear to be any confusion with this text. 

The text contains no grammatical errors.

The text was culturally appropriate and not offensive. Clear examples of potential biases were outlined in this text which I found quite helpful for the reader. 

Overall, I found this to be a great edition. Much of the time I spend researching outside material for students has been included in this text. I enjoyed the format, easier to navigate, helpful to students by providing an updated version of discussions and practice assignments, and visually more appealing. 

Reviewed by Brittany Jeye, Assistant Professor of Psychology, Worcester State University on 6/26/20

All of the main topics in a Research Methods course are covered in this textbook (e.g., scientific method, ethics, measurement, experimental design, hypothesis testing, APA style, etc.). Some of these topics are not covered as in-depth as in other... read more

All of the main topics in a Research Methods course are covered in this textbook (e.g., scientific method, ethics, measurement, experimental design, hypothesis testing, APA style, etc.). Some of these topics are not covered as in-depth as in other Research Method textbooks I have used previously, but this actually may be a positive depending on the students and course level (that is, students may only need a solid overview of certain topics without getting overwhelmed with too many details). It also gives the instructor the ability to add content as needed, which helps with flexibility in course design.

I did not note any errors or inaccurate/biasing statements in the text.

For the most part, everything was up to date. There was a good mix of classic research and newer studies presented and/or used as examples, which kept the chapters interesting, topical and relevant. I only noted the section on APA Style in the chapter “Presenting Your Research” which may need some updating to be in line with the new APA 7th edition. However, there should be only minor edits needed (the chapter itself was great overview and introduction to the main points of APA style) and it looks like they should be relatively easy to implement.

The text was very well-written and was presented at an accessible level for undergraduates new to Research Methods. Terms were well-defined with a helpful glossary at the end of the textbook.

The consistent structure of the textbook is huge positive. Each chapter begins with learning objectives and ends with bulleted key takeaways. There are also good exercises and learning activities for students at the end of each chapter. Instructors may need to add their own activities for chapters that do not go into a lot of depth (there are also instructor resources online, which may have more options available).

This is one of the biggest strengths of this textbook, in my opinion. I appreciate how each chapter is broken down into clearly defined subsections. The chapters and the subsections, in particular, are not lengthy, which is great for students’ learning. These subsections could be reorganized and used in a variety of ways to suit the needs of a particular course (or even as standalone subsections).

The topics were presented in a logical manner. As mentioned above, since the textbook is very modular, I feel that you could easily rearrange the chapters to fit your needs (for example, presenting survey design before experimental research or making the presenting your research section a standalone unit).

I downloaded the textbook as an ebook, which was very easy to use/navigate. There were no problems reading any of the text or figures/tables. I also appreciated that you could open the ebook using a variety of apps (Kindle, iBook, etc.) depending on your preference (and this is good for students who have a variety of technical needs).

There were no grammatical errors noted.

The examples were inclusive of races, ethnicity and background and there were not any examples that were culturally insensitive or offensive in any way. In future iterations of the replicability section, it may be beneficial to touch upon the “weird” phenomena in psychology research (that many studies use participants who are western, educated and from industrialized, rich and democratic countries) as a point to engage students in improving psychological practices.

I will definitely consider switching to this textbook in the future for Research Methods.

Reviewed by Alice Frye, Associate Teaching Professor, University of Massachusetts Lowell on 6/22/20

Hits all the necessary marks from ways of knowing to measurement, research designs, and presentation. Comparable in detail and content to other Research Methods texts I have used for teaching. read more

Hits all the necessary marks from ways of knowing to measurement, research designs, and presentation. Comparable in detail and content to other Research Methods texts I have used for teaching.

Correct and to the point. Complex ideas such as internal consistency reliability and discriminant validity are well handled--correct descriptions that are also succinct and articulated simply and with clear examples that are easy for a student reader to grasp.

Seems likely to have good staying power. One area that has changed quickly in the past is the usefulness of various research data bases. So it is possible that portion could become more quickly outdated, but there is no predicting that. The current descriptions are useful.

Very clearly written without being condescending, overly casual or clunky.

Excellent consistency throughout in terms of organization, language usage, level of detail and tone.

Imho this is one of the particular strengths of the text. Chapters are well divided into discrete parts, which seems likely to be a benefit in cohorts of students who are increasingly accustomed to digesting small amounts of information.

Well organized, straightforward structure that is maintained throughout.

No problems with the interface.

The grammar level is another notable strength. Ideas are articulated clearly, and with sophistication, but in a syntactically very straightforward manner.

The text isn't biased or offensive. I wish that to illustrate various points and research designs it had drawn more frequently on research studies that incorporate a specific focus on race and ethnicity.

This is a very good text. As good as any for profit text I have used to teach a research methods course, if not better.

Reviewed by Lauren Mathieu-Frasier, Adjunct Instructor, University of Indianapolis on 1/13/20

As other reviews have mentioned, this textbook provides a comprehensive look at multiple concepts for an introductory course in research methods in psychology. Some of the concepts (i.e., variables, external validity) are briefly described and... read more

As other reviews have mentioned, this textbook provides a comprehensive look at multiple concepts for an introductory course in research methods in psychology. Some of the concepts (i.e., variables, external validity) are briefly described and glossed over that it will take additional information, examples, and reinforcement from instructors in the classroom. Other sections and concepts, like ethics or reporting of research were well-described and thorough.

It appeared that the information was accurate, error-free, and unbiased.

The information is up-to-date. In the section on APA presentation, it looks like the minor adjustments to the APA Publication Manual 7th Edition would need to be included. However, this section gives a good foundation and the instructor can easily implement the changes.

Clarity rating: 4

The text is clearly written written and provides an appropriate context when terminology is used.

There aren't any issues with consistency in the textbook.

The division of smaller sections can be beneficial when reading it and assigning it to classes. The sections are clearly organized based on learning objectives.

The textbook is organized in a logical, clear manner. There may be topics that instructors choose to present in a different manner (non-experimental and survey research prior to experimental). However, this doesn't generally impact the organization and flow of the book.

While reading and utilizing the book, there weren't any navigation issues that could impact the readability of the book. Students could find this textbook easy to use.

Grammatical errors were not noted.

There weren't any issues with cultural sensitivity in the examples of studies used in the textbook.

Reviewed by Tiffany Kindratt, Assistant Professor, University of Texas at Arlington on 1/1/20

The text is comprehensive with an effective glossary of terms at the end. It would be beneficial to include additional examples and exercises for students to better understand concepts covered in Chapter II, Overview of the Scientific Method,... read more

The text is comprehensive with an effective glossary of terms at the end. It would be beneficial to include additional examples and exercises for students to better understand concepts covered in Chapter II, Overview of the Scientific Method, Chapter IV, Psychological Measurement, and Chapter XII Descriptive Statistics.

The text is accurate and there are minimal type/grammatical errors throughout. The verbiage is written in an unbiased manner consistently throughout the textbook.

The content is up-to-date, and examples can be easily updated for future versions. As a public health instructor, I would be interested in seeing examples of community-based examples in future versions. The current examples provided are relevant for undergraduate public health students as well as psychology students.

The text is written in a clear manner. The studies used can be easily understood by undergraduate students in other social science fields, such as public health. More examples and exercises using inferential statistics would be helpful for students to better grasp the concepts.

The framework for each chapter and terminology used are consistent. It is helpful that each section within each chapter begins with learning objectives and the chapter ends with key takeaways and exercises.

The text is clearly divided into sections within each chapter. When I first started reviewing this textbook, I thought each section was actually a very short chapter. I would recommend including a listing of all of the objectives covered in each chapter at the beginning to improve the modularity of the text.

Some of the topics do not follow a logical order. For example, it would be more appropriate to discuss ethics before providing the overview of the scientific method. It would be better to discuss statistics used to determine results before describing how to write manuscripts. However, the text is written in a way that that the chapters could be assigned to students in a different order without impacting the students’ comprehension of the concepts.

I did not encounter any interface issues when reviewing this text. All links worked and there were no distortions of the images or charts that may confuse the reader. There are several data tables throughout the text which are left-aligned and there is a large amount of empty white space next it. I would rearrange the text in future versions to make better use of this space.

The text contains minimal grammatical errors.

The examples are culturally relevant. I did not see any examples that may be considered culturally insensitive or offensive in any way.

As an instructor for an undergraduate public health sciences and methods course, I will consider using some of the content in this text to supplement the current textbook in the future.

Reviewed by Mickey White, Assistant Professor, East Tennessee State University on 10/23/19

The table of contents is well-formatted and comprehensive. Easy to navigate and find exactly what is needed, students would be able to quickly find needed subjects. read more

The table of contents is well-formatted and comprehensive. Easy to navigate and find exactly what is needed, students would be able to quickly find needed subjects.

Content appears to be accurate and up-to-date.

This text is useful and relevant, particularly with regard to expressing and reporting descriptive statistics and results. As APA updates, the text will be easy to edit, as the sections are separated.

Easy to read and engaging.

Chapters were laid out in a consistent manner, which allows readers to know what is coming. The subsections contained a brief overview and terminology was consistent throughout. The glossary added additional information.

Sections and subsections are delineated in a usable format.

The key takeaways were useful, including the exercises at the end of each chapter.

Reading the book online is a little difficult to navigate page-by-page, but e-pub and PDF formats are easy to navigate.

No errors noted.

Would be helpful to have a clearer exploration of cultural factors impacting research, including historical bias in assessment and research outside of research ethics.

Reviewed by Robert Michael, Assistant Professor, University of Louisiana at Lafayette on 10/14/19

Successfully spans the gamut of topics expected in a Research Methods textbook. Some topics are covered in-depth, while others are addressed only at a surface level. Instructors may therefore need to carefully arrange class material for topics in... read more

Successfully spans the gamut of topics expected in a Research Methods textbook. Some topics are covered in-depth, while others are addressed only at a surface level. Instructors may therefore need to carefully arrange class material for topics in which depth of knowledge is an important learning outcome.

The factual content was error-free, according to my reading. I did spot a few grammatical and typographical errors, but they were infrequent and minor.

Great to see nuanced—although limited—discussion of issues with Null Hypothesis Significance Testing, Reproducibility in Psychological Science, and so forth. I expect that these areas are likely to grow in future editions, perhaps supplementing or even replacing more traditional material.

Extremely easy to read with multiple examples throughout to illustrate the principles being covered. Many of these examples are "classics" that students can easily relate to. Plus, who doesn't like XKCD comics?

The textbook is structured sensibly. At times, certain authors' "voices" seemed apparent in the writing, but I suspect this variability is unlikely to be noticed by or even bothersome to the vast majority of readers.

The topics are easily divisible and seem to follow routine expectations. Instructors might find it beneficial and/or necessary to incorporate some of the statistical thinking and learning into various earlier chapters to facilitate student understanding in-the-moment, rather than trying to leave all the statistics to the end.

Sensible and easy-to-follow structure. As per "Modularity", the Statistical sections may benefit from instructors folding in such learning throughout, rather than only at the end.

Beautifully presented, crisp, easy-to-read and navigate. Caveat: I read this online, in a web-browser, on only one device. I haven't tested across multiple platforms.

High quality writing throughout. Only a few minor slip-ups that could be easily fixed.

Includes limited culturally relevant material where appropriate.

Reviewed by Matthew DeCarlo, Assistant Professor, Radford University on 6/26/19

The authors do a great job of simplifying the concepts of research methods and presenting them in a way that is understandable. There is a tradeoff between brevity and depth here. Faculty who adopt this textbook may need to spend more time in... read more

The authors do a great job of simplifying the concepts of research methods and presenting them in a way that is understandable. There is a tradeoff between brevity and depth here. Faculty who adopt this textbook may need to spend more time in class going in depth into concepts, rather than relying on the textbook for all of the information related to key concepts. The text does not cover qualitative methods in detail.

The textbook provides an accurate picture of research methods. The tone is objective and without bias.

The textbook is highly relevant and up to date. Examples are drawn from modern theories and articles.

The writing is a fantastic mix of objective and authoritative while also being approachable.

The book coheres well together. Each chapter and section are uniform.

This book fits very well within a traditional 16 week semester, covering roughly a chapter per week. One could take out specific chapters and assign them individually if research methods is taught in a different way from a standard research textbook.

Content is very well organized. The table of contents is easy to navigate and each chapter is presented in a clear and consistent manner. The use of a two-tier table of contents is particularly helpful.

Standard pressbooks interface, which is great. Uses all of the standard components of Pressbooks well, though the lack of H5P and interactive content is a drawback.

I did not notice any grammar errors.

Cultural Relevance rating: 2

The book does not deal with cultural competence and humility in the research process. Integration of action research and decolonization perspectives would be helpful.

Reviewed by Christopher Garris, Associate Professor, Metropolitan State University of Denver on 5/24/19

Most content areas in this textbook were covered appropriately extensively. Notably, this textbook included some content that is commonly missing in other textbooks (e.g. presenting your research). There were some areas where more elaboration... read more

Most content areas in this textbook were covered appropriately extensively. Notably, this textbook included some content that is commonly missing in other textbooks (e.g. presenting your research). There were some areas where more elaboration and more examples were needed. For example, the section covering measurement validities included all the important concepts, but needed more guidance for student comprehension. Also, the beginning chapters on 'common sense' reasoning and pseudoscience seemed a little too brief.

Overall, this textbook appeared to be free from glaring errors. There were a couple of instances of concern, but were not errors, per se. For example, the cut-off for Cronbach's alpha was stated definitively at .80, while this value likely would be debated among researchers.

This textbook was presented in such a way that seemed protect it from becoming obsolete within the next few years. This is important for continued, consistent use of the book. The authors have revised this book, and those revisions are clearly summarized in the text. Importantly, the APA section of the textbook appears to be up-to-date. Also, the use of QR codes throughout the text is a nice touch that students may appreciate.

Connected to comprehensiveness, there are some important content areas that I felt were lacking in elaboration and examples (e.g. testing the validity of measurement; introduction of experimental design), which inhibits clarity. Overall, however, the topics seemed to be presented in a straightforward, accessible manner. The textbook includes links to informative videos and walk-throughs where appropriate, which seem to be potentially beneficial for student comprehension. The textbook includes tools designed to aid learning, namely "Key Takeaways" and "Exercises" sections at the end of most modules, but not all. "Key Takeaways" seemed valuable, as they were a nice bookend to the learning objectives stated at the beginning of each module. "Exercises" did not appear to be as valuable, especially for the less-motivated student. On their face, these seemed to be more designed for instructors to use as class activities/active learning. Lastly, many modules of the textbook were text-heavy and visually unappealing. While this is superficial, the inclusion of additional graphics, example boxes, or figures in these text-heavy modules might be beneficial.

The textbook appeared to be internally consistent with its approach and use of terminology.

The textbook had a tendency to 'throw out' big concepts very briefly in earlier modules (e.g. sampling, experimental/non-experimental design), and then cover them in more detail in later modules. This would have been less problematic if the text would explicitly inform the student that these concepts would be elaborated upon later. Beyond this issue, the textbook seems to lend itself to being divided up and used on module-by-module basis.

The organization of the chapters did not make intuitive sense to me. The fact that correlation followed experimental research, and that descriptive research was the second-to-last module in the sequence was confusing. That said, textbook is written in such a way that an instructor easily assign the modules in the order that works best for their class.

Overall, the interface worked smoothly and there were few technical issues. Where there were issues (e.g. inconsistent spacing between lines and words), they were negligible.

The text seemed to be free from glaring grammatical problems.

Because this is a methodology textbook, it does not lend itself to too much cultural criticism. That said, the book did not rely on overly controversial examples, but also didn't shy away from important cultural topics (e.g. gender stereotypes, vaccines).

Reviewed by Michel Heijnen, Assistant Professor, University of North Carolina Wilmington on 3/27/18

The book covers all areas related to research methods, not only for the field of psychology, but also to other related fields like exercise science. Topics include ethics, developing a research questions, experimental designs, non-experimental... read more

The book covers all areas related to research methods, not only for the field of psychology, but also to other related fields like exercise science. Topics include ethics, developing a research questions, experimental designs, non-experimental designs, and basic statistics, making this book a great resource for undergraduate research methods classes.

Reviewed content is accurate and seems free of any personal bias.

The topic of research methods in general is not expected to change quickly. It is not expected that this text will become obsolete in the near future. Furthermore, for both the field of psychology as well as other related fields, the examples will continue to have an application to explain certain concepts and will not be outdated soon, even with new research emerging every day.

The text is written so an undergraduate student should be able to understand the concepts. The examples provided in the text greatly contribute to the understanding of the topics and the proposed exercises at the end of each chapter will further apply the knowledge.

The layout and writing style are consistent throughout the text.

Layout of the text is clear, with multiple subsection within each chapter. Each chapter can easily be split into multiple subsection to assign to students. No evidence of self-refers was observed, and individual chapters could be assigned to students without needed to read all preceding chapters. For example, Chapter 4 may not be particularly useful to students outside of psychology, but an instructor can easily reorganize the text and skip this chapter while students can still understand following chapters.

Topics are addressed in a logical manner. Overall, an introduction to research is provided first (including ethics to research), which is followed by different types of research, and concludes with types of analysis.

No images or tables are distorted, making the text easy to read.

No grammatical errors observed in text.

Text is not offensive and does not appear to be culturally insensitive.

I believe that this book is a great resource and, as mentioned previously, can be used for a wider audience than just psychology as the basics of research methods can be applied to various fields, including exercise science.

Reviewed by Chris Koch, Professor of Psychology, George Fox University on 3/27/18

All appropriate areas and topics are covered in the text. In that sense, this book is equivalent to other top texts dealing with research methods in psychology. The appeal of this book is the brevity and clarity. Therefore, some may find that,... read more

All appropriate areas and topics are covered in the text. In that sense, this book is equivalent to other top texts dealing with research methods in psychology. The appeal of this book is the brevity and clarity. Therefore, some may find that, although the topics are covered, topics may not be covered as thoroughly they might like. Overall, the coverage is solid for an introductory course in research methods.

In terms of presentation, this book could be more comprehensive. Each chapter does start with a set of learning objectives and ends with "takeaways" and a short set of exercises. However, it lacks detailed chapter outlines, summaries, and glossaries. Furthermore, an index does not accompany the text.

I found the book to be accurate with content being fairly presented. There was no underlying bias throughout the book.

This is an introductory text for research methods. The basics of research methods have been consistent for some time. The examples used in the text fit the concepts well. Therefore, it should not be quickly dated. It is organized in such a way that sections could be easily modified with more current examples as needed.

The text is easy to read. It is succinct yet engaging. Examples are clear and terminology is adequately defined.

New terms and concepts are dealt with chapter by chapter. However, those things which go across chapters are consistently presented.

The material for each chapter is presented in subsections with each subsection being tied to a particular learning objective. It is possible to use the book by subsection instead of by chapter. In fact, I did that during class by discussing the majority of one chapter, discussing another chapter, and then covering what I previously skipped,

In general, the book follows a "traditional" organization, matching the organization of many competing books. As mentioned in regard to modularity, I did not follow the organization of the book exactly as it was laid out. This may not necessarily reflect poorly on the book, however, since I have never followed the order of any research methods book. My three exams covered chapter 1 through 4, chapters 5, 6, part of 8, and chapters 7, the remainder of 8, 9, and 10. Once we collected data I covered chapters 11 through 13.

Interface rating: 3

The text and images are clear and distortion free. The text is available in several formats including epub, pdf, mobi, odt, and wxr. Unfortunately, the electronic format is not taken full advantage of. The text could be more interactive. As it is, it is just text and images. Therefore, the interface could be improved.

The book appeared to be well written and edited.

I did not find anything in the book that was culturally insensitive or offensive. However, more examples of cross-cultural research could be included.

I was, honestly, surprised by how much I liked the text. The material was presented in easy to follow format that is consistent with how I think about research methods. That made the text extremely easy to use. Students also thought the book was highly accessible Each chapter was relatively short but informative and easy to read.

Reviewed by Kevin White, Assistant Professor, East Carolina University on 2/1/18

This book covers all relevant topics for an introduction to research methods course in the social sciences, including measurement, sampling, basic research design, and ethics. The chapters were long enough to be somewhat comprehensive, but short... read more

This book covers all relevant topics for an introduction to research methods course in the social sciences, including measurement, sampling, basic research design, and ethics. The chapters were long enough to be somewhat comprehensive, but short enough to be digestible for students in an introductory-level class. Student reviews of the book have so far been very positive. The only section of the text for which more detail may be helpful is 2.3 (Reviewing the Research Literature), in which more specific instructions related to literature searches may be helpful to students.

I did not notice any issues related to accuracy. Content appeared to be accurate, error-free, and unbiased.

One advantage of this book is that it is relevant to other applied fields outside of psychology (e.g., social work, counseling, etc.). Also, the exercises at the end of chapter sections are helpful.

The clarity of the text provides students with succinct definitions for research-related concepts, without unnecessary discipline-specific jargon. One suggestion for future editions would be to make the distinctions between different types of non-experimental research a bit more clear for students in introductory classes (e.g., "Correlational Research" in Section 7.2).

Formatting and terminology was consistent throughout this text.

A nice feature of this book is that instructors can select individual sections within chapters, or even jump between sections within chapters. For example, Section 1.4 may not fit for a class that is less clinically-oriented in nature.

The flow of the text was appropriate, with ethics close to the beginning of the book (and an entire chapter devoted to it), and descriptive/inferential statistics at the end.

I did not notice any problems related to interface. I had no trouble accessing or reading the text, and the images were clear.

The text contained no discernible grammatical errors.

The book does not appear to be culturally insensitive in any discernible way, and explicitly addresses prejudice in research (e.g., Section 5.2). However, I think that continuing to add more examples that relate to specific marginalized groups would help improve the text (and especially exercises).

Overall, this book is very useful for an introductory research methods course in psychology or social work, and I highly recommend.

Reviewed by Elizabeth Do, Instructor, Virginia Commonwealth University on 2/1/18

Although this textbook does provide good information regarding introductory concepts necessary for the understanding of correlational designs, and is presented in a logical order. It does not, however, cover qualitative methodologies, or research... read more

Although this textbook does provide good information regarding introductory concepts necessary for the understanding of correlational designs, and is presented in a logical order. It does not, however, cover qualitative methodologies, or research ethics as it relates to other countries outside of the US.

There does not seem to be any errors within the text.

Since this textbook covers a topic that is unlikely to change over the years and it's content is up-to-date, it remains relevant to the field.

The textbook is written at an appropriate level for undergraduate students and is useful in that it does explain important terminology.

There does not seem to be any major inconsistencies within the text.

Overall, the text is very well organized - it is separated into chapters that are divided up into modules and within each module, there are clear learning objectives. It is also helpful that the textbook includes useful exercises for students to practice what they've read about from the text.

The topics covered by this textbook are presented in an order that is logical. The writing is clear and the examples are very useful. However, more information could be provided in some of the chapters and it would be useful to include a table of contents that links to the different chapters within the PDF copy, for reader's ease in navigation when looking for specific terms and/or topics.

Overall, the PDF copy of the textbook made it easy to read; however, there did seem to be a few links that were missing. Additionally, it would be helpful to have some of the graphs printed in color to help with ease of following explanations provided by the text. The inclusion of a table of contents would also be useful for greater ease with navigation.

There does not seem to be any grammatical errors in the textbook. Also, the textbook is written in a clear way, and the information flows nicely.

This textbook focuses primarily on examples from the United States. It does not seem to be culturally insensitive or offensive in anyway and I liked that it included content regarding the avoidance of biased language (chapter 11).

This textbook makes the material very accessible, and it is easy to read/follow examples.

Reviewed by Eric Lindsey, Professor, Penn State University Berks Campus on 2/1/18

The content of the Research Methods in Psychology textbook was very thorough and covered what I would consider to be the important concepts and issues pertaining to research methods. I would judge that the textbook has a comparable coverage of... read more

The content of the Research Methods in Psychology textbook was very thorough and covered what I would consider to be the important concepts and issues pertaining to research methods. I would judge that the textbook has a comparable coverage of information to other textbooks I have reviewed, including the current textbook I am using. The range of scholarly sources included in the textbook was good, with an appropriate balance between older and classic research examples and newer more cutting edge research information. Overall, the textbook provides substantive coverage of the science of conducting research in the field of psychology, supported by good examples, and thoughtful questions.

The textbook adopts a coherent and student-friendly format, and offers a precise introduction to psychological research methodology that includes consideration of a broad range of qualitative and quantitative methods to help students identify and evaluate the best approach for their research needs. The textbook offers a detailed review of the way that psychological researchers approach their craft. The author guides the reader through all aspects of the research process including formulating objectives, choosing research methods, securing research participants, as well as advice on how to effectively collect, analyze and interpret data and disseminate those findings to others through a variety of presentation and publication venues. The textbook offers relevant supplemental information in textboxes that is highly relevant to the material in the accompanying text and should prove helpful to learners. Likewise the graphics and figures that are included are highly relevant and clearly linked to the material presented in the text. The information covered by the textbook reflects an accurate summary of current techniques and methods used in research in the field of psychology. The presentation of information addresses the pros and cons of different research strategies in an objective and evenhanded way.

The range of scholarly sources included in the textbook was good, with an appropriate balance between older, classic research evidence and newer, cutting edge research. Overall, the textbook provides substantive coverage of the science on most topics in research methods of psychology, supported by good case studies, and thoughtful questions. The book is generally up to date, with adequate coverage of basic data collection methods and statistical techniques. Likewise the review of APA style guidelines is reflects the current manual and I like the way the author summarizes changes from the older version of the APA manual. The organization of the textbook does appear to lend itself to editing and adding new information with updates in the future.

I found the textbook chapters to be well written, in a straightforward yet conversational manner. It gives the reader an impression of being taught by a knowledgeable yet approachable expert. The writing style gives the learner a feeling of being guided through the lessons and supported in a very conversational approach. The experience of reading the textbook is less like being taught and more like a colleague sharing information. Furthermore, the style keeps the reader engaged but doesn't detract from its educational purpose. I also appreciate that the writing is appropriately concise. No explanations are so wordy as to overwhelm or lull the reader to sleep, but at the same time the information is not so vague that the reader can't understand the point at all.

The book’s main aim is to enable students to develop their own skills as researchers, so they can generate and advance common knowledge on a variety of psychological topics. The book achieves this objective by introducing its readers, step-by-step, to psychological research design, while maintaining an excellent balance between substance and attention grabbing examples that is uncommon in other research methods textbooks. Its accessible language and easy-to-follow structure and examples lend themselves to encouraging readers to move away from the mere memorization of facts, formulas and techniques towards a more critical evaluation of their own ideas and work – both inside and outside the classroom. The content of the chapters have a very good flow that help the reader to connect information in a progressive manner as they proceed through the textbook.

Each chapter goes into adequate depth in reviewing both past and current research related to the topic that it covers for an undergraduate textbook on research methods in psychology. The information within each chapter flows well from point-to-point, so that the reader comes away feeling like there is a progression in the information presented. The only limitation that I see is that I felt the author could do a little more to let the reader know how information is connected from chapter to chapter. Rather than just drawing the reader’s attention to things that were mentioned in previous chapters, it would be nice to have brief comments about how issues in one chapter relate to topics covered in previous chapters.

In my opinion the chapters are arranged in easily digestible units that are manageable in 30-40 minute reading sessions. In fact, the author designed the chapters of the textbook in a way to make it easy to chunk information, and start and stop to easily pick up where one leaves off from one reading session to another. I also found the flow of information to be appropriate, with chapters containing just the right amount of detail for use in my introductory course in research methods in psychology.

The book is organized into thirteen chapters. The order of the chapters offers a logical progression from a broad overview of information about the principles and theory behind research in psychology, to more specific issues concerning the techniques and mechanics of conducting research. Each chapter ends with a summary of key takeaways from the chapter and exercises that do more than ask for content regurgitation. I find the organization of the textbook to be effective, and matches my approach to the course very well. I would not make any changes to the overall format with the exception of moving chapter 11 on presenting research to the end of the textbook, after the chapters on statistical analysis and interpretation.

I found the quality of the appearance of the textbook to be very good. The textbook features appropriate text and section/header font sizes that allow for an adequate zooming level to read large or smalls sections of text, that will give readers flexibility to match their personal preference. There are learning objectives at the start of each chapter to help students know what to expect. Key terms are highlighted in a separate color that are easily distinguishable in the body of the page. There are very useful visuals in every chapter, including tables, figures, and graphs. Relevant supplemental information is also highlighted in well formatted text boxes that are color coded to indicate what type of information is included. My only criticism is that the photographs included in the text are of low quality, and there are so few in the textbook that I feel it would have been better to just leave them out.

I found no grammatical errors in my review of the textbook. The textbook is generally well written, and the style of writing is at a level that is appropriate for an undergraduate class.

Although the textbook contains no instances of presenting information that is cultural insensitive or offensive, it does not offer an culturally inclusive review of information pertaining to research methods in psychology. I found no inclusion of examples of research conducting with non European American samples included in the summary of studies. Likewise the authors do place much attention on the issue of cultural sensitivity when conducing research. If there is one major weakness of the textbook I would say it is in this area, but based on my experience it is not an uncommon characteristic of textbooks on research methods in psychology.

Reviewed by zehra peynircioglu, Professor, American University on 2/1/18

Short and sweet in most areas. Covers the basic concepts, not very comprehensively but definitely adequately so for a general beginning-level research methods course. For instance, I would liked to have seen a "separate" chapter on correlational... read more

Comprehensiveness rating: 3 see less

Short and sweet in most areas. Covers the basic concepts, not very comprehensively but definitely adequately so for a general beginning-level research methods course. For instance, I would liked to have seen a "separate" chapter on correlational research (there is one on single subject research and one on survey research), a discussion of the importance of providing a theoretical rationale for "getting an idea" (most students are fine with finding interesting and feasible project ideas but cannot give a theoretical rationale) before or after Chapter 4 on Theory, or a chapter on neuroscientific methods, which are becoming more and more popular. Nevertheless, it touches on most traditional areas that are in other books.

I did not find any errors or biases

This is one area where there is not much danger of going obsolete any time soon. The examples might need to be updated periodically (my students tend to not like dated materials, however relevant), but that should be easy.

Very clear and accessible prose. Despite the brevity, the concepts are put forth quite clearly. I like the "not much fluff" mentality. There is also adequate explanations of jargon and technical terminology.

I could not find any inconsistencies. The style and exposition frameworks are also quite consistent.

Yes, the modularity is fine. The chapters follow a logical pattern, so there should not be too much of a need for jumping around. And even if jumping around is needed depending on teaching style, the sections are solid in terms of being able to stand alone (or as an accompaniment to lectures).

Yes, the contents is ordered logically and the high modularity helps with any reorganization that an instructor may favor. In my case, for instance, Ch. 1 is fine, but I would skip it because it's mostly a repetition of what most introductory psychology books also say. I would also discuss non-experimental methods before going into experimental design. But such changes are easy to do, and if someone followed the book's own organization, there would also be a logical flow.

As far as I could see, the text is free of significant interface issues, at least in the pdf version

I could not find any errors.

As far as I could see, the book was culturally relevant.

I loved the short and sweet learning objectives, key takeaway sections, and the exercises. They are not overwhelming and can be used in class discussions, too.

Reviewed by George Woodbury, Graduate Student, Miami University, Ohio on 6/20/17

This text covers the typical areas for an undergraduate psychology course in research design. There is no table of contents included with the downloadable version, although there is a table of contents on the website (which excludes sub-sections... read more

This text covers the typical areas for an undergraduate psychology course in research design. There is no table of contents included with the downloadable version, although there is a table of contents on the website (which excludes sub-sections of chapters). The sections on statistics are not extensive enough to be useful in and of themselves, but they are useful for transitions to a follow-up statistics course. There does not seem to be a glossary of terms, which made it difficult at times for my read through and I assume later for students who decide to print the text. The text is comprehensive without being wordy or tedious.

Relatively minor errors; There does not seem to be explicit cultural or methodological bias in the text.

The content is up-to-date, and examples from the psychology literature are generally within the last 25 years. Barring extensive restructuring in the fundamentals of methodology and design in psychology, any updates will be very easy to implement.

Text will be very clear and easy to read for students fluent in English. There is little jargon/technical terminology used, and the vocabulary that is provided in the text is contemporary

There do not seem to be obvious shifts in the terminology or the framework. The text is internally consistent in that regard.

The text is well divided into chapter and subsections. Each chapter is relatively self-contained, so there are little issues with referring to past material that may have been skipped. The learning objectives at the beginning of the chapter are very useful. Blocks of text are well divided with headings.

As mentioned above, the topics of the text follow the well-established trajectory of undergraduate psychology courses. This makes it very logical and clear.

The lack of a good table of contents made it difficult to navigate the text for my read through. There were links to an outside photo-hosting website (flickr) for some of the stock photos, which contained the photos of the original creators of the photos. This may be distracting or confusing to readers. However, the hyperlinks in general helped with navigation with the PDF.

No more grammatical errors than a standard, edited textbook.

Very few examples explicitly include other races, ethnicities, or backgrounds, however the examples seem to intentionally avoid cultural bias. Overall, the writing seems to be appropriately focused on avoiding culturally insensitive or offensive content.

After having examined several textbooks on research design and methodology related to psychology, this book stands out as superior.

Reviewed by Angela Curl, Assistant Professor, Miami University (Ohio) on 6/20/17

"Research Methods in Psychology" covers most research method topics comprehensively. The author does an excellent job explaining main concepts. The chapter on causation is very detailed and well-written as well as the chapter on research ethics.... read more

"Research Methods in Psychology" covers most research method topics comprehensively. The author does an excellent job explaining main concepts. The chapter on causation is very detailed and well-written as well as the chapter on research ethics. However, the explanations of data analysis seem to address upper level students rather than beginners. For example, in the “Describing Statistical Relationships” chapter, the author does not give detailed enough explanations for key terms. A reader who is not versed in research terminology, in my opinion, would struggle to understand the process. While most topics are covered, there are some large gaps. For example, this textbook has very little content related to qualitative research methods (five pages).

The content appears to be accurate and unbias.

The majority of the content will not become obsolete within a short time period-- many of the information can be used for the coming years, as the information provided is, overall, general in nature. The notably exceptions are the content on APA Code of Ethics and the APA Publication Manual, which both rely heavily on outdated versions, which limits the usefulness of these sections. In addition, it would be helpful to incorporate research studies that have been published after 2011.

The majority of the text is clear, with content that is easy for undergraduate students to read and understand. The key points included in the chapters are helpful, but some chapters seem to be missing key points (i.e., the key points do not accurately represent the overall chapter).

The text seems to be internally consistent in its terminology and organization.

Each chapter is broken into subsections that can be used alone. For example, section 5.2 covers reliability and validity of measurement. This could be extremely helpful for educators to select specific content for assigned readings.

The topics are presented in a logical matter for the most part. However, the PDF version of the book does not include a table of contents, and none of the formats has a glossary or index. This can make it difficult to quickly navigate to specific topics or terms, especially when explanations do not appear where expected. For example, the definitions of independent and dependent variables is provided under the heading “Correlation Does Not Imply Causation” (p. 22).

The text is consistent but needs more visual representations throughout the book, rather than heavily in some chapters and none at all in other chapters. Similarly, the text within the chapters is not easily readable due to the large sections of text with little to no graphics or breaks.

The interface of the text is adequate. However, the formatting of the PDF is sometimes weak. For example, the textbook has a number of pages with large blank spaces and other pages are taken up with large photos or graphics. The number of pages (and cost of printing) could have been reduced, or more graphics added to maximize utility.

I found no grammatical errors.

Text appears to be culturally sensitive. I appreciated the inclusion of the content about avoiding biased language (chapter 11).

Instructors who adopt this book would likely benefit from either selecting certain chapters/modules and/or integrating multiple texts together to address the shortcomings of this text. Further, the sole focus on psychology limits the use of this textbook for introductory research methods for other disciplines (e.g., social work, sociology).

Reviewed by Pramit Nadpara, Assistant Professor, Virginia Commonwealth University on 4/11/17

The text book provides good information in certain areas, while not comprehensive information in other areas. The text provides practical information, especially the section on survey development was good. Additional information on sampling... read more

The text book provides good information in certain areas, while not comprehensive information in other areas. The text provides practical information, especially the section on survey development was good. Additional information on sampling strategies would have been beneficial for the readers.

There are no errors.

Research method is a common topic and the fundamentals of it will not change over the years. Therefore, the book is relevant and will not become obsolete.

Clarity rating: 3

The text in the book is clear. Certain aspects of the text could have been presented more clearly. For example, the section on main effects and interactions are some concepts that students may have difficulty understanding. Those areas could be explained more clearly with an example.

Consistency rating: 3

Graphs in the book lacks titles and variable names. Also, the format of chapter title page needs to be consistent.

At times there were related topics spread across several chapters. This could be corrected for a better read by the audience..

The book text is very clear, and the flow from one topic to the next was adequate. However, having a outline would help the reader.

The PDF copy of the book was a easy read. There were few links that were missing though.

There were no grammatical errors.

The text is not offensive and examples in it are mostly based on historical US based experiments.

I would start of by saying that I am a supporter of the Open Textbook concept. In this day and age, there are a variety of Research Methods book/text available on the market. While this book covers research methods basics, it cannot be recommended in its current form as an acceptable alternative to the standard text. Modifications to the text as recommended by myself and other reviewers might improve the quality of this book in the future.

Reviewed by Meghan Babcock, Instructor, University of Texas at Arlington on 4/11/17

This text includes all important areas that are featured in other Research Methods textbooks and are presented in a logical order. The text includes great examples and provides the references which can be assigned as supplemental readings. In... read more

This text includes all important areas that are featured in other Research Methods textbooks and are presented in a logical order. The text includes great examples and provides the references which can be assigned as supplemental readings. In addition, the chapters end with exercises that can be completed in class or as part of a laboratory assignment. This text would be a great addition to a Research Methods course or an Introductory Statistics course for Psychology majors.

The content is accurate. I did not find any errors and the material is unbiased.

Yes - the content is up to date and would be easy to update if/when necessary.

The text is written at an appropriate level for undergraduate students and explains important terminology. The research studies that the author references are ones that undergraduate psychology majors should be familiar with. The only section that was questionable to me was that on multiple regression in section 8.3 (Complex Correlational Designs). I am unaware of other introductory Research Methods textbooks that cover this analysis, especially without describing simple regression first.

The text is consistent in terms of terminology. The framework is also consistent - the chapters begin with Learning Objectives and ends with Key Takeaways and Exercises.

The text is divisible into smaller reading sections - possibly too many. The sections are brief, and in some instances too brief (e.g., the section on qualitative research). I think that the section headers are helpful for instructors who plan on using this text in conjunction with another text in their course.

The topics were presented in a logical fashion and are similar to other published Research Methods texts. The writing is very clear and great examples are provided. I think that some of the sections are rather brief and more information and examples could be provided.

I did not see any interface issues. All of the links worked properly and the tables and figures were accurate and free of errors. I particularly liked the figures in section 5.2 on reliability of measurement.

There are three comments that I have about the interface, however. First, I was expecting the keywords in blue font to be linked to a glossary, but they were not. I would have appreciated this feature. Second, I read this text as a PDF on an iPad and this version lacking was the Table of Contents (TOC) feature. Although I was able to view the TOC in different versions, I would have appreciated it in the PDF version. Also, it would be nice if the TOC was clickable (i.e., you could click on a section and it automatically directed you to that section). Third, I think the reader of this text would benefit from a glossary at the end of each chapter and/or an index at the end of the text. The "Key Takeaways" sections at the end of each chapter were helpful, but I think that a glossary would be a nice addition as well.

I did not notice any grammatical errors of any kind. The text was easy to read and I think that undergraduate students would agree.

The text was not insensitive or offensive to any races, ethnicities, or backgrounds. I appreciated the section on avoiding biased language when writing manuscripts (e.g., using 'children with learning disabilities' instead of 'special children' or using 'African American' instead of 'minority').

I think that this text would be a nice addition to a Research Methods & Statistics course in psychology. There are some sections that I found particularly helpful: (1) 2.2 and 2.3 - the author gives detailed information about generating research questions and reviewing the literature; (2) 9.2 - this section focuses on constructing survey questionnaires; (3) 11.2 and 11.3 - the author talks about writing a research report and about presenting at conferences. These sections will be great additions to an undergraduate Research Methods course. The brief introduction to APA style was also helpful, but should be supplemented with the most recent APA style manual.

Reviewed by Shannon Layman, Lecturer, University of Texas at Arlington on 4/11/17

The sections in this textbook are overall more brief than in previous Methods texts that I have used. Sometimes this brevity is helpful in terms of getting to the point of the text and moving on. In other cases, some topics could use a bit more... read more

The sections in this textbook are overall more brief than in previous Methods texts that I have used. Sometimes this brevity is helpful in terms of getting to the point of the text and moving on. In other cases, some topics could use a bit more detail to establish a better foundation of the content before moving on to examples and/or the next topic.

I did not find any incorrect information or gross language issues.

Basic statistical and/or methodological texts tend to stay current and up-to-date because the topics in this field have not changed over the decades. Any updated methodologies would be found in a more advanced methods text.

The text is very clear and the ideas are easy to follow/ presented in a logical manner. The most helpful thing about this textbook is that the author arrives at the point of the topic very quickly. Another helpful point about this textbook is the relevancy of the examples used. The examples appear to be accessible to a wide audience and do not require specialization or previous knowledge of other fields of psychology.

I feel this text is very consistent throughout. The ideas build on each other and no terms are discussed in later chapters without being established in previous chapters.

Each chapter had multiple subsections which would allow for smaller reading sections throughout the course. The amount of content in each section and chapter appeared to be less than what I have encountered in other Methods texts.

The organization of the topics in this textbook follows the same or similar organization that I see in other textbooks. As I mentioned previously, the ideas build very well throughout the text.

I did not find any issues with navigation or distortion of the figures in the text.

There were not any obvious and/or egregious grammatical errors that I encountered in this text.

This topic is not really an issue with a Methods textbook as the topics are more so conceptual as opposed to topical. That being said, I did not see an issue with any examples used.

I have no other comments than what I addressed previously.

Reviewed by Sarah Allred, Associate Professor, Rutgers University, Camden on 2/8/17

Mixed. For some topics, there is more (and more practical) information than in most textbooks. I appreciated the very practical advice to students about how to plot data (in statistics chapters). Similarly, there is practical advice about how... read more

Mixed. For some topics, there is more (and more practical) information than in most textbooks. I appreciated the very practical advice to students about how to plot data (in statistics chapters). Similarly, there is practical advice about how to comply with ethical guidelines. The section on item development in surveys was very good.

On the other hand, there is far too little information about some subjects. For example, independent and dependent variables are introduced in passing in an early chapter and then referred to only much later in the text. In my experience, students have a surprisingly difficult time grasping this concept. Another important example is sampling; I would have preferred much more information on types of samples and sampling techniques, and the problems that arise from poor sampling. A third example is the introduction to basic experimental design. Variables, measurement, validity, and reliability are all introduced in one chapter.

I did not see an index or glossary.

I found no errors.

The fundamentals of research methods do not change much. Given the current replication crisis in psychology, it might be helpful to have something about replicability.

Mixed. The text itself is spare and clear. The style of the book is to explain a concept in very few words. There are some excellent aspects of this, but on the other hand, there are some concepts that students have a very difficult time undersatnding if they are not embedded in concrete examples. For example, the section on main effects and interactions shows bar graphs of interactions, but this is presented without variable names or axis titles, and separate from any specific experiment.

Sometimes the chapter stucture is laid out on the title page, and other times it is not. Some graphs lack titles and variable names.

The chapters can be stand alone, but sometimes I found conceptually similar pieces spread across several chapters, and conceptually different pieces in the same chapters.

The individual sentences and paragraphs are always very clear. However, I felt that more tables/outlines of major concepts would have been helpful. For example, perhaps a flow chart of different kinds of experimental designs would be useful. (See section on comprehensiveness for more about organization).

The flow from one topic to the next was adequate.

I read the pdf. Perhaps the interface is more pleasant on other devices, but I found the different formats and fonts in image/captions/main text/figure labels distracting. Many if the instances of apparently hyperlinked (blue) text to do not link to anything.

I found no grammatical errors, and prose is standard academic English.

Like most psychology textbooks available in the US, examples are focused on important experiments in US history.

I really wanted to be happy with this text. I am a supporter of the Open Textbook concept, and I wanted to find this book an acceptable alternative to the variety of Research Methods texts I’ve used. Unfortunately, I cannot recommend this book as superior in quality.

Reviewed by Joel Malin, Assistant Professor, Miami University on 8/21/16

This textbook covers all or nearly all of what I believe are important topics to provide an introduction to research methods in psychology. One minor issue is that the pdf version, which I reviewed, does not include an index or a glossary. As... read more

This textbook covers all or nearly all of what I believe are important topics to provide an introduction to research methods in psychology. One minor issue is that the pdf version, which I reviewed, does not include an index or a glossary. As such, it may be difficult for readers to zero in on material that they need, and/or to get a full sense of what will be covered and in what order.

I did not notice errors.

The book provides a solid overview of key issues related to introductory research methods, many of which are nearly timeless.

The writing is clear and accessible. It was easy and pleasing to read.

Terms are clearly defined and build upon each other as the book progresses.

I believe the text is organized in such a way that it could be easily divided into smaller sections.

The order in which material is presented seems to be well thought out and sensible.

I did not notice any issues with the interface. I reviewed the pdf version and thought the images were very helpful.

The book is written in a culturally relevant manner.

Reviewed by Abbey Dvorak, Assistant Professor, University of Kansas on 8/21/16

The text includes basic, essential information needed for students in an introductory research methods course. In addition, the text includes three chapters (i.e., research ethics, theory, and APA style) that are typically absent from or... read more

The text includes basic, essential information needed for students in an introductory research methods course. In addition, the text includes three chapters (i.e., research ethics, theory, and APA style) that are typically absent from or inadequately covered in similar texts. However, I did have some areas of concern regarding the coverage of qualitative and mixed methods approaches, and nonparametric tests. Although the author advocates for the research question to guide the choice of approach and design, minimal attention is given to the various qualitative designs (e.g., phenomenology, narrative, participatory action, etc.) beyond grounded theory and case studies, with no mention of the different types of mixed methods designs (e.g., concurrent, explanatory, exploratory) that are prevalent today. In addition, common nonparametric tests (e.g., Wilcoxon, Mann-Whitney, etc.) and parametric tests for categorical data (e.g., chi-square, Fisher’s exact, etc.) are not mentioned.

The text overall is accurate and free of errors. I noticed in the qualitative research sub-section, the author describes qualitative research in general, but does not mention common practices associated with qualitative research, such as transcribing interviews, coding data (e.g., different approaches to coding, different types of codes), and data analysis procedures. The information that is included appears accurate.

The text appears up-to-date and includes basic research information and classic examples that rarely change, which may allow the text to be used for many years. However, the author may want to add information about mixed methods research, a growing research approach, in order for the text to stay relevant across time.

The text includes clear, accessible, straightforward language with minimal jargon. When the author introduces a new term, the term is immediately defined and described. The author also provides interesting examples to clarify and expand understanding of terms and concepts throughout the text.

The text is internally consistent and uses similar language and vocabulary throughout. The author uses real-life examples across chapters in order to provide depth and insight into the information. In addition, the vocabulary, concepts, and organization are consistent with other research methods textbooks.

The modules are short, concise, and manageable for students; the material within each module is logically focused and related to each other. I may move the modules and the sub-topics within them into a slightly different order for my class, and add the information mentioned above, but overall, this is very good.

The author presents topics and structures chapters in a logical and organized manner. The epub and online version do not include page numbers in the text, but the pdf does; this may be confusing when referencing the text or answering student questions. The book ends somewhat abruptly after the chapter on inferential statistics; the text may benefit from a concluding chapter to bring everything together, perhaps with a culminating example that walks the reader through creating the research question, choosing a research approach/design, etc., all the way to writing the research report.

I used and compared the pdf, epub, and online versions of the text. The epub and online versions include a clickable table of contents, but the pdf does not. The table format is inconsistent across the three versions; in the epub version (viewed through ibooks), the table data does not always line up correctly, making it difficult to interpret quickly. In the pdf and online versions, the table format looks different, but the data are lined up. No index made it difficult to quickly find areas of interest in the text; however, I could use the Find/Search functions in all three versions to search and find needed items.

As I read through this text, I did not detect any glaring grammatical errors. Overall, I think the text is written quite well in a style that is accessible to students.

The author uses inclusive, person-first language, and the text does not seem to be offensive or insensitive. As I read, I did notice that topics such as diversity and cultural competency are absent.

I enjoyed reading this text and am very excited to have a free research methods text for my students that I may supplement as needed. I wish there was a test question bank and/or flashcards for my students to help them study, but perhaps that could be added in the future. Overall, this is a great resource!

Reviewed by Karen Pikula, Psychology Instructor PhD, Central Lakes College on 1/7/16

The text covers all the areas and ideas of the subject of research methods in psychology for the learner that is just entering the field. The authors cover all of the content of an introductory research methods textbook and use exemplary examples... read more

The text covers all the areas and ideas of the subject of research methods in psychology for the learner that is just entering the field. The authors cover all of the content of an introductory research methods textbook and use exemplary examples that make those concepts relevent to a beginning researcher. As the authors state, the material is presented in such a manner as to encourage learners to not only be effective consumers of current research but also engage as critical thinkers in the many diverse situations one encounters in everyday life.

The content is accurate, error free, and unbiased. It explains both quantiative and qualitative methods in an unbiased manner. It is a bit slim on qualitative. It would be nice to have a bit more information on, for example, creating interview questions, coding, and qualitative data anaylisis.

The text is up to date, having just been revised. This revision was authored by Rajiv Jhangiani (Capilano University, North Vancouver) and includes the addition of a table of contents and cover page that the original text did not have, changes to Chapter 3 (Research Ethics) to include a contemporary example of an ethical breach and to reflect Canadian ethical guidelines and privacy laws, additional information regarding online data collection in Chapter 9 (Survey Research). Jhangiani has correcte of errors in the text and formulae, as well as changing spelling from US to Canadian conventions. The text is also now available in a inexpensive hard copy which students can purchase online or college bookstores can stock. This makes the text current and updates should be minimal.

The text is very easy to read and also very interesting as the authors supplement content with amazing real life examples.

The text is internally consistent in terms of terminology and framework.

This text is easily and readily divisible into smaller reading sections that can be assigned at different points within a course. I am going to use this text in conjunction with the OER OpenStax Psychology text for my Honors Psychology course. I currently use the OER Openstax Psychology textbook for my Positive Psychology course as well as my General Psychology course,

The topics in the text are presented in logical and clear fashion. The way they are presented allows the text to be used in conjuction with other textbooks as a secondary resource.

The text is free of significant interface issues. It is written in a manner that follows the natural process of doing research.

The text contained no noted grammatical errors.

The text is not culturally insensitive or offensive and actually has been revised to accomodate Canadian ethical guidelines as well as those of the APA.

I have to say that I am excited to have found this revised edition. My students will be so happy that there is also a reasonable priced hard coopy for them to purchase. They love the OpenStax Psychology text with the hard copy available from our bookstore. I do wish there were PowerPoints available for the text as well as a test bank. That is always a bonus!

Reviewed by Alyssa Gibbons, Instructor, Colorado State University on 1/7/16

This text covers everything I would consider essential for a first course in research methods, including some areas that are not consistently found in introductory texts (e.g., qualitative research, criticisms of null hypothesis significance... read more

This text covers everything I would consider essential for a first course in research methods, including some areas that are not consistently found in introductory texts (e.g., qualitative research, criticisms of null hypothesis significance testing). The chapters on ethics (Ch. 3) and theory (Ch. 4) are more comprehensive than most I have seen at this level, but not to the extent of information overload; rather, they anticipate and address many questions that undergraduates often have about these issues.

There is no index or table of contents provided in the PDF, and the table of contents on the website is very broad, but the material is well organized and it would not be hard for an instructor to create such a table. Chapter 2.1 is intended to be an introduction to several key terms and ideas (e.g., variable, correlation) that could serve as a sort of glossary.

I found the text to be highly accurate throughout; terms are defined precisely and correctly.

Where there are controversies or differences of opinion in the field, the author presents both sides of the argument in a respectful and unbiased manner. He explicitly discourages students from dismissing any one approach as inherently flawed, discussing not only the advantages and disadvantages of all methods (including nonexperimental ones) but also ways researchers address the disadvantages.

In several places, the textbook explicitly addresses the history and development of various methods (e.g., qualitative research, null hypothesis significance testing) and the ways in which researchers' views have changed. This allows the author to present current thinking and debate in these areas yet still expose students to older ideas they are likely to encounter as they read the research literature. I think this approach sets students up well to encounter future methodological advances; as a field, we refine our methods over time. I think the author could easily integrate new developments in future editions, or instructors could introduce such developments as supplementary material without creating confusion by contradicting the test.

The examples are generally drawn from classic psychological studies that have held up well over time; I think they will appeal to students for some time to come and not appear dated.

The only area in which I did not feel the content was entirely up to date was in the area of psychological measurement; Chapter 5.2 is based on the traditional view and not the more comprehensive modern or holistic view as presented in the 1999 AERA/APA Standards for Educational and Psychological Measurement. However, a comprehensive treatment of measurement validity is probably not necessary for most undergraduates at this stage, and they will certainly encounter the older framework in the research literature.

The textbook does an excellent job of presenting concepts in simple, accessible language without introducing error by oversimplification. The author consistently anticipates common points of confusion, clarifies terms, and even suggests ways for students to remember key distinctions. Terms are clearly and concretely defined when they are introduced. In contrast to many texts I have used, the terms that are highlighted in the text are actually the terms I would want my students to remember and study; the author refrains from using psychological jargon that is not central to the concepts he is discussing.

I noticed no major inconsistencies or gaps.

The division of sections within each chapter is useful; although I liked the overall organization of the text, there were points at which I would likely assign sections in a slightly different order and I felt I could do this easily without loss of continuity. The one place I would have liked more modularity was in the discussion of inferential statistics: t-tests, ANOVA, and Pearson's r are all covered within Chapter 13.2. On the one hand, this enables students to see the relationships and similarities among these tests, but on the other, this is a lot for students to take in at once.

I found the overall organization of the book to be quite logical, mirroring the sequence of steps a researcher would use to develop a research question, design a study, etc. As discussed above, the modularity of the book makes it easy to reorder sections to suit the structure of a particular class (for example, I might have students read the section on APA writing earlier in the semester as they begin drafting their own research proposals). I like the inclusion of ethics very early on in the text, establishing the importance of this topic for all research design choices.

One organizational feature I particularly appreciated was the consistent integration of conceptual and practical ideas; for example, in the discussion of psychological measurement, reliability and validity are discussed alongside the importance of giving clear instructions and making sure participants cannot be identified by their writing implements. This gives students an accurate and honest picture of the research process - some of the choices we make are driven by scientific ideals and some are driven by practical lessons learned. Students often have questions related to these mundane aspects of conducting research and it is helpful to have them so clearly addressed.

Although I didn't encounter any problems per se with the interface, I do think it could be made more user-friendly. For example, references to figures and tables are highlighted in blue, appearing to be hyperlinks, but they were not. Having such links, as well as a linked, easily-navigable and detailed table of contents, would also be helpful (and useful to students who use assistive technology).

I noticed no grammatical errors.

Where necessary, the author uses inclusive language and there is nothing that seems clearly offensive. The examples generally reflect American psychology research, but the focus is on the methods used and not the participants or cultural context. The text could be more intentionally or proactively inclusive, but it is not insensitive or exclusive.

I am generally hard to please when it comes to textbooks, but I found very little to quibble with in this one. It is a very well-written and accessible introduction to research methods that meets students where they are, addressing their common questions, misconceptions, and concerns. Although it's not flashy, the figures, graphics, and extra resources provided are clear, helpful, and relevant.

Reviewed by Moin Syed, Assistant Professor, University of Minnesota on 6/10/15

The text is thorough in terms of covering introductory concepts that are central to experimental and correlational/association designs. I find the general exclusion of qualitative and mixed methods designs hard to defend (despite some researchers’... read more

The text is thorough in terms of covering introductory concepts that are central to experimental and correlational/association designs. I find the general exclusion of qualitative and mixed methods designs hard to defend (despite some researchers’ distaste for the methods). While these approaches were less commonly used in the recent past, they are prevalent in the early years of psychology and are ascending once again. It strikes me as odd to just ignore two whole families of methods that are used within the practice of psychology—definitely not a sustainable approach.

I do very much appreciate the emphasis on those who will both practice and consume psychology, given the wide variety of undergraduate career paths.

One glaring omission is a Table of Contents within the PDF. It would be nice to make this a linked PDF, so that clicking on the entry in a TOC (or cross-references) would jump the reader to the relevant section.

I did not see an errors. The chapter on theory is not as clear as it could be. The section “what is theory” is not very clear, and these are difficulte concepts (difference between theory, hypothesis, etc.). A bit more time spent here could have been good. Also, the discussion of functional, mechanistic, and typological theories leaves out the fourth of Pepper’s metaphors: contextualism. I’m not sure that was intentional and accidental, but it is noticeable!

This is a research methods text focused on experimental and association designs. The basics of these designs do not change a whole lot over time, so there is little likelihood that the main content will become obsolete anytime soon. Some of the examples used are a bit dated, but then again most of them are considered “classics” in the field, which I think are important to retain (and there is at least one “new classic” included in the ethics section, namely the fraudulent research linking autism to the MMR vaccine).

The text is extremely clear and accessible. In fact, it may even be *too* simple for undergraduate use. Then again, students often struggle with methods, so simplicity is good, and the simplicity can also make the book marketable to high school courses (although I doubt many high schools have methods courses).

Yes, quite consistent throughout. Carrying through the same examples into different chapters is a major strength of the text.

I don’ anticipate any problems here.

The book flows well, with brief sections. I do wonder if maybe the sections are too brief? Perhaps too many check-ins? The “key take-aways” usually come after only a few pages. As mentioned above, the book is written at a very basic level, so this brevity is consistent with that approach. It is not a problem, per se, but those considering adopting the text should be aware of this aspect.

No problems here.

I did not detect any grammatical errors. The text flows very well.

The book is fairly typical of American research methods books in that it only focuses on the U.S. context and draws its examples from “mainstream” psychology (e.g., little inclusion of ethnic minority or cross-cultural psychology). However, the text is certainly not insensitive or offensive in any way.

Nice book, thanks for writing it!

Reviewed by Rajiv Jhangiani, Instructor, Capilano University on 10/9/13

The text is well organized and written, integrates excellent pedagogical features, and covers all of the traditional areas of the topic admirably. The final two chapters provide a good bridge between the research methods course and the follow-up... read more

The text is well organized and written, integrates excellent pedagogical features, and covers all of the traditional areas of the topic admirably. The final two chapters provide a good bridge between the research methods course and the follow-up course on behavioural statistics. The text integrates real psychological measures, harnesses students' existing knowledge from introductory psychology, includes well-chosen examples from real life and research, and even includes a very practical chapter on the use of APA style for writing and referencing. On the other hand, it does not include a table of contents or an index, both of which are highly desirable. The one chapter that requires significant revision is Chapter 3 (Research Ethics), which is based on the US codes of ethics (e.g., Federal policy & APA code) and does not include any mention of the Canadian Tri-Council Policy Statement.

The very few errors I found include the following: 1. The text should read "The fact that his F score…" instead of "The fact that his t score…" on page 364 2. Some formulae are missing the line that separates the numerator from the denominator. See pages 306, 311, 315, and 361 3. Table 12.3 on page 310 lists the variance as 288 when it is 28.8

The text is up-to-date and will not soon lose relevance. The only things I would add are a brief discussion of the contemporary case of Diederik Stapel's research fraud in the chapter on Research Ethics, as well as some research concerning the external validity of web-based studies (e.g., Gosling et al.'s 2004 article in American Psychologist).

Overall, the style of writing makes this text highly accessible. The writing flows well, is well organized, and includes excellent, detailed, and clear examples and explanations for concepts. The examples often build on concepts or theories students would have covered in their introductory psychology course. Some constructive criticism: 1. When discussing z scores on page 311 it might have been helpful to point out that the mean and SD for a set of calculated z scores are 0 and 1 respectively. Good students will come to this realization themselves, but it is not a bad thing to point it out nonetheless. 2. The introduction of the concept of multiple regression might be difficult for some students to grasp. 3. The only place where I felt short of an explanation was in the use of a research example to demonstrate the use of a line graph on page 318. In this case the explanation in question does not pertain to the line graph itself but the result of the study used, which is so fascinating that students will wish for the researchers' explanation for it.

The text is internally consistent.

The text is organized very well into chapters, modules within each chapter, and learning objectives within each module. Each module also includes useful exercises that help consolidate learning.

As mentioned earlier, the style of writing makes this text highly accessible. The writing flows well, is well organized, and includes excellent, detailed, and clear examples and explanations for concepts. The examples often build on concepts or theories students would have covered in their introductory psychology course. Only rarely did I feel that the author could have assisted the student by demonstrating the set-by-step calculation of a statistic (e.g., on page 322 for the calculation of Pearson's r)

The images, graphs, and charts are clear. The only serious issues that hamper navigation are the lack of a table of contents and an index. Many of the graphs will need to be printed in colour (or otherwise modified) for the students to follow the explanations provided in the text.

The text is written rather well and is free from grammatical errors. Of course, spellings are in the US convention.

The text is not culturally insensitive or offensive. Of course, it is not a Canadian edition and so many of the examples (all of which are easy to comprehend) come from a US context.

I have covered most of these issues in my earlier comments. The only things left to mention are that the author should have clearly distinguished between mundane and psychological realism, and that, in my opinion, the threats to internal validity could have been grouped together and might have been closer to an exhaustive list. This review originated in the BC Open Textbook Collection and is licensed under CC BY-ND.

Table of Contents

• Chapter 1: The Science of Psychology
• Chapter 2: Overview of the Scientific Method
• Chapter 3: Research Ethics
• Chapter 4: Psychological Measurement
• Chapter 5: Experimental Research
• Chapter 6: Non-experimental Research
• Chapter 7: Survey Research
• Chapter 8: Quasi-Experimental Research
• Chapter 9: Factorial Designs
• Chapter 10: Single-Subject Research
• Chapter 11: Presenting Your Research
• Chapter 12: Descriptive Statistics
• Chapter 13: Inferential Statistics

Ancillary Material

• Kwantlen Polytechnic University

About the Book

This fourth edition (published in 2019) was co-authored by Rajiv S. Jhangiani (Kwantlen Polytechnic University), Carrie Cuttler (Washington State University), and Dana C. Leighton (Texas A&M University—Texarkana) and is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License. Revisions throughout the current edition include changing the chapter and section numbering system to better accommodate adaptions that remove or reorder chapters; continued reversion from the Canadian edition; general grammatical edits; replacement of “he/she” to “they” and “his/her” to “their”; removal or update of dead links; embedded videos that were not embedded; moved key takeaways and exercises from the end of each chapter section to the end of each chapter; a new cover design.

About the Contributors

Dr. Carrie Cuttler received her Ph.D. in Psychology from the University of British Columbia. She has been teaching research methods and statistics for over a decade. She is currently an Assistant Professor in the Department of Psychology at Washington State University, where she primarily studies the acute and chronic effects of cannabis on cognition, mental health, and physical health. Dr. Cuttler was also an OER Research Fellow with the Center for Open Education and she conducts research on open educational resources. She has over 50 publications including the following two published books:  A Student Guide for SPSS (1st and 2nd edition)  and  Research Methods in Psychology: Student Lab Guide.  Finally, she edited another OER entitled  Essentials of Abnormal Psychology. In her spare time, she likes to travel, hike, bike, run, and watch movies with her husband and son. You can find her online at @carriecuttler or carriecuttler.com.

Dr. Rajiv Jhangiani is the Associate Vice Provost, Open Education at Kwantlen Polytechnic University in British Columbia. He is an internationally known advocate for open education whose research and practice focuses on open educational resources, student-centered pedagogies, and the scholarship of teaching and learning. Rajiv is a co-founder of the Open Pedagogy Notebook, an Ambassador for the Center for Open Science, and serves on the BC Open Education Advisory Committee. He formerly served as an Open Education Advisor and Senior Open Education Research & Advocacy Fellow with BCcampus, an OER Research Fellow with the Open Education Group, a Faculty Workshop Facilitator with the Open Textbook Network, and a Faculty Fellow with the BC Open Textbook Project. A co-author of three open textbooks in Psychology, his most recent book is  Open: The Philosophy and Practices that are Revolutionizing Education and Science (2017). You can find him online at @thatpsychprof or thatpsychprof.com.

Dr. Dana C. Leighton is Assistant Professor of Psychology in the College of Arts, Science, and Education at Texas A&M University—Texarkana. He earned his Ph.D. from the University of Arkansas, and has 15 years experience teaching across the psychology curriculum at community colleges, liberal arts colleges, and research universities. Dr. Leighton’s social psychology research lab studies intergroup relations, and routinely includes undergraduate students as researchers. He is also Chair of the university’s Institutional Review Board. Recently he has been researching and writing about the use of open science research practices by undergraduate researchers to increase diversity, justice, and sustainability in psychological science. He has published on his teaching methods in eBooks from the Society for the Teaching of Psychology, presented his methods at regional and national conferences, and received grants to develop new teaching methods. His teaching interests are in undergraduate research, writing skills, and online student engagement. For more about Dr. Leighton see http://www.danaleighton.net and http://danaleighton.edublogs.org

Contribute to this Page

The newest release in the APA Handbooks in Psychology ® series

750 First Street NE Washington, DC 20002 www.apa.org | [email protected]

Terms of Use | Privacy Statement ©2023 American Psychological Association. All Rights Reserved.

APA Handbook of Research Methods in Psychology

Please select the collection(s) you would like to receive more information on.

A one-time purchase of any collection provides perpetual access to DRM-free titles to best meet the needs of your institution and users.

Table of Contents

Volume 1 — Foundations, Planning, Measures, and Psychometrics

Part I. Philosophical, Ethical, and Societal Underpinnings of Psychological Research (Chapters 1 – 6) Part II. Planning Research (Chapters 7 – 12) Part III. Measurement Methods (Chapters 13 – 32) Part IV. Psychometrics (Chapters 33 – 38)

Volume 2 — Research Designs: Quantitative, Qualitative, Neuropsychological, and Biological

Part I. Qualitative Research Methods (Chapters 1 – 11) Part II. Working Across Epistemologies, Methodologies, and Methods (Chapters 12 – 15) Part III. Sampling Across People and Time (Chapters 16 – 19) Part IV. Building and Testing Methods (Chapters 20 – 26) Part V. Designs Involving Experimental Manipulations (Chapters 27 – 32) Part VI. Quantitative Research Designs Involving Single Participants or Units (Chapters 33 – 34) Part VII. Designs in Neuropsychology and Biological Psychology (Chapters 35 – 38)

Volume 3 — Data Analysis and Research Publication

Part I. Quantitative Data Analysis (Chapters 1 – 24) Part II. Publishing and the Publication Process (Chapters 25 – 27)

This resource serves as an ideal reference for many different courses, including:

Please complete the form and an APA representative will follow up with access options.

By submitting your information, you agree to receive information about American Psychological Association (APA) products and services. You may unsubscribe at any time. Please review the APA Privacy Policy for more information.

With significant new and updated content across dozens of chapters, the second edition of the APA Handbook of Research Methods in Psychology presents the most exhaustive treatment available of the techniques psychologists and others have developed to help them pursue a shared understanding of why humans think, feel, and behave the way they do. Across three volumes, the chapters in this indispensable handbook address broad, crosscutting issues faced by researchers: the philosophical, ethical, and societal underpinnings of psychological research. Newly written chapters cover topics such as:

• Literature searching
• Workflow and reproducibility
• Research funding
• Neuroimaging
• Data analysis methods
• Navigating the publishing process
• Ethics in scholarly authorship
• Research data management and sharing
• Applied Psychology 
• Clinical Psychology
• Cognitive Psychology
• Developmental Psychology
• Education Psychology
• Human Development
• Neuroscience
• Public health

Harris Cooper, 

Duke University

Marc N. Coutanche, 

University of Pittsburgh

Linda M. McMullen, 

University of Saskatchewan (Canada) A.T. Panter, 

University of North Carolina 

at Chapel Hill ISBN: 978-1-4338-4123-1

• Technical Support
• Find My Rep

You are here

Research Methods for Cognitive Neuroscience

• Aaron Newman - Dalhousie University, Canada
• Description

This fresh, new textbook provides a thorough and student-friendly guide to the different techniques used in cognitive neuroscience. Given the breadth of neuroimaging techniques available today, this text is invaluable, serving as an approachable text for students, researchers, and writers. This text provides the right level of detail for those who wish to understand the basics of neuroimaging and also provides more advanced material in order to learn further about particular techniques.  With a conversational, student-friendly writing style, Aaron Newman introduces the key principles of neuroimaging techniques, the relevant theory and the recent changes in the field. 

See what’s new to this edition by selecting the Features tab on this page. Should you need additional information or have questions regarding the HEOA information provided for this title, including what is new to this edition, please email [email protected] . Please include your name, contact information, and the name of the title for which you would like more information. For information on the HEOA, please go to http://ed.gov/policy/highered/leg/hea08/index.html .

For assistance with your order: Please email us at [email protected] or connect with your SAGE representative.

SAGE 2455 Teller Road Thousand Oaks, CA 91320 www.sagepub.com

An excellent and much-needed textbook on research methods for cognitive neuroscience, for the breadth and depth of the techniques, covered. Written in a clear, approachable style, that is easy for even beginning students to digest. This is a book of value that students and professors alike will enjoy reading.

This well-written textbook by Aaron Newman enriches the literature by covering key concepts in research methods for cognitive neuroscience. The book follows a logical progression and covers the main neuroimaging techniques, thus constituting an excellent resource for anyone interested in cognitive neuroscience research and practice. The layout and organisation of each chapter are excellent, there are plenty of visually appealing images throughout and an excellent summary at the end of each chapter.

The book is a fast-track to fundamental knowledge on the general theory of doing research in cognitive neuroscience and a comprehensive introduction to a large panorama of research methods. It gives the reader a strong focus on learning and understanding, and an inspiration to think further into the use of high-tech and basic research instruments. The book is therefore recommended for both the introduction and intermediate teaching into cognitive neuroscience and neuropsychology and in addition as a quick reference work for the single technical methods. A must have for students and teachers in the field!

Aaron Newman's book provides a comprehensive and in-depth, yet easy to read, tour de force across different research methods for Cognitive Neuroscience. This book is not only an indispensable tool for undergraduate students. It is also a valuable source for any neuroscientist, offering an excellent overview of quantitative methodologies in the field.

Overall, this is an outstanding textbook for several reasons.

First, the author has an elegant and yet simple writing. Second, the comprehensive scope of this textbook is simply amazing, such is the complexity of each of the research techniques in focus (i.e., it is extremely difficult to handle all those with expertise). Third, the book structure presents a logic increment in complexity. Aaron Newman integrates seemingly “hard to grasp” computations in a concise style, while providing unique suggestions on experimental design features and data acquisition and analysis. Such methodological concerns tapping the reader’s hands-on-skills are highly meritorious and should appeal to most researchers in the field.

Finally, the textbook layout is impeccable. The “box inlets” at the beginning of each chapter (learning objectives) are quite useful since they help the reader throughout the chapter, eventually pinpointing contents that may merit further study. In addition, the broad summary and “further readings” suggestions at the end of each chapter help to provide awareness of the learning process. A stylish artwork and excellent figures both contribute to top up this edition.

I believe this textbook will soon become an authoritative resource for both graduate students and experienced researchers in the field.

• Introduces different techniques focusing on neurophysiological processes and how these are related to cognition.
• Offers students the "nuts and bolts" of how the technology works with detailed descriptions of the techniques.
• Provides detailed descriptions of the techniques and discusses their application in research.

Preview this book

Sage college publishing.

You can purchase this book and request an instructor sample on our US College site:

Related Products

Want to create or adapt books like this? Learn more about how Pressbooks supports open publishing practices.

1 Lab 1: Research Methods in Cognition: How We Do What We Do

Introduction

Cogniti on , like many areas of psychology and neuroscience , is an empirical discipline. That is, the advances that are made in cognition are largely the result of research. Therefore, in order for you to gain an appreciation for cognitive psychology, you need to understand how research works.

This introductory lab will be a review for many of you. Most of these terms should sound familiar, especially if you have had statistics. We’ll be talking about concepts like independent variables, counterbalancing, data collection and analysis, etc. Please don’t be intimidated by these terms. Research is actually quite simple, but you have to learn to “speak the language.”

Cognitive psychologists employ several kinds of data collection techniques, each with different strengths and weaknesses. We’ll look at many of these techniques, but focus primarily on true experimental designs. These kinds of experiments are most typical of the ones we’ll survey throughout the course.

All of the research methods we will use involve variables. We divide these variables into two categories : dependent variables and independent variables . Dependent variables, which are seen in every kind of research design, are the things that we are interested in measuring. Another way of describing dependent variables is to say they are the data. 1 No matter what kind of research we are doing, we will be measuring something: height, speed, accuracy, confidence, and so on. Every time we collect data from a subject we have measured a dependent variable.

Independent variables are things that the experimenter controls or manipulates. Often, when we are measuring something, we want to compare things. This is when we use an independent variable. Let’s say we have a new drug and think it might improve memory. We could simply give it to people and give them a memory test. But that won’t answer the question we really want answered–we need to make a comparison. So, perhaps we would get two groups of subjects. One of the groups would get the drug, and the other would not. Subjects receiving the drug form the experimental group, while subjects not receiving the drug form a control group. We would give subjects in both groups the same memory test, and see if the group taking the drug did better. In this case, the independent variable would be whether or not they got the drug. We control that, so that makes it an independent variable. The dependent variable would be their performance on the memory test.

We’ll look at several designs used in cognitive psychology. As you’ll notice, all of them use dependent variables. After all, we have to measure something! You’ll also notice, though, that not all of them use independent variables. There are times when we measure things even when we don’t manipulate things.

Introspection

Perhaps the earliest kind of research done in cognition was introspection . Developed by Wundt in the late 1800s, introspection involves “looking inward” and describing what is going on while some process is taking place. For example, say I asked you to imagine the house you lived in when you graduated from high school. Now, tell me if the door handle on the front door is on the left or the right side of the door. After that, I want you to count the number of windows in the first room you enter when you go into that house. If you are like most people, you can do that without too much difficulty.

Introspection takes that one step farther. Instead of just asking you the question, someone using introspection would be asked to report how they got the answer. We don’t really care how many windows were in that room. What we really want to know is how you arrived at your answer.

Thought Question

Try this exercise. How many windows are in the first room of your house? Before answering the question, make it a point to become aware of how you answered it. How easy was it to come up with the answer? How did you do it? Now that you are aware of how you did it, see if you can “count” the windows in the front room of a friend’s house or apartment. Is it easier to be aware of that?

Introspection was widely used around the turn of the century. Those in Wundt’s lab were the primary proponents, but other psychologists (like William James, the founder of American psychology) used it as well. In fact, the historical movement known as “structuralism” largely derived from this approach. Wundt’s followers were trying to identify the basic “structures” of mental activity, such as units of thought and reasoning.

As you probably remember from other psychology courses, introspection–the “study of the internal workings of the mind”–fell out of favor with psychologists after the turn of the century. A number of factors contributed to its demise. First, Wundt became increasingly dictatorial in authenticating introspective experiences. While other investigators tried to employ introspection, Wundt declared himself the final judge on the matter. If others found results that contradicted Wundt’s findings, Wundt might well dismiss their data as unreliable. Only Wundt’s immediate followers, operating under his close supervision, collected “reliable” introspective data (according to Wundt, that is).

In addition to this, it became clear that not all mental experiences could be studied using introspection. For example, try to decide if the following sentence is true or false: “A beagle is a dog.” Hopefully, you said that sentence was true. Now, introspect: how  did you answer that question? If you are like most people, your answer would be something like this: “I don’t know how I knew it. I just knew it .” There will be quite a few times throughout the semester that introspection gives us the wrong answer. What we think  we do isn’t always what we really do.

Finally, the rise of behaviorism put the final nail in the coffin of introspection. Behaviorists contended that the only thing appropriate for study was overt behavior. Trying to infer what was going on in the mind was considered fruitless, since activities taking place in the “black box” could never be empirically verified. As the power of Watson and Skinner rose, introspection was largely abandoned.

Try this demonstration. Assume I give you a series of numbers to remember, like this:

Now, I am going to ask you if a certain number was in the set I asked you to remember. All I want you to do is tell me if the number I give you was in that original set. Do you have the set in mind? (it was 5-2-8-1-3, in case you forgot). Here’s the number: 2

Introspect for a minute. Once you found the item you were looking for (“2” was in the set I gave you to remember) did you keep looking at the rest of the numbers? In other words, did you quit the search once you found the “2” in the original set, or did you finish looking at the rest of the set, even after you found what you were looking for? The answer may surprise you, and we’ll come back to that in Lab 5.

Strengths and Weaknesses of the Introspective Approach

Introspection is a valuable technique for several reasons. First of all, good introspection can lead to powerful insights. For example, James, through introspection, arrived at the conclusion that there were two memory stores, what we now call short- and long-term memory. Second, it is a very efficient technique. All you need to conduct introspection is a place where you can concentrate. Finally, introspection allows the processes underlying complex cognitive activity to be broken down. Recently, Ericsson and Simon (Ericsson & Simon, 1980) adapted the introspective technique for use in problem solving activities. They use what they call “think-aloud protocols.” They asked their subjects to think out loud as they were solving a given task, such as trouble-shooting an electrical circuit. Ericsson and Simon found that they could often discover how the problem solvers worked by analyzing these protocols.

You can demonstrate this think-aloud protocol for yourself. Try to name as many states as you can, and while you are doing it, try to say everything that comes into your mind. A few states, like Texas, may just “pop into your mind.” Before long, though, you’ll likely find yourself using some kinds of strategies to help. What kinds of strategies did you use? Did you find some more successful than others?

As we have seen, not all cognitive tasks can be assessed using introspection. A number of these tasks could be considered “automatic.” Automatic tasks are defined as tasks that occur without awareness on the part of the subject, require no cognitive resources, and occur without intention. You cannot “turn them off.” A good example of an automatic process is word recognition in skilled readers. Try to look at this word, and see only the letters of this word:

You almost certainly could not do it. You can’t help but read the word.

By definition, automatic processes are those for which we cannot be introspectively aware. If I were to ask you to introspect on how you read the word “happy,” you could not do it. We’ll examine automatic processing in Lab 2, and again in Lab 3, which deals with the Stroop effect.

The behaviorists are right at some level–there is no way for a researcher to know if subjects are actually thinking in the way they claim they are. For example, one of the previous questions asked you to determine how many windows were in your house. You might report that you did this by mentally imagining your house, and then counting the windows in your image. Is this what you really did? Though it seems likely, there’s no way we can be certain. 2

Case Studies

Another technique used in research utilizes individual subjects who are exceptional in some way. Analyses of these subjects are called case studies . Often by looking at exceptional individuals, we can understand how “regular” individuals work.

You are certainly familiar with case studies. Sigmund Freud developed much of his theoretical work from a relatively small number of detailed case studies. In cognitive psychology, we have gained a great deal of insight into memory function by looking at exceptional individuals. Perhaps the most famous individual in all of cognitive psychology is a man known only by his initials: “H. M.” H. M. was diagnosed in the early 1950s as suffering from a very severe form of epilepsy. As a last resort, he was treated by destroying those parts of his brain that triggered the seizures (in H. M.’s case, the hippocampus and the amygdala). When H. M. recovered from the surgery, his epilepsy was almost completely eradicated. Unfortunately, the surgery had a very severe complication: it left H. M. unable to form any new long-term memories. Every time H. M. encounters a former acquaintance, it seems to him to be their first meeting. His memory for events prior to the surgery is intact, and his short-term memory is also fine. However, he cannot form new long-term memories. Every time he is distracted, and the contents of his short-term memory disrupted, he forgets what he was just talking about. He can work the same crossword puzzle time and time again, with no recollection of having seen it before. In short, H. M. is perhaps the strongest evidence psychologists have for the distinction between short- and long-term memory, and we’ll study this in Lab 7. Hilts (Hilts, 1995) provides a fascinating biography of H. M. , and discusses the challenges brought on him his profound and irreversible amnesia.

Strengths and Weaknesses of the Case Study Approach

As you will see, psychologists often find out a great deal about how normal cognition takes place by observing abnormal cases. H. M. is a great example. We learn how memory functions normally by finding individuals in which the normal function of memory has been disrupted. Because H. M.’s short-term memory works in the absence of a normally-functioning long-term memory, we have to assume that the two are separate entities.

Case studies allow us to observe things that we could not ethically create. It would be impossible, for example, to take a human being and perform a lobotomy like the one H. M. received, just to observe changes in memory.

However, the use of case studies has some considerable drawbacks. One of the most serious involves a bias in the selection of subjects. Freud’s theories of personality were derived in part from his experience with his patients. He utilized case studies extensively (you’ll remember Anna O., for example). The individuals that Freud saw in his practice, though, were hardly “typical.” They were for the most part well-educated, wealthy, female, sexually-repressed Victorians. While Freud gained some real insights into their personality structure, his analyses were not applicable to all people.

Another serious drawback in using case studies is the lack of a control group for comparison. It’s very tempting to conclude that H. M.’s memory impairment was the result of his temporal lobe damage. We really can’t say that, though, at least not with absolute certainty. H. M. was also an epileptic, which introduces the possibility that his memory impairment could’ve been caused by twenty years of seizures. It might also have resulted from the anesthesia given prior to his operation, or a mistake by the doctor during surgery. Any of a number of other factors might come into play. We’ll come back to the topic of control groups later in the chapter.

Observation

Another powerful research tool involves watching organisms (humans and non-humans) behave in their natural environment, a technique called observation . Sometimes when we try to study something scientifically, we end up controlling things too vigorously, such that we influence the behavior in ways we did not intend by creating an unnatural environment. If we want to see how monkeys behave in groups, for example, a good way to do that would be to silently observe them in the jungle. If we want to judge how racially prejudiced people are, we could observe how likely they are to take a seat in a crowded bus next to a non-Anglo.

You are probably familiar with the work of Jane Goodall. Goodall is an anthropologist who studies the behavior of chimps in the wild. Her painstaking work requires that she spend months, even years, in the wild with the chimps. She does her best to remain unobtrusive, and eventually the chimps act as if she wasn’t even there. She has used observational techniques to study aggressive behavior, sexual behavior, parenting, etc.

Strengths and Weaknesses of the Observational Approach

As the work of Goodall demonstrates, much can be gained using the observational technique. Because our subjects do not know they are being observed, they are much more likely to behave “normally.” We can gain insights into real-world behavior that we otherwise could not.

Despite these real advantages, observation has shortcomings as well. First of all, though we often provide a very good description of naturalistic behavior, we cannot provide an explanation of it. We may know that in a kindergarten classroom, Billy always wins the fight over the Legos. We might even be able to go into considerable detail in our description. But we won’t know why  he always wins. He might have won because he’s the largest, or because he’s the most aggressive. He might have won because nobody else likes Legos. He might have won because he’s male. We just don’t know, based solely on observation. Because we can’t control certain factors, we can’t draw conclusions on what caused the behavior.

Correlational Techniques

Sometimes researchers are interested in looking for relationships between variables. Let’s say we give you a speeded test, like the SAT. We can measure several things when we give you that test. First, we can measure your accuracy. What proportion of the questions did you answer correctly? We can also measure your speed on the test: how many questions did you get through? From taking these kinds of tests, you might suspect that there is a relationship between speed and accuracy. Perhaps you hypothesize that as subjects work more quickly, their accuracy on the test goes down. 3

The way to look at this relationship is to use a correlation. A correlation is a way of seeing how things relate to one another numerically. These correlations are often displayed using what is called a scatter plot. On a scatter plot, each dot represents an observation. Let’s look at a hypothetical scatter plot for the experiment we described above, looking at the relationship between speed and accuracy on the SAT. The scatter plot is displayed in Figure 1.1

Figure 1.1 Hypothetical scatter plot between percent correct and rate of question answering.

Each dot on the graph represents the performance of one person. Each person has a score on two variables: the percent correct on the test (the measure of accuracy) and the number of questions they answered per hour (the measure of speed). The point on the graph identified by the arrow is a person who got 60% correct on the test (you can tell that by reading straight down from the point to the x-axis) while answering 78 questions per hour (you can tell that by reading straight across from the point to the y-axis). As you can clearly see from the graph, there is a strong negative relationship between the two variables. As one increases, the other decreases. This would be an example of a negative correlation.

Let’s take another example, the relationship between number of cigarettes smoked in a day and the likelihood of developing lung cancer. (Again, I have made these numbers up.) A scatter plot might look something like Figure 1.2. This relationship provides an example of a positive correlation: as one variable goes up, so does the other.

Figure 1.2 Hypothetical scatter plot between number of cigarettes smoked and cancer rates.

Strengths and Weaknesses of the Correlational Approach

Correlations are designed to show relationships between variables. They do this very well. Many researchers use correlations to see if there are relationships between diet and health, exercise and weight, and so on. Correlational research is often fairly cheap, and provides a good estimate of the strength of the relationship of interest.

It is tempting in this case to take the correlation between smoking and cancer as evidence that smoking causes  cancer. This is where correlations fall short, though. Correlation cannot show causation . Just because two things are correlated does not mean one is causing the other. It certainly seems likely that smoking causes cancer, and we know from other data that smoking does cause cancer. But from studies like these, using only correlational data, we cannot infer causation.

Another example might make this even clearer. As you are probably aware, there is a modest correlation between SAT scores and freshman GPAs. Which is causing which? As you likely surmised, neither is causing the other. Probably, both are being caused by a third variable, such as level of education or intelligence. Just knowing that two things are correlated does not mean we can tell which is causing the other. 4

Experimental Designs

In case you haven’t noticed, each of the designs described above lack independent variables. In each case we are measuring things, so we have dependent variables. But none of the designs described above involve experimental manipulation. As a result, we cannot determine cause and effect. True experiments, though, do allow us to decide which variable is causing the other.

Experiments rely heavily on control . We want some things to vary between groups (these are our independent variables). But we want everything else to be as consistent as possible. Say we are looking at the effects of a new drug on aggression. We’ll treat the drug as an independent variable (one group gets the drug, the other does not). Especially since we are looking at aggression, we would want to attempt to place an equal number of males and females in each treatment group. Otherwise, we might end up with 80% males in one group and 20% males in the other. If we found differences between the groups, we wouldn’t know if they were due to our drug treatment or to the differences in gender.

Experiments can be performed in several ways. Again, take the example of our drug and aggression. We’ll test for aggression by putting subjects in a room with a coke machine that eats quarters. We’ll tell them that they are to wait here for the experimenter to return, give them $1.25 for the coke machine, and tell them to help themselves to a drink while they wait. Of course, we’ve rigged the machine up so that it will take their money but give them nothing in return. We’ll count the number of times they hit the machine, and use that as a test of aggression. 5

If we have many subjects (let’s say for the sake of argument that we have 200), we could assign half to one of our treatment conditions (the drug condition) and the other half to the other condition (the no-drug condition). One hundred subjects in both conditions is enough for us to split them like this. Assigning subjects to experimental conditions like this is an example of a between-subjects design . All of my treatment effects are between subjects. A given subject is either in one condition or the other–not both.

The experiment could be performed another way. We could take all of the subjects and put them in both conditions, one after another. That is, they could take the drug once, we could measure their aggression, and then we could ask them to return the next day (to let the drug wear off). The next day when they return, we will test them under the no-drug conditions. When subjects participate in all the conditions in an experiment, this is called a within-subjects design . In this case, we compare the subject to himself instead of to the other subjects. Within-subjects designs are very useful when the number of subjects is small. As a result, we’ll be using within-subjects procedures whenever possible this semester.

Thought Question. What kinds of advantages and disadvantages do you think between- and within-subjects designs have? When would you choose one, and when would you choose the other?

The within-subjects experiment we just described has some serious problems. Most seriously, we had all of our subjects first tested under the drug condition, and then in the no-drug condition. Many things might be causing differences besides our drug. For example, the second time subjects are put in the room with the Coke machine, they may be reluctant to even put their money in. Or, they may get even more frustrated the second time because they’ve now lost money twice. Or, they may get less angry the second time because they expected the machine to be broken. Perhaps they are growing suspicious of our little deception, and are now behaving in ways they wouldn’t normally behave. There might be dozens of reasons to expect differences, in addition to the drug. Variables that aren’t controlled for are often called nuisance variables.

These problems can be dealt with, though. For our purposes, one of the easiest ways to control them is to use what is called counterbalancing . Counterbalancing involves switching the order of presentation from one subject to the next in order to eliminate problems of repeated testing. In the example above, we could counterbalance by having half the subjects participate in the drug condition first, and the other half in the no-drug condition first. The next day, they would switch. Any effects of order would cancel each other out, hence the name “counterbalance.”

Counterbalancing is critically important when using repeated measures (another name for within-subject) designs. Several things can often happen with repeated testing. In many instances, subjects tend to get better at whatever task they are doing. These are called practice effects . Several of the experiments we’ll do this semester are difficult. You’ll find them to be much easier with a little practice. Let’s say we are having you memorize 4 lists (A, B, C, & D) of 15 words, as they are being presented on the screen. The first time, you find that they go by too quickly, and you might do poorly. As you get better prepared, you do better on the second list, and so on. Performance is always best on the 4th list. But is this due to the practice or something else? So, in order to rule out practice effects, we’ll have to make sure that some subjects get list A first, some get list B first, etc. That way, if we find performance is best for list D, we know it can’t be due to practice effects: some subjects had list D first, some had it second, some third, and some fourth.

There is another reason to counterbalance: fatigue. Though our experiments are all fairly short, some require serious concentration, and you might find yourself fatiguing near the end. This might make performance worse on the last parts of the experiment. If we make sure that not everybody does the same thing first or last–that is, if we carefully counterbalance–we can overcome problems of practice or fatigue.

With a few important exceptions, we’ll be using two main classes of dependent variables this semester: accuracy and speed. We often want to know how accurate you were on a given test, so we’ll measure things like number of words recalled, proportion of items recognized, and proportion of correct decisions. All of these are measures of accuracy.

There will be some instances, however, when accuracy is not an informative dependent variable to measure. For example, in Lab 8 we’ll be asking subjects to look at a string of letters and determine if those letters make up a word. For example, GRASS is a word, and you would respond positively. GRUSS  is not a word, and you would respond negatively. In cases like this, your accuracy will be virtually perfect. So, instead of measuring your accuracy, we’ll measure your reaction time.

It is vitally important that you understand the concepts of independent and dependent variables, operational definitions, control groups, and counterbalancing. You must also be aware of the differences between within-subjects and between-subjects designs. We’re going to use these terms in every lab we perform. If you still feel uncomfortable about these terms, ask the lab instructor.

Questions for Lab 1

For questions 1-3, answer:

a. what kind of research design is being used? (i. e., case study, introspection, etc.)

b. what is the independent variable? (if any)

c. what is the dependent variable? (if any)

d. what is the experimenter trying to measure?

e. what was the operational definition used by the experimenter?

f. what are the strengths and weaknesses of the design that is being used ?

g. what are the strengths and weaknesses of the operational definition ?

1. A psychologist is interested in looking at the relationship between type of instruction and learning to solve algebra word problems. She knows one junior high school teaches students to solve using Method A. She knows another junior high school uses Method B. At the end of the term she gives both groups of students the same exam, and compares their performance.

2. A psychologist is concerned that children who drink caffeine at lunch have more attention problems in school during the afternoon. To study this, she watches students at lunch, and notes who has a caffeinated drink and who does not. After lunch, she sits in the back of the classroom and records how many times each child gets up from his or her seat.

3. In order to get an estimate of how race influences people’s reaction, two psychologists set up a scenario in a mall. They pick a narrow hallway in the mall, and stage a conversation between two people. The hallway is narrow enough that if someone walking past them wants to get by, that person will either have to squeeze behind them, or walk between them, interrupting the conversation. They believe that people will be more likely to interrupt if one of the pair is black. They have several pairs of people. In some pairs, both are white. In other pairs, both are black. In the remainder, one is white and the other black. They count how many times passers-by walk through and not around . 6

4. A researcher wants to study how sleep influences college students’ test performance. They randomly assign individuals to sleep either 3, 6, or 9 hours per night for one week. At the end of the week, all subjects are given a vocabulary test from their introductory psychology class, and the researcher compares the results.

5 . Come up with three operational definitions (each) for

a. attraction

c. happiness

d. compliance

Laboratory in Cognition Student Manual Copyright © by Charles Weaver, III. All Rights Reserved.

Share This Book

• Bipolar Disorder
• Therapy Center
• When To See a Therapist
• Types of Therapy
• Best Online Therapy
• Best Couples Therapy
• Best Family Therapy
• Managing Stress
• Sleep and Dreaming
• Understanding Emotions
• Self-Improvement
• Healthy Relationships
• Student Resources
• Personality Types
• Guided Meditations
• Verywell Mind Insights
• 2024 Verywell Mind 25
• Mental Health in the Classroom
• Editorial Process
• Meet Our Review Board
• Crisis Support

What Is Cognitive Psychology?

The Science of How We Think

Kendra Cherry, MS, is a psychosocial rehabilitation specialist, psychology educator, and author of the "Everything Psychology Book."

Steven Gans, MD is board-certified in psychiatry and is an active supervisor, teacher, and mentor at Massachusetts General Hospital.

Topics in Cognitive Psychology

• Current Research
• Cognitive Approach in Practice

Careers in Cognitive Psychology

How cognitive psychology differs from other branches of psychology, frequently asked questions.

Cognitive psychology involves the study of internal mental processes—all of the workings inside your brain, including perception, thinking, memory, attention, language, problem-solving, and learning.

Cognitive psychology--the study of how people think and process information--helps researchers understand the human brain. It also allows psychologists to help people deal with psychological difficulties.

This article discusses what cognitive psychology is, the history of this field, and current directions for research. It also covers some of the practical applications for cognitive psychology research and related career options you might consider.

Findings from cognitive psychology help us understand how people think, including how they acquire and store memories. By knowing more about how these processes work, psychologists can develop new ways of helping people with cognitive problems.

Cognitive psychologists explore a wide variety of topics related to thinking processes. Some of these include: 

• Attention --our ability to process information in the environment while tuning out irrelevant details
• Choice-based behavior --actions driven by a choice among other possibilities
• Decision-making
• Information processing
• Language acquisition --how we learn to read, write, and express ourselves
• Problem-solving
• Speech perception -how we process what others are saying
• Visual perception --how we see the physical world around us

History of Cognitive Psychology

Although it is a relatively young branch of psychology , it has quickly grown to become one of the most popular subfields. Cognitive psychology grew into prominence between the 1950s and 1970s.

Prior to this time, behaviorism was the dominant perspective in psychology. This theory holds that we learn all our behaviors from interacting with our environment. It focuses strictly on observable behavior, not thought and emotion. Then, researchers became more interested in the internal processes that affect behavior instead of just the behavior itself. 

This shift is often referred to as the cognitive revolution in psychology. During this time, a great deal of research on topics including memory, attention, and language acquisition began to emerge. 

In 1967, the psychologist Ulric Neisser introduced the term cognitive psychology, which he defined as the study of the processes behind the perception, transformation, storage, and recovery of information.

Cognitive psychology became more prominent after the 1950s as a result of the cognitive revolution.

Current Research in Cognitive Psychology

The field of cognitive psychology is both broad and diverse. It touches on many aspects of daily life. There are numerous practical applications for this research, such as providing help coping with memory disorders, making better decisions , recovering from brain injury, treating learning disorders, and structuring educational curricula to enhance learning.

Current research on cognitive psychology helps play a role in how professionals approach the treatment of mental illness, traumatic brain injury, and degenerative brain diseases.

Thanks to the work of cognitive psychologists, we can better pinpoint ways to measure human intellectual abilities, develop new strategies to combat memory problems, and decode the workings of the human brain—all of which ultimately have a powerful impact on how we treat cognitive disorders.

The field of cognitive psychology is a rapidly growing area that continues to add to our understanding of the many influences that mental processes have on our health and daily lives.

From understanding how cognitive processes change as a child develops to looking at how the brain transforms sensory inputs into perceptions, cognitive psychology has helped us gain a deeper and richer understanding of the many mental events that contribute to our daily existence and overall well-being.

The Cognitive Approach in Practice

In addition to adding to our understanding of how the human mind works, the field of cognitive psychology has also had an impact on approaches to mental health. Before the 1970s, many mental health treatments were focused more on psychoanalytic , behavioral , and humanistic approaches.

The so-called "cognitive revolution" put a greater emphasis on understanding the way people process information and how thinking patterns might contribute to psychological distress. Thanks to research in this area, new approaches to treatment were developed to help treat depression, anxiety, phobias, and other psychological disorders .

Cognitive behavioral therapy and rational emotive behavior therapy are two methods in which clients and therapists focus on the underlying cognitions, or thoughts, that contribute to psychological distress.

What Is Cognitive Behavioral Therapy?

Cognitive behavioral therapy (CBT) is an approach that helps clients identify irrational beliefs and other cognitive distortions that are in conflict with reality and then aid them in replacing such thoughts with more realistic, healthy beliefs.

If you are experiencing symptoms of a psychological disorder that would benefit from the use of cognitive approaches, you might see a psychologist who has specific training in these cognitive treatment methods.

These professionals frequently go by titles other than cognitive psychologists, such as psychiatrists, clinical psychologists , or counseling psychologists , but many of the strategies they use are rooted in the cognitive tradition.

Many cognitive psychologists specialize in research with universities or government agencies. Others take a clinical focus and work directly with people who are experiencing challenges related to mental processes. They work in hospitals, mental health clinics, and private practices.

Research psychologists in this area often concentrate on a particular topic, such as memory. Others work directly on health concerns related to cognition, such as degenerative brain disorders and brain injuries.

Treatments rooted in cognitive research focus on helping people replace negative thought patterns with more positive, realistic ones. With the help of cognitive psychologists, people are often able to find ways to cope and even overcome such difficulties.

Reasons to Consult a Cognitive Psychologist

• Alzheimer's disease, dementia, or memory loss
• Brain trauma treatment
• Cognitive therapy for a mental health condition
• Interventions for learning disabilities
• Perceptual or sensory issues
• Therapy for a speech or language disorder

Whereas behavioral and some other realms of psychology focus on actions--which are external and observable--cognitive psychology is instead concerned with the thought processes behind the behavior. Cognitive psychologists see the mind as if it were a computer, taking in and processing information, and seek to understand the various factors involved.

A Word From Verywell

Cognitive psychology plays an important role in understanding the processes of memory, attention, and learning. It can also provide insights into cognitive conditions that may affect how people function.

Being diagnosed with a brain or cognitive health problem can be daunting, but it is important to remember that you are not alone. Together with a healthcare provider, you can come up with an effective treatment plan to help address brain health and cognitive problems.

Your treatment may involve consulting with a cognitive psychologist who has a background in the specific area of concern that you are facing, or you may be referred to another mental health professional that has training and experience with your particular condition.

Ulric Neisser is considered the founder of cognitive psychology. He was the first to introduce the term and to define the field of cognitive psychology. His primary interests were in the areas of perception and memory, but he suggested that all aspects of human thought and behavior were relevant to the study of cognition.

A cognitive map refers to a mental representation of an environment. Such maps can be formed through observation as well as through trial and error. These cognitive maps allow people to orient themselves in their environment.

While they share some similarities, there are some important differences between cognitive neuroscience and cognitive psychology. While cognitive psychology focuses on thinking processes, cognitive neuroscience is focused on finding connections between thinking and specific brain activity. Cognitive neuroscience also looks at the underlying biology that influences how information is processed.

Cognitive psychology is a form of experimental psychology. Cognitive psychologists use experimental methods to study the internal mental processes that play a role in behavior.

Sternberg RJ, Sternberg K. Cognitive Psychology . Wadsworth/Cengage Learning. 

Krapfl JE. Behaviorism and society . Behav Anal. 2016;39(1):123-9. doi:10.1007/s40614-016-0063-8

Cutting JE. Ulric Neisser (1928-2012) . Am Psychol . 2012;67(6):492. doi:10.1037/a0029351

Ruggiero GM, Spada MM, Caselli G, Sassaroli S. A historical and theoretical review of cognitive behavioral therapies: from structural self-knowledge to functional processes .  J Ration Emot Cogn Behav Ther . 2018;36(4):378-403. doi:10.1007/s10942-018-0292-8

Parvin P. Ulric Neisser, cognitive psychology pioneer, dies . Emory News Center.

APA Dictionary of Psychology. Cognitive map . American Psychological Association.

Forstmann BU, Wagenmakers EJ, Eichele T, Brown S, Serences JT. Reciprocal relations between cognitive neuroscience and formal cognitive models: opposites attract? . Trends Cogn Sci . 2011;15(6):272-279. doi:10.1016/j.tics.2011.04.002

By Kendra Cherry, MSEd Kendra Cherry, MS, is a psychosocial rehabilitation specialist, psychology educator, and author of the "Everything Psychology Book."

Psychology: 85-310: Research Methods in Cognitive Psychology: Start

• Finding Research Articles
• Citation Management with Zotero

Helpful Databases

• PsycINFO This link opens in a new window 1887-present. American Psychological Association's renowned resource for abstracts of scholarly journal articles, book chapters, books, and dissertations, it is the largest resource devoted to peer-reviewed literature in behavioral science and mental health. Database Guide . Also see definitions of methodologies .
• PsycARTICLES This link opens in a new window 1894-present.The full text of nearly 80 journals from the American Psychological Association as well as its imprint, the Educational Publishing Foundation (EPF), and from allied organizations including the Canadian Psychological Association and the Hogrefe Publishing Group. It includes all journal articles, book reviews, letters to the editor and errata from each journal.
• PsycCRITIQUES This link opens in a new window 1956-2017. Produced by the American Psychological Association, full text book reviews featuring current scholarly and professional books in psychology. Also publishes reviews from a psychological perspective of popular films and trade books.
• PubMed This link opens in a new window Biomedical literature from MEDLINE, life science journals, and online books. Citations may include links to full-text content from PubMed Central and publisher web sites.
• Google Scholar This link opens in a new window "Google Scholar provides a simple way to broadly search for scholarly literature. From one place, you can search across many disciplines and sources: articles, theses, books, abstracts and court opinions, from academic publishers, professional societies, online repositories, universities and other web sites." - About Google Scholar
• Web of Science This link opens in a new window A multidisciplinary database, with searchable author abstracts, covering the literature of the sciences, social sciences and the arts & humanities providing indexes and links to cited references for each article.

Data Services & Research Curation Office Hours

Consultations are offered in-person and over Zoom and might include but are not limited to the following:

• Connecting your data analysis problems with an external consultant, or finding datasets to work on.
• Finding, creating, and working with data, including data management, data mining & data modeling, and statistical analysis.
• Learning about the availability of tools and platforms on campus, such as ArcGIS (GIS data), Tableau (data visualization), Open Science Framework, and others. Showing you how to work with experimental digital methods.
• Connecting you to resources for self-teaching or the local networks of Digital Humanities and Digital Scholarship practitioners at CMU Helping you brainstorm, scope, and begin planning a project.
• Evaluating and offering advice on the display of visual content, such as presentations, poster designs, and web design.
• Providing feedback on your dataset, data management plan, project design, and code.

Schedule a consultation 

Useful Resource for Accessing Articles

The LibKey Nomad browser extension provides one-click access to the Libraries' full text resources as you find research on the web and in databases. Find information on how to install here . 

• Next: Finding Research Articles >>
• Last Updated: May 28, 2024 3:03 PM
• URL: https://guides.library.cmu.edu/85-310

Research Methods In Psychology

Saul Mcleod, PhD

Editor-in-Chief for Simply Psychology

BSc (Hons) Psychology, MRes, PhD, University of Manchester

Saul Mcleod, PhD., is a qualified psychology teacher with over 18 years of experience in further and higher education. He has been published in peer-reviewed journals, including the Journal of Clinical Psychology.

Learn about our Editorial Process

Olivia Guy-Evans, MSc

Associate Editor for Simply Psychology

BSc (Hons) Psychology, MSc Psychology of Education

Olivia Guy-Evans is a writer and associate editor for Simply Psychology. She has previously worked in healthcare and educational sectors.

Research methods in psychology are systematic procedures used to observe, describe, predict, and explain behavior and mental processes. They include experiments, surveys, case studies, and naturalistic observations, ensuring data collection is objective and reliable to understand and explain psychological phenomena.

Hypotheses are statements about the prediction of the results, that can be verified or disproved by some investigation.

There are four types of hypotheses :

• Null Hypotheses (H0 ) – these predict that no difference will be found in the results between the conditions. Typically these are written ‘There will be no difference…’
• Alternative Hypotheses (Ha or H1) – these predict that there will be a significant difference in the results between the two conditions. This is also known as the experimental hypothesis.
• One-tailed (directional) hypotheses – these state the specific direction the researcher expects the results to move in, e.g. higher, lower, more, less. In a correlation study, the predicted direction of the correlation can be either positive or negative.
• Two-tailed (non-directional) hypotheses – these state that a difference will be found between the conditions of the independent variable but does not state the direction of a difference or relationship. Typically these are always written ‘There will be a difference ….’

All research has an alternative hypothesis (either a one-tailed or two-tailed) and a corresponding null hypothesis.

Once the research is conducted and results are found, psychologists must accept one hypothesis and reject the other. 

So, if a difference is found, the Psychologist would accept the alternative hypothesis and reject the null.  The opposite applies if no difference is found.

Sampling techniques

Sampling is the process of selecting a representative group from the population under study.

A sample is the participants you select from a target population (the group you are interested in) to make generalizations about.

Representative means the extent to which a sample mirrors a researcher’s target population and reflects its characteristics.

Generalisability means the extent to which their findings can be applied to the larger population of which their sample was a part.

• Volunteer sample : where participants pick themselves through newspaper adverts, noticeboards or online.
• Opportunity sampling : also known as convenience sampling , uses people who are available at the time the study is carried out and willing to take part. It is based on convenience.
• Random sampling : when every person in the target population has an equal chance of being selected. An example of random sampling would be picking names out of a hat.
• Systematic sampling : when a system is used to select participants. Picking every Nth person from all possible participants. N = the number of people in the research population / the number of people needed for the sample.
• Stratified sampling : when you identify the subgroups and select participants in proportion to their occurrences.
• Snowball sampling : when researchers find a few participants, and then ask them to find participants themselves and so on.
• Quota sampling : when researchers will be told to ensure the sample fits certain quotas, for example they might be told to find 90 participants, with 30 of them being unemployed.

Experiments always have an independent and dependent variable .

• The independent variable is the one the experimenter manipulates (the thing that changes between the conditions the participants are placed into). It is assumed to have a direct effect on the dependent variable.
• The dependent variable is the thing being measured, or the results of the experiment.

Operationalization of variables means making them measurable/quantifiable. We must use operationalization to ensure that variables are in a form that can be easily tested.

For instance, we can’t really measure ‘happiness’, but we can measure how many times a person smiles within a two-hour period. 

By operationalizing variables, we make it easy for someone else to replicate our research. Remember, this is important because we can check if our findings are reliable.

Extraneous variables are all variables which are not independent variable but could affect the results of the experiment.

It can be a natural characteristic of the participant, such as intelligence levels, gender, or age for example, or it could be a situational feature of the environment such as lighting or noise.

Demand characteristics are a type of extraneous variable that occurs if the participants work out the aims of the research study, they may begin to behave in a certain way.

For example, in Milgram’s research , critics argued that participants worked out that the shocks were not real and they administered them as they thought this was what was required of them. 

Extraneous variables must be controlled so that they do not affect (confound) the results.

Randomly allocating participants to their conditions or using a matched pairs experimental design can help to reduce participant variables. 

Situational variables are controlled by using standardized procedures, ensuring every participant in a given condition is treated in the same way

Experimental Design

Experimental design refers to how participants are allocated to each condition of the independent variable, such as a control or experimental group.

• Independent design ( between-groups design ): each participant is selected for only one group. With the independent design, the most common way of deciding which participants go into which group is by means of randomization. 
• Matched participants design : each participant is selected for only one group, but the participants in the two groups are matched for some relevant factor or factors (e.g. ability; sex; age).
• Repeated measures design ( within groups) : each participant appears in both groups, so that there are exactly the same participants in each group.
• The main problem with the repeated measures design is that there may well be order effects. Their experiences during the experiment may change the participants in various ways.
• They may perform better when they appear in the second group because they have gained useful information about the experiment or about the task. On the other hand, they may perform less well on the second occasion because of tiredness or boredom.
• Counterbalancing is the best way of preventing order effects from disrupting the findings of an experiment, and involves ensuring that each condition is equally likely to be used first and second by the participants.

If we wish to compare two groups with respect to a given independent variable, it is essential to make sure that the two groups do not differ in any other important way. 

Experimental Methods

All experimental methods involve an iv (independent variable) and dv (dependent variable)..

• Field experiments are conducted in the everyday (natural) environment of the participants. The experimenter still manipulates the IV, but in a real-life setting. It may be possible to control extraneous variables, though such control is more difficult than in a lab experiment.
• Natural experiments are when a naturally occurring IV is investigated that isn’t deliberately manipulated, it exists anyway. Participants are not randomly allocated, and the natural event may only occur rarely.

Case studies are in-depth investigations of a person, group, event, or community. It uses information from a range of sources, such as from the person concerned and also from their family and friends.

Many techniques may be used such as interviews, psychological tests, observations and experiments. Case studies are generally longitudinal: in other words, they follow the individual or group over an extended period of time. 

Case studies are widely used in psychology and among the best-known ones carried out were by Sigmund Freud . He conducted very detailed investigations into the private lives of his patients in an attempt to both understand and help them overcome their illnesses.

Case studies provide rich qualitative data and have high levels of ecological validity. However, it is difficult to generalize from individual cases as each one has unique characteristics.

Correlational Studies

Correlation means association; it is a measure of the extent to which two variables are related. One of the variables can be regarded as the predictor variable with the other one as the outcome variable.

Correlational studies typically involve obtaining two different measures from a group of participants, and then assessing the degree of association between the measures. 

The predictor variable can be seen as occurring before the outcome variable in some sense. It is called the predictor variable, because it forms the basis for predicting the value of the outcome variable.

Relationships between variables can be displayed on a graph or as a numerical score called a correlation coefficient.

• If an increase in one variable tends to be associated with an increase in the other, then this is known as a positive correlation .
• If an increase in one variable tends to be associated with a decrease in the other, then this is known as a negative correlation .
• A zero correlation occurs when there is no relationship between variables.

After looking at the scattergraph, if we want to be sure that a significant relationship does exist between the two variables, a statistical test of correlation can be conducted, such as Spearman’s rho.

The test will give us a score, called a correlation coefficient . This is a value between 0 and 1, and the closer to 1 the score is, the stronger the relationship between the variables. This value can be both positive e.g. 0.63, or negative -0.63.

A correlation between variables, however, does not automatically mean that the change in one variable is the cause of the change in the values of the other variable. A correlation only shows if there is a relationship between variables.

Correlation does not always prove causation, as a third variable may be involved. 

Interview Methods

Interviews are commonly divided into two types: structured and unstructured.

A fixed, predetermined set of questions is put to every participant in the same order and in the same way. 

Responses are recorded on a questionnaire, and the researcher presets the order and wording of questions, and sometimes the range of alternative answers.

The interviewer stays within their role and maintains social distance from the interviewee.

There are no set questions, and the participant can raise whatever topics he/she feels are relevant and ask them in their own way. Questions are posed about participants’ answers to the subject

Unstructured interviews are most useful in qualitative research to analyze attitudes and values.

Though they rarely provide a valid basis for generalization, their main advantage is that they enable the researcher to probe social actors’ subjective point of view. 

Questionnaire Method

Questionnaires can be thought of as a kind of written interview. They can be carried out face to face, by telephone, or post.

The choice of questions is important because of the need to avoid bias or ambiguity in the questions, ‘leading’ the respondent or causing offense.

• Open questions are designed to encourage a full, meaningful answer using the subject’s own knowledge and feelings. They provide insights into feelings, opinions, and understanding. Example: “How do you feel about that situation?”
• Closed questions can be answered with a simple “yes” or “no” or specific information, limiting the depth of response. They are useful for gathering specific facts or confirming details. Example: “Do you feel anxious in crowds?”

Its other practical advantages are that it is cheaper than face-to-face interviews and can be used to contact many respondents scattered over a wide area relatively quickly.

Observations

There are different types of observation methods :

• Covert observation is where the researcher doesn’t tell the participants they are being observed until after the study is complete. There could be ethical problems or deception and consent with this particular observation method.
• Overt observation is where a researcher tells the participants they are being observed and what they are being observed for.
• Controlled : behavior is observed under controlled laboratory conditions (e.g., Bandura’s Bobo doll study).
• Natural : Here, spontaneous behavior is recorded in a natural setting.
• Participant : Here, the observer has direct contact with the group of people they are observing. The researcher becomes a member of the group they are researching.  
• Non-participant (aka “fly on the wall): The researcher does not have direct contact with the people being observed. The observation of participants’ behavior is from a distance

Pilot Study

A pilot  study is a small scale preliminary study conducted in order to evaluate the feasibility of the key s teps in a future, full-scale project.

A pilot study is an initial run-through of the procedures to be used in an investigation; it involves selecting a few people and trying out the study on them. It is possible to save time, and in some cases, money, by identifying any flaws in the procedures designed by the researcher.

A pilot study can help the researcher spot any ambiguities (i.e. unusual things) or confusion in the information given to participants or problems with the task devised.

Sometimes the task is too hard, and the researcher may get a floor effect, because none of the participants can score at all or can complete the task – all performances are low.

The opposite effect is a ceiling effect, when the task is so easy that all achieve virtually full marks or top performances and are “hitting the ceiling”.

Research Design

In cross-sectional research , a researcher compares multiple segments of the population at the same time

Sometimes, we want to see how people change over time, as in studies of human development and lifespan. Longitudinal research is a research design in which data-gathering is administered repeatedly over an extended period of time.

In cohort studies , the participants must share a common factor or characteristic such as age, demographic, or occupation. A cohort study is a type of longitudinal study in which researchers monitor and observe a chosen population over an extended period.

Triangulation means using more than one research method to improve the study’s validity.

Reliability

Reliability is a measure of consistency, if a particular measurement is repeated and the same result is obtained then it is described as being reliable.

• Test-retest reliability :  assessing the same person on two different occasions which shows the extent to which the test produces the same answers.
• Inter-observer reliability : the extent to which there is an agreement between two or more observers.

Meta-Analysis

A meta-analysis is a systematic review that involves identifying an aim and then searching for research studies that have addressed similar aims/hypotheses.

This is done by looking through various databases, and then decisions are made about what studies are to be included/excluded.

Strengths: Increases the conclusions’ validity as they’re based on a wider range.

Weaknesses: Research designs in studies can vary, so they are not truly comparable.

Peer Review

A researcher submits an article to a journal. The choice of the journal may be determined by the journal’s audience or prestige.

The journal selects two or more appropriate experts (psychologists working in a similar field) to peer review the article without payment. The peer reviewers assess: the methods and designs used, originality of the findings, the validity of the original research findings and its content, structure and language.

Feedback from the reviewer determines whether the article is accepted. The article may be: Accepted as it is, accepted with revisions, sent back to the author to revise and re-submit or rejected without the possibility of submission.

The editor makes the final decision whether to accept or reject the research report based on the reviewers comments/ recommendations.

Peer review is important because it prevent faulty data from entering the public domain, it provides a way of checking the validity of findings and the quality of the methodology and is used to assess the research rating of university departments.

Peer reviews may be an ideal, whereas in practice there are lots of problems. For example, it slows publication down and may prevent unusual, new work being published. Some reviewers might use it as an opportunity to prevent competing researchers from publishing work.

Some people doubt whether peer review can really prevent the publication of fraudulent research.

The advent of the internet means that a lot of research and academic comment is being published without official peer reviews than before, though systems are evolving on the internet where everyone really has a chance to offer their opinions and police the quality of research.

Types of Data

• Quantitative data is numerical data e.g. reaction time or number of mistakes. It represents how much or how long, how many there are of something. A tally of behavioral categories and closed questions in a questionnaire collect quantitative data.
• Qualitative data is virtually any type of information that can be observed and recorded that is not numerical in nature and can be in the form of written or verbal communication. Open questions in questionnaires and accounts from observational studies collect qualitative data.
• Primary data is first-hand data collected for the purpose of the investigation.
• Secondary data is information that has been collected by someone other than the person who is conducting the research e.g. taken from journals, books or articles.

Validity means how well a piece of research actually measures what it sets out to, or how well it reflects the reality it claims to represent.

Validity is whether the observed effect is genuine and represents what is actually out there in the world.

• Concurrent validity is the extent to which a psychological measure relates to an existing similar measure and obtains close results. For example, a new intelligence test compared to an established test.
• Face validity : does the test measure what it’s supposed to measure ‘on the face of it’. This is done by ‘eyeballing’ the measuring or by passing it to an expert to check.
• Ecological validit y is the extent to which findings from a research study can be generalized to other settings / real life.
• Temporal validity is the extent to which findings from a research study can be generalized to other historical times.

Features of Science

• Paradigm – A set of shared assumptions and agreed methods within a scientific discipline.
• Paradigm shift – The result of the scientific revolution: a significant change in the dominant unifying theory within a scientific discipline.
• Objectivity – When all sources of personal bias are minimised so not to distort or influence the research process.
• Empirical method – Scientific approaches that are based on the gathering of evidence through direct observation and experience.
• Replicability – The extent to which scientific procedures and findings can be repeated by other researchers.
• Falsifiability – The principle that a theory cannot be considered scientific unless it admits the possibility of being proved untrue.

Statistical Testing

A significant result is one where there is a low probability that chance factors were responsible for any observed difference, correlation, or association in the variables tested.

If our test is significant, we can reject our null hypothesis and accept our alternative hypothesis.

If our test is not significant, we can accept our null hypothesis and reject our alternative hypothesis. A null hypothesis is a statement of no effect.

In Psychology, we use p < 0.05 (as it strikes a balance between making a type I and II error) but p < 0.01 is used in tests that could cause harm like introducing a new drug.

A type I error is when the null hypothesis is rejected when it should have been accepted (happens when a lenient significance level is used, an error of optimism).

A type II error is when the null hypothesis is accepted when it should have been rejected (happens when a stringent significance level is used, an error of pessimism).

Ethical Issues

• Informed consent is when participants are able to make an informed judgment about whether to take part. It causes them to guess the aims of the study and change their behavior.
• To deal with it, we can gain presumptive consent or ask them to formally indicate their agreement to participate but it may invalidate the purpose of the study and it is not guaranteed that the participants would understand.
• Deception should only be used when it is approved by an ethics committee, as it involves deliberately misleading or withholding information. Participants should be fully debriefed after the study but debriefing can’t turn the clock back.
• All participants should be informed at the beginning that they have the right to withdraw if they ever feel distressed or uncomfortable.
• It causes bias as the ones that stayed are obedient and some may not withdraw as they may have been given incentives or feel like they’re spoiling the study. Researchers can offer the right to withdraw data after participation.
• Participants should all have protection from harm . The researcher should avoid risks greater than those experienced in everyday life and they should stop the study if any harm is suspected. However, the harm may not be apparent at the time of the study.
• Confidentiality concerns the communication of personal information. The researchers should not record any names but use numbers or false names though it may not be possible as it is sometimes possible to work out who the researchers were.

Related Articles

Research Methodology

Phenomenology In Qualitative Research

Ethnography In Qualitative Research

Narrative Analysis In Qualitative Research

Thematic Analysis: A Step by Step Guide

Metasynthesis Of Qualitative Research

Grounded Theory In Qualitative Research: A Practical Guide

Department of Cognitive Science

Approaches and methods.

• Empirical Domains
• Approaches & Methods
• Linguistics at JHU

Acquisition and Development

Research in this area addresses foundational issues in the nature and development of human cognition. Studies on language acquisition address the nature of linguistic universals, and their interaction with learning mechanisms that produce language-specific acquisitions.

Studies on cognitive development address the nature of human spatial, visual, and conceptual representations, and how core representations in these areas interact with learning mechanisms to enhance, sharpen, and/or change representations.

Development and acquisition in general are viewed within a framework that emphasizes innate contributions to mature knowledge, and how these might be shaped over time. To address these issues, our group uses a variety of methodological approaches, including experimental, formal linguistic, and computational modeling. Studies cover age ranges from infancy through early childhood, from both normal and unusual populations, and use benchmark evidence from adult studies to determine the nature and course of change.

Cognitive Neuropsychology/Neuroscience

Cognitive neuropsychological and neuroscience methods are used to elucidate the nature of mental representation and processing and its neural substrates.

Computational Studies

Computational research in cognitive science focuses on fundamental issues in language structure, processing, and learning. Part of our work studies the computational and mathematical properties of the symbolic formal systems exploited in linguistic theory. We also investigate both language processing and acquisition, with particular attention to the role played by grammatical knowledge in such processes.

Our group studies the connections between symbolic and neural computation, in order to understand the kinds of symbolic computation that can be neurally realized and genetically encoded.

Our approach to these topics is by and large theoretical, focusing primarily on mathematical formalization, with use of computational simulations for support.

In addition, in conjunction with faculty members in the Center for Language and Speech Processing , our group engages in basic research in a variety of areas of applied computational linguistics, ranging from machine translation to the learning of grammatical structure from corpora.

Psycholinguistics/Cognitive Psychology

Experimental studies in language and other cognitive domains include a range of projects that examine the representational underpinnings of human mental experience.

For example, in the language domain, members of our group explore how aspects of comprehension can be explained in terms of specific hypotheses regarding the mental representation of linguistic expressions. More generally, these concerns are pursued in studies of how the representational mode of linguistic or spatial information constrains the processes that extract that information from a perceptual signal. In the domain of language production, we examine how humans organize and accomplish the planning of a word, phrase, or sentence.

Various methodologies are employed by our group to examine issues in language and spatial processing, including eye tracking and imaging. Equally noteworthy is the degree to which our experimental work draws on complementary approaches to the object of study, including formal, computational, developmental, and neuropsychological investigation.

Cognitive psychology and self-reports: Models and methods

• Published: May 2003
• Volume 12 , pages 219–227, ( 2003 )

Cite this article

• Jared B. Jobe 1  

2165 Accesses

137 Citations

Explore all metrics

This article describes the models and methods that cognitive psychologists and survey researchers use to evaluate and experimentally test cognitive issues in questionnaire design and subsequently improve self-report instruments. These models and methods assess the cognitive processes underlying how respondents comprehend and generate answers to self-report questions. Cognitive processing models are briefly described. Non-experimental methods – expert cognitive review, cognitive task analysis, focus groups, and cognitive interviews – are described. Examples are provided of how these methods were effectively used to identify cognitive self-report issues. Experimental methods – cognitive laboratory experiments, field tests, and experiments embedded in field surveys – are described. Examples are provided of: (a) how laboratory experiments were designed to test the capability and accuracy of respondents in performing the cognitive tasks required to answer self-report questions, (b) how a field experiment was conducted in which a cognitively designed questionnaire was effectively tested against the original questionnaire, and (c) how a cognitive experiment embedded in a field survey was conducted to test cognitive predictions.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price includes VAT (Russian Federation)

Instant access to the full article PDF.

Rent this article via DeepDyve

Institutional subscriptions

Similar content being viewed by others

What is Qualitative in Qualitative Research

A new criterion for assessing discriminant validity in variance-based structural equation modeling.

RMSEA, CFI, and TLI in structural equation modeling with ordered categorical data: The story they tell depends on the estimation methods

Stone AA, Turkkan JS, Bachrach CA, Jobe JB, Kurtzman HS, Cain VS (eds). The Science of Self-report: Implications for Research and Practice. Mahwah, NJ: Erlbaum, 2000.

Google Scholar  

Rubin DC (ed). Autobiographical Memory. Cambridge, UK: Cambridge University Press, 1986.

Jobe JB, Mingay DJ. Cognition and survey measurement: History and overview. Appl Cognit Psychol 1991; 5: 175–192.

Jobe JB, Tourangeau R, Smith AF. Contributions of survey research to the understanding of memory. Appl Cognit Psychol 1993; 7: 567–584.

Sudman S, Bradburn N, Schwarz N. Thinking about Answers: The Application of Cognitive Processes to Survey Methodology. San Francisco: Jossey-Bass, 1995.

Tourangeau R, Rips LJ, Rasinski K. The Psychology of Survey Response. New York: Cambridge University Press, 2000.

Jobe JB, Herrmann DJ. Implications of models of survey cognition for memory theory. In: Herrmann D, Johnson M, McEvoy C, Hertzog C, Hertel P (eds), Basic and Applied Memory Research: Vol. 2. Practical Applications. Hillsdale, NJ: Erlbaum, 1996; 193–205.

Tourangeau R. Cognitive sciences and survey methods. In: Jabine TB, Straf ML, Tanur JM, Tourangeau R (eds), Cognitive Aspects of Survey Methodology: Building a Bridge between Disciplines. Washington, DC: National Academy Press, 1984; 73–101.

Willis GB, Royston P, Bercini D. The use of verbal report methods in the development and the testing of survey questionnaires. Appl Cognit Psychol 1991; 5: 251–267.

Esposito JL, Jobe JB. A general model of the survey interaction process. Bureau of the Census Seventh Annual Research Conference Proceedings 1991; 537–560.

Forsyth BH, Lessler JT. Cognitive laboratory methods: a taxonomy. In: Biemer PP, Groves RM, Lyberg LE, Mathiowetz NA, Sudman S (eds), Measurement Errors in Surveys. New York: Wiley, 1991; 167–183.

Lessler JT, Forsyth BH. A coding system for appraising questionnaires. In: Schwarz N, Sudman S (eds), Answering Questions: Methodology for Determining Cognitive and Communicative Processes in Survey Research. San Francisco: Jossey-Bass, 1996; 259–291.

Lee L, Brittingham A, Tourangeau R, et al. Are reporting errors due to encoding limitations or retrieval failure? Surveys of child vaccination as a case study. Appl Cognit Psychol 1999; 13: 43–63.

Smith AF. Cognitive processes in long-term dietary recall. Vital Health Stat 6. 1991; 4: 1–34.

Bercini DH. Pretesting questionnaires in the laboratory: an alternative approach. J Expo Anal Environ Epidemiol 1992; 2: 241–248.

Pratt WF, Tourangeau R, Jobe JB, et al. Asking sensitive questions in a health survey. Vital Health Stat 6 (in press).

Sudman S, Warnecke R, Johnson T, et al. Cognitive aspects of reporting cancer prevention examinations and tests. Vital Health Stat 6. 1994; 7: 1–171.

Willis GB. The use of the psychological laboratory to study sensitive survey topics. In: Harrison L, Hughes A (eds), The Validity of Self-reported Drug Use: Improving the Accuracy of Survey Estimates. Rockville, MD: National Institute on Drug Abuse, 1997; 416–438.

Jobe JB, Mingay DJ. Cognitive laboratory approach to designing questionnaires for surveys of the elderly. Public Health Rep 1990; 105: 518–524.

Keller DM, Kovar MG, Jobe JB, Branch LG. Problems eliciting elders' reports of functional status. J Aging Health 1993; 5: 306–318.

Schechter S, Herrmann D. The proper use of self-report questions in effective measurement of health outcomes. Eval Health Prof 1997; 20: 28–46.

Subar AF, Thompson FE, Smith AF, et al. Improving food frequency questionnaires: A qualitative approach using cognitive interviews. J Am Diet Assoc 1995; 95: 781–788.

Smith AF, Jobe JB, Mingay DJ. Question-induced cognitive biases in reports of dietary intake by college men and women. Health Psychol 1991; 10: 244–251.

Smith AF, Jobe JB, Mingay DJ. Retrieval from memory of dietary information. Appl Cognit Psychol 1991; 5: 269–296.

Means B, Swan GE, Jobe JB, Esposito JL. An alternative approach to obtaining personal history data. In: Biemer PP, Groves RM, Lyberg LE, Mathiowetz NA, Sudman S (eds), Measurement Errors in Surveys. New York: Wiley, 1991; 167–183.

Thompson FE, Subar AF, Brown CC, et al. Cognitive research enhances accuracy of food frequency questionnaire reports: Results of an experimental validation study. J Am Diet Assoc 2002; 102: 212–218, 223-225.

Jobe JB, White AA, Kelley CL, et al. Recall strategies and memory for health care visits. Milbank Q 1991; 68: 171–189.

Brewer WF. Autobiographical memory and survey research. In: Schwarz N, Sudman S (eds), Autobiographical Memory and the Validity of Retrospective Reports. New York: Springer-Verlag, 1994; 11–20.

Wagenaar WA. My memory: A study of autobiographical memory over six years. Cognit Psychol 1986; 18: 225–252.

Drury CG, Paramore B, Van Gott HP, et al. Task analysis. In: Salvendy G (ed), Handbook of Human Factors. New York: Wiley, 1987; 370–401.

Krueger RA. Focus Groups: A Practical Guide for Applied Research. Thousand Oaks, CA: Sage, 1994.

Jobe JB, Mingay DJ. Cognitive research improves questionnaires. Am J Public Health 1989; 79: 1053–1055.

Means B, Loftus EF. When personal history repeats itself: Decomposing memories for recurring events. Appl Cognit Psychol 1991; 5: 297–318.

Tourangeau R, Rasinski KA. Cognitive processes underlying context effects in attitude measurement. Psychol Bull 1989; 103: 299–314.

Jenkins CR, Dillman DA. Towards a theory of self-administered questionnaire design. In: Lyberg L, Biemer P, Collins M, de Leeuw E, Dippo C, Schwarz N, Trewin D (eds), Survey Measurement and Process Quality. New York: Wiley, 1997; 165–196.

Mullen PA, Lohr KN, Bresnahan BW, McNulty P. Applying cognitive design principles to formatting HRQOL instruments. Qual Life Res 2000; 9: 13–27.

Download references

Author information

Authors and affiliations.

National Heart, Lung, and Blood Institute, Bethesda, MD, USA

Jared B. Jobe

You can also search for this author in PubMed   Google Scholar

Rights and permissions

Reprints and permissions

About this article

Jobe, J.B. Cognitive psychology and self-reports: Models and methods. Qual Life Res 12 , 219–227 (2003). https://doi.org/10.1023/A:1023279029852

Download citation

Issue Date : May 2003

DOI : https://doi.org/10.1023/A:1023279029852

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

• Autobiographical memory
• Cognitive interviews
• Focus groups
• Information processing models
• Find a journal
• Publish with us
• Track your research

• Skip to Content
• Skip to Main Navigation
• Skip to Search

Indiana University Bloomington Indiana University Bloomington IU Bloomington

The College of Arts & Sciences

• Department of Psychological and Brain Sciences
• Student Portal
• Research Areas

Cognitive Psychology

Research in cognitive psychology.

Cognitive psychologists develop a systematic understanding of cognitive processes. These include perception, human learning, attention, categorization, problem solving, decision–making, information processing and retrieval, short and long-term memory and forgetting, sensory encoding, motor control, psycholinguistics, and reading.

• Information processing in decision making
• Categorization and conceptual representation
• Language acquisition and sentence processing
• Speech perception
• Analysis of choice behavior
• Visual perception
• Stages of sensory information processing
• The focus of attention
• Forgetting in short and long-term memory
• The nature of retrieval from memory
• The mechanisms of visual and auditory imagery
• The control of the memorial system
• Shared cognitive processing

Adaptive Behavior and Cognition Lab  - Peter Todd

• Faculty + Staff Intranet

Psychological and Brain Sciences social media channels

• College of Arts & Sciences

• Clinical Psychological Science B.S.
• Neuroscience B.S.
• Organizational + Business Psychology B.S.
• Psychology B.A.
• Psychology B.S.
• Psychology Minor
• Neuroscience Certificate
• Areas of Interest
• Academic Support
• Research Opportunities
• Service-Learning + Practica
• Volunteer Opportunities
• Tutoring + Teaching Internships
• Internships
• Applying to Graduate School
• Financing Graduate School
• Honors Program
• Ph.D. Degree
• Qualifying Exams
• Dissertation
• Research Project
• Double Major
• Ph.D. Minor
• Funding Opportunities
• Meeting Room Reservations
• Physical Plant Service Requests
• Poster Printing
• Undergraduate Teaching Assistant Assignments
• Participate in Experiments

RESEARCH METHODS IN COGNITIVE PSYCHOLOGY

This consists of the various research methods that we use in cognitive psychology. Every research has a goal and it is achieved through the appropriate methodology.

Cognitive psychologists use various methods to explore how humans think. These methods include (i) laboratory or other controlled experiments, (ii) psychobiological research, (iii) self-reports, case studies, naturalistic observation, and (iv) computer simulations and artificial intelligence. Each method offers distinct advantages and disadvantages.

i) Experiments on Human Behaviour: In controlled experimental designs, an experimenter conducts research, typically in a laboratory setting. The experimenter controls as many aspects of the experimental situation as possible. There are basically two kinds of variables in any given experiment – independent variables and dependent variables. The irrelevant variables are held constant and are called control variables. In implementing experimental method, the experimenter must use a representative and random sample of the population of interest. S/he must also exert rigorous control over the experimental conditions. If those requisites for the experimental method are fulfilled, the experimenter may be able to infer probable causality. This influence is the effects of the independent variable (the treatment) on the dependent variable (the outcome) for the given population.

ii) Psychobiological Research: Through psychobiological research, investigators study the relationship between cognitive performance and cerebral events and situations. The various specific techniques used in psychobiological research generally fall into three categories. The first category is that of techniques for studying an individual’s brain post-mortem, relating the individual’s cognitive function prior to death to observable features of the brain. The second category is techniques for studying images showing structures of or activities in the brain of an individual who is known to have a particular cognitive deficit. The third is techniques for obtaining information about cerebral processes during the normal performance of cognitive activity (e.g. by using brain imaging techniques).

iii) Self-Reports, Case Studies, and Naturalistic Observation: Individual experiments and psychobiological studies often focus on the precise specification of discrete aspects of cognition across individuals. To obtain richly textured information about how particular individuals think in a broad range of contexts, researchers may use self-reports (an individual’s own account of cognitive processes), case studies (in-depth studies of individuals), and naturalistic observation (detailed studies of cognitive performance in everyday situations and no laboratory contexts). On the one hand, experimental research is most useful for testing hypotheses. On the other hand, research based on qualitative methods is often particularly useful for the formulation of hypotheses. These methods are also useful to generate descriptions of rare events or processes that we have no other way to measure.

iv) Computer Simulations and Artificial Intelligence: Digital computers played a fundamental role in the emergence of the study of cognitive psychology. One kind of influence is indirect though models of human cognition based on models of how computers process information. Another kind is direct, that is through computer simulations and artificial intelligence. In computer simulations, researchers program computers to imitate a given human function or process. Some researchers even have attempted to create computer models of the entire cognitive architecture of the human mind. Their models have stimulated heated discussions regarding how the human mind may function as a whole. Sometimes the distinction between simulation and artificial intelligence is blurred. It is also possible to combine the two approaches.

Cognitive psychologists often broaden and deepen their understanding of cognition through research in cognitive science. Cognitive science is a cross-disciplinary field that uses ideas and methods from cognitive psychology, psychobiology, artificial intelligence, philosophy, linguistics, and anthropology. Cognitive psychologists use these ideas and methods to focus on the study of how humans acquire and use knowledge. They also work in collaboration with other psychologists, such as social psychologists (in the field of social cognition), psychologists who study motivation and emotion, and engineering psychologists (who study human-machine interactions).

Data Collection Methods

The quest for truth in squiggles and numbers: unpacking the reliability and validity of psychological tests, navigating the moral labyrinth: ethical considerations in psychological research, leave a reply cancel reply.

Your email address will not be published. Required fields are marked *

Save my name, email, and website in this browser for the next time I comment.

Goals and Research Methods in Cognitive Psychology.

• Post category: IGNOU / MAPC / MPC 001
• Post comments: 8 Comments
• Reading time: 4 mins read

In this article, we will Describe the Goals and Research Methods in Cognitive Psychology.

Describe the Goals and Research Methods in Cognitive Psychology.

Research in Cognitive Psychology employs various methods. Each research has a goal achieved through a suitable methodology. Let’s explore the goals of research.

Goals of Research:

The goals of research in cognitive psychology encompass data gathering, data analysis, theory development, hypothesis formulation, testing, and application beyond research settings. Cognitive psychologists aim not only to describe cognition but also to explain its underlying mechanisms. Moving beyond descriptions requires inferring from observations.

Distinctive Research Methods:

Cognitive psychologists use various methods to understand human thinking, including (i) laboratory or other controlled experiments, (ii) psychobiological research, (iii) self-reports, case studies, naturalistic observation, and (iv) computer simulations and artificial intelligence.

i) Laboratory or other Controlled Experiments:

Experiments on Human Behaviour involve controlled settings where researchers manipulate variables to observe cause-and-effect relationships. They use independent and dependent variables and ensure a representative sample for reliable results. By controlling variables, researchers can infer causality and understand the effects of treatments on outcomes.

ii) Psychobiological Research:

Psychobiological research examines how cognitive performance relates to brain events. Researchers use techniques like studying post-mortem brains, brain imaging of individuals with cognitive deficits, and observing brain processes during cognitive tasks. These methods help understand how the brain functions during different cognitive activities.

iii) Self-Reports, Case Studies, and Naturalistic Observation:

Self-reports, case studies, and naturalistic observation are methods used to study cognition in individuals. Researchers gather detailed information about how people think in various contexts. While experimental research tests hypotheses, qualitative methods help formulate hypotheses. These methods are valuable for describing rare events or processes that are hard to measure otherwise.

iv) Computer Simulations and Artificial Intelligence:

Computer simulations and artificial intelligence are crucial in cognitive psychology. They help researchers understand human cognition. Simulation involves programming computers to imitate human functions. Some researchers even create computer models of the human mind. These models spark debates about how the human mind works. Sometimes, it’s hard to differentiate between simulation and artificial intelligence. Combining both approaches is also possible.

Cognitive psychologists expand their knowledge of cognition by studying cognitive science. Cognitive science blends various disciplines like cognitive psychology, psychobiology, artificial intelligence, philosophy, linguistics, and anthropology. Researchers in cognitive psychology apply these interdisciplinary approaches to explore how humans learn and utilize knowledge. They collaborate with other psychologists, including social psychologists focusing on social cognition, psychologists studying motivation and emotion, and engineering psychologists researching human-machine interactions.

• What is the Goal of Research in Cognitive Psychology?
• What are the Research Methods for Cognitive Theory?
• What are Cognitive Research Methods?
• Discuss Goals and Research Methods in Cognitive Psychology with example.

If you like this article, you can Follow us on Facebook . Also, you can Join our Official Facebook Group for QnA Sessions and Discussions with the worldwide IGNOU community.

Share This Share this content

• Opens in a new window

You Might Also Like

Goals of applied positive psychology., neurobiological aspects of hope., key parameters on which indian perspective differs from the western perspective., this post has 8 comments.

It’s hard to find educated people on this topic, but you sound like you know what you’re talking about! Thanks

Thank you for the compliment!

Highly descriptive post, I enjoyed that a lot. Will there be apart 2?

Thank you Crork. Stay Connected for more.

YouTube Channel Link: https://www.youtube.com/c/StudymatOfficial Follow Us on Facebook: https://fb.com/studymat.in

I am so grateful for your article post. Really looking forward to read more. Really Great.

Thank you. Stay Connected for more.

Hello, just wanted to tell you, I enjoyed this post. It was helpful. Keep on posting!

Leave a Reply Cancel reply

Save my name, email, and website in this browser for the next time I comment.

What is Cognitive Behavioral Therapy?

Cognitive behavioral therapy (CBT) is a form of psychological treatment that has been demonstrated to be effective for a range of problems including depression, anxiety disorders, alcohol and drug use problems, marital problems, eating disorders, and severe mental illness. Numerous research studies suggest that CBT leads to significant improvement in functioning and quality of life. In many studies, CBT has been demonstrated to be as effective as, or more effective than, other forms of psychological therapy or psychiatric medications.

It is important to emphasize that advances in CBT have been made on the basis of both research and clinical practice. Indeed, CBT is an approach for which there is ample scientific evidence that the methods that have been developed actually produce change. In this manner, CBT differs from many other forms of psychological treatment.

CBT is based on several core principles, including:

• Psychological problems are based, in part, on faulty or unhelpful ways of thinking.
• Psychological problems are based, in part, on learned patterns of unhelpful behavior.
• People suffering from psychological problems can learn better ways of coping with them, thereby relieving their symptoms and becoming more effective in their lives.

CBT treatment usually involves efforts to change thinking patterns. These strategies might include:

• Learning to recognize one’s distortions in thinking that are creating problems, and then to reevaluate them in light of reality.
• Gaining a better understanding of the behavior and motivation of others.
• Using problem-solving skills to cope with difficult situations.
• Learning to develop a greater sense of confidence in one’s own abilities.

CBT treatment also usually involves efforts to change behavioral patterns. These strategies might include:

• Facing one’s fears instead of avoiding them.
• Using role playing to prepare for potentially problematic interactions with others.
• Learning to calm one’s mind and relax one’s body.

Not all CBT will use all of these strategies. Rather, the psychologist and patient/client work together, in a collaborative fashion, to develop an understanding of the problem and to develop a treatment strategy.

CBT places an emphasis on helping individuals learn to be their own therapists. Through exercises in the session as well as “homework” exercises outside of sessions, patients/clients are helped to develop coping skills, whereby they can learn to change their own thinking, problematic emotions, and behavior.

CBT therapists emphasize what is going on in the person’s current life, rather than what has led up to their difficulties. A certain amount of information about one’s history is needed, but the focus is primarily on moving forward in time to develop more effective ways of coping with life.

Source: APA Div. 12 (Society of Clinical Psychology)