About the Book
This fourth edition of Alan E. Kazdin amp rsquo s classic text is, like its predecessors, intended to help students and professionals alike master a wide range of methodological approaches to examining clinical issues and phenomena. The goal is to help the reader design, conduct, recognize, and appreciate high quality research, and recognize the implications of crucial decisions about methodology and design. Articles cover a comprehensive array of topics, including experimental design the principles, procedures, and practices that govern research assessment of study constructs and their interrelationships potential sources of artifact and bias methods of data analysis and interpretation ethical issues and the nuts and bolts of writing research articles and getting published.
With 2 new articles and significantly revised and expanded introductory material, this revamped edition features scholarly contributions that explicate core concepts, survey contemporary issues in research, and examine ethical responsibilities toward both research participants and science itself. New additions include articles on translational and qualitative research, advances in data collection methods such as Amazon amp rsquo s Mechanical Turk service and obtaining client feedback in psychotherapy, advances in mathematical and statistical modeling including single-case interventions, and new chapters addressing questionable research practices and fraud.
Table of Contents:
Contributors
Preface
Part I. Introduction: Overview and Background
Chapter . Methodology: What It Is and Why It Is So Important
Alan E. Kazdin
Part II. Beginning the Research Process
Research Ideas
Chapter 2. Beginning the Research Process: Key Concepts That Can Guide a Study
Alan E. Kazdin
Chapter 3. Getting Out of Our Conceptual Ruts: Strategies for Expanding Conceptual Frameworks
Allan W. Wicker
Chapter 4. Translational Research
Michael T. Bardo and Mary Ann Pentz
Foci of Research
Chapter 5. In Defense of External Invalidity
Douglas G. Mook
Chapter . When Small Effects Are Impressive
Deborah A. Prentice and Dale T. Miller
Part III. Sampling and Assigning Participants to Conditions
Samples and Selection of Participants
Chapter 7. Most People Are Not WEIRD
Joseph Henrich, Steven J. Heine, and Ara Norenzayan
Chapter 8. The Neglected 95%: Why American Psychology Needs to Become Less American
Jeffrey J. Arnett
Chapter 9. Amazon's Mechanical Turk: A New Source of Inexpensive, Yet High-Quality, Data?
Michael Buhrmester, Tracy Kwang, and Samuel D. Gosling
Randomization and Group Equivalence
Chapter . Random Sampling, Randomization, and Equivalence of Contrasted Groups in Psychotherapy Outcome Research
Louis M. Hsu
Research Design Options
Chapter . Experimental and Observational Designs: An Overview
Alan E. Kazdin
Part IV. Assessment
Measurement Development, Reliability, and Validity
Chapter 2. Constructing Validity: Basic Issues in Objective Scale Development
Lee Anna Clark and David Watson
Chapter 3. Selecting Measures for Research Investigations
Alan E. Kazdin
Chapter 4. Measurement and Assessment: An Editorial View
Cecil R. Reynolds
Measurement Among Diverse Samples
Chapter 5. Methodological Issues in Assessment Research With Ethnic Minorities
Sumie Okazaki and Stanley Sue
Part V. Data Analysis, Evaluation, and Presentation
Background and Underpinnings of Data Analyses
Chapter . On the Origins of the . 5 Level of Statistical Significance
Michael Cowles and Caroline Davis
Chapter 7. Things I Have Learned (So Far)
Jacob Cohen
Null Hypotheses Testing, Meta-Analysis, and Bayesian Statistics
Chapter 8. A Power Primer
Jacob Cohen
Chapter 9. Statistical Significance Testing and Cumulative Knowledge in Psychology: Implications for Training of Researchers
Frank L. Schmidt
Chapter 2 . An Effect Size Primer: A Guide for Clinicians and Researchers
Christopher J. Ferguson
Chapter 2 . The Proof of the Pudding: An Illustration of the Relative Strengths of Null Hypothesis, Meta-Analysis, and Bayesian Analysis
George S. Howard, Scott E. Maxwell, and Kevin J. Fleming
Data Presentation
Chapter 22. Designing Better Graphs by Including Distributional Information and Integrating Words, Numbers, and Images
David M. Lane and Anik amp oacute S amp aacute ndor
Part VI. Special Topics: Evaluation in Clinical Practice and Research
Assessment and Evaluation in Clinical Work
Chapter 23. Collecting Client Feedback
Michael J. Lambert and Kenichi Shimokawa
Chapter 24. Revisiting and Reenvisioning the Outcome Problem in Psychotherapy: An Argument to Include Individualized and Qualitative Measurement
Clara E. Hill, Harold Chui, and Ellen Baumann
Evaluating Interventions
Chapter 25. Beyond Efficacy and Effectiveness: A Multifaceted Approach to Treatment Evaluation
Timothy D. Nelson and Ric G. Steele
Chapter 2 . Methodological Challenges in Treatment Outcome Research With Ethnic Minorities
Anna S. Lau, Doris F. Chang, and Sumie Okazaki
Part VII. Multiple Methodologies
Chapter 27. The Epistemology of Mathematical and Statistical Modeling: A Quiet Methodological Revolution
Joseph Lee Rodgers
Chapter 28. Qualitative Research and Its Place in Psychological Science
Anna Madill and Brendan Gouge
Chapter 29. Single-Case Experimental Research Designs
Alan E. Kazdin
Part VIII. Ethical Issues and Scientific Integrity
Guidelines and Codes
Chapter 3 . Ethical Principles of Psychologists and Code of Conduct
American Psychological Association
Chapter 3 . Research Ethics: How to Treat People Who Participate in Research
Ezekiel Emanuel, Emily Abdoler, and Leanne Stunkel
Chapter 32. Research Ethics for Mental Health Science Involving Ethnic Minority Children and Youths
Celia B. Fisher, Kimberly Hoagwood,Cheryl Boyce, Troy Duster, Deborah A. Frank, Thomas Grisso, Robert J. Levine, Ruth Macklin, Margaret Beale Spencer, Ruby Takanishi, Joseph E. Trimble, and Luis H. Zayas
Questionable Research Practices, Fraud, and Professional Responsibilities
Chapter 33. False-Positive Psychology: Undisclosed Flexibility in Data Collection and Analysis Allows Presenting Anything as Significant
Joseph P. Simmons, Leif D. Nelson, and Uri Simonsohn
Chapter 34. Why Has the Number of Scientific Retractions Increased?
R. Grant Steen, Arturo Casadevall, and Ferric C. Fang
Chapter 35. Best Practices for Allocating Appropriate Credit and Responsibility to Authors of Multi-Authored Articles
Lucas D. Eggert
Part IX. Reproducibility of Findings: Replication and Improving Research Practices
Chapter 3 . Shall We Really Do It Again? The Powerful Concept of Replication is Neglected in the Social Sciences
Stefan Schmidt
Chapter 37. The Empirical March: Making Science Better at Self-Correction
Matthew C. Makel
Chapter 38. Recommendations for Increasing Replicability in Psychology
Jens B. Asendorpf, Mark Conner, Filip de Fruyt, Jan De Houwer, Jaap J. A. Denissen, Klaus Fiedler, Susann Fiedler, David C. Funder, Reinhold Kliegl, Brian A. Nosek, Marco Perugini, Brent W. Roberts, Manfred Schmitt, Marcel A. G. van Aken, Hannelore Weber, and Jelte M. Wicherts
Part X. Publication and Communication of Research
Reporting Standards: What to Cover and Include in an Article
Chapter 39. Reporting Standards for Research in Psychology: Why Do We Need Them? What Might They Be?
APA Publications and Communications Board Working Group on Journal Article Reporting Standards
Preparing Articles for Publication
Chapter 4 . Publication and Communication of Research Findings
Alan E. Kazdin
Chapter 4 . Writing a Review Article for Psychological Bulletin
Daryl J. Bem
Part XI. Perspectives on Methodology
Chapter 42. Methodology: Perspectives and General Lessons to Guide Research
Alan E. Kazdin
Index
About the Editor