Validity of empirical research in psychology

Transcription

1 ANNUAL REPORT 2011 Validity of empirical research in psychology 1. Full title Quantitative Methods: Methods and Models for Brain and Behavior 2. Research group Psychological Methods Program director: Han van der Maas 3. Members Senior staff Paul de Boeck, Denny Borsboom, Conor Dolan, Raoul Grasman, Han van der Maas, Gunter Maris, Eric-Jan Wagenmakers, Lourens Waldorp, Jelte Wicherts Postdoctoral fellows Peter Halpin, Verena Schmittmann, Sanne van der Ven PhD s Marjan Bakker, Angélique Cramer, Gilles Dutilh, Kees Jan Kan, Rogier Kievit, Sharon Klinkenberg, Mariska Knol, Dora Matzke, Dylan Molenaar, Don van Ravenzwaaij, Helen Steingröver, Marthe Straatemeier, Ruud Wetzels 4. Membership Research Schools and other Research Institutes The program is embedded in the Interuniversity Graduate School for Psychometrics and Sociometrics (IOPS). Within IOPS, the program collaborates closely with the National Institute for Educational Measurement (CITO). 5. Research topics Our mission is to improve psychological science in two ways: by developing research methodology and by contributing novel psychological theory. Our cross-cutting vision is that these two strands of science are intertwined: Good substantive theories can be represented in mathematical form, and because formalized substantive theories are closely connected to statistical models, developing methodology goes hand in hand with developing theory. The simultaneous development of novel substantive theories and methodologies suited to test them defines the unique and internationally acclaimed focus of our group. 53

2 PSYCHOLOGICAL METHODS With this general objective, the group focuses on a number of more specific conceptual and empirical challenges in psychological research. First, much of the research concerns matters that involve the conceptual foundations of psychology and psychometrics. This involves the analysis of psychometric concepts such as validity, reliability, and measurement levels, but also of psychological concepts like general intelligence, psychopathology, and personality. Second, a theme that runs through the program is the analysis of data that involve the factor time. This covers, for instance, online adaptive testing procedures, the analysis of learning curves, regime-switching models, and the modeling of speed accuracy trade-offs. Third, a general theme concerns the analysis of individual differences, especially in relation to differences between groups. This theme includes research on measurement invariance, selection, behavior genetics, and latent variable modeling. Finally, a recent addition to this spectrum is the analysis of neuroscientific data, involving models for fmri and EEG/MEG data, but also covering the question of how we should jointly model neurological and behavioral measures. 6. Program development In the past years, the Psychological Methods group has grown spectacularly, mainly as a result of the many research grants that were awarded in These developments crystallized into the following structure. The Psychological Methods group is chaired by professor Han van der Maas. As group leader, he is involved in nearly every research topic pursued in the department. He is also the primary driving force behind the following projects: 1) research into novel methods of adaptive testing in the context of the Math Garden ( Rekentuin ) project, which involves the work of Marthe Straatemeier, Sharon Klinkenberg, and Gunter Maris, and 2) research into the structure of intelligence, which involves the work of Conor Dolan, and Jelte Wicherts. Further, two prominent research programs, each supported by a VIDI-grant from NWO, are driven by Eric-Jan Wagenmakers and Denny Borsboom. Wagenmakers is the program leader of a research program on the analysis of psychonomic data that concern response times and accuracy measures by means of diffusion modeling. This research involves the work of Don van Ravenzwaaij, Gilles Dutilh, Ruud Wetzels, Dora Matzke, and Helen Steingröver. In 2011 Eric-Jan Wagenmaker received a prestigious ERC junior grant (1.5 M ). Borsboom leads a research program into the relation between causal networks and psychometric theory, with special applications to psychopathology. This research involves the work of Angélique Cramer, Lourens Waldorp, and Verena Schmittmann. This research program has also initiated collaborations with members of the Developmental Psychology group (Ingmar Visser), the Clinical Psychology group (Jan-Henk Kamphuis, Arnold van Emmerik) and the 54

3 ANNUAL REPORT 2011 Psychonomics group (Hilde Geurts), and since 2008 features a joint PhD project on behavior genetics with Conor Dolan, and with Dorret Boomsma of the Department of Biological Psychology at the Free University of Amsterdam. In addition, four research programs are pursued in various collaborative constellations. First, the group has a research program on the analysis of neuroscientific data and its relation to psychological or behavioral measures. This work involves contributions by Raoul Grasman, sponsored by an NWO- VENI grant, Lourens Waldorp, Denny Borsboom, and Rogier Kievit. The program involves collaboration with members of the Developmental Psychology group (Hilde Huizenga), the Psychonomics Group (Romke Rouw, Steven Scholte), and the Philosophy of Science Department of Groningen University (Jan-Willem Romeijn). Second, a line of research revolves around invariance relations in psychometrics. Two important relations of this kind are measurement invariance and representational invariance (scale levels). Research on measurement invariance involves the work of Jelte Wicherts, sponsored by an NWO-VENI grant, Conor Dolan, and Dylan Molenaar (sponsored by an NWO-Toptalent grant). Third, several researchers of the group are involved in research on educational measurement. This involves the Math Garden project, but also the work of Mariska Knol on structured teacher feedback, and the research of Gunter Maris, Denny Borsboom, and Jelte Wicherts on fairness in educational testing. Fourth, the group has developed a research line into scientific practices in psychology. Jelte Wicherts is the main researcher in this line of research, which for instance looks at guidelines and practices for data sharing in psychology and evaluates the influence of common practices like subject exclusion on substantive results. This line is supported by a NWO Open Competition grant awarded to Wicherts; the research is carried out by Marjan Bakker, who joined the department in

4 PSYCHOLOGICAL METHODS 7. Composition of research input of academic staff in 2011 FTE wp1 wp2 wp3 Total Full professors (HL) Associate professors (UHD) Assistant professors (UD) Other tenured research staff 0.00 Total tenured research staff Non tenured research staff Ph.D. students (AIO) Research assistants Total non tenured research staff Total

5 ANNUAL REPORT 2011 RESEARCH OUTPUT 1. Academic publications 1.a. Refereed articles Baas, K. D., Cramer, A. O. J., Koeter, M. W. J., Lisdonk, E. van de, Weert, H. C. van, & Schene, A. H. (2011). Measurement invariance with respect to ethnicity of the Patient Health Questionnaire-9 (PHQ-9). Journal of Affective Disorders, 129, Bakker, M., & Wicherts, J. M. (2011). The (mis)reporting of statistical results in psychology journals. Behavior Research Methods, 43, Boeck, P. de, Bakker, M., Zwitser, R., Nivard, M., Hofman, A., Tuerlinckx, F., & Parchev, I. (2011). The estimation of item response models with the lmer function from the lme4 package in R. Journal of Statistical Software, 39, Boeck, P. de, Cho, S.-J., & Wilson, M. (2011). Explanatory secondary dimension modeling of latent DIF. Applied Psychological Measurement, 35, Borsboom, D., Cramer, A. O. J., Schmittmann, V. D., Epskamp, S., & Waldorp, L. J. (2011). The small world of psychopathology. PLoS One, 6(11), e Borsboom, D., Epskamp, S., Kievit, R. A., Cramer, A. O. J., & Schmittmann, V. D. (2011) Transdiagnostic networks. Perspectives on psychological science, 6, Christoffels, I. K., Ven, V. van de, Waldorp, L. J., Formisano, E., & Schiller, N. O. (2011). The sensory consequences of speaking: Parametric neural cancellation during speech in auditory cortex. PLoS One, 6(5), e Donkin, C., Brown, S., Heathcote, A., & Wagenmakers, E. -J. (2011). Diffusion versus linear ballistic accumulation: Different models but the same conclusions about psychological processes? Psychonomic Bulletin & Review, 18, Dutilh, G., Krypotos, A.-M., & Wagenmakers, E. -J. (2011). Task-related vs. stimulus-specific practice: A diffusion model account. Experimental Psychology, 58, Dutilh, G., Wagenmakers, E. -J., Visser, I., & Maas, H. L. J. van der (2011). A phase transition model for the speed-accuracy trade-off in response time experiments. Cognitive Science, 35,

6 PSYCHOLOGICAL METHODS Eck, D. van (2011). Incommensurability and rationality in engineering design: the case of functional decomposition. Techné: Research in Philosophy and Technology, 15(2), Eck, D. van (2011). Supporting design knowledge exchange by converting models of functional decomposition. Journal of Engineering Design, 22(11-12), Facon, B., Magis, D., Nuchadee, M.-L., & Boeck, P. de (2011). Do Raven s Colored Matrices function in the same way in typical and clinical populations? Insights from the intellectual disability field. Intelligence, 39, Forstmann, B. U., Wagenmakers, E. -J., Eichele, T., Brown, S., & Serences, J. T. (2011). Reciprocal relations between cognitive neuroscience and formal cognitive models: Opposites attract? Trends in Cognitive Sciences, 15, Ganis, G., Rosenfeld, J. P., Meixner, J., Kievit, R.A., & Schendan, H. (2011). Lying in the scanner: Covert countermeasures disrupt deception detection by functional Magnetic Resonance Imaging. Neuroimage, 55, Halpin, P. F., Dolan, C. V., Grasman, R. P. P. P., & Boeck, P. A. L. de (2011). On the relation between the linear factor model and the latent profile model. Psychometrika, 76(4), Harmelen, A. L. van, Elzinga, B. M., Kievit, R. A. & Spinhoven, P. (2011). Intrusions of autobiographical memories in individuals reporting childhood emotional maltreatment. European Journal of Psychotraumatology, 2, Huizenga, H. M., Visser, I., & Dolan, C. V. (2011). Testing overall and moderator effects meta-regression. The British Journal of Mathematical & Statistical Psychology, 64(1), Jahfari, S., Waldorp, L. J., Wildenberg, W. P. M., Scholte, H. S., Ridderinkhof, K. R., & Forstmann, B. U. (2011). Effective inhibition reveals important roles for both the hyperdirect (fronto-subthalamic) and the indirect (frontostriatal-pallidal) fronto-basal ganglia pathways during response inhibition. Journal of Neuroscience, 31(18), Kan, K.-J., Kievit, R. A., Dolan, C. V., & Maas, H. L. J. van der (2011). On the interpretation of the CHC factor Gc. Intelligence, 39(5), Kashimura, M., Ogawa, T., Vorst, H. C. M., & Bermond, B. (2011). Psychometric properties of the Bermond-Vorst Alexithymia Questionnaire in Japanese. Japanese Psychological Research, 53(3), Kievit, R. A. (2011). Bayesians caught smuggling priors into Rotterdam Harbour. Perspectives on Psychological Science, 6,

7 ANNUAL REPORT 2011 Kievit, R. A. (2011). Parapsychologie, nullhypothesetoetsing en peer review 2.0. De Psycholoog, 46, Kievit, R. A., & Geurts, H. M. (2011). Autism and perception of awareness in self and others: Two sides of the same coin or dissociated abilities? Cognitive Neuroscience, 2, Kievit, R. A., Romeijn, J. W., Waldorp, L. J., Wicherts, J. M., Scholte, H. S., & Borsboom, D. (2011). Mind the gap: A psychometric approach to the reduction problem. Psychological Inquiry, 22, Kievit, R. A., Romeijn, J. W., Waldorp, L. J., Wicherts, J. M., Scholte, H. S., & Borsboom, D. (2011). Modeling mind and matter: Reductionism and psychological measurement in cognitive neuroscience. Psychological Inquiry, 22, Klinkenberg, S., Straatemeier, M., & Maas, H. L. J. van der (2011). Computer adaptive practice of Maths ability using a new item response model for on the fly ability and difficulty estimation. Computers and Education, 57(2), Kuile, H. ter, Veldhuis, M., Veen, S. van, & Wicherts, J. M. (2011). Bilingual education, metalinguistic awareness, and the understanding of an unknown language. Bilingualism: Language and Cognition, 14, Lodewyckx, T., Kim, W., Tuerlinckx, F., Kuppens, P., Lee, M. D., & Wagenmakers, E. -J. (2011). A tutorial on Bayes factor estimation with the product space method. Journal of Mathematical Psychology, 55, Maanen, L. van, Brown, S., Eichele, T., Wagenmakers, E. -J., Ho, T., Serences, J., & Forstmann, B. U. (2011). Neural correlates of trial-to-trial fluctuations in response caution. Journal of Neuroscience, 31, Maanen, L. van, Grasman, R. P. P. P., Forstmann, B. U., & Wagenmakers, E. - J. (2011). Piéron's law in perceptual decision-making. Frontiers in Decision Neuroscience, 5, 143. Maas, H. L. J. van der, Molenaar, D., Maris, G., Kievit, R. A., & Borsboom, D. (2011). Cognitive psychology meets psychometric theory: On the relation between process models for decision making and latent variable models for individual differences. Psychological Review, 118, Magis, D., & Boeck, P. de (2011). A multivariate outlier detection approach for multi-group differential item functioning. Multivariate Behavioral Research, 46, Molenaar, D., Dolan, C. V., & Maas, H. van der (2011). Modeling ability differentiation in the second-order factor model. Structural Equation Modeling, 18,

8 PSYCHOLOGICAL METHODS Nieuwenhuis, S., Forstmann, B. U., & Wagenmakers, E. -J. (2011). Erroneous analyses of interactions in neuroscience: A problem of significance. Nature Neuroscience, 14, Nilsson, H., Rieskamp, J., & Wagenmakers, E. -J. (2011). Hierarchical Bayesian parameter estimation for cumulative prospect theory. Journal of Mathematical Psychology, 55, Penke, L. Borsboom, D., Johnson, W., Kievit, R. A., Ploeger, A., & Wicherts, J. M. (2011). Evolutionary psychology and intelligence research cannot be integrated the way Kanazawa (2010) suggested. The American Psychologist, 66, Ravenzwaaij, D. van, Brown, S., & Wagenmakers, E. -J. (2011). An integrated perspective on the relation between response speed and intelligence. Cognition, 119, Ravenzwaaij, D. van, Dutilh, G., & Wagenmakers, E. -J. (2011). Cognitive model decomposition of the BART: Assessment and application. Journal of Mathematical Psychology, 55, Ravenzwaaij, D. van, Maas, H. L. J. van der, & Wagenmakers, E. -J. (2011). Does the Name-Race Implicit Association Test measure racial prejudice? Experimental Psychology, 58, Rigdon, E. E., Preacher, K. J., Lee, N., Howell, R. D., Franke, G. R., & Borsboom, D. (2011). Avoiding measurement dogma: A response to Rossiter. European Journal of Marketing, 45, Smits, I. A. M., Dolan, C. V., Vorst, H. C. M., Wicherts, J. M., & Timmerman, M. E. (2011). Cohort differences in big five personality factors over a period of 25 years. Journal of Personality and Social Psycholology, 100(6), Stringer, S., Borsboom, D., & Wagenmakers, E. -J. (2011). Bayesian inference for the information gain model. Behavior Research Methods, 43, Toll, S. W. M., Ven, S. H. G. van der, Kroesbergen, E. H., & Luit, J. E. H. van (2011). Executive functions as predictors of math learning disabilities. Journal of Learning Disabilities, 44, Wagenmakers, E. -J., Wetzels, R., Borsboom, D., & Maas, H. L. J. van der (2011). Why psychologists must change the way they analyze their data: The case of psi. Journal of Personality and Social Psychology, 100, Waldorp, L.J., Christoffels, I. K., & Ven, V. van de (2011). Effective connectivity of fmri data using ancestral graph theory: Dealing with missing regions. NeuroImage, 54,

9 ANNUAL REPORT 2011 Weeda, W. D., Vos, F. de, Waldorp, L. J., Grasman, R. P. P. P., & Huizenga, H. M. (2011). arf3ds4: An integrated framework for localization and connectivity analysis of fmri data. Journal of Statistical Software, 44(14), Weeda, W. D., Waldorp, L. J., Grasman, R. P. P. P., Gaal, S. van, & Huizenga, H. M. (2011) Functional connectivity analysis of fmri data using parameterized regions-of-interest. NeuroImage, 54, Wetzels, R., Matzke, D., Lee, M. D., Rouder, J. N., Iverson, G. J., & Wagenmakers, E. -J. (2011). Statistical evidence in experimental psychology: An empirical comparison using 855 t tests. Perspectives on Psychological Science, 6, Wicherts, J. M. (2011). Psychology must learn a lesson from fraud case. Nature, 480, 7. Wicherts, J. M., Bakker, M., & Molenaar, D. (2011). Willingness to share research data is related to the strength of the evidence and the quality of reporting of statistical results. PLoS ONE, 6, e Zand Scholten, A., Maris, G., & Borsboom, D. (2011). The emperor's new measurement model. Measurement, 9, b. Non-refereed articles Borsboom, D., Wagenmakers, E. -J., & Romeijn, J.-W. (2011). Mechanistic curiosity will not kill the Bayesian cat. [Comment on "Bayesian Fundamentalism or Enlightenment? On the explanatory status and theoretical contributions of Bayesian models of cognition"]. Behavioral and Brain Sciences, 34, Cramer, A. O. J., Kendler, K. S., & Borsboom, D. (2011). Where are the genes? The implications of a network perspective on gene hunting in psychopathology. [A commentary on Johnson et al.]. European Journal of Personality, 25, Wagenmakers, E. -J. (2011). Kleren voor de keizer. [Review of Informative Hypotheses: How to Move Beyond Classical Null Hypothesis Testing, by R. van de Schoot.] De Psycholoog, 46, Wicherts, J. M. (2011). Solving the 432 pieces of the puzzle called measurement invariance. [Review of the book Statistical approaches to measurement invariance, by R.E. Millsap]. PsycCritiques, 56(38), 3. Zand Scholten, A., Maris, G., & Borsboom, D. (2011). The emperor's new measurement model. Measurement, 9, c. Books 61

10 PSYCHOLOGICAL METHODS Mellenbergh, G. J. (2011). A conceptual introduction to psychometrics: Development, analysis, and application of psychological and educational tests. The Hague, the Netherlands: Eleven International Publishing. 1.d. Book Chapters Verkuilen, J., Kievit, R. A., & Zand Scholten, A. (2011). Fuzzy sets to represent concepts in psychology and the behavioral sciences. In R. Belohlavek & G.J. Klir (Eds.), Concepts and Fuzzy Logic (pp ). Cambridge: MIT Press. 1.e. Conference Papers Ravenzwaaij, D. van, Mulder, M. J., & Wagenmakers, E. -J. (2011). How do we deal with bias in prior information? Paper presented at The semi-annual meeting of the Interuniversity Graduate School of Psychometrics and Sociometrics. Leiden, the Netherlands. Ravenzwaaij, D. van, Dutilh, G., & Wagenmakers, E. -J. (2011). New measure for post-error slowing: Robustness to global changes in task performance. Paper presented at The annual meeting of the Mathematical Psychology Society. Boston, Massachusetts, USA. 1.f. Reports - 2. Ph.D. Thesis 2.a. Internally prepared Zand Scholten, A. (January 2011). Admissible statistics from a latent variable perspective (pp. 171). Promotor: H. L. J. van der Maas; co-promotores: D. Borsboom & P. Koele. 2.b. Externally prepared - 2.c. Doctorates at other faculties/universities, co-supervised by program members - 3. Professional Publications Epskamp, S., Cramer, A. O. J., Waldorp, L. J., Schmittmann, V. D., & Borsboom, D. (2011). qgraph: Network representations of relationhips in 62

11 ANNUAL REPORT 2011 data. R package version Available from Koele, P. (2011). Rationeel beslissingen nemen, kan dat? Quality Practice, Nascholingstijdschrift voor tandartsen. 7, Publications aimed at the general public Borsboom, D., Wagenmakers, E. -J., Kievit, R. A., Wetzels, R., Berg, H. van den, & Wichters, J. M. (2011). Universiteiten en subsidieverstrekkers moeten fraude aanpakken. De Volkskrant, Kievit, R. A., Borsboom, D., Wagenmakers, E. -J., Wichters, J. M. Wetzels, R., Harmelen, A.-L. van, & Berg, H. van den (2011). Maatregel om fraude te bemoeilijken brengt enkel voordelen met zich mee. De Volkskrant, Other results 5.a Book editors Adèr, H. J., & Mellenbergh, G. J. (Eds.) (2011). Advising on research methods: Selected topics Huizen, the Netherlands: Johannes van Kessel Publishing. 5.b Journal editorships Boeck, P. A. L. de European Journal of Psychological Assessment (Consulting editor) Measurement: Interdisciplinary Research and Perspective (Co-editor) Psychometrika (Guest associate editor) Borsboom, D. Educational Measurement: Issues and Practice (Editorial Board) Frontiers of quantitative psychology (Editorial Board) Measurement Science Review (Editorial Board) Dolan, C. V. Intelligence (Editorial Board) Multivariate Behavioral Research (Editorial Board) Psychological Methods (Editorial Board) Psychological Medicine (Editorial Board) Koele, P. Acta Psychologica (Editorial Board) Wagenmakers, E. -J. Cognitive Psychology (Action editor) 63

12 PSYCHOLOGICAL METHODS Frontiers in Decision Neuroscience (Consulting editor) Journal of Mathematical Psychology (Action editor) Psychological Review (Consulting editor) Psychonomic Bulletin & Review (Action editor) Wicherts J. M. Intelligence (Editorial board) 5.c Inaugural lectures - 5.d Prizes Bakker, M., & Wicherts, J. M. (2011). Best article of 2011 in Behavior Research Methods for Bakker, M., & Wicherts, J. M. (2011). The (mis)reporting of statistical results in psychology journals. Behavior Research Methods, 43, e Organisation of conferences and symposia Borsboom, D. (2011, August 26-29). Organizer of the Association for Psychological Science (APS) invited symposium Network Analysis. APS Convention, Washington, USA. Borsboom, D. (2011, July 18-22). Organizer of the IMPS invited symposium Validiy. International Meeting of the Psychometric Society, Hong Kong, China. Borsboom, D. (2011, July 18-22). Member of the Program Committee, 2011 International Meeting of the Psychometric Society. Hong Kong, China. Halpin, P. F. (2011, July). Process Models for Behavioral Dynamics. (Organiser and presenter) International Meeting of the Psychometric Society. Hong Kong, China. Molenaar, D. (2011, July). Organisation of the symposium Heterogeneity in Latent Variable Models for the 76th annual meeting of the Psychometric Society. Hong Kong, China. Wagenmakers, E. -J., Wetzels,R. M., Matzke, D, & Lee, M. (2011, August). Bayesian Modeling for Cognitive Science. Amsterdam, the Netherlands. 5.f Research grants Borsboom, D. (2011). NWO Knowledge transfer grant ( Meerwaarde, coapplicant; with Dr. Marija Maric). 64

13 ANNUAL REPORT 2011 Brown, S., Eidels, A., Heathcote, A., & Wagenmakers, E. -J. (2011). The project 'Rapid decisions: From neuroscience to complex cognitions'. Australian Research Council. Karayanidis, F., Lenroot, R., Parsons, M., Michie, P., & Wagenmakers, E. -J. (2011). The project 'Cognitive flexibility from adolescence to senescence: Variability associated with cognitive strategy and brain connectivity'. Australian Research Council. Maas, H. L. J. van der (2011). Online science learning in primary education, National Initiative Brain & Cognition (NIBC), Postdoc. Wagenmakers, E. -J. (2011). The project 'Bayes or bust: Sensible hypothesis tests for social scientists'. 'Consolidator' grant from the European Research Council. Wagenmakers, E. -J., & Forstmann, B. (2011). The Academy Colloquium proposal 'New insights from model-based cognitive neuroscience'. Funded by the Royal Netherlands Academy of Arts and Sciences (KNAW). Wagenmakers, E. -J., Forstmann, B., Nieuwenhuis, S., & Maas, H. van der (2011). The 'MaGW open competition' PhD project 'A dynamic and formal account of what people do before and after they make an error'. The Netherlands Organisation for Scientific Research (NWO). Wagenmakers, E. -J. (2011). External advisor on the Engineering and Physical Sciences Research Council project 'Decision making in an unstable world' (investigators: Iain Gilchrist, Roland Baddeley, Rafal Bogacz, Simon Farrell, David Leslie, Casimir Ludwig, and John McNamara). 5.g Keynote speeches at conferences Wicherts, J. M. (2011). It s alive! A review and prospect of measurement invariance research. Invited 'state-of-the-art' talk at the 76th Meeting of the Psychometric Society. Hong Kong, China, July 19, h Collaborations Borsboom, D. ( present). Dr. Francis Tuerlinckx, Leuven University, Belgium. The construction of network analysis techniques. Borsboom, D. ( present). Dr. Marieke Wichers, Maastricht University, The Netherlands. Network analyses for experience sampling data. Borsboom, D. ( present). Prof. Kenneth S. Kendler and Dr. Steven H. Aggen, Virginia Commonwealth University, USA. Application of network models to clinical data. Borsboom, D. ( present). Dr. Brian D. Haig, University of Canterbury, New Zealand. The concept of truth in psychology. 65

14 PSYCHOLOGICAL METHODS Borsboom, D. ( present). Dr. K. Markus, City University of New York, USA. Measurement theory, psychometrics, and validity theory. 66