Test and measurement instruments in Psychology

Course objectives

2 Training objectives 2.1 General objectives The student should have acquired a knowledge of some intelligence and personality measuring instruments, and a knowledge of theories and techniques of measurements and data analysis for the construction and validation of psychological tests and tools for measuring psychological characteristics. 2.2 Specific objectives 2.2.1 knowledge and understanding. Ability to understand the main psychometric models and the main tests for the measurement of personality and mental abilities. Knowledge of the methodology for the construction of measuring instrument items. 2.2.2 applying knowledge and under-standing Ability to administer and interpret (under supervision) some tests of mental ability and some personality questionnaires. Ability to digitally record data, and to perform (under supervision) data analysis and to correctly interpret outputs (listings) of the SPSS program and of the IRTPRO program. Ability (under supervision) to construct items for measuring instruments. 2.2.3 Making judgments. Ability to critically evaluate the psychometric properties of a psychological test. Ability to choose the appropriate statistical analyses to analyze the psychometric properties of psychological tests and measuring instruments. 2.2.4 Communication skills. Ability to communicate the results of the administration of a psychological test, through the development of a graphic profile (in the case of administrations to single individuals, under supervision) or through tables, graphs and brief summary reports (in the case of collective administration). 2.2.5 5) Learning skills Acquire the quantitative bases in order to be able to effectively follow data analysis and psychometrics courses at an advanced level (first-level masters, advanced training courses, master's degrees)

Channel 1
CLAUDIO BARBARANELLI Lecturers' profile

Program - Frequency - Exams

Course program
Content of the course General description of the course: a) the conceptual elements relating to the measurement of psychological characteristics, with reference to the statistical foundations of psychological testing and the construction of instruments for measuring psychological variables. The in-depth themes will concern in particular: - The models of construction of psychological tests: the classical theory of tests and the theory of item response; - The analysis of the items and the validity and reliability of psychological tests; - The construction of measuring instruments b) Psychological tests: personality questionnaires, intelligence tests, psycho-attitudinal tests, projective tests, specific tools for organizational, clinical and educational contexts. Deontological aspects in the use of tests - Other measuring instruments in psychology: questionnaires, scales, surveys c) The main data analysis techniques used in psychological research, with particular emphasis on those most used for the construction and validation of tests and measurement tools, such as the analysis of simple and multiple linear regression, and the analysis exploratory factorial. Space will be given to data analysis carried out by computer programs, with particular reference to the SPSS software. The SPSS program can be downloaded from the web page http://www.campus.uniroma1.it/ by connecting to an Sapienza ip-address or by following the instructions provided by the teacher on the e-learning site. Application examples related to Classical Test Theory, Item Response Theory and data analysis will be performed through the IRTPRO - Student program. Students can download this program on the website http://www.ssicentral.com/irt/downloads.html Detailed description of the course in terms of the video-lessons planned: Part 1: What are tests and measuring instruments 1. Psychometrics and measurement in psychology 1.1. Introduction to the course 1.2. Measure in psychology: measurement scales and data analysis 1.3. Measurements of psychological characteristics: item, scale, test 2. The process of building psychological tests 2.1. The phases of the construction of the test: from the choice of the construct to the calibration of the test 2.2. The phases of the construction of the test: the definition of the construct 2.3. An example of building a scale in the personality domain 3. Types of tests, types of items 3.1. The different types of tests 3.2. The maximum performance test items 3.3. The typical performance test items Part 2. The Classical theory of tests 4. The classical theory of tests 1 - Theoretical models and application conditions 4.1. The theoretical model and its assumptions of the classical test theory (TCT) 4.2. The actual application conditions of the TCT 4.3. Reliability: a theoretical definition 5. The classical theory of tests 2 - Estimation of reliability 5.1. Psychometric models: Parallel tests, equivalent tau, congenerici 5.2. Empirical estimates of reliability 5.3. Factors that influence reliability 6. The classical theory of tests 3 - Spearman-Brown's prophetic formula 6.1. Test length and reliability: the Spearman-Brown Prophetic Formula 6.2. Practice on the prophetic formula 6.3. Correction for attenuation 7. The classical theory of tests 4 - Standard error 7.1. The standard measurement error 7.2. Interval estimation and point estimate of the true score 7.3. Standard error of the difference 8. The classical theory of tests 5 - Analysis of the items 8.1. The properties of dichotomous items: difficulty 8.2. The properties of dichotomous items: discrimination 8.3. The properties of polytomic items 9. Use the IBM-SPSS software to calculate the TCT indexes 9.1. Preparation and management of the data file 9.2. Indices of reliability and internal consistency in the "Reliability Analysis" procedure 9.3. The calculation of the D index for dichotomous data Part 3. Exploratory factor analysis 10. The study of item dimensionality: exploratory factor analysis 10.1. Aims of Exploratory Factor Analysis (AFE) 10.2. Factor extraction (factor estimation methods) 10.3. Factor rotation 11. Factor analysis and psychometric models: The analysis of items in the construction of psychological tests 11.1. Dimensionality and analysis of the items: strategic and procedural indications 11.2. Dimensionality, internal coherence, external coherence 11.3. Dimensionality, item analysis and construction of psychological tests 12. Use IBM-SPSS software to perform exploratory factor analysis 12.1. The "Factor Analysis" procedure: conditions of applicability 12.2. Steps for factor analysis with SPSS 12.3. Interpretation of output Part 4. The theory of item response (TRI - IRT) 13. The theory of item response (TRI - IRT) 1: fundamental characteristics 13.1. From the limits of TCT to the fundamental concepts of TRI 13.2. The parameters of the TRI models and the characteristic curve of the item 13.3. Logistic models for dichotomous data 14. The theory of item response (TRI - IRT) 2: models and assumptions 14.1. Summary on logistic models with 1, 2 and 3 parameters 14.2. Exercises on the interpretation of parameters and characteristic curves 14.3. Assumptions and properties of IRT models 15. The theory of item response (TRI - IRT) 3: estimation, evaluation of fit, information functions 15.1. Joint estimate of the maximum likelihood 15.2. Goodness of adaptation (fit) 15.3. Information functions and standard errors 16. The theory of item response (TRI - IRT) 4: the construction of tests in TRI 16.1. Test construction according to TRI 16.2. Scoring interpretation 16.3. The item bias and the DIF (differential operation of the items) 17. Use the IRTPRO (Student) software to empirically examine TRI models 17.1. The IRTpro environment, preparation and management of the data file 17.2. Implement the analysis of the TRI logistics models at 1, 2, and 3 parameters and interpret the output, # 1 17.3. Implement the analysis of the TRI logistics models at 1, 2, and 3 parameters and interpret the output, # 2 Part 5. The validity of psychological tests 18. Validity of tests: definitions and types 18.1. Validity as a multidimensional concept 18.2. The validity with respect to the criterion 18.3. Construct validity and nomological validity 19. The empirical study of validity through the analysis of multiple regression 19.1. Simple regression 19.2. Parameter estimation and hypothesis testing 19.3. Multiple regression 20. Use IBM-SPSS software to perform regression analysis 20.1. The "Linear regression analysis" procedure 1: standard regression 20.2. The "Linear regression analysis" procedure 2: hierarchical regression 20.3. The "Linear regression analysis" procedure 3: stepwise regression Part 6. Psychometric techniques: tests and other measuring instruments 21. The interpretation of psychological texts 21.1. Standards and standardization of psychological tests 21.2. Calibration of psychological tests 21.3. The graphical representation of the test results 22. The measure of intelligence 22.1. What intelligence tests measure: 22.2. The Wechsler scales 22.3. Raven's progressive matrices 23. The measurement of attitudes 23.1. Multiple attitudes and mental abilities 23.2. Psycho-attitudinal batteries 23.3. The measure of mental abilities in the organizational context 24. The measure of personality 24.1. The factorial theories of personality and the Big Five model 24.2. The BFQ-2 24.3. Measure the personality in the clinical context: the MMPI2 25. Projective psychodiagnostic tests 25.1. Brief history, categories and use of projective tests 25.2. The Rorschach test 25.3. Thematic tests 26. Deontological elements and areas of application of psychological tests 26.1. The code of ethics of the Order of Psychologists in relation to the use of psychological tests 26.2. The tests in practice: guidelines for a correct application of the tests 26.3. Use and application fields of psychological tests
Prerequisites
The course requires a good mastery of the fundamentals of psychometry (descriptive statistics, probability, verification of statistical hypotheses). We strongly recommend that you take the Psychometrics exam (prof. Vecchione) before taking the Psychological Test exam. Even if there is no "formal" prerequisite, the propedeutical nature is substantial.
Books
1. Barbaranelli C. e Natali E. (2005). I test psicologici: Teorie e Modelli Psicometrici. Carocci, Roma. (these parts can be skipped: paragraphs 2.12.4, 3.2.2, 3.9.2, 4.1.7., 4.2, 4.3.1, 6.2.2, pages 117, 118, 119); 2. Picone L., Pezzuti L., Ribaudo F. (2017). Teorie e tecniche dei test. Uso e interpretazione. Nuova edizione. Carocci Editore, Roma. (these parts can be skipped: paragraphs 5.2-5.5 e 12.10; chapter 9; chapter 11); 3. Chiorri C. (2011). Teoria e tecnica psicometrica. McGraw Hill, Milano. (these parts can be skipped: paragraphs 1.4, 2.2, 5.1) 4.Additional teaching materials (slides, exercises, in-depth lecture notes) that can be downloaded from the e-learning site
Teaching mode
There are 26 video-lessons (Educational Teaching; each lesson corresponds to one of the topics listed in the teaching program). The lessons are accompanied by interactive activities that include: self-test and feedback quizzes, individual activities, webinars, and guided videotaped exercises for exam preparation. Experiential path (optional) It involves the carrying out of online tests divided into 2 parts. The completion of all the tests, in the times and in the ways provided for by the course, entitles the student to not be able to carry out a part of the exam task, and to 1 bonus point, according to the indications that will be provided in the e-learning page of the teacher, integrating then the final grade with the points obtained with participation in the experiential path. Students who choose to undertake this path are required to participate in the online experiences proposed by the teacher.
Frequency
To take the exam we strongly recommend that you view the video lessons presented during the course.
Exam mode
The objective of the final exam is to evaluate the knowledge of the subjects being examined, and the ability to apply this knowledge. The final exam is written and includes: - multiple choice questions on texts 1, 2 and 3 - calculation exercises on the application of the classical test theory - open questions on the application of the theory of the response to the item - An exercise related to the calculation of standardized scores (T) and to the construction of the graphic profile based on the results of a psychological test - open questions concerning the interpretation of statistical analysis results carried out with SPSS and IRTPRO The test lasts 60 minutes. The final grade is expressed in thirtieths. The text of the exam assignment returns the value assigned to each question. Oral integration is provided upon request of the teacher or student. The score may change of 2 points according to the performance.
Bibliography
Theresa J.B. Kline (2005). Psychological Testing A Practical Approach to Design and Evaluation Deborah L. Bandalos (2018). Measurement Theory and Applications for the Social Sciences
Lesson mode
see elearning.uniroma1.it
  • Lesson code1055554
  • Academic year2024/2025
  • CoursePsychological Sciences and Techniques
  • CurriculumSingle curriculum
  • Year3rd year
  • Semester1st semester
  • SSDM-PSI/03
  • CFU12
  • Subject areaAttività formative affini o integrative