Course program
Content of the course
General description of the course:
a) the conceptual elements relating to the measurement of psychological characteristics, with reference to the statistical foundations of psychological testing and the construction of instruments for measuring psychological variables.
The in-depth themes will concern in particular:
- The models of construction of psychological tests: the classical theory of tests and the theory of item response;
- The analysis of the items and the validity and reliability of psychological tests;
- The construction of measuring instruments
b) Psychological tests: personality questionnaires, intelligence tests, psycho-attitudinal tests, projective tests, specific tools for organizational, clinical and educational contexts. Deontological aspects in the use of tests
- Other measuring instruments in psychology: questionnaires, scales, surveys
c) The main data analysis techniques used in psychological research, with particular emphasis on those most used for the construction and validation of tests and measurement tools, such as the analysis of simple and multiple linear regression, and the analysis exploratory factorial. Space will be given to data analysis carried out by computer programs, with particular reference to the SPSS software. The SPSS program can be downloaded from the web page http://www.campus.uniroma1.it/ by connecting to an Sapienza ip-address or by following the instructions provided by the teacher on the e-learning site.
Application examples related to Classical Test Theory, Item Response Theory and data analysis will be performed through the IRTPRO - Student program. Students can download this program on the website http://www.ssicentral.com/irt/downloads.html
Detailed description of the course in terms of the video-lessons planned:
Part 1: What are tests and measuring instruments
1. Psychometrics and measurement in psychology
1.1. Introduction to the course
1.2. Measure in psychology: measurement scales and data analysis
1.3. Measurements of psychological characteristics: item, scale, test
2. The process of building psychological tests
2.1. The phases of the construction of the test: from the choice of the construct to the calibration of the test
2.2. The phases of the construction of the test: the definition of the construct
2.3. An example of building a scale in the personality domain
3. Types of tests, types of items
3.1. The different types of tests
3.2. The maximum performance test items
3.3. The typical performance test items
Part 2. The Classical theory of tests
4. The classical theory of tests 1 - Theoretical models and application conditions
4.1. The theoretical model and its assumptions of the classical test theory (TCT)
4.2. The actual application conditions of the TCT
4.3. Reliability: a theoretical definition
5. The classical theory of tests 2 - Estimation of reliability
5.1. Psychometric models: Parallel tests, equivalent tau, congenerici
5.2. Empirical estimates of reliability
5.3. Factors that influence reliability
6. The classical theory of tests 3 - Spearman-Brown's prophetic formula
6.1. Test length and reliability: the Spearman-Brown Prophetic Formula
6.2. Practice on the prophetic formula
6.3. Correction for attenuation
7. The classical theory of tests 4 - Standard error
7.1. The standard measurement error
7.2. Interval estimation and point estimate of the true score
7.3. Standard error of the difference
8. The classical theory of tests 5 - Analysis of the items
8.1. The properties of dichotomous items: difficulty
8.2. The properties of dichotomous items: discrimination
8.3. The properties of polytomic items
9. Use the IBM-SPSS software to calculate the TCT indexes
9.1. Preparation and management of the data file
9.2. Indices of reliability and internal consistency in the "Reliability Analysis" procedure
9.3. The calculation of the D index for dichotomous data
Part 3. Exploratory factor analysis
10. The study of item dimensionality: exploratory factor analysis
10.1. Aims of Exploratory Factor Analysis (AFE)
10.2. Factor extraction (factor estimation methods)
10.3. Factor rotation
11. Factor analysis and psychometric models: The analysis of items in the construction of psychological tests
11.1. Dimensionality and analysis of the items: strategic and procedural indications
11.2. Dimensionality, internal coherence, external coherence
11.3. Dimensionality, item analysis and construction of psychological tests
12. Use IBM-SPSS software to perform exploratory factor analysis
12.1. The "Factor Analysis" procedure: conditions of applicability
12.2. Steps for factor analysis with SPSS
12.3. Interpretation of output
Part 4. The theory of item response (TRI - IRT)
13. The theory of item response (TRI - IRT) 1: fundamental characteristics
13.1. From the limits of TCT to the fundamental concepts of TRI
13.2. The parameters of the TRI models and the characteristic curve of the item
13.3. Logistic models for dichotomous data
14. The theory of item response (TRI - IRT) 2: models and assumptions
14.1. Summary on logistic models with 1, 2 and 3 parameters
14.2. Exercises on the interpretation of parameters and characteristic curves
14.3. Assumptions and properties of IRT models
15. The theory of item response (TRI - IRT) 3: estimation, evaluation of fit, information functions
15.1. Joint estimate of the maximum likelihood
15.2. Goodness of adaptation (fit)
15.3. Information functions and standard errors
16. The theory of item response (TRI - IRT) 4: the construction of tests in TRI
16.1. Test construction according to TRI
16.2. Scoring interpretation
16.3. The item bias and the DIF (differential operation of the items)
17. Use the IRTPRO (Student) software to empirically examine TRI models
17.1. The IRTpro environment, preparation and management of the data file
17.2. Implement the analysis of the TRI logistics models at 1, 2, and 3 parameters and interpret the output, # 1
17.3. Implement the analysis of the TRI logistics models at 1, 2, and 3 parameters and interpret the output, # 2
Part 5. The validity of psychological tests
18. Validity of tests: definitions and types
18.1. Validity as a multidimensional concept
18.2. The validity with respect to the criterion
18.3. Construct validity and nomological validity
19. The empirical study of validity through the analysis of multiple regression
19.1. Simple regression
19.2. Parameter estimation and hypothesis testing
19.3. Multiple regression
20. Use IBM-SPSS software to perform regression analysis
20.1. The "Linear regression analysis" procedure 1: standard regression
20.2. The "Linear regression analysis" procedure 2: hierarchical regression
20.3. The "Linear regression analysis" procedure 3: stepwise regression
Part 6. Psychometric techniques: tests and other measuring instruments
21. The interpretation of psychological texts
21.1. Standards and standardization of psychological tests
21.2. Calibration of psychological tests
21.3. The graphical representation of the test results
22. The measure of intelligence
22.1. What intelligence tests measure:
22.2. The Wechsler scales
22.3. Raven's progressive matrices
23. The measurement of attitudes
23.1. Multiple attitudes and mental abilities
23.2. Psycho-attitudinal batteries
23.3. The measure of mental abilities in the organizational context
24. The measure of personality
24.1. The factorial theories of personality and the Big Five model
24.2. The BFQ-2
24.3. Measure the personality in the clinical context: the MMPI2
25. Projective psychodiagnostic tests
25.1. Brief history, categories and use of projective tests
25.2. The Rorschach test
25.3. Thematic tests
26. Deontological elements and areas of application of psychological tests
26.1. The code of ethics of the Order of Psychologists in relation to the use of psychological tests
26.2. The tests in practice: guidelines for a correct application of the tests
26.3. Use and application fields of psychological tests
Prerequisites
The course requires a good mastery of the fundamentals of psychometry (descriptive statistics, probability, verification of statistical hypotheses).
We strongly recommend that you take the Psychometrics exam (prof. Vecchione) before taking the Psychological Test exam.
Even if there is no "formal" prerequisite, the propedeutical nature is substantial.
Books
1. Barbaranelli C. e Natali E. (2005). I test psicologici: Teorie e Modelli Psicometrici. Carocci, Roma.
(these parts can be skipped: paragraphs 2.12.4, 3.2.2, 3.9.2, 4.1.7., 4.2, 4.3.1, 6.2.2, pages 117, 118, 119);
2. Picone L., Pezzuti L., Ribaudo F. (2017). Teorie e tecniche dei test. Uso e interpretazione. Nuova edizione. Carocci Editore, Roma.
(these parts can be skipped: paragraphs 5.2-5.5 e 12.10; chapter 9; chapter 11);
3. Chiorri C. (2011). Teoria e tecnica psicometrica. McGraw Hill, Milano.
(these parts can be skipped: paragraphs 1.4, 2.2, 5.1)
4.Additional teaching materials (slides, exercises, in-depth lecture notes) that can be downloaded from the e-learning site
Teaching mode
There are 26 video-lessons (Educational Teaching; each lesson corresponds to one of the topics listed in the teaching program).
The lessons are accompanied by interactive activities that include: self-test and feedback quizzes, individual activities, webinars, and guided videotaped exercises for exam preparation.
Experiential path (optional)
It involves the carrying out of online tests divided into 2 parts.
The completion of all the tests, in the times and in the ways provided for by the course, entitles the student to not be able to carry out a part of the exam task, and to 1 bonus point, according to the indications that will be provided in the e-learning page of the teacher, integrating then the final grade with the points obtained with participation in the experiential path.
Students who choose to undertake this path are required to participate in the online experiences proposed by the teacher.
Frequency
To take the exam we strongly recommend that you view the video lessons presented during the course.
Exam mode
The objective of the final exam is to evaluate the knowledge of the subjects being examined, and the ability to apply this knowledge.
The final exam is written and includes:
- multiple choice questions on texts 1, 2 and 3
- calculation exercises on the application of the classical test theory
- open questions on the application of the theory of the response to the item
- An exercise related to the calculation of standardized scores (T) and to the construction of the graphic profile based on the results of a psychological test
- open questions concerning the interpretation of statistical analysis results carried out with SPSS and IRTPRO
The test lasts 60 minutes. The final grade is expressed in thirtieths. The text of the exam assignment returns the value assigned to each question.
Oral integration is provided upon request of the teacher or student. The score may change of 2 points according to the performance.
Bibliography
Theresa J.B. Kline (2005). Psychological Testing A Practical Approach to Design and Evaluation
Deborah L. Bandalos (2018). Measurement Theory and Applications for the Social Sciences
Lesson mode
see elearning.uniroma1.it