Schedule At A Glance
Monday, 28 September
- Morning: Pre-Conference Workshops*
- Afternoon: Welcome Plenary and Paper Sessions
- Evening: Welcome Reception and Poster Session
Tuesday, 29 September
- Morning: Plenary and Paper Sessions
- Afternoon: Plenary and Paper Sessions
- Evening: Conference Dinner — Concert, Tour and Dinner at Catedral da Sé*
Wednesday, 30 September
- Morning: Plenary and Paper Sessions
- Afternoon: Closing Plenary and Paper Sessions
- Evening: Tour in São Paulo (To be defined)*
Thursday-Friday, 1-2 October
- Organized tour in Rio de Janeiro*
*Additional Options
Pre-conference Workshops
Introduction to IRT and CAT
Nathan Thompson (ASC)
AI Applications in Adaptive Testing
Duanli Yan (ETS)
Alina A. von Davier (Duoling)
The Shadow-Test Approach to Adaptive Testing
Seung W. Choi (UT-Austin)
Richard J. Patz (University of California-Berkeley)
Wim J. van der Linden (University of Twente)
Introduction to IRT and CAT
Nathan Thompson (ASC)
New to CAT? This workshop is for you. We will start with an introduction to the CAT algorithm, including item selection, exposure constraints, scoring, and termination rules. We will discuss how this algorithm can be adapted to various approaches, including multistage testing, and how to utilize simulations to design and validate your CAT. Workshop assumes you are familiar with item response theory, and ready to apply it in adaptive testing.
AI Applications in Adaptive Testing
Duanli Yan (ETS)
Alina A. von Davier (Duoling)
In the era of artificial intelligence (AI), the field of educational testing faces significant challenges, particularly in test development and scoring in adaptive assessment, two key innovations include automated item generation (AIG) and automated scoring (AS). Only recently that generative AI has facilitated the development of complex test items on a large scale. We introduce “the item factory”, for managing large-scale test development including automation of item generation, quality review, quality assurance, and crowdsourcing techniques in adaptive testing. We present an overview of the latest natural language processing (NLP) techniques and large language models for AIG, alongside psychometric principles and practices for test development. We discuss the application of engineering principles in designing efficient item production processes (Luecht, 2008; Dede et al, 2018; von Davier, 2017). As AS becomes an integral part of the assessment landscape due to their advantages in reporting time, cost, objectivity, consistency, transparency, and feedback. We aim to demystify AS and provide a comprehensive understanding of its workings. We offer an overview of the design, development, evaluation, and quality control of automated scoring systems, along with practical advice and considerations for practitioners on the applications of these systems into formative and summative assessments (Yan, Rupp, & Foltz, 2020). We will share the most recent AI applications in educational learning and assessment based on our upcoming volume AI for Measurement in Educational Learning and Assessment (von Davier and Yan, 2026).
The Shadow-Test Approach to Adaptive Testing
Seung W. Choi (UT-Austin)
Richard J. Patz (University of California-Berkeley)
Wim J. van der Linden (University of Twente)
It is tempting to think of adaptive testing as a more complicated version of the problem of automated assembly of fixed test forms. But thanks to a simple twist of the latter, the problem is easier to solve, always produces maximum information about the ability of each of the test takers, meets any blueprint in force for the test, and easily generalizes to testing formats with varying degrees of adaptation such as item-level adaptive testing, linear-on-the-fly testing, standard multistage adaptive testing, and multistage testing with adaptive routing tests.
The course has three different parts. In the first part, we explain the ideas underlying the shadow-test approach, discuss a few practical aspects of its implementation, and show some of its generalizations to different test formats. The next two parts are to introduce two software packages available for the implementation of the shadow-test approach to adaptive testing, offering the participants hands-on experience with the R package TestDesign and Optimal CAT, a currently freely downloadable microservice available for easy integration with common test delivery systems.
Participants are expected to bring their own laptops to the course. Handouts will be sent to the participants prior to the conference to prepare for the course and review its content afterwards.
Full Program
The full program will be published as a PDF in August.
