Translated Instruments: Coverage at the cost of Equity?

Translated Instruments: Coverage at the cost of Equity?

Wednesday | May 5, 2021

12 pm EDT (New York) | 5 pm BST (London) | 6 pm CEST (Brussels)

Join us on May 5 for a one-hour online panel moderated by Steve Dept, founder of cApStAn and expert on linguistic quality assurance in surveys and assessments.

Standardized tests and questionnaires are used in a variety of contexts: admission to university, certification, hiring, or collecting information about background variables, for example. Tests and surveys may come in more than one language. While this broadens the coverage, it may create disparities if the different language versions are not equivalent.

What can be done, what should be done? What is the role of translated instruments in accredited programmes? Can we measure equivalence between different language versions of a test or questionnaire? Does a team translation approach produce reliable results?

Steve Dept will host an online panel to delve into these issues with three eminent guests:

Dr Avi Allalouf, Deputy Director and Director of Scoring & Equating at NITE (Israel)

Dr Dorothée Behr, translation scholar and senior survey methodologist at GESIS – Leibniz Institute for the Social Sciences (Germany)

Dr Joy Matthews-López, senior psychometrician and President of JML Measurement and Testing Services (US), with a wealth of experience in test development and translation


About Panelists

Dr Dorothée Behr, Senior Survey Methodologist at GESIS – Leibniz Institute for the Social Sciences

Dorothée Behr is a translation scholar and a senior survey methodologist at GESIS – Leibniz Institute for the Social Sciences (Mannheim, Germany), where she also heads the team ‘Cross-Cultural Survey Methods’ in the department ‘Survey Design and Methodology’. She has a doctorate in applied translation studies (topic: questionnaire translation) from the University of Mainz. Her research and services (consultancy, training, and project involvement) focus on questionnaire translation as well as comparability of cross-national survey data, as assessed through web probing. Major large-scale projects include PIAAC Cycle 1 and 2. She is also a member of the Translation Expert Panel of the ESS.

Dr Joy Matthews-López, senior psychometrician and President of JML Measurement and Testing Services

Joy is the founder of JML Measurement and Testing Services. She holds a Master of Science in applied mathematics and statistics from NC State University and a PhD in Educational Research and Evaluation from Ohio University. Prior to founding JML-MATS, Joy served as research fellow at the Ball Foundation, measurement psychometrician at Educational Testing Service, CORE Research Director at Ohio University, psychometric supervisor at Prometric, and senior psychometrician at the National Association of Boards of Pharmacy. Joy’s primary practice setting is licensure and certification; her areas of expertise include test adaptation, exam security, and standard setting.

Joy is a contributing author of International Certification, ICE Handbook (3rd ed) and is the 2021 Chair of the National Commission for Certifying Agencies.

Avi_Allalouf NITE

Dr Avi Allalouf, Deputy Director and Director of Scoring & Equating at NITE

Dr Allalouf is Deputy Director as well as the Director of Scoring & Equating at NITE. He is responsible for external coordination, operation of assessment centers, and the NITE research fund. In addition, he oversee the process of scoring, equating and score reporting of tests administered by NITE – including the Psychometric Entrance Test (PET) – to institutions of higher education and to examinees.  Dr Allalouf have served as the president of the Israeli Psychometric Association and as co-editor of the International Journal of Testing (IJT). He is currently head of the Certification Studies in Psychometrics Program at NITE. His areas of research include: scoring & equating, quality control, differential item functioning (DIF), test adaptation to multiple languages, and the impact of testing on society.

Steve Dept cApStAn

Steve Dept, CEO & Founder

Steve is one of cApStAn’s founders. He received his education in English, Dutch, French and German but he is essentially an autodidact and a field practitioner. In 1998, Steve was sought out to organise the translation verification of PISA 2000 instruments and, since cApStAn’s creation in 2000, Steve has supervised linguistic quality assurance in PISA and in over 35 international surveys and polls. His translatability assessment methodology is applied in small and large multilingual projects in both the private and the public sector. Steve is the driving force behind cApStAn’s adaptive strategy.