1. médialab Sciences Po
  2. News
  3. The Politics of Machine Learning Evaluation: From Present to Future

The Politics of Machine Learning Evaluation: From Present to Future

The medialab welcomes Anna Schjøtt Hansen and Dieuwertje Luitse for the next seminar session on June 3rd, 2025. They will give an opening presentation on the politics of machine learning evaluation, before a collective discussion on a coming issue of the Digital Society journal devoted to the same topic.

Event, Research Seminar

⇥

Salle K.011, 1 place Saint Thomas d'Aquin 75007 Paris

Abstract

Is the data good enough for training purposes? Does the model perform accurately enough? Is the error rate low enough? Such questions of ‘good enough’ are at the very core of the process of Machine Learning (ML) evaluation and can also be considered a highly political process in the development of ML systems. There is already a growing interest in the political implications of ML in relation to, for example, dataset construction and the political capacities of specific ML models or foundational algorithmic techniques. However, there has been less focus on the politics of evaluation practices and techniques in ML.

In this talk, we trace how ML evaluation has been studied and conceptualised within the fields Critical AI Studies and Science and Technology Studies (STS). Particularly we highlight a shift from research of scientific ML evaluation in the ‘lab’ to increasingly industrial forms of evaluation across societal domains.

In extension, we celebrate the coming launch of the Topical Collection ‘The Politics of ML Evaluation’ in Digital Society, edited together with Tobias Blanke and with several contributions from Sciences Po medialab. We use these contributions to exemplify emerging approaches and understandings of the politics and implications of ML evaluation. These approaches illustrate the need for more historical awareness, attention towards wider attempts of standardised evaluation infrastructures, and situated accounts of ML evaluation in practice.

Biography

Anna Schjøtt Hansen is a technological anthropologist and PhD Candidate in the Media Studies Department at the University of Amsterdam. In her PhD research, she ethnographically explores how knowledge around Artificial intelligence (AI) is being produced and intervened upon across different media related sites, including industry wide initiatives supporting AI in journalism, in-house development of AI at the BBC and within the Media Museum in Amsterdam. In doing so, she aims to critically examine the politics of knowledge production and its implications for the media sector. She is a member of the AI, Media & Democracy Lab and the Cultural AI Lab. Furthermore, she co-organises the online lecture series Critical AI Studies Seminar series and is currently co-editing the topical collection on the Politics of Machine Learning Evaluation in Digital Society.

Dieuwertje Luitse is PhD Candidate in the Department of Media Studies at the University of Amsterdam (UvA). Her research explores the ethics, politics and power of data, artificial intelligence (AI) system and application development in healthcare. This project is part of the UvA’s interdisciplinary research priority area on AI for Health decision-making that brings together researchers from Computer Science, Medicine, Law and the Humanities. In addition, her research interest focuses on the study of computational infrastructures and the (historical) development of AI systems in relation to their socio-economic and political implications.In line with her research activities, Dieuwertje is the co-organiser of the Critical AI Seminar Series hosted by the Critical Data and AI research group at UvA’s Faculty of Humanities and one of the co-editors of the topical collection on the Politics of Machine Learning Evaluation in Digital Society.

Practical information

This seminar will take place both online and in person on Tuesday, June 3rd, from 2:00 PM to 4:00 PM, in room K.011, 1 Place Saint-Thomas d'Aquin (75007).

 Registration is mandatory via this link.