Rånäs Castle Photo: Anders Fredriksen
The program committee welcomes you to the Wallenberg Advanced Scientific Forum on the theme Measuring What Matters: Evaluation as a Driver of Multimodal Generative AI.
Deep generative models are advancing the state of the art in artificial intelligence by effectively capturing and recreating complex patterns in high-dimensional, real-world data. Recent breakthroughs in generating text, images, and video have led to the development of new ecosystems and are already making a tangible impact on the world. Applications in other modalities are expected to soon experience similar growth.
However, the evaluation of generative AI systems presents greater challenges compared to traditional machine-learning evaluation, as there is rarely a single correct output. Multimodal generative models introduce additional complexities, requiring assessment of consistency, complementarity, and coherence across different modalities.
This forum will bring together global experts in deep generative modeling—including both problem owners and model developers from industry, academia, and other sectors—across various domains. The goal is to bring about new, effective evaluation methods that will drive future progress in multimodal generative models, alongside practical tools to promote their adoption within the research community.
Date and time
The workshop starts at 12:00 with lunch on September 30th and ends at 12:00 on October 3rd, all at Rånäs Castle, Stockholm.
Workshop structure
The forum is designed to be highly interactive, consisting nearly exclusively of structured and directed discussion in smaller focus groups, rather than panels, talks, or plenaries. To make the most out of the event, we will use the so-called double-diamond framework for structured problem solving. This organises problem solving into two stages, first selecting the right problem(s) to tackle and then finding solutions for these. Each stage has two phases: first divergence (exploring possibilities), then convergence (narrowing down choices). The in-person forum will also be preceded by one or two short online workshops to kickstart the discussion before we meet up on site.
Program committee
Jonas Beskow, Professor, Division of speech, music and hearing, KTH Royal Institute of Technology in Stockholm, Sweden
Desmond Elliott, Associate Professor, Department of Computing Science, University of Copenhagen, Denmark
Johanna Björklund, Docent and Associate professor at Department of Computing Science at Umeå University, Sweden
Gustav Eje Henter, Docent and Assistant professor, Division of speech, music and hearing, KTH Royal Institute of Technology in Stockholm, Sweden
Erica Cooper, PhD and Senior Researcher at National Institute of Information and Communications Technology, Japan
Accomodation
A single room is booked for each participant. Guaranteed check-in time is 15:00 at the day of your arrival and check-out is 9:00 on the day of your departure.
Transportation
WASP offers transfer by bus on Tuesday and on Friday between Arlanda Airport and Rånäs Castle. You will receive more information further on.