Sep 18 – 19, 2024
Göttingen, Alte Mensa
Europe/Berlin timezone
Call for Abstracts und Anmeldung sind geöffnet! / Call for Abstracts and Registration are open!


🇬🇧 Session 6. Multi-Modal Foundation Models

Sep 19, 2024, 11:45 AM



Chair: Dr. Joachim Köhler (Fraunhofer IAIS, WestAI)
Moderation: Laszlo Friedmann (Fraunhofer IAIS, WestAI)

Content / Abstract:
With the rapid progress in the field of large language models in recent years, the transfer of the un-derlying technology, i.e. foundation models, to new modalities has become one of the most im-portant research topics in artificial intelligence. With the introduction of CLIP at latest, this develop-ment has been extended to multi-modal foundation models which are able to process different types of modalities, such as images or text. Due to their outstanding properties, such as their excellent ze-ro- or few-shot capability, and their ability to process different modalities, multi-modal foundation models offer huge potential across domains and applications. The overall scope of this session is therefore intended to be broad and to cover all topics related to multi-modal foundation models.

Topics of interest include:
- Vision / sound / language / ... models in any possible combination
- Data- and energy-efficient pre-training
- Methodologies for efficient transfer and model compression
- Application to specific domains
- Ethics, risks, and fairness
- Securing private data

Presentation materials

There are no materials yet.
Dr Jenia Jitsev (Forschungszentrum Jülich)
9/19/24, 11:50 AM
Session 6. Multi-Modal Foundation Models
Marianna Nezhurina (Forschungszentrum Jülich)
9/19/24, 12:20 PM
Session 6. Multi-Modal Foundation Models
Building timetable...