KonKIS 24 - Konferenz der deutschen KI-Servicezentren 2024 (Conference of the German AI Service Centers 2024)

18 Sept 2024, 11:00 → 19 Sept 2024, 21:05 Europe/Berlin

Göttingen, Alte Mensa

Dr. Tina Klüwer, BMBF: „Mit der Förderung der Servicezentren durch das BMBF wird das deutsche KI-Ökosystem um einen wichtigen Baustein erweitert. Die Zentren sichern den Zugang zu Recheninfrastruktur und KI-Expertise und erleichtern durch niederschwellige Angebote den Transfer von KI. Gleichzeitig soll mit den Servicezentren „KI Made in Germany“ fest etabliert und eine Marke mit internationaler Strahlkraft geprägt werden. Ein wichtiger Schlüssel ist der gemeinsame Austausch mit den Anwendern. Die KonKIS bietet dazu eine wunderbare Plattform.“

Wir freuen uns, mit der KonKIS 24 in Göttingen die erste Konferenz der deutschen KI-Servicezentren auszurichten!

🇬🇧 Find English below!

Zielgruppe

Die Konferenz richtet sich an Interessierte aus Wissenschaft und Industrie, insbesondere auch aus kleinen und mittleren Unternehmen mit Bedarf an Rechenleistung und KI-Expertise. 

Das erwartet Sie

• Spannende Keynote-Vorträge zu den Bereichen KI & Gesellschaft, KI & Gesundheitswesen, KI & Energiewirtschaft
• Podiumsdiskussionen mit Expert:innen aus Forschung, Wirtschaft und Politik
• Sessions und Postersession mit der Möglichkeit, eigene Beiträge einzureichen
• Vorstellung der vier deutschen KI-Servicezentren
• Austausch und Vernetzung mit Multiplikatoren und Start-ups
• Erfolgsgeschichten und Demonstratoren
• Führungen durch das Rechenzentrum der GWDG (Gesellschaft für wissenschaftliche Datenverarbeitung mbH Göttingen)
• Diesjähriger Schwerpunkt: KI in Gesundheitswesen und Energiewirtschaft

Schwerpunkt: KISSKI Symposium 2024 - Advancing Secure AI in Critical Infrastructures for Health and Energy

• Ausgerichtet vom KI Servicezentrum für sensible und kritische Infrastrukturen KISSKI
• Keynote-Vorträge von Expertinnen aus den Bereichen "KI & Gesellschaft", "KI & Energie" und "KI & Gesundheitswesen"
  • Prof. Dr. Judith Simon (Universität Hamburg)
  • Prof. Dr. Astrid Nieße (Universität Oldenburg)
  • Prof. Dr. Anne-Laure Boulesteix (LMU München)
• Podiumsdiskussionen zu KI in Gesundheitswesen und Energie mit Expert:innen aus Forschung, Wirtschaft und Politik
• Sessions zu Themen rund um KI-Anwendungen in Gesundheitswesen und Energie mit der Möglichkeit, eigene Vorträge einzureichen
• Postersession mit der Möglichkeit, eigene Poster zu präsentieren
• Workshops zu relevanten KI-Themen rund um die in KISSKI angebotenen Services
• Insbesondere gerichtet an
  • Forschende aus den Bereichen Medizin / Gesundheitswesen, Energie
  • Nutzende von KI-Methoden im Bereich Medizin / Gesundheitswesen, Energie
  • Nutzende des KISSKI sowie an KISSKI Interessierte

Sprache

Eröffnung, Keynotes, Podiumsdiskussionen und die Führungen durch das Rechenzentrum sind auf Deutsch, Sessions und Workshops auf Englisch. Im Programm sind alle Punkte mit entsprechenden Länderflaggen gekennzeichnet.     

Ausrichtende Einrichtungen: Was verbirgt sich unter "KI made in Germany"?

Das Bundesministerium für Bildung und Forschung (BMBF) fördert seit November 2022 vier KI-Servicezentren. Hauptanliegen dieser Zentren ist es, KI-Expertise und eine leistungsstarke, auf KI-Anwendungen ausgerichtete Infrastruktur zu bündeln und Nutzende aus Wissenschaft und Wirtschaft beim Transfer von KI in die Praxis zu unterstützen.

 

+++ Die Anmeldung zur Teilnahme finden Sie hier. +++

 

🇬🇧 English 🇬🇧

+++ Here you can register for participation. +++

We are proud to host KonKIS 24 in Göttingen, the first conference of the German AI service centres

Target group

The conference is aimed at interested persons from science and industry, especially from small and medium-sized companies, with a need for computing power and AI expertise.

What to expect

• Exciting keynote talks on the areas of AI & society, AI & healthcare, AI & energy industry
• Panel discussions with experts from research, business and politics
• Sessions and poster session with the opportunity to submit your own contributions
• Presentation of the four German AI service centres
• Exchange and networking with multipliers and start-ups
• Success stories and demonstrators
• Guided tours of the computing centre of the GWDG (Gesellschaft für wissenschaftliche Datenverarbeitung mbH Göttingen)
• This year's focus: AI in healthcare and the energy industry

Focus: KISSKI Symposium 2024 - Advancing Secure AI in Critical Infrastructures for Health and Energy

• Hosted by the AI Service Centre for Sensitive and Critical Infrastructures KISSKI
• Keynote talks by experts from the fields of "AI & Society", "AI & Energy" and "AI & Healthcare"     
  Keynote speakers: Prof Dr Judith Simon (University of Hamburg), Prof Dr Astrid Nieße (University of Oldenburg), Prof Dr Anne-Laure Boulesteix (LMU Munich)
• Panel discussions on AI in healthcare and energy with experts from research, business and politics
• Sessions on topics related to AI applications in healthcare and energy with the opportunity to submit your own presentations
• Poster session with the opportunity to present your own posters
• Workshops on relevant AI topics related to the services offered in KISSKI
• Especially aimed at
  • Researchers from the fields of medicine / healthcare, energy
  • Users of AI methods in the fields of medicine / healthcare and energy
  • KISSKI users and anyone interested in KISSKI

Language

The opening, keynotes, panel discussions and guided tours of the data centre are in German, sessions and workshop in English. All items in the programme are marked with the corresponding country flags.

Organising institutions: What is "AI made in Germany"?

The Federal Ministry of Education and Research (BMBF) is funding four AI service centres since November 2022. The main goal of these centres is to pool AI expertise and a high-performance infrastructure geared towards AI applications and to support users from science and industry in the transfer of AI into practice.

+++ Here you can register for participation. +++

Wednesday, 18 September

11:00 Registrierung, Mittagssnack / Registration, Lunch

Registrierung: unteres Foyer, Mittagssnack: oberes Foyer
Registration: lower foyer, lunch: upper foyer

🇩🇪 Eröffnung / Opening Session

1 🇩🇪 Begrüßung

Speaker: Prof. Julian Kunkel (GWDG / Georg-August-Universität Göttingen)

2 🇩🇪 Grußwort

Speaker: Prof. Metin Tolan (Georg-August-Universität Göttingen)

3 🇩🇪 Grußwort

Speaker: Prof. Volker Epping (Leibniz Universität Hannover)

4 🇩🇪 Impulsvortrag Ministerium

Über die Sprecherin

Seit Dezember 2023 ist Dr. Tina Klüwer Leiterin der Abteilung 5 „Forschung für technologische Souveränität und Innovationen“ im Bundesministerium für Bildung und Forschung.
Zuvor leitete sie als Direktorin das K.I.E.Z. – das Künstliche Intelligenz Entrepreneurship Zentrum. K.I.E.Z. ist eine Initiative von Science & Startups, dem Verbund der Startup Services der Berliner Universitäten und der Charité Universitätsmedizin. Vor dem Start von K.I.E.Z. war Frau Klüwer Gründerin und Geschäftsführerin der parlamind GmbH, einem Unternehmen für Automatisierung im Kundenservice mittels Künstlicher Intelligenz und Sprachverarbeitung.
Sie war als Wissenschaftlerin 10 Jahre am Deutschen Forschungszentrum für Künstliche Intelligenz (DFKI) und verschiedenen Universitäten tätig und promovierte in Computerlinguistik an der Universität des Saarlandes.
Dr. Tina Klüwer ist eine anerkannte Expertin, Managerin und technische Botschafterin für das Thema Künstliche Intelligenz und dessen Umsetzung in der Wirtschaft.

Speaker: Dr Tina Klüwer (Bundesministerium für Bildung und Forschung)

5 🇩🇪 Impulsvortrag Wirtschaft

Speaker: NN (Sartorius)

6 🇩🇪 Keynote KI & Gesellschaft

Über die Sprecherin
Judith Simon ist Professorin für Ethik in der Informationstechnologie an der Universität Hamburg. Sie beschäftigt sich mit der Verschränkung ethischer, erkenntnistheoretischer und politischer Fragen im Kontext von Big Data, Künstlicher Intelligenz und Digitalisierung im Allgemeinen. Judith Simon ist Mitglied des Deutschen Ethikrates, sowie verschiedener anderer Gremien für wissenschaftliche Politikberatung. Sie war Mitglied der Datenethikkommission der Bundesregierung (2018-2019).

Speaker: Prof. Judith Simon (Universität Hamburg)

14:00 Pause / Break

Oberes Foyer / Upper Foyer

🇩🇪 Rechenzentrum / Computing Center: Führung 1 / Guided Tour 1

Führung durch das Rechenzentrum der Gesellschaft für Wissenschaftliche Datenverarbeitung Göttingen (GWDG) . Gewinnen Sie einen Einblick in den HPC-/ Technikbereich und erfahren Sie, wo Ihre Daten verarbeitet werden, wenn Sie das KI Servicezentrum für sensible und kritische Infrastrukturen KISSKI nutzen.

Die angegebenen Zeiten beziehen sich auf Abfahrt und Rückkunft vor dem Tagungsgebäude. Wir bieten einen Shuttleservice mit 2 Kleinbussen. Bitte finden Sie sich kurz vor der Abfahrszeit pünktlich vor dem Gebäude ein. Die Fahrer:innen können nicht warten.

Die Plätze sind liminiert. Wenn Sie teilnehmen wollen, buchen Sie die kostenpflichtige Führung bei der Anmeldung zur Konferenz.

Weitere Details hier.

🇩🇪 Keynote Energie

Über die Sprecherin
Prof. Dr.-Ing. Astrid Nieße ist seit 2020 Professorin für Digitalisierte Energiesysteme an der Universität Oldenburg und Mitglied im Bereichsvorstand Energie des OFFIS - Institut für Informatik. Ihr Forschungsschwerpunkt liegt in der Anwendung von informatischen Methoden auf Fragestellungen multimodaler Energiesysteme mit einem Fokus auf Methoden der verteilten künstlichen Intelligenz. Fragestellungen in diesem Kontext betreffen zum Beispiel die agentenbasierte Kontrolle von dezentralen Energieanlagen, selbstorganisierende Systeme, Flexibilitätsmodellierung sowie die sogenannte FAIRification von Forschungsdaten inklusive Forschungssoftware.

Convener: Prof. Astrid Nieße (Carl von Ossietzky Universität Oldenburg)

7 🇩🇪 Keynote Energie

Über die Sprecherin
Prof. Dr.-Ing. Astrid Nieße ist seit 2020 Professorin für Digitalisierte Energiesysteme an der Universität Oldenburg und Mitglied im Bereichsvorstand Energie des OFFIS - Institut für Informatik. Ihr Forschungsschwerpunkt liegt in der Anwendung von informatischen Methoden auf Fragestellungen multimodaler Energiesysteme mit einem Fokus auf Methoden der verteilten künstlichen Intelligenz. Fragestellungen in diesem Kontext sind etwa die agentenbasierten Kontrolle von dezentralen Energieanlagen, agentenbasierte Simulation, Flexibilitätsmodellierung, Methoden der Datenanalyse sowie der Analyse der Resilienz verteilter Energiesysteme.

Speaker: Prof. Astrid Nieße (Carl von Ossietzky Universität Oldenburg)

🇬🇧 Workshop 1. Explainable Artificial Intelligence (XAI) in Clinical Decision Support Systems

Instructors: Jun.-Prof. Dr. Anne-Christin Hauschild, Dr. Zully Ritter (both KISSKI / University Medical Center Göttingen UMG)

Agenda:

• Lecture, 30 min
  • Trustworthiness of AI for Clinical Decision Support (CDS) 
  • Introduction to XAI Methods 
  • XAI for CDS 
  • Current Developments on XAI
• Break, 15 min
• Hands-on, 120 min:
  • 3 Jupyter labs will be provided for understanding and working the concepts learned in the lecture
  • Jupyter labs:
    (i) ML (setup),
    (ii) ML and exercises on XAI (using an example),
    (iii) complete pipeline for XAI (using an example)
• Discussion, 15 min

Max. number of participants: 20

Conveners: Prof. Anne-Christin Hauschild (Universitätsmedizin Göttingen), Dr Zully Ritter (Universitätsmedizin Göttingen)

🇩🇪 Podiumsdiskussion "Künstliche Intelligenz: Turbo für Innovationen im Energiesystem"

Über die Mitglieder des Podiums

Moderation: Reinhard Mackensen (Fraunhofer IEE Kassel)

Astrid Nieße (Universität Oldenburg)
Prof. Dr.-Ing. Astrid Nieße ist seit 2020 Professorin für Digitalisierte Energiesysteme an der Universität Oldenburg und Mitglied im Bereichsvorstand Energie des OFFIS - Institut für Informatik. Ihr Forschungsschwerpunkt liegt in der Anwendung von informatischen Methoden auf Fragestellungen multimodaler Energiesysteme mit einem Fokus auf Methoden der verteilten künstlichen Intelligenz. Fragestellungen in diesem Kontext betreffen zum Beispiel die agentenbasierte Kontrolle von dezentralen Energieanlagen, selbstorganisierende Systeme, Flexibilitätsmodellierung sowie die sogenannte FAIRification von Forschungsdaten inklusive Forschungssoftware.

Philipp Richard (dena Deutsche Energie-Agentur)
Philipp Richard leitet den Bereich Digitale Technologien und Start-up Ökosystem (DTS) in der Deutschen Energie-Agentur (dena). Mit seinem Team verantwortet er die Bearbeitung von Grundsatzfragen für eine nachhaltige Digitalisierung des Energiesystems und möchte das Potenzial von Tech-Start-ups für die Energiewende heben. Schwerpunktsetzung sind dabei u. a. der Einsatz von neuen digitalen Technologien wie Blockchain und künstliche Intelligenz.

Marc Stanke (DB Systel)
Dr. Marc Stanke ist Teil des Enterprise Business Management Teams der DB Systel in Frankfurt am Main. Er kommt aus der der Regelung und Steuerung komplexer biotechnologischer Systeme mit Künstliche Intelligenzen und Vorhersagemodellen und hat langjährige Erfahrung in den Bereichen BI, Analytics & Process Mining. Sein Schwerpunkt liegt jetzt auf der Orchestrierung der internen IT und der Etablierung von effektiven, automatisierbaren und wertschaffenden Governance Systemen.

Tanja Utescher-Dabitz (BDEW Bundesverband der Energie- und Wasserwirtschaft)
Die Diplom-Kauffrau und Steuerberaterin Dr. Tanja Utescher-Dabitz ist als Fachgebietsleiterin Steuern und Abgaben beim BDEW (Bundesverband der Energie- und Wasserwirtschaft e.V). in Berlin tätig. Dort ist sie u.a. verantwortlich für betriebswirtschaftliche Fragen und die digitale Transformation.

Conveners: Prof. Astrid Nieße (Carl von Ossietzky Universität Oldenburg), Dr Marc Stanke (DB Systel), Philipp Richard (Deutsche Energie-Agentur), Dr Reinhard Mackensen (Fraunhofer IEE Kassel), Dr Tanja Utescher-Dabitz (Bundesverband der Energie- und Wasserwirtschaft)

🇬🇧 Session 1: AutoML: Efficient Development of new AI Applications

Chair: Prof. Dr. Marius Lindauer (LUH)

• 30min: (20+10) tutorial on the basics of AutoML and how it can support developers in more efficient development of AI applications
• 30min: hands-on tutorial with a Jupyter Notebook showing how to run AutoML in practice
• 30min: Short spotlight talks (5+5) about AutoML projects

🇬🇧 Session 2. Using and Integrating Health Data

Chair: Hendrik Nolte (GWDG), James Bowden (UMG), Dr. Nicolai Spicher (UMG)

Content/Abstract:
This session focusses on the integration and processing of health data. We are looking for talks from various related topics which explore the various challenges and some employed solutions for integrating or processing health data.

Topics of interest include:
- Integration process of health data with the use of research data management systems (e.g. XNAT, ORTHANC, the Leibniz Data Manager, or a broader data lake)
- Security and legal aspects (e.g. encryption, anonymization, access control, AAI, pseudonymization, patient consent, enforcing the correct processing of patient consent revocations)
- How can researchers actually make use of these integrated data sets, (e.g. example use cases when working with XNAT, data stored in the BIDS format, or any other use cases where cross-data source, or cross domain data is processed)
- Challenges concering processing and scalability

8 Towards Integrated Data Management and Automated Analysis of Multi-Omics Datasets in Engineered Human Myocardium

Engineered human myocardium (EHMs) provides unique opportunity for modeling cardiac development, disease, and drug testing. EHMs, derived from stem cells and cultured over extended periods, closely mimic the structure and function of matured cardiac tissue. This cardiac 3D model offers an innovative platform for exploring cardiac biology and developing novel therapeutic strategies.
A critical aspect of our research is the integration and automated analysis of multi-omics datasets to elucidate the complex biological processes involved in EHM development, maturation, and response to pharmacological agents. Over a one-year culture period, EHMs are subjected to extensive multi-omics profiling, including proteomics, transcriptomics, and protein turnover studies. High-resolution imaging with SarcAsM, an AI tool, provides detailed structural analysis of sarcomeres, the fundamental contractile units of muscle tissue. Functional performance is regularly assessed using CardioTraceAnalyzer, an AI-driven tool for analyzing time-series data of tissue contractions.
The integration of these diverse data types presents significant challenges. To address this, we are implementing a Data Lake approach in collaboration with the Gesellschaft für wissenschaftliche Datenverarbeitung Göttingen (GWDG). This strategy ensures that multi-modal data will be accessible, organized, and ready for advanced computational analysis. By centralizing data storage and management, we facilitate seamless data integration, enabling robust cross-disciplinary collaboration and deeper insights into cardiac organoid biology.
Automated analysis pipelines will be established to process and interpret complex datasets efficiently. These pipelines utilize machine learning algorithms to uncover patterns and correlations within the multi-omics data, driving novel insights into cardiac development and disease mechanisms. Our integrated approach not only advances the understanding of EHM morphogenesis and maturation but also sets a precedent for utilizing large-scale, multi-omics datasets in drug testing and disease modeling. By fostering collaboration with data scientists and leveraging automated analytical techniques, we aim to accelerate the development of innovative treatments for cardiac diseases, ultimately contributing to improved patient outcomes.

Speaker: Gesine Marie Dittrich (University Medical Center Goettingen)

9 The Leibniz Data Manager - a semantically-driven data catalog

Research Data Management encompasses the systematic organization, storage, preservation, publication and re-use of data throughout a research project's lifecycle. It aims to ensure effective handling, maintenance, and accessibility of data, promoting reproducibility, transparency, and integrity in scientific research. The surge in digital research data led to the need for standardized practices which are already widely in use in the health domain.
Within the KISSKI Service Centre, the Leibniz Data Manager (LDM) will provide a semantically-driven data catalog which ensures data transparency and privacy protection while enabling data exchange within the respective research groups and scientific communities. The data catalog is developed at TIB – Leibniz Centre of Science and Technology. To enable shared data from two domains (i.e., health and energy), the LDM resorts to semantic integration using ontologies and standards to transform research, clinical, genomic, and scientific data into semantically rich factual statements. Digital research objects (e.g., data benchmarks) are available following the FAIR data principles. Because strict data access policies regulate health data (e.g., clinical and genomic data), two customized instances of the LDM are deployed representing both, an open data and a closed data system. While the public instance will support the publication and exchange of non-sensitive, anonymized data, the second instance will include a privacy-aware query engine and high security standards provided by partners at GWDG ensuring compliance with data access regulations. For future data use, aka AI-ready data, project partners will define domain-specific ontologies to establish a common understanding of the included medical datasets.

Speaker: Dr Angelina Kraft (Technische Informationsbibliothek)

10 FAIR ECG Data processing: From raw data to automated results

Physiological measurements are permanently acquired in daily clinical practice to aid medical staff in decision making.Electrocardiography (ECG) is one of the most commonly used measurements and represents the physiological activity of the heart. It is widely used in emergency care as well as prevention and in clinical studies. Therefore, it offers large potential for data-driven research, e.g. machine learning for disease prediction in acure care or risk assessment for chronic diseases.

However, the collected data is often stored in proprietary devices or printed on paper which limits its potential for advanced analysis methods. Moreover, this propreritary nature leads to negative effect w.r.t. open science: Algorithms are oftentimes written once for a specific research project and are dependent on the data formats used, making them non-reusable.

To overcome these limitations, we aim to develop an interoperable architecture in the framework of the BMBF-funded ACRIBiS project (Advancing Cardiovascular Risk Identification with Structured Clinical Documentation and Biosignal Derived Phenotypes Synthesis). Our goal is to store and exchange ECG data in a findable, accessible, interoperable, and reusable (FAIR) manner. Moreover, we aim for standardized access, selection, filtering, rights management, and user management, enabling scalable use in clinical studies.

As an initial implementation, the objective is to process signal analysis on ECGs stored in a FAIR manner via the AcuWave Software Suite. We evaluated multiple open source solutions for storing our DICOM ECGs. We initially employed Orthanc, which provides access to the ECGs via its Representational State Transfer - Application Programming Interface. This was utilized to construct a pipeline that can load the ECGs into AcuWave, however, we encountered performance and administrative issues. Consequently, a transition to XNAT is being considered as a potential solution to address these challenges. Within AcuWave, the ECGs are processed in a standardised and modular manner, following a pipeline approach. This architecture will be demonstrated, along with the potential benefits of its automation for research.

Speaker: Lennart Graf (Institut für Medizinische Informatik, Universitätsmedizin Göttingen)

11 Improving Cardiovascular Health through AI-based Analysis of Genetic Risk Factors

Cardiovascular diseases (CVDs) represent a global health challenge, causing approximately 17.9 million deaths worldwide in 2019, including 158,359 deaths in Germany. Traditional risk stratification methods focusing on age, blood pressure, and cholesterol levels often result in inaccurate risk assessments. The goal of stratification is to enable more precise and individualized diagnoses, prognoses, and therapies. By identifying specific subgroups within a broader patient population, medical research can develop targeted and effective treatment strategies tailored to the unique needs of these subgroups in the context of personalized medicine.
The landscape of personalized medicine, particularly concerning CVDs, has advanced rapidly due to progress in genomics, data analysis, and artificial intelligence (AI). Incorporating non-traditional risk factors, such as genetic information, into clinical practice has the potential to enhance risk prediction accuracy and treatment stratification, significantly aiding in the prevention of complex diseases. For instance, coronary artery disease (CAD), a prevalent CVD, is influenced by multiple genetic variants (alleles) across the genome. The ApoE gene, which encodes the apolipoprotein E protein, plays a critical role in lipid metabolism and is linked to both neurodegenerative and cardiovascular diseases. The ApoE ε4 allele significantly increases the risk of Alzheimer's and CVDs, including CAD. Early identification of individuals with these genetic markers can lead to proactive cholesterol management, substantially reducing the risk of developing CAD.
Polygenic Risk Scores (PRS), which aggregate the effects of numerous small genetic variations, have shown promise for personalized risk prediction. PRS can be particularly useful for individuals with a family history or genetic predisposition to CVDs. Although PRS are still in the research phase for CVDs, growing studies demonstrate their utility in risk prediction, sparking interest in their clinical application. However, challenges related to data privacy and access to sensitive data persist. The transfer of genomic data from patients to physicians is heavily regulated by privacy laws such as the GDPR and the EU's AI Act.
This research proposes a patient-centered approach that ensures the confidentiality of individual genomic data. Genetic risk factors will be analyzed using AI to enhance risk prediction and treatment stratification, supporting personalized cardiovascular medicine. The goal is to implement personalized risk prediction and treatment stratification for CVDs through AI-based analysis of genetic risk factors, embedded in a patient-centered approach that guarantees data confidentiality.
The envisioned approach involves two modules. The patient module, a client-side software on the patient's smartphone, enables local storage of genomic data and local calculation of CVD risk without transmitting genomic data to cloud providers. Patients can select body organs and send risk analysis results to a chosen physician. The analysis identifies potential disease traits and calculates individual PRS, with results condensed by an AI algorithm. Medical results are not displayed to patients but are interpreted by physicians. The physician module allows physicians to access and visualize results, along with summaries of relevant scientific publications. A language model derived from existing open-source large language models will generate controlled summaries, aiding physicians in personalized diagnoses. This approach paves the way for tailored cardiovascular medicine, where data privacy and ethics play central roles. The resulting decentralized, AI-based platform for personalized genomic health services, exemplified by heart diseases, contrasts with traditional cloud-based methods by empowering patients with data control while enabling personalized medicine based on genomic data, expected to enhance patient trust in personalized medical services.

Speaker: Prof. Wolfgang Maaß

12 GUIDE-IT: Building a medical imaging data sharing platform with XNAT

Randomized controlled trials (RCTs) are the gold standard for evaluating the efficacy and safety of new medical interventions, including medical imaging technologies that are essential for diagnosis and treatment. The integrity and reliability of RCT results depend heavily on the quality and quantity of data collected. Imaging RCTs have the potential to transform patient care, both in their primary analysis and in subsequent reuse of the imaging and clinical data for secondary analyses. In recent years, there has been a growing recognition of the importance of data sharing. Data sharing plays a critical role in advancing the field of medical imaging by fostering collaboration, transparency, accelerating scientific discoveries and improving patient outcomes. Access to diverse datasets from multiple studies allows researchers to perform large-scale analyses, identify patterns, and uncover new insights that may not be apparent from individual studies. This collaborative approach is driving advances in medical imaging research.

To this end, in the GUIDE-IT project, we have developed a first prototype of a clinical imaging trials data sharing platform. Using XNAT we provide a platform with fine-grained access control, automated quality control and data processing capabilities. We have evaluated the platform using data from two large coronary imaging RCTs, DISCHARGE and SCOT-HEART.

Speaker: James Philip Bowden (UKEI)

🇩🇪 Rechenzentrum / Computing Center: Führung 3 / Guided Tour 3

Führung durch das Rechenzentrum der Gesellschaft für Wissenschaftliche Datenverarbeitung Göttingen (GWDG) . Gewinnen Sie einen Einblick in den HPC-/ Technikbereich und erfahren Sie, wo Ihre Daten verarbeitet werden, wenn Sie das KI Servicezentrum für sensible und kritische Infrastrukturen KISSKI nutzen.

Die angegebenen Zeiten beziehen sich auf Abfahrt und Rückkunft vor dem Tagungsgebäude. Wir bieten einen Shuttleservice mit 2 Kleinbussen. Bitte finden Sie sich kurz vor der Abfahrszeit pünktlich vor dem Gebäude ein. Die Fahrer:innen können nicht warten.

Die Plätze sind liminiert. Wenn Sie teilnehmen wollen, buchen Sie die kostenpflichtige Führung bei der Anmeldung zur Konferenz.

Weitere Details hier.

16:50 Getränke / Drinks

unteres Foyer

🇬🇧 🇩🇪 Postersession

🇬🇧 🇩🇪 Postersession

🇩🇪 Rechenzentrum / Computing Center: Führung 3 / Guided Tour 3

Führung durch das Rechenzentrum der Gesellschaft für Wissenschaftliche Datenverarbeitung Göttingen (GWDG) . Gewinnen Sie einen Einblick in den HPC-/ Technikbereich und erfahren Sie, wo Ihre Daten verarbeitet werden, wenn Sie das KI Servicezentrum für sensible und kritische Infrastrukturen KISSKI nutzen.

Die angegebenen Zeiten beziehen sich auf Abfahrt und Rückkunft vor dem Tagungsgebäude. Wir bieten einen Shuttleservice mit 2 Kleinbussen. Bitte finden Sie sich kurz vor der Abfahrszeit pünktlich vor dem Gebäude ein. Die Fahrer:innen können nicht warten.

Die Plätze sind liminiert. Wenn Sie teilnehmen wollen, buchen Sie die kostenpflichtige Führung bei der Anmeldung zur Konferenz.

Weitere Details hier.

18:20 Stehempfang, Get-Together / Stand-up Reception, Get-Together

Oberes Foyer / upper foyer, Adam-von-Trott-Saal

Thursday, 19 September

🇬🇧 Workshop 2. Generative Artificial Intelligence in the Energy Sector

Instuctors: André Baier, Dominik Beinert, Dr. Bastian Schäfermeier (all KISSKI / Frauenhofer IEE Kassel), Dr. Dajan Mimic (KISSKI / University of Hannover LUH)

Abstract: The release of Chat GPT has brought generative artificial intelligence to the forefront of public attention. Identifying the most suitable technologies, tools, and solutions in the current overwhelming dynamic of development can be challenging. This workshop aims to offer guidance and provide participants with the opportunity to collaboratively identify and discuss potential use cases of generative artificial intelligence in the energy sector.
Goal: Interdisciplinary assessment of the potential of generative AI in the energy industry.
Result: Prioritized list of use cases for generative AI in the energy sector

Agenda:

• Input session (1 hour)

  • Introduction to generative AI methodologies (Schäfermeier)
  • Current use cases of generative AI in the energy sector (Baier)
  • Analysis of potential and risks of generative AI in the energy sector (Baier)

• Interactive session (2 hours)

  • Break out 1: Brainstorming additional use cases
  • Plenary discussion
  • Break out 2: Brainstorming additional use cases
  • Plenary discussion
  • Break out 3: Finalization of selected use cases
  • Plenary discussion
  • Summary

Target Group: Energy Experts, Generative AI Experts, Generative AI interested

Max. number of participants: 20

🇩🇪 Begrüßung / Welcome

Convener: Prof. Julian Kunkel (GWDG / Georg-August-Universität Göttingen)

🇩🇪 Rechenzentrum / Computing Center: Führung 4 / Guided Tour 4

Führung durch das Rechenzentrum der Gesellschaft für Wissenschaftliche Datenverarbeitung Göttingen (GWDG) . Gewinnen Sie einen Einblick in den HPC-/ Technikbereich und erfahren Sie, wo Ihre Daten verarbeitet werden, wenn Sie das KI Servicezentrum für sensible und kritische Infrastrukturen KISSKI nutzen.

Die angegebenen Zeiten beziehen sich auf Abfahrt und Rückkunft vor dem Tagungsgebäude. Wir bieten einen Shuttleservice mit 2 Kleinbussen. Bitte finden Sie sich kurz vor der Abfahrszeit pünktlich vor dem Gebäude ein. Die Fahrer:innen können nicht warten.

Die Plätze sind liminiert. Wenn Sie teilnehmen wollen, buchen Sie die kostenpflichtige Führung bei der Anmeldung zur Konferenz.

Weitere Details hier.

🇩🇪 Keynote Medizin - Replicable machine learning in medicine

Über die Sprecherin
Anne-Laure Boulesteix erwarb ein Diplom in Ingenieurwissenschaften an der Ecole Centrale Paris, ein Diplom in Mathematik an der Universität Stuttgart und einen Doktortitel in Statistik an der Ludwig-Maximilians-Universität (LMU) München. Nach einer Postdoc-Phase in medizinischer Statistik wechselte sie als Juniorprofessorin und Professorin (2012) an die Medizinische Fakultät der LMU. Sie arbeitet an der Schnittstelle zwischen Biostatistik, maschinellem Lernen und Medizin mit einem besonderen Fokus auf Metawissenschaft und Methodenevaluation. Sie ist Mitglied im Lenkungsausschuss der STRATOS-Initiative, Gründungsmitglied des LMU Open Science Center und Präsidentin der deutschen Region der International Biometric Society.

Convener: Prof. Anne-Laure Bolesteix (Ludwig-Maximilians-Universität München)

13 🇩🇪 Keynote Medizin - Replizierbares maschinelles Lernen in der Medizin (Replicable machine learning in medicine)

Über die Sprecherin
Anne-Laure Boulesteix erwarb ein Diplom in Ingenieurwissenschaften an der Ecole Centrale Paris, ein Diplom in Mathematik an der Universität Stuttgart und einen Doktortitel in Statistik an der Ludwig-Maximilians-Universität (LMU) München. Nach einer Postdoc-Phase in medizinischer Statistik wechselte sie als Juniorprofessorin und Professorin (2012) an die Medizinische Fakultät der LMU. Sie arbeitet an der Schnittstelle zwischen Biostatistik, maschinellem Lernen und Medizin mit einem besonderen Fokus auf Metawissenschaft und Methodenevaluation. Sie ist Mitglied im Lenkungsausschuss der STRATOS-Initiative, Gründungsmitglied des LMU Open Science Center und Präsidentin der deutschen Region der International Biometric Society.

Speaker: Prof. Anne-Laure Bolesteix (Ludwig-Maximilians-Universität München)

🇩🇪 Podiumsdiskussion "KI-Einsatz im Gesundheitswesen: Aktuelle technische, rechtliche und ethische Entwicklungen (AI Act), Herausforderungen und Möglichkeiten"

Über die Mitglieder des Podiums

Moderation: Dagmar Krefting (Universitätsmedizin Göttingen)
Prof. Dagmar Krefting ist Direktorin des Instituts für Medizinische Informatik an der Universitätsmedizin Göttingen und hat eine Professur für Medizinische Informatik inne. Ein Schwerpunkt ihrer Arbeit liegt auf der institutionenübergreifenden gemeinsamen Nutzung und Analyse von multidimensionalen Biosignalaufzeichnungen wie EKG und EEG, aber auch von Sensordaten, die über Wearables gesammelt werden. Ein weiterer Schwerpunkt liegt auf der Sicherheit, Reproduzierbarkeit und Zuverlässigkeit der Forschungsumgebungen, einschließlich Deep-Learning-Methoden.

Udo Schneider (Techniker Krankenkasse)
Dr. Udo Schneider studierte Volkswirtschaftslehre an der Universität Mannheim. Im Anschluss daran war er Mitarbeiter an der Universität Greifswald und promovierte über das Thema Anreize in der Arzt-Patient-Beziehung, bevor er an die Universität Bayreuth wechselte, wo er sich 2008 habilitierte. Von 2012 bis 2018 war er im WINEG (Wissenschaftliches Institut der TK) im Bereich der Analyse von Routinedaten tätig. Seit Mitte 2018 arbeitet er im Fachbereich Versorgungsmanagement der TK und beschäftigt sich mit Versorgungsforschung auf Basis von GKV-Routinedaten, Versorgungsinnovationen und digitaler Versorgung.

Larisa Wewetzer (Ottobock)
Larisa Wewetzer blickt auf eine 13-jährige Erfahrung in der Medizintechnikindustrie zurück. In ihrer derzeitigen Position bei Ottobock, einem führenden Unternehmen in der Branche, leitet sie die globale Entwicklung für Digital Health Solutions. Ihr Hauptaugenmerk liegt dabei auf der Entwicklung und Einführung eines digitalen Produktangebots, das gezielt auf die Anforderungen von Nutzern von Prothesen und Orthesen ausgerichtet ist. In den vergangenen vier Jahren widmete sie sich zudem intensiv der Erforschung der Faktoren, die die Implementierung von KI-gestützten Systemen im deutschen Gesundheitswesen beeinflussen. Ihre Arbeit verbindet wissenschaftliche Erkenntnisse mit praktischer Anwendung, was ihr ein umfassendes Verständnis für die spezifischen Bedürfnisse in der Medizintechnik ermöglicht.

Helena Zacharias (Medizinische Hochschule Hannover)
Prof. Dr. rer. nat. Helena U. Zacharias ist Professorin für “Klinische Datenwissenschaften” am Peter L. Reichertz Institute für Medizinische Informatik an der Medizinischen Hochschule Hannover. Sie studierte Physik an der Universität Regensburg und promovierte in Biologie am Institut für Funktionelle Genomik, Universität Regensburg, mit einem Fokus auf Kernspinresonanz-Spektroskopie-basierten Metabolomics-Studien. In ihrer PostDoc-Zeit arbeitete sie an der Ohio State University und am Helmholtz Zentrum München. Von 2019-2021 leitete sie die Nachwuchsgruppe “Computational biomarker discovery” an der Universitätsmedizin Greifswald, und von 2021-2022 war sie Professorin für “Klinische Metabolomics” in der Klinik für Innere Medizin I/Institut für klinische Molekularbiologie an der Universität Kiel und dem Universitätsklinikum Schleswig-Holstein. Ihre Forschungsschwerpunkte liegen in der verbesserten Prädiktion von adversen Patientenereignissen und der Untersuchung metabolischer Pathomechanismen, die komplexen Krankheiten zugrundeliegen.

Jana Zschüntzsch (Universitätsmedizin Göttingen)
Priv.-Doz. Dr. Jana Zschüntzsch ist Oberärztin in der Klinik für Neurologie und Leiterin der Neuromuskulären Ambulanz der Klinik für Neurologie sowie Sprecherin des neuromuskulären Zentrums der UMG. Sie war initiativ an der Konzeption des europaweite, interdisziplinäre EU-Forschungsprojekt „Screen4Care“ beteiligt und arbeiten jetzt aktiv an den Zielen und der Umsetzung des innovativen Forschungsvorhabens mit. „Screen4Care“ hat sich das Ziel gesetzt, den Weg bis zur Diagnosestellung von seltenen Erkrankungen zu verkürzen. In „Screen4Care“ leitet Priv.-Doz. Dr. Jana Zschüntzsch das „digitale“ Arbeitspaket zum Einsatz von Algorithmen, die auf maschinellem Lernen beruhen. Patient:innen im frühen Krankheitsstadium sollen so über elektronische Patientenakten schneller identifiziert werden können, damit ihnen auf ihrer Diagnosereise zeitnah geholfen werden kann.

Conveners: Prof. Dagmar Krefting (Universitätsmedizin Göttingen), Prof. Helena Zacharias (Medizinische Hochschule Hannover), Prof. Jana Zschüntzsch (Universitätsmedizin Göttingen), Larisa Wewetzer (Ottobock), Dr Malte Schmieding (Bundesministerium für Gesundheit), Dr Udo Schneider (Techniker Krankenkasse)

🇬🇧 Session 3. Large Language Models

Chair: Dr. Jennifer D'Souza (TIB Hannover)

Content/Abstract:
This session will delve into the intricacies of Large Language Models (LLMs). The session aims address the impact of these AI systems along the topics of interest (see below), exploring their capabilities, implications, and potential applications.

Topics of interest:
- Pretraining Techniques for LLMs: Exploring foundational strategies and algorithms in the development of LLMs.
- Testing and Evaluating LLM Fitness:Methods for assessing LLM performance on well-known tasks and benchmarks.
- Application of LLMs in Scientific Research: Case studies and examples of LLMs driving discovery and innovation in various scientific fields.
- Innovative Insights Generation: Strategies for leveraging LLMs to generate novel insights and accelerate research outcomes.
- Challenges and Solutions in LLM Application: Discussing the practical challenges encountered in applying LLMs to scientific research and potential solutions.

14 Extracting Biochemical Knowledge Graphs from Academic Literature through Large Language Models

The growth and evolution of our civilization have been based on the use of biodiversity. Throughout history, human survival has been intricately intertwined with the utilization of diverse plant species, serving as vital sources of nutrition and medicinal remedies. The exploration of natural products is a cornerstone in the quest for innovative pharmaceuticals. A staggering 67% of all globally approved drugs trace their origins back to natural sources, whether as pure compounds, semi-synthetic derivatives, or bioinspired pharmacophores.

Natural product researchers have been studying the medicinal properties of plants, and significant advances regarding biosynthesis, ecology, and biological properties were achieved in the last century. The biodiversity of tropical and equatorial environments is plentiful. It could offer a particularly rich potential in the search for biologically active compounds to be used as models for product discovery and medicinal chemistry. This extraordinary biodiversity and its rich chemical diversity hold immense potential for the development of bioproducts, including pharmaceuticals, cosmetics, food supplements, and agricultural pesticides.

In this talk, we will shed light on our ongoing effort to bring order and accessibility to the biochemical information available in a structured and organized manner, automated through Large Language Models, to unlock its full potential. Our final goal is to reduce the time spent on scientific studies and processes involving technological development and research of sustainable products and assist in the development of different fields of science, technological development of bio-friendly and sustainable products with high added value, as well as the establishment of novel public policies.

Speaker: Edgard Luiz Marx (InfAI)

15 Towards a Reliable Web of Knowledge

The advent of Large Language Models (LLMs), most notably ChatGPT, has fascinated researchers and the public alike and LLMs. The main attractor toward LLMs is their capability to interpret prompts formulated in natural language and to respond accordingly, allowing for more organic interactions with LLM-based AI systems and increasing their accessibility especially for less tech-savvy users. LLMs gain these capabilities by being trained on a huge corpus of texts and, in the process, learning about patterns of knowledge encoded in this text corpus.

However, we now know that the truth is more complex. Namely, ChatGPT was shown to make mistakes and hallucinate if a response is statistically likely but not conforming to actual knowledge. While arguably harmless in settings motivated by curiosity and learning about the technology and its capabilities, such mistakes are prone to causing real-world damage if they occur in professional settings, become harder to identify, and actively influence our communication and decision-making processes.
Fundamentally, we argue that LLMs should be increasingly seen as what their name implies: AI models for understanding and generating human languages, which provide intuitive human-computer interfaces. Conversely, at least for critical applications, they should not be seen as knowledge models.

This perspective is motivated by the recent shift toward deploying special-purpose LLMs and finetuning existing LLMs for singular applications. This approach is sensible from the perspective of the application provider: They can seize the language-processing capabilities of advanced LLMs, such as ChatGPT, and provide application-specific knowledge in the form of additional training data.

However, this development disconnects from the global view of a universally connected Internet. In a sense, the development outlined above is even antithetical to the evolution of the Internet: In the era before search engines, users would have to know relevant websites; the advent of search engines provided them with a central hub for finding relevant information. Given that LLMs are at least partly used to get information, the above-mentioned shift toward a vast landscape of application-specific LLMs bears the potential of partly reverting this convenience if users now have to know which LLM serves their purpose best.

We argue that, from an end-user perspective, we should strive for establishing an LLM-based Web of Knowledge (WoK), which uses an LLM with versatile interpretation capabilities as a unified interface for querying relevant knowledge pools before formulating an answer. In contrast to implicit knowledge learning or relying on a federation of specialized LLMs, an LLM-based WoK could rather analyze users’ prompts for relevant knowledge repositories and gain the information from there in a structured manner before formulating an answer in natural language.

On the flip side, the idea of a WoK introduces new challenges as well, which require additional attention, such as well-defined APIs for information retrieval or the combination of knowledge obtained from different sources. In this presentation, we outline the concept of the WoK and point out further research efforts required to steer toward a WoK.

Speaker: Roman Matzutt (Fraunhofer FIT)

16 Knowledge Injection Strategies for Large Language Models

During pre-training a Large Language Model (LLM) learns language features such as syntax, grammar and, to a certain degree, semantics. In this process, the model not only acquires language, but also implicitly acquires knowledge. In this sense knowledge is a byproduct of language acquisition. This characteristic is inherent in the architecture of modern LLMs. Hence, much like language features, knowledge is also learned in a fuzzy manner by these models, leading to difficulties in understanding highly specific concepts and a tendency to generate hallucinations.

This talk will explore various techniques and strategies for sharpening fuzzy knowledge in LLMs with domain-specific information. Here, our focus is on lightweight methods, that require no further pre-training. We will examine direct text injection strategies for LLM encoders (such as triple injection and K-BERT), integration of additional features using multilayer perceptrons (MLPs), and the use of modular lightweight components with knowledge-based adapters. Furthermore, we will investigate injection techniques for LLM decoders that go beyond simple prompting, such as RAGs, and how these can be enhanced by a multi-agent architecture.

Speaker: Benjamin Wolff (ZB MED - Information Centre for Life Sciences)

17 Enhancing Emotional Support Chatbots for Depression Using Reinforcement Learning with Expert Knowledge Integration

Abstract

Mental health has become a paramount concern in contemporary society, as an increasing number of individuals are grappling with depression​ (WHO, 2023)​. People increasingly rely on partners, friends, or even chatbots as effective means to prevent and alleviate symptoms of depression​ (Rauws, 2022)​. When observing interpersonal interactions, it's evident that conversations are frequently driven by emotional responses rather than logical reasoning. For example, in reaction to a statement like, “My teacher is so annoying. He insists that I attend his course precisely on time”, a supportive friend might empathize by saying, “That sounds tough. Everyone has urgent matters sometimes. Being 10 minutes late shouldn't matter”. In contrast, a chatbot, designed to respond logically, might suggest, “It seems important to adhere to the schedule as required by your course guidelines”.

To enhance the effectiveness of an emotional support chatbot specifically designed for supporting individuals with depression, integrating proven therapeutic approaches like Solution-Focused Brief Therapy (SFBT) and Cognitive Behavioral Therapy (CBT) can be beneficial. A practical approach is to involve developing datasets from expert therapeutic sessions to train the chatbot to ensure it learns to emulate effective therapeutic communication. Additionally, integrating therapeutic principles into the advanced layers of transformer models can allow the chatbot to generate responses that are not only contextually appropriate but also therapeutically beneficial ​(Qi Ge, 2023)​. This method enhances the chatbot's capability to provide meaningful support, making it a valuable tool in mental health care. However, these techniques pose the risk of catastrophic forgetting, where the model may lose earlier knowledge as it acquires new information.

We aim to examine the application of Reinforcement Learning (RL) to embed expert therapeutic knowledge in chatbots, focusing on Solution-Focused Brief Therapy (SFBT) and Cognitive Behavioral Therapy (CBT). By employing Inverse Reinforcement Learning (IRL), we deduce the reward functions implicit in annotated expert behaviors. This allows a pre-trained Large Language Model (LLM) to be fine-tuned through RL. The goal is to enable the chatbot to conduct multi-turn emotional support conversations that more effectively support and enhance the patient's emotional well-being, while mitigating the issue of catastrophic forgetting.

​​References

​​WHO (2023). Depressive disorder (depression). Retrieved from WHO Official Website: https://www.who.int/news-room/fact-sheets/detail/depression

​Qi Ge, L. L. (2023). Designing Philobot: A Chatbot for Mental Health Support with CBT Techniques. Proceedings of 2023 Chinese Intelligent Automation Conference .

​Rauws, M. (2022). The Rise of the Mental Health Chatbot. Artificial Intelligence in Medicine, 1609–1618.​​

Speaker: Lingxiao Kong (Fraunhofer Institute for Applied Information Technology FIT)

18 Unlocking LLMs: Forgiving Errors, Ethical Considerations, and BAIS Challenges in Domain Adaptation

Large language models (LLMs) have shown promising capabilities in several domains, but “Inherent Bias,” “Data Privacy & Confidentiality,” “Hallucinations,” “Stochastic Parrot,” and “Inadequate Evaluations” limit the LLM’s reliability for direct and unsupervised use. These challenges are exacerbated in complex, sensitive, low-resource domains with scarce large-scale, high-quality datasets. Therefore, this work introduces in-context synthetic data generation through LLMs as a potential technique to mitigate the Bias in machine learning (ML) pipelines and scarce data challenges by undertaking two real-world use cases in the healthcare domain (Mental health) and Agri-Food Sapce (Food Hazard Identification). In this context, this work presents expert-annotated Food-Hazard and Conversational Therapy (MI dialogues) datasets developed through the joint effort of LLM and humans in the loop. The data generation process incorporates accurately engineered prompts through cues and tailored information to ensure high-quality dialogue generation, taking into account contextual relevance and false semantic change. Both datasets are comprehensively evaluated through binary and multiclass classification problems that uncover the ability of LLMs to reason and understand domain intricacies. Our empirical findings demonstrate that the data generated through this rigorous quality control process is both plausible and substantially beneficial in enabling ML techniques to address the targeted biases, thereby supporting the use of LLMs for supervised, task-specific applications in sensitive domains like mental health. Our contributions not only provide the MI community with comprehensive datasets but also valuable insights for using LLMs in plausible text generation in multiple low-resource domains.

Speaker: Vivek Kumar (Universität der Bundeswehr München)

🇬🇧 Session 4. Large AI Models by and for Europe

Chair: Dr. Wolfgang Stille (hessian.AI)

19 Safety and Fairness in Large AI Models

In the burgeoning field of artificial intelligence, ensuring the safety and fairness of larg-scale models is paramount. This talk presents Aurora-M, a state-of-the-art multilingual model designed specifically for non-English, e.g. European, languages. Our focus lies in the safety tuning process of Aurora-M, highlighting innovative methodologies to mitigate biases and enhance the model's ethical integrity. We will delve into the broader implications of safety and fairness in large AI models, discussing best practices and challenges faced in the European context. Join us as we explore how Aurora-M exemplifies the commitment to creating AI that is not only powerful and versatile but also aligned with the values of fairness and safety.

Speaker: Felix Friedrich (Hessian.AI, TU Darmstadt)

20 Distilling Graph Structure Knowledge into Code Language Models for Generative Tasks

Although pre-trained language models (PLMs) on code get significantly better, code is largely treated as sequential.
By ignoring easily extractable structural rules -- through static analysis -- that programming languages and algorithmic concepts follow, significant potential for improvement is lost.
Some previous work used abstract syntax trees (ASTs) and their extended versions by extracting paths, flattening or using graph-based auxiliary training, etc., which have been shown to improve either performance or reliability in code generation and program synthesis.
Most of these methods disrupt the nature of graph modality by applying such adaptations to work with transformer-based sequential models, which are currently state of the art.
We propose a novel method to work directly with graph representations by using graph neural networks (GNNs) and infusing learned structural information into sequential transformer models.
In doing so, the learned structural knowledge from GNNs is distilled into PLM to help with generative tasks where the target is a programming language and therefore there are no graphs, as opposed to code summarization or search tasks.

Speaker: Mert Tiftikci (Hessian.AI, TU Darmstadt)

21 Llavaguard: VLM-based Safeguards for Vision Dataset Curation and Safety Assessment

We introduce LlavaGuard, a family of VLM-based safeguard models, offering a versatile framework for evaluating the safety compliance of visual content.
Specifically, we designed LlavaGuard for dataset annotation and generative model safeguarding.
To this end, we collected and annotated a high-quality visual dataset incorporating a broad safety taxonomy, which we use to tune VLMs on context-aware safety risks.
As a key innovation, LlavaGuard's responses contain comprehensive information, including a safety rating, the violated safety categories, and an in-depth rationale.
Further, our introduced customizable taxonomy categories enable the context-specific alignment of LlavaGuard to various scenarios.
Our experiments highlight the capabilities of LlavaGuard in complex and real-world applications.
We provide checkpoints ranging from 7B to 34B parameters demonstrating state-of-the-art performance, with even the smallest models outperforming baselines like GPT-4.
We make our dataset and model weights publicly available and invite further research to address the diverse needs of communities and contexts.

Speaker: Lukas Helff (Hessian.AI, TU Darmstadt)

22 Occiglot - Open Language Models by and for Europe

Large language models (LLMs) have emerged as transformative tools, revolutionizing various natural language processing tasks. Despite their remarkable potential, the LLM landscape is predominantly shaped by US tech companies, leaving Europe with limited access and influence. This talk will present Occiglot - an ongoing research collective for open-source language models for and by Europe. More specifically, we will explain why open European LLMs are needed and share insights as well as lessons learned, ranging from data collection and curation, model training and evaluation.

Speaker: Malte Ostendorff (German Research Center for Artificial Intelligence (DFKI), Occiglot)

🇩🇪 Rechenzentrum / Computing Center: Führung 5 / Guided Tour 5

Führung durch das Rechenzentrum der Gesellschaft für Wissenschaftliche Datenverarbeitung Göttingen (GWDG) . Gewinnen Sie einen Einblick in den HPC-/ Technikbereich und erfahren Sie, wo Ihre Daten verarbeitet werden, wenn Sie das KI Servicezentrum für sensible und kritische Infrastrukturen KISSKI nutzen.

Die angegebenen Zeiten beziehen sich auf Abfahrt und Rückkunft vor dem Tagungsgebäude. Wir bieten einen Shuttleservice mit 2 Kleinbussen. Bitte finden Sie sich kurz vor der Abfahrszeit pünktlich vor dem Gebäude ein. Die Fahrer:innen können nicht warten.

Die Plätze sind liminiert. Wenn Sie teilnehmen wollen, buchen Sie die kostenpflichtige Führung bei der Anmeldung zur Konferenz.

Weitere Details hier.

11:15 Pause / Break

🇩🇪 Rechenzentrum / Computing Center: Führung 6 / Guided Tour 6

Führung durch das Rechenzentrum der Gesellschaft für Wissenschaftliche Datenverarbeitung Göttingen (GWDG) . Gewinnen Sie einen Einblick in den HPC-/ Technikbereich und erfahren Sie, wo Ihre Daten verarbeitet werden, wenn Sie das KI Servicezentrum für sensible und kritische Infrastrukturen KISSKI nutzen.

Die angegebenen Zeiten beziehen sich auf Abfahrt und Rückkunft vor dem Tagungsgebäude. Wir bieten einen Shuttleservice mit 2 Kleinbussen. Bitte finden Sie sich kurz vor der Abfahrszeit pünktlich vor dem Gebäude ein. Die Fahrer:innen können nicht warten.

Die Plätze sind liminiert. Wenn Sie teilnehmen wollen, buchen Sie die kostenpflichtige Führung bei der Anmeldung zur Konferenz.

Weitere Details hier.

🇬🇧 Session 5. AI-Applications in Clinical Practice: Challenges and Successes

Chair: Jun.-Prof. Dr. Anne-Christin Hauschild (UMG), Dr. Nicolas Spicher (UMG), Dr. Zully Ritter (UMG)

Content / Abstract:
Nowadays, AI applications in healthcare and in general for clinical practice have proved to be successful in specific tasks like diagnosis prediction, risk estimation (e.g., heart failure risks), alarm and order automation, or cancer differential diagnosis; on the other hand, these achievements are confronted to endurance challenges related mainly to patient security (data privacy and data ownership) and bias additionally to ethical issues. Even without considering the regulation of AI and the coming AI Act, AI solutions to be implemented in clinical practice have been developed in academia and industry. In our session, we will provide insights into already proven solutions and those being tested to be efficiently implemented in clinical setups. We will present and delve into machine-learning approaches using mainly clinical, image, and biosignal data. Concerning solutions to handle data privacy properly, among other patient security issues, we will present in this session how, for example, federated learning is gaining in importance as an appropriate technique, allowing not only to solve the problems related to data sharing (both ethical and technical) but also even improving the performance of AI solutions in the case of not having enough or representative data to find a good performing AI solution.
Aiming to share and discuss the lessons learned during designing and testing AI solutions for clinical practice, we invite you to participate and be part of it.

Topics of interest include:
- Lessons learned from AI projects in clinical practice
- Federated Learning as a novel modality enabling AI in clinical practice
- Translation of AI methods for biosignal processing towards clinical practice

23 Topic Introduction

Speaker: Prof. Anne-Christin Hauschild (Universitätsmedizin Göttingen)

24 Keynote

Speaker: Michael Dietrich (Deutsches Forschungszentrum für Künstliche Intelligenz (DFKI))

25 Predicting heart failure recovery by wearables and machine learning

Heart failure (HF) poses a significant health burden in high-income countries, affecting over 10% of individuals aged 70 and older. The progressive nature of HF leads to frequent hospital admissions and elevated healthcare costs. There is no easily-acquired biomarker available which allows to gain insight and derive predictions into HF dynamics with the current diagnosis being based on blood tests, X-ray or cardiac ultrasound. Wearable devices like the Apple Watch (Apple Inc., Cupertino, California, U.S.) offer a more unobtrusive monitoring of health parameters compared to these measures. In this feasibility study, we aim to determine in how far Apple Watch data combined with machine learning can be used to predict the course of HF in a well-defined cohort.

A observational clinical study is conducted at the University Medical Center Göttingen’s Department of Cardiology and Pneumology (IRB Ethics Approval No. 23/2/24; funding via German Centre for Cardiovascular Research, DZHK). N=32 HF patients with reduced ejection fraction hospitalized for acute decompensation (ejection fraction ≤40%, NTproBNP >1000 pg/ml, and at least one symptom such as edema, pleural effusion, or ascites) will be included with a 90 day follow-up period. Patients will wear an Apple Watch during their hospitalization and sensor data (e.g. single-lead electrocardiography, SpO2, Respiration, Step counter) will be acquired. This data is used to predict clinical parameters and risk assessment, e.g. prediction of HF course.

In this talk we present initial insights of our study with the data that is available at this point. Next to the main research question, we will present results regarding the patients’ opinion on using the Apple Watch and their adherence.

Speaker: Philip Hempel (Department of Medical Informatics, University Medical Center Göttingen, Göttingen, Germany)

26 Backpropagation vs. Forward-Forward: unveiling different insights of Duchenne Muscular Dystrophy from multiphoton microscopy imaging data

In addition to genetic testing, current diagnostic practices for rare neuromuscular diseases involve muscle biopsy analysis, often hindered by subjective interpretation and variability. Advances in artificial intelligence, particularly deep learning, offer promising solutions to automate and enhance diagnostic accuracy by identifying new quantitative, standardized features and phenotypic expressions within biopsy images. These features can be extracted from neural networks using explainable AI tools.

Backpropagation is the gold standard for training Convolutional Neural Networks (CNNs). However, its forward and backward passes are not biologically plausible given the data flow in the human brain. In December 2022, Prof. Geoffrey Hinton, one of its inventors, proposed an alternative: the Forward-Forward (FF) algorithm, which avoids backward passes by using two forward passes, preventing previous hidden layers from receiving information from subsequent ones. In 2023, we were the first to implement this algorithm on CNNs.

In this study, we applied FF-trained CNNs to analyze multiphoton microscopy images of muscle biopsies from patients with rare neuromuscular diseases, specifically Duchenne Muscular Dystrophy (DMD). The images included autofluorescence, second harmonic generation, and third harmonic generation signals (SLAM approach).

We compared the performance of the FF algorithm with backpropagation on the same CNN, reaching 91% and 98% of accuracy on the test dataset, respectively. Using explainable AI tools, specifically class activation maps, we revealed the decision-making processes of the CNNs, showing that FF and backpropagation use different image properties for DMD diagnosis. We validated and then integrated these features by introducing an attention metric, providing a unique and standardized value to quantify pathological characteristics for immediate clinical use.

Our findings demonstrate the potential of the FF algorithm in delivering new, reliable and interpretable diagnostic insights from biomedical images. This paves the way for its parallel integration with backpropagation-based networks into clinical workflows, enhancing state-of-the-art analysis pipelines by more efficiently exploiting the complex information content available from biological images.

Speaker: Riccardo Scodellaro (MPINAT)

27 AI-Driven Adaptive Systems for Knee Rehabilitation: Leveraging Artificial Mental Models for Personalized Patient Support

In the rapidly changing field of prevention and rehabilitation, adaptive and personalized Artificial Intelligence (AI) systems play a crucial role as facilitators of patient-centric care. These systems, by analyzing comprehensive data on user behavior and situational context, offer support customized to the specific needs of individual patients [1, 2, 3, 4]. However, patients dealing with ailments or recovery from incidents like knee surgeries may face cognitive challenges. These challenges can result in the creation of data that is incomplete, inaccurate, or biased, significantly hampering the patient's ability to make informed decisions, understand complex medical information, or effectively communicate their symptoms and concerns [5, 6, 7, 8]. Recognizing the significant influence of these cognitive limitations, it is essential to leverage AI healthcare systems designed to mitigate these gaps, ensuring care that aligns perfectly with each patient’s distinct needs and conditions [1, 2].
The exploration of mental models [9] in therapeutic settings and their integration into AI systems introduces a promising path to improve patient care and treatment outcomes. Mental models are cognitive structures that encompass a patient's perceptions and presumptions about their therapy and rehabilitation journey [10, 11, 12, 13, 14]. Existing research highlights the need for accurately capturing and understanding these models, especially in therapeutic and recovery scenarios [15, 16, 17, 18].
Our research investigates the potential of using meta-representations of patients’ mental models called artificial mental models (AMM) within healthcare AI systems to enhance patient support, especially in making informed choices amidst the uncertainty and discomfort typical in rehabilitation phases. For instance, Carlos is an amateur soccer player recovering from knee surgery and eager to return to the field. His AMM acts as his representative by communicating directly with his physiotherapist to develop a personalized exercise plan that aligns with his goals and recovery status. The AMM schedules these exercises throughout the week, adjusting the intensity based on feedback from Carlos’s wearable devices that track his pain and performance. It also arranges video consultations with his therapist if it detects issues or deviations in his recovery progress, ensuring Carlos remains on the safest and quickest path to full activity.
In this work, we investigate the elicitation and individualization of AMMs for patients in rehabilitation situations. Large Language Models (LLMs) are used for the generation of AMMs. Training data are acquired by indirect observations, a quantitative study and direct observation. Our research is driven by the following research questions (RQ):
• RQ1: Can we elicit an individual AMM for a specific patient by using LLMs?
• RQ2: Are predictions of the AMM regarding expected pain in exercises comparable with expectations of the patient?
• RQ3: Are predictions of the AMM regarding expected pain in exercises accurate compared with assessment by the therapist?

For tackling the research questions, we specified a research design according to Design Science Research (DSR) [19, 20] covering a prospective study with two phases: elicitation and individualization. Within each phase, an artifact is created and evaluated [21]. Objective of the elicitation phase is the generation of a discrimination- and bias-free domain-specific basis AMM in the domain of knee rehabilitation. Here, large scale data are acquired on the one hand by a quantitative study (n=150) on personality traits (Big Five [22]) and expected pain in exercises (e.g., squats). On the other hand, indirect observation of patients with knee issues is applied in terms of a twofold scraping approach. Additionally, large corpora of healthcare dialogues are filtered, analyzed, and prepared for model training, e.g., HealthCareMagic [23], ChatDoctor [24], medAlpaca [25]. The resulting artifact – a discrimination- and bias-free domain-specific basis AMM is evaluated in a technical experiment (ablation study). The individualization phase uses this AMM basis model for fine-tuning an AMM for an individual patient. Here, direct observation of a specific patient is used for training the model. Curated data like medication, rehabilitation therapy plans, data on injury, surgical procedure and duration, complications, self-reported pain scales (e.g., Visual Analog Scale (VAS) [26], Wong-Baker FACES Pain Rating Scale [27]) are integrated as well as non-curated data like movement data, sleep, fitness status etc. of the patient. The resulting artifact – an AMM for a specific patient - is evaluated by an action research approach with the patient.

As result of the elicitation phase, a technically evaluated domain-specific basis AMM in the domain of knee rehabilitation is generated. For building this model, open source LLMs like BLOOM, Mistral7B or Falcon are applied. For ensuring fairness and mitigating bias in the basis AMM, discrimination and bias checks are used. Here a combination of methods is designed, i.e., counterfactual fairness testing [28], adversarial debiasing [29], fairness metrics such as equality of opportunity [30] or demographic parity [31], and interpretability. The basis AMM is used for fine-tuning the AMM for a specific patient in the individualization phase (RQ1). This patient AMM is evaluated in a real-world rehabilitation situation with the patient as part of a research intervention, evaluating its effect on the real-world situation. For the experimental setting an A/B test is planned with focus on anticipation respectively prediction of pain in a therapy unit. Predictions are generated in two variants: (A) by the patient, and (B) by the AMM. For ground truthing, predictions are mirrored with a subsequent actual pain assessment by the patient in a therapy unit. Thus, overlapping of predictions of patient and AMM in concrete cases as well as their accuracy with respect to ground truth are measured (RQ 2 & 3). Contribution of this research is the support of personalized patient care in knee rehabilitation by leveraging LLMs to create and individualize patient-specific AMM for AI systems in healthcare.

This research emphasizes the role of Artificial Intelligence (AI) systems in enhancing patient-centric care in the field of prevention and rehabilitation. It particularly focuses on the development and implementation of Artificial Mental Models (AMM) within healthcare AI systems in knee rehabilitation. These models are personalized to account for individual patients' mental models regarding their therapy and rehabilitation journeys. In this work, the potential of using Large Language Models (LLMs) to generate and fine-tune these AMMs, aiming for more accurate, bias-free, and personalized patient care, are highlighted.
By creating systems that better understand and predict patient needs and responses, healthcare providers can offer more targeted and effective interventions in knee rehabilitation. This could lead to quicker recoveries and improved overall patient outcomes. Additionally, the methodological approach of using AMMs could be expanded to other areas of healthcare, suggesting a broad potential impact on how AI is integrated into patient care systems and routine care.

References:
1. Khera, R., Butte, A.J., Berkwits, M., Hswen, Y., Flanagin, A., Park, H., Curfman, G., Bibbins-Domingo, K.: Ai in medicine—jama’s focus on clinical outcomes, patient-centered care, quality, and equity. Jama (2023)
2. Wan, T.T., Wan, H.S.: Predictive analytics with a transdisciplinary framework in promoting patient-centric care of polychronic conditions: Trends, challenges, and solutions. AI 4(3), 482–490 (2023)
3. Bollos, L.A.C.L., Zhao, Y., Soriano, G.P., Tanioka, T., Otsuka, H., Locsin, R.: Technologies, physician’s caring competency, and patient centered care: A systematic review. The Journal of Medical Investigation 70(3.4), 307–316 (2023)
4. Li, W., Ge, X., Liu, S., Xu, L., Zhai, X., Yu, L.: Opportunities and challenges of traditional chinese medicine doctors in the era of artificial intelligence. Frontiers in Medicine 10 (2023)
5. Timm, A., Schmidt-Wilcke, T., Blenk, S., Studer, B.: Altered social decision making in patients with chronic pain. Psychological Medicine 53(6), 2466–2475 (2023)
6. Meyer, A.N., Giardina, T.D., Khawaja, L., Singh, H.: Patient and clinician experiences of uncertainty in the diagnostic process: current understanding and future directions. Patient Education and Counseling 104(11), 2606–2615 (2021)
7. Dildine, T.C., Amir, C.M., Parsons, J., Atlas, L.Y.: How pain-related facial expressions are evaluated in relation to gender, race, and emotion. Affective Science pp. 1–20 (2023)
8. Dildine, T.C., Necka, E.A., Atlas, L.Y.: Confidence in subjective pain is predicted by reaction time during decision making. Scientific reports 10(1), 21373 (2020)
9. Norman, D.A.: Some observations on mental models, pp. 241–244. Morgan Kaufmann Publishers Inc., San Francisco, CA, USA (1987)
10. Jones, N.A., Ross, H., Lynam, T., Perez, P., Leitch, A.M.: Mental models: an interdisciplinary synthesis of theory and methods. Ecology and Society 16(1), 46 (2011), https://api.semanticscholar.org/CorpusID:38976887
11. LaMere, K., M¨antyniemi, S., Vanhatalo, J., Haapasaari, P.: Making the most of mental models: Advancing the methodology for mental model elicitation and documentation with expert stakeholders. Environmental Modelling & Software 124, 104589 (2020)
12. Borders, J., Klein, G., Besuijen, R.: Mental model matrix: Implications for system design and training. Journal of Cognitive Engineering and Decision Making p. 15553434231226317 (2024)
13. Johnson-Laird, P.N.: Mental models. The MIT Press (1989)
14. Hermans, A., Muhammad, S., Treur, J.: You feel so familiar, you feel so different: A controlled adaptive network model for attachment patterns as adaptive mental models. In: Mental Models and Their Dynamics, Adaptation, and Control: A SelfModeling Network Modeling Approach, pp. 321–346. Springer (2022)
15. Hermans, A., Muhammad, S., Treur, J.: You feel so familiar, you feel so different: A controlled adaptive network model for attachment patterns as adaptive mental models. In: Mental Models and Their Dynamics, Adaptation, and Control: A SelfModeling Network Modeling Approach, pp. 321–346. Springer (2022)
16. Gabbas, M., Kim, K.: Gamified user interface design for dysphagia rehabilitation based on common mental models. In: DRS2022, Bilbao, Spain (2022)
17. Barber, T., Crick, K., Toon, L., Tate, J., Kelm, K., Novak, K., Yeung, R.O., Tandon, P., Sadowski, D.C., Veldhuyzen van Zanten, S., et al.: Gastroscopy for dyspepsia: Understanding primary care and gastroenterologist mental models of practice: A cognitive task analysis approach. Journal of the Canadian Association of Gastroenterology 6(6), 234–243 (2023)
18. Naik, A.D.: Collaborative decision-making: Identifying and aligning care with the health priorities of older adults. In: Geriatric Medicine: A Person Centered Evidence Based Approach, pp. 1–21. Springer (2023)
19. Hevner, A.R., March, S.T., Park, J., Ram, S.: Design science in information systems research. MIS Quaterly 28, 75–105 (2004), https://api.semanticscholar.org/CorpusID:13553735
20. Peffers, K., Tuunanen, T., Rothenberger, M.A., Chatterjee, S.: A design science research methodology for information systems research. Journal of Management Information Systems 24, 45 – 77 (2007), https://api.semanticscholar.org/CorpusID:17511997
21. Peffers, K., Rothenberger, M., Tuunanen, T., Vaezi, R.: Design science research evaluation. In: Design Science Research in Information Systems. Advances in Theory and Practice: 7th International Conference, DESRIST 2012, Las Vegas, NV, USA, May 14-15, 2012. Proceedings 7. pp. 398–410. Springer (2012)
22. Oliver P. John, Laura P. Naumann, Christopher J. Soto: (2008) Paradigm Shift to the Integrative Big Five Trait Taxonomy. Handbook of Personality Theory and Research. 3. Auflage. S. 114–117
23. https://huggingface.co/datasets/RafaelMPereira/HealthCareMagic-100k-Chat-Format-en
24. Li Y, Li Z, Zhang K, et al. (June 24, 2023) ChatDoctor: A Medical Chat Model Fine-Tuned on a Large Language Model Meta-AI (LLaMA) Using Medical Domain Knowledge. Cureus 15(6): e40895. doi:10.7759/cureus.40895
25. https://github.com/kbressem/medAlpaca
26. Crichton, N.: Visual analogue scale (vas). J Clin Nurs 10(5), 706–6 (2001)
27. Wong, D.L., Baker, C.M.: Wong-baker faces pain rating scale. Pain Management Nursing (2012)
28. Kusner, M.J., Loftus, J., Russell, C., Silva, R.: Counterfactual fairness. In: Advances in Neural Information Processing Systems. vol. 30 (2017).
29. Lemoine, B., Zhang, B., Mitchell, M.: Mitigating unwanted biases with adversarial learning. In: Proceedings of the ACM Conference (2018)
30. Hardt, M., Price, E., Srebro, N.: Equality of opportunity in supervised learning. In: Advances in Neural Information Processing Systems. vol. 29 (2016).
31. Zafar, M.B., Valera, I., Rogriguez, M.G., Gummadi, K.P.: Fairness constraints: Mechanisms for fair classification. In: Proceedings of the 20th International Conference on Artificial Intelligence and Statistics. Proceedings of Machine Learning Research, vol. 54, pp. 962–970. PMLR (2017).

Speaker: Sabine Janzen

28 tba

Speaker: tba

🇬🇧 Session 6. Multi-Modal Foundation Models

Chair: Dr. Joachim Köhler (Fraunhofer IAIS, WestAI)
Moderation: Laszlo Friedmann (Fraunhofer IAIS, WestAI)

Content / Abstract:
With the rapid progress in the field of large language models in recent years, the transfer of the un-derlying technology, i.e. foundation models, to new modalities has become one of the most im-portant research topics in artificial intelligence. With the introduction of CLIP at latest, this develop-ment has been extended to multi-modal foundation models which are able to process different types of modalities, such as images or text. Due to their outstanding properties, such as their excellent ze-ro- or few-shot capability, and their ability to process different modalities, multi-modal foundation models offer huge potential across domains and applications. The overall scope of this session is therefore intended to be broad and to cover all topics related to multi-modal foundation models.

Topics of interest include:
- Vision / sound / language / ... models in any possible combination
- Data- and energy-efficient pre-training
- Methodologies for efficient transfer and model compression
- Application to specific domains
- Ethics, risks, and fairness
- Securing private data

29 Open multi-modal foundation models: reproducible science of transferable learning

Speaker: Dr Jenia Jitsev (Forschungszentrum Jülich)

30 Importance of data in multi-modal modelling

Speaker: Marianna Nezhurina (Forschungszentrum Jülich)

31 High Fidelity Video Background Music Generation with Transformers

The recent success of large language models (LLMs) like GPT and BERT has demonstrated the immense capabilities of transformer-based architectures on natural language processing (NLP) tasks, such as text generation, translation, and summarization, setting new benchmarks in Artificial Intelligence (AI) performance. Building on this momentum, the AI research community is increasingly focusing on extending the capabilities of LLMs to multi-modal data, giving rise to multimodal foundation models. The use of generative models for music generation has also been gaining popularity. In this study, we present the application of multi-modal foundation models in the domain of video background music generation. Current music generation models are predominantly controlled by a single input modality: text. Video input is one such modality, with remarkably different requirements for the generation of background music accompanying it. Even though alternative methods for generating video background music exist, none achieve a music quality and diversity that is comparable to the text-based models. We adapt the text-based models to accept video as an alternative input modality for the control of the audio generation process and evaluate our approach quantitatively and qualitatively through the analysis of exemplary results in terms of audio quality and through a case study to determine the users’ perspective on the video-audio correspondence of our results.

Speaker: Yongli Mou (RWTH Aachen University)

32 Multi-Modal Foundation Models in Production – Potentials and Challenges

The emergence of multi-modal foundation models, i.e., large AI models pre-trained on vast amounts of data of different modalities, which show emergent behavior and generalization ability over a set of different tasks, brings enormous possibilities across industries. Specific use cases in the production sector around this technology are however currently scarcely available. Therefore, this presentation gives an overview about the possibilities and challenges of such models for productional use cases.

Speaker: Hannes Behnen

33 Enhancing Transparency and Trustworthiness in Neuro-Symbolic Scholarly Knowledge Curation Using Language and Visual Models

Scholarly knowledge curation encounters challenges due to the diverse methodologies across scientific fields. Tailored approaches and protocols are essential to address these challenges, considering each domain's unique characteristics. Machine assistance, particularly through Large Language Models (LLMs) such as GPT-3.5, offers significant potential to navigate these complexities and enhance knowledge curation processes. The Open Research Knowledge Graph (ORKG) is a structured semantic platform to mitigate issues associated with traditional document-centric scholarly communication, including publication overload and peer review deficiencies.
The rapid evolution of multi-modal foundation models in artificial intelligence has transformed the integration of diverse modalities, including language and visual data. In this session, we aim to explore innovative approaches that leverage these multi-modal models alongside prompt engineering techniques. Emphasizing explainability, transparency, and trustworthiness, our research focuses on the curation of scholarly knowledge. By integrating LLMs (e.g., GPT-3.5) and visual models, we aim to deepen insights and enhance the accessibility of knowledge extracted from academic literature.
In this session, we demonstrate our approach using LLMs (e.g., GPT-3.5) to extract data from research articles, facilitating innovative insights and accelerating research outcomes. Our method integrates LLM capabilities with ORKG, validated by domain experts to ensure data accuracy and relevance. This collaborative framework merges neural LLM capabilities with symbolic knowledge graphs and human expertise, addressing practical challenges in applying LLMs to scientific research. We leverage both language and visual models to enrich our understanding and interpretation of scholarly content, thereby broadening the scope of insights generated.
We employ prompt engineering with predefined templates to effectively interact with LLMs, ensuring consistent and precise data extraction. Our discussion will cover strategies for leveraging LLMs to generate novel insights, challenges encountered in their application, and solutions developed to overcome these obstacles. Emphasis will be placed on tools for enhancing AI explainability and trustworthiness, ensuring transparent and reliable use of LLMs in scientific research.

Speaker: Hassan Hussein (LUH)

🇬🇧 Session 7. Applications of artificial intelligence in the energy sector

Chair: André Baier, Dominik Beinert (Fraunhofer IEE)

Content / Abstract:
This session focuses on the application of artefitial intelligence in the energy sector. We are looking for talks from various related topics which explore the challenges and some of the employed solutions for the critcal energy infrastructure.

Topics of interest include:
- Forecasting generation and consumption
- State estimation for electrical grids
- Vegetation detection for overhead condutors
- Bird detection on wind sites
- Autonomous agents for grid operation und energy markets

Agenda
- Welcome: 5 min
- 4 contributed talks (each 15 min + 5 min discusison)
- Conclusion: 5 min

34 Remote sensing driven machine learning methods in the field of energy system analysis

The expansion of renewable energies is of crucial importance for the future of energy supply. There are numerous reasons for this change and highlight the need for a transition from fossil fuels to sustainable energy sources. Access to clean energy plays a central role in improving the quality of life and protecting our environment. A diverse data basis is essential for efficient implementation at the various levels.

In recent years, the number of satellites orbiting the earth has increased rapidly. They are used for a variety of applications. For example, satellite based services include global communication via. Mobile telephony and internet connections, navigation using GPS, weather forecasts based on weather data and the provision of up-to-date maps of the earth's surface for various mapping services are part of the daily habits of billions of people. Favorable drivers of advancing technologization and decreasing costs for satellite launches have led to an increasing number of different players such as countries and companies being able to operate satellites in Earth orbit. This results in large quantities of data collected by satellites, which is often made available at low cost or even free of charge. However, this is also accompanied by the great challenge of handling such enormous amounts of data. Methods from the field of machine learning can provide a remedy for handling the enormous amounts of data that arise in the field of remote sensing.

Machine learning methods offer a wide range of possible applications in data driven domains such as the financial industry, the automotive industry and also in the various areas of image-based processes. For example, recurring and conspicuous patterns can be identified in large data sets. Large amounts of data collected by satellites on land use, soil conditions, cover and other geographical features can be processed automatically using machine learning methods to obtain information that would otherwise be difficult or impossible to obtain.

When the two areas of remote sensing and machine learning are combined, a wide range of possibilities arise for various aspects of the energy system. For example, machine learning methods can be combined with aerial and satellite images to map the stock of renewable energy plants. Various studies have already dealt with the automated detection of PV, wind power, biogas and hydropower plants. The methods and data used vary greatly. In the planned presentation, 3 different studies on remote sensing-based machine learning for energy system analysis will be presented. The resulting findings will then be used to identify paths for the energy system landscape.

• The first article shows the extent to which semi-automated approaches can be used to create training patterns for object recognition in photovoltaic systems on roofs. It is shown that the time and effort
required for manual identification can be greatly reduced if existing spatial information is combined automatically. The article has already been published (Kleebauer et al. 2021). The methodology can also be used in a similar way to improve the location accuracy of wind turbines (Kleebauer et al. 2024).

• In a further contribution, varying training data will be examined with regard to their suitability for the detection of renewable energy plants. Various modern deep learning-based approaches for segmentation
will be combined and compared with a wide variety of aerial images and satellite images. (Kleebauer et a. 2023).

• In a third contribution, methods for image sharpening in satellite and aerial images will be investigated using various deep learning methods. Various popular architectures such as Generative Adversarial Networks and various Transformer Networks can be used here (Horst & Kleebauer 2022).

The results of the various contributions are then summarized and examined with regard to their future suitability, associated challenges and further potential in the area of the energy system landscape.

Speaker: Maximilian Kleebauer (Department of Energy Management and Power System Operation, University of Kassel; Energy Meteorology and Geo Information System, Fraunhofer IEE, Kassel)

Kleebauer_KonKis2024_Remote_sensing_driven_machine_learning_methods.pdf

35 Optimizing Renewable Energy Forecasts: An MLOps Conceptual Approach for Scalability

As the expansion of renewable energies grows, the need for accurate energy forecasts becomes crucial due to the dependency on volatile energy sources. Traditional forecasting systems, which utilize weather data and historical generation data, are challenged by the unique behaviors of individual power plants, lack of data and changing conditions (Yan et al. 2022). To address these challenges, we propose a highly scalable energy prediction system based on MLOps principles to ensure efficient model updates while adhering to appropriate quality criteria. This aims to improve the accuracy and efficiency of renewable energy forecasts, supporting a reliable energy supply in the dynamic energy sector.
The primary purpose of MLOps is to efficiently facilitate the deployment of ML models into production by eliminating bottlenecks in Development and Operations and automating the workflows (Subramanya et al. 2022). Building on these principles, we aim to develop a service mesh comprising multiple interacting microservices, which include a training service for both experimental and production environments, a forecasting service for operational forecasts, a centralized feature store that houses all necessary data including training, test, operational data, and master data, a model store for archiving models with their parameters and metrics, and a monitoring service to ensure prediction quality and service reliability.
The main challenge we address is the large number of assets, each requiring individual model predictions, necessitating a highly flexible and scalable ML pipeline. We employ dual training modes for initial and continuous model retraining within the same productive Kubernetes cluster used for inference. Furthermore, a separate model store for logging and tracking supports access at any stage of the ML pipeline (Alla and Adari 2021), complemented by a central feature store that enhances flexibility and adaptability by utilizing consistent data interfaces (Dowling 2023). For a high scalability of our inference service, we use Horizontal Pod Autoscaling provided by Kubernetes that automatically updates a workload resource to match request demand (The Kubernetes Authors 2024).
In summary, conventional static methods do not fulfill the growing requirements of increasingly frequent dynamic changes in modern energy systems. We therefore aim to use MLOps concepts to provide scalable services for the continuous improvement of forecasts under changing conditions.

Literature
Alla, Sridhar; Adari, Suman Kalyan (2021): Introduction to MLFlow. In Sridhar Alla, Suman Kalyan Adari (Eds.): Beginning MLOps with MLFlow. Berkeley, CA: Apress, pp. 125–227.
Dowling, John (2023): What is a Feature Store for Machine Learning? Available online at https://www.featurestore.org/what-is-a-feature-store, updated on 8/11/2023, checked on 5/17/2024.
Subramanya, Rakshith; Sierla, Seppo; Vyatkin, Valeriy (2022): From DevOps to MLOps: Overview and Application to Electricity Market Forecasting. In Applied Sciences 12 (19), p. 9851. DOI: 10.3390/app12199851.
The Kubernetes Authors (2024): Horizontal Pod Autoscaling. Available online at https://kubernetes.io/docs/tasks/run-application/horizontal-pod-autoscale/, updated on 2/18/2024, checked on 5/17/2024.
Yan, Jie; Möhrlen, Corinna; Göçmen, Tuhfe; Kelly, Mark; Wessel, Arne; Giebel, Gregor (2022): Uncovering wind power forecasting uncertainty sources and their propagation through the whole modelling chain. In Renewable and Sustainable Energy Reviews 165, p. 112519. DOI: 10.1016/j.rser.2022.112519.

Speaker: Raphael Riege (Fraunhofer IEE)

240517_KISSKI_Abstract_Optimizing_Renewable_Energy_Forecasts_MLOps.pdf

36 KPI Extraction from Maintenance Work Orders—A Comparison of Expert Labeling, Text Classification and AI-Assisted Tagging for Computing Failure Rates of Wind Turbines

Maintenance work orders are commonly used to document information about wind turbine operation and maintenance. This includes details about proactive and reactive wind turbine downtimes, such as preventative and corrective maintenance. However, the information contained in
maintenance work orders is often unstructured and difficult to analyze, presenting challenges for decision-makers wishing to use it for optimizing operation and maintenance. To address this issue,
this work compares three different approaches to calculating reliability key performance indicators from maintenance work orders. The first approach involves manual labeling of the maintenance work
orders by domain experts, using the schema defined in an industrial guideline to assign the label accordingly. The second approach involves the development of a model that automatically labels
the maintenance work orders using text classification methods. Through this method, we are able to achieve macro average and weighted average F1-scores of 0.75 and 0.85 respectively. The third technique uses an AI-assisted tagging tool to tag and structure the raw maintenance information, together with a novel rule-based approach for extracting relevant maintenance work orders for failure rate calculation. In our experiments, the AI-assisted tool leads to an 88% drop in tagging
time in comparison to the other two approaches, while expert labeling and text classification are more accurate in KPI extraction. Overall, our findings make extracting maintenance information from maintenance work orders more efficient, enable the assessment of reliability key performance indicators, and therefore support the optimization of wind turbine operation and maintenance.

Speaker: Bastian Schäfermeier (GNOI)

energies-16-07937-v2.pdf.pdf

🇬🇧 Workshop 3. Data Science & Research Data

Instructurs: Prof. Sören Auer, Dr. Markus Stocker, Dr. Oliver Karras (all University of Hannover LUH)

Agenda:

• Presentation of the Open Research Knowledge Graph for the organisation of research information
• Organisation of research data with Jupyter Notebooks
• Organisation of Energy Scenario Factsheets in the ORKG
• Ontology-based research data management

Target Group: Researchers in the field of AI medicine and energy, users of KISSKI and those interested in research data management

Prerequisites: None. A laptop ist usful, but not required.

Max. number of participants: 20

13:15 Mittagspause / Lunch Break

Oberes Foyer / Upper Foyer & Adam-von-Trott-Saal

🇩🇪 Podiumsdiskussion "AI made in Germany: Wie beschleunigen KI-Servicezentren den Transfer von KI-Anwendungen in Unternehmen? "

Zusammensetzung des Podiums

• Moderation: Holger Karl (Hasso-Plattner-Institut für Digital Engineering)
• Florian Kieser (HessianAI)
• Marie-Jolin Köster (Deutsche Krebsgsellschaft e.V., Berlin)
• Sophia Lenz (Zentrale Anlaufstelle für künstliche Intelligenz)
• Michael Markeev (Deutsche Bank)
• Pina Merkert
• Cornelius Scheffel (u-form Verlag und u-form Testsysteme)

Über die Mitglieder des Podiums

Marie-Jolin Köster (Deutsche Krebsgsellschaft e.V., Berlin)
Marie-Jolin Köster ist Anthropologin und leitet seit 2017 die Abteilung Wissensmanagement | INFONETZ KREBS der Deutschen Krebsgesellschaft e.V..
Die Abteilung erstellt evidenzbasierte Informationen zum Thema Krebs sowohl in Fachsprache als auch in allgemeinverständlicher Form. Das erste KI-Projekt startete sie im Jahr 2017 mit dem Ziel, maschinelles Lernen zur Bewältigung großer Datenmengen im Zusammenhang mit systematischen Literaturrecherchen einzusetzen. Derzeit arbeitet die Abteilung an einer KI-Anwendung zur Unterstützung der Textredaktion. Schwerpunkte der Arbeit von Frau Köster sind: Organisation von Wissen sowie Innovations- & Change-Management.

Michael Markeev (Deutsche Bank)
Michael Markeev arbeitet im Innovations-Team der Deutschen Bank in Berlin und verantwortet dort einige Projekte zur Erprobung generativer KI-Technologien im Bereich „Conversational AI“. Als Gründungsmitglied der bankinternen AI/ML Guild Berlin engagiert er sich in der Förderung und Vernetzung der internen KI-Community. Zuvor war er seit 2021 als AI Product Lead tätig und leitete mehrere Innovationsprojekte in unterschiedlichen Bereichen der Bank. Im Rahmen seiner Tätigkeit für das Innovationsteam arbeitete er intensiv mit Start-ups zusammen, um neueste Technologien aus den Bereichen KI, VR/AR und Data Privacy Engineering einzuführen.

Cornelius Scheffel (u-form Verlag und u-form Testsysteme)
Cornelius Scheffel blickt auf eine fast 40-jährige IT-Karriere zurück. Angefangen an Großrechnern über Apple II, PC und alles, was danach kam, war die darauf laufende Software und -architektur sein Steckenpferd. Nach anfänglichen vielen Jahren im Bereich der ERP-Softwarelösungen, hat er sich seit 2008 den Softwaresystemen rund um die duale Ausbildung verschrieben. Zu seinen Aufgabengebieten gehören neben dem aktuellen KI-Projekt mit WestAI die Softwarearchitektur und -entwicklungsprozess sowie der Betrieb der Lösungen in den Rechenzentren der u-form Gruppe.

🇬🇧 Workshop 3. Data Science & Research Data: Continued

Instructurs: Prof. Sören Auer, Dr. Markus Stocker, Dr. Oliver Karras (all University of Hannover LUH)

Agenda:

• Presentation of the Open Research Knowledge Graph for the organisation of research information
• Organisation of research data with Jupyter Notebooks
• Organisation of Energy Scenario Factsheets in the ORKG
• Ontology-based research data management

Target Group: Researchers in the field of AI medicine and energy, users of KISSKI and those interested in research data management

Prerequisites: None. A laptop ist usful, but not required.

Max. number of participants: 20

🇩🇪 🇬🇧 Industrieausstellung & Networking / Industrial Exhibition & Networking

🇩🇪 🇬🇧 Industrieausstellung & Networking / Industrial Exhibition & Networking

🇩🇪 Zusammenfassung & Abschluss / Summary & Good-Bye

Convener: Prof. Julian Kunkel (GWDG / Georg-August-Universität Göttingen)