Performance Tools for Machine and Deep Learning

Thursday Oct 26, 2023, 9:00 AM → 4:00 PM Europe/Berlin

GWDG

In this workshop profiling and optimization tools for deep neural network will be presented. This will be accompanied by hands-on on GPU-systems. Tools to be presented are: Pytorch Profiler, DeepSpeed, Nsight Systems and LIKWID 

9:00 AM → 10:00 AM Introduction to Deep Learning Infrustructure

Convener: Jack Ogaja

10:00 AM → 10:15 AM Coffee Break

10:15 AM → 12:00 PM Insights into Grete GPU System

Conveners: Jack Ogaja, Tino Meisel

12:00 PM → 1:00 PM Lunch Break

1:00 PM → 2:30 PM Profiling Tools for Deep Learning Workflows

Convener: Hauke Kirchner (GWDG)

2:30 PM → 2:45 PM Coffeee Break

2:45 PM → 4:00 PM Roofline Model for Deep Learning Workloads

Convener: Jack Ogaja