Performance Tools for Machine and Deep Learning

Name: Performance Tools for Machine and Deep Learning
Start: 2023-10-26T09:00:00+02:00
End: 2023-10-26T16:00:00+02:00
Location: GWDG

Thursday 26 Oct 2023, 09:00 → 16:00 Europe/Berlin

GWDG

Description

In this workshop profiling and optimization tools for deep neural network will be presented. This will be accompanied by hands-on on GPU-systems. Tools to be presented are: Pytorch Profiler, DeepSpeed, Nsight Systems and LIKWID

- Introduction to Deep Learning Infrustructure
  
  Convener: Jack Ogaja
- 10:00
  
  Coffee Break
- Insights into Grete GPU System
  
  Conveners: Jack Ogaja, Tino Meisel
- 12:00
  
  Lunch Break
- Profiling Tools for Deep Learning Workflows
  
  Convener: Hauke Kirchner (GWDG)
- 14:30
  
  Coffeee Break
- Roofline Model for Deep Learning Workloads
  
  Convener: Jack Ogaja