Past NCSA Training Events Repository

View archived training materials.

Modern deep learning challenges leverage increasingly larger datasets and more complex models. As a result, significant computational power is required to train models effectively and efficiently. Learning to distribute data across multiple GPUs during deep learning model training makes possible an incredible wealth of new applications utilizing deep learning. Additionally, the effective use of systems with multiple GPUs reduces training time, allowing for faster application development and much faster iteration cycles. Teams who are able to perform training using multiple GPUs will have an edge, building models trained on more data in shorter periods of time and with greater engineer productivity. This workshop teaches you techniques for data-parallel deep learning training on multiple GPUs to shorten the training time required for data-intensive applications. Working with deep learning tools, frameworks, and workflows to perform neural network training, you’ll learn how to decrease model training time by distributing data to multiple GPUs while retaining the accuracy of training on a single GPU.

This webinar introduces how to use the Message Passing Interface (MPI) to parallelize your scientific applications. MPI is the standard framework for parallel computing in distributed-memory systems. 

Topics include:

• The message-passing interface paradigm
• Core components of an MPI message: body, envelope
• MPI processes and communicators
• Collective communications: broadcast messages and reductions

This webinar, presented by QuEra Computing Inc., is the third installment in the NCSA Fall 2023 Quantum Tutorials series, which focuses on the programming aspects of quantum technologies. This webinar introduces the fundamentals of how to use Bloqade to solve quantum simulations and optimization problems. Note, this is session 2 of 2 on the subject of analog quantum computing with Bloqade.

• Fundamental concepts behind the dynamics of neutral atoms
  
  • Rabi oscillations 
  • The Rydberg blockade
• The analysis of one application for studying a problem of quantum magnetism

This webinar, presented by QuEra Computing Inc., is the second installment in the NCSA Fall 2023 Quantum Tutorials series, which focuses on the programming aspects of quantum technologies. This webinar provides an overview of neutral-atoms-based quantum computers. Note, this is session 1 of 2 on the subject of analog quantum computing with Bloqade.

Topics include:

• Basic concepts of neutral-atom quantum computing
  
  • How the machines operate
  • How qubits are defined
    
  • How quantum information is manipulated
• Basic functionalities of programming a neutral-atom device under the constraints of what is physically possible at Aquila, QuEra’s cloud-accessible quantum computer

This webinar introduces how to parallelize model scientific applications using OpenMP, a shared-memory application programming interface. This webinar builds on the Introduction to Parallel Computing on High-Performance Systems webinar.

Topics include, how to:

• Balance workloads to threads in parallel loops using different schedules (static, dynamic, guided)
• Tune your loop parallelization for optimal performance
• Explicitly declare data contexts (private, shared) to avoid race conditions and improve the quality of your code
• Use reduction clauses (additions, maximum and minimum values) to calculate properties without thread concurrency
• Use OpenMP library functions to span teams of threads, mix data and task parallelism, and insert barriers

This webinar is an introduction to parallel computing on high-performance systems and OpenMP; OpenMP is a standardized API for parallelizing Fortran, C, and C++ programs on shared-memory architectures. The core concepts in this webinar prepare you for more advanced or different parallel computing tools and techniques.

Topics include:

• Parallel computing terminology
• Programming models
• High-performance systems architecture
• Data and task parallelism
• Performance measurement
• Basic OpenMP parallelization

This webinar, hosted by the NCSA and NVIDIA, demonstrates how to accelerate Python codes with NVIDIA GPUs.

Topics include:

• An overview of GPU computing
• Drop-in replacements for SciPy and NumPy code through the CuPy library
  
• GPU acceleration for end-to-end data science workloads using NVIDIA RAPIDS
  
• Custom accelerated code without leaving the Python language using Numba

This webinar introduces the Illinois Campus Cluster Program (ICCP) and how to perform basic tasks in the cluster environment.

Topics include:

• About ICCP’s organization, resources, and examples of research applications
• Potential advantages of becoming an ICC investor or user
• How to access the cluster
• How to run codes, applications, and software
• How to transfer files from and to the cluster

This webinar opens the NCSA Fall 2023 Quantum Tutorials series, which focuses on the programming aspects of quantum technologies. This webinar introduces how to install and run IBM's Qiskit, navigate Qiskit's documentation, create and simulate quantum circuits, and interpret simulation results.

Topics include:

• Quantum circuits with IBM Qiskit
• Simulating quantum circuits with Qiskit
• Applications: quantum machine learning with Qiskit