Session 5

• GPU Paralellism in HPC
  • Kernel Function
  • Device Functions
  • Thread Indexing
• Memory Management
• Streams
• Vectorization in GPU
  • How the Return Works
• Reduction in GPU
• Distributed Parallelism
  • Overview Diagram
  • Step-by-Step Code Explanation
    • Initialize MPI
    • Define Problem Size
    • Create Arrays on Root Process
    • Allocate Buffers for Chunks
    • Distribute the Work (Scatter)
    • Perform Computation
    • Gather Results to Root
    • Print Final Result
  • Summary Table
• Exercise 8
  • Launch Jupyter Notebook
• Exercise 9