Multi-GPU LLM Inference

Workshop Overview

• Introduction
• UVA HPC
• Multi-GPU Strategies
• Accelerate
• DeepSpeed
• vLLM
• Best Practices
• Wrap Up