The CXL Consortium will present “CXL for LLMs and Ray: A Practical Guide to Unleashing the Potential of AI and Machine Learning” at the SNIA Developer Conference (SDC) 2024.
CXL for LLMs and Ray: A Practical Guide to Unleashing the Potential of AI and Machine Learning
- Presenter: Steve Scargall (MemVerge)
- Date and Time: September 16 at 8:30 am PT
- Abstract: This session dives into the practical applications of CXL for AI/ML. We’ll explore how CXL Memory Expansion and Sharing can boost performance by breaking traditional memory barriers. Join us for a practical guide packed with insights showcasing CXL in action for:
- Faster LLM training & inference: Reduce training times for massive language models by providing near-memory access to critical datasets and deploying your LLMs in big memory environments.
- Supercharged Ray clusters: Enabling seamless in-memory data sharing between compute nodes unlocks the full potential of distributed computing frameworks like Ray.
- Learn how to leverage CXL to unleash the true potential of your AI and ML workloads and gain a competitive edge!