
Sponsored Session: Lightning Talk: Accelerating Experimentation... - Niall Lyons & Luca Antiga
Sponsored Session: Lightning Talk: Accelerating Experimentation and Unlocking Real-Time Inference on Microcontrollers with Lightning - Niall Lyons, Infineon Technologies & Luca Antiga, Lightning AI
Join Luca Antiga, CTO of Lightning AI and early PyTorch core contributor, and Niall Lyons, Staff Deep Learning Researcher at Infineon Technologies.Learn first-hand how the Lightning platform streamlines model training and optimized inference by handling environment setup, scaling across heterogeneous hardware, and enabling rapid experimentation. Infineon will share how they applied Lightning to train and deploy sub 30MB language models on Cortex M55 and U55 microcontrollers, achieving inference under 100ms per token fully on device with no external compute. Learn how the Lightning platform enabled the Infineon team to accelerate experimentation and unlock real-time AI inference at the edge.
Join Luca Antiga, CTO of Lightning AI and early PyTorch core contributor, and Niall Lyons, Staff Deep Learning Researcher at Infineon Technologies.Learn first-hand how the Lightning platform streamlines model training and optimized inference by handling environment setup, scaling across heterogeneous hardware, and enabling rapid experimentation. Infineon will share how they applied Lightning to train and deploy sub 30MB language models on Cortex M55 and U55 microcontrollers, achieving inference under 100ms per token fully on device with no external compute. Learn how the Lightning platform enabled the Infineon team to accelerate experimentation and unlock real-time AI inference at the edge.
PyTorch
Welcome to the official PyTorch YouTube Channel. Learn about the latest PyTorch tutorials, new, and more.
PyTorch is an open source machine learning framework that is used by both researchers and developers to build, train, and deploy ML systems that so...
torch.compile and Diffusers: A Hands-On Guide to Peak Performance - Sayak Paul, Hugging Face
PyTorch
torch compile and Diffusers - A Hands On Guide to Peak Performance - PyTorch Compiler Series
PyTorch
verl: An Open Source Large Scale LLM RL Framework for Agentic Tasks - Yuxuan Tong, Bytedance
PyTorch
Lightning Talk: Sparsifying Vision Transformers with Minimal Accuracy Loss - Jesse Cai, Meta
PyTorch