What runs ChatGPT? Inside Microsoft's AI supercomputer | Featuring Mark Russinovich

<p>Get an inside look at the AI supercomputer infrastructure built to run ChatGPT and other large language models, and see how to leverage it for your workloads in Azure, at any scale.</p> <p>Go behind the scenes:<br /> -For how we collaborated with NVIDIA to deliver purpose-built AI infrastructure with NVIDIA GPUs<br /> -How Project Forge checkpointing works to restore job states if a long training job fails or needs to be migrated<br /> -How we used LoRA fine-tuning to update a fraction of the base model for more training throughput and smaller checkpoints<br /> -How UK-based company, Wayve, is using Azure's AI supercomputer infrastructure for self-driving cars<br /> -And how Confidential Computing works with Azure AI to combine datasets without sharing personally identifiable information for secure multiparty collaborations.</p> <p>Mark Russinovich, Azure CTO, joins Jeremy Chapman to break it down.</p> <p>► QUICK LINKS:<br /> 00:00 - Introduction<br /> 01:15 - AI innovation building specialized hardware and software<br /> 04:22 - Optimizing hardware<br /> 05:40 - Improved throughput<br /> 06:17 - Project Forge<br /> 08:01 - Project Forge checkpointing demo<br /> 10:02 - LoRA fine tuning<br /> 11:29 - Use AI supercomputer infrastructure for your workloads<br /> 12:34 - How Wayve is leveraging AI supercomputer infrastructure ​​<br /> 13:47 - How Confidential Computing works with Azure AI<br /> 15:21 - Wrap up</p> <p>► Link References:</p> <p>Leverage Azure AI capabilities for yourself at <a href= "https://aka.ms/AzureAIInfrastructure">https://aka.ms/AzureAIInfrastructure</a></p> <p>► Unfamiliar with Microsoft Mechanics?<br /> As Microsoft's official video series for IT, you can watch and share valuable content and demos of current and upcoming tech from the people who build it at Microsoft.</p> <p>• Subscribe to our YouTube: <a href= "https://www.youtube.com/c/MicrosoftMechanicsSeries">https://www.youtube.com/c/MicrosoftMechanicsSeries</a></p> <p>• Talk with other IT Pros, join us on the Microsoft Tech Community