670: LLaMA: GPT-3 performance, 10x smaller

<p>How does Meta AI&apos;s natural language model, LLaMa compare to the rest? Based on the Chinchilla scaling laws, LLaMa is designed to be smaller but more performant. But how exactly does it achieve this feat? It&apos;s all done by training a small model for a longer period of time. Discover how LLaMa compares to its competition, including GPT-3, in this week&apos;s episode. <br/><br/>Additional materials: <a href='https://www.superdatascience.com/670'>www.superdatascience.com/670</a><br/><br/>Interested in sponsoring a SuperDataScience Podcast episode? Visit <a href='https://www.jonkrohn.com/podcast'>JonKrohn.com/podcast</a> for sponsorship information.</p>