SDS 559: GPT-3 for Natural Language Processing

<p>Natural language processing expert and PhD student Melanie Subbiah sits down with Jon Krohn to discuss GPT-3, its strengths and weaknesses, and the future of NLP.</p><p>In this episode you will learn:<br/>• What is GPT-3? [6:24]<br/>• The strengths and weaknesses of GPT-3 [14:38]<br/>• What is autoregression? [18:03]<br/>• GPT-3&apos;s new fine-tuning abilities [20:02]<br/>• Bias issues with GPT-3 [22:47]<br/>• The future of natural language processing models [27:54]<br/>• How Melanie ended up working at OpenAI [38:13]<br/>• Melanie’s self-study process [42:19]<br/>• Melanie&apos;s work on OpenAI API [45:45]<br/>• How to address the climate change and bias issues that cloud discussions of large natural language models [49:40]<br/>• Why Melanie chose to do a PhD at Columbia University [1:01:17]<br/>• The machine learning tools Melanie’s most excited about [1:08:09]</p><p>Additional materials: <a href='https://gate.sc/?url=http%3A%2F%2Fwww.superdatascience.com%2F559&amp;token=65f7b3-1-1647936874570'>www.superdatascience.com/559</a></p>