Lineage Driven Fault Injection [Kolton Andrus]

<p>The theoretical foundation of Chaos Engineering.</p><p>Audio source: Gremlin Podcast <a href="https://www.gremlin.com/blog/podcast-break-things-on-purpose-ep-9-kolton-andrus-ceo-and-co-founder-at-gremlin/">https://www.gremlin.com/blog/podcast-break-things-on-purpose-ep-9-kolton-andrus-ceo-and-co-founder-at-gremlin/</a> (33 mins in)</p><p><strong>Reading</strong></p><ul> <li>Lineage Driven Fault Injection - <a href="https://people.ucsc.edu/~palvaro/socc16.pdf">Paper</a>, <a href="https://medium.com/becloudy/chaos-engineering-review-lineage-driven-failure-injection-ldfi-a1c831abe504">Review</a> </li> <li> <a href="https://netflixtechblog.com/fit-failure-injection-testing-35d8e2a9bb2">Failure Injection Testing</a> at Netflix</li> <li> <a href="https://netflixtechblog.com/chap-chaos-automation-platform-53e6d528371f">ChAP: Chaos Automation Platform</a> at Netflix</li> </ul><p><br><strong>Transcript</strong><br><strong><br>Rich Burroughs:</strong> Hey, so to shift gears a little bit Kolton, so you're one of the authors of a paper about Lineage Driven Fault Injection or LDFI. And I tried to read that paper and it was a bit over my head. So, I'm hoping you can explain to me and the listeners like we're five years old what LDFI is.</p><p><strong><br>Kolton Andrus:</strong> Yes, it's both a mouthful and as an academic paper, it can be a little hard to digest. There is the Netflix tech blog where we try to show some pictures and simplify it for folks that may be about to follow along at home. So the idea behind Lineage Driven Fault Injection is systems really stay up because there's some amount of redundancy. Whether it's hardware redundancy, a host failed, we had another host to take its place, or it's a logical redundancy. We had a bit of code and it failed, but we have some other way to fill that data or to have a fallback for that data.</p><p><strong><br>Kolton Andrus:</strong> And so the key idea was, if we have some way to walk the system, we have some way to graph it, think like tracing, and we can see ho