Mixture of Experts

<p>In this episode we talk about the paper &quot;Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer&quot; by Noam Shazeer, Azalia Mirhoseini, Krzysztof Maziarz, Andy Davis, Quoc Le, Geoffrey Hinton, Jeff Dean.</p>