10: Outracing champion Gran Turismo drivers with deep reinforcement learning

<p>We discuss Sony AI&apos;s accomplishment of creating a novel AI agent that can beat professional racers in Gran Turismo. Some topics include:<br/>- The crafting of rewards to make the agent behave nicely<br/>- What is QR-SAC?<br/>- How to deal with &quot;rare&quot; experiences in the replay buffer<br/><br/>Link to paper: https://www.nature.com/articles/s41586-021-04357-7</p>