Soft Actor Critic is Easy in PyTorch | Complete Deep Reinforcement Learning Tutorial

The soft actor critic algorithm is an off policy actor critic method for dealing with reinforcement learning problems in continuous action spaces. It makes use of a novel framework that seeks to maximize the entropy of our agent. We’re going to write our very own SAC agent in PyTorch, starting from scratch.

We’re going to need to implement several classes for this project:

A Replay buffer to keep track of the states the agent encountered, the actions it took, and the rewards it received along the way.

A critic network that tells the agent how valuable it thinks the chosen actions were.

A value network that informs the agent how valuable each state is.

We will also make use of ideas from double Q learning, like taking the minimum of estimation from two critics, for our update rules for the value and actor network.

We will test our agent in the Inverted Pendulum environment from the PyBullet package, which is an open 3d rendering and physics engine.

Code for this video is here:

https://github.com/philtabor/Youtube-Code-Repository/tree/master/ReinforcementLearning/PolicyGradient/SAC

Learn how to turn deep reinforcement learning papers into code:

Deep Q Learning:
https://www.udemy.com/course/deep-q-learning-from-paper-to-code/?couponCode=DQN-OCT-21

Actor Critic Methods:
https://www.udemy.com/course/actor-critic-methods-from-paper-to-code-with-pytorch/?couponCode=AC-OCT-21

Curiosity Driven Deep Reinforcement Learning
https://www.udemy.com/course/curiosity-driven-deep-reinforcement-learning/?couponCode=ICM-OCTOBER-21

Natural Language Processing from First Principles:
https://www.udemy.com/course/natural-language-processing-from-first-principles/?couponCode=NLP1-OCT-21Reinforcement Learning Fundamentals
https://www.manning.com/livevideo/reinforcement-learning-in-motion

Here are some books / courses I recommend (affiliate links):
Grokking Deep Learning in Motion: https://bit.ly/3fXHy8W
Grokking Deep Learning: https://bit.ly/3yJ14gT
Grokking Deep Reinforcement Learning: https://bit.ly/2VNAXql

Come hang out on Discord here:
https://discord.gg/Zr4VCdv

Website: https://www.neuralnet.ai
Github: https://github.com/philtabor
Twitter: https://twitter.com/MLWithPhil

#SoftActorCritic #DeepReinforcementLearning #Pytorch

Source of this AI Video

AI video(s) you might be interested in …