Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DDPG Actor output saturate #3

Open
m5823779 opened this issue Jan 23, 2019 · 1 comment
Open

DDPG Actor output saturate #3

m5823779 opened this issue Jan 23, 2019 · 1 comment

Comments

@m5823779
Copy link

Hello~ I have some question about DDPG
When my action dimension = 1, the result is good, but when my action dimension = 2 (the activation function is tanh and sigmoid), the output of actor will saturate.
Here is the result what I said: https://github.com/m5823779/DDPG
By the way, I use batch normalization only in my actor network.
Do you know where is the problem?

@osigaud
Copy link
Collaborator

osigaud commented Jan 23, 2019

Hi,

This repo is old stuff (3 years without a commit). Things evolved a lot in deep RL meanwhile. Check OpenAI's website for the deep RL baselines, or spinning up. You'll find state-of-the-art algorithms with clean code. But this does not mean your DDPG won't saturate anymore...

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants