Files

pzhokhov ab59de6922 mpi-less baselines (#689 )

* make baselines run without mpi wip

* squash-merged latest master

* further removing MPI references where unnecessary

* more MPI removal

* syntax and flake8

* MpiAdam becomes regular Adam if Mpi not present

* autopep8

* add assertion to test in mpi_adam; fix trpo_mpi failure without MPI on cartpole

* mpiless ddpg

2018-10-31 11:15:41 -07:00

__init__.py

add __init__.py

2017-08-27 22:36:24 -07:00

defaults.py

tighten flake8, autopep8 to fix trailing whitespaces and blank lines with whitespaces (#87 )

2018-09-11 13:18:43 -07:00

README.md

update readmes (#514 )

2018-08-16 14:53:49 -07:00

trpo_mpi.py

mpi-less baselines (#689 )

2018-10-31 11:15:41 -07:00

README.md

trpo_mpi

Original paper: https://arxiv.org/abs/1502.05477
Baselines blog post https://blog.openai.com/openai-baselines-ppo/
mpirun -np 16 python -m baselines.run --alg=trpo_mpi --env=PongNoFrameskip-v4 runs the algorithm for 40M frames = 10M timesteps on an Atari Pong. See help (-h) for more options.
python -m baselines.run --alg=trpo_mpi --env=Ant-v2 --num_timesteps=1e6 runs the algorithm for 1M timesteps on a Mujoco Ant environment.
also refer to the repo-wide README.md