gaspersic/baselines
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

refactor ACER (#664)

Browse Source 
* make acer use vecframestack

* acer passes mnist test with 20k steps

* acer with non-image observations and tests

* flake8

* test acer serialization with non-recurrent policies
This commit is contained in:
pzhokhov
2018-10-23 10:01:25 -07:00
committed by GitHub
parent 4ed1350326
commit 014a5597b1
8 changed files with 118 additions and 61 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
baselines/run.py
View File

@@ -91,9 +91,7 @@ def build_env(args):
env_type, env_id = get_env_type(args.env)
if env_type in {'atari', 'retro'}:
if alg == 'acer':
env = make_vec_env(env_id, env_type, nenv, seed)
elif alg == 'deepq':
if alg == 'deepq':
env = make_env(env_id, env_type, seed=seed, wrapper_kwargs={'frame_stack': True})
elif alg == 'trpo_mpi':
env = make_env(env_id, env_type, seed=seed)