2016-09-21 14:55:04 -07:00
|
|
|
import argparse
|
|
|
|
import sys
|
2016-04-27 08:00:58 -07:00
|
|
|
|
|
|
|
import gym
|
Cleanup, removal of unmaintained code (#836)
* add dtype to Box
* remove board_game, debugging, safety, parameter_tuning environments
* massive set of breaking changes
- remove python logging module
- _step, _reset, _seed, _close => non underscored method
- remove benchmark and scoring folder
* Improve render("human"), now resizable, closable window.
* get rid of default step and reset in wrappers, so it doesn’t silently fail for people with underscore methods
* CubeCrash unit test environment
* followup fixes
* MemorizeDigits unit test envrionment
* refactored spaces a bit
fixed indentation
disabled test_env_semantics
* fix unit tests
* fixes
* CubeCrash, MemorizeDigits tested
* gym backwards compatibility patch
* gym backwards compatibility, followup fixes
* changelist, add spaces to main namespaces
* undo_logger_setup for backwards compat
* remove configuration.py
2018-01-25 18:20:14 -08:00
|
|
|
from gym import wrappers, logger
|
2016-04-27 08:00:58 -07:00
|
|
|
|
2021-07-29 02:26:34 +02:00
|
|
|
|
2016-04-27 08:00:58 -07:00
|
|
|
class RandomAgent(object):
|
2016-12-23 16:21:42 -08:00
|
|
|
"""The world's simplest agent!"""
|
2021-07-29 02:26:34 +02:00
|
|
|
|
2016-04-27 08:00:58 -07:00
|
|
|
def __init__(self, action_space):
|
|
|
|
self.action_space = action_space
|
|
|
|
|
|
|
|
def act(self, observation, reward, done):
|
|
|
|
return self.action_space.sample()
|
|
|
|
|
2021-07-29 02:26:34 +02:00
|
|
|
|
|
|
|
if __name__ == "__main__":
|
2016-09-21 14:55:04 -07:00
|
|
|
parser = argparse.ArgumentParser(description=None)
|
2021-07-29 12:42:48 -04:00
|
|
|
parser.add_argument("env_id", nargs="?", default="CartPole-v0", help="Select the environment to run")
|
2016-09-21 14:55:04 -07:00
|
|
|
args = parser.parse_args()
|
|
|
|
|
Cleanup, removal of unmaintained code (#836)
* add dtype to Box
* remove board_game, debugging, safety, parameter_tuning environments
* massive set of breaking changes
- remove python logging module
- _step, _reset, _seed, _close => non underscored method
- remove benchmark and scoring folder
* Improve render("human"), now resizable, closable window.
* get rid of default step and reset in wrappers, so it doesn’t silently fail for people with underscore methods
* CubeCrash unit test environment
* followup fixes
* MemorizeDigits unit test envrionment
* refactored spaces a bit
fixed indentation
disabled test_env_semantics
* fix unit tests
* fixes
* CubeCrash, MemorizeDigits tested
* gym backwards compatibility patch
* gym backwards compatibility, followup fixes
* changelist, add spaces to main namespaces
* undo_logger_setup for backwards compat
* remove configuration.py
2018-01-25 18:20:14 -08:00
|
|
|
# You can set the level to logger.DEBUG or logger.WARN if you
|
2016-09-21 14:55:04 -07:00
|
|
|
# want to change the amount of output.
|
Cleanup, removal of unmaintained code (#836)
* add dtype to Box
* remove board_game, debugging, safety, parameter_tuning environments
* massive set of breaking changes
- remove python logging module
- _step, _reset, _seed, _close => non underscored method
- remove benchmark and scoring folder
* Improve render("human"), now resizable, closable window.
* get rid of default step and reset in wrappers, so it doesn’t silently fail for people with underscore methods
* CubeCrash unit test environment
* followup fixes
* MemorizeDigits unit test envrionment
* refactored spaces a bit
fixed indentation
disabled test_env_semantics
* fix unit tests
* fixes
* CubeCrash, MemorizeDigits tested
* gym backwards compatibility patch
* gym backwards compatibility, followup fixes
* changelist, add spaces to main namespaces
* undo_logger_setup for backwards compat
* remove configuration.py
2018-01-25 18:20:14 -08:00
|
|
|
logger.set_level(logger.INFO)
|
2016-04-27 08:00:58 -07:00
|
|
|
|
2016-09-21 14:55:04 -07:00
|
|
|
env = gym.make(args.env_id)
|
2016-04-27 08:00:58 -07:00
|
|
|
|
|
|
|
# You provide the directory to write to (can be an existing
|
2016-05-26 13:44:14 -07:00
|
|
|
# directory, including one with existing data -- all monitor files
|
|
|
|
# will be namespaced). You can also dump to a tempdir if you'd
|
|
|
|
# like: tempfile.mkdtemp().
|
2021-07-29 02:26:34 +02:00
|
|
|
outdir = "/tmp/random-agent-results"
|
2016-12-27 16:10:23 -08:00
|
|
|
env = wrappers.Monitor(env, directory=outdir, force=True)
|
2016-10-31 22:20:02 -07:00
|
|
|
env.seed(0)
|
2016-05-29 09:07:09 -07:00
|
|
|
agent = RandomAgent(env.action_space)
|
2016-04-27 08:00:58 -07:00
|
|
|
|
2016-04-29 10:47:11 +02:00
|
|
|
episode_count = 100
|
2016-04-27 08:00:58 -07:00
|
|
|
reward = 0
|
|
|
|
done = False
|
|
|
|
|
2016-05-01 23:17:38 -04:00
|
|
|
for i in range(episode_count):
|
2016-04-27 08:00:58 -07:00
|
|
|
ob = env.reset()
|
2016-12-06 17:07:23 -08:00
|
|
|
while True:
|
2016-04-27 08:00:58 -07:00
|
|
|
action = agent.act(ob, reward, done)
|
|
|
|
ob, reward, done, _ = env.step(action)
|
|
|
|
if done:
|
|
|
|
break
|
2016-05-26 21:39:57 +03:00
|
|
|
# Note there's no env.render() here. But the environment still can open window and
|
|
|
|
# render if asked by env.monitor: it calls env.render('rgb_array') to record video.
|
|
|
|
# Video is not recorded every episode, see capped_cubic_video_schedule for details.
|
2016-04-27 08:00:58 -07:00
|
|
|
|
2016-12-23 16:21:42 -08:00
|
|
|
# Close the env and write monitor result info to disk
|
|
|
|
env.close()
|