Commit Graph

19 Commits

Author SHA1 Message Date
Greg Brockman
517c2e0524 Tweak error message 2016-10-18 20:29:38 -07:00
Jie Tang
db4f977bcd Treat each directory as a single trial 2016-10-18 20:26:08 -07:00
Jie Tang
2dc3e56ac2 Don't check exact seeds for now 2016-10-18 12:05:01 -07:00
Jie Tang
6e0f83e9d5 Validate multiple seeds for benchmark 2016-10-17 17:56:14 -07:00
Jie Tang
422882913b Separate benchmark and evaluation control flow in upload(), add client side validation of benchmark contents 2016-10-09 20:49:49 -07:00
Greg Brockman
934b2acbb7 Add benchmark support (#338)
* Warn if seed doesn't return a list

* Add preliminary BenchmarkRun support

* Add experimental benchmark registration

* Flesh out interface

* Add preliminary BenchmarkRun support

* Warn if seed doesn't return a list

* Add experimental benchmark registration

* Flesh out interface

* Make benchmarkrun upload recursive

* Add evaluation episodes

* Add benchmark scoring

* Tweak reward locations

* Tweak scoring

* Clear default metadata in Wrapper

* Improve scoring

* Expose registry; fix test

* Add initial_reset_timestamp

* Add back algorithm; fix tests
2016-09-23 01:04:26 -07:00
Philip Paquette
f4ae35ea73 Wrappers - Added 'wrappers' and 'step_count' property + monitor support (#288)
* Wrappers - Added 'wrappers' and 'step_count' property + monitor support

* Removed step_count and wrappers from api and monitor

* Removed wrappers and name property
2016-08-13 10:25:19 -07:00
Jie Tang
d173281ea6 Remove algorithm id from example agents, add documentation to api.py 2016-06-01 11:16:29 -07:00
Greg Brockman
58e6aa95e5 [WIP] add support for seeding environments (#135)
* Make environments seedable

* Fix monitor bugs

- Set monitor_id before setting the infix. This was a bug that would yield incorrect results with multiple monitors.
- Remove extra pid from stats recorder filename. This should be purely cosmetic.

* Start uploading seeds in episode_batch

* Fix _bigint_from_bytes for python3

* Set seed explicitly in random_agent

* Pass through seed argument

* Also pass through random state to spaces

* Pass random state into the observation/action spaces

* Make all _seed methods return the list of used seeds

* Switch over to np.random where possible

* Start hashing seeds, and also seed doom engine

* Fixup seeding determinism in many cases

* Seed before loading the ROM

* Make seeding more Python3 friendly

* Make the MuJoCo skipping a bit more forgiving

* Remove debugging PDB calls

* Make setInt argument into raw bytes

* Validate and upload seeds

* Skip box2d

* Make seeds smaller, and change representation of seeds in upload

* Handle long seeds

* Fix RandomAgent example to be deterministic

* Handle integer types correctly in Python2 and Python3

* Try caching pip

* Try adding swap

* Add df and free calls

* Bump swap

* Bump swap size

* Try setting overcommit

* Try other sysctls

* Try fixing overcommit

* Try just setting overcommit_memory=1

* Add explanatory comment

* Add what's new section to readme

* BUG: Mark ElevatorAction-ram-v0 as non-deterministic for now

* Document seed

* Move nondetermistic check into spec
2016-05-29 09:07:09 -07:00
rafaelcp
2e26518b4f Fixes tar file generation for upload on Windows (#129)
* Fixes tar file generation for upload on Windows

The temp file cannot be added to the tar while open on Windows.

* Update api.py

* Rewritten with try..finally

* Fix indent.
2016-05-27 23:52:27 -07:00
Jie Tang
b92796ae89 Renaming close_registry to closer 2016-05-18 01:27:58 -07:00
Jie Tang
b578a22bef Refactor monitor to use CloseRegistry 2016-05-16 23:45:56 -07:00
Trevor Blackwell
d845b79a07 Allow resuming monitoring 2016-05-10 17:25:23 -07:00
John Schulman
b69df1b5f3 fix subsampling of videos 2016-05-02 22:43:17 -07:00
Jonas Schneider
7ec98ede9b Cast WeakRefDict to list first to ensure stability 2016-05-01 23:39:57 -04:00
Jonas Schneider
e45f945afd Python 3 encoding fixes
Closes #43.
2016-05-01 23:39:48 -04:00
Greg Brockman
98461ff8d8 Add env_id to log messages while uploading 2016-04-28 07:44:03 -07:00
Jonas Schneider
0a543edc72 gym.scoreboard: Correctly pass a given API key 2016-04-27 12:46:35 -07:00
Greg Brockman
e8f2980603 Initial release. Hello world :). 2016-04-27 08:00:58 -07:00