16 Commits

Author	SHA1	Message	Date
Greg Brockman	7b5aceaa84	Remove scoreboard references (#750)	2017-10-15 16:10:02 -07:00
Jie Tang	77568accd7	Thread episode lengths through when scoring, add tests	2017-02-13 12:29:11 -08:00
Jie Tang	f1f13a2de1	* Print local benchmark score ... * Turn off video recording for benchmark_runner * Add force argument to benchmark runner	2017-02-13 12:28:48 -08:00
Jie Tang	10f7e4ffb0	Go from decorator to constructor syntax for Monitor; add note to What's New	2016-12-28 13:08:47 -08:00
Tom Brown	68c66b9a00	Kill timestep_limit	2016-12-28 13:08:47 -08:00
Tom Brown	2d44ed4968	Add Monitored wrapper (#434) ... * Add WIP Monitored wrapper * Remove irrelevant render after close monitor test * py27 compatibility * Fix test_benchmark * Move Monitored out of wrappers __init__ * Turn Monitored into a function that returns a Monitor class * Fix monitor tests * Remove deprecated test * Remove deprecated utility * Prevent duplicate wrapping, add test * Fix test * close env in tests to prevent writing to nonexistent file * Disable semisuper tests * typo * Fix failing spec * Fix monitoring on semisuper tasks * Allow disabling of duplicate check * Rename MonitorManager * Monitored -> Monitor * Clean up comments * Remove cruft	2016-12-23 16:21:42 -08:00
Jie Tang	ae95553ca7	Supply default algorithm name in sample upload code	2016-10-31 23:56:37 -07:00
Jie Tang	c46008bfae	Fix up benchmark runner to use new benchmark format	2016-10-20 22:19:03 -07:00
Jie Tang	d35c2f0480	minor tweak to benchmark runner helper	2016-10-17 17:56:14 -07:00
Jie Tang	8941313121	Make random benchmark runner script respect seeds	2016-10-17 17:56:14 -07:00
Jie Tang	953d56cb18	Example benchmark runner script	2016-10-09 20:49:53 -07:00
Greg Brockman	934b2acbb7	Add benchmark support (#338) ... * Warn if seed doesn't return a list * Add preliminary BenchmarkRun support * Add experimental benchmark registration * Flesh out interface * Add preliminary BenchmarkRun support * Warn if seed doesn't return a list * Add experimental benchmark registration * Flesh out interface * Make benchmarkrun upload recursive * Add evaluation episodes * Add benchmark scoring * Tweak reward locations * Tweak scoring * Clear default metadata in Wrapper * Improve scoring * Expose registry; fix test * Add initial_reset_timestamp * Add back algorithm; fix tests	2016-09-23 01:04:26 -07:00
Shu Shen	168f25b976	Fix Python3 compatibility in Go env (#64) ... Under Python3, user inputs are in string format and needs be converted into bytes before passing to pachi-py. The returned __repr__ from pachi-py for the boards are bytes and needs be converted into string for line breaks to work. Also fixed raw_input and print functions in play_go under examples/scripts with six package.	2016-05-09 19:18:55 -07:00
John Schulman	69ef2a76f3	use raw_input instead of opencv	2016-05-07 21:01:05 -04:00
Jonas Schneider	688629c070	Replace xrange -> range in example scripts	2016-05-01 23:17:38 -04:00
Greg Brockman	e8f2980603	Initial release. Hello world :).	2016-04-27 08:00:58 -07:00