9 Commits

Author	SHA1	Message	Date
Jie Tang	77568accd7	Thread episode lengths through when scoring, add tests	2017-02-13 12:29:11 -08:00
Jie Tang	f1f13a2de1	* Print local benchmark score ... * Turn off video recording for benchmark_runner * Add force argument to benchmark runner	2017-02-13 12:28:48 -08:00
Jie Tang	10f7e4ffb0	Go from decorator to constructor syntax for Monitor; add note to What's New	2016-12-28 13:08:47 -08:00
Tom Brown	2d44ed4968	Add Monitored wrapper (#434) ... * Add WIP Monitored wrapper * Remove irrelevant render after close monitor test * py27 compatibility * Fix test_benchmark * Move Monitored out of wrappers __init__ * Turn Monitored into a function that returns a Monitor class * Fix monitor tests * Remove deprecated test * Remove deprecated utility * Prevent duplicate wrapping, add test * Fix test * close env in tests to prevent writing to nonexistent file * Disable semisuper tests * typo * Fix failing spec * Fix monitoring on semisuper tasks * Allow disabling of duplicate check * Rename MonitorManager * Monitored -> Monitor * Clean up comments * Remove cruft	2016-12-23 16:21:42 -08:00
Jie Tang	ae95553ca7	Supply default algorithm name in sample upload code	2016-10-31 23:56:37 -07:00
Jie Tang	c46008bfae	Fix up benchmark runner to use new benchmark format	2016-10-20 22:19:03 -07:00
Jie Tang	d35c2f0480	minor tweak to benchmark runner helper	2016-10-17 17:56:14 -07:00
Jie Tang	8941313121	Make random benchmark runner script respect seeds	2016-10-17 17:56:14 -07:00
Jie Tang	953d56cb18	Example benchmark runner script	2016-10-09 20:49:53 -07:00