gaspersic/Gymnasium
1
0
Fork 0
mirror of https://github.com/Farama-Foundation/Gymnasium.git synced 2025-08-29 17:45:07 +00:00
Code Issues Packages Projects Releases Wiki Activity

Generalized Kelly Coinflip game: right, observation space has to match the sufficient statistics...

Browse Source
This commit is contained in:
gwern
2017-03-21 19:01:00 -04:00
committed by Trevor Blackwell
parent 1de6febf46
commit 7c813e87c2
1 changed files with 4 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

5
gym/envs/toy_text/kellycoinflip.py
View File

@@ -85,7 +85,10 @@ class KellyCoinflipGeneralizedEnv(gym.Env):
self.action_space = spaces.Discrete(maxWealth*100)
self.observation_space = spaces.Tuple((
spaces.Discrete(maxWealth*100+1),
spaces.Discrete(maxRounds+1)))
spaces.Discrete(maxRounds+1), # rounds elapsed
spaces.Discrete(maxRounds+1), # wins
spaces.Discrete(maxRounds+1), # losses
spaces.Discrete(maxWealth*100+1))) # maximum observed wealth
self.reward_range = (0, maxWealth)
self.edge = edge
self.wealth = initialWealth