By default, the environment returns the RGB image that is displayed to human players as an observation. However, it is
possible to observe
- The 128 Bytes of RAM of the console
- A grayscale image
instead. The respective observation spaces are
-`Box([0 ... 0], [255 ... 255], (128,), uint8)`
- `Box([[0 ... 0]
...
[0 ... 0]], [[255 ... 255]
...
[255 ... 255]], (250, 160), uint8)
`
respectively. [The general article on Atari environments](https://brosa.ca/blog/ale-release-v0.7) outlines different ways to instantiate corresponding environments
via `gymnasium.make`.
### Rewards
The game ends when you complete the last mission or when you lose the last craft. In either case, you'll receive your final score.
There will be a rating based on your score. The highest rating in NOVICE is 006. The highest rating in AGENT is 007.
For a more detailed documentation, consult [the AtariAge page](https://atariage.com/manual_html_page.php?SoftwareLabelID=250).
A thorough discussion of the intricate differences between the versions and configurations can be found in the
general article on Atari environments.
* v5: Stickiness was added back and stochastic frameskipping was removed. The entire action space is used by default. The environments are now in the "ALE" namespace.