mirror of
https://github.com/Farama-Foundation/Gymnasium.git
synced 2025-08-01 22:11:25 +00:00
90 lines
3.9 KiB
Markdown
90 lines
3.9 KiB
Markdown
---
|
|
title: Breakout
|
|
---
|
|
# Breakout
|
|
|
|
```{figure} ../../_static/videos/atari/breakout.gif
|
|
:width: 120px
|
|
:name: Breakout
|
|
```
|
|
|
|
This environment is part of the <a href='..'>Atari environments</a>. Please read that page first for general information.
|
|
|
|
| | |
|
|
|-------------------|-------------------------------------|
|
|
| Action Space | Discrete(18) |
|
|
| Observation Space | (210, 160, 3) |
|
|
| Observation High | 255 |
|
|
| Observation Low | 0 |
|
|
| Import | `gymnasium.make("ALE/Breakout-v5")` |
|
|
|
|
### Description
|
|
Another famous Atari game. The dynamics are similar to pong: You move a paddle and hit the ball in a brick wall at the
|
|
top of the screen. Your goal is to destroy the brick wall. You can try to break through the wall and let the ball
|
|
wreak havoc on the other side, all on its own! You have five lives.
|
|
Detailed documentation can be found on [the AtariAge page](https://atariage.com/manual_html_page.php?SoftwareID=889).
|
|
|
|
### Actions
|
|
By default, all actions that can be performed on an Atari 2600 are available in this environment.
|
|
However, if you use v0 or v4 or specify `full_action_space=False` during initialization, only a reduced
|
|
number of actions (those that are meaningful in this game) are available. The reduced action space may depend
|
|
on the flavor of the environment (the combination of `mode` and `difficulty`). The reduced action space for the default
|
|
flavor looks like this:
|
|
|
|
| Num | Action |
|
|
|-----|--------|
|
|
| 0 | NOOP |
|
|
| 1 | FIRE |
|
|
| 2 | RIGHT |
|
|
| 3 | LEFT |
|
|
|
|
### Observations
|
|
By default, the environment returns the RGB image that is displayed to human players as an observation. However, it is
|
|
possible to observe
|
|
- The 128 Bytes of RAM of the console
|
|
- A grayscale image
|
|
|
|
instead. The respective observation spaces are
|
|
- `Box([0 ... 0], [255 ... 255], (128,), uint8)`
|
|
- `Box([[0 ... 0]
|
|
...
|
|
[0 ... 0]], [[255 ... 255]
|
|
...
|
|
[255 ... 255]], (250, 160), uint8)
|
|
`
|
|
|
|
respectively. The general article on Atari environments outlines different ways to instantiate corresponding environments
|
|
via `gymnasium.make`.
|
|
|
|
|
|
### Rewards
|
|
You score points by destroying bricks in the wall. The reward for destroying a brick depends on the color of the brick.
|
|
For a more detailed documentation, see [the AtariAge page](https://atariage.com/manual_html_page.php?SoftwareID=889).
|
|
|
|
### Arguments
|
|
|
|
```
|
|
env = gymnasium.make("ALE/Breakout-v5")
|
|
```
|
|
|
|
The various ways to configure the environment are described in detail in the article on Atari environments.
|
|
It is possible to specify various flavors of the environment via the keyword arguments `difficulty` and `mode`.
|
|
A flavor is a combination of a game mode and a difficulty setting.
|
|
|
|
| Environment | Valid Modes | Valid Difficulties | Default Mode |
|
|
|-------------|-------------------------------------------------|--------------------|--------------|
|
|
| Breakout | `[0, 4, 8, 12, 16, 20, 24, 28, 32, 36, 40, 44]` | `[0, 1]` | `0` |
|
|
|
|
You may use the suffix "-ram" to switch to the RAM observation space. In v0 and v4, the suffixes "Deterministic" and "NoFrameskip"
|
|
are available. These are no longer supported in v5. In order to obtain equivalent behavior, pass keyword arguments to `gymnasium.make` as outlined in
|
|
the general article on Atari environments.
|
|
The versions v0 and v4 are not contained in the "ALE" namespace. I.e. they are instantiated via `gymnasium.make("Breakout-v0")`.
|
|
|
|
### Version History
|
|
A thorough discussion of the intricate differences between the versions and configurations can be found in the
|
|
general article on Atari environments.
|
|
|
|
* v5: Stickiness was added back and stochastic frameskipping was removed. The entire action space is used by default. The environments are now in the "ALE" namespace.
|
|
* v4: Stickiness of actions was removed
|
|
* v0: Initial versions release (1.0.0)
|