Files
Gymnasium/docs/environments/atari/centipede.md

94 lines
5.3 KiB
Markdown
Raw Normal View History

2022-09-13 20:27:34 +01:00
---
title: Centipede
---
2022-09-13 20:27:34 +01:00
# Centipede
```{figure} ../../_static/videos/atari/centipede.gif
2022-09-13 20:27:34 +01:00
:width: 120px
:name: Centipede
```
This environment is part of the <a href='..'>Atari environments</a>. Please read that page first for general information.
| | |
|---|---|
| Action Space | Discrete(18) |
| Observation Space | Box(0, 255, (210, 160, 3), uint8) |
| Import | `gymnasium.make("ALE/Centipede-v5")` |
For more Centipede variants with different observation and action spaces, see the variants section.
## Description
2023-02-15 01:30:47 +00:00
You are an elf and must use your magic wands to fend off spiders, fleas and centipedes. Your goal is to protect mushrooms in an enchanted forest. If you are bitten by a spider, flea or centipede, you will be temporally paralyzed and you will lose a magic wand. The game ends once you have lost all wands. You may receive additional wands after scoring a sufficient number of points.
For a more detailed documentation, see [the AtariAge page](https://atariage.com/manual_html_page.php?SoftwareID=911)
2022-09-13 20:27:34 +01:00
## Actions
Centipede has the action space `Discrete(18)` with the table below listing the meaning of each action's meanings.
2023-02-15 01:30:47 +00:00
As Centipede uses the full set of actions then specifying `full_action_space=True` will not modify the action space of the environment if passed to `gymnasium.make`.
| Value | Meaning | Value | Meaning | Value | Meaning |
|---------|--------------|---------|-----------------|---------|----------------|
| `0` | `NOOP` | `1` | `FIRE` | `2` | `UP` |
| `3` | `RIGHT` | `4` | `LEFT` | `5` | `DOWN` |
| `6` | `UPRIGHT` | `7` | `UPLEFT` | `8` | `DOWNRIGHT` |
| `9` | `DOWNLEFT` | `10` | `UPFIRE` | `11` | `RIGHTFIRE` |
| `12` | `LEFTFIRE` | `13` | `DOWNFIRE` | `14` | `UPRIGHTFIRE` |
| `15` | `UPLEFTFIRE` | `16` | `DOWNRIGHTFIRE` | `17` | `DOWNLEFTFIRE` |
2022-09-13 20:27:34 +01:00
## Observations
Atari environments have three possible observation types: `"rgb"`, `"grayscale"` and `"ram"`.
2023-02-15 01:30:47 +00:00
- `obs_type="rgb" -> observation_space=Box(0, 255, (210, 160, 3), np.uint8)`
- `obs_type="ram" -> observation_space=Box(0, 255, (128,), np.uint8)`
- `obs_type="grayscale" -> Box(0, 255, (210, 160), np.uint8)`, a grayscale version of the "rgb" type
See variants section for the type of observation used by each environment id by default.
2022-09-13 20:27:34 +01:00
2024-02-05 15:26:56 +00:00
## Rewards
You score points by hitting centipedes, scorpions, fleas and spiders. Additional points are awarded after every round (i.e. after you have lost a wand) for mushrooms that were not destroyed. Detailed documentation can be found on the [AtariAge page](https://atariage.com/manual_html_page.php?SoftwareID=911).
2022-09-13 20:27:34 +01:00
2023-02-15 01:30:47 +00:00
## Variants
Centipede has the following variants of the environment id which have the following differences in observation,
the number of frame-skips and the repeat action probability.
| Env-id | obs_type= | frameskip= | repeat_action_probability= |
|-------------------------------|-------------|--------------|------------------------------|
| Centipede-v0 | `"rgb"` | `(2, 5)` | `0.25` |
| Centipede-ram-v0 | `"ram"` | `(2, 5)` | `0.25` |
| Centipede-ramDeterministic-v0 | `"ram"` | `4` | `0.25` |
| Centipede-ramNoFrameskip-v0 | `"ram"` | `1` | `0.25` |
| CentipedeDeterministic-v0 | `"rgb"` | `4` | `0.25` |
| CentipedeNoFrameskip-v0 | `"rgb"` | `1` | `0.25` |
| Centipede-v4 | `"rgb"` | `(2, 5)` | `0.0` |
| Centipede-ram-v4 | `"ram"` | `(2, 5)` | `0.0` |
| Centipede-ramDeterministic-v4 | `"ram"` | `4` | `0.0` |
| Centipede-ramNoFrameskip-v4 | `"ram"` | `1` | `0.0` |
| CentipedeDeterministic-v4 | `"rgb"` | `4` | `0.0` |
| CentipedeNoFrameskip-v4 | `"rgb"` | `1` | `0.0` |
| ALE/Centipede-v5 | `"rgb"` | `4` | `0.25` |
| ALE/Centipede-ram-v5 | `"ram"` | `4` | `0.25` |
## Difficulty and modes
2022-09-13 20:27:34 +01:00
It is possible to specify various flavors of the environment via the keyword arguments `difficulty` and `mode`.
2023-02-15 01:30:47 +00:00
A flavor is a combination of a game mode and a difficulty setting. The table below lists the possible difficulty and mode values
along with the default values.
2022-09-13 20:27:34 +01:00
2023-02-15 01:30:47 +00:00
| Available Modes | Default Mode | Available Difficulties | Default Difficulty |
|-------------------|----------------|--------------------------|----------------------|
| `[22, 86]` | `22` | `[0]` | `0` |
2022-09-13 20:27:34 +01:00
## Version History
2023-02-15 01:30:47 +00:00
A thorough discussion of the intricate differences between the versions and configurations can be found in the general article on Atari environments.
2022-09-13 20:27:34 +01:00
2023-02-15 01:30:47 +00:00
* v5: Stickiness was added back and stochastic frameskipping was removed. The environments are now in the "ALE" namespace.
2022-09-13 20:27:34 +01:00
* v4: Stickiness of actions was removed
2023-02-15 01:30:47 +00:00
* v0: Initial versions release