Files
Gymnasium/docs/environments/atari/demon_attack.md

96 lines
5.1 KiB
Markdown
Raw Normal View History

2022-09-13 20:27:34 +01:00
---
2023-02-15 01:30:47 +00:00
title: DemonAttack
2022-09-13 20:27:34 +01:00
---
2023-02-15 01:30:47 +00:00
# DemonAttack
2022-09-13 20:27:34 +01:00
```{figure} ../../_static/videos/atari/demon_attack.gif
2022-09-13 20:27:34 +01:00
:width: 120px
:name: DemonAttack
```
This environment is part of the <a href='..'>Atari environments</a>. Please read that page first for general information.
| | |
|---|---|
| Action Space | Discrete(6) |
| Observation Shape | (210, 160, 3) |
| Observation High | 255 |
| Observation Low | 0 |
| Import | `gymnasium.make("ALE/DemonAttack-v5")` |
For more DemonAttack variants with different observation and action spaces, see the variants section.
## Description
2023-02-15 01:30:47 +00:00
You are facing waves of demons in the ice planet of Krybor. Points are accumulated by destroying demons. You begin with 3 reserve bunkers, and can increase its number (up to 6) by avoiding enemy attacks. Each attack wave you survive without any hits, grants you a new bunker. Every time an enemy hits you, a bunker is destroyed. When the last bunker falls, the next enemy hit will destroy you and the game ends.
2022-09-13 20:27:34 +01:00
For a more detailed documentation, see [the AtariAge page](https://atariage.com/manual_html_page.php?SoftwareLabelID=135)
2022-09-13 20:27:34 +01:00
## Actions
2023-02-15 01:30:47 +00:00
DemonAttack has the action space `Discrete(6)` with the table below lists the meaning of each action's meanings.
As DemonAttack uses a reduced set of actions for `v0`, `v4` and `v5` versions of the environment.
To enable all 18 possible actions that can be performed on an Atari 2600, specify `full_action_space=True` during
initialization or by passing `full_action_space=True` to `gymnasium.make`.
| Value | Meaning | Value | Meaning | Value | Meaning |
|---------|-----------|---------|-------------|---------|------------|
| `0` | `NOOP` | `1` | `FIRE` | `2` | `RIGHT` |
| `3` | `LEFT` | `4` | `RIGHTFIRE` | `5` | `LEFTFIRE` |
2022-09-13 20:27:34 +01:00
2023-02-15 01:30:47 +00:00
## Observations
2023-02-15 01:30:47 +00:00
Atari environment have two possible observation types, the observation space is listed below.
See variants section for the type of observation used by each environment id.
2022-09-13 20:27:34 +01:00
2023-02-15 01:30:47 +00:00
- `obs_type="rgb" -> observation_space=Box(0, 255, (210, 160, 3), np.uint8)`
- `obs_type="ram" -> observation_space=Box(0, 255, (128,), np.uint8)`
2022-09-13 20:27:34 +01:00
2023-02-15 01:30:47 +00:00
Additionally, `obs_type="grayscale"` cause the environment return a grayscale version of the rgb array for observations with the observation space being `Box(0, 255, (210, 160), np.uint8)`
2022-09-13 20:27:34 +01:00
### Rewards
2022-09-13 20:27:34 +01:00
Each enemy you slay gives you points. The amount of points depends on the type of demon and which
wave you are in. A detailed table of scores is provided on [the AtariAge
page](https://atariage.com/manual_html_page.php?SoftwareLabelID=135).
2023-02-15 01:30:47 +00:00
## Variants
DemonAttack has the following variants of the environment id which have the following differences in observation,
the number of frame-skips and the repeat action probability.
| Env-id | obs_type= | frameskip= | repeat_action_probability= |
|---------------------------------|-------------|--------------|------------------------------|
| DemonAttack-v0 | `"rgb"` | `(2, 5)` | `0.25` |
| DemonAttack-ram-v0 | `"ram"` | `(2, 5)` | `0.25` |
| DemonAttack-ramDeterministic-v0 | `"ram"` | `4` | `0.25` |
| DemonAttack-ramNoFrameskip-v0 | `"ram"` | `1` | `0.25` |
| DemonAttackDeterministic-v0 | `"rgb"` | `4` | `0.25` |
| DemonAttackNoFrameskip-v0 | `"rgb"` | `1` | `0.25` |
| DemonAttack-v4 | `"rgb"` | `(2, 5)` | `0.0` |
| DemonAttack-ram-v4 | `"ram"` | `(2, 5)` | `0.0` |
| DemonAttack-ramDeterministic-v4 | `"ram"` | `4` | `0.0` |
| DemonAttack-ramNoFrameskip-v4 | `"ram"` | `1` | `0.0` |
| DemonAttackDeterministic-v4 | `"rgb"` | `4` | `0.0` |
| DemonAttackNoFrameskip-v4 | `"rgb"` | `1` | `0.0` |
| ALE/DemonAttack-v5 | `"rgb"` | `4` | `0.25` |
| ALE/DemonAttack-ram-v5 | `"ram"` | `4` | `0.25` |
## Difficulty and modes
2022-09-13 20:27:34 +01:00
It is possible to specify various flavors of the environment via the keyword arguments `difficulty` and `mode`.
2023-02-15 01:30:47 +00:00
A flavor is a combination of a game mode and a difficulty setting. The table below lists the possible difficulty and mode values
along with the default values.
2022-09-13 20:27:34 +01:00
2023-02-15 01:30:47 +00:00
| Available Modes | Default Mode | Available Difficulties | Default Difficulty |
|-------------------|----------------|--------------------------|----------------------|
| `[1, 3, 5, 7]` | `1` | `[0, 1]` | `0` |
2022-09-13 20:27:34 +01:00
## Version History
2023-02-15 01:30:47 +00:00
A thorough discussion of the intricate differences between the versions and configurations can be found in the general article on Atari environments.
2022-09-13 20:27:34 +01:00
2023-02-15 01:30:47 +00:00
* v5: Stickiness was added back and stochastic frameskipping was removed. The environments are now in the "ALE" namespace.
2022-09-13 20:27:34 +01:00
* v4: Stickiness of actions was removed
2023-02-15 01:30:47 +00:00
* v0: Initial versions release