Files
Gymnasium/docs/environments/atari/freeway.md
Manuel Goulão 91769fc862 Add docs (#13)
2022-09-13 20:27:34 +01:00

4.7 KiB

title
title
Freeway

Freeway

:width: 120px
:name: Freeway

This environment is part of the Atari environments. Please read that page first for general information.

Action Space Discrete(18)
Observation Space (210, 160, 3)
Observation High 255
Observation Low 0
Import gymnasium.make("ALE/Freeway-v5")

Description

your objective is to guide your chicken across lane after lane of busy rush hour traffic. You receive a point for every chicken that makes it to the top of the screen after crossing all the lanes of traffic. Detailed documentation can be found on the AtariAge page.

Rewards

The exact reward dynamics depend on the environment and are usually documented in the game's manual. You can find these manuals on AtariAge.

Atari environments are simulated via the Arcade Learning Environment (ALE) [1].

Action Space

The action space a subset of the following discrete set of legal actions:

Num Action
0 NOOP
1 FIRE
2 UP
3 RIGHT
4 LEFT
5 DOWN
6 UPRIGHT
7 UPLEFT
8 DOWNRIGHT
9 DOWNLEFT
10 UPFIRE
11 RIGHTFIRE
12 LEFTFIRE
13 DOWNFIRE
14 UPRIGHTFIRE
15 UPLEFTFIRE
16 DOWNRIGHTFIRE
17 DOWNLEFTFIRE

If you use v0 or v4 and the environment is initialized via make, the action space will usually be much smaller since most legal actions don't have any effect. Thus, the enumeration of the actions will differ. The action space can be expanded to the full legal space by passing the keyword argument full_action_space=True to make.

The reduced action space of an Atari environment may depend on the flavor of the game. You can specify the flavor by providing the arguments difficulty and mode when constructing the environment. This documentation only provides details on the action spaces of default flavors.

Observations

By default, the environment returns the RGB image that is displayed to human players as an observation. However, it is possible to observe

  • The 128 Bytes of RAM of the console
  • A grayscale image

instead. The respective observation spaces are

  • Box([0 ... 0], [255 ... 255], (128,), uint8)
  • Box([[0 ... 0] ... [0 ... 0]], [[255 ... 255] ... [255 ... 255]], (250, 160), uint8)

respectively. The general article on Atari environments outlines different ways to instantiate corresponding environments via gymnasium.make.

Arguments

env = gymnasium.make("ALE/Freeway-v5")

The various ways to configure the environment are described in detail in the article on Atari environments.

Environment Valid Modes Valid Difficulties Default Mode
Freeway [0, ..., 7] [0, 1] 0

You may use the suffix "-ram" to switch to the RAM observation space. In v0 and v4, the suffixes "Deterministic" and "NoFrameskip" are available. These are no longer supported in v5. In order to obtain equivalent behavior, pass keyword arguments to gymnasium.make as outlined in the general article on Atari environments. The versions v0 and v4 are not contained in the "ALE" namespace. I.e. they are instantiated via gymnasium.make("Freeway-v0").

Version History

A thorough discussion of the intricate differences between the versions and configurations can be found in the general article on Atari environments.

Version frameskip= repeat_action_probability= full_action_space=
v0 (2, 5,) 0.25 False
v4 (2, 5,) 0.0 False
v5 5 0.25 True

Version v5 follows the best practices outlined in [2]. Thus, it is recommended to transition to v5 and customize the environment using the arguments above, if necessary.