add samples

This commit is contained in:
Jeff Wu
2019-02-14 00:17:55 -08:00
parent c2dae27c10
commit e3e1ad5b7a
2 changed files with 20009 additions and 1 deletions

View File

@ -4,7 +4,7 @@ Code and samples from the paper "Language Models are Unsupervised Multitask Lear
## Installation ## Installation
Download the model data: Download the (small, 117M parameter) model data:
``` ```
gsutil rsync -r gs://gpt-2/models/ models/ gsutil rsync -r gs://gpt-2/models/ models/
``` ```
@ -27,3 +27,11 @@ There are various flags for controlling the samples:
``` ```
python3 src/main.py --top_k 40 --temperature 0.7 | tee samples python3 src/main.py --top_k 40 --temperature 0.7 | tee samples
``` ```
While we have not yet released GPT-2 itself, you can see some unconditional samples (with default settings of temperature 1 and no truncation) in `gpt2-samples.txt`.
## Future work
We may release code for evaluating the models on various benchmarks.
We are still considering release of the larger models.

20000
gpt2-samples.txt Normal file

File diff suppressed because one or more lines are too long