Fetch model using curl, add shebang to download_files.sh and mark it executable

This commit is contained in:
Mathieu Rene
2019-02-16 10:32:30 -05:00
committed by Jeff Wu
parent 2d0b62225c
commit 0aad2ab3f4
2 changed files with 6 additions and 2 deletions

View File

@ -8,7 +8,7 @@ See more details in our [blog post](https://blog.openai.com/better-language-mode
## Installation
Download the model data (needs [gsutil](https://cloud.google.com/storage/docs/gsutil_install)):
Download the model data
```
sh download_model.sh 117M
```

6
download_model.sh Normal file → Executable file
View File

@ -1,3 +1,5 @@
#!/bin/sh
if [ "$#" -ne 1 ]; then
echo "You must enter the model name as a parameter, e.g.: sh download_model.sh 117M"
exit 1
@ -9,5 +11,7 @@ mkdir -p models/$model
# TODO: gsutil rsync -r gs://gpt-2/models/ models/
for filename in checkpoint encoder.json hparams.json model.ckpt.data-00000-of-00001 model.ckpt.index model.ckpt.meta vocab.bpe; do
gsutil cp gs://gpt-2/models/$model/$filename models/$model
fetch=$model/$filename
echo "Fetching $fetch"
curl --output models/$fetch https://storage.googleapis.com/gpt-2/models/$fetch
done