gaspersic/gpt-2
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

Fetch model using curl, add shebang to download_files.sh and mark it executable

Browse Source
This commit is contained in:
Mathieu Rene
2019-02-16 10:32:30 -05:00
committed by Jeff Wu
parent 2d0b62225c
commit 0aad2ab3f4
2 changed files with 6 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
README.md
View File

@ -8,7 +8,7 @@ See more details in our [blog post](https://blog.openai.com/better-language-mode
## Installation ## Installation
Download the model data (needs [gsutil](https://cloud.google.com/storage/docs/gsutil_install)): Download the model data
``` ```
sh download_model.sh 117M sh download_model.sh 117M
``` ```

6
download_model.sh Normal file → Executable file
View File

@ -1,3 +1,5 @@
#!/bin/sh
if [ "$#" -ne 1 ]; then if [ "$#" -ne 1 ]; then
echo "You must enter the model name as a parameter, e.g.: sh download_model.sh 117M" echo "You must enter the model name as a parameter, e.g.: sh download_model.sh 117M"
exit 1 exit 1
@ -9,5 +11,7 @@ mkdir -p models/$model
# TODO: gsutil rsync -r gs://gpt-2/models/ models/ # TODO: gsutil rsync -r gs://gpt-2/models/ models/
for filename in checkpoint encoder.json hparams.json model.ckpt.data-00000-of-00001 model.ckpt.index model.ckpt.meta vocab.bpe; do for filename in checkpoint encoder.json hparams.json model.ckpt.data-00000-of-00001 model.ckpt.index model.ckpt.meta vocab.bpe; do
gsutil cp gs://gpt-2/models/$model/$filename models/$model fetch=$model/$filename
echo "Fetching $fetch"
curl --output models/$fetch https://storage.googleapis.com/gpt-2/models/$fetch
done done