Skip to content

Commit

Permalink
Update microbenchmarks_llama2-70b-trillium_2x4.sh
Browse files Browse the repository at this point in the history
  • Loading branch information
s2bk authored Feb 8, 2025
1 parent 045fc14 commit b556197
Showing 1 changed file with 1 addition and 1 deletion.
Original file line number Diff line number Diff line change
Expand Up @@ -58,7 +58,7 @@ echo "LIBTPU_INIT_ARGS:${LIBTPU_INIT_ARGS}"
echo "XLA_FLAGS:${XLA_FLAGS}"
echo
export TOKENIZER_PATH=/home/${USER}/maxtext/assets/tokenizer.llama2
export LOAD_PARAMETERS_PATH=gs://msingh-bkt/checkpoints/quant_llama2-70b-chat/prod/int8_
export LOAD_PARAMETERS_PATH=gs://${USER}-bkt/checkpoints/quant_llama2-70b-chat/prod/int8_
export MAX_PREFILL_PREDICT_LENGTH=1024
export MAX_TARGET_LENGTH=2048
export MODEL_NAME=llama2-70b
Expand Down

0 comments on commit b556197

Please sign in to comment.