Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix: Resolve pip install errors by adjusting dependencies and cleanup #17

Open
wants to merge 1 commit into
base: main
Choose a base branch
from
Open

fix: Resolve pip install errors by adjusting dependencies and cleanup #17

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
5 changes: 2 additions & 3 deletions install_Megatron-Llama2.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -4,12 +4,11 @@ git clone https://github.com/rioyokotalab/Megatron-Llama2.git
cd Megatron-Llama2
python3 -m venv venv
source venv/bin/activate
pip install -U pip setuptools wheel
pip install -U pip 'setuptools<70' wheel
pip install -r requirements.txt
git clone https://github.com/NVIDIA/apex -b 23.08
cd apex
pip install -v --disable-pip-version-check --no-cache-dir --no-build-isolation --config-settings "--build-option=--cpp_ext" --config-settings "--build-option=--cuda_ext" ./
cd ..
cp ../tools/convert_megatron_to_hf_llama.sh .
pip install packaging ninja
FLASH_ATTENTION_FORCE_BUILD=TRUE pip install flash-attn --no-build-isolation
FLASH_ATTENTION_FORCE_BUILD=TRUE pip install "flash-attn!=2.5.9.post1" --no-build-isolation