Skip to content

Commit

Permalink
add flash attention build to dockerfile
Browse files Browse the repository at this point in the history
  • Loading branch information
samsja committed Jul 17, 2024
1 parent 422769a commit ff545df
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions Dockerfile
Original file line number Diff line number Diff line change
Expand Up @@ -35,6 +35,7 @@ RUN echo "export PATH=\"/opt/conda/bin:/root/.cargo/bin:\$PATH\"" >> /root/.bash
# Install Python dependencies (The gradual copies help with caching)
WORKDIR open_diloco
RUN pip install --pre torchdata --index-url https://download.pytorch.org/whl/nightly/cpu
RUN pip install flash-attn>=2.5.8
COPY requirements.txt requirements.txt
RUN pip install --no-cache-dir -r requirements.txt
COPY requirements-dev.txt requirements-dev.txt
Expand Down

0 comments on commit ff545df

Please sign in to comment.