New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

gcc/cuda used for training #24

Open

danyaljj opened this issue Jul 26, 2023 · 1 comment

danyaljj commented Jul 26, 2023

In your tutorial on llama-2 (below) would you mind sharing what versions of gcc and cuda you're using?

https://github.com/philschmid/deep-learning-pytorch-huggingface/blob/main/training/instruction-tune-llama-2-int4.ipynb

The text was updated successfully, but these errors were encountered:

Owner

philschmid commented Jul 26, 2023

Sure.

>> nvcc --version
nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2022 NVIDIA Corporation
Built on Wed_Jun__8_16:49:14_PDT_2022
Cuda compilation tools, release 11.7, V11.7.99
Build cuda_11.7.r11.7/compiler.31442593_0

and

>> gcc --version
gcc (Ubuntu 9.4.0-1ubuntu1~20.04.1) 9.4.0
Copyright (C) 2019 Free Software Foundation, Inc.
This is free software; see the source for copying conditions.  There is NO
warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.

I am using this AMI Deep Learning AMI GPU PyTorch 1.13.1 (Ubuntu 20.04) 20230309 with ami id ami-078afdc6b93b6177f in us-east-1

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment