Skip to content

Commit

Permalink
Merge pull request #872 from willtaner/T4_docs
Browse files Browse the repository at this point in the history
T4 docs
  • Loading branch information
doberst authored Jun 11, 2024
2 parents 90d0594 + 3ba052d commit e3b949b
Show file tree
Hide file tree
Showing 2 changed files with 23 additions and 0 deletions.
12 changes: 12 additions & 0 deletions docs/community/faq.md
Original file line number Diff line number Diff line change
Expand Up @@ -177,3 +177,15 @@ library.add_files(input_foler_path=Path('~/llmware_data/sample_files/Agreements'
library.install_new_embedding(embedding_model_name='mini-lm-sber')
library.install_new_embedding(embedding_model_name='industry-bert-contracts')
```

### Why is the model running slowly in Google Colab?
#### "I want to improve the performance of my model on Google Colab"

Our models are designed to run on at least 16GB of RAM. By default Google Colab provides ~13GB of RAM, which significantly slows computational speed. To ensure the best performance when using our models, we highly recommend enabling the T4 GPU in Colab. This will provide the notebook with additional resources, including 16GB of RAM, allowing our models to run smoothly and efficiently.

Steps to enabling T4 GPU in Colab:
1. In your Colab notebook, click on the "Runtime" tab
2. Select "Change runtime type"
3. Under "Hardware Accelerator", select T4 GPU

NOTE: There is a weekly usage limit on using T4 for free.
11 changes: 11 additions & 0 deletions docs/examples/notebooks.md
Original file line number Diff line number Diff line change
Expand Up @@ -27,6 +27,17 @@ Google Colab (or Colaboratory) is a free Jupyter notebook environment that requi
- **Language Support:** Primarily, both are used for executing Python code. However, Jupyter Notebooks support other languages such as R and Julia.
- **Use Cases:** They are widely used for data analysis, machine learning, and education, allowing for easy sharing of results and methodologies.

## Increase Google Colab Computational Power with T4 GPU

Our models are designed to run on at least 16GB of RAM. By default Google Colab provides ~13GB of RAM, which significantly slows computational speed. To ensure the best performance when using our models, we highly recommend enabling the T4 GPU in Colab. This will provide the notebook with additional resources, including 16GB of RAM, allowing our models to run smoothly and efficiently.

Steps to enabling T4 GPU in Colab:
1. In your Colab notebook, click on the "Runtime" tab
2. Select "Change runtime type"
3. Under "Hardware Accelerator", select T4 GPU

NOTE: There is a weekly usage limit on using T4 for free.

## Key Differences

- **Execution Environment:** Jupyter Notebooks can be run locally on your machine or on a server, but Google Colab is hosted in the cloud.
Expand Down

0 comments on commit e3b949b

Please sign in to comment.