Finetune LLMs

This repo is developed under Python 3.10

Installation

1. Clone the repo

   git clone https://github.com/ALS15204/load_prediction.git

2. Build venv: under the repo root

   python3.10 -m venv ./

3. Install requirements

   pip install -r requirements.txt

(back to top)

NER task

1. At project root, retrieve data with

   git clone https://github.com/leslie-huang/UN-named-entity-recognition```

2. To finetune a model, run

   python scripts/ner/finetune_lm_ner.py`

3. To run inference with a pretrained model, run

   python scripts/ner/predict_with_un_ner.py`

(back to top)