Skip to content

XindaLi304/LLM_from_Scratch

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

11 Commits
 
 
 
 

Repository files navigation

LLM_from_Scratch

  1. LLM fine-tuning:
    LLM: bigscience/bloom-560m

    objective: information summarization-classifying the review of movie viewers.

    dataset used to finetune: IMDBDataset

    TODO:
    RLHF
    training: Pytorch FSDP
    inferring: vllm

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published