Code

Nemotron5 features#403

Code

Draft

arendu wants to merge 6 commits intomainNVIDIA/NeMo-Aligner:mainfrom nemotron5_featuresNVIDIA/NeMo-Aligner:nemotron5_featuresCopy head branch name to clipboard

+256-118

Commits

Commits on Nov 20, 2024

• feat: TRTLLM API handle tokenizers without pad_id (e.g., tiktoken) (#399)

  Show description for eb2db8b
  

  terrykong

  and

  pre-commit-ci[bot]

  authored
  eb2db8b

Commits on Nov 21, 2024

• feat: nemotron-5 features

  Show description for 5270081
  

  arendu

  authored and

  terrykong

  committed
  5270081

• [pre-commit.ci] auto fixes from pre-commit.com hooks

  Show description for 6394adb
  pre-commit-ci[bot]

  committed
  6394adb

Commits on Nov 22, 2024

• feat: dpo dataset new openai chat completion format

  terrykong

  committed
  7723879

Commits on Dec 3, 2024

• remove dockerfile patches for nemotron-5 since nemo includes PRs needed

  Show description for d97f299
  terrykong

  committed
  d97f299

Commits on Dec 17, 2024

• meta tokens support

  Show description for a9c8b0a
  arendu

  committed
  a9c8b0a