New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Move reusable code from jupyter notebooks to python modules #1

Open

2 tasks

navalnica opened this issue Oct 3, 2022 · 0 comments

Open

2 tasks

Move reusable code from jupyter notebooks to python modules #1

navalnica opened this issue Oct 3, 2022 · 0 comments

Assignees

Labels

code enhancement

Milestone

Owner

navalnica commented Oct 3, 2022 •

edited

Loading

Refactor current code to be easily reusable in further model training / evaluation / deployment.

Create a function for loading of tokenizer, processor, decoder (for use of Language models)
Extract input ids from any dataset on the fly #2

navalnica self-assigned this

navalnica added this to the Refactor 1 milestone

navalnica added the code enhancement label

navalnica mentioned this issue

Extract input ids from any dataset on the fly #2

Open

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment