Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Tokenizer error #798

Open
Percy-J opened this issue Oct 20, 2024 · 4 comments
Open

Tokenizer error #798

Percy-J opened this issue Oct 20, 2024 · 4 comments
Labels

Comments

@Percy-J
Copy link

Percy-J commented Oct 20, 2024

Hi HuggingFace and mates

I fine tune Extractive Question Answer on AutoTrain online, I uploaded dataset proper and did the column mapping correctly, keep getting this issues:

"ValueError: Asking to pad but the tokenizer does not have a padding token. Please select a token to use as pad_token (tokenizer.pad_token = tokenizer.eos_token e.g.) or add a new pad token via tokenizer.add_special_tokens({'pad_token': '[PAD]'}).

Thanks for helps!!!

@abhishekkrthakur
Copy link
Member

which model is it?

@Percy-J
Copy link
Author

Percy-J commented Oct 21, 2024

which model is it?

meta-llama/Llama-3.2-3B-Instruct

@abhishekkrthakur
Copy link
Member

why do you want to use an llm model for extractive question answering task? seems like an overkill.

Copy link

This issue is stale because it has been open for 30 days with no activity.

@github-actions github-actions bot added the stale label Nov 20, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants