Skip to content

Issues: openai/finetune-transformer-lm

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

25 Open 17 Closed
25 Open 17 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

The Conv1d over Linear?
#49 opened May 26, 2022 by maciejbalawejder
lm_h = tf.reshape(h[:, :-1], [-1, args.n_embd])
#48 opened Aug 30, 2019 by lshowway
what does the variable n_ctx mean ?
#47 opened Aug 28, 2019 by lshowway
great dataset
#46 opened May 6, 2019 by amirakazadeh
Why are the "wrong" sentences are learned during training via LM?
#45 opened Apr 30, 2019 by fabiang7
How to use the current model for classification task?
#44 opened Mar 25, 2019 by dhirajpatnaik16297
Why do we need to apply mask while fine tuning?
#43 opened Mar 11, 2019 by pranoy-k
Is it possible to edit the code based on this project to train from scratch?
#42 opened Feb 28, 2019 by guotong1988
Error!! :(
#39 opened Dec 28, 2018 by amirakazadeh
10
have you ever try a bigger corpus
#38 opened Nov 26, 2018 by ZizhenWang
1
Using it as a Language model
#37 opened Nov 22, 2018 by mdasadul
About the non-determinism due to GPU ops
#36 opened Nov 22, 2018 by OanaMariaCamburu
Is the LM pre-trained with a _start_ symbol?
#34 opened Nov 20, 2018 by OanaMariaCamburu
What is training accuracy of the language model?
#32 opened Oct 29, 2018 by peace195
1
Question about "rf" parameter in conv1d() function
#31 opened Oct 25, 2018 by XisnZhang
What is the specific formula for learning rate used in adam optimizer during pre-train?
#29 opened Oct 18, 2018 by ShuGao0810
Do you ever try your model on ROCstory training dataset?
#28 opened Oct 15, 2018 by Brandonnogithub
How to pretrain the model?
#27 opened Oct 12, 2018 by ShuGao0810
1
Universal Transformer as base architecture
#23 opened Sep 4, 2018 by rodgzilla
How to deal with logits from position indices in the output layer?
#22 opened Aug 24, 2018 by xiaoda99
1
how could i train the language with chinese
#20 opened Aug 14, 2018 by wykdg
3
Any timeline to release the code to train the LM + finetune on the other 11 tasks?
#13 opened Jul 18, 2018 by Franck-Dernoncourt
2
Question about the shape of X_train
#9 opened Jul 2, 2018 by FrankWork
1
CPU support
#3 opened Jun 14, 2018 by throwaway73
6
Supported languages
#2 opened Jun 13, 2018 by ErikTromp
1
ProTip! Adding no:label will show everything without a label.