Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Regularization defaults missing #94

Open
adambielski opened this issue Apr 6, 2018 · 0 comments
Open

Regularization defaults missing #94

adambielski opened this issue Apr 6, 2018 · 0 comments

Comments

@adambielski
Copy link

The models shared are great for feature extraction, but their use for deeper fine-tuning is limited due to lack of information regarding L2 kernel regularization and Dropout.
What's the reason for not adding them to the model definition? They wouldn't change anything for inference, but would allow proper fine-tuning of earlier layers. There's also no information where the weights are taken from, so it's impossible to the modification on one's own. Fine-tuning the entire model with mismatching regularization (or no regularization) seems suboptimal.
@fchollet is it possible to add original L2 reg and Dropout for model definition? If not, could at least the information about these values be available along with models?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant