Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Option for non HDF5 #12

Open
wants to merge 5 commits into
base: master
Choose a base branch
from
Open

Conversation

northanapon
Copy link

I had a few problems with HDF5 format on my dataset, so I add an additional code:

  1. Added a script for preprocessing in torch.
  2. Added an option to training.lua to use data from the new script
  3. Added a new data loader that returns data continuously from batch to batch

@AlekzNet
Copy link

AlekzNet commented Apr 2, 2016

You may want to add sorting (e.g. like in char-rnn) to avoid index mismatching, when you use a pre-trained model on a different corpus:
#43
#37 (comment)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants