Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Bert/TensorFlow]add prefetching to data preprocessing #643

Open
zhao1157 opened this issue Aug 10, 2020 · 0 comments
Open

[Bert/TensorFlow]add prefetching to data preprocessing #643

zhao1157 opened this issue Aug 10, 2020 · 0 comments
Assignees
@swethmandava

Comments

@zhao1157
Copy link

To overlap data preprocessing and execution, do you think we should add d.prefetch(tf.data.experimental.AUTOTUNE) after the following line?

DeepLearningExamples/TensorFlow/LanguageModeling/BERT/run_pretraining.py

Line 520 in 36ad5fe

d = d.apply(

@zhao1157 zhao1157 changed the title add prefetching to data preprocessing [Bert/TensorFlow]add prefetching to data preprocessing Aug 11, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@swethmandava swethmandava

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@zhao1157 @swethmandava