Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Allow sharing of temporary tables between tasks #300

Open
civitaspo opened this issue Sep 13, 2021 · 0 comments
Open

Allow sharing of temporary tables between tasks #300

civitaspo opened this issue Sep 13, 2021 · 0 comments

Comments

@civitaspo
Copy link
Member

Hi maintainers,

I create an issue related to #299.

If we create a temporary table for each task, we will end up with a lot of temporary tables when there are many tasks. Therefore, depending on the workload, the number of temporary tables may reach the limit of the number of tables created in the destination database. From what I've read in the code, it looks like it's okay to share temporary tables between tasks if we ignore the resume feature. So, I think we should create an option recycle_temp_table or share_temp_table to allow sharing of temporary tables between tasks. How do you think?

@civitaspo civitaspo changed the title Allow recycle of temporary tables Allow sharing of temporary tables between tasks Sep 13, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Development

No branches or pull requests

1 participant