Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Enable non-blob async writeback #921

Open
rclapp opened this issue May 25, 2023 · 1 comment
Open

Enable non-blob async writeback #921

rclapp opened this issue May 25, 2023 · 1 comment

Comments

@rclapp
Copy link
Collaborator

rclapp commented May 25, 2023

One of the trade offs of using a blob based write back is that you can no longer leverage change sets. In certain applications change sets are required to properly group transactions together. We should expose useBlob parameters in the async write back methods so that change sets could be used. If we do this we may need to change the way change sets are managed. An async writer could

  1. Return a list of change sets, 1 from each worker
  2. Create a change set and pass it into the worker, then all workers write using the same change set ID

Thoughts?

@MariusWirtz
Copy link
Collaborator

I agree. Using changesets in conjunction with the fast async write would be nice.
Ideally, we could make use of changesets in TI. If that's not possible we could use the standard REST-based write.

In both cases, we could return a list of changesets or share a changeset-id among the workers.
I will tag this issue as an enhancement.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants