Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Docs/507 rest_api: Documents how to specify a transformation function for the cursor field in incremental load configurations #1541

Open
wants to merge 2 commits into
base: devel
Choose a base branch
from

Conversation

willi-mueller
Copy link
Collaborator

Description

Documents the usage of a transform callable in the incremental configurations

Related Issues

Copy link

netlify bot commented Jul 3, 2024

Deploy Preview for dlt-hub-docs ready!

Name Link
🔨 Latest commit 4e9912e
🔍 Latest deploy log https://app.netlify.com/sites/dlt-hub-docs/deploys/668593f4e3c19b00085e0d56
😎 Deploy Preview https://deploy-preview-1541--dlt-hub-docs.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify site configuration.

@@ -608,28 +609,56 @@ When the API endpoint supports incremental loading, you can configure the source
"since": {
"type": "incremental",
"cursor_path": "updated_at",
"initial_value": "2024-01-25T11:21:28Z",
"initial_value": "2024-01-25T00:00:00Z",
Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I changed it into zeroes so that it is clearer when we show the url-encoded query string below

@willi-mueller willi-mueller changed the title rest_api: Feat/507 Documents how to specify a transformation function for the cursor field in incremental load configurations Docs/507 rest_api: Documents how to specify a transformation function for the cursor field in incremental load configurations Jul 9, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

rest_api: Allow to specify a transformation function for the cursor field in incremental load configuration
2 participants