Skip to content

0.3.0

Compare
Choose a tag to compare
@rudolfix rudolfix released this 11 Jun 18:51
· 1811 commits to devel since this release

Core Library

  • renames Pipelines to Verified Sources by @rudolfix in #382
  • adds tests to build containers, removes psutil by @rudolfix in #373
  • finalizes where the resource state is stored in pipeline state by @rudolfix in #374
  • accepts explicit values for unions if type of value is one of types by @rudolfix in #377
  • add quotes to missing dependency exception output by @sh-rp in #387
  • Feat/Add transaction management for filesystem operations using fsspec by @z3z1ma in #384

Minor Version Changes

  • source name is now the key in pipeline state that stores all the source and resource state. previously the source section (which was the name of python module where source was defined) was used. this change will affect the already deployed pipelines that had name of the source different from the name of the module. they will not see the already stored state and may, for example, load some data twice. the only verified source affected by this is zendesk.

Docs

  • rewrites the sections on source, resource and pipeline state by @rudolfix in #376
  • minor changes to schema evolution doc by @rahuljo in #372
  • pushing experiment 4 blog by @rahuljo in #371
  • update docusaurus and fix gtag by @sh-rp in #385
  • add section landing pages to docusaurus by @sh-rp in #386

New Contributors

Full Changelog: 0.2.9...0.3.0