v0.0.1

What's Changed

Client Changes

• feat(reattach): Add reattach & release logic by @sjrusso8 in #78
• bug(deadlock): change to async rwlock by @wvwwvwwv in #48
• bug(tls): incorrect scheme for default endpoint by @sjrusso8 in #39

Spark Session Changes

• refactor(session): use ref for session methods & error messages by @sjrusso8 in #51
• feat(session): add RunTimeConfig & Session tags by @sjrusso8 in #45

DataFrame Changes & ReadWriter Changes

• Implement File Format Reader/Writer by @lexara-prime-ai in #72
• feat(dataframe): implement missing methods by @sjrusso8 in #67
• feat(dataframe): Spark DF to Polars, DataFusion, or JSON by @sjrusso8 in #43
• feat(dataframe): implement transform by @sjrusso8 in #34
• feat: initial implementation of DataframeWriterV2 by @hntd187 in #30

Column Changes

• Enhance Column Function Coverage with Additional Test Cases by @lexara-prime-ai in #68
• feat(col): dropFields & withField by @sjrusso8 in #32

Spark DataType Changes

• feat(data types): implement data types by @sjrusso8 in #41
• feat(types) & bug(plan): add new datatypes & fix plan id bug by @sjrusso8 in #31

Function Changes

• feat(functions): implement more functions by @sjrusso8 in #75

Streaming Changes

• feat(sqm): add streaming query manager by @sjrusso8 in #80
• feat(sq): implement missing methods by @sjrusso8 in #53

Catalog Changes

• feat(catalog): Implement createTable on Catalog by @lexara-prime-ai in #82

Error Handlers

• feat(errors): cleaner handling of tonic status errors by @sjrusso8 in #79

Repo Changes

• feat!(wasm): remove feature flag by @sjrusso8 in #85
• grunt: remove rust/ folder and change core/ to crates/ by @sjrusso8 in #81
• refactor: consolidate traits by @sjrusso8 in #74
• chore: update readme & bump dependency by @sjrusso8 in #73
• Resolve issue with broken CI/CD Release Pipeline by @lexara-prime-ai in #70
• fix(cicd): issue with docker compose by @sjrusso8 in #69
• feat!(submodule): remove git submodule by @sjrusso8 in #66
• refactor: remove non snake case by @sjrusso8 in #52
• feat(examples): update with local datasets by @sjrusso8 in #44
• Update readme tracker by @abrassel in #37
• feat(examples): update examples by @sjrusso8 in #35
• fix: add include to cargo.toml by @sjrusso8 in #29

Contributors

• @hntd187 made a contribution in #30
• @abrassel made a contribution in #37
• @lexara-prime-ai made a contribution in #68
• @wvwwvwwv made a contribution in #47

Full Changelog: v0.0.1-beta.4...v0.0.1

v0.0.1-beta.4

Changes

• Split out code into core/ and rust/ as rust workspace #24
• Update public modules and re-exports on the crates #24
• Implement more core spark class methods #22 & #12
• Increase code coverage #23
• Update dependencies & docker #21
• Add window and windowspec #19
• Update README and rust docs #15

v0.0.1-beta.1

What's Changed

• feat: better use of generics
• feat: restructure existing modules, and add Column, Expression, and Functions modules by @sjrusso8 in #1
• feat: marco refactor and lots of functions by @sjrusso8 in #3

Full Changelog: v0.0.1-beta...v0.0.1-beta.1

v0.0.1-beta - spark-connect-rs

Beta release of a way to early spark-connect-rs client

v0.0.1-alpha.1

Releasing additional DataFrame transformations and commands including:

• schema
• explain
• dropDuplicates
• and some more

Additional DataFrameWriter outputs including:

• saveAsTable
• insertInto