v2.5.1

Arrow v2.5.1

Diff since v2.5.0

Closed issues:

• Performance regression caused by Arrow type piracy (#266)
• Precompilation broken on Julia 1.9-rc1 (#391)
• Does Arrow.write have an upper limit for the number of columns? (#414)
• [Discussion] Need for early-returning friendly iteration interface (#417)
• Test failure on 1.8.5 Rosetta (#425)
• Test Failure (#429)

Merged pull requests:

• Fix deprecation of getproperty(::Pairs, s) (#409) (@baumgold)
• Use getproperty instead of type parameter to get names (#415) (@simsurace)
• Add @testsets for misc tests (#421) (@JoaoAparicio)
• Pre-allocate buffer (#422) (@JoaoAparicio)
• Bump patch version (#423) (@simsurace)
• add dev CI for monorepo (#424) (@Moelf)
• #429 fix alignment for compressed data (#430) (@baumgold)

v2.5.0

Arrow v2.5.0

Diff since v2.4.3

Closed issues:

• How to represent customize type field in schema (#383)
• Making Custom types documentation example work (#386)
• Tag release (#387)

Merged pull requests:

• Revert "Tag new version dev/release/release.sh (#381)" (#388) (@kou)
• fix arrowname and arrowmetadata for nullable types (#389) (@baumgold)
• add IPv4/IPv6 support to ArrowTypes (#390) (@baumgold)
• define eltype for Stream (#394) (@baumgold)
• Implement Tables.columnnames and Tables.schema for Arrow.Stream (#395) (@baumgold)
• Bump Arrow version to 2.5.0 (#406) (@baumgold)

v2.4.3

Arrow v2.4.3

Diff since v2.2.1

Closed issues:

• Re-use PyArrow memory via PyCall (#92)
• Can't roundtrip NamedTuples of Nanoseconds twice (#214)
• Serializing Dict{String,Real} result in garbage values (#232)
• VersionNumber issues when you also have missing (#243)
• Order of record batches from "arrow file" format files (i.e. Arrow.Table) not preserved (#295)
• dev/release/release.sh misses a feature that removes old releases and RCs (#307)
• Release process misses "add a new release to ASF's report database" (#311)
• RC verification script name is wrong (#313)
• Verify release CI jobs are failed for a RC1 commit (#314)
• Versions in footer and message do not agree, this causes issues reading Arrow files with other libraries (such as arrow-rs). (#320)
• filtering DataFrame loaded from feather file triggers deleteat! error (#324)
• DST ambiguities in ZonedDateTime not supported (#327)
• error earlier when number of entries don't match across all fields (#344)
• Tests fail on Apple silicon on Julia 1.8 (#345)
• Install Registrator.jl github app (#348)
• Allow appending record batches to an existing Arrow file (#352)
• Arrow.append to non-existent file (#354)
• PooledArray are incorrectly saved (#364)
• inappropriately applied Arrow.NullVector optimization to Union{ZonedDateTime,Missing} column (#367)
• Release [email protected] (#376)
• RC verification script doesn't test ArrowTypes (#378)
• dev/release/release.sh doesn't tag (#380)

Merged pull requests:

• refactor Arrow.write to support incremental writes (#277) (@baumgold)
• disallow non-concrete map-like types to prevent incorrect serialization (#305) (@jrevels)
• add missing arrowtype(b, ::Type{<:Period}) method to enable roundtripping of Period types (#306) (@jrevels)
• Bump version to 2.3.0 (#312) (@quinnj)
• Remove old releases and RCs on a new release (#315) (@kou)
• Use a large RC number for CI (#316) (@kou)
• Fix wrong RC verification path (#317) (@kou)
• Add a missing release process to update ASF's report database (#318) (@kou)
• fix version mismatch by changing footer to V5 (#321) (@pcjentsch)
• Fix repo name in the Readme (#322) (@CarloLucibello)
• allow ntasks to be 0 and determine whetheher to use threads based on nthreads rather than ntasks (#325) (@baumgold)
• Store ZDT with a UTC, not local, timestamp (#329) (@tpgillam)
• support reading empty files that are in the process of being written (#338) (@baumgold)
• Use OrderedSynchronizer instead of OrderedChannel (#339) (@quinnj)
• Add ArgumentError for deleteat on ArrowVectors; fixes #324 (#341) (@quinnj)
• Remove requirement to have 1 approval on PRs (#343) (@quinnj)
• Bump version to 2.4.0 (#346) (@baumgold)
• Tar is also needed to verify release candidates (#347) (@bkmgit)
• fix Julia 1.6 (#349) (@SimonDanisch)
• replace custom debug handling with LoggingExtras (#355) (@baumgold)
• fix BatchIterator iterate method to handle partial messages (#356) (@baumgold)
• Ensure Julia types have alignment respected (#357) (@quinnj)
• allow append to act on non-existent/blank file/io (#358) (@tanmaykm)
• don't run tests that fail on Windows (#361) (@visr)
• Bump compat for LoggingExtras for 1.0 (#362) (@quinnj)
• Ensure elements are converted when indexed from ArrowTypes.ToArrow (#365) (@quinnj)
• MINOR: Update issue notifications to issues mailing list to match Arrow repo (#366) (@raulcd)
• Create CompatHelper.yml (#369) (@CarloLucibello)
• Fix issue with missing and non-concrete Arrow types (#371) (@omus)
• Define defaults for Missing/Nothing (#372) (@omus)
• bugfix & test for columns with VersionNumber & missing (#374) (@ericphanson)
• Bump Arrow version to 2.4.2 (#377) (@quinnj)
• Test ArrowTypes package in RC verification script (#379) (@kou)
• Tag new version dev/release/release.sh (#381) (@kou)
• Fix ToArrow when using an abstract eltype with all missing elements (#385) (@omus)

v2.2.1

Arrow v2.2.1

Diff since v2.2.0

Closed issues:

• memory not freed reading python exported compressed feather format (#93)
• error when metadata is present but empty? (#253)
• pyarrow unable to load Arrow data written by Arrow.jl (#261)
• Support for Decimal (#264)
• Transfer repository to apache organization (#265)
• Error with Julia 1.7.0 (#269)
• Add GitHub Actions used in this repository to allow list (#273)
• Future of the Julia arrow implementation (#284)
• Check license automatically (#286)
• Implement release script (#287)
• Implement release verification script (#288)
• Release script publishes the artifacts to wrong URL (#301)

Merged pull requests:

• Remove use of symlinks in CI matrix (#256) (@omus)
• Proposal: change @scopedenum to make modules to avoid type piracy (#267) (@NHDaly)
• Configure repository metadata (#272) (@kou)
• Send issue comments notification to [email protected] (#274) (@kou)
• Fix case where metadata is provided but empty (#276) (@quinnj)
• Introduce Release audit tool (Rat) (#289) (@kou)
• Add release scripts (#290) (@kou)
• Add verification script (#292) (@kou)
• Bump version for release (#299) (@quinnj)
• Fix wrong release artifacts URL (#302) (@kou)

v2.2.0

Arrow v2.2.0

Diff since v2.1.0

Closed issues:

• Error when displaying value of Arrow.NullVector{ZonedDateTime} (#248)
• Stable docs point towards an old version (#249)
• Avro.jl exists (#251)

Merged pull requests:

• add DOCUMENTER_KEY secret to TagBot (#250) (@KristofferC)
• Add Avro reference, add links (#252) (@KronosTheLate)
• Replace Base.n_waiters with isempty (#254) (@barucden)
• Support AbstractPath where file paths are used (#255) (@omus)

v2.1.0

Arrow v2.1.0

Diff since v2.0.0

Merged pull requests:

• Remove unused line (#245) (@nickrobinson251)
• Add ability to pass directory of inputs to Arrow.Table/Arrow.Stream (#246) (@quinnj)

v2.0.0

Arrow v2.0.0

Diff since v1.6.2

Closed issues:

• remove global metadata cache (OBJ_METADATA) (#90)
• Ambiguity error with fromarrow with missings and NamedTupless (#199)
• use of setmetadata! on generic tables basically requires calling Tables.columns on the input (#211)
• How to read parquet files, partitioned datasets? (#227)
• bump request (#242)

Merged pull requests:

• fix ambiguity error (#219) (@ericphanson)
• bugfix reading arrays (#234) (@jonalm)
• remove global metadata cache, refactor custom_metadata API (#238) (@jrevels)
• delete deprecations in preparation for v2.0 release (#241) (@jrevels)

v1.6.2

Arrow v1.6.2

Diff since v1.6.1

Merged pull requests:

• Support Julia 1.0 for ArrowTypes package (#223) (@omus)
• custom struct getindex should deserialize based on the shape of the actual ArrowType, not the target JuliaType (#229) (@jrevels)

v1.6.1

Arrow v1.6.1

Diff since v1.6.0

Merged pull requests:

• Add maxlog=1 to not spam logs (#224) (@ericphanson)
• use _id in warn logging (#225) (@ericphanson)

v1.6.0

Arrow v1.6.0

Diff since v1.5.0

Closed issues:

• A vector with elementtype Any stackoverflows Arrow.write: (#191)
• Writing an empty DataFrame errors (#194)
• ArrowTypes as standalone package doesn't interoperate with Arrow.ArrowTypes (#209)
• ERROR: type Nothing has no field fields (#210)
• Remove master branch (#216)

Merged pull requests:

• Rename LICENSE.md to LICENSE (#195) (@simeonschaub)
• Test expected log records (#204) (@omus)
• Use standalone ArrowTypes package (#212) (@omus)
• Set ArrowTypes to version 1.1.0 (#213) (@omus)
• Remove old arrowtypes.jl file (#215) (@omus)
• add metadata to show method (#217) (@ericphanson)
• fix writing an empty table (#221) (@KristofferC)
• Set project version to 1.6.0 (#222) (@omus)