v0.5.14

Promoted from v0.5.14-rc3

Highlights

• The Report post-processor supports unique reach and custom measurement policies. See #1906 and #1974
• There are new command line options for specifying the VID model line for Reports. See #1931

Potentially Requiring Action

• There is a Reporting v2 DB schema update that recreates the metrics_comparison index. During that time, Report creations may be slow. See #1949
• Reporting v1 has been deleted from the codebase. Images for it will no longer be built. See #1917

Issues Addressed

• Simulator event groups created without event templates from --event-message-descriptor-set #1934
• Mill's exception handler should compare the token version before enqueuing it. #1918
• Exchange tasks are executed sequentially. #1962
• HMSS max concurrency is 1 in dev configuration. #1940

What's Changed

• refactor: Delete Reporting v1 by @SanjayVas in #1917
• feat: Define Access API by @SanjayVas in #1662
• feat: Define internal Access API by @SanjayVas in #1907
• Create Population Requisition Fulfiller Daemon. by @jojijac0b in #1820
• docs: update local kubenetes configuration README.md by @roaminggypsy in #1928
• fix: Drop unused UpdatePrincipal method and rename repeated field by @SanjayVas in #1938
• Expose deletion_protection variable on gcloud cluster Terraform module by @SanjayVas in #1939
• feat: Report processor supports cumulative and total measurements with different sets of EDP combinations. by @ple13 in #1885
• fix: Ensure event annotations is included in compile-time protobuf descriptors by @SanjayVas in #1945
• fix:Compare computatation token versions in Millbase during exception handling. by @renjiezh in #1920
• ci: Mark webpack_bundle target as no-remote-exec by @SanjayVas in #1933
• refactor: Extract common functionality for APIs by @SanjayVas in #1952
• feat: Add error reasons and exceptions for internal Access API by @SanjayVas in #1953
• feat: Implement Access GetPrincipal and UpdateRole by @SanjayVas in #1954
• feat: prober cron job local configuration by @roaminggypsy in #1935
• fix: Modify IDs used in Report creation in Cloud Correctness Test by @tristanvuong2021 in #1950
• perf: Recreate metric reuse index by @tristanvuong2021 in #1949
• fix: Register event annotations when loading event message descriptor by @SanjayVas in #1958
• feat: report processor supports unique reach measurements. by @ple13 in #1906
• feat: Add flag for specifying the the VID model line by @kungfucraig in #1931
• feat: Add database schema for internal Access API by @SanjayVas in #1900
• feat: implement public create principal and related tests by @roaminggypsy in #1956
• feat: Implement internal Access API services by @SanjayVas in #1932
• feat: Add server for Access internal API by @SanjayVas in #1963
• feat: Add server for Access API by @SanjayVas in #1964
• ci:Migrate worker2 from AWS to GCP by @renjiezh in #1966
• fix: Set --hmss-maximum-concurrency=5 in dev configuration for GKE by @SanjayVas in #1940
• feat: report processor to support incremental reach. by @ple13 in #1960
• feat: Add BaseTeeApplication by @Marco-Premier in #1904
• fix: Execute exchange tasks as new coroutines. by @robinsons in #1962
• build: Update any-sketch-java dep for Maven coordinates by @SanjayVas in #1973
• feat: Report processor supports custom measurement policy. by @ple13 in #1974

Full Changelog: v0.5.13...v0.5.14

v0.5.14-rc3

Highlights

• The Report post-processor supports unique reach and custom measurement policies. See #1906 and #1974
• There are new command line options for specifying the VID model line for Reports. See #1931

Potentially Requiring Action

• There is a Reporting v2 DB schema update that recreates the metrics_comparison index. During that time, Report creations may be slow. See #1949
• Reporting v1 has been deleted from the codebase. Images for it will no longer be built. See #1917

Issues Addressed

• Simulator event groups created without event templates from --event-message-descriptor-set #1934
• Mill's exception handler should compare the token version before enqueuing it. #1918
• Exchange tasks are executed sequentially. #1962
• HMSS max concurrency is 1 in dev configuration. #1940

What's Changed

• refactor: Delete Reporting v1 by @SanjayVas in #1917
• feat: Define Access API by @SanjayVas in #1662
• feat: Define internal Access API by @SanjayVas in #1907
• Create Population Requisition Fulfiller Daemon. by @jojijac0b in #1820
• docs: update local kubenetes configuration README.md by @roaminggypsy in #1928
• fix: Drop unused UpdatePrincipal method and rename repeated field by @SanjayVas in #1938
• Expose deletion_protection variable on gcloud cluster Terraform module by @SanjayVas in #1939
• feat: Report processor supports cumulative and total measurements with different sets of EDP combinations. by @ple13 in #1885
• fix: Ensure event annotations is included in compile-time protobuf descriptors by @SanjayVas in #1945
• fix:Compare computatation token versions in Millbase during exception handling. by @renjiezh in #1920
• ci: Mark webpack_bundle target as no-remote-exec by @SanjayVas in #1933
• refactor: Extract common functionality for APIs by @SanjayVas in #1952
• feat: Add error reasons and exceptions for internal Access API by @SanjayVas in #1953
• feat: Implement Access GetPrincipal and UpdateRole by @SanjayVas in #1954
• feat: prober cron job local configuration by @roaminggypsy in #1935
• fix: Modify IDs used in Report creation in Cloud Correctness Test by @tristanvuong2021 in #1950
• perf: Recreate metric reuse index by @tristanvuong2021 in #1949
• fix: Register event annotations when loading event message descriptor by @SanjayVas in #1958
• feat: report processor supports unique reach measurements. by @ple13 in #1906
• feat: Add flag for specifying the the VID model line by @kungfucraig in #1931
• feat: Add database schema for internal Access API by @SanjayVas in #1900
• feat: implement public create principal and related tests by @roaminggypsy in #1956
• feat: Implement internal Access API services by @SanjayVas in #1932
• feat: Add server for Access internal API by @SanjayVas in #1963
• feat: Add server for Access API by @SanjayVas in #1964
• ci:Migrate worker2 from AWS to GCP by @renjiezh in #1966
• fix: Set --hmss-maximum-concurrency=5 in dev configuration for GKE by @SanjayVas in #1940
• feat: report processor to support incremental reach. by @ple13 in #1960
• feat: Add BaseTeeApplication by @Marco-Premier in #1904
• fix: Execute exchange tasks as new coroutines. by @robinsons in #1962
• build: Update any-sketch-java dep for Maven coordinates by @SanjayVas in #1973
• feat: Report processor supports custom measurement policy. by @ple13 in #1974

Full Changelog: v0.5.13...v0.5.14-rc3

v0.5.14-rc2

Highlights

• The Report post-processor supports unique reach and custom measurement policies. See #1906 and #1974
• There are new command line options for specifying the VID model line for Reports. See #1931

Potentially Requiring Action

• There is a Reporting v2 DB schema update that recreates the metrics_comparison index. During that time, Report creations may be slow. See #1949
• Reporting v1 has been deleted from the codebase. Images for it will no longer be built. See #1917

Issues Addressed

• Simulator event groups created without event templates from --event-message-descriptor-set #1934
• Mill's exception handler should compare the token version before enqueuing it. #1918
• Exchange tasks are executed sequentially. #1962
• HMSS max concurrency is 1 in dev configuration. #1940
• Number of open connections locks keep increasing on reporting server postgresql instance #1922

What's Changed

• refactor: Delete Reporting v1 by @SanjayVas in #1917
• feat: Define Access API by @SanjayVas in #1662
• feat: Define internal Access API by @SanjayVas in #1907
• Create Population Requisition Fulfiller Daemon. by @jojijac0b in #1820
• docs: update local kubenetes configuration README.md by @roaminggypsy in #1928
• fix: Drop unused UpdatePrincipal method and rename repeated field by @SanjayVas in #1938
• Expose deletion_protection variable on gcloud cluster Terraform module by @SanjayVas in #1939
• feat: Report processor supports cumulative and total measurements with different sets of EDP combinations. by @ple13 in #1885
• fix: Ensure event annotations is included in compile-time protobuf descriptors by @SanjayVas in #1945
• fix:Compare computatation token versions in Millbase during exception handling. by @renjiezh in #1920
• ci: Mark webpack_bundle target as no-remote-exec by @SanjayVas in #1933
• refactor: Extract common functionality for APIs by @SanjayVas in #1952
• feat: Add error reasons and exceptions for internal Access API by @SanjayVas in #1953
• feat: Implement Access GetPrincipal and UpdateRole by @SanjayVas in #1954
• feat: prober cron job local configuration by @roaminggypsy in #1935
• fix: Modify IDs used in Report creation in Cloud Correctness Test by @tristanvuong2021 in #1950
• perf: Recreate metric reuse index by @tristanvuong2021 in #1949
• fix: Register event annotations when loading event message descriptor by @SanjayVas in #1958
• feat: report processor supports unique reach measurements. by @ple13 in #1906
• feat: Add flag for specifying the the VID model line by @kungfucraig in #1931
• feat: Add database schema for internal Access API by @SanjayVas in #1900
• feat: implement public create principal and related tests by @roaminggypsy in #1956
• feat: Implement internal Access API services by @SanjayVas in #1932
• feat: Add server for Access internal API by @SanjayVas in #1963
• feat: Add server for Access API by @SanjayVas in #1964
• ci:Migrate worker2 from AWS to GCP by @renjiezh in #1966
• fix: Set --hmss-maximum-concurrency=5 in dev configuration for GKE by @SanjayVas in #1940
• feat: report processor to support incremental reach. by @ple13 in #1960
• feat: Add BaseTeeApplication by @Marco-Premier in #1904
• fix: Execute exchange tasks as new coroutines. by @robinsons in #1962
• build: Update any-sketch-java dep for Maven coordinates by @SanjayVas in #1973
• feat: Report processor supports custom measurement policy. by @ple13 in #1974
• build: Update common-jvm to 0.98.0 by @tristanvuong2021 in #1971

Full Changelog: v0.5.13...v0.5.14-rc2

v0.5.14-rc1

Potentially Requiring Action

• There is a Reporting v2 DB schema update that recreates the metrics_comparison index. During that time, Report creations may be slow. See #1949
• Reporting v1 has been deleted from the codebase. Images for it will no longer be built. See #1917

Issues Addressed

• Simulator event groups created without event templates from --event-message-descriptor-set #1934
• Mill's exception handler should compare the token version before enqueuing it. #1918

What's Changed

• refactor: Delete Reporting v1 by @SanjayVas in #1917
• feat: Define Access API by @SanjayVas in #1662
• feat: Define internal Access API by @SanjayVas in #1907
• Create Population Requisition Fulfiller Daemon. by @jojijac0b in #1820
• docs: update local kubenetes configuration README.md by @roaminggypsy in #1928
• fix: Drop unused UpdatePrincipal method and rename repeated field by @SanjayVas in #1938
• Expose deletion_protection variable on gcloud cluster Terraform module by @SanjayVas in #1939
• feat: Report processor supports cumulative and total measurements with different sets of EDP combinations. by @ple13 in #1885
• fix: Ensure event annotations is included in compile-time protobuf descriptors by @SanjayVas in #1945
• fix:Compare computatation token versions in Millbase during exception handling. by @renjiezh in #1920
• ci: Mark webpack_bundle target as no-remote-exec by @SanjayVas in #1933
• refactor: Extract common functionality for APIs by @SanjayVas in #1952
• feat: Add error reasons and exceptions for internal Access API by @SanjayVas in #1953
• feat: Implement Access GetPrincipal and UpdateRole by @SanjayVas in #1954
• feat: prober cron job local configuration by @roaminggypsy in #1935
• fix: Modify IDs used in Report creation in Cloud Correctness Test by @tristanvuong2021 in #1950
• perf: Recreate metric reuse index by @tristanvuong2021 in #1949
• fix: Register event annotations when loading event message descriptor by @SanjayVas in #1958

Full Changelog: v0.5.13...v0.5.14-rc1

v0.5.13

Issues Addressed

• ListMeasurements returns no results when timestamp filter bounds are not set #1893
• ListEventGroups throws error when filtering with known metadata types #1924
• MC and EDP simulators read all EventGroups rather than stopping at first page #1927

Potentially Requiring Action

• The cross-media-measurement-api version is updated to 0.70.0
• The default and maximum page sizes for the ListEventGroups and ListRequisitions methods in this API have changed. See #1924

Full Changelog: v0.5.12...v0.5.13

What's Changed

• ci: Fix cache path for update-trivy-cache workflow by @SanjayVas in #1892
• feat: Add new view for retrieving additional log entries by @tristanvuong2021 in #1889
• ci: Set TCP keepalive for Bazel test workflows by @SanjayVas in #1894
• fix: check updated and created fields before assignment by @roaminggypsy in #1895
• fix: Remove if check for update time filters when adding shard ID clause in StreamMeasurements by @tristanvuong2021 in #1901
• feat: Log ComputationToken details for ALREADY_EXISITS computation. by @renjiezh in #1897
• test: prober integration test by @roaminggypsy in #1887
• feat: Add new Bigquery Table for Computation Participant Stages by @tristanvuong2021 in #1805
• feat: Add new filter for checking externalComputationId, and checking externalComputationId if view is COMPUTATION or COMPUTATION_STATS by @tristanvuong2021 in #1753
• fix: Ensure population is persisted in ModelRelease upon creation by @jojijac0b in #1914
• fix:Handle ApiKey authentication error when it is invalid. by @renjiezh in #1921
• fix: Include known types when building EventGroup filter registry by @SanjayVas in #1925
• fix!: Update maximum and default page_size for ListRequisitions and ListEventGroups by @SanjayVas in #1916
• feat: Use Bouncy Castle to generate CSRs for AWS private CA. by @robinsons in #1905
• test: Implement population requisition fulfiller test in InProcessLifeOfAMeasurementIntegrationTest by @jojijac0b in #1911
• test: Add report creation to correctness test by @tristanvuong2021 in #1845
• refactor: Extract listResources utility function for handling pagination by @SanjayVas in #1923
• fix: Read all EventGroups from simulators rather than stopping at first page #1927 (Included in PR #1923)

Full Changelog: v0.5.12...v0.5.13

v0.5.13-rc1

What's Changed

• ci: Fix cache path for update-trivy-cache workflow by @SanjayVas in #1892
• feat: Add new view for retrieving additional log entries by @tristanvuong2021 in #1889
• ci: Set TCP keepalive for Bazel test workflows by @SanjayVas in #1894
• fix: check updated and created fields before assignment by @roaminggypsy in #1895
• fix: Remove if check for update time filters when adding shard ID clause in StreamMeasurements by @tristanvuong2021 in #1901
• feat: Log ComputationToken details for ALREADY_EXISITS computation. by @renjiezh in #1897
• test: prober integration test by @roaminggypsy in #1887
• feat: Add new Bigquery Table for Computation Participant Stages by @tristanvuong2021 in #1805
• feat: Add new filter for checking externalComputationId, and checking externalComputationId if view is COMPUTATION or COMPUTATION_STATS by @tristanvuong2021 in #1753
• fix: Ensure population is persisted in ModelRelease upon creation by @jojijac0b in #1914

Full Changelog: v0.5.12...v0.5.13-rc1

v0.5.12

Highlights

• The EDP simulator allows custom EventGroup metadata to be specified. See #1880

Potentially Requiring Action

• EDP Simulator EventGroup metadata is now supplied by the required --event-group-metadata option. See #1886 and the updated deployment guide.
  • The previous behavior was to set the metadata to the SyntheticEventGroupSpec specified in the --event-group-spec option.
  • The --event-group-metadata-type-url option is used to indicate the message type of the EventGroup metadata, which must be a known metadata type.
  • The simulator now has the same --known-event-group-metadata-type option as the Kingdom and Reporting API servers.

What's Changed

• feat(edp-simulator)!: Specify EventGroup metadata via command-line option by @SanjayVas in #1886

Full Changelog: v0.5.11...v0.5.12

v0.5.11

Issues Addressed

• Variance calculation throws an error when reach is 0. See #1883

Potentially Requiring Action

• The BigQuery variant of the EDP simulator has been deleted. Only the synthetic generator is supported. See #1881

What's Changed

• refactor: Prevent Get Report failure when result or variance calculation fails by @tristanvuong2021 in #1859
• fix: ensure kplus reach ratio not exceeding 1.0 by @ple13 in #1868
• ci: Use BuildBuddy for Bazel results, remote caching, and remote execution by @SanjayVas in #1840
• refactor: Graduate Report post-processing from experimental by @ple13 in #1853
• test: implement measurement system prober unit test by @roaminggypsy in #1848
• fix: Ensure update-cmms workflow can run with ci Bazel configuration by @SanjayVas in #1876
• ci: Keep Trivy cache up-to-date on default branch by @SanjayVas in #1878
• refactor!: Delete BigQuery and CSV EDP simulator variants by @SanjayVas in #1884
• fix: Allow zero reach in relative frequency variance computation. by @ple13 in #1883

Full Changelog: v0.5.10...v0.5.11

v0.5.10

Highlights

• Last Report time interval extended to end of Report. See #1869
• Liquid Legions sketch params are validated when calculating variance. See #1860
  • This should provide a clearer error message for the case hit in #1858.

Potentially Requiring Action

• During the update process, there may be a temporary performance drop on Kingdom service methods as the MeasurementsByContinuationToken index is dropped and recreated. See #1852 and #1863

What's Changed

• feat: Call noise correction python binary from kotlin. by @ple13 in #1803
• docs: Update Kingdom Deployment doc for HMSS config file. by @renjiezh in #1850
• feat: Add create_time to internal Requisition parent_measurement by @tristanvuong2021 in #1851
• refactor: Use separate queries for each bigquery metrics table by @tristanvuong2021 in #1823
• Add updatetime to Requisition by @roaminggypsy in #1847
• feat: Implement measurement prober metric creation and publication by @roaminggypsy in #1842
• ci: Read Spanner processing units from GitHub environment by @SanjayVas in #1856
• fix: Shard MeasurementsByContinuationToken index to avoid hotspotting by @SanjayVas in #1852
• feat: Throw Transient exceptions in HMSS GetCertificate call. by @renjiezh in #1857
• refactor: verify liquid legion sketch params when computing variances. by @ple13 in #1860
• fix!: Ensure that MeasurementIndexShardId is non-negative by @SanjayVas in #1863
• ControlPlane initial proto definitions. by @Marco-Premier in #1843
• test: Temporarily disable SpannerModelRolloutsServiceTest by @SanjayVas in #1872
• build: Update common-jvm dep for Spanner emulator JUnit rule by @SanjayVas in #1866
• refactor: Remove unneeded measurement view by @tristanvuong2021 in #1854
• ci: Update aquasecurity/trivy-action to 0.28.0 by @SanjayVas in #1875
• build: Update common-jvm for Spanner AsyncDatabaseClient by @SanjayVas in #1839
• feat: Extend last report time interval to end of report by @tristanvuong2021 in #1869

Full Changelog: v0.5.9...v0.5.10

v0.5.10-rc2

What's Changed

• feat: Call noise correction python binary from kotlin. by @ple13 in #1803
• docs: Update Kingdom Deployment doc for HMSS config file. by @renjiezh in #1850
• feat: Add create_time to internal Requisition parent_measurement by @tristanvuong2021 in #1851
• refactor: Use separate queries for each bigquery metrics table by @tristanvuong2021 in #1823
• Add updatetime to Requisition by @roaminggypsy in #1847
• feat: Implement measurement prober metric creation and publication by @roaminggypsy in #1842
• ci: Read Spanner processing units from GitHub environment by @SanjayVas in #1856
• fix: Shard MeasurementsByContinuationToken index to avoid hotspotting by @SanjayVas in #1852
• feat: Throw Transient exceptions in HMSS GetCertificate call. by @renjiezh in #1857
• refactor: verify liquid legion sketch params when computing variances. by @ple13 in #1860
• fix!: Ensure that MeasurementIndexShardId is non-negative by @SanjayVas in #1863

Full Changelog: v0.5.9...v0.5.10-rc2