release-5779

What's Changed

• storcon: handle entire cluster going unavailable correctly by @VladLazar in #8060
• CI(check-build-tools-image): change build-tools image persistent tag by @bayandin in #8059
• Fix log rates by @MMeent in #8035
• [v2] Include openssl and ICU statically linked by @problame in #8074
• pageserver: eliminate CalculateSyntheticSizeError::LsnNotFound (test_metric_collection flake) by @jcsp in #8065
• safekeeper: streaming pull_timeline by @arssher in #7944
• Add support to specifying storage account in AzureConfig by @arpad-m in #8090
• build(deps): bump ws from 8.16.0 to 8.17.1 in /test_runner/pg_clients/typescript/serverless-driver by @dependabot in #8087
• build(deps): bump urllib3 from 1.26.18 to 1.26.19 by @dependabot in #8086
• Update document on Postgres core changes by @hlinnaka in #7416
• feat(pageserver): use leases to temporarily block gc by @yliang412 in #8084
• Remove dead code from walproposer_pg.c by @arssher in #8092
• feat(pageserver): add iterator API for btree reader by @skyzh in #8083
• Copy release images to prod ECR by @SergeyMelnikov in #8101
• storcon: add drain and fill background operations for graceful cluster restarts by @VladLazar in #8014
• test: fix tenant duplication utility generation numbers by @VladLazar in #8096
• neon_local: background_process: launch all processes in repo dir (or datadir) by @problame in #8058
• tests: make Endpoint.stop() thread safe (occasional flakes in test_multi_attach) by @jcsp in #8110
• proxy: reduce some per-task memory usage by @conradludgate in #8095
• allow storage_controller error during pagebench by @Bodobolero in #8109
• Make sure we can handle temporarily offline PS when we first connect by @MMeent in #8094
• tests: use semaphore instead of lock for Endpoint.running by @jcsp in #8112
• CI(test-images): add dockerhub auth by @bayandin in #8115
• CI: miscellaneous cleanups by @bayandin in #8073
• remove materialized page cache by @problame in #8105
• fix: preinitialize pageserver_basebackup_query_seconds metric by @problame in #8121
• storcon: use attached shard counts for initial shard placement by @VladLazar in #8061
• Add tracing for shared locks in id_lock_map by @jbajic in #7618
• storcon: avoid promoting too many shards of the same tenant by @VladLazar in #8099
• pageserver: remove unused load/ignore APIs by @jcsp in #8122
• Allow longer timeout for starting pageserver, safe keeper and storage controller in test cases to make test cases less flaky by @Bodobolero in #8079
• Add eviction_state to control file by @petuhovskiy in #8125
• pageserver: always detach before deleting by @jcsp in #8082
• storcon: implement endpoints for cancellation of drain and fill operations by @VladLazar in #8029
• tests: allow-list neon_local endpoint errors from storage controller by @jcsp in #8123
• Remove kq_imcx extension from public compute image by @lubennikovaav in #5201
• storcon: improve drain and fill shard placement by @VladLazar in #8119
• Use serde for RemoteStorageConfig parsing by @arpad-m in #8126
• Storage & Compute release 2024-06-24 by @vipvap in #8138

Full Changelog: release-5733...release-5779