Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Do not set hint bits at replica until running-xacts record is received #403

Open
wants to merge 25 commits into
base: REL_16_STABLE_neon
Choose a base branch
from
Open

Do not set hint bits at replica until running-xacts record is received #403

wants to merge 25 commits into from

Conversation

knizhnik
Copy link
Contributor

@knizhnik knizhnik commented Mar 22, 2024 •
edited by skyzh
Loading

Matthias van de Meent and others added 25 commits February 6, 2024 13:06
@tristan957
Patch PostgreSQL v16 with squashed patchset
e6f1e42 
This prepares PostgreSQL for compatibility with Neon's storage.
Significant changes compared to the PostgreSQL 15 patchset include:

- Backported changes for users and roles are no longer required
- Use RM_NEON_ID for changes in WAL, instead of modifying core WAL records
@hlinnaka @tristan957
Fix WAL-logging XLOG_NEON_HEAP_LOCK records.
a449856
@knizhnik @tristan957
Upadte last written LSN after walloging all createdb stuff (#308)
2afa3f1 
Co-authored-by: Konstantin Knizhnik <[email protected]>
@knizhnik @arssher @tristan957
Neon logical replication support for PG16 (#310)
5d54d7a 
* Neon logical replication support for PG16

* Log heap rewrite file after creation.

---------

Co-authored-by: Konstantin Knizhnik <[email protected]>
Co-authored-by: Arseny Sher <[email protected]>
@knizhnik @tristan957
Fix elog format error in wallog_mapping_file (#317)
d5424da 
Co-authored-by: Konstantin Knizhnik <[email protected]>
@knizhnik @tristan957
Update WAL buffers when restoring WAL at compute needed for LR (#323)
383b05a 
* Update WAL buffers when restoring WAL at compute needed for LR

* Fix copying data in WAL buffers

---------

Co-authored-by: Konstantin Knizhnik <[email protected]>
@knizhnik @tristan957
Optimize stroing zero FPI in WAL (#327)
e25fffd 
PG16 adds new function to SMGR: zeroextend
It's implementation in Neon actually wal-log zero pages of extended relation.
This zero page is wal-logged using XLOG_FPI.
As far as page is zero, the hole optimization (excluding from the image everything between pg_upper and pd_lower) doesn't work.

This PR allows to set hole size to BLCKSZ in case of zero page (PageIsNull() returns true).
---------

Co-authored-by: Konstantin Knizhnik <[email protected]>
@save-buffer @tristan957
Prevent output callbacks from hearing about neon-file messages (#328)
b5f5755 
* Prevent output callbacks from hearing about neon-file messages
@save-buffer @tristan957
Use strncmp instead of strcmp
a3c2335
@arssher @tristan957
Flush slot creation/drop.
cd07691
@arssher @tristan957
Remove excessive walsender reply logging.
ddd992d
@save-buffer @tristan957
Allow publications FOR ALL TABLES to neon_superuser
d88acb5
@save-buffer @tristan957
Switch GetCurrentRoleId to GetUserId
d4eeba9
@knizhnik @tristan957
Load SLRU segments on demand (#331)
550cdd2 
* Load SLRU segments on demand

refer #8763

* Fix errors in downloading SLRU segments

* Fix build problems

* Undo occcasional changes

* Remove unintenmded changes

* Fix smgr_read_slru_segment

* Determine SLRU kind in extension

* Use ctl->PagePrecedes for SLRU page comparison in SimpleLruDownloadSegment to address wraparround

---------

Co-authored-by: Konstantin Knizhnik <[email protected]>
@hlinnaka
Fix 'mmap' DSM implementation with allocations larger than 4 GB
9c37a49 
Fixes bug #18341. Backpatch to all supported versions.

Discussion: https://www.postgresql.org/message-id/[email protected]
@knizhnik
Flush logical messages with snapshots and replication origin (#382)
dc40299 
Co-authored-by: Konstantin Knizhnik <[email protected]>
@knizhnik
Set wasShutdown=true during hot-standby replica startup only when pri…
61c280c 
…mary is not alive (#363)

* Set wasShutdown=true during hot-standby replica startup only when primary is not alive
* Report fatal error if hot standaby replica is started with oldestAcriveXid=0

Postgres part of neondatabase/neon#6705
---------

Co-authored-by: Konstantin Knizhnik <[email protected]>
@knizhnik
Add comment explaining why it is safe to use FirstNormalTransactionXi…
67240b5 
…d for oldestActiveXid while replica startup (#387)

Co-authored-by: Konstantin Knizhnik <[email protected]>
@knizhnik
Show information about local file cache in EXPLAIN ANALYZE (#384)
072697b 
Co-authored-by: Konstantin Knizhnik <[email protected]>
@hlinnaka @arssher
Treat walproposer like walsenders in postmaster.
6969d90 
This keeps the walproposer processes alive at shutdown, until after
the shutdown checkpoint has been written. That gives the walproposers
a chance to stream it to the safekeepers.
@knizhnik
Include backtrace in 'cannot set parameters during a parallel operati…
2fb3014 
…on' error message (#390)

Co-authored-by: Konstantin Knizhnik <[email protected]>
@arssher
Fix bug introduced in 6969d90
9007894
@tristan957
Add include for storage/off.h in neon_xlog.h
2cd4fc3 
This is done in other Postgres headers.
@knizhnik
Remove Get/SetZenithCurrentClusterSize from Postgres core (#399)
111e82c 
Co-authored-by: Konstantin Knizhnik <[email protected]>
refer #7204
ae092b8 
Do not set hint bits at replica until running-xacts record is received
@skyzh
Copy link
Member

skyzh commented Mar 25, 2024

linking to neondatabase/neon#7236

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

None yet
6 participants
@knizhnik @skyzh @hlinnaka @save-buffer @arssher @tristan957