Releases: PeerDB-io/peerdb
v0.36.2
What's Changed
- Improve ci logging output by @jgao54 in #3766
- Test mysql 9.5 (gtid) and 5.7 (filepos) by @jgao54 in #3767
- CVE-2025-66478: Update nextjs and react,react-dom by @Amogh-Bharadwaj in #3773
- fix(bigquery): improve RECORD data type handling for BigQuery connector by @jkaflik in #3774
- Log paging errors on data migration failure by @ilidemi in #3769
- pgwire 0.36 by @serprex in #3771
- chore(deps): update dockerfile dependencies by @renovate[bot] in #3776
- classify: neon quota exceeded error by @jgao54 in #3780
- chore(deps): update github-actions dependencies by @renovate[bot] in #3777
- chore(deps): update postgres:18-alpine docker digest to eca6fb2 by @renovate[bot] in #3775
- feat(bigquery): verbose into flow info on GCS snapshot by @jkaflik in #3778
- pin clickhouse to a specific version by @jgao54 in #3785
- Shadow deploy applySchemaDeltasV2 with validations by @jgao54 in #3770
Full Changelog: v0.36.1...v0.36.2
v0.36.1
Caution
PeerDB UI on this version is vulnerable to CVE-2025-66478
What’s Changed
- MySQL: support gh-ost migrations (#3756) @ilidemi
- Cancel table addition feature (#3735) @Amogh-Bharadwaj
v0.36.0
Caution
PeerDB UI on this version is vulnerable to CVE-2025-66478
Important
Please pause all mirrors before upgrading to this version!
This version includes a code migration which can cause your mirrors to go non-deterministic and difficult to recover if they're running during deployment.
What's Changed
- Reapply "Store and migrate Postgres table OIDs to catalog (#3704)" (… by @jgao54 in #3730
- track uncompressed bytes for mongodb connector by @jgao54 in #3715
- support Avro uncompressed - improvements by @jgao54 in #3739
- better error handling for getPartitions by @jgao54 in #3742
- notify connectivity error by @jgao54 in #3748
- Notify on auth failure for mongo connector by @jgao54 in #3747
- Dark mode and UI fixes by @ilidemi in #3736
- Don't warn on Mongo variant unsupported by @ilidemi in #3744
- Display more precise durations in batches table by @ilidemi in #3743
- make a catch-all for mongo pool cleared errors by @jgao54 in #3745
- pg qrep: config for avro schema nullable, debug logging by @ilidemi in #3750
- Add missing fields from table addition by @ilidemi in #3755
- improve schema validations gaps by @jgao54 in #3752
- Refactor SchemaTable -> QualifiedTable (and move to pkg) by @jgao54 in #3758
Full Changelog: v0.35.5...v0.36.0
v0.35.5
Caution
PeerDB UI on this version is vulnerable to CVE-2025-66478
What's Changed
- feat: upgrade
docker-compose.ymlstable image tags by @github-actions[bot] in #3664 - Feat: Panic Middleware by @Br0wnHammer in #3680
- chore(deps): update github-actions dependencies by @renovate[bot] in #3711
- Classify PG18 slot error by @ilidemi in #3714
- ignore ShutdownInProgress errors by @jgao54 in #3713
- check wal_level first in postgres by @jgao54 in #3716
- fix(mysql): only error on minimal binlog_row_metadata if supported by @heavycrystal in #3717
- Make safe_wal_size metric optional by @ilidemi in #3724
- Halve CDC channel size by @ilidemi in #3725
- Make ClickHouse client name configurable by @ilidemi in #3726
- improve confusing error message by @jgao54 in #3723
- Classify Mongo error related to incomplete read of message header by @Amogh-Bharadwaj in #3719
- Store and migrate Postgres table OIDs to catalog by @Amogh-Bharadwaj in #3704
- fix(bigquery): fix GCS bucket listing in PullQRepObjects by @jkaflik in #3722
- Revert "Store and migrate Postgres table OIDs to catalog (#3704)" by @jgao54 in #3728
New Contributors
- @Br0wnHammer made their first contribution in #3680
Full Changelog: v0.35.4...v0.35.5
v0.35.4
Caution
PeerDB UI on this version is vulnerable to CVE-2025-66478
What’s Changed
- Revert "Better metrics for CDC store (#3700)" (#3712) @ilidemi
- chore(deps): update dockerfile dependencies (#3710) @renovate[bot]
- [snowflake] Feature Flag for skipping Avro compression algorithm (#3707) @alexstoick
v0.35.3
Caution
PeerDB UI on this version is vulnerable to CVE-2025-66478
What’s Changed
- Better metrics for CDC store (#3700) @ilidemi
- chore(deps): update docker-compose dependencies (#3709) @renovate[bot]
- Add more WAL metrics (#3685) @ilidemi
- Classify too large string for FixedString (#3699) @ilidemi
- detect when binlog_row_metadata becomes minimal (#3698) @jgao54
- Add user-facing logging to identify large tables (#3686) @jgao54
- Revert "Support TIME64 data type for ClickHouse replication (#3691)" (#3696) @jgao54
- Support TIME64 data type for ClickHouse replication (#3691) @NehharShah
- better logging around mysql versioning (#3693) @jgao54
- Improve initial load partitioning logic readability in PG (#3687) @jgao54
- Classify PG pfree invalid pointer error (#3692) @ilidemi
- Update dependencies (#3690) @ilidemi
- Increase QRep fetch size (#3689) @ilidemi
- fix(bigquery): fix down-scoped token prefix path (#3688) @jkaflik
- Set wal_sender_timeout=120s on CDC startup (#3682) @ilidemi
- interrupted query is retryable (#3679) @jgao54
v0.35.2
Caution
PeerDB UI on this version is vulnerable to CVE-2025-66478
What’s Changed
- auth failure should notify connectivity (#3675) @jgao54
- mongo: measure event size instead of metered dialer (#3669) @jgao54
- chore(deps): update temporalio/ui docker tag to v2.43.2 (#3674) @renovate[bot]
- chore(deps): update golang:1.25-alpine docker digest to d3f0cf7 (#3673) @renovate[bot]
- Fix unused code warnings from rust-analyzer (#3672) @ilidemi
- Nudge connection closing via explicit func (#3671) @ilidemi
- follow existing convention: close with logging (#3668) @jgao54
v0.35.1
Caution
PeerDB UI on this version is vulnerable to CVE-2025-66478
What's Changed
- bug fixes for NormalizeRecords by @jgao54 in #3663
- update buf plugin versions by @heavycrystal in #3661
- fix(ui): import @bufbuild/protobuf by @heavycrystal in #3665
- Run UI/nexus CI on buf.gen.yaml changes by @ilidemi in #3666
- make sure dst connection is closed after use by @jgao54 in #3667
Full Changelog: v0.35.0...v0.35.1
v0.35.0
Caution
PeerDB UI on this version is vulnerable to CVE-2025-66478
Breaking changes
- We removed the
PEERDB_CLICKHOUSE_NORMALIZATION_PARTSsetting which historically allow us to chunk our normalization query into parts to address OOM issues for tables with very high volume of updates per batch during CDC. This setting is not enabled by default, and was used sparingly by us. We discovered that if used in conjunction withPEERDB_CLICKHOUSE_PARALLEL_NORMALIZE, could trigger a race condition that results in data loss during replication. The setting that is more useful for addressing OOMs isPEERDB_S3_BYTES_PER_AVRO_FILE, which determines the staging Avro file size limit.
New features
- We added support for Amazon DocumentDB 5.0 by testing its change stream API and removing validation checks that were blocking DocumentDB peer setup.
Changelog
- ui: update dependencies by @serprex in #3638
- fix: trigger GetSourceVariant only during ScheduledTasks by @heavycrystal in #3639
- feat: upgrade
docker-compose.ymlstable image tags by @github-actions[bot] in #3636 - skip unsupported validations for documentdb by @jgao54 in #3635
- make required check generic by @jgao54 in #3643
- fix flow test complete check by @jgao54 in #3652
- chore(deps): update github/codeql-action digest to 0499de3 by @renovate[bot] in #3648
- chore(deps): update node.js to f36fed0 by @renovate[bot] in #3649
- chore(deps): update temporalio/auto-setup:1.29 docker digest to 5b3502a by @renovate[bot] in #3650
- PEERDB_LOG_LEVEL by @serprex in #3647
- improve normalize logic readability by @jgao54 in #3640
- Dev build for PeerDB UI by @ilidemi in #3645
- Speed up dev nexus build by @ilidemi in #3644
- dynamic required job v2 by @jgao54 in #3653
- Add PG18 to CI by @ilidemi in #3641
- [nexus] remove peer_connections by @heavycrystal in #3651
- deprecate PEERDB_CLICKHOUSE_NORMALIZATION_PARTS by @jgao54 in #3654
- [nexus] base64 decode SSH private key before use by @heavycrystal in #3612
- dynamic required job v3 by @jgao54 in #3656
- [postgres] QuoteIdentifier slotName during StartReplication by @heavycrystal in #3658
- Fully remove PEERDB_CLICKHOUSE_INITIAL_LOAD_PARTS_PER_PARTITION by @jgao54 in #3659
- [nexus] create features, disable everything for dev by @heavycrystal in #3646
- PeerDB UI: Better handling of charts and isolate dev changes by @Amogh-Bharadwaj in #3660
Full Changelog: v0.34.8...v0.35.0
v0.34.8
Caution
PeerDB UI on this version is vulnerable to CVE-2025-66478