Skip to content

Conversation

@SumitKumar-17
Copy link

- Remove extraneous `%s` from `zooPathPrefix` constant in [cdc.go]
- This fixes an issue where the table name was incorrectly prefixed with
`%s` in the Zookeeper path (e.g., `.../mydb/%sanjul_test3_log`) when
using Replicated table engines.
- Resolves PeerDB-io#3783.
@CLAassistant
Copy link

CLAassistant commented Dec 27, 2025

CLA assistant check
All committers have signed the CLA.

@codecov
Copy link

codecov bot commented Dec 27, 2025

❌ 4 Tests Failed:

Tests completed Failed Passed Skipped
1583 4 1579 158
View the top 3 failed test(s) by shortest run time
github.com/PeerDB-io/peerdb/flow/e2e::TestGenericBQ
Stack Traces | 0.01s run time
=== RUN   TestGenericBQ
=== PAUSE TestGenericBQ
=== CONT  TestGenericBQ
--- FAIL: TestGenericBQ (0.01s)
2025/12/27 16:43:29 INFO Executing and processing query x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,t1,k FROM e2e_test_sf_vflqoxv8_20251227164318.\"test_toast_sf_4\" ORDER BY id"
2025/12/27 16:43:29 INFO Executing and processing query stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,t1,k FROM e2e_test_sf_vflqoxv8_20251227164318.\"test_toast_sf_4\" ORDER BY id"
2025/12/27 16:43:29 INFO [pg_query_executor] declared cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursorQuery="DECLARE peerdb_cursor_11728446182950872390 CURSOR FOR SELECT id,t1,k FROM e2e_test_sf_vflqoxv8_20251227164318.\"test_toast_sf_4\" ORDER BY id" args=[]
2025/12/27 16:43:29 INFO [pg_query_executor] fetching rows start x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,t1,k FROM e2e_test_sf_vflqoxv8_20251227164318.\"test_toast_sf_4\" ORDER BY id" channelLen=0
2025/12/27 16:43:29 INFO [pg_query_executor] fetching from cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_11728446182950872390
2025/12/27 16:43:29 INFO processed row stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_11728446182950872390 records=1 bytes=8853 channelLen=0
2025/12/27 16:43:29 INFO [pg_query_executor] fetched rows x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,t1,k FROM e2e_test_sf_vflqoxv8_20251227164318.\"test_toast_sf_4\" ORDER BY id" rows=1 bytes=8853 channelLen=0
2025/12/27 16:43:29 INFO [pg_query_executor] fetching from cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_11728446182950872390
2025/12/27 16:43:29 INFO processed row stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_11728446182950872390 records=0 bytes=0 channelLen=0
2025/12/27 16:43:29 INFO [pg_query_executor] fetched rows x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,t1,k FROM e2e_test_sf_vflqoxv8_20251227164318.\"test_toast_sf_4\" ORDER BY id" rows=0 bytes=0 channelLen=0
2025/12/27 16:43:29 INFO [pg_query_executor] committing transaction x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart
2025/12/27 16:43:29 INFO [pg_query_executor] committed transaction for query x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,t1,k FROM e2e_test_sf_vflqoxv8_20251227164318.\"test_toast_sf_4\" ORDER BY id" rows=1 bytes=8853 channelLen=0
github.com/PeerDB-io/peerdb/flow/e2e::TestPeerFlowE2ETestSuitePG_CH
Stack Traces | 0.01s run time
=== RUN   TestPeerFlowE2ETestSuitePG_CH
=== PAUSE TestPeerFlowE2ETestSuitePG_CH
=== CONT  TestPeerFlowE2ETestSuitePG_CH
--- FAIL: TestPeerFlowE2ETestSuitePG_CH (0.01s)
github.com/PeerDB-io/peerdb/flow/e2e::TestGenericBQ/Test_Inheritance_Table_With_Dynamic_Setting
Stack Traces | 32.6s run time
=== RUN   TestGenericBQ/Test_Inheritance_Table_With_Dynamic_Setting
=== PAUSE TestGenericBQ/Test_Inheritance_Table_With_Dynamic_Setting
=== CONT  TestGenericBQ/Test_Inheritance_Table_With_Dynamic_Setting
2025/12/27 16:41:50 INFO Executing and processing query x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,name,created_at FROM e2e_test_pg_1hewa7vg.\"test_inheritance_dynconf\" ORDER BY id"
2025/12/27 16:41:50 INFO Executing and processing query stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,name,created_at FROM e2e_test_pg_1hewa7vg.\"test_inheritance_dynconf\" ORDER BY id"
2025/12/27 16:41:50 INFO [pg_query_executor] declared cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursorQuery="DECLARE peerdb_cursor_5900255156210606267 CURSOR FOR SELECT id,name,created_at FROM e2e_test_pg_1hewa7vg.\"test_inheritance_dynconf\" ORDER BY id" args=[]
2025/12/27 16:41:50 INFO [pg_query_executor] fetching rows start x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,name,created_at FROM e2e_test_pg_1hewa7vg.\"test_inheritance_dynconf\" ORDER BY id" channelLen=0
2025/12/27 16:41:50 INFO [pg_query_executor] fetching from cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_5900255156210606267
2025/12/27 16:41:50 INFO processed row stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_5900255156210606267 records=8 bytes=168 channelLen=7
2025/12/27 16:41:50 INFO [pg_query_executor] fetched rows x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,name,created_at FROM e2e_test_pg_1hewa7vg.\"test_inheritance_dynconf\" ORDER BY id" rows=8 bytes=168 channelLen=0
2025/12/27 16:41:50 INFO [pg_query_executor] fetching from cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_5900255156210606267
2025/12/27 16:41:50 INFO processed row stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_5900255156210606267 records=0 bytes=0 channelLen=0
2025/12/27 16:41:50 INFO [pg_query_executor] fetched rows x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,name,created_at FROM e2e_test_pg_1hewa7vg.\"test_inheritance_dynconf\" ORDER BY id" rows=0 bytes=0 channelLen=0
2025/12/27 16:41:50 INFO [pg_query_executor] committing transaction x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart
2025/12/27 16:41:50 INFO [pg_query_executor] committed transaction for query x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,name,created_at FROM e2e_test_pg_1hewa7vg.\"test_inheritance_dynconf\" ORDER BY id" rows=8 bytes=168 channelLen=0
2025/12/27 16:41:50 INFO Executing and processing query x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,name,created_at FROM e2e_test_pg_1hewa7vg.\"test_inheritance_dynconf_dst\" ORDER BY id"
2025/12/27 16:41:50 INFO Executing and processing query stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,name,created_at FROM e2e_test_pg_1hewa7vg.\"test_inheritance_dynconf_dst\" ORDER BY id"
2025/12/27 16:41:50 INFO [pg_query_executor] declared cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursorQuery="DECLARE peerdb_cursor_6491105150020264784 CURSOR FOR SELECT id,name,created_at FROM e2e_test_pg_1hewa7vg.\"test_inheritance_dynconf_dst\" ORDER BY id" args=[]
2025/12/27 16:41:50 INFO [pg_query_executor] fetching rows start x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,name,created_at FROM e2e_test_pg_1hewa7vg.\"test_inheritance_dynconf_dst\" ORDER BY id" channelLen=0
2025/12/27 16:41:50 INFO [pg_query_executor] fetching from cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_6491105150020264784
2025/12/27 16:41:50 INFO processed row stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_6491105150020264784 records=8 bytes=168 channelLen=7
2025/12/27 16:41:50 INFO [pg_query_executor] fetched rows x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,name,created_at FROM e2e_test_pg_1hewa7vg.\"test_inheritance_dynconf_dst\" ORDER BY id" rows=8 bytes=168 channelLen=0
2025/12/27 16:41:50 INFO [pg_query_executor] fetching from cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_6491105150020264784
2025/12/27 16:41:50 INFO processed row stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_6491105150020264784 records=0 bytes=0 channelLen=0
2025/12/27 16:41:50 INFO [pg_query_executor] fetched rows x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,name,created_at FROM e2e_test_pg_1hewa7vg.\"test_inheritance_dynconf_dst\" ORDER BY id" rows=0 bytes=0 channelLen=0
2025/12/27 16:41:50 INFO [pg_query_executor] committing transaction x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart
2025/12/27 16:41:50 INFO [pg_query_executor] committed transaction for query x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,name,created_at FROM e2e_test_pg_1hewa7vg.\"test_inheritance_dynconf_dst\" ORDER BY id" rows=8 bytes=168 channelLen=0
    generic_test.go:978: UNEXPECTED STATUS TIMEOUT STATUS_SNAPSHOT
    bigquery.go:86: begin tearing down postgres schema bq_jkwrnn3l_20251227164150
2025/12/27 16:42:22 INFO Executing and processing query x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,name,created_at FROM e2e_test_bq_2ong1nn3_20251227164139.\"test_partition_noroot\" ORDER BY id"
2025/12/27 16:42:22 INFO Executing and processing query stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,name,created_at FROM e2e_test_bq_2ong1nn3_20251227164139.\"test_partition_noroot\" ORDER BY id"
2025/12/27 16:42:22 INFO [pg_query_executor] declared cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursorQuery="DECLARE peerdb_cursor_549862440697428545 CURSOR FOR SELECT id,name,created_at FROM e2e_test_bq_2ong1nn3_20251227164139.\"test_partition_noroot\" ORDER BY id" args=[]
2025/12/27 16:42:22 INFO [pg_query_executor] fetching rows start x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,name,created_at FROM e2e_test_bq_2ong1nn3_20251227164139.\"test_partition_noroot\" ORDER BY id" channelLen=0
2025/12/27 16:42:22 INFO [pg_query_executor] fetching from cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_549862440697428545
2025/12/27 16:42:22 INFO processed row stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_549862440697428545 records=13 bytes=293 channelLen=12
2025/12/27 16:42:22 INFO [pg_query_executor] fetched rows x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,name,created_at FROM e2e_test_bq_2ong1nn3_20251227164139.\"test_partition_noroot\" ORDER BY id" rows=13 bytes=293 channelLen=12
2025/12/27 16:42:22 INFO [pg_query_executor] fetching from cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_549862440697428545
2025/12/27 16:42:22 INFO processed row stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_549862440697428545 records=0 bytes=0 channelLen=0
2025/12/27 16:42:22 INFO [pg_query_executor] fetched rows x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,name,created_at FROM e2e_test_bq_2ong1nn3_20251227164139.\"test_partition_noroot\" ORDER BY id" rows=0 bytes=0 channelLen=0
2025/12/27 16:42:22 INFO [pg_query_executor] committing transaction x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart
2025/12/27 16:42:22 INFO [pg_query_executor] committed transaction for query x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,name,created_at FROM e2e_test_bq_2ong1nn3_20251227164139.\"test_partition_noroot\" ORDER BY id" rows=13 bytes=293 channelLen=0
--- FAIL: TestGenericBQ/Test_Inheritance_Table_With_Dynamic_Setting (32.63s)
github.com/PeerDB-io/peerdb/flow/e2e::TestPeerFlowE2ETestSuitePG_CH/Test_Normalize_Metadata_With_Retry
Stack Traces | 201s run time
=== RUN   TestPeerFlowE2ETestSuitePG_CH/Test_Normalize_Metadata_With_Retry
=== PAUSE TestPeerFlowE2ETestSuitePG_CH/Test_Normalize_Metadata_With_Retry
=== CONT  TestPeerFlowE2ETestSuitePG_CH/Test_Normalize_Metadata_With_Retry
2025/12/27 16:49:06 INFO Received AWS credentials from peer for connector: ci x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN}
2025/12/27 16:49:06 INFO Received AWS credentials from peer for connector: clickhouse x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN}
2025/12/27 16:49:06 INFO Executing and processing query x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,ky,val,n,t FROM e2e_test_pgch_grzwmm4m.\"test_nullable_mirror\" ORDER BY id"
2025/12/27 16:49:06 INFO Executing and processing query stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,ky,val,n,t FROM e2e_test_pgch_grzwmm4m.\"test_nullable_mirror\" ORDER BY id"
2025/12/27 16:49:06 INFO [pg_query_executor] declared cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursorQuery="DECLARE peerdb_cursor_5438767614736594102 CURSOR FOR SELECT id,ky,val,n,t FROM e2e_test_pgch_grzwmm4m.\"test_nullable_mirror\" ORDER BY id" args=[]
2025/12/27 16:49:06 INFO [pg_query_executor] fetching rows start x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,ky,val,n,t FROM e2e_test_pgch_grzwmm4m.\"test_nullable_mirror\" ORDER BY id" channelLen=0
2025/12/27 16:49:06 INFO [pg_query_executor] fetching from cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_5438767614736594102
2025/12/27 16:49:06 INFO processed row stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_5438767614736594102 records=2 bytes=15 channelLen=1
2025/12/27 16:49:06 INFO [pg_query_executor] fetched rows x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,ky,val,n,t FROM e2e_test_pgch_grzwmm4m.\"test_nullable_mirror\" ORDER BY id" rows=2 bytes=15 channelLen=0
2025/12/27 16:49:06 INFO [pg_query_executor] fetching from cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_5438767614736594102
2025/12/27 16:49:06 INFO processed row stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_5438767614736594102 records=0 bytes=0 channelLen=0
2025/12/27 16:49:06 INFO [pg_query_executor] fetched rows x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,ky,val,n,t FROM e2e_test_pgch_grzwmm4m.\"test_nullable_mirror\" ORDER BY id" rows=0 bytes=0 channelLen=0
2025/12/27 16:49:06 INFO [pg_query_executor] committing transaction x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart
2025/12/27 16:49:06 INFO [pg_query_executor] committed transaction for query x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,ky,val,n,t FROM e2e_test_pgch_grzwmm4m.\"test_nullable_mirror\" ORDER BY id" rows=2 bytes=15 channelLen=0
    clickhouse_test.go:2100: WaitFor waiting on initial 2025-12-27 16:49:11.515317065 +0000 UTC m=+585.731437964
2025/12/27 16:49:11 INFO Executing and processing query x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,\"key\" FROM e2e_test_pgch_0q175ydk.\"test_normalize_metadata_with_retry_1\" ORDER BY id"
2025/12/27 16:49:11 INFO Executing and processing query stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,\"key\" FROM e2e_test_pgch_0q175ydk.\"test_normalize_metadata_with_retry_1\" ORDER BY id"
2025/12/27 16:49:11 INFO [pg_query_executor] declared cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursorQuery="DECLARE peerdb_cursor_915485950965073748 CURSOR FOR SELECT id,\"key\" FROM e2e_test_pgch_0q175ydk.\"test_normalize_metadata_with_retry_1\" ORDER BY id" args=[]
2025/12/27 16:49:11 INFO [pg_query_executor] fetching rows start x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,\"key\" FROM e2e_test_pgch_0q175ydk.\"test_normalize_metadata_with_retry_1\" ORDER BY id" channelLen=0
2025/12/27 16:49:11 INFO [pg_query_executor] fetching from cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_915485950965073748
2025/12/27 16:49:11 INFO processed row stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_915485950965073748 records=4 bytes=29 channelLen=3
2025/12/27 16:49:11 INFO [pg_query_executor] fetched rows x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,\"key\" FROM e2e_test_pgch_0q175ydk.\"test_normalize_metadata_with_retry_1\" ORDER BY id" rows=4 bytes=29 channelLen=0
2025/12/27 16:49:11 INFO [pg_query_executor] fetching from cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_915485950965073748
2025/12/27 16:49:11 INFO processed row stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_915485950965073748 records=0 bytes=0 channelLen=0
2025/12/27 16:49:11 INFO [pg_query_executor] fetched rows x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,\"key\" FROM e2e_test_pgch_0q175ydk.\"test_normalize_metadata_with_retry_1\" ORDER BY id" rows=0 bytes=0 channelLen=0
2025/12/27 16:49:11 INFO [pg_query_executor] committing transaction x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart
2025/12/27 16:49:11 INFO [pg_query_executor] committed transaction for query x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,\"key\" FROM e2e_test_pgch_0q175ydk.\"test_normalize_metadata_with_retry_1\" ORDER BY id" rows=4 bytes=29 channelLen=0
    clickhouse_test.go:2114: WaitFor waiting for first sync to complete 2025-12-27 16:49:11.532267729 +0000 UTC m=+585.748388628
2025/12/27 16:49:11 INFO Executing and processing query x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT sync_batch_id FROM metadata_last_sync_state WHERE job_name='test_normalize_metadata_with_retry_pgch_0q175ydk'"
2025/12/27 16:49:11 INFO Executing and processing query stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT sync_batch_id FROM metadata_last_sync_state WHERE job_name='test_normalize_metadata_with_retry_pgch_0q175ydk'"
2025/12/27 16:49:11 INFO [pg_query_executor] declared cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursorQuery="DECLARE peerdb_cursor_14630571003560528661 CURSOR FOR SELECT sync_batch_id FROM metadata_last_sync_state WHERE job_name='test_normalize_metadata_with_retry_pgch_0q175ydk'" args=[]
2025/12/27 16:49:11 INFO [pg_query_executor] fetching rows start x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT sync_batch_id FROM metadata_last_sync_state WHERE job_name='test_normalize_metadata_with_retry_pgch_0q175ydk'" channelLen=0
2025/12/27 16:49:11 INFO [pg_query_executor] fetching from cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_14630571003560528661
2025/12/27 16:49:11 INFO processed row stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_14630571003560528661 records=0 bytes=0 channelLen=0
2025/12/27 16:49:11 INFO [pg_query_executor] fetched rows x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT sync_batch_id FROM metadata_last_sync_state WHERE job_name='test_normalize_metadata_with_retry_pgch_0q175ydk'" rows=0 bytes=0 channelLen=0
2025/12/27 16:49:11 INFO [pg_query_executor] committing transaction x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart
2025/12/27 16:49:11 INFO [pg_query_executor] committed transaction for query x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT sync_batch_id FROM metadata_last_sync_state WHERE job_name='test_normalize_metadata_with_retry_pgch_0q175ydk'" rows=0 bytes=0 channelLen=0
    clickhouse_test.go:2129: WaitFor waiting for raw table push to complete 2025-12-27 16:49:27.576184216 +0000 UTC m=+601.792305115
    clickhouse_test.go:2142: WaitFor waiting for normalize error 2025-12-27 16:49:27.578971468 +0000 UTC m=+601.795092377
2025/12/27 16:49:27 INFO Executing and processing query x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="\n\t\tSELECT COUNT(*) FROM peerdb_stats.flow_errors\n\t\tWHERE error_type='error' AND position('test_normalize_metadata_with_retry_pgch_0q175ydk' in flow_name) > 0\n\t\tAND error_message ILIKE '%error while inserting into target clickhouse table%'"
2025/12/27 16:49:27 INFO Executing and processing query stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="\n\t\tSELECT COUNT(*) FROM peerdb_stats.flow_errors\n\t\tWHERE error_type='error' AND position('test_normalize_metadata_with_retry_pgch_0q175ydk' in flow_name) > 0\n\t\tAND error_message ILIKE '%error while inserting into target clickhouse table%'"
2025/12/27 16:49:27 INFO [pg_query_executor] declared cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursorQuery="DECLARE peerdb_cursor_1520531051714517596 CURSOR FOR \n\t\tSELECT COUNT(*) FROM peerdb_stats.flow_errors\n\t\tWHERE error_type='error' AND position('test_normalize_metadata_with_retry_pgch_0q175ydk' in flow_name) > 0\n\t\tAND error_message ILIKE '%error while inserting into target clickhouse table%'" args=[]
2025/12/27 16:49:27 INFO [pg_query_executor] fetching rows start x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="\n\t\tSELECT COUNT(*) FROM peerdb_stats.flow_errors\n\t\tWHERE error_type='error' AND position('test_normalize_metadata_with_retry_pgch_0q175ydk' in flow_name) > 0\n\t\tAND error_message ILIKE '%error while inserting into target clickhouse table%'" channelLen=0
2025/12/27 16:49:27 INFO [pg_query_executor] fetching from cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_1520531051714517596
2025/12/27 16:49:27 INFO processed row stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_1520531051714517596 records=1 bytes=8 channelLen=0
2025/12/27 16:49:27 INFO [pg_query_executor] fetched rows x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="\n\t\tSELECT COUNT(*) FROM peerdb_stats.flow_errors\n\t\tWHERE error_type='error' AND position('test_normalize_metadata_with_retry_pgch_0q175ydk' in flow_name) > 0\n\t\tAND error_message ILIKE '%error while inserting into target clickhouse table%'" rows=1 bytes=8 channelLen=0
2025/12/27 16:49:27 INFO [pg_query_executor] fetching from cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_1520531051714517596
2025/12/27 16:49:27 INFO processed row stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_1520531051714517596 records=0 bytes=0 channelLen=0
2025/12/27 16:49:27 INFO [pg_query_executor] fetched rows x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="\n\t\tSELECT COUNT(*) FROM peerdb_stats.flow_errors\n\t\tWHERE error_type='error' AND position('test_normalize_metadata_with_retry_pgch_0q175ydk' in flow_name) > 0\n\t\tAND error_message ILIKE '%error while inserting into target clickhouse table%'" rows=0 bytes=0 channelLen=0
2025/12/27 16:49:27 INFO [pg_query_executor] committing transaction x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart
2025/12/27 16:49:27 INFO [pg_query_executor] committed transaction for query x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="\n\t\tSELECT COUNT(*) FROM peerdb_stats.flow_errors\n\t\tWHERE error_type='error' AND position('test_normalize_metadata_with_retry_pgch_0q175ydk' in flow_name) > 0\n\t\tAND error_message ILIKE '%error while inserting into target clickhouse table%'" rows=1 bytes=8 channelLen=0
    clickhouse_test.go:2155: WaitFor waiting for second sync to complete 2025-12-27 16:49:27.590091594 +0000 UTC m=+601.806212513
2025/12/27 16:49:27 INFO Executing and processing query x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT sync_batch_id FROM metadata_last_sync_state WHERE job_name='test_normalize_metadata_with_retry_pgch_0q175ydk'"
2025/12/27 16:49:27 INFO Executing and processing query stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT sync_batch_id FROM metadata_last_sync_state WHERE job_name='test_normalize_metadata_with_retry_pgch_0q175ydk'"
2025/12/27 16:49:27 INFO [pg_query_executor] declared cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursorQuery="DECLARE peerdb_cursor_18165014774950039618 CURSOR FOR SELECT sync_batch_id FROM metadata_last_sync_state WHERE job_name='test_normalize_metadata_with_retry_pgch_0q175ydk'" args=[]
2025/12/27 16:49:27 INFO [pg_query_executor] fetching rows start x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT sync_batch_id FROM metadata_last_sync_state WHERE job_name='test_normalize_metadata_with_retry_pgch_0q175ydk'" channelLen=0
2025/12/27 16:49:27 INFO [pg_query_executor] fetching from cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_18165014774950039618
2025/12/27 16:49:27 INFO processed row stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_18165014774950039618 records=1 bytes=8 channelLen=0
2025/12/27 16:49:27 INFO [pg_query_executor] fetched rows x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT sync_batch_id FROM metadata_last_sync_state WHERE job_name='test_normalize_metadata_with_retry_pgch_0q175ydk'" rows=1 bytes=8 channelLen=0
2025/12/27 16:49:27 INFO [pg_query_executor] fetching from cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_18165014774950039618
2025/12/27 16:49:27 INFO processed row stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_18165014774950039618 records=0 bytes=0 channelLen=0
2025/12/27 16:49:27 INFO [pg_query_executor] fetched rows x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT sync_batch_id FROM metadata_last_sync_state WHERE job_name='test_normalize_metadata_with_retry_pgch_0q175ydk'" rows=0 bytes=0 channelLen=0
2025/12/27 16:49:27 INFO [pg_query_executor] committing transaction x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart
2025/12/27 16:49:27 INFO [pg_query_executor] committed transaction for query x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT sync_batch_id FROM metadata_last_sync_state WHERE job_name='test_normalize_metadata_with_retry_pgch_0q175ydk'" rows=1 bytes=8 channelLen=0
    clickhouse_test.go:2169: WaitFor waiting for second raw table push to complete 2025-12-27 16:49:42.630989118 +0000 UTC m=+616.847110017
2025/12/27 16:49:42 INFO Executing and processing query x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_xbr822yx.\"t1\" ORDER BY id"
2025/12/27 16:49:42 INFO Executing and processing query stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_xbr822yx.\"t1\" ORDER BY id"
2025/12/27 16:49:42 INFO [pg_query_executor] declared cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursorQuery="DECLARE peerdb_cursor_13645188237010773250 CURSOR FOR SELECT id,val FROM e2e_test_api_xbr822yx.\"t1\" ORDER BY id" args=[]
2025/12/27 16:49:42 INFO [pg_query_executor] fetching rows start x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_xbr822yx.\"t1\" ORDER BY id" channelLen=0
2025/12/27 16:49:42 INFO [pg_query_executor] fetching from cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_13645188237010773250
2025/12/27 16:49:42 INFO processed row stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_13645188237010773250 records=2 bytes=19 channelLen=1
2025/12/27 16:49:42 INFO [pg_query_executor] fetched rows x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_xbr822yx.\"t1\" ORDER BY id" rows=2 bytes=19 channelLen=0
2025/12/27 16:49:42 INFO [pg_query_executor] fetching from cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_13645188237010773250
2025/12/27 16:49:42 INFO processed row stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_13645188237010773250 records=0 bytes=0 channelLen=0
2025/12/27 16:49:42 INFO [pg_query_executor] fetched rows x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_xbr822yx.\"t1\" ORDER BY id" rows=0 bytes=0 channelLen=0
2025/12/27 16:49:42 INFO [pg_query_executor] committing transaction x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart
2025/12/27 16:49:42 INFO [pg_query_executor] committed transaction for query x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_xbr822yx.\"t1\" ORDER BY id" rows=2 bytes=19 channelLen=0
    clickhouse_test.go:2181: WaitFor check normalize table metadata after normalize 2025-12-27 16:50:26.797150352 +0000 UTC m=+661.013271251
2025/12/27 16:50:26 INFO Executing and processing query x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="\n\t\tSELECT (table_batch_id_data->>'test_normalize_metadata_with_retry_dst_1')::bigint, (table_batch_id_data->>'test_normalize_metadata_with_retry_dst_2')::bigint\n\t\tFROM metadata_last_sync_state WHERE job_name='test_normalize_metadata_with_retry_pgch_0q175ydk'"
2025/12/27 16:50:26 INFO Executing and processing query stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="\n\t\tSELECT (table_batch_id_data->>'test_normalize_metadata_with_retry_dst_1')::bigint, (table_batch_id_data->>'test_normalize_metadata_with_retry_dst_2')::bigint\n\t\tFROM metadata_last_sync_state WHERE job_name='test_normalize_metadata_with_retry_pgch_0q175ydk'"
2025/12/27 16:50:26 INFO [pg_query_executor] declared cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursorQuery="DECLARE peerdb_cursor_11617518865442903841 CURSOR FOR \n\t\tSELECT (table_batch_id_data->>'test_normalize_metadata_with_retry_dst_1')::bigint, (table_batch_id_data->>'test_normalize_metadata_with_retry_dst_2')::bigint\n\t\tFROM metadata_last_sync_state WHERE job_name='test_normalize_metadata_with_retry_pgch_0q175ydk'" args=[]
2025/12/27 16:50:26 INFO [pg_query_executor] fetching rows start x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="\n\t\tSELECT (table_batch_id_data->>'test_normalize_metadata_with_retry_dst_1')::bigint, (table_batch_id_data->>'test_normalize_metadata_with_retry_dst_2')::bigint\n\t\tFROM metadata_last_sync_state WHERE job_name='test_normalize_metadata_with_retry_pgch_0q175ydk'" channelLen=0
2025/12/27 16:50:26 INFO [pg_query_executor] fetching from cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_11617518865442903841
2025/12/27 16:50:26 INFO processed row stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_11617518865442903841 records=1 bytes=0 channelLen=0
2025/12/27 16:50:26 INFO [pg_query_executor] fetched rows x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="\n\t\tSELECT (table_batch_id_data->>'test_normalize_metadata_with_retry_dst_1')::bigint, (table_batch_id_data->>'test_normalize_metadata_with_retry_dst_2')::bigint\n\t\tFROM metadata_last_sync_state WHERE job_name='test_normalize_metadata_with_retry_pgch_0q175ydk'" rows=1 bytes=0 channelLen=0
2025/12/27 16:50:26 INFO [pg_query_executor] fetching from cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_11617518865442903841
2025/12/27 16:50:26 INFO processed row stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_11617518865442903841 records=0 bytes=0 channelLen=0
2025/12/27 16:50:26 INFO [pg_query_executor] fetched rows x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="\n\t\tSELECT (table_batch_id_data->>'test_normalize_metadata_with_retry_dst_1')::bigint, (table_batch_id_data->>'test_normalize_metadata_with_retry_dst_2')::bigint\n\t\tFROM metadata_last_sync_state WHERE job_name='test_normalize_metadata_with_retry_pgch_0q175ydk'" rows=0 bytes=0 channelLen=0
2025/12/27 16:50:26 INFO [pg_query_executor] committing transaction x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart
2025/12/27 16:50:26 INFO [pg_query_executor] committed transaction for query x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="\n\t\tSELECT (table_batch_id_data->>'test_normalize_metadata_with_retry_dst_1')::bigint, (table_batch_id_data->>'test_normalize_metadata_with_retry_dst_2')::bigint\n\t\tFROM metadata_last_sync_state WHERE job_name='test_normalize_metadata_with_retry_pgch_0q175ydk'" rows=1 bytes=0 channelLen=0
    clickhouse_test.go:2195: metadata_last_sync_state <nil> <nil>
    clickhouse.go:114: begin tearing down postgres schema pgch_0q175ydk
    clickhouse.go:114: 
        	Error Trace:	.../flow/e2e/pg.go:149
        	            				.../flow/e2e/clickhouse.go:114
        	            				.../flow/e2eshared/e2eshared.go:38
        	            				.../hostedtoolcache/go/1.25.5.../src/testing/testing.go:1308
        	            				.../hostedtoolcache/go/1.25.5.../src/testing/testing.go:1572
        	            				.../hostedtoolcache/go/1.25.5.../src/testing/testing.go:1928
        	            				.../hostedtoolcache/go/1.25.5.../src/runtime/panic.go:783
        	            				.../hostedtoolcache/go/1.25.5.../src/runtime/iface.go:275
        	            				.../flow/e2e/clickhouse_test.go:2196
        	            				.../flow/e2e/test_utils.go:848
        	            				.../flow/e2e/clickhouse_test.go:2181
        	Error:      	failed to teardown postgres schema
        	Test:       	TestPeerFlowE2ETestSuitePG_CH/Test_Normalize_Metadata_With_Retry
        	Messages:   	pgch_0q175ydk: failed to drop replication slots: ERROR: replication slot "peerflow_slot_test_normalize_metadata_with_retry_pgch_0q175ydk" is active for PID 23206 (SQLSTATE 55006)
--- FAIL: TestPeerFlowE2ETestSuitePG_CH/Test_Normalize_Metadata_With_Retry (200.54s)

To view more test analytics, go to the Test Analytics Dashboard
📋 Got 3 mins? Take this short survey to help us improve Test Analytics.

@SumitKumar-17 SumitKumar-17 deployed to external-contributor January 2, 2026 19:10 — with GitHub Actions Active
@SumitKumar-17 SumitKumar-17 temporarily deployed to external-contributor January 2, 2026 19:10 — with GitHub Actions Inactive
ilidemi added a commit that referenced this pull request Jan 2, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Wrong Zookeeper path when using Replicated table engine

2 participants