Data Console

Data Console/ Pipeline Detail

payment-sync

Status

Failed

Success rate

87.4%

Last run

8 min ago

Avg duration

3.2s

Execution stages

1

Extract

48,210 rows · 1.2s

completed
2

Transform

48,210 rows · 2.4s

completed
3

Validate

47,891 rows · 0.3s

failed
4

Load

Waiting for previous stage

pending

Execution log

ERROR09:42:18.342VALIDATESchemaValidationError: column "amount" expected DECIMAL(10,2), got VARCHAR(255) — 319 rows affected [src: payment_events_raw]
ERROR09:42:18.201VALIDATEReferentialIntegrityError: foreign key constraint failed on "order_id" — 47 orphan rows detected
WARN09:42:17.089TRANSFORMNullCoalesceWarning: field "user_id" contained 12 NULL values, coalesced to "anonymous"
WARN09:42:16.774TRANSFORMTypeCoercionWarning: implicit cast from INT to BIGINT on 2,841 rows in column "transaction_id"
INFO09:42:15.112EXTRACTConnectionPool: acquired 4/8 connections, avg wait 23ms, source=payment_db_replica_2
INFO09:42:14.008EXTRACTBatchRead: fetched 48,210 rows in 1,204ms, batch_size=5000, partitions=10
Pipeline ID: payment-syncLast sync: just now
reopt design 예제