Data Console

Data Console/ Pipeline Detail

log-aggregator

Status

Degraded

Success rate

92.1%

Last run

< 1 min ago

Avg duration

0.9s

Execution stages

1

Extract

48,210 rows · 1.2s

completed
2

Transform

48,210 rows · 2.4s

completed
3

Validate

47,891 rows · 0.3s

failed
4

Load

Waiting for previous stage

pending

Execution log

WARN09:42:17.089TRANSFORMNullCoalesceWarning: field "user_id" contained 12 NULL values, coalesced to "anonymous"
WARN09:42:16.774TRANSFORMTypeCoercionWarning: implicit cast from INT to BIGINT on 2,841 rows in column "transaction_id"
INFO09:42:15.112EXTRACTConnectionPool: acquired 4/8 connections, avg wait 23ms, source=payment_db_replica_2
INFO09:42:14.008EXTRACTBatchRead: fetched 48,210 rows in 1,204ms, batch_size=5000, partitions=10
Pipeline ID: log-aggLast sync: just now
reopt design example