Data ConsoleAcme / Data platformPipeline detail
Productionaws · us-east-1AK
Data platformSample workspace
Data platformAcme workspace
OverviewPipelines 6Workspace guide
Needs attentionpayment-synclog-aggregator
Scheduler onlineSample data · read-only sources
AKAlex KimPlatform engineer
Pipelines

log-aggregator

S3 → ClickHouse · Every 1 min · SRE

Degraded
Selected runrun_1842
Rows extracted14,210
Rows loaded9,840
Execution stateDegraded

Execution stages

run_1842 · select a stage to filter logs

Execution log

4 entries
0109:55:12.880WARNLOADBackpressureWarning: queue depth 14.2k exceeds 10k threshold — load throughput throttled to 1.2k rows/s
0209:55:11.430WARNLOADSlowCommit: target table commit took 8,100ms (p99 budget 3,000ms)
0309:55:10.004INFOVALIDATESchemaCheck: 14,210 rows validated, 0 violations
0409:55:09.117INFOEXTRACTBatchRead: fetched 14,210 rows in 412ms, batch_size=5000
End of captured logUTF-8 · UTC

Pipeline metadata

Pipeline ID
log-agg
Owner
SRE
Schedule
Every 1 min
Success · 24h
92.1%
Avg. duration
0.9s
Source
S3
Destination
ClickHouse

Run diagnostics

Degraded

Destination is responding slowly

The load stage is still running. Check destination capacity and connection pool saturation.

Simulation uses the same sample input and produces the same outcome. No jobs are sent to an external service.

Sample workspace · 27 Oct 2026, 09:56 UTCPipeline ID: log-agg
reopt design exampleDemo screen, not a live serviceTemplates

Example notes

This screen is a reopt design example shaped like a standalone app, not a live service.

Components and usageInstall in your project

Use this in your project

Open the component guide above for live examples and imports, then follow the installation guide to connect styles and theming.

Connect your own service

Review authentication, API and storage behavior before connecting your own environment. Supported actions and sample data differ by example.