Real sources, controlled access
The PostgreSQL connector scans the source in a read-only transaction. Scope, row budget, method, and duration are reported; a partial scan is never presented as a full scan.
PipeSentinel makes silent data failures visible. It detects anomalies, maps the affected pipeline, explains likely root causes with evidence, and tests proposed fixes on isolated data before a person decides what to do.
Working prototype, clearly defined scope.
PostgreSQL source analysis and evidence-based RCA are available.
orders.total_amount · latest scan
A SUCCESSFUL JOB DOES NOT GUARANTEE TRUSTWORTHY DATA.
A pipeline can finish without an error while a column disappears, amounts arrive in the wrong units, or the same rows load twice. The dashboard is green, but the data behind a decision may be wrong.
Explore a real test scenario ↗Schema, completeness, distribution, volume, and freshness appear in separate tools.
An alert alone cannot show which source affects which report.
Changing production data is hard without evidence and a before-and-after comparison.
ONE WORKFLOW, FROM DETECTION TO DECISION.
PipeSentinel connects quality signals with technical and business context. Every step produces evidence that can be reviewed.
A read-only PostgreSQL connection starts a scoped analysis of the selected table and partition. The connection secret stays in an environment variable, outside metadata.
AN EXPLAINABLE INCIDENT, NOT AN ABSTRACT ALERT.
Six synthetic scenarios reproduce failures ranging from schema loss to delayed freshness. Each is evaluated against its expected signal and root-cause hypothesis.
orders.total_amount values rise to roughly 100 times the expected level.
A contract range violation and baseline distribution shift appear together.
The rules engine presents a possible unit / scale change as an evidence-backed hypothesis.
A limited scale template is tested on an isolated snapshot; the result goes to human review.
AN AUDITABLE ARCHITECTURE.
Anomaly detection uses deterministic contract rules and statistical comparisons. The core workflow works with the LLM disabled; when enabled, it turns existing evidence into a clearer explanation.
The PostgreSQL connector scans the source in a read-only transaction. Scope, row budget, method, and duration are reported; a partial scan is never presented as a full scan.
Empty or anomalous scans cannot become baselines. A clean candidate needs operator approval, and seasonal comparisons require enough approved history.
dbt manifests and OpenLineage events feed the dependency graph. Related incidents are grouped, while timing alone is never presented as proof of a shared cause.
Scale correction and exact-row deduplication templates run on isolated snapshots. Before-and-after profiles, contracts, and control groups are compared.
PipeSentinel does not write fixes to production data on its own. An approval record does not execute SQL. Snapshot validation shows whether a proposal meets the contract; it does not guarantee business correctness or every downstream outcome.
Read the scope limitsPRODUCT HYPOTHESIS AND NEXT MILESTONE.
The initial customer hypothesis is small and midsize data teams using PostgreSQL and dbt. The value proposition brings early detection, evidence-backed diagnosis, and controlled fix evaluation into one interface.
“Shorten the path from alert to action without losing the evidence.”
Live PostgreSQL source analysis, YAML contracts, quality-approved baselines, dbt/OpenLineage ingestion, RCA, isolated fix validation, dashboard, and API.
Pilots will measure false alert rate, time to detect and diagnose, human effort per incident, query cost, and the share of fixes validated in real pipelines.
Pilot feedback will guide priorities for access control, deployment, broader data sources, and safeguards for production remediation.
F01–F06 results come from synthetic regression scenarios. They do not claim production accuracy, revenue, customer count, or market share.
FOR TECHNICAL EVALUATION.
A PostgreSQL connector supports real source analysis. dbt manifests and run results, plus OpenLineage RunEvents, add dependency and change context. Support for other databases is not claimed.
No. Detection uses contracts and statistical rules. Rule-based root-cause hypotheses link back to evidence; the LLM is an optional explanation layer. Actions are presented for human review.
No. Supported templates are tested on isolated snapshots. An approval record does not run SQL or dbt in production. Automatic production application, rollback, and backfill are outside this version’s scope.
The F01–F06 synthetic failure catalog has deterministic regression evaluations and integration tests. Real-world false alert and detection rates still need to be measured in pilots.
Review the technical architecture, current scope, and pilot hypothesis together.