dbt Elementary на собеседовании Data Engineer

Что такое Elementary

dbt package для data observability. Open source.

packages:
  - package: elementary-data/elementary
    version: 0.14.0

Adds tests, monitoring, dashboards к dbt project.

Anomaly detection

Auto detect unusual values без manual rules.

Tracks:

• Row count over time.
• Null rate.
• Distinct values.
• Min / max / mean / stddev.

models:
  - name: orders
    tests:
      - elementary.volume_anomalies
      - elementary.freshness_anomalies

Если row count drops 80% from typical — alert.

Monitors

Regular metrics tracking.

Schema changes — detect new / dropped columns.

Freshness. When data was last updated.

Test results. Track failures over time.

Dashboard visualizes — easy to spot regressions.

Alerts

Failures → Slack / email / webhook.

models:
  - name: orders
    config:
      elementary:
        alerts:
          channel: "#data-quality"

Runs as part dbt CI / scheduled.

Связанные темы

• dbt на собесе DE
• Great Expectations для DE
• DQ dimensions для DE
• Data lineage для DE
• Подготовка к собесу Data Engineer

FAQ

Это официальная информация?

Нет. Статья основана на документации Elementary.

Тренируйте Data Engineering — откройте тренажёр с 1500+ вопросами для собесов.