Security Data Works

Component reference

Dremio — semantic layer + Reflections

Engine-anchored architecture for organizations with mixed BI and security analytics on shared Iceberg data. Reflections pre-materialize the hot paths; the semantic layer keeps the SQL surface clean for analyst and engineer alike.

Iceberg-native semantic-layer engine for organizations with mixed BI and security analytics on shared data. Reflections pre-materialize the hot query paths transparently, and the semantic layer keeps the SQL surface clean for analyst and engineer alike — engineers tune the accelerations, analysts just benefit.

The pipeline

  1. Sources

    Security telemetry

    Network, endpoint, cloud, identity

  2. Route

    Vector / Cribl / Kafka

    OCSF normalization on ingress

  3. Store

    Iceberg on S3

    Polaris / Nessie catalog

  4. Engine

    Dremio + Reflections

    Semantic layer; materialized accelerations

  5. Serve

    BI + SOC UIs

    Grafana · Superset · notebooks

What composes, what’s brittle

  • Iceberg-native. Queries hit the lake without copy-out.
  • Reflections. Accelerate hot queries transparently; engineers tune, analysts benefit.
  • Semantic layer. Reduces SQL complexity for SOC analysts.
  • Best fit. Mixed BI + security analytics on shared data; reusable accelerations.
  • Trade-off. The acceleration story is the Reflections layer: without it, the engine leans on raw scan speed, so Dremio earns its place for the semantic layer and reusable materializations rather than for cold-scan latency.
  • What survives. Standard SQL detections portable to Trino, StarRocks, ClickHouse-Iceberg.

Sources: Methodology: published spec, reproducible on equivalent hardware · Dremio engineering documentation

See how the pattern lands on your workload.

The matrix scoring that justified each reference architecture's tool choices is the paid deliverable. The benchmark behind it is public — reproduce it on your own workload, then book a call to scope the work.