Security Data Works

Component reference

RisingWave — streaming threat detection

Engine-anchored architecture for SOCs that cannot afford batch latency. PostgreSQL-compatible streaming database; continuous SQL computation over Kafka and CDC streams; writes natively to Iceberg without a separate buffer layer.

<100ms

Event-to-rule firing. Replaces the batch-index methodology that creates a five-minute vulnerability window before scheduled queries run. Detection fires the moment an event arrives. Production references: Palo Alto Networks (Cortex XSIAM), China Telecom Bestpay.

The pipeline

  1. Sources

    Kafka / CDC

    Auth logs, API calls, network telemetry, Postgres/MySQL CDC

  2. Engine

    RisingWave streaming compute

    Continuous SQL; incremental view maintenance

  3. Store

    Iceberg on S3

    Exactly-once writes to open table format

  4. Serve

    SOAR + dashboards

    Sub-100ms alerts to automated containment

What composes, what’s brittle

  • Production at scale. Palo Alto Networks (Cortex XSIAM), China Telecom Bestpay.
  • PostgreSQL-compatible. Standard SQL, no proprietary dialect to learn.
  • Native CDC ingestion. Postgres, MySQL, MongoDB streams as first-class inputs.
  • Why this matters. Closes the open-format streaming-ingest gap at security scale.
  • Materialized views. Ground LLMs and agentic AI on live telemetry, not stale snapshots.
  • Best fit. Sub-minute detection that must run on lakehouse-native data.

Sources: RisingWave engineering blog · Palo Alto Networks (Cortex XSIAM) and China Telecom Bestpay public references. Honorable mention: Feldera (incremental view maintenance, conceptually adjacent via DBSP).

See how the pattern lands on your workload.

The matrix scoring that justified each reference architecture's tool choices is the paid deliverable. The benchmark behind it is public — reproduce it on your own workload, then book a call to scope the work.