Go to file
kjuulh 3c5c5759ca
feat: add data ingest
Signed-off-by: kjuulh <contact@kjuulh.io>
2024-08-10 00:54:10 +02:00
crates/nodata feat: add data ingest 2024-08-10 00:54:10 +02:00
proto feat: add data ingest 2024-08-10 00:54:10 +02:00
templates feat: add base 2024-08-10 00:09:11 +02:00
.drone.yml feat: add base 2024-08-10 00:09:11 +02:00
.env feat: add base 2024-08-10 00:09:11 +02:00
.gitignore feat: add base 2024-08-10 00:09:11 +02:00
buf.gen.yaml feat: add data ingest 2024-08-10 00:54:10 +02:00
buf.yaml feat: add data ingest 2024-08-10 00:54:10 +02:00
Cargo.lock feat: add data ingest 2024-08-10 00:54:10 +02:00
Cargo.toml feat: add base 2024-08-10 00:09:11 +02:00
cuddle.yaml feat: add base 2024-08-10 00:09:11 +02:00
README.md feat: add docs 2024-08-10 00:17:12 +02:00
renovate.json feat: add base 2024-08-10 00:09:11 +02:00

nodata

Nodata is a simple binary that consists of two parts:

  1. Data ingest
  2. Data storage
  3. Data aggregation
  4. Data API / egress

Data ingest

Nodata presents a simple protobuf grpc api for ingesting either single events or batch

Data storage

Nodata stores data locally in a parquet partitioned scheme

Data aggregation

Nodata accepts wasm routines for running aggregations over data to be processed

Data Egress

Nodata exposes aggregations as apis, or events to be sent as grpc streamed apis to a service.