Go to file
kjuulh cce1400a34
feat: add ingest layer
Signed-off-by: kjuulh <contact@kjuulh.io>
2024-08-14 14:59:26 +02:00
crates/nodata feat: add ingest layer 2024-08-14 14:59:26 +02:00
proto/nodata/v1 feat: added v1 files 2024-08-12 00:36:17 +02:00
templates feat: add base 2024-08-10 00:09:11 +02:00
.drone.yml feat: add base 2024-08-10 00:09:11 +02:00
.env feat: add base 2024-08-10 00:09:11 +02:00
.gitignore feat: add base 2024-08-10 00:09:11 +02:00
buf.gen.yaml feat: add data ingest 2024-08-10 00:54:10 +02:00
buf.yaml feat: add data ingest 2024-08-10 00:54:10 +02:00
Cargo.lock fix: offset be inclusive end 2024-08-14 14:46:53 +02:00
Cargo.toml feat: add base 2024-08-10 00:09:11 +02:00
cuddle.yaml feat: add base 2024-08-10 00:09:11 +02:00
README.md feat: add docs 2024-08-10 00:17:12 +02:00
renovate.json feat: add base 2024-08-10 00:09:11 +02:00

nodata

Nodata is a simple binary that consists of two parts:

  1. Data ingest
  2. Data storage
  3. Data aggregation
  4. Data API / egress

Data ingest

Nodata presents a simple protobuf grpc api for ingesting either single events or batch

Data storage

Nodata stores data locally in a parquet partitioned scheme

Data aggregation

Nodata accepts wasm routines for running aggregations over data to be processed

Data Egress

Nodata exposes aggregations as apis, or events to be sent as grpc streamed apis to a service.