Commit Graph

27 Commits

Author SHA1 Message Date
0e03a8b9ac feat: increase size of index
Signed-off-by: kjuulh <contact@kjuulh.io>
2024-11-09 17:44:20 +01:00
b9e1184a7a feat: add indexes
Signed-off-by: kjuulh <contact@kjuulh.io>
2024-11-09 17:44:05 +01:00
c726f3d1a9 feat: set notification to 4mb
Signed-off-by: kjuulh <contact@kjuulh.io>
2024-11-09 17:19:51 +01:00
4d37578c59 feat: add storage backend
Signed-off-by: kjuulh <contact@kjuulh.io>
2024-11-09 17:19:19 +01:00
ecc6d785e7 feat: remove more partitions
Signed-off-by: kjuulh <contact@kjuulh.io>
2024-11-09 16:05:26 +01:00
6dfd7d7011 feat: cleanup
Signed-off-by: kjuulh <contact@kjuulh.io>
2024-11-09 11:51:03 +01:00
a327cdb02e feat: remove keys and ids
Signed-off-by: kjuulh <contact@kjuulh.io>
2024-11-09 11:47:50 +01:00
b9be9a3ef1 feat: working dagger engine
Signed-off-by: kjuulh <contact@kjuulh.io>
2024-08-19 07:29:26 +02:00
bfe88dc008 feat: should listen on public endpoint
Signed-off-by: kjuulh <contact@kjuulh.io>
2024-08-18 01:46:46 +02:00
95acdf4f4a feat: with sdk
Signed-off-by: kjuulh <contact@kjuulh.io>
2024-08-18 01:31:58 +02:00
c51cd4dfc1 feat: with dagger engine
Signed-off-by: kjuulh <contact@kjuulh.io>
2024-08-18 01:13:27 +02:00
705da45497 feat: do cleanup
Signed-off-by: kjuulh <contact@kjuulh.io>
2024-08-17 13:59:58 +02:00
d0ea8019e1 feat: add broker setup
this is mainly to decouple the actual sending of events, from the ingest.

we now ingest the data, and update consumer groups with the new offset. Consumer groups now in the background continously send out data from the update. they tick 1 second between checks, but if something takes long than a second, the next run just continues from where we left off

Signed-off-by: kjuulh <contact@kjuulh.io>
2024-08-16 00:25:43 +02:00
f818a18d65 feat: update
Signed-off-by: kjuulh <contact@kjuulh.io>
2024-08-15 21:07:37 +02:00
3a2a65dfa7 feat: add basic streaming data
Signed-off-by: kjuulh <contact@kjuulh.io>
2024-08-15 21:07:22 +02:00
cce1400a34 feat: add ingest layer
Signed-off-by: kjuulh <contact@kjuulh.io>
2024-08-14 14:59:26 +02:00
b6afcc700c feat: extract handler
Signed-off-by: kjuulh <contact@kjuulh.io>
2024-08-14 14:47:19 +02:00
101a266ea2 fix: offset be inclusive end
Signed-off-by: kjuulh <contact@kjuulh.io>
2024-08-14 14:46:53 +02:00
242dd2ce76 feat: add offset to consumers
Signed-off-by: kjuulh <contact@kjuulh.io>
2024-08-14 14:40:58 +02:00
334dd1bde2 feat: add complexity
Signed-off-by: kjuulh <contact@kjuulh.io>
2024-08-14 11:16:52 +02:00
fcaf77b777 feat: added v1 files
Signed-off-by: kjuulh <contact@kjuulh.io>
2024-08-12 00:36:17 +02:00
8c1f7f829d feat: add operations endpoint to get topics
Signed-off-by: kjuulh <contact@kjuulh.io>
2024-08-12 00:26:17 +02:00
5cf8956cad feat: add staging
Signed-off-by: kjuulh <contact@kjuulh.io>
2024-08-12 00:09:37 +02:00
3c5c5759ca feat: add data ingest
Signed-off-by: kjuulh <contact@kjuulh.io>
2024-08-10 00:54:10 +02:00
5395e8bb1e refactor: into files
Signed-off-by: kjuulh <contact@kjuulh.io>
2024-08-10 00:25:46 +02:00
cf321d110e feat: add docs
Signed-off-by: kjuulh <contact@kjuulh.io>
2024-08-10 00:17:12 +02:00
a5196b005e feat: add base
Signed-off-by: kjuulh <contact@kjuulh.io>
2024-08-10 00:09:11 +02:00