Commit Graph

17 Commits

Author SHA1 Message Date
c51cd4dfc1
feat: with dagger engine
Signed-off-by: kjuulh <contact@kjuulh.io>
2024-08-18 01:13:27 +02:00
705da45497
feat: do cleanup
Signed-off-by: kjuulh <contact@kjuulh.io>
2024-08-17 13:59:58 +02:00
d0ea8019e1
feat: add broker setup
this is mainly to decouple the actual sending of events, from the ingest.

we now ingest the data, and update consumer groups with the new offset. Consumer groups now in the background continously send out data from the update. they tick 1 second between checks, but if something takes long than a second, the next run just continues from where we left off

Signed-off-by: kjuulh <contact@kjuulh.io>
2024-08-16 00:25:43 +02:00
f818a18d65
feat: update
Signed-off-by: kjuulh <contact@kjuulh.io>
2024-08-15 21:07:37 +02:00
3a2a65dfa7
feat: add basic streaming data
Signed-off-by: kjuulh <contact@kjuulh.io>
2024-08-15 21:07:22 +02:00
cce1400a34
feat: add ingest layer
Signed-off-by: kjuulh <contact@kjuulh.io>
2024-08-14 14:59:26 +02:00
b6afcc700c
feat: extract handler
Signed-off-by: kjuulh <contact@kjuulh.io>
2024-08-14 14:47:19 +02:00
101a266ea2
fix: offset be inclusive end
Signed-off-by: kjuulh <contact@kjuulh.io>
2024-08-14 14:46:53 +02:00
242dd2ce76
feat: add offset to consumers
Signed-off-by: kjuulh <contact@kjuulh.io>
2024-08-14 14:40:58 +02:00
334dd1bde2
feat: add complexity
Signed-off-by: kjuulh <contact@kjuulh.io>
2024-08-14 11:16:52 +02:00
fcaf77b777
feat: added v1 files
Signed-off-by: kjuulh <contact@kjuulh.io>
2024-08-12 00:36:17 +02:00
8c1f7f829d
feat: add operations endpoint to get topics
Signed-off-by: kjuulh <contact@kjuulh.io>
2024-08-12 00:26:17 +02:00
5cf8956cad
feat: add staging
Signed-off-by: kjuulh <contact@kjuulh.io>
2024-08-12 00:09:37 +02:00
3c5c5759ca
feat: add data ingest
Signed-off-by: kjuulh <contact@kjuulh.io>
2024-08-10 00:54:10 +02:00
5395e8bb1e
refactor: into files
Signed-off-by: kjuulh <contact@kjuulh.io>
2024-08-10 00:25:46 +02:00
cf321d110e
feat: add docs
Signed-off-by: kjuulh <contact@kjuulh.io>
2024-08-10 00:17:12 +02:00
a5196b005e
feat: add base
Signed-off-by: kjuulh <contact@kjuulh.io>
2024-08-10 00:09:11 +02:00