feat: event log and history server (Spark History Server equivalent) - #1925

Closed

andygrove wants to merge 14 commits into

apache:mainfrom

andygrove:feat/1923-event-log-history-server

Commits on Jul 3, 2026

feat(history): add ballista-history crate with event-log schema
andygrove
committed
7cbcfea
feat(history): add async buffered event-log writer
andygrove
committed
564a999
refactor(scheduler): share REST DTOs and extract graph-to-DTO builders
andygrove
committed
20daac9
feat(scheduler): add event_log_dir config option
andygrove
committed
c542809
feat(scheduler): tee lifecycle events into the event log
andygrove
committed
da38192
feat(history): add event-log reader producing ReplayedJob
andygrove
committed
1eda517
feat(scheduler): add ballista-history-server binary and router
andygrove
committed
af575ef
fix(scheduler): harden history-server router against corrupt logs and missing jobs
andygrove
committed
dcbd2bb
test(history): verify history store serves byte-identical JSON to live scheduler
andygrove
committed
ed0065c
fix(history): guarantee terminal JobEnd is not dropped on a full channel
andygrove
committed
9b545d7
chore(history): add Apache license header to Cargo.toml
andygrove
committed
d919d1b
chore(scheduler): make ballista-history an optional dep gated by rest-api
andygrove
committed
7852a91
chore(scheduler): gate serde_json behind rest-api feature
andygrove
committed
09686e3

Commits on Aug 5, 2026

fix(scheduler): address event-log review feedback
andygrove
committed
970d72e