feat(wirings): capstone demo composing all 4 tier wirings in one pipeline (closes the #6→#9 stack)#10
Closed
estebanzimanyi wants to merge 1 commit into
Conversation
6bddf45 to
d322b8c
Compare
…peline Adds MeosAllTiersCapstoneDemo — a single Flink DataStream job that exercises all four tier-wiring classes from the PR MobilityDB#6→MobilityDB#7→MobilityDB#8→MobilityDB#9 stack in a coherent end-to-end pipeline. Pipeline (each stage uses one tier-wiring class from the stack): ① MeosStatelessFilter — drop events outside regions of interest ② MeosBoundedStateMap — per-vehicle running tbox union (byte[] state) ③ MeosWindowedAggregate — per-vehicle 30s tumbling tbox summary ④ MeosCrossStreamJoin — interval-join vehicle aggregates against region queries (±1m bound, regionId key) The pipeline answers: 'for each region, which vehicles had an aggregate trajectory (running union) overlapping the region's query bbox during the latest 30-second window?' Proves the wirings compose into a realistic pipeline shape (not just work in isolation), each tier delivering its specific contract: stateless filter is per-event, bounded-state persists handle state across events as bytes, windowed aggregates window-close-only, cross- stream interval-joins on shared key. Stacks on PR MobilityDB#9; additive-only (1 new demo file). Locally compile- verified: 146 .class files total (145 from PR MobilityDB#9 base + 1 new demo). (cherry picked from commit d322b8c)
d322b8c to
173429b
Compare
Member
Author
|
Superseded by the Path-B consolidation: the former 18-deep stack is collapsed into two reviewable topical PRs on top of the merged scaffold — MEOS integration #30 → benchmark #31 — each one clean squashed commit with the generated-facade bulk, dead family-flag profiles, committed target/ artifacts, and invented synthetic corpus removed. Closing as folded into #30/#31. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Capstone follow-up on the PR #6 → #7 → #8 → #9 tier-wirings stack. Single Flink DataStream job that composes all four tier wirings in a coherent end-to-end pipeline — proves the wirings compose into a realistic pipeline shape, not just work in isolation.
Pipeline
Each stage uses one tier-wiring class:
Answers: "for each region, which vehicles had an aggregate trajectory (running union) overlapping the region's query bbox during the latest 30-second window?"
Tier-per-stage breakdown
MeosStatelessFilterMeosBoundedStateMapbyte[]state (checkpoint-safe)MeosWindowedAggregateMeosCrossStreamJoinFile / compile
demo/MeosAllTiersCapstoneDemo.java(~215 lines)Stacking + closure
This PR closes the PR #6 → #9 wiring stack with the composite-demo capstone. The 5-PR stack collectively delivers:
MeosStatelessMap+MeosStatelessFilter(stateless tier — 804 methods)MeosBoundedStateMap(bounded-state tier — 797 methods)MeosWindowedAggregate(windowed tier — 161 methods)MeosCrossStreamJoin(cross-stream tier — 140 methods)Cumulative wirings-layer coverage = 2,097 of 2,097 emitted methods (100%) wirable through 5 generic classes; this PR proves they compose.