Skip to content

feat: Flowmap data preparation and visualization - #172

Draft
ilyabo wants to merge 35 commits into
mainfrom
flowmap
Draft

feat: Flowmap data preparation and visualization#172
ilyabo wants to merge 35 commits into
mainfrom
flowmap

Conversation

@ilyabo

@ilyabo ilyabo commented Oct 31, 2025 •
edited
Loading

Copy link
Copy Markdown
Collaborator

sqlrooms-flowmap, a Python tool that uses DuckDB with spatial extensions to prepare OD data for tiled serving:

  • Hierarchical clustering: locations are grouped at each zoom level using pixel-radius clustering, creating a hierarchy where clusters merge as users zoom out
  • Nested Hilbert indexing: OD pairs are indexed using a space-filling curve that preserves locality, enabling efficient range queries for tile-based serving
  • Spatio-temporal aggregation: flows are aggregated to match zoom-based clustering, with optional temporal bucketing by hour/day/week
  • Output format: Parquet files ordered by (zoom, hilbert_index) for sequential reads and efficient tile extraction
  •  Browser visualization: SQLRooms + flowmap.gl renders clustered flows with smooth zoom transitions

@ilyabo ilyabo changed the title Flowmap feat: Flowmap data preparation and visualization Nov 30, 2025
ilyabo added 11 commits December 28, 2025 15:41
@ilyabo
Merge branch 'main' of github.com:sqlrooms/sqlrooms into flowmap
697f17c
@ilyabo
basic flow map example
23cd0f9 
Signed-off-by: Ilya Boyandin <[email protected]>
@ilyabo
basic flow map example
b193589 
Signed-off-by: Ilya Boyandin <[email protected]>
@ilyabo
flowmap example fixes
a2887e2 
Signed-off-by: Ilya Boyandin <[email protected]>
@ilyabo
removed debug output
b65b413 
Signed-off-by: Ilya Boyandin <[email protected]>
@ilyabo
initial state
c69ff93 
Signed-off-by: Ilya Boyandin <[email protected]>
@ilyabo
bundle monaco
8919d3e 
Signed-off-by: Ilya Boyandin <[email protected]>
@ilyabo
fix knip
7a86a8b 
Signed-off-by: Ilya Boyandin <[email protected]>
@ilyabo
Merge branch 'main' of github.com:sqlrooms/sqlrooms into flowmap
9202f01 
Signed-off-by: Ilya Boyandin <[email protected]>
@ilyabo
fix build
6bef0aa 
Signed-off-by: Ilya Boyandin <[email protected]>
@ilyabo
revert lockfile
3151a4c 
Signed-off-by: Ilya Boyandin <[email protected]>
ilyabo added 5 commits January 28, 2026 21:22
@ilyabo
fix deps
81c0b65 
Signed-off-by: Ilya Boyandin <[email protected]>
@ilyabo
fix deps
8d8c494 
Signed-off-by: Ilya Boyandin <[email protected]>
@ilyabo
fix deps
65a4302 
Signed-off-by: Ilya Boyandin <[email protected]>
@ilyabo
fix deps
be17211 
Signed-off-by: Ilya Boyandin <[email protected]>
@ilyabo
fix(flowmap): resolve conflicts with main
10bc55d
@coderabbitai

coderabbitai Bot commented Oct 11, 2026

Copy link
Copy Markdown
Contributor

Important

Draft PR not reviewed

Draft PRs are not automatically reviewed by default.

  • Trigger a manual review

To automatically review draft PRs, update your CodeRabbit configuration:

reviews:
  auto_review:
    drafts: true
  • Autofix · Keep fixing CodeRabbit findings and required CI, and resolving merge conflicts

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

See More

Successfully merging this pull request may close these issues.

1 participant

@ilyabo