feat: non-branching paths compaction #827

Is your feature request related to a problem? Please describe.

At the moment there is no single API for graph simplification by compaction of the non-branching paths.

Describe the solution you would like

An API for simplification of graphs that do non-branching paths compaction.

1. Users should be able to specify the cycles policy
2. Users should be able to specify any amount of custom aggregations
3. Users should be able to specify the expression for "always keep" nodes/edges
4. Users should be able to specify the expression for "always compact" nodes/edges

Component

• Scala Core Internal
• Scala API
• Spark Connect Plugin
• Infrastructure
• PySpark Classic
• PySpark Connect

Additional context

Are you planning on creating a PR?

• I'm willing to make a pull-request