Skip to content

CUDA graph phase N - graph updates #1330

Closed
5 of 5 issues completed
Closed

Description

@leofang

This task should cover updating both whole graphs and individual graph nodes.

Activity

  1. added this to the cuda.core backlog milestone on Dec 6, 2025
  2. added
    triageNeeds the team's attention
    featureNew feature or request
    cuda.coreEverything related to the cuda.core module
    on Dec 6, 2025
  3. Andy-Jost commented on Mar 31, 2026

    @Andy-Jost
    Contributor

    Implementation plan for graph updates

    Breaking this into five PRs:

    1. Whole-graph update tests — Add tests for the existing Graph.update() API (cuGraphExecUpdate), which replaces an entire executable graph from a new graph definition. Refactoring: test file reorganization and breaking down of _graphdef.pyx into a submodule.

    2. Edge mutation on GraphDef — Support adding and removing edges between nodes in a graph definition, wrapping cuGraphAddDependencies / cuGraphRemoveDependencies.

    3. GraphBuilder interop with GraphDef — Add a method GraphBuilder.graph_def to get the explicit representation of a graph built by stream capture. This involves changing GraphBuilder to use an RAII graph handle internally so that ownership can be shared.

    4. Node property setters (definition-level) — Add property setters to all GraphNode subclasses (KernelNode, MemsetNode, MemcpyNode, etc.) that call the corresponding cuGraph*NodeSetParams APIs to modify nodes in a graph definition.

    5. Exec-level node updates — Enable modifying nodes in an instantiated graph using graph[node].property = new_value, so users can update kernel parameters, memset values, etc. without rebuilding the graph.

  4. 12 remaining items

  5. added
    P0High priority - Must do!
    and removed
    P1Medium priority - Should do
    on Jul 13, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

P0High priority - Must do!cuda.coreEverything related to the cuda.core modulefeatureNew feature or request

Type

No type

Projects

No projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions