Skip to content

Support managed memory advise, prefetch, and discard-prefetch #1332

Closed

Description

@leofang

Blocked by #718.

Activity

  1. added this to the cuda.core beta 11 milestone on Dec 6, 2025
  2. added
    P1Medium priority - Should do
    featureNew feature or request
    cuda.coreEverything related to the cuda.core module
    blockedThis task is currently blocked by other tasks
    on Dec 6, 2025
  3. removed
    blockedThis task is currently blocked by other tasks
    on Dec 18, 2025
  4. leofang commented on Apr 7, 2026

    @leofang
    MemberAuthor

    Pushing this out after discussing with Andy

  5. cpcloud commented on Apr 23, 2026

    @cpcloud
    Contributor

    Status update: the blocker (#718 ManagedMemoryResource) was closed on 2025-12-16, so this issue itself is unblocked.

    Work is happening in PR #1775 by @rparolin, but it has been inactive since 2026-03-19 and has a CHANGES_REQUESTED review from @leofang (2026-03-25). Full triage posted on the PR: #1775

    Two design decisions need to be resolved before the PR can merge:

    1. Free functions under cuda.core.managed_memory vs. a ManagedBuffer(Buffer) subclass with property-style API (Andy-Jost's proposal).
    2. Whether single-range advise/prefetch/discard_prefetch lands together with the batched variants (Support batched memory movement #1333) or separately.

    Plus mechanical issues (rebase against main, cydriver / IF/ELSE, options dataclass, module-placement nit).

    Given v1.0.0 is due 2026-05-07 (14 days) and the design is not yet settled, this may need to slip to the post-1.0 milestone unless the design decisions close within a few days.

  6. Andy-Jost commented on Apr 27, 2026

    @Andy-Jost
    Contributor

    I can pick this issue up after the v1.0.0 release. We have agreement all around on using property-like access and richer location specifiers such as Host(numa_id=1).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

P1Medium priority - Should docuda.coreEverything related to the cuda.core modulefeatureNew feature or request

Type

No type

Projects

No projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions