You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
[FEA] cuda.core: support copies with attributes (CUDA 13.2) #2365
CUDA 13.2 adds attribute-carrying variants of single copies:
cuMemcpyWithAttributesAsync(CUdeviceptr dst, CUdeviceptr src, size_t size, CUmemcpyAttributes* attr, CUstream)
— flat 1D copy taking the same CUmemcpyAttributes (access-order and location hints)
introduced with the 12.8 batched-copy machinery;
cuMemcpy3DWithAttributesAsync(CUDA_MEMCPY3D_BATCH_OP* op, unsigned long long flags, CUstream)
— executes a single 3D batch-op descriptor.
cuda.core's copy APIs (Buffer.copy_to / copy_from) accept no attributes today. #1333
tracks the batched entry points (cuMemcpyBatchAsync — its P1 discard/prefetch half is
already implemented in _memory/_managed_memory_ops.pyx);
the attribute plumbing is shared, so this issue should be implemented in coordination with #1333.
I narrow the scope of this to the access-order attributes that were introduced for issue #1333. With that scope we don't need much alignment on the design.
Adding cuda.core support cuMemcpy3DWithAttributesAsync should be a separate issue.
Activity
juenglin commentedon Aug 13, 2026
I narrow the scope of this to the access-order attributes that were introduced for issue #1333. With that scope we don't need much alignment on the design.
Adding
cuda.coresupportcuMemcpy3DWithAttributesAsyncshould be a separate issue.cuda.core: introduce copy options for Buffer.copy_{to/from} (NVIDIA#2636