Module memory

Expand description

CUDA memory management

This module provides GPU memory management with budget enforcement. It wraps cudarc’s allocation functions and tracks total allocated memory.

Structs§

AllocationReclamation: Accounting owned by one allocation attempt and then by its physical storage.
ArrowDeviceColumn
CudaBuffer: Column-oriented GPU buffer
DeviceAllocationProvenance: Physical provenance of a view of an allocation owned by XLOG.
DeviceMemoryView: A checked typed device span with a strong allocation owner. Subviews and reinterpretations preserve this same owner; none expose cudarc pointer traits.
DlpackColumn
GpuMemoryManager: Budget-enforced device allocation. Every view retains actual storage. Runtime-backed managers use the canonical resource stack. Native allocations share its raw owner: post-malloc failures retain storage and budget together.
GpuMemoryReservation: One atomic claim on a GpuMemoryManager budget.
RuntimeAllocBlock: Owned handle for a raw allocation routed through the device runtime. Both raw allocations and typed storage views retain this handle. Drop hands its block identity to the runtime; the actual raw owner’s successful physical reclamation returns the local manager charge, including on another reaper.
TrackedCudaSlice: A typed view retaining its actual device allocation and memory budget.

DeviceRead: Safe XLOG device operations accept owner-bearing spans, not native pointer adapters. The returned span must retain the actual allocation.
DeviceWrite: A span accepted as a destination by safe XLOG operations. Conflicting aliases are excluded by operation admission, including aliases of a different type.