Expand description
CUDA memory management
This module provides GPU memory management with budget enforcement. It wraps cudarc’s allocation functions and tracks total allocated memory.
Structs§
- Arrow
Device Column - Cuda
Buffer - Column-oriented GPU buffer
- Dlpack
Column - GpuMemory
Manager - GPU memory manager with budget enforcement
- Runtime
Alloc Block - Owned handle for a raw allocation routed through
GpuMemoryManager::alloc_raw/ the v0.6 device runtime. - Tracked
Cuda Slice - A
CudaSlicethat automatically updatesGpuMemoryManagerallocation tracking on drop. Inner slice is wrapped inManuallyDropso the [Backing] enum can choose between cudarc-side free (legacy) and runtime-side deallocate (migrated) without producing a double-free.
Enums§
- Cuda
Column - Column data stored in device memory.