Struct EpistemicGpuTransferBudgetTrace 

pub struct EpistemicGpuTransferBudgetTrace {
    pub candidate_count: usize,
    pub tracked_dtoh_bytes: u64,
    pub tracked_htod_bytes: u64,
    pub tracked_dtoh_calls: u64,
    pub tracked_htod_calls: u64,
    pub tracked_aggregate_htod_bytes: u64,
    pub tracked_aggregate_htod_calls: u64,
    pub tracked_launch_metadata_htod_bytes: u64,
    pub tracked_launch_metadata_htod_calls: u64,
    pub tracked_data_plane_htod_bytes: u64,
    pub tracked_data_plane_htod_calls: u64,
    pub per_candidate_host_round_trips: u64,
}

Trace proving the epistemic GPU hot path avoided tracked data-plane host transfers.

Fields

candidate_count: usize

Number of candidate rows covered by this transfer-budget check.

tracked_dtoh_bytes: u64

Tracked device-to-host bytes observed inside the GPU hot path.

tracked_htod_bytes: u64

Tracked data-plane host-to-device bytes observed inside the GPU hot path.

tracked_dtoh_calls: u64

Tracked device-to-host calls observed inside the GPU hot path.

tracked_htod_calls: u64

Tracked data-plane host-to-device calls observed inside the GPU hot path.

tracked_aggregate_htod_bytes: u64

Tracked aggregate host-to-device bytes observed inside the GPU hot path.

tracked_aggregate_htod_calls: u64

Tracked aggregate host-to-device calls observed inside the GPU hot path.

tracked_launch_metadata_htod_bytes: u64

Tracked launch-metadata host-to-device bytes observed inside the GPU hot path.

tracked_launch_metadata_htod_calls: u64

Tracked launch-metadata host-to-device calls observed inside the GPU hot path.

tracked_data_plane_htod_bytes: u64

Tracked data-plane host-to-device bytes observed inside the GPU hot path.

tracked_data_plane_htod_calls: u64

Tracked data-plane host-to-device calls observed inside the GPU hot path.

per_candidate_host_round_trips: u64

Per-candidate host round trips observed inside the GPU hot path.

Implementations

impl EpistemicGpuTransferBudgetTrace

pub fn from_host_transfer_stats( candidate_count: usize, before: HostTransferStats, after: HostTransferStats, ) -> Result<Self>

Build a hot-path transfer trace from provider host-transfer snapshots.

pub fn from_host_transfer_stats_with_launch_metadata( candidate_count: usize, before: HostTransferStats, after: HostTransferStats, launch_metadata_before: HostLaunchMetadataTransferStats, launch_metadata_after: HostLaunchMetadataTransferStats, ) -> Result<Self>

Build a hot-path transfer trace while distinguishing bounded launch metadata host-to-device transfers from data-plane transfers.

Trait Implementations

impl Clone for EpistemicGpuTransferBudgetTrace

fn clone(&self) -> EpistemicGpuTransferBudgetTrace

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for EpistemicGpuTransferBudgetTrace

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for EpistemicGpuTransferBudgetTrace

fn eq(&self, other: &EpistemicGpuTransferBudgetTrace) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Copy for EpistemicGpuTransferBudgetTrace

impl Eq for EpistemicGpuTransferBudgetTrace

impl StructuralPartialEq for EpistemicGpuTransferBudgetTrace