Lab 11: KServe Inference with HAMi DRA GPU Sharing
Deploy a KServe Standard vLLM service and run two Predictor replicas on one NVIDIA GPU through native HAMi DRA claims.
3 docs tagged with "resource-sharing"
View all tagsLab 20: Ascend NPU Sharing with HAMi DRA
Install HAMi DRA 0.2.3 and the Ascend DRA driver on an Ascend 310P3 node, watch the webhook turn huawei.com/Ascend310P requests into ResourceClaims, and verify two-Pod NPU sharing, memory quota enforcement, and scheduler capacity accounting.
Lab 5: Fake-GPU Scheduling with nvml-mock
Simulate 8 A100 GPUs with HAMi scheduling features, no real GPU needed.
