Commit Graph

3 Commits

Author SHA1 Message Date
roboomp 941a931599 fix(tiny): repaired cuda sidecars for auto gpu requests
Extended ONNX Runtime CUDA sidecar repair to PI_TINY_DEVICE=auto and gpu on Linux x64, matching the CUDA-capable diagnostics path.

Added focused regression coverage for both generic accelerated settings.

Refs #4475
2026-07-03 18:34:56 +00:00
roboomp ccd68b9d84 fix(tiny): preserved cpu fallback when cuda sidecar repair fails
Deferred ONNX Runtime CUDA sidecar repair failure into the runtime metadata so loadTransformersRuntime keeps loading and loadPipelineWithDeviceFallback still gets its CUDA→CPU retry when NuGet is offline or the ort install script is unavailable. The failure surfaces through the CUDA diagnostics helper instead of hard-erroring the tiny worker.

Refs #4475
2026-07-03 18:26:13 +00:00
roboomp f257fd533f fix(tiny): repaired cuda side-runtime install
Downloaded missing ONNX Runtime CUDA provider sidecars when the compiled tiny-model side runtime is used with PI_TINY_DEVICE=cuda.

Preserved actionable CUDA worker diagnostics in tiny-models text output and added focused regression coverage.

Fixes #4475
2026-07-03 18:21:19 +00:00