Database Administration (MOSC)

MOSC Banner

gpu-index-26.1.2.0 Private AI container crashes on startup — ONNX model load failure with GPU mode

I'm running the Oracle Private AI Services Container gpu-index-26.1.0.0.0/26.1.2.0on Oracle Linux with Podman, on a host with multiple NVIDIA GPUs (driver 610.57.04, CUDA 13.1). nvidia-smi and nvidia-ctk cdi list both confirm the GPUs and driver are healthy and correctly exposed to Podman via --gpus all / CDI.

The container starts, but exits a few seconds later. The CPU-only image (private-ai:25.1.3.0.0) using the identical model/config/security directories starts and runs without issue, which rules out a bad model file or config problem.

Container log shows:

Error starting Micronaut server: Bean definition [com.oracle.pai.config.EagerLoaderHelper] could not be loadedMessage: Failed to load the onnx model file EM_ALL_MINILM_L12_V2.onnx with ONNX Runtime version 1.20.1.Caused by: com.oracle.oaa.scoring.exception.InputFormatException: Failed to load the onnx model file EM_ALL_MINILM_L12_V
Tagged:

Howdy, Stranger!

Log In

To view full details, sign in to My Oracle Support Community.

Register

Don't have a My Oracle Support Community account? Click here to get started.

Category Leaderboard

Top contributors this month

New to My Oracle Support Community? Visit our Welcome Center

MOSC Help Center