Skip to content

Models larger than 2 GB cannot be used due to Protobuf limitation #320

@slobodaapl

Description

@slobodaapl

It seems to be impossible to run ONNX Runtime session with Vitis AI provider if the model size exceeds 2 GB. ONNX Runtime already solves this through external data but Vitis fails to handle it properly.

onnxruntime: 1.23.2.dev20251030
available providers: ['VitisAIExecutionProvider', 'DmlExecutionProvider', 'CPUExecutionProvider']
Creating VitisAI EP session for: C:\Users\Jack\aleph0\onnxnpu\export_npu.onnx
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260109 22:20:37.581284 12136 register_ssmlp.cpp:124] Registering Custom Operator: com.amd:SSMLP
I20260109 22:20:37.581284 12136 register_matmulnbits.cpp:110] Registering Custom Operator: com.amd:MatMulNBits
I20260109 22:20:37.866566 12136 vitisai_compile_model.cpp:1263] Vitis AI EP Load ONNX Model Success
I20260109 22:20:37.866566 12136 vitisai_compile_model.cpp:1264] Graph Input Node Name/Shape (2)
I20260109 22:20:37.866566 12136 vitisai_compile_model.cpp:1268]          input_ids : [16x4096]
I20260109 22:20:37.866566 12136 vitisai_compile_model.cpp:1268]          attention_mask : [16x4096]
I20260109 22:20:37.866566 12136 vitisai_compile_model.cpp:1274] Graph Output Node Name/Shape (1)
I20260109 22:20:37.866566 12136 vitisai_compile_model.cpp:1278]          embeddings : [16x1024]
I20260109 22:20:37.914145 12136 vitisai_compile_model.cpp:451] File base signature : 2532093ee1e03b184790774191ebd68b
I20260109 22:20:37.914145 12136 vitisai_compile_model.cpp:452] Algorithm-A: based on topologically ordered signature : 0098927e5a4f5112b3e3e9e85a7d88f5
I20260109 22:20:37.914145 12136 vitisai_compile_model.cpp:454] Algorithm-B: based on graph inputs/outputs signature : 2b869a8f961ec26f474267d89de07858
I20260109 22:20:37.914145 12136 vitisai_compile_model.cpp:456] Algorithm-B: node count: 1928
I20260109 22:20:37.914145 12136 vitisai_compile_model.cpp:432] Can not find signature in meptable , use in memory signature 0098927e5a4f5112b3e3e9e85a7d88f5
I20260109 22:20:37.914145 12136 vitisai_compile_model.cpp:482] use cache key specified by user model
I20260109 22:20:57.932646 12136 vaip_driver_info.cpp:192] Driver detection through setup api: 314
[libprotobuf ERROR C:\Users\z1aiebuild\protobuf\src\google\protobuf\message_lite.cc:449] serial_v2.Graph exceeded maximum protobuf size of 2GB: 6415092416
F20260109 22:21:09.277324 12136 serialize_v2.cpp:783] fail to parse pb struct to string.
W20260109 22:21:09.849975 12136 pass_main.cpp:401] Unexcepted exception: (Exception type: struct vaip_core::GlogFatalException) xir_deserialize_cif

RyzenAI v1.6 (ryzenai-lt-1.6.1.exe)

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions