-
Notifications
You must be signed in to change notification settings - Fork 111
Open
Description
It seems to be impossible to run ONNX Runtime session with Vitis AI provider if the model size exceeds 2 GB. ONNX Runtime already solves this through external data but Vitis fails to handle it properly.
onnxruntime: 1.23.2.dev20251030
available providers: ['VitisAIExecutionProvider', 'DmlExecutionProvider', 'CPUExecutionProvider']
Creating VitisAI EP session for: C:\Users\Jack\aleph0\onnxnpu\export_npu.onnx
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260109 22:20:37.581284 12136 register_ssmlp.cpp:124] Registering Custom Operator: com.amd:SSMLP
I20260109 22:20:37.581284 12136 register_matmulnbits.cpp:110] Registering Custom Operator: com.amd:MatMulNBits
I20260109 22:20:37.866566 12136 vitisai_compile_model.cpp:1263] Vitis AI EP Load ONNX Model Success
I20260109 22:20:37.866566 12136 vitisai_compile_model.cpp:1264] Graph Input Node Name/Shape (2)
I20260109 22:20:37.866566 12136 vitisai_compile_model.cpp:1268] input_ids : [16x4096]
I20260109 22:20:37.866566 12136 vitisai_compile_model.cpp:1268] attention_mask : [16x4096]
I20260109 22:20:37.866566 12136 vitisai_compile_model.cpp:1274] Graph Output Node Name/Shape (1)
I20260109 22:20:37.866566 12136 vitisai_compile_model.cpp:1278] embeddings : [16x1024]
I20260109 22:20:37.914145 12136 vitisai_compile_model.cpp:451] File base signature : 2532093ee1e03b184790774191ebd68b
I20260109 22:20:37.914145 12136 vitisai_compile_model.cpp:452] Algorithm-A: based on topologically ordered signature : 0098927e5a4f5112b3e3e9e85a7d88f5
I20260109 22:20:37.914145 12136 vitisai_compile_model.cpp:454] Algorithm-B: based on graph inputs/outputs signature : 2b869a8f961ec26f474267d89de07858
I20260109 22:20:37.914145 12136 vitisai_compile_model.cpp:456] Algorithm-B: node count: 1928
I20260109 22:20:37.914145 12136 vitisai_compile_model.cpp:432] Can not find signature in meptable , use in memory signature 0098927e5a4f5112b3e3e9e85a7d88f5
I20260109 22:20:37.914145 12136 vitisai_compile_model.cpp:482] use cache key specified by user model
I20260109 22:20:57.932646 12136 vaip_driver_info.cpp:192] Driver detection through setup api: 314
[libprotobuf ERROR C:\Users\z1aiebuild\protobuf\src\google\protobuf\message_lite.cc:449] serial_v2.Graph exceeded maximum protobuf size of 2GB: 6415092416
F20260109 22:21:09.277324 12136 serialize_v2.cpp:783] fail to parse pb struct to string.
W20260109 22:21:09.849975 12136 pass_main.cpp:401] Unexcepted exception: (Exception type: struct vaip_core::GlogFatalException) xir_deserialize_cif
RyzenAI v1.6 (ryzenai-lt-1.6.1.exe)
Metadata
Metadata
Assignees
Labels
No labels