[Bug]: RKNN: 0.16.3: [E:onnxruntime:, inference_session.cc:2544 operator()] Exception during initialization #20751
Replies: 4 comments 8 replies
-
|
The error you're encountering is related to the semantic search embeddings initialization, not the RKNN detector itself(1). The ONNX runtime error occurs when Frigate attempts to load the vision embedding models for semantic search functionality. From your logs, the embeddings process is failing during initialization with an ONNX runtime exception. The error indicates that the vision model and vision model feature extractor are marked as "nok" (not okay), while the text model and tokenizer loaded successfully. To resolve this issue, you have a few options: Option 1: Disable semantic search temporarily Since your RKNN detectors (rknn_0, rknn_1, rknn_2) are starting successfully and the core detection functionality appears to be working, you can disable semantic search in your config: semantic_search:
enabled: falseOption 2: Try a different model size You're currently using the "jinav1" model with "small" size. You could try switching to a different configuration: semantic_search:
enabled: true
reindex: false
model_size: smallRemove the Option 3: Clear the model cache The ONNX model files may be corrupted. You can try clearing the model cache directory (typically Your RKNN detector configuration looks correct with three detectors configured(1)(2), and based on your system metrics screenshots, the detectors appear to be functioning properly. The issue is isolated to the embeddings/semantic search component, not your primary object detection pipeline. 📚 Sources: Have another question? Just tag @inkeep. |
Beta Was this translation helpful? Give feedback.
-
|
Sorry, Option 1-3 is not a real solution. |
Beta Was this translation helpful? Give feedback.
-
|
Hint
info | 2025-11-01 20:15:27 | frigate.camera.maintainer | Camera processor started for PTZ-3: 986 |
Beta Was this translation helpful? Give feedback.
-
|
Now i try Docker image: "ghcr.io/blakeblackshear/frigate:stable-rk" onnxruntime crashed...: Attempting to get index by a name which does not exis What is the difference from 0.16.1 (ok) -> 0.16.2 (nok) -> 0.16.3 (nok) -> 0.17.dev (ok) ??? 2025-11-04 18:09:28.356082248 W rknn-toolkit-lite2 version: 2.3.2 ` |
Beta Was this translation helpful? Give feedback.
-
|
0.17 has had this completely rewritten |
Beta Was this translation helpful? Give feedback.
-
|
Update from 0.16.1 to 0.16.2 AND 0.16.3 give me this error.
So should i use the 0.17 dev versions?
|
Beta Was this translation helpful? Give feedback.
-
|
As @NickM-27 mentioned, this has been rewritten for 0.17. We don't intend to back port the changes to 0.16, so yes, running a dev version of 0.17 is your best option. |
Beta Was this translation helpful? Give feedback.
-
|
what is the tag of the docker image for the dev 0.17? |
Beta Was this translation helpful? Give feedback.
-
|
For my Radxa Rock5b the last working 16er docker image was ghcr.io/blakeblackshear/frigate:0.16.1-rk. So i test the *-rk docker from here: https://github.com/blakeblackshear/frigate/pkgs/container/frigate |
Beta Was this translation helpful? Give feedback.
-
|
sorry, I made a mistake of my previous message. I am looking for 0.17. which has solved the error. So, I believe the image will be: |
Beta Was this translation helpful? Give feedback.
-
|
the current image is ghcr.io/blakeblackshear/frigate:0.17.0-beta1 |
Beta Was this translation helpful? Give feedback.
-
|
thanks |
Beta Was this translation helpful? Give feedback.
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
Checklist
Describe the problem you are having
Update from 0.16.1 to 0.16.2 AND 0.16.3 give me this error:
RAXDA Rock 5b 16GB RAM
v25.8.2 for Rock 5B running Armbian Linux 6.1.115-vendor-rk35xx
uname -r
6.1.115-vendor-rk35xx
ls /dev/dri
by-path card0 card1 renderD128 renderD129
cat /sys/kernel/debug/rknpu/version
RKNPU driver: v0.9.8
Error-Message
2025-11-01 17:41:17.178364994 [E:onnxruntime:, inference_session.cc:2544 operator()] Exception during initialization: /onnxruntime_src/onnxruntime/core/graph/graph_utils.cc:29 int onnxruntime::graph_utils::GetIndexFromName(const onnxruntime::Node&, const std::string&, bool) itr != node_args.end() was false. Attempting to get index by a name which does not exist:InsertedPrecisionFreeCast_/transformer/encoder/layers.11/norm1/Constant_output_0for node: /transformer/emb_ln/Mul/SimplifiedLayerNormFusion/
Explore is Unavailable
Frigate is downloading the necessary embeddings models to support the Semantic Search feature. This may take several minutes depending on the speed of your network connection.
Vision model nok
Vision model feature extractor nok
Text model ok
Text tokenizer ok
Steps to reproduce
image: ghcr.io/blakeblackshear/frigate:0.16.1-rk)
image: ghcr.io/blakeblackshear/frigate:0.16.2-rk
image: ghcr.io/blakeblackshear/frigate:0.16.3-rk
Version
System 0.16.2-4d58206
In which browser(s) are you experiencing the issue with?
No response
Frigate config file
docker-compose file or Docker CLI command
Relevant Frigate log output
Relevant go2rtc log output
Operating system
Other
Install method
Docker Compose
Network connection
Wired
Camera make and model
54X 8MP 4K Sony415
Screenshots of the Frigate UI's System metrics pages
Any other information that may be helpful
Explore is Unavailable
Frigate is downloading the necessary embeddings models to support the Semantic Search feature. This may take several minutes depending on the speed of your network connection.
Vision model nok
Vision model feature extractor nok
Text model ok
Text tokenizer ok
You may want to reindex the embeddings of your tracked objects once the models are downloaded.
Read the documentation
Beta Was this translation helpful? Give feedback.
All reactions