Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ImportError: whisper_trt not installed (minimum BSP version JetPack 6 / L4T R36 #588

Open
menkeyi001 opened this issue Aug 14, 2024 · 0 comments

Comments

@menkeyi001
Copy link

Starting Docker error output, what version of image should I have for jetpack5
docker run --runtime nvidia -it --rm --network host --volume /tmp/argus_socket:/tmp/argus_socket --volume /etc/enctune.conf:/etc/enctune.conf -e http_proxy=10.192.1.26:7890 -e https_proxy=10.192.1.26:7890 -v /data/models:/models --volume /etc/nv_tegra_release:/etc/nv_tegra_release --volume /tmp/nv_jetson_model:/tmp/nv_jetson_model --volume /var/run/dbus:/var/run/dbus --volume /var/run/avahi-daemon/socket:/var/run/avahi-daemon/socket --volume /var/run/docker.sock:/var/run/docker.sock --volume /data/jetson-containers/data:/data --device /dev/snd --device /dev/bus/usb --device /dev/video0 --device /dev/video1 --device /dev/video2 --device /dev/video3 --device /dev/video4 --device /dev/video5 --device /dev/i2c-0 --device /dev/i2c-1 --device /dev/i2c-2 --device /dev/i2c-3 --device /dev/i2c-4 --device /dev/i2c-5 --device /dev/i2c-6 --device /dev/i2c-7 --device /dev/i2c-8 --device /dev/i2c-9 -v /run/jtop.sock:/run/jtop.sock --env HUGGINGFACE_TOKEN=hf_xyz123abc456 registry.cn-hangzhou.aliyuncs.com/menky/nano_llm:24.7-r35.4.1 python3 -m nano_llm.agents.web_chat --api=mlc --model /models/Llama3-8B-Chinese-Chat --asr=riva --tts=piper --chat-template=llama-3

E0814 07:26:41.427059952 1 http_proxy_mapper.cc:130] cannot parse value of 'http_proxy' env var. Error: INVALID_ARGUMENT: Could not parse 'scheme' from uri '10.192.1.26:7890'. Scheme must begin with an alpha character [A-Za-z].
Traceback (most recent call last):
File "/usr/lib/python3.8/runpy.py", line 194, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/usr/lib/python3.8/runpy.py", line 87, in _run_code
exec(code, run_globals)
File "/opt/NanoLLM/nano_llm/agents/web_chat.py", line 327, in
agent = WebChat(**vars(args))
File "/opt/NanoLLM/nano_llm/agents/web_chat.py", line 32, in init
super().init(**kwargs)
File "/opt/NanoLLM/nano_llm/agents/voice_chat.py", line 42, in init
self.vad = VADFilter(**kwargs).add(self.asr) if self.asr else None
File "/opt/NanoLLM/nano_llm/plugins/speech/vad_filter.py", line 49, in init
raise ImportError("whisper_trt not installed (minimum BSP version JetPack 6 / L4T R36)")
ImportError: whisper_trt not installed (minimum BSP version JetPack 6 / L4T R36)

NX Information:
jetson@ubuntu:~$ jetson_release
Software part of jetson-stats 4.2.1 - (c) 2023, Raffaello Bonghi
Model: NVIDIA Orin NX Developer Kit - Jetpack 5.1.1 [L4T 35.3.1]
NV Power Mode[0]: MAXN
Serial Number: [XXX Show with: jetson_release -s XXX]
Hardware:

  • P-Number: p3767-0000
  • Module: NVIDIA Jetson Orin NX (16GB ram)
    Platform:
  • Distribution: Ubuntu 20.04 focal
  • Release: 5.10.104-tegra
    jtop:
  • Version: 4.2.1
  • Service: Active
    Libraries:
  • CUDA: 11.4.315
  • cuDNN: 8.6.0.166
  • TensorRT: 8.5.2.2
  • VPI: 2.2.7
  • Vulkan: 1.3.204
  • OpenCV: 4.5.4 - with CUDA: NO
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant