[Error] Windows Model Download ERROR - Model (llava-v1.6-vicuna-7b:q4_0) is not applicable.

[laggingreflex]

It works fine when choosing the "By Type" option.

But always fails at By Content option, which is probably what I needed the most, by date/type can always be grouped by the file explorer itself...

...
Output path successfully set to: mydir-organized
--------------------------------------------------
Time taken to load file paths: 0.00 seconds
--------------------------------------------------
Directory tree before organizing:
mydir
├── ...
└── ...
**************************************************
Please choose the mode to organize your files:
1. By Content
2. By Date
3. By Type
Enter 1, 2, or 3 (or type '/exit' to exit): 1
Checking if the model is already downloaded. If not, downloading it now.
model-q4_0.gguf:   0%|                                        | 0.00/3.56G [00:00<?, ?B/s]

It stays stuck there for quite a while then fails with:

ERROR - Model (llava-v1.6-vicuna-7b:q4_0) is not applicable. Please refer to our docs for proper usage.

---

Specs:

conda info

     active environment : base
    active env location : C:\ProgramData\anaconda3
            shell level : 1
       user config file : C:\Users\…\.condarc
 populated config files : C:\ProgramData\anaconda3\.condarc
                          C:\Users\…\.condarc
          conda version : 24.9.2
    conda-build version : 24.9.0
         python version : 3.12.7.final.0
                 solver : libmamba (default)
       virtual packages : __archspec=1=x86_64_v3
                          __conda=24.9.2=0
                          __win=0=0
       base environment : C:\ProgramData\anaconda3  (read only)
      conda av data dir : C:\ProgramData\anaconda3\etc\conda
  conda av metadata url : None
           channel URLs : https://repo.anaconda.com/pkgs/main/win-64
                          https://repo.anaconda.com/pkgs/main/noarch
                          https://repo.anaconda.com/pkgs/r/win-64
                          https://repo.anaconda.com/pkgs/r/noarch
                          https://repo.anaconda.com/pkgs/msys2/win-64
                          https://repo.anaconda.com/pkgs/msys2/noarch
          package cache : C:\ProgramData\anaconda3\pkgs
                          C:\Users\…\.conda\pkgs
                          C:\Users\…\AppData\Local\conda\conda\pkgs
       envs directories : C:\Users\…\.conda\envs
                          C:\ProgramData\anaconda3\envs
                          C:\Users\…\AppData\Local\conda\conda\envs
               platform : win-64
             user-agent : conda/24.9.2 requests/2.32.3 CPython/3.12.7 Windows/11 Windows/10.0.22635 solver/libmamba conda-libmamba-solver/24.9.0 libmambapy/1.5.8 aau/0.4.4 c/. s/. e/.
          administrator : False
           offline mode : False

python -m sysconfig

Platform: "win-amd64"
Python version: "3.12"
Current installation scheme: "nt"

Paths:
        data = "C:\ProgramData\anaconda3"
        include = "C:\ProgramData\anaconda3\Include"
        platinclude = "C:\ProgramData\anaconda3\Include"
        platlib = "C:\ProgramData\anaconda3\Lib\site-packages"
        platstdlib = "C:\ProgramData\anaconda3\Lib"
        purelib = "C:\ProgramData\anaconda3\Lib\site-packages"
        scripts = "C:\ProgramData\anaconda3\Scripts"
        stdlib = "C:\ProgramData\anaconda3\Lib"

Variables:
        BINDIR = "C:\ProgramData\anaconda3"
        BINLIBDEST = "C:\ProgramData\anaconda3\Lib"
        EXE = ".exe"
        EXT_SUFFIX = ".cp312-win_amd64.pyd"
        INCLUDEPY = "C:\ProgramData\anaconda3\Include"
        LIBDEST = "C:\ProgramData\anaconda3\Lib"
        TZPATH = "C:\ProgramData\anaconda3\share\zoneinfo"
        VERSION = "312"
        VPATH = "..\.."
        abiflags = ""
        base = "C:\ProgramData\anaconda3"
        exec_prefix = "C:\ProgramData\anaconda3"
        installed_base = "C:\ProgramData\anaconda3"
        installed_platbase = "C:\ProgramData\anaconda3"
        platbase = "C:\ProgramData\anaconda3"
        platlibdir = "DLLs"
        prefix = "C:\ProgramData\anaconda3"
        projectbase = "C:\ProgramData\anaconda3"
        py_version = "3.12.7"
        py_version_nodot = "312"
        py_version_nodot_plat = "312"
        py_version_short = "3.12"
        srcdir = "C:\ProgramData\anaconda3"
        userbase = "C:\Users\…\AppData\Roaming\Python"

systeminfo

Host Name:                 …
OS Name:                   Microsoft Windows 11 Pro
OS Version:                10.0.22635 N/A Build 22635
OS Manufacturer:           Microsoft Corporation
OS Configuration:          Standalone Workstation
OS Build Type:             Multiprocessor Free
Registered Owner:          Windows User
Registered Organization:
Product ID:                …
Original Install Date:     2024-08-09
System Boot Time:          …
System Manufacturer:       Default string
System Model:              Default string
System Type:               x64-based PC
Processor(s):              1 Processor(s) Installed.
                           [01]: AMD64 Family 25 Model 68 Stepping 1 AuthenticAMD ~3301 Mhz
BIOS Version:              …
Windows Directory:         C:\Windows
System Directory:          C:\Windows\system32
Boot Device:               \Device\HarddiskVolume1
System Locale:             en-us;English (United States)
Input Locale:              en-us;English (United States)
Time Zone:                 …
Total Physical Memory:     64,766 MB
Available Physical Memory: 10,296 MB
Virtual Memory: Max Size:  87,434 MB
Virtual Memory: Available: 9,725 MB
Virtual Memory: In Use:    77,709 MB
Page File Location(s):     C:\pagefile.sys
Domain:                    WORKGROUP
Logon Server:              \\…
Hotfix(s):                 4 Hotfix(s) Installed.
                           [01]: KB5044033
                           [02]: KB5031483
                           [03]: KB5040555
                           [04]: KB5040556
Network Card(s):           2 NIC(s) Installed.
                           [01]: …
                           [02]: …
Hyper-V Requirements:      A hypervisor has been detected. Features required for Hyper-V will not be displayed.

[shs621079]

I'm having the exact same problem. please let me know if there is a fix.

[Wanatux]

make sure that you have this set up:

C:\Users{your user}.cache\nexa\hub\official\llava-v1.6-vicuna-7b

model-q4_0.gguf
projector-q4_0.gguf

if you modified the main.py make sure you put it back to

def initialize_models():
"""Initialize the models if they haven't been initialized yet."""
global image_inference, text_inference
if image_inference is None or text_inference is None:
# Initialize the models
model_path = "llava-v1.6-vicuna-7b:q4_0"
model_path_text = "Llama3.2-3B-Instruct:q3_K_M"

lastly but not least, copy the llama_shared.dll to the lib parent directory, the lib utils.py is not able to get the dll from the llama subdirectory

C:\Users{your_user}\python_sandbox\local_file_organizer\Lib\site-packages\nexa\gguf\lib

paste in there the llava_shared.dll

now you should be able to run the code