An error occurred while loading the local model

[Sirius2016]

ll -shl /root/.cache/huggingface/hub/models--Qwen--Qwen3.6-35B-A3B/
total 43K
512 drwxr-xr-x 6 root root 6 Apr 27 04:30 ./
8.5K drwxr-xr-x 16 root root 17 Jun 7 06:28 ../
512 drwxr-xr-x 3 root root 3 Apr 27 03:22 .no_exist/
33K drwxr-xr-x 2 root root 38 Apr 27 04:30 blobs/
512 drwxr-xr-x 2 root root 3 Apr 27 03:22 refs/
512 drwxr-xr-x 3 root root 3 Apr 27 03:22 snapshots/
(freetoken) root@myubuntu2204-ai:~/freetoken# ft serve --model /root/.cache/huggingface/hub/models--Qwen--Qwen3.6-35B-A3B/
Traceback (most recent call last):
File "/root/freetoken/.venv/bin/ft", line 10, in
sys.exit(main())
^^^^^^
File "/root/freetoken/.venv/lib/python3.12/site-packages/freetoken/cli.py", line 126, in main
return runner(args[1:])
^^^^^^^^^^^^^^^^
File "/root/freetoken/.venv/lib/python3.12/site-packages/freetoken/cli.py", line 30, in _run_serve
launch_server(argv=argv, prog="ft serve")
File "/root/freetoken/.venv/lib/python3.12/site-packages/freetoken/server/launch.py", line 123, in launch_server
server_args, run_shell = parse_args(
^^^^^^^^^^^
File "/root/freetoken/.venv/lib/python3.12/site-packages/freetoken/server/args.py", line 667, in parse_args
cfg = cached_load_hf_config(kwargs["model_path"]).to_dict()
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/root/freetoken/.venv/lib/python3.12/site-packages/freetoken/utils/hf.py", line 201, in cached_load_hf_config
config = _load_hf_config(model_path)
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/root/freetoken/.venv/lib/python3.12/site-packages/freetoken/utils/hf.py", line 182, in _load_hf_config
return AutoConfig.from_pretrained(model_path, trust_remote_code=True)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/root/freetoken/.venv/lib/python3.12/site-packages/transformers/models/auto/configuration_auto.py", line 433, in from_pretrained
raise ValueError(
ValueError: Unrecognized model in /root/.cache/huggingface/hub/models--Qwen--Qwen3.6-35B-A3B/. Should have a model_type key in its config.json.

[Sirius2016]

I also got an error when trying the command from the quick start documentation: ft serve --model ~/models/Qwen3.6-35B-A3B"

ft serve --model ~/models/Qwen3.6-35B-A3B
Traceback (most recent call last):
File "/root/freetoken/.venv/bin/ft", line 10, in
sys.exit(main())
^^^^^^
File "/root/freetoken/.venv/lib/python3.12/site-packages/freetoken/cli.py", line 126, in main
return runner(args[1:])
^^^^^^^^^^^^^^^^
File "/root/freetoken/.venv/lib/python3.12/site-packages/freetoken/cli.py", line 30, in _run_serve
launch_server(argv=argv, prog="ft serve")
File "/root/freetoken/.venv/lib/python3.12/site-packages/freetoken/server/launch.py", line 123, in launch_server
server_args, run_shell = parse_args(
^^^^^^^^^^^
File "/root/freetoken/.venv/lib/python3.12/site-packages/freetoken/server/args.py", line 667, in parse_args
cfg = cached_load_hf_config(kwargs["model_path"]).to_dict()
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/root/freetoken/.venv/lib/python3.12/site-packages/freetoken/utils/hf.py", line 201, in cached_load_hf_config
config = _load_hf_config(model_path)
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/root/freetoken/.venv/lib/python3.12/site-packages/freetoken/utils/hf.py", line 182, in _load_hf_config
return AutoConfig.from_pretrained(model_path, trust_remote_code=True)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/root/freetoken/.venv/lib/python3.12/site-packages/transformers/models/auto/configuration_auto.py", line 433, in from_pretrained
raise ValueError(
ValueError: Unrecognized model in /root/models/Qwen3.6-35B-A3B. Should have a model_type key in its config.json.

[Sirius2016]

ft --version
freetoken version 0.1.2

[Sirius2016]

(freetoken) root@myubuntu2204-ai:~/freetoken# uv pip list|egrep "transformers|safetensors|torch|nvidia-cuda|cuda-"
cuda-bindings 13.3.1
cuda-core 1.0.1
cuda-pathfinder 1.7.0
cuda-python 13.3.1
cuda-tile 1.5.0
cuda-toolkit 13.0.2
nvidia-cuda-cupti 13.0.85
nvidia-cuda-nvdisasm 13.3.73
nvidia-cuda-nvrtc 13.0.88
nvidia-cuda-runtime 13.0.96
safetensors 0.8.0
torch 2.11.0
transformers 5.15.1