No file named configuration_lfm2_moe.py
#3
by
Mohaddz
- opened
I am getting this error
OSError: LiquidAI/LFM2-8B-A1B does not appear to have a file named configuration_lfm2_moe.py. Checkout 'https://huggingface.co/LiquidAI/LFM2-8B-A1B/tree/main' for available files.
Transformers version:
pip install git+https://github.com/huggingface/transformers.git@0c9a72e4576fe4c84077f066e585129c97bfd4e6
Can you verify thattrust_remote_code is set to False?
@paulpak58
Oh thanks, now it works, I would suggest to add it to the model card (not sure if its common knowledge)
Also, congrats on the launch and well done!
@paulpak58 Unfortunately, this doesn't work with vllm serve. If trust_remote_code is not enabled, vllm complains that it needs to be enabled. If you enable it, then you get the missing configuration_lfm2_moe.py error.
ERROR: (APIServer pid=4114) Please pass the argument `trust_remote_code=True` to allow custom code to be run. [type=value_error, input_value=ArgsKwargs(()