This model is copied from https://huggingface.co/yuhuili/EAGLE-LLaMA3-Instruct-70B with the following modifications to make it compatible with SGLang:
- Modify the architecture in config.json to LlamaForCausalLMEagle
This model is copied from https://huggingface.co/yuhuili/EAGLE-LLaMA3-Instruct-70B with the following modifications to make it compatible with SGLang: