max_length and max_position_embeddings

by awyshen - opened Dec 18, 2023

Dec 18, 2023

Why max_length and max_position_embeddings are inconsistent? AceGPT is based on LLama-2, why not 4096.

hh2017

FreedomAI org Jan 2, 2024

AceGPT trained with max_length=2048

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Your need to confirm your account before you can post a new comment.

· Sign up or log in to comment