Longformer 8192

Longformer model with 8192 tokens sequence length. Initialized from FaceboookAI/roberta-base. No additional pre-training has been done.

Model can be loaded and run using AutoModel and AutoTokenizer.

Safetensors

Model size

152M params

Tensor type

F32

Inference Providers NEW

This model is not currently available via any of the supported Inference Providers.

Model tree for capemox/longformer-8192

Base model

Finetuned

(1661)

this model