Activator: GLU Activations as The Core Functions of a Vision Transformer
Paper
•
2405.15953
•
Published
•
1
Abdullah Nazhat Abdullah
Abdullah-Nazhat
AI & ML interests
Computer Vision, Natural Language Processing, Large Language Models, Foundational Vision Models, Vision Language Models, Large Multi-Modal Models
Organizations
None yet