zamal/Molmo-4bit Thrilled to announce that the Molmo 7B 4-bit Space is now live! š The model size has been reduced by six times with almost no performance loss, and the results will leave you amazed!
It runs on zero GPU, making it incredibly accessible for everyone!
# Excited to Share: New LLM Tokenization - Convert Text to tokens and vice versa! š
I've just developed a powerful tool for anyone working with Language Models (LLMs) or diving into Natural Language Processing (NLP).
š Introducing the LLM Tokenization - Convert Text to tokens and vice versa!!
Key Features: - Convert text to tokens and token IDs - Reverse engineer: convert token IDs back to text - Support for popular models: LLama3 (Will add more models iteratively) - User-friendly Gradio interface for easy interaction
Whether you're debugging your NLP pipeline, exploring how different models tokenize text, or just curious about the inner workings of LLMs, this tool is for you!