Is this only for loading the nemotron tokenizer?

by ZQ-Dev - opened Jun 18

Jun 18

This repo seems to make the tokenizer load-able with HF transformers, but what about the model itself. Is this tokenizer fix all you need to load the model with AutoModelForCausalLM? If not, what are the next steps to work towards that?

Would be great to one day load nemotron-4 with TGI.

Xenova

Owner Jun 18

Hi there! Yes, this repo is only for the tokenizer; the model is being ported over here which you can follow for updates.

AyeshaIrshad124

Jun 19

how can i use the nemotron for the data generation ??

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment