Missing files
#1
by
sirwart
- opened
Is this repo missing the data files? When trying to run the example I get an error looking for https://huggingface.co/BleachNick/MMICL-Instructblip-T5-xxl/resolve/main/config.json, and looking at the files there's nothing apart from the README
Sorry, currently the release of my model and data is still in progress, and the maintenance of the repository is not yet complete.
For the config.json file, you can simply use the same file from instructnlip.
You can use the code from our repository,
and try to load the model using the following script:
from model.instructblip import InstructBlipConfig, InstructBlipModel, InstructBlipPreTrainedModel,InstructBlipForConditionalGeneration,InstructBlipProcessor
import transformers
from PIL import Image
import torch
model_ckpt="BleachNick/MMICL-Instructblip-T5-xxl"
config_ckpt = "Salesforce/instructblip-flan-t5-xxl"
config = InstructBlipConfig.from_pretrained(config_ckpt )
model = InstructBlipForConditionalGeneration.from_pretrained(
model_ckpt,
config=config).to('cuda:0')