PaulLerner/triviaqa_for_viquae
Viewer • Updated • 50.7k • 546
How to use PaulLerner/multi_passage_bert_triviaqa_without_viquae_mean_pool_loss with Transformers:
# Load model directly
from transformers import AutoTokenizer, MultiPassageBERT
tokenizer = AutoTokenizer.from_pretrained("PaulLerner/multi_passage_bert_triviaqa_without_viquae_mean_pool_loss")
model = MultiPassageBERT.from_pretrained("PaulLerner/multi_passage_bert_triviaqa_without_viquae_mean_pool_loss")Model trained on TriviaQA, filtered of all questions used in ViQuAE, as described in https://paullerner.github.io/ViQuAE/index.html#reading-comprehension but after fixing the loss (mean-pooling instead of max-pooling, see https://github.com/facebookresearch/DPR/issues/244)