UniHGKR-7B-pretrained

This is a large language model based retriever for heterogeneous knowledge retrieval, trained from LLARA.

The model was trained after Stages 1 and 2. It needs to be fine-tuned before being used for an information retrieval task.

Our paper: UniHGKR: Unified Instruction-aware Heterogeneous Knowledge Retrievers.

Please see github repository UniHGKR to know how to use this model.

Citation

If you find this resource useful in your research, please consider giving a like and citation.

@article{min2024unihgkr,
  title={UniHGKR: Unified Instruction-aware Heterogeneous Knowledge Retrievers},
  author={Min, Dehai and Xu, Zhiyang and Qi, Guilin and Huang, Lifu and You, Chenyu},
  journal={arXiv preprint arXiv:2410.20163},
  year={2024}
}
Downloads last month
2
Safetensors
Model size
6.61B params
Tensor type
FP16
·
Inference Providers NEW
This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.