Example for Fine-Tuning Models on Asymmetric Semantic Search with Hard Negatives.
#98
by
wilfoderek
- opened
Hi everyone!
I am currently working on a project focused on asymmetric semantic search involving hard negative sentences, and I would like to fine-tune a model using this approach. I am seeking a practical example to better understand the process.
Could you please provide an example or reference on:
- Preparing the dataset for fine-tuning, including how to structure pairs with hard negatives for asymmetric tasks?
- Implementing the fine-tuning process using Hugging Face tools (e.g., transformers or datasets)?
A step-by-step example or notebook reference would be extremely helpful!
Thank you so much for your guidance.