---
license: apache-2.0
---
# Cross-Encoder for MS Marco

This model is a generic masked language model fine tuned on stack overflow data.  It's base pre-trained model was the cross-encoder/ms-marco-MiniLM-L-12-v2 model.

The model can be used for creating vectors for search applications.  It was trained to be used in conjunction with a knn search with OpenSearch for a pet project I've been working on.  It's easiest to create document embeddings with the flair package as shown below.


## Usage with Transformers

```python
from flair.data import Sentence
from flair.embeddings import TransformerDocumentEmbeddings

sentence = Sentence("Text to be embedded.")
model = TransformerDocumentEmbeddings("model-name")
model.embed(sentence)
embeddings = sentence.embedding
```