bge-reranker-base

bge-reranker-base

Mirror of BAAI/bge-reranker-base.

Example code

Install packages

pip install -U xinference[embedding]

Start a local instance of Xinference

xinference -p 9997

Launch and inference

from xinference.client import Client

client = Client("http://localhost:9997")
model_uid = client.launch_model(
    model_name="bge-reranker-base",
    model_type="rerank",
    )
model = client.get_model(model_uid)

print(model.rerank(['doc1', 'doc2'], 'query'))

More information

Xinference Replace OpenAI GPT with another LLM in your app by changing a single line of code. Xinference gives you the freedom to use any LLM you need. With Xinference, you are empowered to run inference with any open-source language models, speech recognition models, and multimodal models, whether in the cloud, on-premises, or even on your laptop.

? Join our Slack community!