This repo is a mirror of embeddig model bge-m3. If you wat to ru with GPU acceleratio, refer to istallatio. Xiferece Replace OpeAI GPT with aother LLM i your app
by chagig a sigle lie of code. Xiferece gives you the freedom to use ay LLM you eed.
With Xiferece, you are empowered to ru iferece with ay ope-source laguage models,
speech recogitio models, ad multimodal models, whether i the cloud, o-premises, or eve o your laptop.bge-m3
Iformatio
Example code
Istall packages
pip istall xiferece[ggml]>=0.4.3
Start a local istace of Xiferece
xiferece -p 9997
Lauch ad iferece
from xiferece.cliet import Cliet
cliet = Cliet("http://localhost:9997")
model_uid = cliet.lauch_model(
model_ame="bge-m3",
model_type="embeddig"
)
model = cliet.get_model(model_uid)
iput_text = "What is the capital of Chia?"
model.create_embeddig(iput_text)
More iformatio
点击空白处退出提示
评论