---
license: apache-2.0
pipeline_tag: text-ranking
---

# TEI-Compatible Version of Alibaba-NLP/gte-multilingual-reranker-base  

This repository provides a [TEI](https://github.com/huggingface/text-embeddings-inference)-compatible version of [Alibaba-NLP/gte-multilingual-reranker-base](https://huggingface.co/Alibaba-NLP/gte-multilingual-reranker-base).  

### Key Features
- No need to download additional model architecture files.  
- Fully compatible with TEI (Thanks to this [pr](https://huggingface.co/Alibaba-NLP/gte-multilingual-reranker-base/discussions/3)). 

### Running with TEI

You can deploy this model with TEI using the following command:  

```bash
text-embeddings-router --model-id aqweteddy/alibaba-gte-multilingual-reranker-base \
  --dtype float16 \
  --max-client-batch-size 128 \
  --auto-truncate
```