improve_sentence_transformers_support

#1

Hello!

Pull Request Overview

Improve the handle the model in the Sentence Transformers library.

Setup

You should first install the current version of the library:

python -m pip install -e ".[dev]" # in your sentence-transformers folder

Then you can access to the model using the revision="refs/pr/1"

cc @tomaarsen

Arthur BRESNU

Y Research Group org
β€’
edited Jul 5

We have updated our other CSR models' config files to load them with SparseEncoder. Both "similarity test" and tests on MTEB (we have updated test results in READMEs) seem to get good results. You can review and test them now. Besides, we found that the performance of backbone NV-Embed-v2 gets much lower scores in TweetSentiment and FiQA2018 when tested with MTEB package instead of downloading the dataset and testing with our own scripts. We are searching through to see where the problems may lie in, so models and results for these two models are still not available currently. @arthurbresnu

arthurbresnu changed pull request status to closed

Sign up or log in to comment