README.md

metadata

title: FilBench Leaderboard
emoji: 🥇
colorFrom: green
colorTo: indigo
sdk: gradio
app_file: app.py
pinned: true
license: apache-2.0
short_description: An Open LLM Leaderboard for Filipino
sdk_version: 5.19.0

HF Leaderboard Backend

This is a fork of the leaderboard demo from HuggingFace with some additional scripts for parsing the results from our evaluation runs.

Set-up and installation

To start development, clone the repository and install the dependencies. Make sure to also install the pre-commit hooks so that formatting is uniform across the codebase.

git clone git@github.com:filbench/hf-leaderboard-backend.git
cd hf-leaderboard-backend
python -m venv venv
source venv/bin/activate
pip install -r requirements.txt
pre-commit install

To view the leaderboard locally, then run the following command:

gradio app.py

This will launch the leaderboard (by default in localhost:7860) in hot-reload mode, so you can see the changes as you edit the source code.

Updating the HuggingFace Space

All development should happen in this GitHub remote. If you want to update the HuggingFace space, you should add a remote pointing to the space and push all changes.

git remote add hf https://huggingface.co/spaces/UD-Filipino/filbench-leaderboard
git push hf main