Installation
First, clone the repository of spora-bench and install its requirements. This will automatically install spora-io as well:
git clone https://github.com/bunnelab/spora-bench.git
pip install -r requirements.txt
Finally, make sure the foundation models you want to benchmark are set up in those repositories as well. For installation instructions, refer to the model-specific projects:
VirTues: https://github.com/bunnelab/virtues
spora [bench] can also be used to evaluate new foundation models. If you want that, follow the later section in the README for the model integration notes.