CodaLab Competitions: An Open Source Platform to Organize Scientific Challenges
Abstract
CodaLab Competitions is an open source web platform designed to help data scientists and research teams to crowd-source the resolution of machine learning problems through the organization of competitions, also called challenges or contests. CodaLab Competitions provides useful features such as multiple phases, results and code submissions, multi-score leaderboards, and jobs running inside Docker containers. The platform is very flexible and can handle large scale experiments, by allowing organizers to upload large datasets and provide their own CPU or GPU compute workers.
Cite
Text
Pavao et al. "CodaLab Competitions: An Open Source Platform to Organize Scientific Challenges." Machine Learning Open Source Software, 2023.Markdown
[Pavao et al. "CodaLab Competitions: An Open Source Platform to Organize Scientific Challenges." Machine Learning Open Source Software, 2023.](https://mlanthology.org/mloss/2023/pavao2023jmlr-codalab/)BibTeX
@article{pavao2023jmlr-codalab,
title = {{CodaLab Competitions: An Open Source Platform to Organize Scientific Challenges}},
author = {Pavao, Adrien and Guyon, Isabelle and Letournel, Anne-Catherine and Tran, Dinh-Tuan and Baro, Xavier and Escalante, Hugo Jair and Escalera, Sergio and Thomas, Tyler and Xu, Zhen},
journal = {Machine Learning Open Source Software},
year = {2023},
pages = {1-6},
volume = {24},
url = {https://mlanthology.org/mloss/2023/pavao2023jmlr-codalab/}
}