On the Suitability of Hugging Face Hub for Empirical Studies
2307.14841

Authors

Adem Ait,Javier Luis Cánovas Izquierdo,Jordi Cabot

Abstract

Background. The development of empirical studies in software engineering mainly relies on the data available on code hosting platforms, being GitHub the most representative.

Nevertheless, in the last years, the emergence of Machine Learning (ML) has led to the development of platforms specifically designed for developing ML-based projects, being Hugging Face Hub (HFH) the most popular one. With over 250k repositories, and growing fast, HFH is becoming a promising ecosystem of ML artifacts and therefore a potential source of data for empirical studies.

However, so far there have been no studies evaluating the potential of HFH for such studies. Objective.

In this proposal for a registered report, we aim at performing an exploratory study of the current state of HFH in order to investigate its suitability to be used as a source platform for empirical studies. Method.

We conduct a qualitative and quantitative analysis of HFH for empirical studies. The former will be performed by comparing the features of HFH with those of other code hosting platforms, such as GitHub and GitLab.

The latter will be performed by analyzing the data available in HFH.

Resources

Ray graphicRay graphicRay graphicRay graphic

Stay in the loop

Every AI paper that matters, free in your inbox daily.

Details

  • takara.ai
  • Custom AI and machine learning from the Frontier Research Team.
  • © 2026 takara.ai Ltd
  • Content is sourced from third-party publications.
Ray graphicRay graphicRay graphic