Article
flexcv: Python package for fitting, comparing, and logging multiple machine learning models using various cross-validation methods (en)
* Presenting author
Abstract:
The evaluation of listening experiments and studies on acoustics not only requires basic knowledge of statistics, but also poses challenges in the implementation of different methodologies. Especially for small sample sizes and peculiarities regarding hierarchical data structures, the need to individualize evaluation scripts arises. Therefore, we introduce flexcv, a powerful machine learning package for Python for evaluating various models on experimental tabular data, especially with small sample sizes. It supports random effects evaluation (including random slopes) for both linear and non-linear regressors, providing broad applicability to different experiments and research questions.flexcv quickly allows to perform nested cross-validation on a variety of models for comparison with each other. On the one hand, the implementation of a flexible interface simplifies the exchange of methods in the script, allowing researchers to change cross-validation methods without having to touch the actual cross-validation code. On the other hand, extensive online logging allows and simplifies the evaluation and experiment tracking along the process and different machines.