benchmarks

by catboost

catboost / benchmarks

Comparison tools

135 Stars 40 Forks Last release: Not found Other 54 Commits 0 Releases

Available items

No Items, yet!

The developer of this repository has not created any items for sale yet. Need a bug fixed? Help with integration? A different license? Create a request here:

Benchmarks

This repo contains different CatBoost benchmarks.

Quality: comparison with other libraries

Go to subdirectory quality benchmarks to see quality benchmarks. These are benchmarks in binary classification mode. They compare CatBoost vs XGBoost vs LightGBM vs H20.

Training speed: comparisons with other libraries

You can find scripts to run LigthGBM/XGBoost/CatBoost CPU and GPU versions and compare its runtime in training speed subdirectory

Training speed: CPU vs GPU

This benchmark shows speedup of GPU over CPU on different dataset sizes and on different devices.

Applier speed: comparison with other libraries

Benchmarks with comparison of applier speed with other libraries are in folder model evaluation speed

Ranking: compare quality of different GBDT libraries and different modes

This benchmark shows how different libraries and modes perform on existing open source ranking datasets.

SHAP values calculation speed: comparison with others

Shap values calculation benchmarks are in shap speed subdirectory. This benchmark will show the complexity of SHAP calculation for each library. And will show a speed comparison on a fixed dataset.

Kaggle

This is the folder where we are adding quality comparisons on some kaggle datasets. Corrently it only contains comparison of different libraries on Rossman store sales competition.

We use cookies. If you continue to browse the site, you agree to the use of cookies. For more information on our use of cookies please see our Privacy Policy.