Historical results (2017-2024, based on current and past data in this repo):
- All tools have been improving (the hardware was kept the same throughout the period, EC2 r4 for CPU and p3 for GPU)
- On CPU XGBoost/LightGBM have been the fastest
- On GPU XGBoost has been the fastest

Data and code to make the plots here: https://github.com/szilard/GBM-perf/tree/master/analysis/2024_updates/history