Portable, scalable and reliable distributed machine learning.
Wormhole is a place where DMLC projects works together to provide scalable and reliable machine learning toolkits that can run on various platforms
Since wormhole has been Deprecated, we retain some useful tools and keep updating
- Portable:
- Supported platforms: local machine, Apache YARN, MPI and Sungrid Engine
- Rich support of Data Source
- All projects can read data from HDFS, S3 or local filesystem
- Scalable and Reliable
-
Requires a C++11 compiler (e.g.~
g++ >=4.8
) andgit
. Install them on Ubuntu >= 13.10 -
cd dmlc-core; make
to make dmlc core
cd rabit; make
to make rabit
cd src/lbfgs-linear; make
orcd src/lbfgs-fm; make