An open source AutoML toolkit for automate machine learning lifecycle, including feature engineering...
The developer of this repository has not created any items for sale yet. Need a bug fixed? Help with integration? A different license? Create a request here:
The tool manages automated machine learning (AutoML) experiments, dispatches and runs experiments' trial jobs generated by tuning algorithms to search the best neural architecture and/or hyper-parameters in different training environments like Local Machine, Remote Servers, OpenPAI, Kubeflow, FrameworkController on K8S (AKS etc.), DLWorkspace (aka. DLTS), AML (Azure Machine Learning) and other cloud options.
NNI provides CommandLine Tool as well as an user friendly WebUI to manage training experiments. With the extensible API, you can customize your own AutoML algorithms and training services. To make it easy for new users, NNI also provides a set of build-in state-of-the-art AutoML algorithms and out of box support for popular training platforms.
Within the following table, we summarized the current NNI capabilities, we are gradually adding new capabilities and we'd love to have your contribution.
<tr valign="top"> <td align="center" valign="middle"> <b>Built-in</b> </td> <td> <ul>
</tr> <tr valign="top"> <td valign="middle"> <b>References</b> </td> <td style="border-top:#FF0000 solid 0px;"> <ul> <li><a href="https://nni.readthedocs.io/en/latest/autotune_ref.html#trial">Python API</a></li> <li><a href="https://github.com/microsoft/nni/blob/master/docs/en_US/Tutorial/AnnotationSpec.md">NNI Annotation</a></li> <li><a href="https://nni.readthedocs.io/en/latest/installation.html">Supported OS</a></li> </ul> </td> <td style="border-top:#FF0000 solid 0px;"> <ul> <li><a href="https://github.com/microsoft/nni/blob/master/docs/en_US/Tuner/CustomizeTuner.md">CustomizeTuner</a></li> <li><a href="https://github.com/microsoft/nni/blob/master/docs/en_US/Assessor/CustomizeAssessor.md">CustomizeAssessor</a></li> <li><a href="https://github.com/microsoft/nni/blob/master/docs/en_US/Tutorial/InstallCustomizedAlgos.md">Install Customized Algorithms as Builtin Tuners/Assessors/Advisors</a></li> </ul> </td> <td style="border-top:#FF0000 solid 0px;"> <ul> <li><a href="https://github.com/microsoft/nni/blob/master/docs/en_US/TrainingService/Overview.md">Support TrainingService</a></li> <li><a href="https://github.com/microsoft/nni/blob/master/docs/en_US/TrainingService/HowToImplementTrainingService.md">Implement TrainingService</a></li> </ul> </td> </tr>
|Frameworks & Libraries||Algorithms||Training Services|
NNI supports and is tested on Ubuntu >= 16.04, macOS >= 10.14.1, and Windows 10 >= 1809. Simply run the following
pip installin an environment that has
python 64-bit >= 3.6.
Linux or macOS
python3 -m pip install --upgrade nni
python -m pip install --upgrade nni
If you want to try latest code, please install NNI from source code.
--userto install NNI in the user directory.
Segmentation fault, please refer to FAQ. For FAQ on Windows, please refer to NNI on Windows.
The following example is built on TensorFlow 1.x. Make sure TensorFlow 1.x is used when running it.
git clone -b v1.8 https://github.com/Microsoft/nni.git
Linux or macOS
nnictl create --config nni/examples/trials/mnist-tfv1/config.yml
nnictl create --config nni\examples\trials\mnist-tfv1\config_windows.yml
INFO: Successfully started experiment!in the command line. This message indicates that your experiment has been successfully started. You can explore the experiment using the
Web UI url.
INFO: Starting restful server... INFO: Successfully started Restful server! INFO: Setting local config... INFO: Successfully set local config! INFO: Starting experiment... INFO: Successfully started experiment! ----------------------------------------------------------------------- The experiment id is egchD4qy The Web UI urls are: http://22.214.171.124:8080 http://127.0.0.1:8080 -----------------------------------------------------------------------
You can use these commands to get more information about the experiment
- nnictl experiment show show the information of experiments
- nnictl trial ls list all of trial jobs
- nnictl top monitor the status of running experiments
- nnictl log stderr show stderr log content
- nnictl log stdout show stdout log content
- nnictl stop stop an experiment
- nnictl trial kill kill a trial job by id
- nnictl --help get help information about nnictl
Web UI urlin your browser, you can view detail information of the experiment and all the submitted trial jobs as shown below. Here are more Web UI pages.
This project welcomes contributions and suggestions. Most contributions require you to agree to a Contributor License Agreement (CLA) declaring that you have the right to, and actually do, grant us the rights to use your contribution. For details, visit https://cla.microsoft.com.
When you submit a pull request, a CLA-bot will automatically determine whether you need to provide a CLA and decorate the PR appropriately (e.g., label, comment). Simply follow the instructions provided by the bot. You will only need to do this once across all repos using our CLA.
After getting familiar with contribution agreements, you are ready to create your first PR =), follow the NNI developer tutorials to get start:
With authors' permission, we listed a set of NNI usage examples and relevant articles.
Join IM discussion groups: |Gitter||WeChat| |----|----|----| || OR ||
Targeting at openness and advancing state-of-art technology, Microsoft Research (MSR) had also released few other open source projects.
We encourage researchers and students leverage these projects to accelerate the AI development and research.
The entire codebase is under MIT license