Need help with soft-decision-tree?
Click the “chat” button below for chat support from the developer who created it, or find similar developers for support.

About the developer

kimhc6028
216 Stars 42 Forks BSD 3-Clause "New" or "Revised" License 3 Commits 11 Opened issues

Description

pytorch implementation of "Distilling a Neural Network Into a Soft Decision Tree"

Services available

!
?

Need anything else?

Contributors list

# 66,426
C++
pytorch
Tensorf...
self-su...
3 commits

Soft-Decision-Tree

Soft-Decision-Tree is the pytorch implementation of Distilling a Neural Network Into a Soft Decision Tree, paper recently published on Arxiv about adopting decision tree algorithm into neural network. "If we could take the knowledge acquired by the neural net and express the same knowledge in a model that relies on hierarchical decisions instead, explaining a particular decision would be much easier."

Requirements

Result

I achieved 92.95% of test dataset accuracy on MNISTafter 40 epoches, without exploring enough of hyper-parameters (The paper achieved 94.45%). Higher accuracy might be achievable with searching hyper-parameters, or training longer epoches (if you can, please let me know :) )

Usage

$ python main.py

We use cookies. If you continue to browse the site, you agree to the use of cookies. For more information on our use of cookies please see our Privacy Policy.