Need help with parfit?
Click the “chat” button below for chat support from the developer who created it, or find similar developers for support.

About the developer

jmcarpenter2
197 Stars 26 Forks MIT License 127 Commits 7 Opened issues

Description

A package for parallelizing the fit and flexibly scoring of sklearn machine learning models, with visualization routines.

Services available

!
?

Need anything else?

Contributors list

# 55,887
Python
paralle...
pandas-...
pandas
108 commits
# 287
Python
nlp-lib...
utility...
pytorch
13 commits

parfit

A package for parallelizing the fit and flexibly scoring of sklearn machine learning models, with visualization routines.

This python package is NO LONGER MAINTAINED.

Alternatives

There are several fantastic alternatives that serve the same purpose as

parfit
, but do it even better.

Below I list a few libraries that are very effective at solving the particular problem that parfit originally aimed to solve.

Hyper-parameter optimization

Visualization of hyper-parameter optimizations

Deprecated

CURRENT VERSION == 0.220

Installation:

$pip install parfit # first time installation
$pip install -U parfit # upgrade to latest version

and then import into your code using: ``` from parfit import bestFit # Necessary if you wish to use bestFit

Necessary if you wish to run each step sequentially

from parfit.fit import * from parfit.score import * from parfit.plot import * from parfit.crossval import * ```

Once imported, you can use bestFit() or other functions freely.

Easy to use

grid = {
    'min_samples_leaf': [1, 5, 10, 15, 20, 25],
    'max_features': ['sqrt', 'log2', 0.5, 0.6, 0.7],
    'n_estimators': [60],
    'n_jobs': [-1],
    'random_state': [42]
}
paramGrid = ParameterGrid(grid)

best_model, best_score, all_models, all_scores = bestFit(RandomForestClassifier(), paramGrid, X_train, y_train, X_val, y_val, # nfolds=5 [optional, instead of validation set] metric=roc_auc_score, greater_is_better=True, scoreLabel='AUC')

print(best_model, best_score)

{max_features': 'sqrt', 'min_samples_leaf': 1, 'n_estimators': 60, 'n_jobs': -1, 'random_state': 42}
0.9627794057231478

Interpretable Visualizations

Alt text

Notes

  1. You can either use bestFit() to automate the steps of the process, and optionally plot the scores over the parameter grid, OR you can do each step in order:

fitModels()
->
scoreModels()
->
plotScores()
->
getBestModel()
->
getBestScore()

or

crossvalModels()
->
plotScores()
->
getBestModel()
->
getBestScore()
  1. Be sure to specify ALL parameters in the ParameterGrid, even the ones you are not searching over.

  2. For example usage, see parfit_ex.ipynb. Each function is well-documented in the .py file. In Jupyter Notebooks, you can see the docs by pressing Shift+Tab(x3). Also, check out the complete documentation here along with the changelog.

  3. This package is designed for use with sklearn machine learning models, but in theory will work with any model that has a .fit(X,y) function. Furthermore, the sklearn scoring metrics are typically used, but any function that reads in two vectors and returns a score will work.

  4. The plotScores() function will only work for up to a 3D parameterGrid object. That is, you can only view the scores of a grid varying over 1-3 parameters. Other parameters which do not vary can still be set, and you can still train and scores models over a higher dimensional grid.

We use cookies. If you continue to browse the site, you agree to the use of cookies. For more information on our use of cookies please see our Privacy Policy.