Matlab and Python toolbox for fast Total Variation proximity operators
|Linux|Mac OS X|Windows| |-----|--------|-------| ||(!)|Not supported (yet)|
proxTV is a toolbox implementing blazing fast implementations of Total Variation proximity operators, which form the basic building blocks for applications such as image denoising, image deconvolution, image inpainting, video denoising, or fused lasso models, to name a few. While the core algorithms are implemented in C to achieve top efficiency, Matlab and Python interfaces are provided for ease of use.
Some examples of applications using proxTV:
and others, such as Fused Lasso signal filtering, Fused Lasso classification and regression, lp-norm signal filtering, weighted image denosing, video denosing, tensor denoising, ...
More technically, the library provides efficient solvers for the following Total Variation proximity problems:
| Problem | Formulation | | ------- | ----------- | | Standard (l1) Total Variation on a 1-dimensional signal | | | Quadratic (l2) Total Variation on a 1-dimensional signal | | | lp-norm Total Variation on a 1-dimensional signal | | | Weighted Total Variation on a 1-dimensional signal | | | Anisotropic Total Variation on a 2-dimensional signal (image denoising) | | | lp-norm Anisotropic Total Variation on a 2-dimensional signal | | | Weighted Anisotropic Total Variation on a 2-dimensional signal | | | Anisotropic Total Variation on a 3-dimensional signal (video denoising) | | | Generalized N-dimensional Anisotropic Total Variation (tensor denoising) | , with X(di) every possible 1-dimensional slice of X following dimension di.|
pip install prox-tv
If the above doesn't work or you are using an unsupported operative system or Python version, you can install proxTV from souce.
The following system prerequisites are necessary
apt install build-essential
apt install libblas-dev
apt install liblapack-dev
Then you can clone this repository and install the library with
python setup.py install
Additionally, if you would like to run the provided demos you will also require the following packages:
Import proxTV Python package as
import prox_tv as ptv
or
from prox_tv import *
for direct access to all the package routines.
The documentation of use of the package functions is maintained online at http://pythonhosted.org/prox_tv/.
To install proxTV clone this repository and run
installat the Matlab prompt once located at proxTV folder. If any problem arises please refer to the "Installation" subsection.
After that the TV solver can be invoked easily through the general purpose "TV" function. For instance,
TV(X,lambda)
solves TV for X signal and lambda regularizer. The dimensionality of X is automatically checked and an adequate solver is applied.
To solve TV for a general TV-Lp norm just add the value of p as a third argument,
TV(X,lambda,p)
Weighted versions of TV can also be solved by using exactly the same interface, but providing a vector of lambda weights instead of a scalar. For multidimensional signals the relevant weights are provided as a cell array; the "Usage" section for more details on this and more advanced uses of toolbox.
To install proxTV follow the steps:
Note: this interface has only been tested under Linux. Installation might require LAPACK (http://www.netlib.org/lapack/) and BLAS (http://www.netlib.org/blas/) libraries.
Two main functions conform the Matlab interface of proxTV: TV and TVgen. The first one provides basic options over the Total Variation problem, while the second one allows a more advanced configuration. In general, the TV function should suffice for most uses.
Solves Total Variation proximity operators for n-dimensional signals, applying a TV-Lp norm. The inputs and outputs of this function are:
[x,info] = TV(y,lambda,p,threads)
Inputs * y: input of the proximity operator. * lambda: premultiplier of the norm. * (Optional) p: norm. Default is p = 1. * (Optional) threads: number of threads (default 1). Used only for 2-D or higher-dimensional signals.
Outputs * x: solution of the proximity problem. * info: statistical info of the run algorithm: * info.iters: number of iterations run (major iterations for the 2D case) * info.stop: value of the stopping criterion.
For 1-dimensional signals the problem solved is
Using p=1 results in the standard Total Variation regularizer, which generates a "blocky" reconstruction of the signal. Using p=2 instead produces a smoother reconstruction.
For 2-dimensional signals (e.g. images) the problem solved is
where X(i,:) is i-th row of X and X(:,j) is the j-th column of X. Using p=1 results in an anisotropic denoising filter.
For D-dimensional signals the problem being solved becomes
where X[d,i] is the i-th 1-dimensional fiber of X along its d-th dimension, and TV1D denotes the standard 1-dimensional Total Variation penalty applied over such fiber.
If a vector of weights w is provided for the lambda parameter instead of an scalar value, the special weighted version of TV is solved,
were each difference among signal entries xi and x(i-1) is penalized using a different weight w_i.
In the case of 2D signals the weighted problem is
Weight matrices are provided in the TV function as the lambda parameter through a cell array in the form {w, v} (see the examples in the "Examples" section)
Solves a generalized TV proximity operator for a multidimensional signal, in the form
, with X(di) every possible 1-dimensional slice of X following dimension di.
The inputs and outputs of this function are:
[x,info] = TVgen(y,lambdas,ds,norms,threads)
Inputs: * y: input signal. * lambdas: vector of lambda penalties of each penalty term. * ds: vector of dimensions of application of each penalty term. * norms: vector of norms of each penalty term. * (Optional) threads: number of threads to use (default: 1)
Outputs: * x: solution of the proximity problem. * info: statistical info of the run algorithm: * info.iters: number of major iterations run. * info.stop: value of the stopping criterion.
When possible, TV should be preferred. See the Examples section next for some specific examples on using this function.
Filter 1D signal using TV-L1 norm:
TV(x,lambda)
Filter 1D signal using weighted TV-L1 norm (for x vector of length N, weights vector of length N-1)
TV(x,weights)
Filter 1D signal using TV-L2 norm:
TV(x,lambda,2)
Filter 1D signal using both TV-L1 and TV-L2 norms:
TVgen(X,[lambda1 lambda2],[1 1],[1 2])
Filter 2D signal using TV-L1 norm (image denoising):
TV(X,lambda)
or
TVgen(X,[lambda lambda],[1 2],[1 1])
Filter 2D signal using TV-L2 norm:
TV(X,lambda,2)
or
TVgen(X,[lambda lambda],[1 2],[2 2])
Filter 2D signal using 4 parallel threads (last argument):
TV(X,lambda,1,4)
or
TVgen(X,[lambda lambda],[1 2],[1 1],4)
Filter 2D signal using TV-L1 norm for the rows, TV-L2 for the columns, and different penalties:
TVgen(X,[lambdaRows lambdaCols],[1 2],[1 2])
Filter 2D signal using both TV-L1 and TV-L2 norms:
TVgen(X,[lambda1 lambda1 lambda2 lambda2],[1 2 1 2],[1 1 2 2])
Filter 2D signal using weighted TV-L1 norm (for X image of size MxN, W1 weights of size (M-1)xN, W2 weights of size Mx(N-1))
TV(X, {W1, W2})
Filter 3D signal using TV-L1 norm (video denoising):
TV(X,lambda)
or
TVgen(X,[lambda lambda lambda],[1 2 3],[1 1 1])
Filter 3D signal using TV-L2 norm, not penalizing over the second dimension:
TVgen(X,[lambda lambda],[1 3],[2 2])
Some demos in the form of both Matlab and Python scripts showing how to work with proxTV are included in the subfolders /matlab/demos and /prox_tv/demos, respectively. They are:
Under Mac OS X some numerical accuracy issues have been observed for TV-L2 solvers. This is due to low-level Mac numerical libraries, and may produce failures in some of proxTV tests. Other solvers should work OK.
If you find this toolbox useful please reference the following papers:
Fast Newton-type Methods for Total Variation Regularization. Álvaro Barbero, Suvrit Sra. ICML 2011 proceedings.
Modular Proximal Optimization for Multidimensional Total-Variation Regularization. Álvaro Barbero, Suvrit Sra. http://www.jmlr.org/papers/v19/13-538.html
whose Bibtex entries are
@inproceedings{conf/icml/Barbero11, added-at = {2011-12-16T00:00:00.000+0100}, author = {Barbero, \'Alvaro and Sra, Suvrit}, biburl = {http://www.bibsonomy.org/bibtex/214ce9f5c15d1d462bd264d8af9e4c3c7/dblp}, booktitle = {ICML}, crossref = {conf/icml/2011}, editor = {Getoor, Lise and Scheffer, Tobias}, interhash = {5d6359b6c7f4d0fb6de36aada6827a3e}, intrahash = {14ce9f5c15d1d462bd264d8af9e4c3c7}, keywords = {dblp}, pages = {313-320}, publisher = {Omnipress}, timestamp = {2011-12-16T00:00:00.000+0100}, title = {Fast Newton-type Methods for Total Variation Regularization.}, url = {http://dblp.uni-trier.de/db/conf/icml/icml2011.html#JimenezS11}, year = 2011 }@article{JMLR:v19:13-538, author = {Alvaro Barbero and Suvrit Sra}, title = {Modular Proximal Optimization for Multidimensional Total-Variation Regularization}, journal = {Journal of Machine Learning Research}, year = {2018}, volume = {19}, number = {56}, pages = {1-82}, url = {http://jmlr.org/papers/v19/13-538.html} }
We wish to thank the following people for helping us in debugging and extending the toolbox: