The source code for paper "Landmark Detection and 3D Face Reconstruction for Caricature using a Nonlinear Parametric Model".
This repository includes source code, pretrained model and a 3D dataset of paper "Landmark Detection and 3D Face Reconstruction for Caricature using a Nonlinear Parametric Model", http://arxiv.org/abs/2004.09190.
Authors: Juyong Zhang, Hongrui Cai, Yudong Guo and Zhuang Peng.
Note that all of the code is protected under patent. It can be only used for research purposes. If you are interested in business purposes/for-profit use, please contact Juyong Zhang (the corresponding author, email: [email protected]).
You can download the 3D caricature dataset we constructed via Google Drive, or Baidu Drive with password: 0nk6. The 3D caricature dataset contains 7,800 2D caricatures, 2D landmarks and 3D meshes. We also attach the scipts for visualization.
If you want to do some comparison with our method, you can download a testset here Google Drive, or Baidu Drive with password: 4nvs. It includes 2D caricatures, groundtruth 68 landmarks, 68 landmarks detected by our method and 3D meshes recovered by our method.
Clone this repository:
bash git clone [email protected]:Juyong/CaricatureFace.git cd CaricatureFaceInstall dependencies using Anaconda:
bash conda create -n cariface python=3.7 source activate cariface pip install -r requirements.txt
Prepare related data: - You can download related data for alogorithm here Google Drive, or Baidu Drive with password: tjps. - Unzip downloaded files and move files into
./datadirectory.
Prepare pretrained model: - You can download pretrained model here Google Drive, or Baidu Drive with password: fukf. - Unzip downloaded files and move files into
./modeldirectory.
Prepare some examples: - You can download some examples here Google Drive, or Baidu Drive with password: sq06. - Unzip downloaded files and move files into
./expdirectory.
Within
./CaricatureFacedirectory, run following command:
bash bash test.sh
Note: Input images must be preprocessed - crop the whole face roughly and resize to size (224, 224).
Please follow README.txt in
./toy_exampledirectory.
Please follow README.txt in
./update_contourdirectory.
If you find this useful for your research, please cite the paper:
@article{Zhang2020Caricature, author = {Juyong Zhang and Hongrui Cai and Yudong Guo and Zhuang Peng}, title = {Landmark Detection and 3D Face Reconstruction for Caricature using a Nonlinear Parametric Model}, journal = {CoRR}, volume = {abs/2004.09190}, year = {2020} }