Need help with Deep3dPortrait?
Click the “chat” button below for chat support from the developer who created it, or find similar developers for support.

About the developer

sicxu
193 Stars 43 Forks MIT License 11 Commits 5 Opened issues

Description

Deep 3D Portrait from a Single Image

Services available

!
?

Need anything else?

Contributors list

No Data

Deep 3d Portrait from a Single Image (CVPR2020)

This is a tensorflow implementation of the following paper: Deep 3d Portrait from a Single Image. We propose a two-step geometry learning scheme which first learn 3DMM face reconstruction from single images then learn to estimate hair and ear depth in a stereo setup. <!--

-->

Getting Started

System Requirements

python step1_recon_3d_face.py
python step2_face_segmentation.py
python step3_get_head_geometry.py
python step4_save_obj.py
  1. To check the results, see ./output subfolders which contain the results of corresponding steps.

Others

  • An image pre-alignment is necessary for face reconstruction. We recommend using Bulat et al.'s method to get facial landmarks (3D definition). We also need to use the masks of face, hair and ear as input to the depth estimation network. We recommend using Lin et al.'s method for semantic segmentation.
  • The face reconstruction code is heavily borrowed from Deep3DFaceReconstruction.
  • The render code is modified from tfmeshrender. Note that the renderer we complied does not support other tensorflow versions and can only be used on Linux.
  • The manipulation code will not be released. If you want to make a comparison with our method, please use the results in our paper, or you can contact me([email protected]) for more comparisons.

Citation

If you find this code helpful for your research, please cite our paper.

We use cookies. If you continue to browse the site, you agree to the use of cookies. For more information on our use of cookies please see our Privacy Policy.