face-landmarking-ios

by zweigraf

👦 Basic face landmarking on iPhone with Dlib via Swift & ObjC++

448 Stars 125 Forks Last release: Not found 57 Commits 0 Releases

Available items

No Items, yet!

The developer of this repository has not created any items for sale yet. Need a bug fixed? Help with integration? A different license? Create a request here:

Face Landmarking on iPhone

This prototype shows basic face landmark recognition on a

CMSampleBuffer
(see
DlibWrapper.mm
) coming out of an
AVCaptureSession
.

Frame rate is actually quite good on an iPhone 6S now that we are using the system face detection via

AVCaptureMetadataOutput
. I did not measure performance yet but there is no discernible lag anymore. It looks like 30fps.

But I am sure there are a lot more performance improvements to be made. Currently, the buffers are copied around a lot.

Screenshot

screenshot

Credits

This app uses the Dlib library (http://dlib.net) and their default face landmarking model file downloaded from http://dlib.net/files/shape_predictor_68_face_landmarks.dat.bz2. Thanks for the great work.

This project includes a precompiled Dlib. If you want to change something, consider that the

Preprocessor Macros
in the project linking Dlib need to be the same as the
Compiler Flags
when building the lib.

The project to build Dlib on iOS was generated according to these instructions.

Thanks to Satya Mallick from learnopencv.com. He recommended using the system face detector to me.

License

Code (except for

DisplayLiveSamples/lib/*
) is released under MIT license.

We use cookies. If you continue to browse the site, you agree to the use of cookies. For more information on our use of cookies please see our Privacy Policy.