Beyond Reality Face SDK - BRFv5 - Platform: Browser
It is a real-time face detection and face tracking SDK. It analyses image data (eg. a camera stream, video stream or a static image) and returns facial landmarks and data to place 3d objects on a face.
Read the EULA (eula.txt) carefully before using the trial SDK. You can try and test the trial SDK free of charge. Before you buy a license, please test the SDK thoroughly to see if it meets the requirements of your project. Once you decide to use BRFv5 commercially, please contact us by email. You will receive a separate license agreement, which you must agree to.
Or download this repository from GitHub and run the index.html on a local server.
If you are looking to implement an Augmented Reality Try-On, that places 3d objects on to of the face, we got you covered. Try the demo here:
It's a Vue.js based web component, can be plugged into any website and is easily configurable.
See artov5/artov5static/js/artov5api.js for what's configurable.
ARTOv5 is available for paying customers.
Also available is TPPTv5 - ThreeJS Post Processing Tool for ARTOv5.
It allows you to load 3D models into the ThreeJS editor, place them correctly on a 3D head and export those models for ARTOv5. You can also conveniently try on your model within the editor.
Run the index.html on a local server.
Open the Xcode project. Attach your actual iOS device and run the example app on your device (examples need the device camera).
Open the Android Studio project. Attach your Android device and run the example app on your device (examples need the device camera).
Have OpenCV brewed (opencv3) on your system. Open the Xcode project and just run it on your Mac.
Good luck in trying to compile OpenCV for your Windows. Update the Visual Studio (2017) project properties that mention OpenCV. Then run the Release x64 target. Fingers crossed!
Use your preferred IDE. Add the src folder and the ANE itself to your class path and run the example class on your desired device (not in a simulator).
BRFv5 comes with the following components:
All available platform-specific packages have approximately the same content and come with a number of examples to demonstrate the use of the SDK.
You can input any image size.
Internally BRFv5 uses a XYZx480 (landscape) or 480xXYZ (portrait) image for the analysis. 480px is the base size that every other input size gets scaled to, eg.
BRFv5 scales the results up again, so you don't have to do that yourself. All parameters named *size or *width are pixel values based on the actual image size. eg. telling BRF what face sizes to initially detect:
If you work with a 640x480 camera stream, it would be something like this:
Can I track other objects, eg. hands or neck or full body? + No, the library is tracking faces only.
Can you improve the performance? + BRFv5 has various configuration values that you can use to influence performance.
Can you make the library smaller? + We put a lot of effort into making the smallest possible library. The min versions of the models are the smallest that don't sacrifice too much accuracy. This might not be true for your use case. We might be able to provide even less accurate thus smaller models, but only for commercial customers.
When will the other platforms be available. + We plan to work on the other example projects until the end of 2019.
v5.1.5 - 17th March 2020
v5.1.3 - 29th January 2020
v5.1.0 - 14th November 2019
v5.0.2 - 10th November 2019
v5.0.1 - 11th September 2019
v5.0.0 - 26th August 2019
It's done! After over a year of development Tastenkunst is proud to announce the release of BRFv5.
Features: + Face Tracking + Face Detection
Changes from BRFv4: + Smaller models: The largest model is now 5MB (instead of 9MB for BRFv4). The smallest for 3D placement is 2,5MB. + Rewrote the whole API to streamline configuration. + Removed: Point Tracking. It was rarely requested and might come as a separate library if there is demand for it. + Removed ASM package: WebAssembly is now widely supported.