Control 3D Virtual Character through Tensroflow.js Posenet
No Data
Personal Project
Master Branch
Experimental Branch
Note:
Master Branchcontains functionalities only for head movements.
Experimental Branchcontains functionalities for arms movements as well; however, the functionalities for arms movements do not work well enough to be added to
Master Branchyet.
This web app is an experiment to combine Machine Learning and Computer Graphics through TensorFlow.js and BabylonJS. Tensorflow.js is an official Javascript API of Google's popular machine learning framework Tensorflow, and since Tensorflow.js is a Javscript library, it provides a way to run machine learning models in browser environments. On the other hand, BabylonJS is a 3D engine that lets you create and run 3D graphics in web apps.
app.js- main React app
posenet.js- class for running Tensorflow.js and Posenet
graphics.js- class for running BabylonJS and creating the 3D scene
joints.js,
transform.js- miscellaneous classes
yarn yarn watch
MIT