AI4Animation-js

by sneha-belkhale

sneha-belkhale / AI4Animation-js

AI4Animation in javascript & three.js

209 Stars 15 Forks Last release: Not found 27 Commits 0 Releases

Available items

No Items, yet!

The developer of this repository has not created any items for sale yet. Need a bug fixed? Help with integration? A different license? Create a request here:

AI4Animation - for javascript & three.js

Description

This project is a port of the original AI4Animation project, for use with three.js on the web. It explores the possibilities of using artifical intelligence to generate realtime character animations. This is very powerful as it allows for an unlimited number of realistic transitions between animation states.

I followed the SIGGRAPH 2018. example for this demo, using the same model weights and corresponding skeleton. After providing the inputs of trajectory points and previous bone positions, the neural network ( written using numjs ) outputs the next set of bone positions and velocities.

If you want to use a different skeleton, you will need to get motion capture data for this skeleton and train a new model, the instructions and tensorflow code for this are in the AI4Animation project here.

Todo Items

  • An example with a human skeleton.
  • Trying a simpler machine learning model to help with the fps.

Discord chat

https://discord.gg/UXypcZV

Live Demo

https://codercat.tk/ai-animation/

Run the demo yourself

Run the following commands:

yarn install
yarn pull // this pulls the model weights hosted on the web
yarn start
Then open http://127.0.0.1:3000 in a web browser.

License

MIT License, Copyright © 2019 Sneha Belkhale

However, if you are using the original dataset for commercial purposes, you should read the copyright information from the original AI4Animation project.

We use cookies. If you continue to browse the site, you agree to the use of cookies. For more information on our use of cookies please see our Privacy Policy.