Need help with posenet-sketchbook?
Click the “chat” button below for chat support from the developer who created it, or find similar developers for support.

About the developer

googlecreativelab
169 Stars 42 Forks Apache License 2.0 8 Commits 1 Opened issues

Description

PoseNet Sketchbook is a collection of open source, interactive web experiments designed to allude to the artistic possibilities of using PoseNet (running on tensorflow.js) to create a relationship between movement and machine.

Services available

!
?

Need anything else?

Contributors list

# 312,871
HTML
CSS
tensorf...
5 commits

PoseNet Sketchbook

PoseNet Sketchbook is a collection of open source, interactive web experiments designed to allude to the artistic possibilities of using PoseNet (running on tensorflow.js) to create a relationship between movement and machine.

Try out the live demos.

These prototypes exemplify a wide range of interactions that PoseNet can enable. Together, they make up a raw starter kit that is built to be used by dancers and developers alike.

This is not a library or code repository that intends to evolve. Instead, it is an archive of where Body, Movement, Language first began. You can use this collection of code as a starting point to create your own wacky or wild or just plain useful PoseNet experiments.

To read more about the journey from PoseNet Sketchbook to Body, Movement, Language in the blog post here.

Install and Run

First, clone or download this repository. For more information on how to do this, check out this article.

Next, Make sure you are in the project folder: All of the commands below should be run from your terminal on your machine.

cd posenet-sketches

Install dependencies:

yarn

To watch files for changes, and launch a dev server:

yarn watch

The server should be running at localhost:1234.

File structure

All sketches use PoseDetection.js, a wrapper class I created to handle the PoseNet data.

Each individual sketch is hosted in the 'sketches' folder. - index.html: - style.css: Styling for the sketch. - assets/: The thumbnail, gif, and any additional assets used in the sketch. - js/: The soure files. - main.js: Set up the camera, load the video, and initialize Pose Detection and the sketch. - sketch.js: This is where the ~ magic ~ happens. Some functions to note: - setup: Initializes the the canvas width and height. - initSketchGui: Sets up the GUI elements that will affect the sketch and adds them to the GUI structure. - draw: Looping at 60 fps. Renders and updates elements on canvas with each call.

The Sketches

Basic

How does PoseNet interpret your pose?

basic demo gif

Movement Multiplier

How might we allow past motion to linger?

movement multiplier gif

Text Trailer

How might movement history affect text on screen?

text trailer gif

Shape Shifter

How might movement be translated and abstracted into new forms?

shape shifter gif

Collage Creator

How might a variety of elements collage to recreate a figure on screen?

collage creator gif

Body Transcriber

How might spoken words manifest on screen in relation to the body?

body transcriber gif

Color Mapper

How might body poisition be used as a controller?

color mapper gif

Image Mapper

How might body position surface and highlight content?

image mapper gif

Audio Controller

How might body position manipulate an audio experience?

audio controller gif

Contributors

Built by Maya Man at the Google Creative Lab.

Notes

This is not an official Google product.

We encourage open sourcing projects as a way of learning from each other. Please respect our and other creators’ rights, including copyright and trademark rights when present when sharing these works and creating derivative work. If you want more info on Google's policy, you can find it here. To contribute to the project, please refer to the contributing document in this repository.

We use cookies. If you continue to browse the site, you agree to the use of cookies. For more information on our use of cookies please see our Privacy Policy.