drumbot

by magenta

magenta / drumbot

Play real-time music with a machine learning drummer that drums based on your melody.

146 Stars 11 Forks Last release: Not found Other 14 Commits 0 Releases

Available items

No Items, yet!

The developer of this repository has not created any items for sale yet. Need a bug fixed? Help with integration? A different license? Create a request here:

DrumBot

Need a drummer but don't know anybody? Try DrumBot! Play real-time music with a machine learning drummer that drums based on your melody.

How does it work?

This app uses an open-source Magenta model called Drumify, which is is able to convert a constant-velocity 'tap' pattern into a drum pattern.

DrumBot records 2 bars of your melody, removes the pitches from it (so that it's a sequence of taps), and then sends it to the model, which is running on a Node server. Even though the model could run in your browser, we run the slightly expensive machine learning code in the background, on the Node server, so that your realtime audio is never interrupted.

You can read more about how the model was trained on the Magenta blog!

How to run locally

After cloning this repo, run:

npm install
npm start

Depending on your connection, this will take a bit of time (it needs to download a model checkpoint that's about 50MB). You will also see a warning that

This browser does not support Tone.js
-- ignore that. It's a red herring :)

This will start the local Node server on port

9876
. In your browser, navigate to localhost:9876 to view the app.

We use cookies. If you continue to browse the site, you agree to the use of cookies. For more information on our use of cookies please see our Privacy Policy.