Tinker-Controller

An open-source Game Controller App that allows you to use an Xbox/Ps4/Joycon or any controller that works with your phone to effortlessly control most micro-controllers such as Arduino/Esp8266/Raspberry Pi over WiFi, bluetooth, or USB. I have also made a Car controllered by this app.

Tinker Controller

DOWNLOAD LATEST DEMO

|Slick and fast UI| Dozens of Themes| Quick Reactions using UDP protocol| |:--:|:---:|:------:| | | | |

Table Of Contents

• Tinker-Controller
  • Videos
  • Getting Started
  • Thank you
• Questions
  • Controller Support?
  • Contribute?
  • App Store?
  • How does it Work?
  • Submit an Issue/Bug?
• Updates
  • Agenda
  • Features
  • Bugs To Fix
  • License

Videos

This new video below demonstrates and explains how it works:

And these are my teaser videos from Reddit and Youtube

Getting Started

1. Download Android Studio 3.2.0 or higher and then use it to build the project files into an .apk file
   • If you are on your Android phone, then you can download the demo.apk file here
2. Next upload the TinkerControllerWIFI.ino file to the esp8266
   • It's located in Arduino/Basics/TinkerControllerWiFi folder
3. Launch app, and click on "Gamepad".
   
4. You should notice the app will automatically connect to the esp8266, but if it doesn't you can tap on the button that has the WiFi symbol
   • If that doesn't work, then go to your WiFi settings, and connect to the "ESPTest" network.
5. When connected successfully, the WiFi button and toggle button should turn blue.
6. Now, grab a game controller supported by Android.
   • If you don't have a controller, then you can tap on the toggle button(located at bottom left) to toggle esp8266's built-in LED
7. You should notice that the game controller on the screen is showing the live actions you are doing on your controller
   • If nothing happens, try to close app, and try again. If it still fails, then your controller is not supported by Android(which is sad)
8. Press the A button(down button) on your controller, and you should notice that you are controlling the Esp8266's Built-in Led.
9. If you open the Serial monitor, and press the other buttons like the dpad, they should say something
   • Note: I didn't code the Serial output for the other triggers because I was bored, but you can do that. :D
10. To disconnect, you can leave the gamepad mode or press the WiFi button.
11. Have fun, and join me/donate if you want this project to continue :)

Thank you

• People who fixed this project's bugs:
  • reddit user u/cointoss3 fixed WDT resets
• Guys at Espressif for the amazing and fast library and plugin for esp8266
• Guys who post good code with examples on stack overflow
• JareDrummler for the amazing Theme Engine
• Jake Whorton, for Butterknife library
• AndroidX libraries and other libraries cause I don't know where I'd be without you.

Questions

Controller Support?

Works with any controller that can connect to your phone. They are called HID/Bluetooth controller devices.

Note: For Wii U/Switch, you must use the Mayflash Adapter(Because Nintendo hates open-source)

Contribute?

Yes, please contribute. It will make the community a much better and active environment. Also, running away with the source code without recognizing us and knowing how it works it just plain rude. :\

App Store?

Yes, it will be there once I add "Terminal mode" and "Phone as a Gamepad" mode. Also, Google Play has been removing more and more apps lately, so I'm worried that my app may be removed. But at least it's open-source :)

How does it Work?

The Phone is the most powerful device that we all carry in our pockets, It can perform stuff on its screen while doing some magic in the background. So how does it work? It's quite simple, really :D

For my app, the game controller connects via bluetooth or USB to your phone.
The Android IDE(aka Android Studio) has built-in functions to handle keyEvents like a button press or joystick movement. It can even detect keyboard presses and mouse clicks.

Well, my app takes these controller inputs and sends them to the ESP8266 (aka best WiFi microcontroller) by the network SSID: "ESPTest". The way I programmed the Esp8266 is based on my MusicWithoutDelay library. This means we will use the Char-by-Char or Streaming method to evaluate each byte in the order it came. For example, the phone sends a UDP packet containing two values that I made up. So, if I press the

A

a1

a1

a0

The Esp8266 acts as the server, while my phone is the client. Fortunately, you don't have to connect to this server manually. My app immediately starts searching for WiFi devices with the name "ESPTest" within your area. I tried to mimic Google Chromecast's method, but its hard to decipher :/

Next, after the phone connects to your esp8266, it will enable streaming mode. This mode allows you to send UDP packets to your esp8266 quickly. Of course, there are many problems that arose. Because UDP is so fast, it caused my esp8266 to Crash XD.

The solution I found was to pause the UDP stream if the game controller sent the same stuff before. Essentially, I'm muting extra repeating data. This idea/method is very similar with my SensorToButton library. You can check that out, as it's very simple to use.

The only downside is that some packets can be lost, but since this is game data, we don't care because the Human button press only takes around 10-20 ms which is hardly noticeable when streaming :) But you could try and clicking faster and see a few hiccups, but let's just be honest that this looks cool; it's just so satisfying to see an LED fade when its being controlled by a Xbox controller's joystick.

Submit an Issue/Bug?

Submit an Issue and we'll fix it. :)

Updates

Agenda

Things I plan to do: - [x] ~~Fix Esp8266 from WDT resets, which is caused by doing an action too fast(such as printing to Serial or analogWrite())~~ - [x] ~~Create a Table of Contents~~ :D - [ ] Create TinkerController Arduino Library - [x] ~~Add WiFi support~~ - [ ] Add Bluetooth support(If its fast enough to handle gamecontroller input) - [ ] Add USB support - [ ] Allow a Keyboard/Mouse to act as a game controller - [ ] Add MQTT/CloudMQTT support (This allows playing over the internet anywhere in the world for free) - [ ] Make the Phone act as the server instead of the Esp8266 + This will allow us to connect as many WiFi devices to the phone + You can add multiple controllers to the Phone thus creating a game server :D - [ ] Create a page to access and change Esp8266 password and other stuff + Essentially, I'm trying to mimic Google Chromecast's Setup procedure - [ ] Make a Terminal for communicating via TCP/UDP. - [ ] Make the Phone as a Gamepad, because some people don't have controllers - [ ] Conquer my fear: Dagger 2 :'( - [x] Have Fun :D

Features

I decided to use UDP because it's WAYYYYYYY faster than TCP. I didn't know if esp8266 had a UDP library, but low and behold it did :)

Bugs To Fix

1. Arduino Side:
   • ~~Esp8266 WDT reset happens when you move the joystick for a long time.~~
     • Solved by reddit User: u/cointoss3 who said to use

       yield()

       when using the controller data.
2. Android Side:
   • The WiFi struggles to connect to esp8266 when the Phone's autoconnect is turned on.
   • Lag develops after exiting gamepad mode

License

GNU GENERAL PUBLIC LICENSE
   Version 3, 29 June 2007

Copyright (C) 2007 Free Software Foundation, Inc. https:
Everyone is permitted to copy and distribute verbatim copies
of this license document, but changing it is not allowed.
Rest of License found here: https://github.com/nathanRamaNoodles/Tinker-Controller/blob/master/LICENSE