I recently got rid of my iPhone and bought a HTC phone with Android (one of the best consumer decisions I’ve ever made). I decided to see if I could using the phone’s multi-touch input to produce TUIO. After some searching I found an app on the nuigroup forums calledTUIO droid by TobiTobsen (Available here).
The video first shows the phone being used to provide an input for the compiz plugin. Unfortunately I didn’t have time to try the gesture feature of the plugin. There’s nothing in the plugin that hasn’t been shown in any of the previous videos. It is worth noting that in this video the plugin is running on a recently installed instance of Ubuntu 10.10.
The remainder of the video shows the phone acting as the input to MT4j (Multi-touch for java – http://www.mt4j.org) framework. I really like this framework and it runs very smoothly. The instance of the MT4j framework shown in the video is running on a 64-bit edition of Windows 7.
As is always the problem with indirect touch devices its difficult to make accurate inputs. As a result in the video you’ll see me miss a few times when trying to press something. You will also notice that I was only able to perform two simultaneous touches, I’m not sure if this is a shortcoming with the phone or the app. I’m currently teaching myself android development so I may try producing a similar app.
UPDATE: I’ve just discovered a new version of TUIOdroid is available. I’ve updated the link in the previous post to redirect to where you can get the newest version (http://code.google.com/p/tuiodroid/). On my HTC (wildfire) it allows for three simultaneous touches which is the maximum the phone can handle so you may be able to get more touches on other devices. On a HTC Desire it can utilise 4 simultaneous updates. The app is also available on the android market.
Nice post. I am also interested in a tuio app for android. An app that would send tuio as well as all the sensor states would be even better! That way you can test remore interaction using accelorometer, gyro etc. As well. By the way, you can find out how many touch your device supports by installing one of the multitouch tester apps from the market. I wish the tuio app you mentioned was on the market as well. I am a bit skeptik about trying apps that are not registered.
Ah thanks, just got a multitouch tester app. Turns out the HTC wildfire has up to 3 simultaneous touches, so therefore the first version of the TUIOdroid app I tried only collects information on up to two simultaneous touches.
EDIT: However the newer version of the app has allowed me to use all 3 touches.
How connect tuio on htc wildfire and pc? i cant connect it
Ok, first you need the TUIOdroid app on your wildfire (you can get this through the android market). Then you need something on your PC that receives TUIO running. You will need to find out which port it listens for TUIO on (this is usually 3333). Make sure your firewalls won’t be blocking this port. Now ensure your wildfire is connected to the same wireless network that your PC is on. On TUIOdroid go to menu > settings and put in network IP of your PC and the port it is listening for TUIO on. Now it should work. If it isn’t there’s a technical issue which I can’t help you with. Hope this helps.