Multi-Touch HQ: NuMTyPYsics / NuMTMPPYsics

Welcome to the MT experiments web page. Here you will be informed about our progress on working with Multi-Touch tables, the MTmini and NumptyPhysics.

NuMTyPYsics source repository: You can download the source code using Git from git://repo.or.cz/numtypysics.git

2009-10-24: Bachelor thesis now online

The full bachelor thesis is now available for download online under the terms of the Creative Commons BY-NC-ND 3.0 license:

2009-08-13: Best Of HCI Seminar Multi-Touch 2009

The DECO research team has published a video summary of the student projects from the HCI Seminar about multi-touch. Yep, this is the seminar in which we developed our Numpty Physics. The final presentations (which this video shows) have been held on the 25th of June, 2009, and we have added some more features in July for our second evaluation, for which we will also post a video shortly.

2009-08-03: TuioTablet - A TUIO simulator for Maemo devices

TuioTablet, a TUIO simulator for devices running Maemo is now available. Version 1.0 is the initial release and provides a launcher with which you can configure the destination host and port where TUIO messages are sent.

This software is based on TUIO_CPP's SimpleSimulator and allows tablet owners that do not have a multi-touch table and don't want to build a MTmini device to remote-control TUIO applications on the local network.

2009-07-31: Source repository now online

As promised, we have now finished most of the work on the code (except for some clean-up and refactoring - the last few days have been busy, so we had to do some quick-fixes). For you, this means that the source code is now available using Git. The code is hosted at repo.or.cz, and you can get it by cloning from git://repo.or.cz/numtypysics.git

Feel free to send any patches my way (contact info).

2009-07-29: Emulating multi-touch via two single-touch tablets

In order to do some more testing at home, I decided to modify the TUIO SimpleSimulator from TUIO_CPP a bit and compile it for N8x0 tablets. This way, I have been able to "simulate" multi-touch (max. two cursors) with two single-touch touchscreen devices. You can find out more by watching this video which shows the input scheme in action:

2009-07-28: Evaluation - done!

We just completed our final evaluation of NuMTyPYsics. We will post an overview of the results shortly and will of course merge our findings and feedback from our testers into our bachelor thesis.

2009-07-27: Last pre-evaluation hands-on session

Today we had another hands-on session at the INSO to fix up the last bugs in our application and to test compatibility of the new features with the table. One highlight that will be evaluated and tested tomorrow is the sound output, which provides audible feedback for users that draw, drag or delete strokes in the game. Of course, the audio features stereo positioning so that multi-player games still work fine with audio output.

2009-07-26: First draft of bachelor thesis

We've spent the last few weeks drafting our bachelor thesis and merged all the feedback from the evaluation and our findings into the document. We will be releasing the final version under a Creative Commons license and publish it here. Also, around that time the final version of our source code should be ready and we'll publish the Git repository that we have used to maintain our codebase during this semester.

2009-07-21: Hands-on with new features and bug-fixes

Today we spent an afternoon at the INSO with the table for some hands-on bugfixing, because it's easier to test things directly with the hardware to get the correct input. Testing with the TUIO Simulator or the MTmini is fun, but does not yield the same results as testing with the real table. Apart from bug fixing, we also started working on some extra features that should improve usability and feedback from the application. More on that soon.

2009-07-12: Work on bachelor thesis has begun

The semester is over, and we've had a week to relax and welcome the summer holidays. Now, it's time to start working on our bachelor thesis. We plan another evaluation in July, as the last evaluation at the end of June was not successful due to a hardware failure.

2009-06-25: Presentation at the INSO

At the end of the multi-touch seminar at the INSO (at the University of Technology Vienna), we held a presentation about our multi-touch improvements to NumptyPhysics and demoed the application on the table using a Win32 build.

2009-06-16: Windows build of Numptyphysics MT+MP

In order to run our Multi-touch and Multi-player version of NumptyPhysics at the institute table, we had to compile NP-MT-MP for Windows (we used Mac OS X for all the testing, because it was the only system that supported the PS3 Eye + tbeta out of the box).

This means that when our project is finished, we will be able to provide multitouch-enabled binaries for Windows (in addition to the source code), so you can run NumptyPhysics using a TUIO-compatible tracker in Windows without having to go through installing MinGW, msys, SDL development packages and GCC4 (there are also some tweaks necessary like disabling ZipFile and happyhttp support ATM - none of these features are essential for normal playing of levels, though).

2009-05-25: Interaction evaluation of multiplayer mode

In recent weeks, we have added Multiplayer capabilities to Numptyphysics and made the event queuing and cursor tracking a bit more robust, so errors in hardware and software tracking won't affect the gameplay. Thanks to our testers! :)

2009-04-23: Multi-Touch-enabling NumptyPhysics - NuMTyPYsics

NuMTyPYsics are our enhancements to Tim Edmond's NumptyPhysics game. We added support for receiving TUIO messages from tbeta via PyTUIO by embedding an Python interpreter into the NumptyPhysics code. Currently, we simply emulate mouse input by pushing hand-crafted input events (SDL_Event) onto the SDL event queue (SDL_PushEvent). In the future, we plan to do bi-directional communication between the game engine (written in C++) and our multi-touch handling code, which will be written in Python.

Parts of the changes have already been submitted to the NumptyPhysics Subversion repository (mostly build support on Mac OS X and generic enabling code).

The multitouch-related code (PyTUIO integration and module) are not yet available in the Subversion repository, as I have not yet had feedback from Tim Edmonds. We are working on getting a Git repository set up for our local changes and develop our improvements there.

2009-04-20: MTmini for testing at home

See this page for photos of my MTmini.

Thomas Perl · 2013-04-12