Proton: A new input architecture for multitouch applications based on regular expressions
23rd January 2012, 3:00pm
Entrée libre et gratuite.
Salle 435, PCRI (how to get there ?)
Current multitouch frameworks require application developers to write recognition code for custom gestures; this code is split across multiple event-handling callbacks. As the number of custom gestures grows it becomes increasingly difficult to 1) know if new gestures will conflict with existing gestures, and 2) know how to extend existing code to reliably recognize the complete gesture set. Proton is a novel framework that addresses both of these problems. Using Proton, the application developer declaratively specifies each gesture as a regular expression over event streams. Proton statically analyzes the set of gestures to report conflicts, and it can automatically create a recognizer for the entire set. To simplify the creation of complex multitouch gestures, Proton introduces gesture tablature, a graphical notation that concisely describes the sequencing of multiple interleaved touch actions over time. Proton contributes a graphical editor for authoring tablatures and automatically compiles tablatures into regular expressions.
Björn Hartmann is an Assistant Professor in the Department of Electrical Engineering and Computer Sciences at the University of California, Berkeley. His research interests lie at the intersections of three domains: crowdsourcing; design tools; and physical computing. He received degrees in Communication, Digital Media Design, and Computer and Information Science from the University of Pennsylvania in 2002, and a PhD in Computer Science from Stanford University in 2009. He is a co-recipient of four Best Paper awards at CHI and UIST, top-tier Human-Computer Interaction conferences. Before entering academia, Björn had a successful career as an electronic musician and record label owner.