Media Interaction Lab

We will present the “NiCE Formula Editor” at SIGGRAPH 2010. In this talk, we present a system, which recognizes handwritten formulas to provide in situ computation and visualization. Our editor uses a novel hardware setup, suitable for use as a desktop or whiteboard that disambiguates pen and multi-touch input. In our interface, the pen writes and performs gestures, while touch manipulates. Multiple users can sketch mathematical expressions (e.g. formulas, vectors, matrices, etc.) with digital pens on the interactive surface. These expressions are analyzed and interpreted using the StarPad SDK’s (from our friends at the Brown University) support for mathematics recognition. Pen and touch gestures can be used to manipulate the written expressions. In addition, expressions can be selected and moved by touch or pen input.