Postdoctoral Researcher in Human-Computer Interaction
Papertab is a paper computer with multiple 10.7” functional touch sensitive flexible electrophoretic displays. Papertab merges the benefits of working with electronic documents with the tangibility of paper documents. In Papertab, each document window is represented as a physical, functional, flexible e-paper screen called a tab. Each tab is an Android computer that can show documents at varying resolutions. The location of tabs is tracked on the desk using an electro-magnetic tracker. This allows for context-aware operations between tabs. Touch and bend sensors in each tab allow users to navigate content.
PaperTab was presented at the Consumer Electronics Show (International CES 2013) in Las Vegas. It has garnered over 1.8 million YouTube hits since then and has also been shortlisted for Innovation of the Year 2013 by T3 Magazine and Stuff Magazine.
PaperTab: Revolutionary paper tablet reveals future tablets to be thin and flexible as paper.
Paper-like computers with multiple flexible displays: Aneesh Tarun at TEDxQueensU
Stacking physical documents is one of the main forms of spatio-temporal organization of information. We present DisplayStacks, a system that enables physical stacking of digital documents via piles of flexible E Ink displays. With a conductive dot pattern sensor attached to the flexible display, we dynamically track the position and orientation of these displays in relation to one another. We introduce mechanisms for interacting with these physical stacks for access and manipulation of information using asymmetric bimanual interactions, such as providing contextual overviews. Initial user experiences indicate a preference for linear overlaps as a stacking configuration.
DisplayStacks: Interaction Techniques for Stacks of Flexible Thin-Film Displays
Snaplet is a paper computer in the form of a bracelet. Snaplet is a wearable flexible E Ink display augmented with sensors that allow the shape of the display to be detected. We propose that the physical form of a flexible display, depending on the way it is held or worn, can help shape its current functionality. When in a convex shape on the wrist, Snaplet functions as a watch and media player. When held flat in the hand it is a PDA with notepad functionality. When held in a concave shape Snaplet functions as a phone. Calls are dropped by returning its shape to a flat or convex shape.
Snaplet: A Flexible E Ink Wristband Computer That Senses Its Shape
Flexible Printed Circuits
Prototyping interactions and interfaces with flexible displays presents its own challenges. These thin-film displays require thin and lightweight sensor solutions for enabling interactions. At our lab, we have been building our own flexible circuits to augment flexible displays with custom sensors and 3rd party sensors. These circuits may support anything from sensing relative positioning (DisplayStacks), to sensing bend (PaperTab) and touch (Snaplet) interactions.
We hosted a workshop on designing, building, and using flexible circuits at TEI 2012. We got teams to conceptualize and build interactive projects. Here is a copy of the workshop presentation slides that outlines how to build flexible circuits. If you are interested in further exploring this area, I highly recommend these websites: Meg Grant’s page on flexible circuits, MIT’s High-Low Tech Group.
NewsBreaker is a tower-defense game that explores alternate ways of dissemination of news information. NewsBreaker scours the news articles of the day to generate unique gameplay.
We use a semantic engine to analyze any given news article and extract useful data. This data is used to procedurally generate monsters, towers, and gameplay dynamics on the fly.
I’m currently working on an updated version of the game. Watch this space for an online-playable version of the game as well as further technical details of the procedural content generation mechanism.