Publications

Siftables: Towards Sensor Network User Interfaces

Author(s): 
David Merrill, Jeevan Kalanithi, and Pattie Maes

This paper outlines Siftables, a novel platform that applies technology and methodology from wireless sensor networks to tangible user interfaces in order to yield new possibilities for human-computer interaction. Siftables are compact devices with sensing, graphical display, and wireless communication. They can be physically manipulated as a group to interact with digital information and media. We discuss the unique affordances that a sensor network user interface. (SNUI) such as Siftables provides, as well as the resulting directness between the physical interface and the data being manipulated.

Mining Face-to-Face Interaction Networks Using Sociometric Badges: Predicting Productivity in an IT Configuration Task

Author(s): 
Lynn Wu, Benjamin Waber, Sinan Aral, Erik Brynjolffson, and Alex (Sandy) Pentland

Reality mining is a revolutionary new technology that provides a 'god's eye' view of human relationships and behavior patterns by applying data-mining algorithms to information collected by cellphones, electronic name badges, and other sensors. This award-winning paper uses reality mining to show that the informal, human side of organizations, especially face-to-face social networks, are more important for industrial productivity than almost any other factor.

Connected Consumption: The Hidden Networks of Consumption

Author(s): 
Kwan Hong Lee and Dawei Shen

Ubiquitous availability of mobile devices that sense the user's context and interest will network consumers in real time to help each other fulfill their short term and long term goals. We present the Connected Consumption Network. (CCN), an on going research platform that we are building to bring together communities of consumers with complementary interests. Currently, there is no way to obtain the itemized level transactions of individuals across their spending categories at point-of-sale (POS). Merchants have POS transaction databases of customer's itemized purchases, but they are closed to those merchants.

Learning Plan Networks in Conversational Video Games

Author(s): 
Jeff Orkin

We look forward to a future where robots collaborate with humans in the home and workplace, and virtual agents collaborate with humans in games and training simulations. A representation of common ground for everyday scenarios is essential for these agents if they are to be effective collaborators and communicators.  Effective collaborators can infer a partner’s goals and predict future actions.  Effective communicators can infer the meaning of utterances based on semantic context.  This thesis introduces a computational cognitive model of common ground called a Plan Network.  A Plan Network is...

The Restaurant Game: Learning Social Behavior and Language from Thousands of Players Online

Author(s): 
Jeff Orkin and Deb Roy

We envision a future in which conversational virtual agents collaborate with humans in games and training simulations. A representation of common ground for everyday scenarios is essential for these agents if they are to be effective collaborators and communicators. Effective collaborators can infer a partner’s goals and predict future actions. Effective communicators can infer the meaning of utterances based on semantic context. This article introduces a computational model of common ground called...