PixelSense

PixelSense
Name	PixelSense
Developer	Microsoft Corporation
Introduced	2007
Discontinued	2012 (consumer products)
Type	Interactive tabletop computing platform
Predecessor	Microsoft Surface (research)
Successor	Microsoft Surface Hub

PixelSense PixelSense was an interactive tabletop computing platform developed by Microsoft Corporation that combined touch-sensitive hardware, multi-touch software, and optical sensing to enable direct manipulation of digital content. Initially unveiled through research at Microsoft Research and later commercialized, the platform bridged ideas originating from projects at MIT Media Lab and influences from products demonstrated at events such as CES and Computex. PixelSense deployments appeared in retail environments run by Best Buy, experiential installations by Disney Consumer Products, and enterprise trials at organizations such as Toyota dealerships and Bank of America branches.

History

Development traces back to research teams inside Microsoft Research who experimented with interactive tabletop concepts alongside academic projects at Irvine and prototypes inspired by the work of Bill Buxton and researchers from Xerox PARC. Public demonstrations occurred at trade shows like SIGGRAPH and Consumer Electronics Show, where prototypes drew comparisons with offerings from Apple Inc. and academic exhibits from the MIT Media Lab. Microsoft introduced the commercial iteration in 2007 under the brand used for a separate touch initiative, later positioning the product within Microsoft Studios and retail channels managed in part by Best Buy and Fry's Electronics. After limited consumer adoption and strategic reorganization under executives previously associated with Windows and Xbox, Microsoft shifted focus toward enterprise solutions exemplified by the Microsoft Surface Hub and platform components folded into Windows 8 touch APIs.

Technology and Design

The platform's engineering combined technologies from several domains: rear-projection optics demonstrated in prototypes distributed by Sony and Samsung, infrared illumination techniques common to work at Princeton University, and computer vision algorithms advanced by teams at Carnegie Mellon University. The table used a rear-projection display module paired with cameras and infrared sensors mounted beneath a durable surface fabricated by suppliers such as 3M and Corning. Multi-touch detection exploited bespoke image-processing pipelines influenced by publications in CVPR and IEEE conferences, while gesture and object recognition leveraged pattern recognition research associated with Stanford University and UC Berkeley. Industrial design iterations were influenced by consumer electronics designers who had worked with IDEO and Frog Design on large-format interactive exhibits for clients including Coca-Cola and Nike.

Software and Applications

PixelSense ran software built on top of middleware from Microsoft Visual Studio toolchains and utilized frameworks related to Windows Presentation Foundation and earlier APIs from Microsoft DirectX. Application development attracted independent developers showcased at events like PAX and SXSW Interactive, while corporate partners produced vertical applications for Starbucks point-of-sale trials and experiential kiosks for Universal Studios. Media playback, collaborative whiteboarding, and retail catalog browsing were common demo scenarios developed using components familiar to developers from Adobe Systems and plug-in ecosystems similar to those used by Autodesk. Third-party software often interfaced with enterprise systems such as SAP and Oracle Corporation for inventory and CRM integration.

Commercial Products and Variants

Microsoft commercialized multiple form factors, including a 30-inch and larger 55-inch tableized unit sold through enterprise channels handled by CDW and Accenture partners. Branded deployments were customized for entertainment clients such as Disney Interactive Studios and hospitality chains managed by Marriott International. Variants included ruggedized versions for museum exhibits at institutions like the Smithsonian Institution and scaled-up wall versions that prefigured the Microsoft Surface Hub used in conference rooms at corporations such as IBM and Deloitte. Manufacturing and integration were subcontracted to original design manufacturers with histories working for HP and Lenovo.

Reception and Impact

Critical reception in publications like Wired, The New York Times, and The Wall Street Journal praised the platform's intuitiveness and collaborative potential, while analysts from firms such as Gartner and Forrester Research noted cost and integration hurdles for mass-market adoption. Academics referenced PixelSense in comparative studies alongside interactive systems developed at MIT Media Lab and prototypes at Stanford University, using it as a case study in human-computer interaction curricula at institutions including Carnegie Mellon University and Georgia Institute of Technology. The technology influenced later large-format interfaces and informed product strategies at Apple Inc. for multi-touch gesture design and at Google for kiosk and retail experiments.

Technical Specifications and Performance

Commercial units typically used high-resolution rear-projection engines with native resolutions comparable to Adobe RGB-calibrated displays, ran multicore processors from Intel Xeon families or comparable chips from AMD, and shipped with dedicated graphics solutions built on NVIDIA GPUs. Sensor arrays combined infrared LED illumination with camera modules similar to those used in products by Logitech and captured frames at rates sufficient for low-latency touch detection reported in benchmarks from AnandTech and Tom's Hardware. Thermal management and power supplies followed standards set by UL and CE certification regimes; network connectivity supported Ethernet and 802.11 wireless specifications common to enterprise deployments managed through Cisco Systems infrastructure.

Category:Microsoft hardware