Nov
06
2024
It has been 10 years since HP released the Sprout, an innovative desktop computer with a touch screen and built-in projector with a tabletop touchpad. The Sprout had a camera on the projector arm to scan objects; it could also be used for object recognition. Our firm has an interesting history with this extraordinary device as we designed and authored a series of HP-branded and unbranded applications a decade ago. Many of the lessons we learned from authoring applications for this dual-input and dual-display device are still relevant today as we build more complex interactive experiences for public spaces.
Our first contact with the HP team was through our work with Intel in developing GestureWorks Gameplay. This software tool enabled touch and gesture controls for video games on Windows 8 devices, which, at the time, were primarily tablets. Our first assignment was to rework Gameplay to allow interface elements to be placed on the touchpad (rather than the primary touchscreen). Additionally, we needed to support five languages, most of the HP Sprout apps were multilingual. Once GestureWorks for the Sprout was created, we began working more closely with HP to develop a series of applications from scratch. We had the opportunity to work with the device’s inventor, Brad Short, along with Louis Kim, the Head of Immersive Computing at HP, and a very talented team of engineers.
The HP Sprout running Castle Crashers with Ideum’s Gameplay software.
Our team developed a few applications to help “seed” an HP Sprout marketplace for third-party applications; we also created a few of the branded HP applications. The most notable of these software packages was the Stop Motion application. We designed and built this particular application based on HP's rough but functional proof of concept. We redesigned the interface, did a lot of user testing, and built the application, including some examples that came with the software.
The cool thing about this application is that on the projection mat, you could make animations with real physical objects using the camera on the projection arm or digital assets that you created elsewhere or scanned into the Sprout. That “mixed reality” type of approach is what set the Sprout apart from standard desktop computers. The HP Sprout could capture images or scan objects. You could also use the mat as a tabletop display, providing an additional area for application elements, including the interface. Ideum also developed the HP-branded Light Stencil and Sprout Video Capture applications.
The “unbranded” HP applications were great fun to dream up, design, and program. They each had a unique look and feel, and they delved into more specific topic areas than the branded applications, which were made to be more utilitarian and general in their approach.
This application taught users how to make origami objects with step-by-step instructions. The tabletop project provided visual guides for folding the paper, making it easier for beginners to learn how to create origami. You can learn more about Origami Apprentice and see the promotional video in our portfolio.
Origami Apprentice provided step-by-step directions on both the touch screen and projection mat.
Using object recognition, Bills + Coins identified currency from around the world and provided a way for users to learn about geography, history, material science, and economics. The currency was connected to an API that had current conversion information. Bills + Coins was based on informal classroom lessons that developed decades ago when I was a teacher. I would bring in my old coins and then have the students look them up and learn about the currency and countries that produced them.
You can learn more about Bills + Coins and see the promotion video in our portfolio.
Bills + Coins used common currencies from around the world. Like all of the HP Sprout apps, it was developed in five languages.
A mixed-reality application, Fish & Ships, allowed young users to scan in physical objects or create digital ones representing either a “fish” or a “ship.” The objects would then be placed on the main screen in an animated environment. The animations could be used as a screen saver for the Sprout. The look and feel of the application was decidedly steampunk and fun!
You can learn more about Fish & Ships by watching the promotional video in our portfolio.
Young Learners engage with Fish & Ships
In developing these applications, we quickly learned that where you direct a user’s attention is paramount in creating a successful Sprout application. We are all used to looking directly at a monitor in front of us, so it isn’t necessarily intuitive to split your attention between the monitor and the tabletop projection. Also, what functions should be accessible on the mat or the screen? How do you prompt users to turn their attention to one or the other?
Over time, we began to understand how users approached the device, and we broadly defined the approach. Each application was unique, but general design conventions appeared. The mat was always geared for physical objects, but some commonly used interface elements could be placed there for ease of access, as the touchscreen required the user to extend their arm fully.
Much of our experience design work with museums involves multiple displays or projections, and questions about ease of access (and accessibility!) abound. Visitors to public installations like museums won’t spend time learning how to navigate a complex interface, so making thoughtful and intuitive interfaces is vitally important. This is especially true when developing installations where visitors create or share digital content on the museum floor. These types of experiences often involve multiple steps and sometimes even different “stations” or other places in the museum to complete those tasks.
Sadly, the HP Sprout (like many other first-of-its-kind devices) didn’t have enough commercial success to build the ecosystem necessary to sustain it. It had a custom OS layer that was ultimately difficult to maintain, especially as Windows was evolving rapidly in those days. Also, HP underwent significant changes around that time that likely undercut its commitment to the technology. (I should mention a Pro version of the Sprout was available for several years after the original, but it was more geared to professionals than the public at large.) Looking back at the Sprout, it truly was a revolutionary computer, and we were fortunate to have the opportunity to create such exciting software and to work so closely with the talented team at HP that helped invent this device.
