All images by Bret Victor
Even if you've never heard of him, Bret Victor ought have some credibility as a former Human-Interface Inventor for Apple, where he worked on "pervasively direct-manipulation interfaces (where the user does his thing by moving and gesturing with meaningful objects, instead of relying on verb buttons and other indirect controls)" among other things. Remember the Microsoft "Vision of the Future" that made the blog rounds, including ours, two weeks ago? Victor's frustration with it is palpable:
I had the opportunity to design with real working prototypes, not green screens and After Effects, so there certainly are some interactions in the video which I'm a little skeptical of, given that I've actually tried them and the animators presumably haven't. But that's not my problem with the video.
My problem is the opposite, really—this vision, from an interaction perspective, is not visionary. It's a timid increment from the status quo, and the status quo, from an interaction perspective, is actually rather terrible.
On his blog, Victor lays out a well-considered and well-communicated diatribe against current touchscreen technology, dismissing it as "Pictures Under Glass [which sacrifices] all the tactile richness of working with our hands, offering instead a hokey visual facade." His suggestions for what interface designers ought be looking into for the future is pretty exciting, and we won't spoil it for you by revealing it here. Go read his essay. Now! (Even if you're on a touchscreen.)
Create a Core77 Account
Already have an account? Sign In
By creating a Core77 account you confirm that you accept the Terms of Use
Please enter your email and we will send an email to reset your password.
Comments
Fact is: we have and might as well use them, and so the rest of our body.
Victor does not say touch screen is flawed. He says it should not be the central feature around which a vision for the future is build.
Well, call me a worrydream fan. I think his brief rant makes Microsoft's vision look rather shortsighted indeed.
I think for the most part the world of human-computer interaction is advancing quite steadily and positively. Manipulating actual things on the screen (representations of objects atleast) is still more natural and intuitive than using a mouse and keyboard to manipulate those same representations.
Bret says that manipulating "Pictures under glass" is unnatural and absurd, given the vast movement capabilities of the hand. Although I can see potential uses of 3D cameras to allow for hand movements that go beyond manipulating mere 2D images, at this point I think we've got as much as we need from computer interaction.
Why do we need to chase the perfect way to interact realistically with simulations of real world things. Why
Touchscreen devices are a better way to interact with phones and the internet, but it doesn't replace actually doing the thing that touchscreen device is simulating.
When you get into actually manipulating things other than photos.. you are talking about design work which after an 8 hour day would require your arm laying down RESTING and using 1-2 fingers. Instead you are saying it would be be better to have our entire upper body in use. Like carpal tunnel isn't bad enough.
First, pads and tablets directly relate to pieces of paper and clipboards, things we've used for a very long time. Touch eliminates the pen, which is simply a tool for manipulating the paper, and allows direct manipulation.
Second, as I recall the iPad supports multi-touch, so you can use a finger, or two, or three, to swipe, pinch, rotate, and perform additional interactions.
Third, I think that voice is going to play a major role in the "future of interaction."
Fourth, that single finger interaction is so simple and easy that even a toddler can use it. Anyone remember the story where the toddler who'd used an iPad got upset when she came across paper magazines that were "broken"?
Finally, I was lying in bed last night reading. I had one arm behind my head, and held the iPad in the other, propped on my stomach, and used my thumb to scroll up, down, and through articles in Zite and Instapaper.
Single finger (thumb) interaction was perfect for that use case. It worked and worked well.
They are a simple reproduction of what was once there physically.
In this sense the physicality and pleasure from pushing a button is much more effective than a touch screen. Also in some instances creating more work for the user. Plus this push for touch screen computers. I'm sorry but I can move my hand a few cm and get it across a 27" screen. If this were to happen i'd physically be doing 10,000 times more work physically. I consider that a fail. Plus I can text message on my phone incredibly fast without looking but now that will never happen in the future because buttons will be obsolete. Not to mention Apple's auto correct feature is absolute garbage.
I get Bret Victor's rant [http://worrydream.com/ABriefRantOnTheFutureOfInteractionDesign/]. It makes a lot of logical sense. My prob though is it doesn't match my experience ...
... I love touching glass and obviously so do a gazillion others. My son took to it amazingly quick @ 2yo (as have many a toddler) ...
... a focus on tangibility is interesting. There are examples of pure tangible or hybrid UIs, but a condemnation like this is overstated.
Where I most certainly agree, is that we are desperate for OTHER visions of the future besides this one. I still love this one: http://www.youtube.com/watch?v=IX-gTobCJHs
Make me a Nokia Morph ... Hell 1/2 a Nokia Morph and I'd be like a pig in shit! It is a hybrid of Interface under glass and tangibility presented in a future scene that while not the MOST inspirational, should definitely inspire.