Mouse, keyboard and touch screens are all great ways to interact with computers and devices. However when it comes to a User interface that I really want, it’s gesture control. That Minority Report like ability to control things with the movement of your hands. There is technology that is certainly moving us in the right direction like augmented reality and the Xbox Kinect which could reasonably accurately identify voice patterns and some hand movements, but this is still expensive technology and has floundered because it was too focused on gaming applications rather than on UI, which is where its real beauty lies. The other peripherals have their uses, but when it comes to the best ways to interact with technology, I think gesture control is the way to go for the future.
This type of technology needs to become a lot cheaper and more integrated into a wider variety of devices to start making any significant impact. It also needs to ensure that gestures are intuitive and makes sense to what a user is trying to do.
One of the interesting technologies to come out of the ongoing Mobile World Congress was that of gesture controls that use ultra sound technology to identify more accurate hand gestures. A company called Elliptic Labs has designed technology based on ultrasound, which allows the company to monitor movement in a 360-degree dome surrounding your smartphone. Essentially working like sonar — sending out inaudible frequencies from your phone’s speaker, and listening for their return with the microphone. The company’s algorithms time how long each wave takes to return, and then use these times to estimate distance.
It sounds a little bizarre, considering most companies are utilizing camera technology to try and develop gesture control. Sonar technology however adds a whole different dimension to it though and essentially can make a device more aware of its immediate surrounding and also more likely to accurately measure movement, compared to what a camera is able to do.
The result of this technology is seamless gesture control that uses hardware already available in every smartphone on the market. Elliptic doesn’t have any consumer products available at the moment, but was able to show off a handful of demo interactions at MWC, showing how this technology can be put to great use.
Picture a ringing phone that mutes instantly the moment it realizes you are moving your hands towards it. Or volume controls that instinctively pop up on screen before you even touch the volume button. Even better, the ability to zoom in and out of phone simply by using you hand. These might all sound like subtle improvements that are likely to make you look like the office fruitcake when walking around, but can actually make operating a device a whole lot easier. And more importantly, move us closer to a world of true gesture driven UI.
Last Updated: March 1, 2017
Kromas Ryder
March 1, 2017 at 12:15
Nope.
This is .
https://wisee.cs.washington.edu/
Original Heretic
March 1, 2017 at 12:36
That looks rather awesome. Though under their FAQ’s, when they speak about the “startup sequence” of gestures that you need to do that acts as a personal password of sorts, it makes me wonder what kind of strange dance I’d have to do just to let the system know that it’s-a me, Mario.
Kromas Ryder
March 1, 2017 at 13:00
Actually from a video presentation the startup sequence could be a series of hand gestures like a fist followed by an open hand followed by a middle finger(that would be mine) 😛
Original Heretic
March 1, 2017 at 13:03
“Could” be.
But it could also be the dance from The Three Amigos. Yeah, I’d totally go for that one. https://uploads.disquscdn.com/images/8e9c2167d14363f30b4a9ac7ecc6562dd7f388cbff1de4de4ab4861c770863f9.jpg
Kromas Ryder
March 1, 2017 at 13:04
Hokey pokey maybe? 😛
Or the time warp. Hell we will have one super fit test group. 😛
Original Heretic
March 1, 2017 at 13:05
Ha! now my imagination is running wild with this one.
As long as no Nicki Minaj dances make the cut. My pelvic area cannot move like that.
Original Heretic
March 1, 2017 at 13:04
https://uploads.disquscdn.com/images/ec98015782f59e917c41c0fadb8fc0b1d3d1a23e7585d798893efd536b6d4f21.jpg
HvR
March 1, 2017 at 13:04
Gesture password not meeting Microsoft password complexity requirements.
Gesture password require 4 of the 5 following criteria:
5 hand movments
2 finger movements
1 pelvis thrust movent
2 handstand movements
1 classic modern interpretive dance movement
Original Heretic
March 1, 2017 at 13:07
The older you get, the more dangerous your own password becomes to you.
Original Heretic
March 1, 2017 at 12:41
Sounds like something similar to sonar used by bats or dolphins.
Why don’t we just invent a shrink ray and miniaturize a few bats and put them into our phones?
I vote shrink ray. It would have other uses, too. https://uploads.disquscdn.com/images/48a7fe073bc285661d6294f1a8cffb232f96cfb8eb3721161875eacef7918933.jpg
miaau
March 1, 2017 at 14:01
Voice. I want voice control and gestures as a backup or when with other people.