The story of Google Glass is one of bold visions and broken dreams. It's a tale that will be told to the end of time, on the pages of history books, in the Museum of Failure and in the whispers of folklore. "Mother, father," your grandchildren will beam as you sit around the roaring fire, "tell us again about Google Glass". And then for hours you'll regale them with tales of the short-lived wearable. How Google envisioned the future of smartglasses. How so many believed in the dream. How it was left destroyed, a hundred shards across Robert Scoble's shower floor. "I saw one with my very own eyes," you say as the embers eke out their final breath. "Yup, a real life Glasshole".
Either that, or we'll all be wearing Google Glass 7.0, which seems far more likely. As we've said many times before, we think Google Glass was always more a proof of concept than a real product, despite being made widely available, and we believe there's more to come.
And, as we've learned from the rest of our Patent series, to tell the future we often need to delve into the past. Here's a rundown of the most important patents that led up to the launch of Google Glass, and the ones that have followed since.
April 2012: X marks the spot
Sergey Brin wears a prototype to the Foundation Fighting Blindness event in San Francisco the same month. Details are scarce, but Google asks for input on what people want to see, and reveals that it's working on making a product that glasses-wearers can also enjoy.
August 2012: Unlocking the eyes
Google wants to patent an idea for unlocking a screen using eye tracking. It reads: "The computing system may determine that a path associated with the eye movement of the user substantially matches a path associated with the moving object on the display and switch to be in an unlocked mode of operation including unlocking the screen." In short, a bit like swiping to unlock your phone but, you know, with your eyes.
February 2013: Detailed design
Details of Glass are still quite thin, but this patent reveals a lot more about how it works. It explains how weight will be distributed across the frame, and outlines provisions for a gyroscope, accelerometer and other sensors.
It also describes the potential to use augmented reality to meld virtual images with the real world. It's clear that Google wants this gadget to do a lot, but it's not certain that all of these things will make it into the final product.
April 2013: Glass on sale
Google starts selling its wearable to qualified "Glass Explorers" for an eye-watering sum of $1,500. Glass leans on Google Now for many of its smarts and includes a camera and touchpad for interacting with it when not using your voice.
It doesn't go on sale to the general public until May 2014, by which time Google offers a range of different frame designs, and announces a partnership with eyewear company Luxottica. The main unit, however, is very similar to the Explorer edition.
September 2013: Glass for all types
Patents reveal Google is thinking about different forms of Glass beyond the basic frame. One shows Glass as part of an actual pair of specs, another reveals a sporty design for the wearable that would wrap around the user's head to keep it in place during more vigorous activity. Of particular note on this one is the lack of camera; the idea suggests a form of Glass that would be just about delivering visual information.
October 2013: Have heart
One of the limitations of Glass is how we interact with it. The trackpad provides one interface, but Google has an idea for hand gesture functionality, as revealed in this patent. Rather than tapping or swiping anything on the frame, you would be able to perform certain gestures with a hand to interact, so long as it's in view of the camera.
The patent describes examples of this, like tracing objects in your vision to cut them out of the landscape, or making the shape of a heart with your hands to "like" something you see and post it to social media. The idea never surfaced in Glass, but we can definitely see it becoming a reality in any future iterations of the device.
December 2013: More eye tracking
Google is looking at ways the human eye can be an input device. In this patent it considers a "gaze axis" and tracking the pupils so augmented objects are easier to see.
April 2014: First contact
Google's contact lens make its first appearance in a patent which says it would be powered by solar power, radio waves or even tears. It's a big leap from the Glass we've seen so far, and while the technologies could apply to the same device, the illustrations clearly show a contact lens that's very different. If Google Glass is dead, is this what's next?
May 2014: A more traditional look
Google Glass's biggest problem was arguably looks, but what if Google could make it less conspicuous? That seems to be the idea behind the latest patent which, again, describes mounting the display entirely into a pair of glasses with no external projector. Not only would it make Glass more appealing to wear, it could even make it easier to use.
More evidence that Google is interested in applying the idea to a more traditional glasses design. Note that this this patent was refreshed in October 2016. That doesn't mean the next Glass will definitely look like this, but Google is holding onto the idea. Another one follows in August.
June 2014: A new audio solution
Google invents a new way of delivering sound to the Glass wearer: ultrasonic waves. It describes a means of wirelessly beaming the audio to the ear in a way that only that person could hear the sound. Neat.
November 2014: Projecting
But what if Glass could project onto other things, like a wall, or a car windshield? Google has a new invention for a Glass projector that would mean you could share things with other people, or simply throw images and information onto a bigger surface.
December 2014: Glass to slim down?
Bulk isn't really Glass's problem – it's more the shape that's going to draw gazes – but it can't harm it to make it a bit more svelte. Google patents a version of Glass with a slimmer design; the battery pack is gone, and all technology is crammed into the casing around the prism. Still looks a bit weird, but better.
January 2015: Google calls time
Google announces it's ending the Explorer program, halting sales of the wearable. It insists Glass is not dead, putting Tony "The Podfather" Fadell in charge of the project, but it feels like the dream is over for now.
We soon learn that the next version of Glass won't be for normal consumers, but aimed exclusively at enterprise. The enterprise edition pops up at the FCC, complete with a foldable hinge, and then in 2016 on eBay.
September 2015: Project Aura
The Glass team has been renamed Aura, and is working on the future edition of Google Glass. Google is also hiring former Amazon engineers who worked on the failed Fire Phone. Internally, the Aura team says it's working on "Glass and Beyond", with some LinkedIn job postings and descriptions mentioning the same thing.
At the same time, Google starts quietly seeding Glass Enterprise Edition to healthcare, manufacturing and other businesses.
October 2015: Holograms?
A published patent similar to the November 2014 projector one appears, but this one makes reference to holograms, and there's some speculation that Google may be getting cozy with mysterious AR company Magic Leap.
November 2015: Easy on the eyes
Taking the slimming down a step further, Google patents a version of Glass that would act more like a monocle. It would rest on just one side of the face with a flexible frame that could be easily adjusted. We certainly prefer the look of it, and there's every chance it could be a sign of what's to come.
June 2017: Glass gets an update
Glass shows some signs of life, as Google updates the device for the first time in three years. The new XE23 version gets support for Bluetooth devices like keyboards, while the MyGlass app gets much-needed bug fixes, support for Android phones running at least 5.0 and better notification syncing.
July 2017: Enterprise Edition becomes official
After years of secretly seeding Glass to businesses, Google announces a "new chapter" for the device. It's aimed at businesses, yes, but the biggest businesses in the world, from the likes of GE and Boeing to Volkswagen. The new version is lighter and more comfortable than the original and even has battery and power improvements over the first gen.
The camera gets upgraded to 8MP and there's a red dot to alert that it's recording. Plus, there's faster Wi-Fi support. The Glass Pod, which houses all the electronics, can also snap off and be added to prescription glasses or safety glasses, depending on your needs.
November 2017: Glass reinvented?
Patently Mobile spots a patent for a new kind of Google Glass. These look a lot more stylish, almost like Ray-Bans, and they use dual microLEDs in a display to show augmented reality to users. Rather than use projection tech or light field, it appears Google is considering just putting little displays directly in the lens of your glasses to put you in the world of AR.
February 2018: Google hints at the future
In an interview, Google's head of hardware, Rick Osterloh, admits that smartglasses are "very interesting" to Google but that it's waiting for the technology to advance before going at it again. The Mountain View company, he says, is considering all sorts of form factors and has no announcements in the offing.
So it's clear that the next version of Glass is being worked on somewhere in Alphabet land. We haven't seen many of these patented concepts appear in the flesh, but Google is likely going to play things much closer to the vest this time.
With the debut of Magic Leap One in 2018, it feels like it's high time for AR smartglasses to hit the mainstream. Google appears to be biding its time, building an ecosystem via ARCore and looking to release a product that's ready for mass consumption, rather than an open beta with a clear prototype device, as it did with Glass.
How we test