Is augmented reality (AR) more than a concept? Yes and AR is currently being used today. It is not science fiction or anything mystical. AR is currently being delivered on smartphones for location-based searches; through head-mounted devices for training and visual-aid; and in printed materials like magazines and newspapers.
Current AR applications on smartphones fall into these broad categories: navigation, location overlay, geo-informational services, and gaming. Navigation AR utilizes mapping tools like Google Maps or MapQuest to provide route information to destinations by overlaying digital arrows, a compass, or a path on top of the video feed that is seen on the display. Location overlay uses tagging to provide supplemental information or images on a specific location or site such as a skyline, a building, or a historic landmark. A good example would be to point the smartphone camera at the Statue of Liberty and be presented with historic or current data like user-generated comments or reviews. Geo-informational services, on the other hand, would be like a tour guide who provides tips and tidbits of local attractions and recommendations based on your location. The gaming category is self-explanatory and was demonstrated using the AR.Drone.
A realistic example is how a tourist can use their smartphone to interactively see nearby landmarks, attractions and venues. Rather than look for this information on the Internet in the hotel, the user could simply walk around with a cell phone and point at a building or street. The smartphone will then use GPS, an internal compass, and if outfitted with one, an accelerometer to provide location-based data from either a database or the Internet. The GPS is used to provide the user’s location, the compass provides the direction the phone is being pointed to, and the accelerometer determines tilt of the device. This is only one example of how AR is changing reality. This type of application is currently available on devices such as the Apple iTouch, Apple iPhone, or Google Android smartphones. Besides mobile phone, where else can augmented reality be seen today?
Current AR applications on smartphones fall into these broad categories: navigation, location overlay, geo-informational services, and gaming. Navigation AR utilizes mapping tools like Google Maps or MapQuest to provide route information to destinations by overlaying digital arrows, a compass, or a path on top of the video feed that is seen on the display. Location overlay uses tagging to provide supplemental information or images on a specific location or site such as a skyline, a building, or a historic landmark. A good example would be to point the smartphone camera at the Statue of Liberty and be presented with historic or current data like user-generated comments or reviews. Geo-informational services, on the other hand, would be like a tour guide who provides tips and tidbits of local attractions and recommendations based on your location. The gaming category is self-explanatory and was demonstrated using the AR.Drone.
A realistic example is how a tourist can use their smartphone to interactively see nearby landmarks, attractions and venues. Rather than look for this information on the Internet in the hotel, the user could simply walk around with a cell phone and point at a building or street. The smartphone will then use GPS, an internal compass, and if outfitted with one, an accelerometer to provide location-based data from either a database or the Internet. The GPS is used to provide the user’s location, the compass provides the direction the phone is being pointed to, and the accelerometer determines tilt of the device. This is only one example of how AR is changing reality. This type of application is currently available on devices such as the Apple iTouch, Apple iPhone, or Google Android smartphones. Besides mobile phone, where else can augmented reality be seen today?
One of the earliest devices for augmented reality has been the head-mounted display (HMD). It has practical use as a tool for training or to provide visual aid. The biggest challenge of HMD has been to make it socially acceptable. Developers of HMDs have been able to decrease its size as well as make it look somewhat cooler by making them into sunglasses. HMD places a small micro display before a user's eye in order for them to perceive an image generated from a computer or video source. This is similar to a heads-up display (HUD) a pilot would use to navigate and fly an aircraft. The technology has been used by the military to train soldiers as well as provide visual aid during combat. In addition to the military, the HMD has been used for commercial applications like aiding the blind or providing entertainment.
One of the fascinating exploits of augmented reality has to be the 2-D printed marker that delivers a 3-D image with a webcam. The concept is open source and available from ARToolkit as a software library to build augmented reality applications. How does it all work? The marker itself is a square with a white shape, either blocks or symbols, placed on a black background. The program allows the computer to recognize the marker from the captured frames from the video feed. In addition, the application allows virtual imagery to be superimposed over live video of the real world. These virtual images are 3-D templates that are stored on the computer. Since it is the computer that superimposes both the video feed and the digital imagery, it can present these in real time. A mathematical algorithm is used to track the distance of the camera from the marker. This is important as the marker may change position or distance depending how the user presents it to the camera. This technique presents a new way to market and advertise on printed materials like magazine and newspapers.Total Immersion has already taken full advantage of the AR resource and developed their own program. They have been successful in showcasing augmented reality in consumer products, for entertainment, in digital marketing, and for exhibitions. Another great example of these markers being used in printed materials has been through Esquire magazine. Esquire magazine provided a special edition of their magazine to deliver augmented reality in which the user could see the pages of the magazine come to life on a computer.
Both the HMD and 2-D marker are still in development and are still trying to make an impact in the augmented reality market. On the other hand, the augmented reality on a smartphone continues to have a dramatic force in the mobile market. The driving force for augmented reality on mobile phones is advertising and paid-for applications. Augmented reality for the mobile market is forecasted to continue to grow with estimated annual revenues that will reach $732 million by 2014 according to Juniper Research. Currently the future of augmented reality seems bright for smartphones especially as the technology on the phone continues to progress in areas of power, graphics, wireless speed, and processor capabilities.
In next week’s post, I will discuss further the future of augmented reality especially for HMD and the 2-D marker. There is already a huge hype built around AR on smartphones but the future of what AR can deliver on smartphones is still not realized. Mostly AR has been utilized as a gimmick or for adversting but there is still potential for AR in other areas. In my opinion, augmented reality is here to stay and it will change how we perceive the world.