Augmented Reality Technologies Today: 2024 AR Research & Applications

Advances in augmented reality (AR) technologies have made it possible to bring the digital dimension into the real world. The best example of this innovation could be seen in Pokemon Go. The game took the world by storm when it was launched, as it allowed players to catch pocket monsters out “in the wild.” The annual revenue generated by Pokemon Go in 2016 reached $588.77 million.

Its huge success pushed augmented reality into the public consciousness. More games using the technology were released. This development is one of the main drivers that propelled the CAGR of augmented reality games to grow 175.9% from 2018 to 2023.

Games, however, are not the only use case of AR. Indeed, it is widely utilized in onsite assembly and safety particularly in construction, industrial maintenance, and retail showcasing. Additionally, there are now learning management systems that integrate AR.

So, how does augmented reality work? In this article, we take a deeper look into augmented reality technologies. There will be information about R&D, related technologies, how AR works, AR applications, emerging technologies, and trends.

Two Boeing engineers, Thomas Caudell and David Mizell, coined the term “augmented reality” in 1992. At the time, they were working on a simple headset that would help airplane engineers in handling complex wiring schematics. Their goal was to reduce costs and enhance efficiency in processes involved in airline manufacturing.

But the augmented reality history began long before there was a term for it. Indeed, Ivan Sutherland and his MIT Lincoln Lab colleagues worked on a simple head-mounted three-dimensional display. They had a pretty neat name for it, too, “Sword of Damocles.” It was nothing like the lightweight AR equipment common these days. This sword was so heavy it had to be suspended from the ceiling.

Even before that, there was Morton Heilig with the multisensory theater he dubbed “The Cinema of the Future.” Dubbed the “Sensorama,” this was an arcade-like mechanical cabinet designed to stimulate the senses. After that, Heilig also came up with the Telesphere Mask, a head-mounted display that delivered stereoscopic 3D visuals and sounds.

Technological advancements in the late 20th century and in the last two decades have expanded the horizon of AR. That is thanks largely to investments in the technology, which amounted to $4.1 billion in 2019 alone. How it works has become more complicated as well. Below, we look into how AR works and what technologies are required for it to function.

How AR Works

There are three augmented reality technologies and applications that allow AR to work. These are simultaneous location and mapping (SLAM), depth tracking, and image processing and projection. When put together, they make AR a reality.

SLAM is a piece of technology that allows a device to overlay digital images onto the real world. It is aided by localizing sensors to take a full sense of a physical setting. Depth tracking, on the other hand, measures the range of an object or a surface from the AR device’s camera. Lastly, the AR application or software processes the images to get the dimensions and the location correctly.

When these applications work simultaneously, they project a digitally produced object into the real space.

A device with a camera, such as a mobile phone or a pair of smart glasses, is essential to making this happen. Plus, AR software is required for image processing—it is this tool that recognizes objects using computer vision technology. In turn, that technology reads or analyzes the video stream.

To make it complete, the device gets information regarding an object from the cloud. It provides a 3D experience that moves with the user, whose size and orientation are adaptable to the device settings.

If you have colleagues asking, “How does augmented reality work?” point them to this graphic for a digestible answer:

Types of Augmented Reality

There are different types of augmented reality. These are categorized according to how the augmentation is triggered: marker-based AR and markerless AR.

Marker-based AR

Markers are unique patterns that cameras can pick up from any environment. Users will need an app to scan them and to trigger an augmented experience that will appear on a person’s device. Depending on the design, the marker or the camera can be moved around for various effects.

The downside of this type is that users are entirely reliant on apps for the experience.

Markerless AR

Markerless AR is the more versatile type of AR since it does not require visual cues or patterns. Rather, it gathers information from the environment through the camera, GPS, accelerometer, and digital compass of a device. This is where SLAM comes in. Since it offers more flexibility, markerless AR is more popular with developers.

There are two variations for this type of AR:

1. Location-based AR – Ties the augmentation experience to particular settings. The software determines whether an area meets the criteria to project virtual objects. This is what Pokemon Go does.

2. Projection-based AR – This variation of markerless AR does not require any user-operated tech. To provide an augmented experience, it projects images onto flat areas. It is often used for entertainment and practical applications.

Common Software or Applications for Building Augmented Reality

As mentioned above, a piece of software or application is required to enable augmented reality. In line with this, there are also platforms that are used to develop those AR experiences. These are a few:

1. ARCore – This is Google’s platform for AR development. It utilizes multiple APIs to allow a user’s phone to map out the environment, understand the setting, and interact with the data it processes.

• There are 27 Android-compatible smartphone brands that have ARCore-enabled devices. (Google Developers, 2021)
• In total, there are 404 devices that are currently ARCore supported. Google Developers, 2021)
• Its market size is $122 billion, as of 2020. (AR Insider, 2021)
• 39% of organizations in the US use Google ARCore to develop AR. (XR Association, 2020)

2. Apple ARKit – A cutting-edge framework for AR. This platform comes from Apple and is designed to work with iOS and iPadOS. The latest iteration, ARKit 4, has a new Depth API that works with the LiDAR scanner on the iPhone 12 family and the iPad Pro.

• 26% of organizations in the US develop AR experiences with Apple ARKit. (XR Association, 2020)
• $147 billion—ARKit market size. (AR Insider, 2021)
• 10% of game developers worldwide are working with ARKit. (Game Developers Conference, 2021)

3. Unity – The industry-leading AR development software has tools and a unified workflow for developers. It is equipped with an XR Interaction Toolkit that enables users to drop elements into a scene. This means no more coding objects from scratch.

• People download 2 billion games built using Unity every month. (TechCrunch)
• People have played at least one Unity game on more than 3 billion devices. (TechCrunch)
• Unity recorded a revenue of $200.8 million in 2020. (VentureBeat, 2020)

Technologies Related to AR

SLAM, image processing, and depth tracking are three technologies that enable augmented reality. However, there are other augmented reality emerging technologies that bring it all together. A few examples are sensors, cameras, accelerometers, digital compass, displays, navigation devices, and gyroscopes. On top of that, they need to be paired with the right CPU to run smoothly.

Moreover, they require suitable devices for augmented reality such as the following:

• AR-compatible devices – These are smartphones and tablets that can run applications with AR functionality. Smartphone makers would have a list of devices that are enabled for AR. If not, Google has a page that lists every smartphone that can support its ARCore.
• AR glasses – Otherwise known as smart glasses, these are glasses that overlay digital images or information into the physical environment. These require a camera and a smartphone or tablet connected to them. However, there are others that work with head-mounted displays as well. According to virtual reality statistics, shipment for AR and VR headsets is taking off.
• AR contact lenses – The concept of AR itself is already Sci-Fi material, but now there are companies taking it further. One such company is Mojo Vision. It is mainly targeted towards people who have sight impairments to give them augmented vision.
• AR helmets – Since AR is now widely used in architecture and construction, it makes sense that there are now helmets devised to incorporate the technology. An example is the DAQRI Smart Helmet, which promises to enhance site efficiency while ensuring safety.

Augmented Reality Use Cases

One of the most common augmented reality use cases is gaming. But this technology does more than just provide a different facet to playing games. As can be seen in the increase in corporate and industrial investment in augmented reality software, it is also widely used in scenarios other than gaming. The following are augmented reality technologies applications and limitations.

Medical Training

Medical institutions are using AR to train doctors in performing surgeries, especially the more complex ones. For example, the Cleveland Clinic at Case Western Reserve University has its students learning anatomy using HoloLens. Students reported that 15 minutes with the device could have shaved dozens of hours of learning in traditional laboratories.

Retail

Have you ever wished you could try a piece of furniture first before proceeding to purchase it? With IKEA’s augmented reality app, it is possible. Users can place any item of furniture they like in their homes (virtually, of course). This way, they can be sure that it fits in the room they want to place it in. It also gives consumers time to decide whether to move things around or get rid of some items. What’s more, the Swedish furniture maker allows users to place several pieces of furniture at once! A similar virtual reality trend is afoot, too.

Civil Construction

AR as a civil construction tool goes beyond 3D plans and digital models. With it, engineers and architects can get an in-depth look at what will be built. It can allow them to understand complex layers that would otherwise be challenging to perceive.

Apart from that, design and construction firms can use it for inspection. An inspector can compare the building information model generated by BIM solutions with what is being built. Thus, it would be easier to see discrepancies and to relay the information to ensure it is corrected swiftly.

AR for Deaf and Hard-Hearing Individuals

Students of Cornell Tech worked on AR software for deaf and hard-of-hearing individuals as part of their specialization project. Their aim is to ease the challenges of deaf and hard-of-hearing people when they have one-on-one and prolonged conversations. The software is designed to project captions to pave the way for seamless verbal exchanges. Other organizations have also begun developments of similar devices.

Investment in AR/VR Technology by 2024 (IDC, 2020)

• Training – $4.1 billion
• Industrial maintenance – $4.1 billion
• Retail showcasing –  $2.7 billion
• AR/VR gaming & VR video/feature viewing – $17.6 billion

Research and Development

There are a number of tech companies that conduct research and development of AR software and products. Often, many of them are tied with use cases such as the ones above.

According to a literature review, computer science is the leading category where AR research is being done. Following it is the medical area, particularly in rehabilitation and clinical neurology. Other categories where AR has received much attention are engineering, education and educational research, automation and control systems, and more.

Limitations

Augmented reality is magic. But there are still limitations to the technology. The founders of Laan Labs mentioned that design and development are limited to the technology available today. This means that consumers themselves have to set realistic expectations, too.

Additionally, AR is still restricted in some sense, especially on mobile. An article by DAQRI talked about depth cameras that are utilized in mobile AR. Consumers may be more familiar with Xbox 360’s Kinect—the gaming accessory uses a depth camera to capture the user’s motions. But this technology is back into the public consciousness, thanks to Apple’s iPhone X, which integrates a basic form.

There are complex requirements for mobile AR depth cameras, however. According to the smart glasses maker, first, sensors have to be small enough to match the size restrictions of headsets. Second, it needs to consume as little power as possible to prevent overheating. Third, it must not be demanding in terms of processing of the sensor output. Because if it is, then it will only consume more power. And lastly, they need proper calibration. Since mobile cameras undergo stress and wear over time, their factory calibration may not be long-lasting.

But advances in other areas may soon provide solutions to such challenges and propel augmented reality technologies to greater heights.

Augmented Reality Developments

Though augmented reality has been around for a while, it was not until less than a decade ago when it really started taking off. Looking at augmented reality developments, mobile phones had a huge part to play. Because of such devices, it was possible to have applications and games in the hands of the public. Indeed, the number of AR-enabled smartphones will reach 4,670.8 million by 2022.

Apart from that, there are other notable trends in the field:

1. Shopping with AR – It was previously mentioned that IKEA has an app that lets people envision how items from the Swedish furniture company will look in their homes. It is not the only retail store that has thought of this. This approach is also popular among fashion brands.
2. Training in Healthcare – The training of surgeons in schools and hospitals is being augmented by, well, augmented reality. Using AR projections, they can practice complex surgeries and have some proficiency before the actual undertaking.
3. AR for Driving Assistance – AR is also being used in automobiles. The technology is used mostly for navigation. Arrows appear on a heads-up display to guide drivers, eliminating the need to look on their mobile devices for directions while driving.

Key Challenges in Implementing AR

While augmented reality (AR) offers significant potential across industries, its implementation is not without challenges. Here are some key obstacles organizations face when adopting AR technology:

• High Development Costs: Creating immersive AR experiences requires specialized hardware and software, which can be expensive. From designing 3D models to developing complex applications, the development process can be resource-intensive, making it a costly investment for businesses.
• Technical Limitations: AR applications require robust hardware, such as high-performance smartphones or AR glasses. The lack of standardization across devices means developers must optimize AR solutions for different platforms, which can lead to compatibility issues.
• User Experience (UX) Challenges: Ensuring that AR experiences are intuitive and seamless can be challenging. Poorly designed interfaces or lagging visuals can lead to frustration, diminishing the effectiveness of the AR experience. Balancing functionality with ease of use is crucial.
• Privacy and Security Concerns: AR technologies often collect vast user data, including location and personal preferences. This raises concerns about data privacy and security, especially when users interact with AR in public spaces or with sensitive information.
• Content Creation: High-quality AR content requires significant time and effort to create. Whether it’s 3D models, animations, or interactive features, creating compelling AR content that feels natural and engaging can be resource-heavy.
• Limited Consumer Adoption: Despite AR’s potential, consumer adoption is still growing slowly. Many users may be unfamiliar with the technology or lack the hardware to fully experience it, hindering widespread usage.

The Reality of Augmented Reality

AR is now commonplace, with millions of devices ready to support it. But there are still challenges that must be surmounted to create a near-perfect AR experience. For one, there is the matter of depth sensing. Depth cameras must meet three important criteria points to be optimal.

There is also the issue of cost. While AR has become more accessible to the ordinary consumer, AR-enabled devices still come with a hefty price tag in other sectors. Therefore, it will still be a long while before medical institutions, civil construction firms, enterprises, and other entities would be able to afford widespread implementation.

And though augmented reality technologies today are a boon, there are downsides to it, too.

Cons of Augmented Reality

1. Real-world intrusion. It is highly possible that AR device or application users could intrude into the spaces of private individuals. That has happened with Pokemon Go, which is one of the world’s top games, according to Pokemon Go statistics. A couple in Detroit, Michigan sued Niantic, the game’s developer, because of players trespassing on their property. In their lawsuit, they explained that they did not feel safe due to strangers trampling around the area. This is an issue that future game developers need to address to avoid disturbing neighborhoods.
2. Risky behaviors. Again, Pokemon Go provides a prime example. Two men in San Diego, California fell off a cliff while playing the game. While that is not exactly the fault of the game maker, it is still a very real drawback because AR uses the environment to give an augmented experience.
3. Privacy and security concerns. AR devices have cameras attached to them to take in the world and software for processing and providing the augmented information. These things can be used to gather data by companies without the knowledge of the user. Companies need to be clear in how they will handle the data they collect to assuage the fears of people over security and privacy breaches.

These are immediate concerns that AR developers need to address, as augmented reality statistics point to further growth. They also need to educate and inform their users. Niantic, for its part, has public service announcements in the game to remind players to be mindful of their surroundings.

Key Insights

• Core Technologies in AR: Augmented reality relies on simultaneous location and mapping (SLAM), depth tracking, and image processing and projection to function effectively.
• Types of AR: There are two primary types of augmented reality: marker-based AR, which uses visual cues to trigger augmented experiences, and markerless AR, which gathers information from the environment using sensors.
• Popular AR Development Platforms: Google’s ARCore, Apple’s ARKit, and Unity are among the most popular platforms for developing AR experiences.
• Wide Range of Applications: AR is used in various fields beyond gaming, including medical training, retail, civil construction, and for assisting deaf and hard-of-hearing individuals.
• Investment in AR: Significant investments have been made in AR and VR technologies, with expectations of continued growth in areas like training, industrial maintenance, and retail showcasing.
• Historical Context: The concept of augmented reality dates back to the 1960s, with substantial advancements in recent decades thanks to technological investments.
• Emerging Technologies: Advancements in sensors, cameras, and other devices are pushing the boundaries of what AR can achieve, including the development of AR glasses, contact lenses, and helmets.
• Challenges and Limitations: Despite its potential, AR faces challenges such as high costs, technical limitations, and privacy concerns that need to be addressed for wider adoption.

FAQ

1. What is augmented reality (AR)? Augmented reality is a technology that overlays digital content, such as images, videos, or 3D models, onto the real world, enhancing the user’s perception of their environment.
2. How does augmented reality work? AR works through the integration of technologies like SLAM, depth tracking, and image processing, which allow digital content to be seamlessly overlaid onto real-world views. This process typically involves a device with a camera and AR software.
3. What are the main types of augmented reality? The main types of AR are marker-based AR, which uses visual markers to trigger augmented experiences, and markerless AR, which relies on sensors to gather environmental information and provide augmented experiences without visual cues.
4. What devices are commonly used for augmented reality? Common devices for AR include smartphones and tablets that support AR applications, AR glasses or smart glasses, AR contact lenses, and AR helmets designed for industrial and construction use.
5. Which platforms are popular for AR development? Popular platforms for AR development include Google’s ARCore, Apple’s ARKit, and Unity, each offering tools and frameworks for creating AR experiences.
6. What are some common use cases of augmented reality? AR is used in various fields such as gaming, medical training, retail (e.g., virtual furniture placement), civil construction (e.g., inspection and planning), and for aiding deaf and hard-of-hearing individuals.
7. What are the limitations of augmented reality? Limitations of AR include high costs of AR-enabled devices, technical challenges like depth sensing and power consumption, and privacy concerns due to the data collected by AR devices.
8. What is the future outlook for augmented reality? The future of AR looks promising with continued investment and technological advancements. Areas such as healthcare training, retail, industrial maintenance, and gaming are expected to see significant growth and innovation.
9. What are the privacy and security concerns associated with AR? Privacy and security concerns in AR stem from the data collected by AR devices, which can include sensitive personal information. Companies need to clearly communicate how they handle and protect this data to address user concerns.
10. How did augmented reality gain public attention? AR gained widespread public attention with the success of the game Pokemon Go, which demonstrated the potential of AR technology and significantly raised awareness of its capabilities and applications.

By Nestor Gilbert

Nestor Gilbert is a senior B2B and SaaS analyst and a core contributor at FinancesOnline for over 5 years. With his experience in software development and extensive knowledge of SaaS management, he writes mostly about emerging B2B technologies and their impact on the current business landscape. However, he also provides in-depth reviews on a wide range of software solutions to help businesses find suitable options for them. Through his work, he aims to help companies develop a more tech-forward approach to their operations and overcome their SaaS-related challenges.