Course Title: Introduction to Emerging

Technologies
Credit Hour: 3 hrs.
Course Code: EMTE1012.
ECTS: 5 [2 Lecture hours and 3 Lab hours]
Lecture Schedule: Every ____________
Bedasa Wayessa
[email protected]

10/14/2024 EmTe1012 1
 Classroom Rules
• Late comer will only tolerated for the first 5 minutes of every class
• Talk to me and Not to each other
• Do not sleep
• Do not use phones
• Fail to obey the Classroom rule  face 2  3 class ban

10/14/2024 EmTe1012 2
 Assignment Submission
 Guidelines for submission will be provided with every assignment
 Re-grade requests will ONLY be entertained within one week after
the assignments have been handed back to students or assignment due
date
 IMPORTANT: Late submissions are allowed ONLY until 1 day following
the deadline, with 10% marks deduction.
 IMPORTANT: Late + Copy = ZERO Marking

10/14/2024 EmTe1012 3
 QUIZZES
• Quizzes will NOT be announced
• Re-grade requests will only be entertained within one week after the
marked quizzes have been handed back to students [with tangible and
acceptable reason only]

10/14/2024 EmTe1012 4
 Chapter Five

Augmented Reality (AR)

Bedasa Wayessa
[email protected]

10/14/2024 EmTe1012 5
Outlines
• Overview
– Augmented Reality (AR) overlays digital content onto the real world.
– Differs from Virtual Reality (VR) and Mixed Reality (MR).
• Key Differences
– VR: Full immersion in a digital environment.
– AR: Enhances the real world with virtual elements.
– MR: Blends real and virtual worlds with interaction.
• AR Architecture
– Sensors/Cameras: Capture the real-world environment.
– Processing Unit: Analyzes data and renders virtual objects.
– Display: Projects augmented content (smartphones, headsets).
– User Interaction: Via gestures, voice, or environmental triggers.
10/14/2024 EmTe1012 6
Outlines
• Overview of augmented reality
• Virtual reality (VR), Augmented Reality (AR) vs Mixed reality (MR
– Virtual Reality (VR)
– Augmented Reality (AR)
– Mixed Reality (MR)
• The architecture of AR Systems
• Applications of AR Systems
– AR In education
– AR In Medicine
– AR In Entertainment
• Chapter Five Review Questions

10/14/2024 EmTe1012 7
 Objectives
• Explain augmented reality
• Explain the features of augmented reality
• Explain the difference between AR,VR, and MR
• Explain the architecture of augmented reality systems
• Describe the application areas of augmented reality

10/14/2024 EmTe1012 8
 Activity

Activity 5.1.
➢ What do you think about augmented reality?
➢ What are the common features of augmented reality?

10/14/2024 EmTe1012 9
 Overview of Augmented Reality (AR)
• What is Augmented Reality?
• Definition: Augmented Reality (AR) merges real-world environments
with computer-generated content, creating an interactive experience.
• Key Point: It enhances the user's perception by adding virtual objects to
the real world.
• Core Concept of AR
• Main Idea: AR blends the real environment with virtual content through
computer graphics.
• Point to Highlight: The virtual content aligns with real objects, and as
users move, the virtual content adjusts perspective in real-time.

10/14/2024 EmTe1012 10
 Overview of Augmented Reality (AR)
• Augmented vs Virtual Reality
• Augmented Reality (AR):
– Integrates digital info with the real environment.
– Enhances, not replaces, reality.
– X-ray vision is just the start
• Virtual Reality (VR):
– Creates a completely artificial environment, detached from reality.
• How Does AR Work?
– Live view of a real-world environment.
– Overlay of computer-generated images, video, or data.
– Ensures real-time interaction and perspective adjustment with user
movements.
10/14/2024 EmTe1012 11
 Overview of Augmented Reality (AR)
• Real-Time Augmentation
– Key Idea: The augmentation happens in real-time and integrates
seamlessly with the surrounding environment.
– Examples: GPS data, graphics, sound, and video are commonly
augmented elements.
• Benefits of Augmented Reality
– Enhanced Interaction: Users can digitally interact with the real-world
objects around them.
– Digital Usability: Information becomes interactive and usable digitally
through AR applications.
• Metaverse:
– https://www.youtube.com/watch?v=gElfIo6uw4g
10/14/2024 EmTe1012 12
 Overview of Augmented Reality (AR)
• Summary
• Augmented Reality enhances the real world with virtual elements,
transforming how users interact with their environment.
• AR will continue to impact fields like education, gaming, healthcare, and
more.

10/14/2024 EmTe1012 13
 Introduction to VR, AR, and MR
• Virtual Reality (VR), Augmented Reality (AR), and Mixed Reality (MR)
are emerging technologies with similarities and differences.
• Augmented reality (AR): a view of the real world—physical world—
with an overlay of digital elements.
• Mixed Reality (MR): a view of the real world—physical world—with
an overlay of digital elements where physical and digital elements can
interact.
• Virtual reality (VR): a fully-immersive digital environment.
• Advancements in computer vision and processing power make these
technologies more prominent.
• Understanding the differences and applications of VR, AR, and MR is
crucial as they often overlap but serve different purposes.
10/14/2024 EmTe1012 14
 Introduction to VR, AR, and MR
• The main differences between them are explained below (see Figure 5.1)

Figure 5.1 Paul Milgram's Reality-Virtuality (RV) Continuum

10/14/2024 EmTe1012 15
 Introduction to VR
• Definition: VR is a fully immersive technology that tricks your senses
into thinking you're in a different environment.
• Advanced VR environments aim to engage all five senses:
– Sight: Realistic visuals enhance immersion.
– Sound: Surround sound technology adds depth.
– Touch: Haptic feedback for physical sensations.
– Taste: Simulated through experiences (though rare).
– Smell: Aroma diffusers can enhance realism (though not widely
implemented).

10/14/2024 EmTe1012 16
 Introduction to VR
• Components
• Head-Mounted Display (HMD) or Headset
– Experience a computer-generated world of imagery and sounds.
– A device worn on the head that fully immerses the user in a virtual
environment.
– Provides a 360-degree view of the virtual world.
– May include built-in audio for immersive sound.

10/14/2024 EmTe1012 17
 Introduction to VR
• Components
• Computer-Simulated Reality
– Creates a realistic and immersive visual experience by rendering 3D
graphics and playing sounds that correspond to the virtual
environment.
– The quality of the imagery and sounds can vary depending on the
hardware and software used.

10/14/2024 EmTe1012 18
 Introduction to VR
• Components
• Haptic controllers (optional):
– Provide tactile feedback, simulating the feeling of touching or
interacting with virtual objects.
– Can be used for tasks such as picking up objects, firing weapons, or
playing musical instruments.

10/14/2024 EmTe1012 19
 Introduction to VR
• Types of VR Systems
• Tethered VR: Connected to a powerful computer or gaming console
for processing.
– Examples: HTC Vive, Oculus Rift
• Standalone VR: Google Cardboard (popular standalone option)
– Independent devices with built-in processing power.
– Examples: Oculus Quest, PlayStation VR
• Smartphone-Compatible Headsets
– Most standalone VR headsets work in combination with smartphones:
• Insert a smartphone into the headset.
• Immerse yourself in virtual reality.

10/14/2024 EmTe1012 20
 Introduction to VR
• Popular VR Devices https://www.researchgate.net/
Figure 6 - uploaded by Beatriz Añorbe

10/14/2024 EmTe1012 21
 Augmented Reality (AR)
• Augmented Reality (AR)
• Augmented Reality (AR) allows users to see and interact with the real
world while digital content is added to it.
• Users can easily download AR apps on modern smartphones to try out
this technology.
• Special AR headsets, such as Google Glass, display digital content on a
tiny screen in front of the user's eye.
• Examples of Augmented Reality Experiences:
– Snapchat Lenses
– Pokemon Go

10/14/2024 EmTe1012 22
 Augmented Reality (AR)
• How AR Works
• AR adds digital elements to a live view, often using the smartphone camera.
– Camera captures real-world scene.
– Device processes the image and identifies objects.
– Digital content is overlaid onto the scene.

Figure 5.4 Direct and Indirect Augmentation of Objects

10/14/2024 EmTe1012 23
 Mixed Reality (MR)
• Definition: Mixed Reality (MR), or hybrid reality, merges real and virtual
worlds to create new environments where physical and digital objects
coexist and interact in real-time.
• Key Characteristics:
– Real-world environment
– Digital content
– Interaction between real and virtual elements.
• New imagery is placed within a real space, allowing it to interact with
physical objects.

10/14/2024 EmTe1012 24
 Mixed Reality (MR)
• Example: In MR, you can play a video game and interact with real-world
items, such as using a water bottle to interact with virtual characters
(See Figure 5.5 and Figure 5.6).

Figure 5.5 Mixed Reality in Engineering and Medicine

Figure 5.6 Mixed Reality
in Entertainment

10/14/2024 EmTe1012 25
 Mixed Reality (MR)
• MR allows users to manipulate both physical and virtual items without
removing the headset.
• Users can see and immerse themselves in their surroundings while
interacting with virtual environments.
• Differences Among AR,VR, and MR:
– Augmented Reality (AR): Overlays digital content on the real
world, often running on smartphones.
– Virtual Reality (VR): Fully immersive with content that is 100%
digital, requiring specialized headsets and hardware.
– Mixed Reality (MR): Combines interactive virtual elements with
the real world, requiring advanced hardware.

10/14/2024 EmTe1012 26
 Mixed Reality (MR)
• Differences Among AR,VR, and MR:

10/14/2024 EmTe1012 27
 Activity

Activity 5.2.
➢ Describe AR, VR and MR
➢ Compare and contrast AR, VR and MR.

10/14/2024 EmTe1012 28
 The Architecture of AR Systems
• The first Augmented Reality Systems (ARS) were usually designed with a
basis on three main blocks:
1. Infrastructure Tracker Unit,
2. Processing Unit, and Figure 5.7
Augmented Reality
3. Visual Unit.
Systems (ARS)
standard
architecture

10/14/2024 EmTe1012 29
 The Architecture of AR Systems
1. Infrastructure Tracker Unit
– Responsible for collecting data from the real world.
– Sends collected data to the Processing Unit.
2. Processing Unit:
– Combines real and virtual content.
– Mixes virtual content with real content.
– Sends the mixed result to the Video Out module of the Visual Unit.
3. Visual Unit:
– Displays the merged images.
– Types of Systems Based on Visualization Technology:
1. Video See-Through
2. Optical See-Through

10/14/2024 EmTe1012 30
 The Architecture of AR Systems
3. Visual Unit:
• Types of Systems Based on Visualization Technology:
1. Video See-Through(VST): Uses real-scene video images
– Utilizes a Head-Mounted Display (HMD).
– A technology that uses cameras to capture the real-world view.
– Employs video mixing to display merged images.
– Images are shown on a closed-view HMD.
– The user does not see the real world directly.
– The device processes the camera feed, combining it with digital overlays in
real time.
– The combined feed (real world + digital content) is shown to the user on
screens inside the headset.
– Examples: Some VR headsets (like the Oculus Quest Pro) with
external cameras use this method for AR.

10/14/2024 EmTe1012 31
 The Architecture of AR Systems
3. Visual Unit:
• Types of Systems Based on Visualization Technology:
2. Optical See-Through: Provides a direct view of the real scene
– Also uses a Head-Mounted Display (HMD).
– The user sees the physical world directly through transparent or
semi-transparent lenses (like glasses).
– Digital information is overlaid on these lenses, allowing the user to view both
the real-world environment and virtual content simultaneously.
– Utilizes optical combiners to overlay digital content onto the real-world view.
– Employs optical combiners to merge images.
– Images are viewed through an open-view HMD.
– Examples: Microsoft HoloLens, Magic Leap, Google Glass.
10/14/2024 EmTe1012 32
 The Architecture of AR Systems
• Challenges with HMDs
• HMDs are currently the dominant display technology in the AR field.
• Limitations:
– Ergonomics: Often uncomfortable for extended use.
– High cost: Many HMDs are expensive.
– Low mobility: Bulky sizes and connectivity issues hinder mobility.
• Interaction Issues:
– Difficulty in interacting with the real environment, making it
challenging to engage with virtual interactive zones effectively.

10/14/2024 EmTe1012 33
 The Architecture of AR Systems
• Alternative approaches to developing ARS involve the use of:
– Monitors  are used as an option for indirect view since the user
does not look directly into the mixed world.
– Tablets  are used in direct view since the user points the camera
to the scene and looks directly into the mixed world.
• Both approaches still have difficulties in getting a collision.

10/14/2024 EmTe1012 34
 Activity

Activity 5.3.
➢ What are the three blocks/components of the AR system
architecture?
➢ Describe the functions of the Infrastructure Tracking Unit, the
Processing Unit, and the Visual Unit?
➢ What is the difference between Video-see through and Optical-
see through visualization technologies?

10/14/2024 EmTe1012 35
 Applications of AR Systems
• Exploring AR Across Various Fields
• AR is an emerging technology with growing applications in many fields.
• AR overlays digital information onto the real world using various devices
like smartphones and desktops.
• Major applications include:
– education,
– medicine,
– entertainment,
– military, and more

10/14/2024 EmTe1012 36
 AR in Education
• AR’s Role in Education
– AR enhances learning experiences by making educational
content interactive and engaging.
– It is adaptable to various devices such as desktops, mobile
phones, and smartphones.
– Supports traditional classroom instruction, special education,
and extends learning beyond the classroom.
– AR can combine with other technologies to enrich their
applications.

10/14/2024 EmTe1012 37
 AR in Education
• Why Use AR in Education?
– Affordable learning materials: AR reduces the need for costly
physical models or prototypes.
– Interactive lessons: Students can engage with 3D models on
their smartphones, enhancing their understanding.
– Higher engagement: Students are more engaged, leading to
productive learning.
– Higher retention: AR helps students remember information
longer by using multiple senses.
– Boost intellectual curiosity: AR excites students, especially
those in the digital era, fostering critical thinking.
10/14/2024 EmTe1012 38
 AR in Medicine
• AR Transforming Healthcare
• AR plays a vital role in improving safety and efficiency in healthcare.
• Significant applications in:
– Surgery: AR provides 3D models for more precise, minimally
invasive procedures.
– Education: AR helps in training future doctors.
– Diagnostics: Enhances diagnosis accuracy, even for mental health
disorders.
– Patient education: Apps like AyeDecide simulate vision
impairments to help patients understand their conditions.

10/14/2024 EmTe1012 39
 AR in Medicine
• In medicine, AR has the following applications:
1. Describing Symptoms: AyeDecide simulates vision problems to help
patients better describe their symptoms, aiding doctors in diagnosis.
2. Nursing care: AR tools like AccuVein improve the success rate of
intravenous injections, especially for children and elderly patients.
3. Surgery: AR systems like Augmedics give surgeons "X-ray vision" to
overlay 3D scans during procedures, reducing risks.
4. Ultrasound: AR-integrated portable ultrasound scanners are useful in
remote areas and military medicine.
5. Diabetes management: Google’s smart contact lens helps track
glucose levels in real-time.
6. Navigation: Apps like EHBO use AR to locate nearby hospitals and
defibrillators.
10/14/2024 EmTe1012 40
 AR in Medicine
• Advantages for Patients and Healthcare Workers
– Assists in routine medical tasks.
– Reduces risks in minimally invasive surgeries.
– Helps in better diagnosis and treatment decisions.
– Makes medical procedures more tolerable for patients.
– Improves aftercare.
– Enhances medical education and routine procedures.

10/14/2024 EmTe1012 41
 AR in Entertainment
• AR’s Influence on Entertainment
– AR is reshaping various entertainment industries like gaming, music,
TV, eSports, and live performances.
– Gaming: AR games (e.g., Pokémon GO) increase physical activity but
have also raised safety concerns.
– Music: AR provides extra information about songs, performers, and
even adds visuals to live performances.
– TV: AR can add supplementary information (e.g., match scores,
betting options) to enhance the viewing experience.
– eSports: AR makes eSports events more interactive for viewers.
– Theater: AR can add virtual objects for accessibility, such as
providing subtitles for hearing-impaired audiences.

10/14/2024 EmTe1012 42
 Activity

Activity 5.5.
➢ Describe the applications of AR in education?
➢ What are the reasons to apply AR in education?
➢ List some of the applications of AR in medicine?
➢ Describe the benefits of AR to patients and healthcare workers.
➢ How AR can be used in Entertainment?

10/14/2024 EmTe1012 43
 End of Chapter-five
Thank you !!!

10/14/2024 EmTe1012 44