O-RAN Radio Unit Conformance

Testing

Ben Smythe Martha Zemede Paris Akhshi, PhD

R&D Project Manager & Senior Applications Engineer Product Marketing Manager
Solution Manager
O-RU Test Solutions 1
Agenda

• Review of O-RAN
• Functional Splits
• Conformance Tests
• Test set-up
• Test flow
• Keysight solutions

O-RAN Radio Unit Conformance Testing 2

Overview of O-RAN

3
O-RAN Radio Unit Conformance Testing
Evolution of the Radio Access Network
Traditional RAN
Centralized
Distributed
Cloud RANRANRAN
(or Virtualized RAN)
Active
Antenna
Antennas
System
Amp
RRH

Fronthaul
Coax
Fiber

BBU
Fronthaul
Mobile
Cloud RAU BBU RU
Core Backhaul Fronthaul
RAN
BBUMidhaul Base Station Site

Baseband Hotel

O-RAN Radio Unit Conformance Testing 4

 Why O-RAN
CAPTURE GROWTH IN NEW 5G VERTICAL MARKETS
CAPEX/OPEX CONTROL

Driving Forces
Objectives
• Network Densification
Expected Gains
• Scalability limitations • Increase Network
of traditional Resource utilization
architectures Operational Efficiency
(Slicing , Pooling)
• Proprietary Networks • Capex Reduction
• Same cost reduction
dependence (HW optimization)
as data Centers
• Virtualization • Opex Reduction
• Power, Space Saving
technology • Revenue maximization
• Automation /
orchestration

O-RAN Radio Unit Conformance Testing 5

O-RAN Alliance and Ecosystem

Keysight’s Commitment and

Leadership
• Active member of O-RAN ALLIANCE
since its inception in 2018
• Co-chairs a committee (MVP-C) that
drives O-RAN releases and
specification priorities
• Leads and contributes in multiple
(eight) groups to all major technical
and test specifications for Open
Interfaces, Transport, Security, Open
Intelligence and Automation, E2E Test
and Integration

O-RAN Radio Unit Conformance Testing 6

O-RAN Market Trends
TOP TECHNOLOGY AND MARKET FORCES

Massive MIMO
• Augment Throughput and Spectral Efficiency
• Drives Changes in Test approach for evaluating, testing, validation for dis-aggregated multi-
vendors O-RAN
• Migration towards multi-channel test environments and channel Emulation

Cloudification
• High-speed mobile networking demand continues to increase
• Operators need for cost-effective network capacity expansion
• Resource virtualization in the cloud allows optimization of resources

Intelligent Control
• RAN Increased Complexity require Intelligent control (RIC)
• Real-time and non-real time RIC testing

O-RAN Radio Unit Conformance Testing 7

 O-RAN: Edge to Core

RIC

RF O-RAN O-RAN
Fronthaul Midhaul Backhaul

UEs O-RU O-DU O-CU

5G RAN / gNB 5G Core / EPC

O-RAN Radio Unit Conformance Testing 8

 Edge to Core Solutions Overview

RuSIM Open RAN RICtest LoadCore

Studio

RIC

RF O-RAN O-RAN
Fronthaul Midhaul Backhaul

UEs O-RU O-DU O-CU

5G RAN / gNB 5G Core / EPC

UeSIM CuSIM CoreSIM

DuSIM
LoadRAN

O-RAN Radio Unit Conformance Testing 9

 Edge to Core Solutions Overview

RuSIM Open RAN RICtest LoadCore

Studio

RIC

RF O-RAN O-RAN
Fronthaul Midhaul Backhaul

UEs O-RU O-DU O-CU

5G RAN / gNB 5G Core / EPC

UeSIM CuSIM CoreSIM

DuSIM
LoadRAN

O-RAN Radio Unit Conformance Testing 10

5G Radio Unit (O-RU) Architecture
Ethernet ORAN – L1 Digital Front End RF
5G Radio Unit Data Analog
Analog up/down Front end
Lower layer split converters beamforming
Antenna
PA

Downlink carriers DL IQ Up
Buffers DAC Filter
Conv.
Filter
Duplexer

decompression

IFFT and CP
beamforming
Precoding
LO

addition
UL IQ

Digital
U-Plane ADC LNA

IQ
Buffers
Down
Filter Filter
Conv.

100 Gbps ethernet

ORAN Ctrl Ctrl Ctrl Ctrl

data data data data Number of
Rx PCS Rx MAC L2 Rx channels
100 G 100 G Bridge C-Plane Analog Number of
Transceiver
beamforming elements
ssss
wrapper
Tx PCS
100 G
Tx MAC T2 Rx
C-Plane
control logic
100 G Bridge
Ctrl Ctrl Ctrl
TSN Logic data data data

Uplink Carriers Filter

Up
Filter
DL IQ Conv.
Buffers DAC

decompression
M_plane

IFFT and CP
beamforming
U-plane LO

addition
Antenna

Digital
PA

IQ
UL IQ
Buffers
ADC Down
Filter Filter
Conv.
Duplexer

LNA
S-plane

Digital Analog/ RF

Ethernet eCPRI IQ Data

O-RAN Radio Unit Conformance Testing 11
Functional Splits

O-RAN Radio Unit Conformance Testing 12

Functional Splits
4G-LTE O-RAN
DATA RRC
Layer 3
Radio Functional Split
O-CU …
PDCP Scrambling
Option 2
F1 Modulation
RLC-H Layer Mapping
O-DU
Precoding
Layer 2

RLC-L
BBU RE Mapping
MAC-H O-DU IQ Compression
O-RAN FH
MAC-L
IQ Decompression
PHY-H Precoding
Option 7
O-RAN FH
Layer 1

Digital Beamforming
PHY-L
O-RU
iFFT & CP Addition
Option 8
CPRI O-RU Digital to Analog
RF RRH Analog Beamforming
O-RAN Radio Unit Conformance Testing 13
O-RAN Model
gNB UE
DATA RRC DATA RRC
Layer 3

O-CU
PDCP PDCP
Option 2
F1
RLC-H RLC-H
Layer 2

RLC-L RLC-L

MAC-H O-DU MAC-H

MAC-L MAC-L

PHY-H PHY-H
Option 7
Layer 1

PHY-L PHY-L
O-RAN FH
O-RU
U, C, S, M plane
RF RF RF
O-RAN Radio Unit Conformance Testing 14
O-RAN Fronthaul Architecture
FUNCTIONAL SUMMARY

M-Plane: Management Plane

Static configuration of O-RU C-Plane: Control Plane

and O-DU
Dynamic and real-time
control of the O-RU

M
C
U O-RAN Fronthaul F1
O-RU (v)O-DU (v)O-CU
S

U-Plane: User plane S-Plane: Synchronization Plane

Real-time payload Synchronization between the O-

data DU and O-RU

O-RAN Radio Unit Conformance Testing 15

Conformance Tests

O-RAN Radio Unit Conformance Testing 16

O-RAN Alliance – Testing, Certification and Badging
Source: O-RAN Alliance

Prerequisite
Conformance Test Interoperability Test End-To-End Test
(e.g. 3GPP Conformance Field Test
(O-RAN Alliance) (O-RAN Alliance) (O-RAN Alliance & 3GPP)
for RU or others)

Certification Badging
(OTIC) (OTIC) Planning & Development

TIFG Certification & Badging TIFG Certification & Badging

OTIC Services
1.0 (Mar 2021) 2.0 Candidates
Operations
WG4 Conformance Test 2.0 (Published) WG4 Conformance Test 3.0 (Mar 2021)
Certification • O-RU • O-RU

WG4 Interoperability Test 3.0 (Published) WG4 Interoperability Test 4.0 (Mar 2021)
• OFH between O-DU/O-RU • OFH between O-DU/O-RU
Badging (IOT)
WG5 Interoperability Test 1.0 (Published) WG5 Interoperability Test 2.0 (Mar 2021)
• X2 between eNB and en-gNB • F1 (NSA) and Xn (SA)

TIFG E2E System Test 1.0 (Mar 2021) TIFG E2E System Test 2.0 (Candidates)
• 3GPP RAN functional, performance • Timing & Synchronization
Badging (E2E) • 3GPP Services (Voice) • O&M
• Security • Enhancements to 1.0 test cases

17
O-RAN Radio Unit Conformance Testing
3GPP Conformance vs O-RAN Conformance vs IOT

Test DUT Purpose

3GPP Conformance DUT 3GPP

Run RF performance tests to guarantee
Base Station gNB as a
that DUT is compliant with 3GPP
gNB Conformance whole
standard
Tests
O-CU
O-RU in
O-RAN IOT DUT O-RAN WG4
isolation Run functional tests to guarantee that
Fronthaul
DUTs are compliant with O-RAN WG4
Conformance
O-DU in FH standard
Tests
O-DU O-RU isolation

Run end-to-end functional tests to

O-RAN Conf. DUT
O-RAN
O-RAN Conf. DUT O-RU + guarantee that the DUT can act as a
Interoperability
O-DU single entity according to O-RAN WG4
(IOT) tests
FH standard

O-RAN Radio Unit Conformance Testing 18

O-RAN Conformance Test Specification- [Link].0-v04.00
Specification Structure
Test Bench & methodology
Conducted OTA
Chapters
FR1 FR1 FR2
M_plane Section 3.1
Section 3.1

Section 3.2.3.x Section 3.2.4.x

Base
FDD
Chapters

Beamforming Section [Link] Section [Link]

CU_plane
Section 3.2 Section 3.2.5.x Section 3.2.6.x
Base Section 3.2.6.x
TDD
Beamforming Section [Link] Section [Link] Section [Link]

S_plane
Section 3.3
Section 3.3

O-RAN Radio Unit Conformance Testing 19

O-RAN Conformance vs Interoperability
O-DU 1 O-DU 2 O-DU 3

Conformance Conformance Conformance

IOT IOT IOT IOT

O-RAN WG4
Profile Profile Profile Profile
CUS Spec
1 2 3 4

Conformance Conformance

O-RU 1 O-RU 2

“Interoperability is a blind and random test of a subset of the spec”

O-RAN Radio Unit Conformance Testing 20
Test Flow

O-RAN Radio Unit Conformance Testing 21

O-RAN Conformance Test Spec
UC-PLANE

• Philosophy: Declared O-RU features must be tested for compliance

• Mandatory Tests
• Conditional Mandatory Tests
• Optional
• Mostly functional tests and some performance tests (S-plane)
• Positive and Negative tests
• Pass/fail criteria based on a mix of:
• RF measurement = EVM and power measurements
• Protocol messaging = Header fields checking
• Payload integrity

O-RAN Radio Unit Conformance Testing 22

 O-RAN Conformance Test Spec – M-Plane
M-PLANE Number of Test
Chapters Pass/Fail
Cases
• Tests basic operations such as: 3.1
Protocol Status Reporting on success or
Connection establishment 3.1.1 Transport and handshake test scenarios 4 Test Cases failure
Stuck on Call Home procedures
Reporting:
3.1.2 Manage Alarm Requests 1 Test Case NETCONF client subscribes to server
Notifications successfully
Subscriptions
Protocol Status Reporting on success or
3.1.3 M-Plane connection supervision 2 Test Cases
failure

M-Plane conformance Test

O-RU querying 3.1.4 Retrieval of O-RU's information elements 2 Test Cases Report of valid information
Reporting of no sync source and list of
3.1.5 Fault Management 2 Test Cases
alarms
3.1.6 O-RU SW update 2 Test Cases Install or not SW update
SW management Reporting of SW update state and
3.1.7 O-RU SW activation 2 Test Cases
activation
3.1.8 Access Control 6 Test Cases Reporting of access granted or denied

Reporting of failure for shorted input

3.1.9 External Input / Output Ports 2 Test Cases lines and correct voltage measurement
of output lines

Reporting of successful or rejection of

O-RU configuration 3.1.10 O-RU configurability 2 Test Cases
configuration

3.1.11 ALD communication test 1 Test Case …

• Only functional tests 3.1.12

Log management 1 Test Case …
3.1.13
Connectivity Check 2 Test Cases …
• Positive and Negative tests
• Pass/fail criteria based on NetConf Server = DUT = O-RU to report success or fail operation
[Link].0-v04.00
O-RAN Radio Unit Conformance Testing 23
 O-RAN Conformance Test Spec – UC Plane
UC-PLANE Chapters
Number of Test
Pass/Fail
Cases
• The tests are built to exercise: 3.2
3.2.3
Section Type 1 and extension Type=6 with emphasis of UC-Plane O-DU Scenario Class NR testing
[Link] 13 Test Cases EVM
specific fields such as rb, reMask, SymIn, etc. Generic (NRG)
Payload match

Beamforming with Section Types 1, 5, 6 and exTypes 1 UC-Plane O-DU Scenario Class Beamforming
[Link] 10 Test Cases
and 2 (BFM) EVM

UC-Plane Measurements, DUT = O-RU

Payload match
Weights match
Power Check

UC-Plane Conformance Test

UC-Plane O-RU Scenario Class Compression EVM
[Link] (CMP)
14 Test Cases
Payload match
Compression with Section Types 1 and exTypes 4 and 5 FR1 FDD Conducted Header check
Tests
Timing within reception windows [Link]
UC-Plane O-RU Scenario Class Delay
4 Test Cases Payload match
Management (DLM)
U-plane reporting
UC-Plane O-RU Scenario Class Transport
[Link] (TRN) TBD
RF data detection
[Link] UC-Plane O-RU Scenario Class LAA (LAA) 1 Test Case
LBT check
EVM
Specific test for LTE with Section Type 1 and exType 3 [Link] UC-Plane O-RU Scenario Class LTE (LTE) 6 Test Cases Payload match
Weights match

PRACH with Section Type 3 UC-Plane O-RU Scenario Testing Section

[Link] Type 3 (ST3)
2 Test Cases Probability of
detection
FR1 FDD Non-
3.2.4
conducted (OTA) Tests Same number of Tests as for FR1 FDD Conducted
FR1 TDD Conducted
3.2.3
Tests Same number of Tests as for FR1 FDD Conducted
FR1 and FR2 TDD Non-
3.2.4
conducted (OTA) Tests Same number of Tests as for FR1 FDD Conducted
O-RAN Radio Unit Conformance Testing 24
[Link].0-v04.00
 O-RAN Conformance Test Spec
UC-PLANE - [Link].1 TEST

UC-Plane O-RU Scenario Class Extended 3GPP DL -

- Resource allocation:
• Purpose: Meet basic downlink requirements for O-RAN
fronthaul.
• Payload: 3GPP TM1.1 test waveform with “PN23”
• The O-DU emulator converts the test waveform into O-RAN
compliant C-plane and U-plane messages to signal and
transfer the user data to the DUT O-RU.
• The DUT O-RU receives the test waveform, reconstructs it and
transmits it over the antenna port.
• The Signal Analyzer captures the test waveform coming from
the DUT O-RU.
• The Signal Analyzer demodulates and decodes the payload.
• Pass criteria: Downlink
• Measured EVM below 3GPP threshold.
• Decoded Payload matches original payload.

O-RAN Radio Unit Conformance Testing 25

Test Set-up

O-RAN Radio Unit Conformance Testing 26

 Non-Beam Forming O-RAN Conformance Test Environment
DUT = O-RU

• Only one antenna port / one component carrier / one band is tested.

gNB
• Transceivers

S-plane tester

• Signal Analyzers

High-Phy based O-DU

Emulator CU S M L-PHY
PTP Yang
eCPRI
SyncE NetConf
RF
• Signal Sources
Ethernet MAC
eCPRI
ORAN WG4
Ethernet PHY O-RU

O-RAN Radio Unit Conformance Testing 27

Beam Forming O-RAN Conformance Test Environment
DUT = O-RU – conducted measurement

• 1:1 Port
Radio Unit Analog
Lower Layer Split DFE Up/Down Data Converters
Front End
• N:M Switch • Signal
O-DU
Matrix Analyzers
Emulator
with 89600
• Channel VSA
Emulator
• Signal
RF Sources
O-RAN

Digital Analog/ RF

Channel Model

O-RAN Data injection / Extraction RF Signal Source

Protocol Traffic Generator / Analyzer Synchronization/Triggering RF Vector Signal Analyzer

O-RAN Radio Unit Conformance Testing

28
Beam Forming O-RAN Conformance Test Environment
DUT = O-RU – over the air measurements

Radio Unit Analog

Lower Layer Split DFE Up/Down Data Converters
Front End • Signal
O-DU Antenna

Over
PA
Analyzers
Emulator Duplexer

L
N
A
The with 89600
Air VSA
Antenna

• Signal
Sources
O-RAN Antenna

Antenna

PA

Duplexer

L
N
A

Digital Analog/ RF

O-RAN Data injection / Extraction RF Signal Source

Protocol Traffic Generator / Analyzer Synchronization/Triggering RF Vector Signal Analyzer

O-RAN Radio Unit Conformance Testing 29

3GPP Test Environment
DUT = Base Station

gNB
O-CU (Central Unit)
PDCP

RLC

MAC 3GPP Conformance

Solutions
H-PHY

CU S M CU S M L-PHY
PTP Yang PTP Yang
eCPRI eCPRI RF
O-DU SyncE NetConf SyncE NetConf

Ethernet MAC Ethernet MAC

eCPRI
ORAN WG4
Ethernet PHY Ethernet PHY O-RU

O-RAN Radio Unit Conformance Testing 30

Keysight Solutions

O-RAN Radio Unit Conformance Testing 31

Keysight O-RAN Solutions Accelerate 5G RAN Workflow
Workflow solutions with common measurement science, protocol stack, automation, and logging

Development Conformance Manufacturing Deployment

R&D /Validation System Automated Test System

• Full O-RAN Feature Set • PathWave Test Automation
• RF / Protocol Cross Domain • Optimized Feature Set
• Signal Studio/O-RAN Builder/Player • Downlink Test - Player
• Capture/Extractor/VSA/BLER • Uplink Test - Capture/Extractor/BLER
• Uplink/Downlink Test • Predefined Files

Reuse Setup files

& Test vectors

O-RAN Radio Unit Conformance Testing 32

Keysight Open RAN Studio Solution
O-DU Emulation platform for O-RU (Radio Unit) testing

5G
O-RAN Fronthaul O-RU
Open RAN Studio
O-DU Emulation

Comprehensive : O-RAN Stimulus and Analysis portfolio for uplink/downlink test​

Compliant : O-RAN Standard CUS_plane ([Link])
Configurable : Maximize and optimize O-RAN test coverage
Cross Domain : for complete Radio RF / Protocol / Timing testing
Integrated : with RF / mmWave instrumentation and applications

O-RAN Radio Unit Conformance Testing 33

Open RAN Studio O-DU Emulation Platform
S5040A - Open RAN Studio Player and Capture Appliance
Pulse Per Triggers and Pulse
Clock
Second Output Per Second Input
Input
• O-DU functional emulation
• Parametric timing control
• Real-time generation/analysis
• Enable clock and time alignment Fiber Optic
between DUT and test system connections to O-RU
QSFP28 Ports QSFP28 Ports
• API for test automation 10/25 Gbps 10/25 Gbps

O-RAN Radio Unit Conformance Testing 34

 Keysight Open RAN Studio Solution
O-DU Emulation Platform for O-RU Testing
89600 VSA
Software
PathWave Signal for 5G NR/LTE
Generation Modulation Analysis
for 5G NR/LTE Measurements
Create 3GPP compliant
FR1
Waveforms
Conducted
Radios
Open RAN Studio
Builder
Construct O-RAN
Open RAN Studio DUT
compliant CUS stimulus Player (O-RU)
Ethernet

Open RAN Studio Open RAN Studio

Explorer Capture
O-RAN/eCPRI
Protocols Decode FR1 & FR2
OTA
IQ Extractor (optional)
Radios
89600 VSA
for 5G NR/LTE
Modulation Analysis S5040A
Measurements Open RAN Studio Player
and Capture Appliance
O-RAN Radio Unit Conformance Testing 35
Downlink Test Flow for Transmitter Test

89600 VSA Software

for 5G NR
PathWave Signal Open RAN Studio Open RAN Studio Downlink Signal Analysis
Generation for 5G NR Builder Player
Create 3GPP compliant Construct O-RAN 5G NR Modulation
5G NR Downlink compliant CUS stimulus Measurements
Waveforms

RF
DUT
Ethernet (O-RU)

Frequency O-RAN O-RAN Ethernet

Domain IQ CUS_plane Frames (U and Signal Analyzer
and set up Stimulus C Plane)
data File

S5040A
Open RAN Studio Player Triggers and Clock
and Capture Appliance

O-RAN Radio Unit Conformance Testing 36

 Uplink Test Flow for Receiver Test

5G uplink Waveform file

PathWave Signal (time domain)
Generation for 5G NR
Create 3GPP compliant
5G NR Uplink
Waveforms
Open RAN Studio Open RAN Studio
5G uplink
Builder/Capture Player/Recorder Waveform
Build C_plane messages Play C_plane messages
(time domain)
Explore U_plane messages Record U_plane messages

C_plane

Ethernet
DUT
(O-RU) RF
U_plane Signal
Source
IQ Extractor
89600 VSA
for 5G NR S5040A
5G NR Uplink Open RAN Studio Player
Signal Analysis and Capture Appliance Triggers and Clock

O-RAN Radio Unit Conformance Testing 37

5R NR Signal Generation
N7631APPC/N7631EMBC/N7631ORNC PathWave Signal Generation 2023

• Waveform generation in line with 3GPP Rel 15, Rel 16 and Rel 17
• Uplink (UL), Downlink (DL) and PRACH carrier types
• Export meta data for O-RAN radio unit (O-RU) physical layer
testing
• Carrier aggregation with up to 48 component carriers
• Up to 8x8 SU-MIMO for DL and 4x4 for UL
• Full transport layer channel coding for receiver testing
• LTE-NR coexistence waveform generation for DSS testing
• Configuration wizard for Test Models, FRC Channels, PUCCH
and PRACH Test Preambles per 3GPP’s RF conformance test
• User friendly graphical display for frame resource allocation
• Programming .NET API & SCPI for automating the signal
generation
• Exports VSA setup file (.setx)

• O-RAN Radio Unit Conformance Testing 38

5G NR Modulation Analysis
89601BHNC PathWave Vector Signal Analysis (89600 VSA)

• Measurements in line with 3GPP Rel 15, Rel 16 and Rel 17

• Uplink (UL) and downlink (DL) measurements for FR1 and FR2
• O-RAN radio unit (O-RU) physical layer testing
• Carrier aggregation with up to 32 component carriers
• Up to 8x8 SU-MIMO for DL and 4x4 for UL
• Up to 64 channels Massive MIMO/beamforming
• Transport layer decoding with CRC pass/fail results
• LTE-NR coexistence testing
• In-depth analysis and troubleshooting tools with best
visualization
• ACP and SEM measurements per 3GPP’s RF conformance test
• Connects to > 400 hardware and software platforms
• Programming .NET API & SCPI for automation

O-RAN Radio Unit Conformance Testing 39

89600 VSA 5G NR Example
Measure EVM, Tx Power, 3D Beam Pattern Confirm the transmitted
Freq Error etc.. resource allocations are correct

Validate beamforming by
For MIMO, validate Power, EVM measuring Beam Weights
3D Power: power vs.
TAE, Freq and Phase offset
symbol vs. subcarrier
between antenna ports

Confirm the transmitted

packet has no error
Confirm the decoded (CRC Pass)
payload matches the
original payload
40
O-RAN Radio Unit Conformance Testing
O-RAN Radio Unit Conformance Test Automation

Signal Analyzer
O-DU Emulator
Signal Generator

OpenRAN Studio API M-plane Instrument Drivers Test Vectors Creation Measurement Control / Data

Keysight Test Automation platform

TC’s Development Campaign Manager Remote Desktop - TaaS Results Analysis

O-RAN Radio Unit Conformance Testing 41

Q&A

42
O-RAN Radio Unit Conformance Testing