Communications Systems DesignModeling and SimulationNetwork Systems EngineeringSoftware DevelopmentVisualization Tools

EMANE Real-Time Spectrum and Waterfall Viewer

Introduction

Network emulation and simulation frameworks are essential for designing, developing, and analyzing the creation of communications systems.  The differences between network emulation and simulation are described in the post  Network Emulation vs Simulation.

In general, graphical presentations are powerful instruments for the communication of research results. Graphical outputs produced using network emulation and simulation tools are essential to system development, testing, and customer demonstrations.

Here we present the creation of a custom viewer, eView, that supplements the EMANE network emulation framework to provide real-time graphical output as spectrum and waterfall views of EMANE network emulation over the air (OTA) activities and events.

Time-Frequency Analysis

The design of digital communications systems requires the performance and interpretation of time-frequency signal analysis. In practical communications applications, signals are non-stationary and their frequency-domain representation (their spectrum) changes over time.

To create and analyze communications systems, communications engineers utilize time-frequency techniques over pure frequency-domain techniques, which is a time-domain representations of a signal. Having an overview of all signals across a portion of the spectrum allows an engineer to quickly and easily determine whether there are any strong or weak signals at various frequencies.  Time-Frequency analysis is particularly important when working with adaptive frequency agile based communications and custom waveforms.

What communications engineers typically need to know:

  • What frequency components are present in my signal?
  • How do I increase the time or frequency resolution for inspection and analysis of my signal?
  • How can I sharpen the spectrum of a component or extract a particular mode?
  • How do I measure power in a time-frequency representation?
  • How do I visualize the time-frequency information of my signal?
  • How do I find intermittent interference within the frequency content of the signal of interest?
  • What is my signal’s spectral content, the power distribution as a function of frequency?
  • What is the time history of my signal?
  • How does the system respond in the presence of noise, interference, or jamming?

Time-frequency analysis by communications engineers is typically visualized using the standard display types described in the following paragraphs.

Spectrum Analyzer View

Typical communications systems design utilizes special test equipment for measuring time-frequency properties of a system. This will almost certainly include a standalone hardware or software based spectrum analyzer. A spectrum analyzer measures the magnitude of an input signal versus frequency within the full frequency range of the instrument. The primary use is to measure the power of the spectrum of known signals of interest, and unknown signals such as noise or jamming signals.

The input signal that a spectrum analyzer measures is electrical. A spectrum analyzer typically provides an FFT frequency representation of a real-time analog electrical signal. The frequency components for the signal and their magnitude are displayed, and the persistence (or sometimes the color) of the display indicates the time duration of each frequency component associated with the sweep rate of the spectrum analyzer.

Waterfall View

While a pure spectrum analysis provides a time-frequency display of a input signal, it does not capture the time history of this information for analysis. The historic view of the time-frequency relationship of a signal is typically captured and displayed using a waterfall view, often referred to as a waterfall plot with heat map, or density map.  Waterfall graphs is a data visualization technique, normally used for understanding how an initial value is affected by a series of intermediate positive or negative values. A heat map is a graphical representation of data where the individual values are represented as a matrix of colors. A waterfall view is a graphical representation of the signals across a frequency range, generally color-coded to indicate signal amplitude or strength, displayed over time.

Many real time spectrum analyzers are now commonly equipped with persistent displays as a waterfall display. This display method adds a measure of significance—usually based upon a color pattern corresponding to the amplitude at a single frequency over time—to signal energy as specific frequencies that occur over time.

In a waterfall view, frequency signals can be very narrow (representing only a few tens of Hz of spectrum), but it could easily cover a much larger frequency range when in a “zoomed out” state. Waterfall views typically use black and dark blue colors to indicate background noise, and bright white to represent a very strong signal.

EMANE Network Emulation

For real-time network emulation, we utilize the Extended Mobile Ad-hoc Network Emulator (EMANE) framework. EMANE is a next-generation framework for real-time modeling of mobile network systems. For discrete event network simulation, we utilize OPNET Modeler. The EMANE framework has a focus on real-time modeling of link and physical layer connectivity so that network protocol and application software can be experimentally subjected to the same conditions that are expected to occur in real-world mobile, wireless network systems. The EMANE architecture provides for Network Emulation Modules (NEMs) that can be associated with computer system (real or virtualized) network stacks as interfaces. The EMANE framework further provides an event-driven control bus and logging facilities.

EMANE provides emulation activity and results in the form of standard log files. Results may also be viewed by querying and displayed in text format by accessing the information stored in EMANE components as tables and values. EMANE graphical output is currently limited to a network node viewer showing one hop neighbors communications nodes along with GPS information (if available) for each test node.  While expensive network simulation packages such as OPNET contain 2D line graphs for test results, real-time spectrum and waterfall views do not currently exist using the EMANE framework nor the OPNET package.

No current network real-time emulation or discrete event network simulation framework or add-on provides support for time-frequency analysis in the form of real-time spectrum and waterfall plots.

EMANE Over the Air (OTA) Control Bus

To emulate the RF spectrum for emulated nodes, EMANE provides a control bus for over the air network traffic. The EMANE framework utilizes a control bus defaulting to IP multi-cast LAN (e.g. Gbps Ethernet) to act as the over the air (OTA) interface between the radio nodes. This logical OTA control bus is traditionally created using a Linux bridge, which is a named instance with an assigned IP address. All EMANE NEMs monitor and receive the OTA transmission from other nodes on this OTA network interface, but based on the the receive sensitivity of the node compared to the transmit signal level, path-loss, and antenna gains, the Physical (PHY) layer of the EMANE stack may drop the packet. The EMANE Physical Layer Model describes the propagations models, the receive power calculation and components, and the criteria for packet drops and receptions.

Network Simulation and Emulation Visualization Tools

While the EMANE and OPNET provide industry leading environments for network emulation or simulation, it if often necessary to create visualization tools to allow for understanding the results of the network simulation or emulation for design, development, and customer presentations. As a result of this need, we have developed various visualization tools to allow for visually analyzing the performance of network simulation and emulation as described as Network Visualizer and Embedded Visualizer.  While these tools demonstrate the historic need to develop custom visualization tools to support real-time embedded communications systems development, or network simulation/emulation, neither of these two custom tools support real-time spectrum and waterfall views within the EMANE network emulation framework.

Custom EMANE Viewer eView

To provide time-frequency visualization for the EMANE network emulation environment, we have created a visualization tool, eView, that combines a spectral plot along with a waterfall plot. eView monitors the real-time traffic on the EMANE OTA control bus, representing RF transmissions into the shared RF medium, decoding and displaying this content real-time spectrum/waterfall views.

eView Transmit Duration Display Persistence

The EMANE PHY header includes a transmit time and a transmit duration for each network packet.  An EMANE radio model will typically include a TimeStampControlMessage when sending a downstream message to the OTA network interface specifying the time that transmission begins.  Additional information in the EMANE PHY header provides transmit durations for each possible frequency segment of the transmit waveform.

eView utilizes this information from the PHY header for a network frame when displaying network packets read from the EMANE OTA network interface, and will:

  • begin the display of network packets received starting with the specified transmit start time, and
  • persist the display for the durations specified by the transmit durations for each transmit frequency segment.

eView Display Components

eView is composed of the following visual components as shown in the following figure:

  1. The current frequency of interest.
  2. A signal strength meter showing the average signal level for a marked frequency range.
  3. The RF spectrum view of detected frequencies and signal power levels.
  4. The waterfall view displaying the spectrum history.
  5. A display settings control panel.
  6. A bookmark panel indicating any user defined frequency bookmarks.

 

Figure 1: eView Detail View with Frequency Bookmark

eView Display Rate Controls

eView has controls for independently setting the spectral and waterfall view update rates as described in the following paragraphs.

Spectrum View Rate

eView supports data display refresh rates up to 200 frames per second (FPS) providing a data resolution of 5 milliseconds per waterfall view line (when the waterfall display rate is set to “Auto”).  Therefore, it is capable of capturing transmissions detected on the EMANE OTA control bus with up to 5 milliseconds of display resolution. When using the 200 FPS display rate, signals whose transmit durations are less than and equal to 5 ms will result in a single line in the waterfall view. The spectral plot display rate ranges from 200 FPS to 1 FPS specifying a spectrum view resolution from a range of 5 ms to 1 sec. The resolution associated with the spectrum view rate is shown on the display options panel upon selecting a spectrum display/sampling rate.

The spectrum view represents the sampling rate for the application. As OTA content is received, it is queued until a display update is required. At that moment, eView checks for all queued OTA frames whose transmit start and end times relative to the current wall clock indicate a transmission is active. For network frames for which the transmission is active relative to the system time, they are used to build the composite spectrum view using data reduction my maximum data value for each displayed frequency.

Waterfall View Rate

The waterfall view time span ranges from the “Auto” setting, to a time value range as 1 minute to 48 hours. The “Auto” setting will update the waterfall plot at the same rate as the display rate set for the spectral plot.  For example, when the spectrum view rates is set to 200 FPS, a single line of output to the waterfall view will represent 5 milliseconds of a transmit signal duration.  At the 200 FPS spectrum rate, for transmission durations in the EMANE simulation that are less than 5 ms in duration, the signal will be present in only one line of the waterfall view.  For the time based setting, the waterfall view will accumulate FFT data carried on EMANE PHY layer network packets over a time range using a maximum value reduction technique (maximum value decimation).

Frequency Band Marker

eView provides a user movable frequency range marker with a predefined bandwidth and center frequency as shown in Figure 1. The frequency marker (grey rectangle) is useful for indicating the marking the bandwidth of a particular signal, which indicates the frequency range for a particular RF modulation. The center frequency of the frequency band marker is the red vertical cursor. The marker can be positioned in the user interface by dragging the marker rectangle using the mouse. The current frequency indicator will display the frequency of the center of the marker corresponding to the red vertical cursor.  The width of the marker represents the two sidebands around the center frequency marking the bandwidth of the expected signal.

Other eView Display Controls

Display settings are modified using the Display Settings control panel.

In addition to the two timing controls previously described, eView also includes the following user modifiable and persistent display settings:

  • The Spectrum ⇔ Waterfall slider is used to modify the portion of the main display allocated to the spectrum and to the waterfall views.
  • The Peak “Detect” button will attach little circles to the spectra peaks of the RF spectrum view.
  • The Peak “Hold” buttons will display faintly the envelope of RF spectrum.
  • The Spectrum dB slider is used to modify the db Range of the spectrum view. This allows zooming in on a particular range of values.
  • The Lock button is used to lock the spectrum and waterfall sliders together.
  • The Waterfall dB slider is used to change the colors associated with different spectrum dB levels. This slider can be used to show black or blue colors for noise floor level signals, and white or red for strong level signals. This allows user control of the colors used for the waterfall to match the signal level characteristics of the
  • The Freq Zoom slider is used to zoom in on both the Spectrum and Waterfall views to see a particular frequency of interest. This value ranges from 1x (no zoom) up to 50x. Frequency zooming is relative to the center frequency of the spectrum view.
  • The Zoom “Reset”, “Center”, “Marker” buttons are respectively for:
    • R = resetting the RF spectrum view to its 100% default value.
    • C = centering the RF spectrum view around the original frequency.
    • M = centering the RF spectrum view around the user defined marker frequency.
  • The Color selector changes the color of the RF spectrum view.
  • The “Fill” button will fill/clear the space below the spectrum line with a color gradient.
  • Zooming and Panning Frequency and Signal Level.
  • Zooming in and out of the frequency scale can be performed using either the Frequency Zoom slider, or by click on the frequency scale and using the mouse scroll wheel to zoom in our out. The frequency scale can also be dragged horizontally by use of the mouse.

Signal Strength Indicator

A signal strength indicator is provided that indicates the average signal levels for all signals contained within the frequency marker selector as shown in Figure 1.

Bookmark Frequencies

User defined bookmarks are supporting allowing the user to annotate specified frequencies with labels which appear on the spectrum view as shown in Figure 1.

Signal Capture And Analysis

The majority of real-world signals—from complex modulated communications signals, to interference events, and to pulsed tactical signals—the signal energy can be sporadic, non recurring, or even random. With traditional spectrum analysis, these signals could be nearly impossible to “catch” in an analysis window and trigger on. Present and future communication modulations are increasing the challenge further with techniques, such as frequency hopping, spread spectrum, pulsed, and cognitive radio techniques. Additionally, in order to analyze the quality of these communications, the ability to rapidly process, store, and compare these signals over time is necessary.

eView provides a Start/Stop button to allow the user to start and stop signal acquisition from the EMANE OTA control bus. This allows the user to terminate the display when a particular event has occurred that needs to be captured and analyzed.  This feature prevents possible overwrites of the captured signal of interest with new content.  The user can then zoom in on a particular frequency of interest for captured signal analysis.

EMANE Common Header Processing

eView utilizes the field values from the EMANE common physical layer header to adjust the received OTA data stream signal power levels for displaying. This includes using the specified transmit center frequency, the transmit path loss, fixed transmit and receiver antenna gains, and transmit power consistent with the receiver processing performed by the EMANE framework.

The EMANE common physical layer header also includes the transmit time relative to the Linux standard epoch (Jan 1 1970), and the transmit duration in microseconds. eView uses this transmit timing information along with the real-time clock on the platform for rendering content to the spectrum and waterfall plots. The content of queue networked packets is rendered if the transmit time start specified is greater than or equal to the platform time and the transmit stop time is not exceeded. Queued network packets are discarded when the transmit stop time is exceeded by the platform time.

Customized Modulation Transmit Power Spectral Density (PSD) Output

Depending upon the custom or standard communications modulation (e.g. OFDM) and waveform used with a communications system, an RF communications system will have a modulation transmit power spectral density (PSD) frequency distribution, or curve, around a center frequency that spans a certain bandwidth.  For example, an amplitude modulated (AM) signal consists of a carrier with two sidebands that extend out from the main carrier. When using narrow-band FM, and FM signal consists of the carrier and the two sidebands spaced at the modulation frequency on either side of the carrier, similar to an AM signal, but the difference is that the lower sideband is out of phase by 180 degrees. OFDM, which has been adopted for wireless standards such as IEEE 802.11a, uses the sum of several sinusoids channel, and has a PSD curve similar to  the reference figure.

The PSD output for the modulation being modeled describes how power of a transmission signal or time series is distributed over a frequency range centered around the center frequency of the transmission. As shown in Figure 1, the PSD signal frequency distribution in the spectrum and waterfall views is for OFDM modulation with a 10 MHz bandwidth (5 MHz on each side of the center frequency).

EMANE specifies the characteristics of a transmission such as wall clock time of transmit, transmit power, transmit and receive antenna gains, and one or more frequency segments that make up a transmission. eView builds upon these EMANE transmit attributes by leveraging the functionality of a custom EMANE Physical Layer (PHY) shim, which adds higher fidelity to RF physical layer characteristics by including spectral power levels for the full frequency range of the modulation.  For OFDM modulation, this includes 1024 FFT data points for a 10 MHz signal bandwidth.

eView utilizes a custom EMANE shim that is part of the EMANE NEM stack that provides a bandwidth specific custom modulation PSD spectra power level distribution for a transmission that is broadcast along with the EMANE OTA network frame. This custom shim transparently adds and removes the custom PSD content below the EMANE PHY layer so that the EMANE emulation stack operates nominally without any knowledge of the customization and added content.  Custom modulation PSD  signatures can be used by making changes to this custom EMANE shim. By using the features of this custom EMANE PHY layer shim, spectral waveforms displayed have familiar patterns to what occurs with actual RF over the air transmissions.

Distributed Deployment

eView is typically executed on the same platform as the EMANE network emulation as time synchronization is required between them. Similar to the available EMANE environment modes, this is described as a centralized deployment. eView can also be used on a separate physical platform from the EMANE network emulation in a distributed deployment. Distributed deployment requires the use of the EMANE transport mechanism as described in the EMANE documentation, as well as ensuring that the two platforms are in time synchronization. High accuracy time synchronization between platforms is usually implemented using the Precision Time Protocol (PTPv2) to achieves clock accuracy in the sub-microsecond range. eView was developed to operate on various operating systems using the cross platform Qt application framework.

Conclusion

EMANE is an industry leading network emulation framework for real-time design and analysis of networking systems. The eView application supplements this open source framework by providing real-time graphical display and captures to help in the analysis of network emulation results. While eView currently supports real-time data collection directly from the EMANE over the air (OTA) control bus, it may also be driven (with some customization) with stream results from other applications which benefit from real-time spectrum and waterfall views.

eView extends EMANE’s capabilities to provide advanced features for visualization and analysis of RF spectrum data using a spectrogram in real-time.  eView supports viewing and inspection of the frequency spectrum during real-time network emulation of collected OTA data.

The eView waterfall view continuously displays signal strength history during EMANE network emulation of a user-selectable frequency range using a user defined intuitive color scale that is customized to the signal level range of the signals of interest.

Additional capabilities include:

  • narrowing the span of the frequency range to focus on a signal,
  • frequency bookmarks,
  • signal peak and hold display in the spectrum view,
  • frequency range marking, and
  • waterfall display export to an image file.