⬇ Download Markdown · ⬇ Download LaTeX · ⬇ original · view original

Published Online November 2010 in MECS (http://www.mecs-press.org/)
Chao Yang The Key Lab, the Academy of Equipment Command & Technology, Beijing 101416, P.R. China
Lingda Wu The Key Lab, the Academy of Equipment Command & Technology, Beijing 101416, P.R. China Key Lab of C4ISR Technology, National University of Defense Technology, Changsha 410073, Hunan, P. R. China Abstract—Volume rendering is an important and effect algorithm to represent 3D volumetric data and 3D visualization on electromagnetic environment (EME) is one of the most important research fields in 3D battlespace. This paper presents a novel framework on visualizing the 3D EME by direct volume rendering on virtual globe. 3D power volumetric data is calculated based on the Longley-Rice radio propagation model (Irregular Terrain Model, ITM), which takes into account the effects of irregular terrain and atmosphere, and we use GPU-accelerated method to compute the EME volumetric data. The EME data are rendered using direct volume rendering method on virtual globe by assigning different color and opacity depending on user’s interactive input with color picker. We also propose an interactive method to show detailed information of EME at given place. This approach provides excellent decision supporting and plan-aiding for users.
Index Terms—volume rendering, electromagnetic environment, virtual globe, irregular terrain model
Electromagnetic environment (EME) is composed of natural and man-made electromagnetic radiation and this paper focuses on 3D visualization of man-made electromagnetic environment. EME is complicated and invisible, and it is difficult for users to decide how to plan and design the wireless systems because of a large number of wireless systems designed to serve a variety of commercial and military uses. Computer graphics can represent the numeric data vividly, through which users can intuitively understand the information that the numeric data implicates.
As EME is invisible, we represent it on the terrain by computer visualization and users can adjust parameters of electromagnetic devices to see their influence dynamically in time, so this approach provides excellent decision supporting and plan-aiding for users. But it is extremely difficult to represent 3D EME efficiently and accurately on terrain. In order to visualize the EME, we need to compute EME data using radio propagation model[1][2]. Although finite difference time domain(FDTD) algorithm can accurately describe the propagation of Manuscript received ; revised ; accepted Corresponding author: Chao Yang +8613786149482
Copyright © 2010 MECS .
electromagnetic wave, it fails to meet our needs of interactively and dynamically visualizing the EME in virtual battle space because of its time-consuming calculation. Longley-Rice radio propagation model(Irregular Terrain Model, ITM)[3] is a computerized method that could take into account the detailed terrain and atmosphere features. The model is based on electromagnetic theory and statistical analyses of both terrain features and radio measurements, and predicts the median attenuation of a radio signal as a function of distance. Because of the availability of digital terrain models (DTM) we can use the point-to-point prediction mode of the model to compute propagation losses due to terrain irregularity. This mode can predict the radio propagation in time, and it is suitable to visualize the EME on irregular terrain.
In our former works[4],[5], we implemented 3D representation of radar detection range on terrain based on isosurface rendering method, which only shows the outer boundary but fails to capture most of the volumetric information. Multiple transparent isosurface rendering[6],[7] overcomes the single isosurface’s drawback by adding more information to rendered images. But it fails to clip the volumetric data and visualize the sectional information. Direct volume rendering (DVR) can overcome these drawbacks. DVR via 3D textures has positioned itself as an efficient tool for the display and visual analysis of volumetric data[8]. Thanks to the advances in graphics hardware performance and functionality, DVR using graphical processing units(GPU)[9] allows producing high quality rendering on current graphics hardware at interactive frame rates. GPU-based DVR which projects 3D volumetric data onto 2D image using front-to-back compositing is an important and popular technique used for volumetric data exploration. And it can show the inner detailed information of the volumetric data. So inheriting from[9], we extend GPU-based DVR method to visualize the 3D EME on virtual globe, and propose an interactive method to show detailed information of EME at given place.
The paper is organized as follows: Section II is described the background of GPU-based DVR and general purpose computation on GPU; in section III, the I.J. Image, Graphics and Signal Processing, 2010, 1, 53-60 54 GPU-Based Volume Rendering for 3D Electromagnetic Environment on Virtual Globe framework of the GPU-based volume rendering system is proposed, and in section IV and section V, we will describe the GPU-based computation of 3D EME and extend GPU-based DVR on virtual globe in detail; The experiment results and conclusions are shown in section VI and section VII respectively.
Volume visualization is one of the important research fields in computer graphics. The recently works of GPU-based volume rendering is summarized in the book [10]. Here we only discuss the ray casting approach we relate to. Because of commodity graphics hardware fully programmable, traditional direct volume ray-casting rendering approach can completely transfer from CPU to programmable GPU, which can take advantage of parallel fragment units and high bandwidth to video memory. And GPU-based ray-casting can produce high quality 2D images on current graphics hardware at interactive frame rates. Now it is widely used in scientific visualization.
GPU-based ray-casting approach projects 3D volumetric data to 2D image along projecting direction. The rendering proxy mesh is a volume bounding box and its vertex color is assigned the 3D texture coordinates. And it is a multi-pass approach[8],[9] to render the volumetric data. The first pass renders back faces of the volume bounding box to a 2D RGB texture by the performance of Frame Buffer Object(FBO)[11]. So the color components in the texture correspond to the termination point between the projecting rays of sight and volume. The second pass renders front faces of the volume bounding box. In this pass, the main ray-casting fragment shader is executed. In vertex shader, the vertex position is transformed to eye coordinates space and passed to fragment shader. In fragment shader, the termination point is fetched for each fragment from back faces texture by the transformed vertex position. So the projecting ray direction can be computed as fragment color minus termination point. And then the shader samples 3D texture of the volumetric data from front to back along the ray direction and assigns color to each sampler by the transfer function. At last it composes each sampler color along this ray direction as the final fragment color. The last pass is blended the 2D volume image to the scene. There are many methods to speed up the GPU-based ray-casting, such as octree[12], early ray termination[13] , empty-space skipping[8], and so on.
There are also many literatures on studying general purpose computation and visualization on GPU[17][18], such as cloud rendering[15] and fluid simulation[16]. Current GPU has high data bandwidth and high dense parallel computation, and it can render the pixel color to 3D texture, which can be used to calculate and output the 3D volumetric data directly. Therefore it enhances the application of the GPU in 3D volumetric data computation. Crane et al [19]proposed a real-time physically based simulation and rendering of 3D fluids. They showed not only how 3D fluids can be simulated and rendered in real time, but also how they can be seamlessly integrated into real-time applications. So inspired from [19], we use GPU Copyright © 2010 MECS to accelerate the 3D EME volumetric data computation, and output the volumetric data using 3D texture.
This paper aims at exploiting graphics processing units (GPUs) for interactive volume rendering of 3D EME on virtual globe. The framework of the computation and rendering system is shown in Fig. 1. The steps in the dash box are run on GPU. The system consists of two major parts: GPU-based 3D EME calculation and direct volume rendering. Our system takes full advantage of the performance of current GPU.
The 3D EME computation is based on Longley-Rice radio propagation model(ITM). Using ITM, we can get power density of radio radiation at 3D space, while taking into account the effects of atmosphere and terrain. By calculating and summing the power density of every radio radiation within a certain frequency bands, the 3D EME volumetric data is constructed. All of these calculations are performed via a fragment shader. And the calculation result is stored in a 3D floating-point texture. We use the Ping-Pong technology [20] and bind different 3D textures to feed back the EME power density. To facilitate the use of GPU computing on 3D virtual globe, the 3D EME volumetric data is divided along the direction of latitude, longitude and height. Therefore, the resulting 3D floating-point texture uses spherical coordinate system for its voxels. The detail of GPU-based computation of 3D EME is described in section IV.
Radio device parameters Terrain height data texture ITM parameters 3D Space Position GPU Computation
Radar detection probability
computation kernel Pre 3D texture of EME data Σ Current 3D texture
of EME data GPU DVR EME volumetric data
bounding box Back face position texture - Projecting Ray Front face position
Map Color Blend Color Final Image Fig. 1. System architecture I.J. Image, Graphics and Signal Processing, 2010, 1, 53-60 GPU-Based Volume Rendering for 3D Electromagnetic Environment on Virtual Globe We use GPU-based DVR algorithm to render the 3D EME on virtual globe (detail in section V). Our DVR algorithm is similar to [9]. But the voxel position of the resulting 3D floating-point texture uses spherical coordinate system, and it is not regular. So the GPU-based ray-casting regular volume rendering approach can not be used to directly visualize the 3D EME volumetric data. We first transform the 3D EME volumetric data bounding box position to Cartesian coordinate, and then generate the projecting ray in Cartesian coordinate to sample the 3D EME power density data from the 3D texture. At the end, the map color is blended along the projecting ray to composite the final image. Through the coordinate transformation, the 3D EME volumetric data is directly rendered on virtual globe.
Because of using the GPU to accelerate, we can dynamically see the coverage of the 3D EME power density by adjusting the radio device parameters.
EME
The ITM is used to calculate the 3D EME volumetric data. The purpose of the model is to estimate some of the characteristics of a received signal level for a radio link. This usually means cumulative distributions for what really appears to be a random phenomenon[14]. As described in an ESSA technical report[3], ITM model calculates path loss in three regions, called line-of-sight, diffraction, and scatter regions. And the reference attenuation A ref is determined as a function of the distance d from the piecewise formula:
⎧ max( 0 , A el + K 1 d
⎪ A + m d , s ⎪ es ⎩
(1)
Where the coefficients A el , K 1 , K 2 , A ed , m d , A es , m s , and the distance d ls , d x are calculated using the algorithms described in [14]. Free space propagation loss is:
In which, f is the frequency of radio. So the propagation loss is:
We use the radiated power density value of the radio to represent the EME. From (3), the radio radiated power density value in 3D space is:
In which, P t is the radio’s power, and L s is the other

losses, such as system loss, operation loss.
If there are N radio devices within the frequency bands, the EME power density is summation of these N radio devices:
Copyright © 2010 MECS (5)
55 Where, P i is the power density of ith radio radiating at a certain place.
The point-to-point prediction mode of ITM requires terrain elevation database to extract terrain elevation profiles. We use the digital terrain elevation data (DTED). As shown in the left of Fig. 2, the red lines are the path between transmitter and receiver, and the blue lines are the DTED terrain. In order to extract the profile of terrain, we sample DTED along the path using bilinear interpolation. An example of profile of terrain is shown in the right of Fig. 2.
We suppose that there is a radio link between every radio and any 3D space position. Using (5), we can calculate 3D space radio power density value. But the original 3D space radio power density value is a large scale data field, it can not be used to visualize on terrain directly. So as shown in the left of Fig. 3, we divide the 3D space radio power density value into grids as follows. First, 3D space is divided into n layers along altitude direction, and then for each layer we divide it into m×k grids along longitude and latitude direction and calculate the radio power density value of every node in the grids. After all layers are processed, we will get a discrete 3D power density volumetric data, which is composed of m× k×n samples, as shown in the right of Fig. 3. So if there are N radio devices calculated on the virtual globe, the total number of radio links is m×k×n×N.
As described above, the calculation of 3D EME power density value is independent at each grid of divided volume space, so it’s suitable for parallel computing on GPU. We implement the computation as a fragment shader, and write the result to a 3D texture. Because GPU is designed to render to 2D frame buffer, we must execute fragment shader for each slice of the 3D texture. To run the fragment shader on a particular slice, we render a single quad whose size equals to the length and width of 3D volume. By running all slices along height, we can get the entire volumetric data.
Before the GPU calculation, we must input radio parameters (Position, Power, Gain, Frequency, System loss), and terrain height data into GPU. The radio parameters are organized as uniform structure and terrain height data is packed into a 2D texture. The output EME data is stored in two 3D textures which are bound to FBO by Ping-Pong technology. We swap the two 3D textures for output and input target. The pre 3D texture stores the summation of 3D EME power density of all radio devices
GPU-Based Volume Rendering for 3D Electromagnetic Environment on Virtual Globe 56


I.J. Image, Graphics and Signal Processing, 2010, 1, 53-60 GPU-Based Volume Rendering for 3D Electromagnetic Environment on Virtual Globe The pseudo-fragment shader of our DVR algorithm is that: alt
alt 1 alt 0 θ R Figure 5. Section of volumetric data bounding box(wide lines), filled color
parts is the volumetric data vertexes. And then by the performance of floating point texture, the floating color value of volumetric data bounding box can be rendered to texture. So the fragment shader can fetch the floating Cartesian coordinates from this texture as projecting ray termination point.
Transformation
In our approach, each vertex’s color of volumetric data bounding box is its vertex’s Cartesian coordinates position. By rendering the back faces of bounding box to floating point texture as projecting ray termination point and rendering the front faces as projecting ray start point, the projecting ray direction is calculated in fragment shader using vector difference between projecting ray termination point and start point. Traveling along the projecting ray direction, fragment shader is able to fetch EME value from the volumetric texture which contains the volumetric data. But projecting ray is in Cartesian coordinates system, and it needs to transform to texture coordinates system to fetch value from texture. Because the volumetric texture’s bounding box is from position minLLA(lat 0 , lon 0 , alt 0 ) to position maxLLA(lat 1 , lon 1 , alt 1 ) in spherical coordinates system, the texture coordinates of this sampling point can be interpolated by spherical coordinates with texture’s bounding box.
Transformation of Cartesian coordinates to spherical coordinates is:
(8)
Interpolation of texture coordinates is:
⎧ α − lat 0 ⎪ u = lat 1 − lat 0 ⎪ ⎪ ⎪ β − lon 0 ⎨ v = lon 1 − lon 0 ⎪ ⎪ R − alt 0 ⎪ s = ⎪ ⎩ alt 1 − alt 0 (9)
The valid range of the volumetric texture coordinates u, v, s is from 0 to 1. So if the volumetric texture coordinates are beyond the valid range, empty-space skipping method can be used to speed up the volumetric data rendering.
Copyright © 2010 MECS 57
GetFromBackFacesTexture(fragmentposition); float3 vecRayDir = vecStart – vecTermin;
{
TransformTextureCoord(i, vecRayDir); //Clip volume data if(samplepos is in clip area)
continue; float EMEdensity = GetDensityfrom3Dtexture(samplepos);
fragColor.r gb * (1 - color.a);
color.a); } return fragcolor;
The 3D EME is represented using GPU-based volume ray-casting rendering approach. Although it shows the situation of EME composed of many wireless systems on 3D space, it fails to get the detail information of every single wireless system radiation from the volume rendering result, which is important for wireless systems design. The detail information widget is proposed to meet the needs. As shown in Fig. 6, the detail in formation widget is composed of selected arrows, information box and connected line. The origin of selected arrows represents 3D space position of querying detail information, and the arrows can be picked and moved along latitude, longitude, altit ude direction by mouse cur sor. The detail information of EME at the origin of selected arrows can be shown immediately in the information box which lists all wireless systems of EME. The wireless system can be selected in the information box marked by white rectangle, and it is connected to the origin of selected arrows by a white line which shows the distance between selected wireless system and information querying position. So with our novel detail information widget, the radiation of every wireless systems of EME is shown in detail at any position of virtual globe interactively.
I.J. Image, Graphics and Signal Processing, 2010, 1, 53-60 GPU-Based Volume Rendering for 3D Electromagnetic Environment on Virtual Globe 58
The prototyp e system is implemented using OpenGL and Cg in the Windows operation system. In our experiments, twenty radio devices are located on the virtual globe which has a latitude-longitude grid spacing of 30 arc-seconds terrain data. These radio devices’ parameters are shown in Table I. The polarization is horizontal. The parameters of ITM propagation model are that surface refractivity is 320 N-units, and dielectric constant and conductivity of ground is 15 and 0.005 S/m respectively. The experiments are run on an Intel Pentium Dual 1.8 GHz (2 GB) with a GeForce 8600 GT graphic card (256 MB).
Fig. 7 shows the volume visualization of EME on 3D globe. The volumetric data has a resolution of 256×256 ×64 with 32 bits/sample. If the volumetric data is larger, the volumetric data can be divided into several bricks with appropriate size. Each brick is rendered by our ray-casting approach, and then every bricks are blended from back to front. So our approach is suitable for visualizing large EME volumetric data on 3D globe.
TABLE I. P ARAMETERS OF RADIO DEVICES Device No
1 2

3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 Frequency
(MHz) 450 200 500 350 320 200 500 400 500 100 200 350 350 300 480 200 350 350 400 500 Copyright © 2010 MECS Pow er (kw) 2500 2500 3000 1500 2000 1500 1200 1200 2000 500 100 500 600 2500 500 1000 450 2500 1500 1200 Gain (dB) 20 15 18 25 22 26 17 26 21 15 21 18 26 18 30 21 32 18 20 29 Calculation(s) CPU GPU
From Table 2, we c an see that GPU based implemen tation improves the comput ing performance about 30 times than the CPU based . Our GPU based system is able to interac t in real-time. And the average rendering frame rate is 25fps w ith a widow size of 102 4× 7 68.
The EME is represented by interactively assigned d ifferent color and opacity with color picker(see b ottom of F ig. 7). T he EME coverage affected by irregular t errain is v ividly a nd dynamically visualized in time and the p aramete rs of radios can be adjusted interactively, which c an provi de excellent decision supporting and plan -aiding fo r u se rs. The top l eft of Fig. 7 is the result of closing one ra di o m arked by a white circle in the lower-right corner, a nd it’s clearly and in tuitively to see how much the coverage decreases. As shown in Fig. 8, the inner in formation of EME can be represented by clipping the volumetric data. The 3D EME v olumetric data is clipped in altitude, longitude, and latitude direction respectively. So the inner detail information can be seen, and our method can supply more information than isosurface rendering.
We have proposed an approach to extend the GPU-based DVR to represent EME on virtual globe at interactive frame-rates. The Longley-Rice radio propagation model(ITM), which takes into account the effects of irregular terrain and atmosphere, is used to
I.J. Image, Graphics and Signal Processing, 2010, 1, 53-60 GPU-Based Volume Rendering for 3D Electromagnetic Environment on Virtual Globe 59 [2]

I.J. Image, Graphics and Signal Processing, 2010, 1, 53-60 60 GPU-Based Volume Rendering for 3D Electromagnetic Environment on Virtual Globe
Copyright © 2010 MECS I.J. Image, Graphics and Signal Processing, 2010, 1, 53-60 Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.