Radar Project
METR 5613-001
Thomas Jones
April 26, 2002
1. Introduction
This research attempts to utilize the Doppler-On-Wheels (DOW) mobile radars in a verification experiment against algorithm output from the WSR-88D radars (Wurman et al. 1996). The WSR-88D algorithm to be studied is the NSSL mesocyclone detection algorithm (MDA) (Stumpf et al. 1998). The MDA uses Doppler velocity data acquired by the WSR-88D radar and attempts to derive the location and attributes of storm-scale vortices from these data. Unfortunately, there has been no attempt to verify whether the vortex detections produced by the MDA are indeed real and accurate. An independent source of velocity data is required to accomplish this. The DOWs can provide this independent data source and make possible for the first time a study in the true ability of the MDA to detect mesocyclones and their attributes.
The MDA produces several mesocyclone detection attributes that can be analyzed. These include gate to gate velocity difference, rotational velocity difference, shear, and mesocyclone depth. However, the accuracy of these attributes is somewhat suspect. Several factors can cause false and misleading mesocyclone detections. First, the WSR-88D velocity dealiasing algorithm often incorrectly dealiases small regions of data causing the reported velocity vectors to be opposite in direction than to what they really are. This in turn can cause the MDA to detect a mesocyclone where there is not a true vortex. Even given accurate velocity data, the MDA often fails to account for storm motion and vertical association characteristics of a mesocyclone. This can lead to incorrect values for a mesocyclonesís attributes even if the detection location is correct. Using the DOW to collect comparable data may provide greater insight into the overall accuracy of MDA detection attributes and enhance the ability to compare those attributes to additional phenomena.
The MDA in its current, operational form only detects cyclonic vortices.
The rational for this is that cyclones are much more common in the Northern
Hemisphere than anticyclones, and that most anticyclonic detections would
be artifacts of true cyclonic detections (Fig. 1). However, the degree
to which this assumption is correct has never been tested using WSR-88D
data. The MDA can be "reversed" so as to operate in anticyclonic mode and
recent research suggests that the number of anticyclonic detections is
approximately equal to the number of cyclonic detections for the same event.
It is difficult to believe that all these anticyclonic detections are indeed
artifacts. Some must represent true anticyclonic circulations and it is
hoped that this work can provide a rough estimate of the percentage of
anticyclonic detections that are indeed real not just artifacts. (Detections
which were caused by faulty dealiasing or other radar problems were discounted
prior to proceeding with that analysis). Then, if a significant percentage
do prove real, further analysis of their importance in severe weather could
then be studied.

2. Data Acquisition
In order to acquire DOW data that is comparable to WSR-88D data, DOW data was to be collected in modes that used similar range bins and unambiguous velocities as the WSR-88D. However, the DOW settings were set so that higher gate resolutions could be received to ensure that any features seen by the WSR-88D are also seen by the DOW. Due to the setting used by the DOW, the DOW had significantly greater resolution than the WSR-88D radar enabling the DOW to be positioned 10-20km away from the target area and still get the resolution required. Getting too near a rotating event with the DOW would not be useful for this research as the DOW would mostly sample the atmosphere below the lowest elevation scan of a WSR-88D. To account for the fact that the WSR-88D has a five to six minute interval between volume scans, the DOW sampled the storm events at a higher frequency (e.g. two minutes per volume scan) so that a near-time match between DOW data and WSR-88D data could be found. (Also, the clock on WSR-88D radars is not set to any specific standard and thus may be several minutes off the "true" time as well.) In all, approximately one hour of DOW data per event was analyzed in this initial survey.
In order to successfully accomplish the goals of this research, some rotating convection is required. Ideally, a rotating supercell thunderstorm would be used in this algorithm verification research. A supercell with a strong-long lasting mesocyclone would result in strong mesocyclone detections from the MDA and would be easily observable by a DOW. The location and attributes of the DOW velocity data could then be easily compared to the MDA output. An isolated supercell simplifies this comparison, but is not required for the success of this project. In fact, this research does not even require strong storm vortices to be successful. Any vortex that is observable by the WSR-88D and within ~200 km of a WSR-88D radar could then be observed by a DOW positioned at a much closer range. Ideally, only mesocyclone detections less than 100 km away from a particular WSR-88D should be used as the horizontal resolution of the WSR-88D beyond that range becomes quite poor. However, given the time constraints inherent in the project, this ideal situation was not used as a requirement. To be detected by the MDA a vortex must have a gate to gate velocity difference greater that 10 ms-1. Vortices this weak are common in many types convection such as squall lines and gust fronts. Since the threshold for detection by the MDA is so low, it is expected that any true circulations detected by the MDA should be observable with the DOW especially given the DOW dataís finer temporal and spatial resolution.
Using these techniques, the DOW was used to collect data for one event. This event occurred on 9 March 2002 between 3:00 and 5:15 Zulu time. The corresponding WSR-88D data used to run the MDA originated from the KTLX: Twin Lakes, OK radar1. Given the relative positions of the DOW and KTLX, the location requirements stated above were met by a significant margin. Further analysis of the event will be presented in the Results portion of this work. To supplement the data set collected above, an additional supercell case collected by DOW2 and DOW3 was also used during this analysis. This case occurred on 29-30 May 2001 and data between 22:00Z and 0:00Z was acquired. Since this case occurred with in the range of both the KAMA: Amarillo, TX and the KLBB: Lubbock, TX WSR-88D radars, data and algorithm output from both radars was initially analyzed. After a brief survey of the radar data available for this case, it was decided to use the KAMA data for algorithm output and DOW2 as the secondary source of radar data. Table 1 gives the settings used for DOW2 during the data collection process for both cases.

The analysis began by finding mesocyclone detections from the MDA that occurred during the time and within the range of the DOW. The location of each mesocyclone detection was determined using the known lat-lon position of those detections provided by the MDA. These positions are only given to a precision of one kilometer and the accuracy is somewhat worse due to radar geometry issues. Thus, small spatial errors in the MDA detections may exist and must be taken into account. For each volume scan of WSR-88D data, the MDA defines the begin time of that volume scan as the time of occurrence for each mesocyclone detected during that volume scan. Unfortunately, this combined with the lack of a standard clock for the WSR-88D can cause temporal errors of several minutes from when the detection actually occurred. After taking into account these issues, the MDA detections for each event were ingested into Arc-View where that could be displayed in a spatially representative way. Please note the detections displayed are the 3-D detections which are made up of several 2-D components. Once the initial correspondence between these detections and the DOW data has been made, further analysis was undertaken using the 2-D detection information.
To make the actual comparison between vortices detected by the DOW and those detected by the MDA algorithm, the location of the centroid of a DOW detected vortex at a certain time will first be determined by hand. This process used the known spatial position of the DOW and the observed range and azimuth information. This process was complicated by the fact that the DOW was not pointed in the due North direction during the data collection period of each event. Since the DOW data display software (Solo II) displays the data in a truck relative North position, the data display must be mentally rotated so that it corresponds to true North2. If a correlation between a certain mesocyclone detection and DOW velocity data could not be found, further analysis as to the characteristics of the WSR-88D velocity data were analyzed. Possible causes of this discrepancy may be due to faulty dealising of WSR-88D velocity data and/or ground clutter interference. Under certain types of atmospheric conditions, it is possible for the MDA to produce many false detections. Due to higher resolution of the DOW data, the DOW should be able to resolve any vorticy that the WSR-88D can see. Thus, the DOW data will be used as a baseline for determine whether the circulations detected by the MDA are indeed real. Assuming a correlation is made between a MDA detection and a DOW vortex, the determination of which elevation angles to analyze that best correspond with the WSR-88D data must be made. To accomplish this, a custom program was designed that can take the 2-D information from each mesocyclone detection and its estimated range from the DOW and determine the elevation scan from the DOW that best corresponds with the MDA 2-D information. This process is carried out for both cyclonic and anticyclonic detections. For the purpose of this research, a mesocyclone detection is independent of time. Thus, detections of the same circulation during different volume scans of WSR-88D data will results in multiple mesocyclone detections and they will be counted as such.
Once the spatial and temporal correlation between MDA mesocyclone detections and vortices observed by the DOW, the maximum velocity difference will be calculated from the DOW data and compared to similar values derived from the MDA. Given the finer resolution of the DOW data, these values should be greater than or equal to those observed by the WSR-88D. If they were not, a more in depth analysis of both the DOW and WSR-88D for that particular case was undertaken in hope of determining the answer. Again, these answers include faulty dealiasing of either the DOW or WSR-88D data, and the possibility that the raw data itself for that case is somehow defective. For each DOW observed case, these comparisons were made for several vortices observed by both radars over the time span of the recorded data set.
In addition to the raw attribute analysis, the significance of the MDA detected meso-anticyclones was analyzed. Given an anticyclonic detection, DOW data for that detectionís time and place was analyzed to see if the anticyclonic detection was a result of weak anticyclonic shear induced by a larger cyclonic circulation or a true anticyclonic circulation. Both results were anticipated and the ratio of artifacts to real anticyclones was to be derived. However, in several cases ambiguity may exist as to the nature of the circulation as shown by the DOW data. If the nature of the circulation could not be placed into one of the categories about without a high degree of certainty, the corresponding WSR-88D detection was not used in creating the ratio. From this analysis, the percentage of cyclonic vs. anticyclonic detections will be determined along with the percentage of those anticyclonic detections that prove to be independent anticyclonic circulations.
Hopefully, these comparisons will be able to provide some insights,
though not conclusive by any means, into the true abilities of the NSSL
algorithm to detect storm scale vortices and their attributes.
4. Results
a. 8 March, 2002 Case:
This case is characterized best as a weak to moderate squall line along a strong cold front. In addition, it was associated with a strong outflow boundary that propagated 10 to 20 km ahead of the convection. Since this was far from the ideal case discussed above, the results garnered from this case where not expected to provide the previously anticipated results.

While the DOW data does show small-scale vortices on the leading edge of the outflow boundary, they are small in scale (<1 km) and are not detectable over multiple scans. Since the WSR-88D data and is its associated algorithm output have a much coarser temporal and spatial resolution, and detection made by the algorithm under these circumstances cannot be verified. The MDA is not designed to handle outflow boundary situations, which is probably a large reason for its low performance in this case. Also, during several volume scans, significant velocity dealising errors occurred with the WSR-88D data. Since the MDA does cannot differentiate good velocity data from bad, several of the mesocyclone detections for this case appear to be a result of bad velocity data. Since the number of verifiable mesocyclone detections was so small for this case certain parameters such as the percentage of true anticyclonic vs. cyclonic detections were not calculated. Also, it appears that the sole "good" anticyclonic detection for this case which occurred at 4:35Z (88D time) is an artifact of a cyclonic circulation that was also detected (Figs. 3 and 4). One should notice that the cyclonic detection is associated with a strong (relatively speaking) gradient of incoming velocity while the anticyclonic detection is associated with a much broader gradient implying that there is no independent anticyclonic circulation. The exact nature of the circulation observed remains unclear. It does not appear to be a mesocyclone in the traditional sense as it is partially associated with the outflow boundary and only detectable at a few elevations. Also, this feature is not apparent a few minutes later suggesting it may have been a very quickly evolving event. Further statistics concerning the relationship between anticyclonic and cyclonic detections could not be made due to the small number of detections.

Figure 3. (above) WSR-88D 0.5° velocity
data from the KTLX radar at 4:35 Z with anticyclonic (right) and cyclonic
(left) MDA detections overlaid. Note that during this volume scan, several
anticyclonic and cyclonic detections were made most along the outflow boundary
(white). Also note the dealiasing error present to the SW leading to the
false detection of mesoanticyclone #488. The white dot represents the location
of the DOW during this time.

Figure 4. (left) DOW 1.7° velocity data
from 4:38Z which reveals some shear to the SW of the radar. This shear
or circulation appears to correspond with detections 453 and 563 respectively.
The black circle represents the cyclonic circulation identified by the
MDA as 563 while the anticyclonic shear on the opposite was detected as
453. Note that the gradient in velocity is much less on the anticyclonic
side leading to the conclusion that 453 is an artifact of a true cyclonic
circulation.
However, an attempt was made to verify the velocity difference attributes of the handful of mesocyclone detections that appear to be real given the DOW data. See table 2 for the numerical results. From this analysis, it appears that the MDA did an acceptable job at determining the velocity characteristics of the mesocyclones and mesoanticylones that were at least partially associated with convection. Unfortunately, this number only represents a very small percentage of the total number of both cyclonic and anticyclonic detections made during this event. For the rest, it appears from the DOW data that they are associated with small-scale vortices along the edge of the gust front. Most of these circulations have velocity differences that only marginally exceed the 10 ms-1 threshold used by the MDA indicating that the WSR-88D and the MDA would need to be quite sensitive in order to detect them. At first glance, the MDA appears to be detecting them. However, when the velocity attributes of the MDA detected mesocyclones are analyzed, they reveal circulations which have a maximum velocity difference of upwards of 50 ms-1. The velocity data from the DOW shows no such strong velocity signatures (Fig. 5). It is assumed that the nature of the outflow boundary causes difficulties in WSR-88D velocity dealiasing and decreases the noise to signal ratio leading to improper mesocyclone detections.

Figure 5. DOW 1.9° velocity from 4:47Z.
Highlighted in red is a region of cyclonic shear with a *V of no more than
20 ms-1. However, the MDA detected a cyclone (#649) with a *V
of over 50 ms-1. (See Table 2). Given the DOW velocity data
from this and adjacent scans, there is no evidence of such a strong circulation.
Thus, it appears that for this case the MDA grossly over estimated the
strength of what was a true area of cyclonic shear.

Due to the drought of rotating convection in OK during the month of
March, it was decided to pull a more ideal case from the DOW archives in
order to achieve more of the goals of this research. Thus, the supercell
case from May 29, 2001 was chosen. Several supercells occurred on this
day sponing several significant tornadoes. The storm the DOWs were observing
as located roughly in between Amarillo and Lubbock, TX. The DOWs observed
this storm for the better part of a day. This storm had with it a single,
strong mesocyclone that sustained itself for the duration of the stormís
life. Since there is only one true mesocyclone in which to analyze, this
case proved much simpler to decipher and produced much more significant
results. To simplify this research, only the observations from DOW2 between
22:12Z and 23:14Z were used in association with the KAMA WSR-88D data (Fig.
6).




While the DOW data sets and storm events were not ideal to what was proposed, significant and important results were still obtained from this experiment. Analyzing the 9 March 2002 case revealed that the MDA had some major problems in its ability to detect mesocyclones in the vicinity of an outflow boundary. The MDA was not designed to handle outflow situations and this fact shows itself when the MDA detects many anomalous circulations along the outflow boundary. Worse, many of these anomalous detections are classified as strong, which when compared to the DOW velocity data is obviously not true. While this was not the goal of this research, analyzing this case seemed to verify that MDA is not capable of effectively dealing with outflow boundary situations.
The 29 May 2001 case provided significantly different results. First as the MDA was designed around detecting a single mesocyclone associated with a supercell, the percentage of "real" detections was expected to be much higher. Fortunately, it was. For both cyclonic and anticyclonic detections, all MDA detections could be verified from DOW velocity data assuming the DOW was not too close to see the appropriate feature. However, the MDA did produce velocity attributes that were much smaller that the DOW observed values. Given the range of the KAMA WSR-88D from the storm (90 km) and the much closer range of the DOW (10km), this was not unexpected. Still, the degree to which the stronger velocity difference got averaged out of the WSR-88D data was somewhat unexpected. Unfortunately, there is no practical solution to correct for this under estimation since it is mainly a result of the 1° beam-width of the WSR-88D radar. A smaller beam-width would require a larger WSR-88D antenna which is just not practical or oversampling of the beam which is not possible with the current, operational WSR-88D hardware.
Another surprising result of this research is that nearly all of the anticyclonic detections seemed to be associated with some sort of independent anticyclonic circulation as seem by the DOW data. No cases of "artifact" induced mesocyclone detections could be shown though a few where questionable. While it would be a stretch to call the anticyclonic features seen by the DOW full-fledged mesoanticyclones, they do appear to be real and may warrant further study. Hopefully, this research was able to provide a small insight into the real-life performance of the MDA. Even given this small sample of data, it is obvious that the MDA has a long way to go before it can reliably detect (and not detect) important circulations.
6. References
Stumpf, G.J., A. Witt, E. D. Mitchell, P. L. Spencer, J. T. Johnson, M. D. Eilts, K. W. Thomas, and D. W. Burgess, 1998: The National Severe Storms Laboratory mesocyclone detection algorithm for the WSR-88D.Wea. Forecasting. 13, 304-326.
Witt, A., M. D. Eilts, G. J. Stumpf, E. D. Mitchell, J. T. Johnson, and K. W. Thomas, 1998: Evaluating the performance of WSR-88D severe storm detection algorithms. The National Severe Storms Laboratory Tornado Detection Algorithm.Wea. Forecasting. 13, 313-318.
Wurman, J., J. Straka, and E. Rasmussen, 1996: Preliminary radar observations
of the structure of tornadoes. Preprints, 18th Conference on Severe
Local Storms. San Francisco, CA, Amer. Meteor. Soc., 17-22.
Notes:
1. The MDA (and other algorithms) were run on a Solaris Workstation using version 3.10 of the NSSL SSAP package and version 2.1 of the HIRES-dealising package. WSR-88D data was displayed using version 10.1 of WATADS on Rossby.
2. Dow data was processed using Solo II by NCAR and all velocity images
shown in this paper where dealiased.