AcDC Composite Growth Index
research 06 Jun 2022Overview
This document is long showing my thoughts as I dive into each aspect heading. For brevity, I’ve outlined the major points here.
Linear extension values are not skewed by their window of observation within realistic bounds. I keep data within +/- 1 month of the target i.e. 5-7 months for 6 month growth rates and 11-13 months for 12-month growth rates. Rates are calculated by daily productivity values within the observation window and scaled to the target to ensure comparability.
Scores are standardized using z-scores to calculate mean standard deviation about the mean for each trait and genotype. Positive values indicate above average performance, 0 denotes average performance, and negative values indicate below average performance.
Mean standardized scores are calculated for linear extension (6-mo and 12-mo TLE and colony volumetric growth) and calcification (buoyant weight, light calcification, and dark calcification), and then the mean of the calcification and linear extension scores is calculated for the composite growth index.
Outliers are identified and removed using modified z-scores. The modified z-scores use median values instead of mean values since medians are more resistant to being skewed by outlier observations. Modified z-scores greater than 3.5 or less than -3.5 are filtered out, and normal z-scores are then calculated. This prevents the inclusion of data which are greater than or less than the central tendency of all other data as is the case of buoyant weight data collected from one study which is >> all other and a few linear extension growth rates of corals that were on average smaller yet had high proportionate growth (~20x initial size).
Previous Studies
There exist 16 studies that have investigated the growth forms of Acropora cervicornis at the genotype level which have been incorporated into our database. These studies began with Diego Lirman who analyzed genotype-specific differences in annual proportionate growth (termed productivity in Lirman et al. 2014) across genotypes within Diego’s Biscayne National Park nurseries and his work in the Dominican Republic. Katie Lohr built upon this and analyzed 10 genotypes for differences in total linear extension and calcification rate over a 13 month study of CRF genotypes (Lohr and Patterson 2017). At the same time, Ford Drury analyzed the genotype niches in a genotype by environment study (Dury, Manzello, Lirman 2017). Other studies did not solely focus on differences among genotypes but their data analyzing growth under OA, temperature stress, or a combination of the two shed light on genotype-specific patterns. There has consistently been genotypic patterns of growth throughout all of these studies. Through the connection of each individual dataset, we can elucidate new, overarching genotype-specific patterns of growth. Below is a table summarizing the aforementioned and complementary studies that have analyzed growth of genotyped A. cervicornis. The remaining tables delve into the combined data of all these studies to begin to draw patterns.
Traits Table
trait | unit | method | mean | sd | min | max | n | datasets | genotypes |
---|---|---|---|---|---|---|---|---|---|
6-month colony volumetric growth | proportionate growth | 3D photogrammetry | 2.5333658 | 4.5160081 | 0.0377524 | 60.28155 | 293 | 3 | 17 |
6-month linear growth | proportionate growth | ruler | 1.6449644 | 1.4264161 | 0.0133041 | 16.52444 | 2686 | 10 | 120 |
annual colony volumetric growth | annual proportionate growth | 3D photogrammetry | 6.5244687 | 8.1461205 | 0.3835854 | 63.97418 | 170 | 3 | 18 |
annual linear growth | annual proportionate growth | ruler | 6.6611193 | 5.8815492 | 0.0405556 | 59.21111 | 1583 | 9 | 81 |
dark calcification | µmol cm^-2 h^-1 | alkalinity anomaly | 0.6967946 | 0.2713945 | 0.0180000 | 1.59400 | 56 | 1 | 12 |
light calcification | µmol cm^-2 h^-1 | alkalinity anomaly | 0.8475254 | 0.2766803 | 0.3110000 | 1.59400 | 59 | 1 | 12 |
mass normalized daily calcification | mg day^-1 g^-1 | buoyant weight | 27.2406909 | 41.4262869 | 0.3450656 | 191.19915 | 244 | 4 | 27 |
- Note: Proportionate growth indicates multiplicative growth over the time scale. If a coral was 10cm and it’s 6-month linear growth is 2, it will have grown 20cm in the 6-months and it’s new size is 30cm.
Linear Extension Analysis
Here, we see how TLE is changing over time, specifically looking at the 6-month and 12-month time points. For this overview, the colors in the graphs denote the largest windows of +/- 60 days around the time-point targets; 6-month growth is selected between 120 and 240 days (4-8 months) and for 12-month growth is between 10 months and 14 months.
The formula for calculating productivity is:
\[ \frac{TLE_f - TLE_i}{TLEi}/days \times (182 \space|\space 365) \] Thus, we calculate the daily prod over the time scale observed, and scale to its target. For instance a coral viewed over 175 days would have 7 days linearly extrapolated and a coral viewed over 185 days would have 3 days linearly subtracted. The amount of extrapolation or subtraction is proportionate to the length of the window chosen. As noted above, the units are in proportionate growth per time scale, \(yr^{-1}\) or \(6mo^{-1}\)
We can narrow our windows around the 6-month and 12-month growth rates. Here I investigate windows of +/- 15, 30, 45, and 60 days. A window of 15 denotes a single month around the midpoint, 30 days denotes 2 months, 45 days 3 months, and 60 days 4 months.
+/- days | annual | 6-month |
---|---|---|
15 | 1079 | 2083 |
30 | 1271 | 2370 |
45 | 1274 | 2633 |
60 | 1333 | 2666 |
For some reason, the 12-month has lots of outliers that bring it all the way up to ~60 cm/cm/yr, which just doesn’t seem right. Let’s dive in.
datafile_name | average initial TLE | average annual prod |
---|---|---|
2014_data | 7.64 | 7.37 |
everything else | 12.03 | 3.64 |
So, the outliers are explained by a dataset which had a handful of small colonies <5cm which had significant growth relative to its initial size. This is only 31 colonies that have prod >20 and initial TLE <5. Many of these values are filtered out with the adopted outlier removal scheme outlined below. Anyway, back to the problem at hand: does increasing the window cause any scaling problems?
Slopes and R2 for all plots are weak and show mixed patterns. My takeaway is that since we are scaling within fairly limited windows, we are not seeing any extrapolation or subtraction problems. Not quite sure what statistics I should run on this or even if they are needed. But visually, it seems as if increasing the window does not have an effect on the derived productivity value. My final takeaway is that +/-30 days seems like a nice balance of including more data points and not straying too far from the target. We can say, “data within one month of the target metric was included in calculations”. This would include data between 5 months and 7 months and data from 11 months to 13 months.
Connecting Across Datasets
We can then look at the mean value of each metric for each genotype. The columns have been ordered by their amount of data completeness. Columns to the left of the vertical line describe linear extension, while columns to the right of the line describe total calcification. Linear extension includes TLE and volumetric methods for a total of 4 metrics, and calcification metrics include buoyant weight and total alkalinity anomaly methodologies for a total of 3 metrics. The large amounts of missing data prohibit a truly robust composite assessment. However, creating the groundwork for a composite index which will become more robust over time will certainly be useful. One of the goals of this tool is for practitioners and researchers to easily complete their genotype’s row using easy to use metrics. CRANG (or manual incubations), buoyant weight, and a ruler is all that is needed for these 7 metrics. I have eliminated metrics that share data with one another or are overtly complex for practitioners (interstitial metric) to measure.genotype | 6-month linear growth | annual linear growth | annual colony volumetric growth | 6-month colony volumetric growth | mass normalized daily calcification | dark calcification | light calcification |
---|---|---|---|---|---|---|---|
ML41 | 1.32 | 3.96 | 4.09 | 2.31 | 1.85 | 0.91 | 0.82 |
ML7 | 0.99 | 3.48 | 7.25 | 1.88 | 2.51 | 0.74 | 0.88 |
ML62 | 2.10 | 4.88 | 6.67 | 1.73 | 1.90 | 0.48 | 0.84 |
ML50 | 1.86 | 5.62 | 6.05 | 1.55 | 2.34 | 0.84 | 0.73 |
ML31 | 1.86 | 4.40 | 2.73 | 1.54 | 2.05 | 0.92 | 0.87 |
ML3 | 1.70 | 4.55 | 5.13 | 1.51 | 2.02 | 0.75 | 0.71 |
ML44 | 1.15 | 4.51 | 6.35 | 1.31 | 2.10 | 0.65 | 0.99 |
ML1 | 1.50 | 3.80 | 4.63 | 1.30 | 1.32 | 0.64 | 0.67 |
ML13 | 1.29 | 3.42 | 2.94 | 1.13 | 1.54 | 0.65 | 0.87 |
M6 | 1.72 | - | 11.98 | 5.30 | 0.89 | - | - |
ML36 | 0.95 | 3.66 | 5.82 | 1.70 | - | - | - |
U41 | 5.52 | 13.29 | 5.30 | - | 65.67 | - | - |
K3 | 5.08 | 14.59 | 2.39 | - | 84.94 | - | - |
K2 | 4.51 | 15.98 | 2.54 | - | 84.65 | - | - |
U77 | 4.01 | 10.08 | 6.98 | - | 54.90 | - | - |
U44 | 3.64 | 11.19 | 4.26 | - | 47.16 | - | - |
ML34 | 2.12 | - | - | - | 2.10 | 0.57 | 0.85 |
Marker 9 | 1.67 | 8.89 | - | 1.80 | - | - | - |
U47 | 4.70 | 18.24 | - | - | 52.37 | - | - |
U73 | 4.61 | 19.55 | - | - | 46.89 | - | - |
U78 | 4.10 | 16.52 | - | - | 47.16 | - | - |
K1 | 3.93 | 15.47 | - | - | 34.87 | - | - |
K25 | 3.02 | 9.95 | - | - | 23.20 | - | - |
ML47 | - | - | - | - | 2.20 | 0.84 | 1.01 |
ML63 | - | - | - | - | 2.25 | 0.38 | 0.92 |
FM20 | - | - | 16.16 | 8.02 | - | - | - |
BC-G | 0.76 | - | - | 2.52 | - | - | - |
Stagreef | 1.13 | - | - | 2.49 | - | - | - |
Sunny Isles-F | 1.00 | - | - | 2.02 | - | - | - |
BC-H | 1.61 | - | - | 1.58 | - | - | - |
B | 3.61 | 18.89 | - | - | - | - | - |
ML5 | 2.82 | 5.50 | - | - | - | - | - |
DR-A | 2.45 | 5.40 | - | - | - | - | - |
THIN | 2.19 | 6.78 | - | - | - | - | - |
ML56 | 2.18 | 3.38 | - | - | - | - | - |
Acerv 1 (A-AC) | 2.00 | 7.89 | - | - | - | - | - |
ML54 | 1.87 | 3.99 | - | - | - | - | - |
ELK | 1.74 | 5.36 | - | - | - | - | - |
G1 | 1.66 | 5.27 | - | - | - | - | - |
Struggle Bus | 1.66 | 9.27 | - | - | - | - | - |
Acerv 3 (C-AC) | 1.63 | 7.82 | - | - | - | - | - |
Acerv 2 (B-AC) | 1.61 | 5.26 | - | - | - | - | - |
Site 406 | 1.61 | 8.05 | - | - | - | - | - |
G16 | 1.58 | 6.75 | - | - | - | - | - |
TT (Thicket 3) | 1.53 | 3.25 | - | - | - | - | - |
FM12 | 1.50 | 1.33 | - | - | - | - | - |
Acerv 5 (E-AC) | 1.46 | 7.24 | - | - | - | - | - |
G17 | 1.43 | 6.39 | - | - | - | - | - |
ML4 | 1.38 | 3.82 | - | - | - | - | - |
U24 | 1.33 | 3.84 | - | - | - | - | - |
Steph’s | 1.33 | 10.34 | - | - | - | - | - |
Trans 2 | 1.27 | 7.51 | - | - | - | - | - |
THICK | 1.27 | 2.87 | - | - | - | - | - |
Grounding | 1.26 | 5.07 | - | - | - | - | - |
G11 | 1.26 | 3.78 | - | - | - | - | - |
Dom’s Reef | 1.25 | 9.31 | - | - | - | - | - |
ML20 | 1.21 | - | - | - | 1.13 | - | - |
G6 | 1.15 | 3.82 | - | - | - | - | - |
Cooper’s | 1.12 | 4.53 | - | - | - | - | - |
Inshore | 1.09 | 4.08 | - | - | - | - | - |
FM5 | 1.08 | 3.10 | - | - | - | - | - |
Trav’s Reef | 1.05 | 7.62 | - | - | - | - | - |
FM7 | 1.05 | 1.97 | - | - | - | - | - |
Britt’s Reef | 1.01 | 9.59 | - | - | - | - | - |
FM18 | 0.91 | 2.08 | - | - | - | - | - |
FM13 | 0.90 | 1.78 | - | - | - | - | - |
FM1 | 0.90 | 4.37 | - | - | - | - | - |
FM10 | 0.89 | 2.48 | - | - | - | - | - |
Almost Done | 0.87 | 6.22 | - | - | - | - | - |
Ford’s Reef | 0.86 | 10.78 | - | - | - | - | - |
G15 | 0.86 | 5.03 | - | - | - | - | - |
G2 | 0.85 | 4.38 | - | - | - | - | - |
Acerv 4 (D-AC) | 0.84 | 7.05 | - | - | - | - | - |
MUTANT182 | 0.83 | 3.83 | - | - | - | - | - |
Alina-B | 0.82 | 6.81 | - | - | - | - | - |
Alina-A | 0.70 | 7.81 | - | - | - | - | - |
Big Bertha | 0.70 | 5.20 | - | - | - | - | - |
Fowey | 0.60 | 6.29 | - | - | - | - | - |
Navassa | 0.59 | 2.34 | - | - | - | - | - |
B/B | 0.58 | 2.94 | - | - | - | - | - |
Trans 1 | 0.56 | 4.82 | - | - | - | - | - |
FM9 | 0.54 | 2.27 | - | - | - | - | - |
G18 | 0.51 | 1.64 | - | - | - | - | - |
North Midchannel-A | 0.49 | 9.07 | - | - | - | - | - |
W/Y | 0.40 | 2.47 | - | - | - | - | - |
W/G | 0.34 | 7.10 | - | - | - | - | - |
W/B | 0.30 | 3.51 | - | - | - | - | - |
U25 | - | 1.63 | 5.38 | - | - | - | - |
Sunny Isles-A | 4.50 | - | - | - | - | - | - |
Stag-B | 4.05 | - | - | - | - | - | - |
MB-C | 3.90 | - | - | - | - | - | - |
MB-A | 3.83 | - | - | - | - | - | - |
BC-8A | 3.79 | - | - | - | - | - | - |
Cheetos-C | 3.71 | - | - | - | - | - | - |
MB-B | 3.39 | - | - | - | - | - | - |
Sunny Isles-C | 3.38 | - | - | - | - | - | - |
Stag-A | 3.31 | - | - | - | - | - | - |
BC-8B | 3.30 | - | - | - | - | - | - |
Cheetos-D | 3.15 | - | - | - | - | - | - |
BC-11 | 3.01 | - | - | - | - | - | - |
Tuna Jelly-B | 2.95 | - | - | - | - | - | - |
MB-D | 2.88 | - | - | - | - | - | - |
Sunny Isles-B | 2.82 | - | - | - | - | - | - |
Sunny Isles-D | 2.73 | - | - | - | - | - | - |
FM17 | 2.50 | - | - | - | - | - | - |
Tuna Jelly-A | 2.46 | - | - | - | - | - | - |
Yung’s-B | 2.45 | - | - | - | - | - | - |
Kelsey-1 | 2.38 | - | - | - | - | - | - |
Yung’s-A | 2.36 | - | - | - | - | - | - |
Kelsey-2 | 2.33 | - | - | - | - | - | - |
BC-1 | 2.26 | - | - | - | - | - | - |
Cheetos-A | 2.25 | - | - | - | - | - | - |
ML48 | 2.24 | - | - | - | - | - | - |
Site 211 | 1.64 | - | - | - | - | - | - |
FM15 | 1.62 | - | - | - | - | - | - |
MB | 1.61 | - | - | - | - | - | - |
Govt Cut | 1.58 | - | - | - | - | - | - |
Cheetos-B | 1.37 | - | - | - | - | - | - |
ML14 | 1.35 | - | - | - | - | - | - |
FM16 | 1.34 | - | - | - | - | - | - |
Jons | 1.26 | - | - | - | - | - | - |
FM3 | 0.80 | - | - | - | - | - | - |
FM11 | 0.80 | - | - | - | - | - | - |
FM19 | 0.47 | - | - | - | - | - | - |
ML38 | - | 3.66 | - | - | - | - | - |
ML43 | - | 2.59 | - | - | - | - | - |
ML11 | - | 1.01 | - | - | - | - | - |
M10 | - | - | - | - | 2.23 | - | - |
B8 | - | - | - | - | 1.32 | - | - |
M1 | - | - | - | - | 0.58 | - | - |
Standardizing Scores
Because each of these metrics describe a different component of coral growth and are measured on different scales, they cannot be directly aggregated. Instead, we must first calculate standardized scores for each metric prior to aligning disparate measurements. I chose to standardize by calculating z-scores where the difference of each value and the column mean is divided by the column’s standard deviation. Thus, the column mean is now 0 and the standard deviation is 1. Each resulting value indicates the amount of standard deviations about the mean for that metric.
The table below shows the resulting standardized data.genotype | 6-month linear growth | annual linear growth | annual colony volumetric growth | 6-month colony volumetric growth | mass normalized daily calcification | dark calcification | light calcification |
---|---|---|---|---|---|---|---|
ML41 | -0.49 | -0.57 | -0.54 | -0.01 | -0.68 | 1.26 | -0.22 |
ML7 | -0.77 | -0.68 | 0.39 | -0.26 | -0.66 | 0.25 | 0.30 |
ML62 | 0.17 | -0.35 | 0.22 | -0.35 | -0.68 | -1.27 | -0.06 |
ML50 | -0.02 | -0.17 | 0.04 | -0.45 | -0.67 | 0.86 | -1.11 |
ML31 | -0.02 | -0.46 | -0.94 | -0.46 | -0.68 | 1.31 | 0.19 |
ML3 | -0.16 | -0.43 | -0.23 | -0.47 | -0.68 | 0.28 | -1.33 |
ML44 | -0.63 | -0.43 | 0.12 | -0.59 | -0.68 | -0.28 | 1.41 |
ML1 | -0.33 | -0.60 | -0.38 | -0.59 | -0.70 | -0.35 | -1.69 |
ML13 | -0.51 | -0.69 | -0.88 | -0.69 | -0.70 | -0.28 | 0.25 |
M6 | -0.15 | - | 1.78 | 1.70 | -0.72 | - | - |
ML36 | -0.79 | -0.64 | -0.03 | -0.36 | - | - | - |
U41 | 3.07 | 1.64 | -0.18 | - | 1.57 | - | - |
K3 | 2.70 | 1.95 | -1.04 | - | 2.25 | - | - |
K2 | 2.21 | 2.28 | -0.99 | - | 2.24 | - | - |
U77 | 1.79 | 0.88 | 0.31 | - | 1.19 | - | - |
U44 | 1.48 | 1.15 | -0.49 | - | 0.92 | - | - |
ML34 | 0.20 | - | - | - | -0.68 | -0.75 | 0.03 |
Marker 9 | -0.19 | 0.60 | - | -0.31 | - | - | - |
U47 | 2.37 | 2.82 | - | - | 1.10 | - | - |
U73 | 2.30 | 3.13 | - | - | 0.91 | - | - |
U78 | 1.87 | 2.41 | - | - | 0.92 | - | - |
K1 | 1.72 | 2.16 | - | - | 0.48 | - | - |
K25 | 0.96 | 0.85 | - | - | 0.07 | - | - |
ML47 | - | - | - | - | -0.67 | 0.86 | 1.57 |
ML63 | - | - | - | - | -0.67 | -1.90 | 0.66 |
FM20 | - | - | 3.00 | 3.26 | - | - | - |
BC-G | -0.96 | - | - | 0.11 | - | - | - |
Stagreef | -0.65 | - | - | 0.09 | - | - | - |
Sunny Isles-F | -0.76 | - | - | -0.18 | - | - | - |
BC-H | -0.24 | - | - | -0.43 | - | - | - |
B | 1.46 | 2.97 | - | - | - | - | - |
ML5 | 0.78 | -0.20 | - | - | - | - | - |
DR-A | 0.47 | -0.22 | - | - | - | - | - |
THIN | 0.25 | 0.10 | - | - | - | - | - |
ML56 | 0.24 | -0.70 | - | - | - | - | - |
Acerv 1 (A-AC) | 0.09 | 0.36 | - | - | - | - | - |
ML54 | -0.02 | -0.56 | - | - | - | - | - |
ELK | -0.13 | -0.23 | - | - | - | - | - |
G1 | -0.20 | -0.26 | - | - | - | - | - |
Struggle Bus | -0.20 | 0.69 | - | - | - | - | - |
Acerv 3 (C-AC) | -0.22 | 0.35 | - | - | - | - | - |
Acerv 2 (B-AC) | -0.24 | -0.26 | - | - | - | - | - |
Site 406 | -0.24 | 0.40 | - | - | - | - | - |
G16 | -0.26 | 0.09 | - | - | - | - | - |
TT (Thicket 3) | -0.30 | -0.73 | - | - | - | - | - |
FM12 | -0.33 | -1.19 | - | - | - | - | - |
Acerv 5 (E-AC) | -0.37 | 0.21 | - | - | - | - | - |
G17 | -0.39 | 0.01 | - | - | - | - | - |
ML4 | -0.44 | -0.60 | - | - | - | - | - |
U24 | -0.47 | -0.59 | - | - | - | - | - |
Steph’s | -0.47 | 0.94 | - | - | - | - | - |
Trans 2 | -0.53 | 0.28 | - | - | - | - | - |
THICK | -0.53 | -0.82 | - | - | - | - | - |
Grounding | -0.53 | -0.30 | - | - | - | - | - |
G11 | -0.54 | -0.61 | - | - | - | - | - |
Dom’s Reef | -0.54 | 0.70 | - | - | - | - | - |
ML20 | -0.58 | - | - | - | -0.71 | - | - |
G6 | -0.63 | -0.60 | - | - | - | - | - |
Cooper’s | -0.66 | -0.43 | - | - | - | - | - |
Inshore | -0.68 | -0.54 | - | - | - | - | - |
FM5 | -0.69 | -0.77 | - | - | - | - | - |
Trav’s Reef | -0.71 | 0.30 | - | - | - | - | - |
FM7 | -0.71 | -1.04 | - | - | - | - | - |
Britt’s Reef | -0.75 | 0.77 | - | - | - | - | - |
FM18 | -0.83 | -1.01 | - | - | - | - | - |
FM13 | -0.84 | -1.08 | - | - | - | - | - |
FM1 | -0.84 | -0.47 | - | - | - | - | - |
FM10 | -0.85 | -0.91 | - | - | - | - | - |
Almost Done | -0.86 | -0.03 | - | - | - | - | - |
Ford’s Reef | -0.87 | 1.05 | - | - | - | - | - |
G15 | -0.87 | -0.31 | - | - | - | - | - |
G2 | -0.88 | -0.47 | - | - | - | - | - |
Acerv 4 (D-AC) | -0.89 | 0.17 | - | - | - | - | - |
MUTANT182 | -0.90 | -0.60 | - | - | - | - | - |
Alina-B | -0.91 | 0.11 | - | - | - | - | - |
Alina-A | -1.01 | 0.35 | - | - | - | - | - |
Big Bertha | -1.01 | -0.27 | - | - | - | - | - |
Fowey | -1.10 | -0.01 | - | - | - | - | - |
Navassa | -1.10 | -0.95 | - | - | - | - | - |
B/B | -1.11 | -0.81 | - | - | - | - | - |
Trans 1 | -1.13 | -0.36 | - | - | - | - | - |
FM9 | -1.14 | -0.97 | - | - | - | - | - |
G18 | -1.17 | -1.12 | - | - | - | - | - |
North Midchannel-A | -1.19 | 0.64 | - | - | - | - | - |
W/Y | -1.27 | -0.92 | - | - | - | - | - |
W/G | -1.31 | 0.18 | - | - | - | - | - |
W/B | -1.35 | -0.67 | - | - | - | - | - |
U25 | - | -1.12 | -0.16 | - | - | - | - |
Sunny Isles-A | 2.20 | - | - | - | - | - | - |
Stag-B | 1.83 | - | - | - | - | - | - |
MB-C | 1.70 | - | - | - | - | - | - |
MB-A | 1.64 | - | - | - | - | - | - |
BC-8A | 1.61 | - | - | - | - | - | - |
Cheetos-C | 1.54 | - | - | - | - | - | - |
MB-B | 1.26 | - | - | - | - | - | - |
Sunny Isles-C | 1.26 | - | - | - | - | - | - |
Stag-A | 1.20 | - | - | - | - | - | - |
BC-8B | 1.19 | - | - | - | - | - | - |
Cheetos-D | 1.07 | - | - | - | - | - | - |
BC-11 | 0.95 | - | - | - | - | - | - |
Tuna Jelly-B | 0.90 | - | - | - | - | - | - |
MB-D | 0.83 | - | - | - | - | - | - |
Sunny Isles-B | 0.79 | - | - | - | - | - | - |
Sunny Isles-D | 0.71 | - | - | - | - | - | - |
FM17 | 0.52 | - | - | - | - | - | - |
Tuna Jelly-A | 0.48 | - | - | - | - | - | - |
Yung’s-B | 0.47 | - | - | - | - | - | - |
Kelsey-1 | 0.41 | - | - | - | - | - | - |
Yung’s-A | 0.39 | - | - | - | - | - | - |
Kelsey-2 | 0.37 | - | - | - | - | - | - |
BC-1 | 0.31 | - | - | - | - | - | - |
Cheetos-A | 0.30 | - | - | - | - | - | - |
ML48 | 0.29 | - | - | - | - | - | - |
Site 211 | -0.21 | - | - | - | - | - | - |
FM15 | -0.23 | - | - | - | - | - | - |
MB | -0.24 | - | - | - | - | - | - |
Govt Cut | -0.27 | - | - | - | - | - | - |
Cheetos-B | -0.44 | - | - | - | - | - | - |
ML14 | -0.46 | - | - | - | - | - | - |
FM16 | -0.47 | - | - | - | - | - | - |
Jons | -0.53 | - | - | - | - | - | - |
FM3 | -0.92 | - | - | - | - | - | - |
FM11 | -0.93 | - | - | - | - | - | - |
FM19 | -1.20 | - | - | - | - | - | - |
ML38 | - | -0.64 | - | - | - | - | - |
ML43 | - | -0.89 | - | - | - | - | - |
ML11 | - | -1.26 | - | - | - | - | - |
M10 | - | - | - | - | -0.67 | - | - |
B8 | - | - | - | - | -0.70 | - | - |
M1 | - | - | - | - | -0.73 | - | - |
Composite Growth Index
Now that we have standardized scores for 7 different metrics, we can compare and align metrics into a single, composite index to understand relative genotype performance.
Methods
Because coral growth is comprised of lateral thickening and linear extension, I first separate linear growth measurements from net calcification measurements and determine average performance within these groupings and exclude any missing data points. Then, I combine these two scores into a single, composite growth score. If only linear extension or calcification data is available, then the growth score will be based solely off of this available data.
Thus, a composite growth score is the amalgamation of multiple standardized metrics. The more metrics available, the more robust the score will be. However, a genotype’s score will not be biased by the number of metrics or the type of metrics available. This scheme further removes any imputation and a score is solely based off available data.
Robustness Testing
Lets Graph It Out
genotype | LE | G | score | rank |
---|---|---|---|---|
FM20 | 3.132 | - | 3.132 | 1 |
B | 2.213 | - | 2.213 | 2 |
Sunny Isles-A | 2.204 | - | 2.204 | 3 |
U47 | 2.595 | 1.103 | 1.849 | 4 |
Stag-B | 1.831 | - | 1.831 | 5 |
U73 | 2.715 | 0.909 | 1.812 | 6 |
K3 | 1.204 | 2.255 | 1.729 | 7 |
K2 | 1.167 | 2.244 | 1.705 | 8 |
MB-C | 1.701 | - | 1.701 | 9 |
MB-A | 1.641 | - | 1.641 | 10 |
BC-8A | 1.608 | - | 1.608 | 11 |
U41 | 1.511 | 1.573 | 1.542 | 12 |
Cheetos-C | 1.538 | - | 1.538 | 13 |
U78 | 2.140 | 0.919 | 1.529 | 14 |
MB-B | 1.264 | - | 1.264 | 15 |
Sunny Isles-C | 1.258 | - | 1.258 | 16 |
K1 | 1.942 | 0.484 | 1.213 | 17 |
Stag-A | 1.196 | - | 1.196 | 18 |
BC-8B | 1.188 | - | 1.188 | 19 |
U77 | 0.995 | 1.192 | 1.094 | 20 |
Cheetos-D | 1.066 | - | 1.066 | 21 |
BC-11 | 0.948 | - | 0.948 | 22 |
Tuna Jelly-B | 0.897 | - | 0.897 | 23 |
MB-D | 0.833 | - | 0.833 | 24 |
U44 | 0.712 | 0.918 | 0.815 | 25 |
Sunny Isles-B | 0.787 | - | 0.787 | 26 |
Sunny Isles-D | 0.706 | - | 0.706 | 27 |
ML47 | - | 0.588 | 0.588 | 28 |
FM17 | 0.516 | - | 0.516 | 29 |
K25 | 0.904 | 0.071 | 0.487 | 30 |
Tuna Jelly-A | 0.485 | - | 0.485 | 31 |
Yung’s-B | 0.470 | - | 0.470 | 32 |
Kelsey-1 | 0.410 | - | 0.410 | 33 |
Yung’s-A | 0.393 | - | 0.393 | 34 |
Kelsey-2 | 0.369 | - | 0.369 | 35 |
BC-1 | 0.307 | - | 0.307 | 36 |
Cheetos-A | 0.301 | - | 0.301 | 37 |
ML5 | 0.292 | - | 0.292 | 38 |
ML48 | 0.291 | - | 0.291 | 39 |
Struggle Bus | 0.246 | - | 0.246 | 40 |
Steph’s | 0.235 | - | 0.235 | 41 |
Acerv 1 (A-AC) | 0.228 | - | 0.228 | 42 |
M6 | 1.111 | -0.718 | 0.197 | 43 |
THIN | 0.176 | - | 0.176 | 44 |
DR-A | 0.124 | - | 0.124 | 45 |
Ford’s Reef | 0.089 | - | 0.089 | 46 |
Site 406 | 0.081 | - | 0.081 | 47 |
Dom’s Reef | 0.080 | - | 0.080 | 48 |
Acerv 3 (C-AC) | 0.063 | - | 0.063 | 49 |
Marker 9 | 0.035 | - | 0.035 | 50 |
Britt’s Reef | 0.010 | - | 0.010 | 51 |
Acerv 5 (E-AC) | -0.077 | - | -0.077 | 52 |
G16 | -0.085 | - | -0.085 | 53 |
ML31 | -0.471 | 0.273 | -0.099 | 54 |
ML44 | -0.382 | 0.153 | -0.114 | 55 |
Trans 2 | -0.126 | - | -0.126 | 56 |
ML34 | 0.196 | -0.465 | -0.134 | 57 |
ML41 | -0.401 | 0.119 | -0.141 | 58 |
ELK | -0.182 | - | -0.182 | 59 |
ML7 | -0.330 | -0.035 | -0.183 | 60 |
G17 | -0.192 | - | -0.192 | 61 |
Trav’s Reef | -0.205 | - | -0.205 | 62 |
Site 211 | -0.213 | - | -0.213 | 63 |
G1 | -0.227 | - | -0.227 | 64 |
ML50 | -0.152 | -0.304 | -0.228 | 65 |
ML56 | -0.231 | - | -0.231 | 66 |
FM15 | -0.231 | - | -0.231 | 67 |
MB | -0.242 | - | -0.242 | 68 |
Acerv 2 (B-AC) | -0.247 | - | -0.247 | 69 |
Govt Cut | -0.268 | - | -0.268 | 70 |
North Midchannel-A | -0.271 | - | -0.271 | 71 |
Stagreef | -0.280 | - | -0.280 | 72 |
ML54 | -0.287 | - | -0.287 | 73 |
Alina-A | -0.332 | - | -0.332 | 74 |
BC-H | -0.337 | - | -0.337 | 75 |
Acerv 4 (D-AC) | -0.361 | - | -0.361 | 76 |
ML62 | -0.076 | -0.670 | -0.373 | 77 |
Alina-B | -0.399 | - | -0.399 | 78 |
Grounding | -0.417 | - | -0.417 | 79 |
BC-G | -0.427 | - | -0.427 | 80 |
Cheetos-B | -0.443 | - | -0.443 | 81 |
Almost Done | -0.448 | - | -0.448 | 82 |
ML3 | -0.324 | -0.577 | -0.451 | 83 |
ML36 | -0.456 | - | -0.456 | 84 |
ML14 | -0.458 | - | -0.458 | 85 |
ML13 | -0.692 | -0.241 | -0.467 | 86 |
FM16 | -0.467 | - | -0.467 | 87 |
Sunny Isles-F | -0.469 | - | -0.469 | 88 |
ML4 | -0.518 | - | -0.518 | 89 |
TT (Thicket 3) | -0.519 | - | -0.519 | 90 |
U24 | -0.533 | - | -0.533 | 91 |
Jons | -0.533 | - | -0.533 | 92 |
Cooper’s | -0.544 | - | -0.544 | 93 |
Fowey | -0.556 | - | -0.556 | 94 |
W/G | -0.569 | - | -0.569 | 95 |
G11 | -0.572 | - | -0.572 | 96 |
G15 | -0.591 | - | -0.591 | 97 |
Inshore | -0.610 | - | -0.610 | 98 |
G6 | -0.615 | - | -0.615 | 99 |
ML38 | -0.637 | - | -0.637 | 100 |
ML63 | - | -0.639 | -0.639 | 101 |
U25 | -0.639 | - | -0.639 | 102 |
Big Bertha | -0.641 | - | -0.641 | 103 |
ML20 | -0.579 | -0.709 | -0.644 | 104 |
FM1 | -0.655 | - | -0.655 | 105 |
M10 | - | -0.670 | -0.670 | 106 |
G2 | -0.675 | - | -0.675 | 107 |
THICK | -0.676 | - | -0.676 | 108 |
ML1 | -0.477 | -0.913 | -0.695 | 109 |
B8 | - | -0.703 | -0.703 | 110 |
FM5 | -0.728 | - | -0.728 | 111 |
M1 | - | -0.729 | -0.729 | 112 |
Trans 1 | -0.745 | - | -0.745 | 113 |
MUTANT182 | -0.747 | - | -0.747 | 114 |
FM12 | -0.759 | - | -0.759 | 115 |
FM7 | -0.875 | - | -0.875 | 116 |
FM10 | -0.882 | - | -0.882 | 117 |
ML43 | -0.890 | - | -0.890 | 118 |
FM18 | -0.920 | - | -0.920 | 119 |
FM3 | -0.923 | - | -0.923 | 120 |
FM11 | -0.928 | - | -0.928 | 121 |
FM13 | -0.960 | - | -0.960 | 122 |
B/B | -0.960 | - | -0.960 | 123 |
W/B | -1.011 | - | -1.011 | 124 |
Navassa | -1.026 | - | -1.026 | 125 |
FM9 | -1.054 | - | -1.054 | 126 |
W/Y | -1.092 | - | -1.092 | 127 |
G18 | -1.143 | - | -1.143 | 128 |
FM19 | -1.203 | - | -1.203 | 129 |
ML11 | -1.263 | - | -1.263 | 130 |
type | n | mean | sd | median |
---|---|---|---|---|
Both | 22 | 0.475 | 0.915 | 0.049 |
G | 5 | -0.431 | 0.570 | -0.670 |
LE | 103 | -0.052 | 0.842 | -0.268 |
##
## Kruskal-Wallis rank sum test
##
## data: score by type
## Kruskal-Wallis chi-squared = 9.4527, df = 2, p-value = 0.008859
##
## Pairwise comparisons using Wilcoxon rank sum exact test
##
## data: composite$score and composite$type
##
## Both G
## G 0.019 -
## LE 0.019 0.188
##
## P value adjustment method: BH
From the first plot, we can see that the number of metrics does not bias the score, as dots are vertically scattered across the y-axis. There is, however, a horizontal grouping with metrics to the right (~3+) being dominated by the type both. This makes sense as there is a maximum of 7 possible metrics, 4 of which are LE and 3 of which are G. If a genotype has more than 4 metrics, than it will certainly be classified as ‘Both’. Further, there are many more genotypes which only have linear extension data compared to genotypes which only have calcification data. However, since the number of metrics is not affecting the score, the clustering of # of metrics and type does not matter.
From the second plot, we can see that the types ‘both’ and ‘LE’ span a wide range of scores with the median being approximately 0 (average of 0 std deviations from the mean, i.e. average performance). Type G however, is fairly depressed with the median score ~-0.7. This is suggesting that by only having calcification data, its composite score will be lower than having both or linear extension data. When we run some simple non-parametric tests, we can see that the mean calcification score is not significantly different than the mean linear extension score (p~0.19), while the mean ‘both’ score is significantly different than the mean calcification score and mean linear extension score (p<0.05 for both). This is certainly a problem and deserves diving into.
Analysis
We can then dive into the 9 genotypes which are driving this statistically significant difference (have a score >0.5 and have both metrics represented). They all happen to be CRF genotypes used by Katie Lohr in her PhD work at UF. This data is distinguished by having long term buoyant weight measurements from the nursery which have much higher values than other buoyant weight rates. Katie Lohr measured the linear extension and calcification of the corals in a CRF nursery and is the main driver of why these corals are classified as ‘Both’.
genotype | datafile_name | location_name |
---|---|---|
K1 | Paradis2019 | Auburn Lab |
K1 | LohrPatterson2017 | CRF Tavenier Nursery |
K2 | LohrPatterson2017 | CRF Tavenier Nursery |
K2 | Lohr2020 | U4 Patch |
K2 | Lohr2020 | U14 Patch |
K3 | LohrPatterson2017 | CRF Tavenier Nursery |
K3 | Lohr2020 | U4 Patch |
U41 | LohrPatterson2017 | CRF Tavenier Nursery |
U41 | Lohr2020 | U4 Patch |
U41 | Lohr2020 | U14 Patch |
U44 | LohrPatterson2017 | CRF Tavenier Nursery |
U44 | Lohr2020 | U4 Patch |
U47 | LohrPatterson2017 | CRF Tavenier Nursery |
U73 | LohrPatterson2017 | CRF Tavenier Nursery |
U77 | LohrPatterson2017 | CRF Tavenier Nursery |
U77 | Lohr2020 | U4 Patch |
U77 | Lohr2020 | U14 Patch |
U78 | LohrPatterson2017 | CRF Tavenier Nursery |
datafile_name | average mg/ initial G/day |
---|---|
LohrPatterson2017 | 55.585 |
Everything Else | 1.554 |
This leads me to believe that the composite growth index is not sensitive to data comprised only of calcification or linear extension metrics, rather, the index is sensitive to evenness of sampling effort where a few high growth values in a single metric may skew the composite score. While this dampens the robustness of our index as it stands today, the index will become more robust over time with the inclusion of more datasets from the lab and field. Further, we can programmatically implement outlier removal to refine the composite growth score.
To support this conclusion, I am recalculating the composite growth index. However, for this index, the calcification data for Katie Lohr’s work is removed. Thus, these genotypes will now only be classified as linear extension. I am then recreating the exact plot and tables from above on this data subset.genotype | LE | G | score | rank |
---|---|---|---|---|
FM20 | 3.132 | - | 3.132 | 1 |
U73 | 2.715 | - | 2.715 | 2 |
U47 | 2.595 | - | 2.595 | 3 |
B | 2.213 | - | 2.213 | 4 |
Sunny Isles-A | 2.204 | - | 2.204 | 5 |
U78 | 2.140 | - | 2.140 | 6 |
Stag-B | 1.831 | - | 1.831 | 7 |
MB-C | 1.701 | - | 1.701 | 8 |
MB-A | 1.641 | - | 1.641 | 9 |
BC-8A | 1.608 | - | 1.608 | 10 |
Cheetos-C | 1.538 | - | 1.538 | 11 |
U41 | 1.511 | - | 1.511 | 12 |
MB-B | 1.264 | - | 1.264 | 13 |
Sunny Isles-C | 1.258 | - | 1.258 | 14 |
K3 | 1.204 | - | 1.204 | 15 |
Stag-A | 1.196 | - | 1.196 | 16 |
BC-8B | 1.188 | - | 1.188 | 17 |
K2 | 1.167 | - | 1.167 | 18 |
ML47 | - | 1.079 | 1.079 | 19 |
Cheetos-D | 1.066 | - | 1.066 | 20 |
U77 | 0.995 | - | 0.995 | 21 |
BC-11 | 0.948 | - | 0.948 | 22 |
K25 | 0.904 | - | 0.904 | 23 |
Tuna Jelly-B | 0.897 | - | 0.897 | 24 |
M10 | - | 0.871 | 0.871 | 25 |
MB-D | 0.833 | - | 0.833 | 26 |
Sunny Isles-B | 0.787 | - | 0.787 | 27 |
U44 | 0.712 | - | 0.712 | 28 |
Sunny Isles-D | 0.706 | - | 0.706 | 29 |
FM17 | 0.516 | - | 0.516 | 30 |
Tuna Jelly-A | 0.485 | - | 0.485 | 31 |
Yung’s-B | 0.470 | - | 0.470 | 32 |
Kelsey-1 | 0.410 | - | 0.410 | 33 |
Yung’s-A | 0.393 | - | 0.393 | 34 |
K1 | 1.942 | -1.163 | 0.389 | 35 |
Kelsey-2 | 0.369 | - | 0.369 | 36 |
BC-1 | 0.307 | - | 0.307 | 37 |
Cheetos-A | 0.301 | - | 0.301 | 38 |
ML5 | 0.292 | - | 0.292 | 39 |
ML48 | 0.291 | - | 0.291 | 40 |
Struggle Bus | 0.246 | - | 0.246 | 41 |
Steph’s | 0.235 | - | 0.235 | 42 |
Acerv 1 (A-AC) | 0.228 | - | 0.228 | 43 |
THIN | 0.176 | - | 0.176 | 44 |
ML7 | -0.330 | 0.637 | 0.153 | 45 |
DR-A | 0.124 | - | 0.124 | 46 |
ML44 | -0.382 | 0.589 | 0.104 | 47 |
ML31 | -0.471 | 0.678 | 0.104 | 48 |
Ford’s Reef | 0.089 | - | 0.089 | 49 |
ML34 | 0.196 | -0.031 | 0.083 | 50 |
Site 406 | 0.081 | - | 0.081 | 51 |
Dom’s Reef | 0.080 | - | 0.080 | 52 |
Acerv 3 (C-AC) | 0.063 | - | 0.063 | 53 |
ML50 | -0.152 | 0.269 | 0.059 | 54 |
Marker 9 | 0.035 | - | 0.035 | 55 |
Britt’s Reef | 0.010 | - | 0.010 | 56 |
ML41 | -0.401 | 0.409 | 0.004 | 57 |
Acerv 5 (E-AC) | -0.077 | - | -0.077 | 58 |
G16 | -0.085 | - | -0.085 | 59 |
ML63 | - | -0.117 | -0.117 | 60 |
Trans 2 | -0.126 | - | -0.126 | 61 |
ELK | -0.182 | - | -0.182 | 62 |
G17 | -0.192 | - | -0.192 | 63 |
M6 | 1.111 | -1.519 | -0.204 | 64 |
Trav’s Reef | -0.205 | - | -0.205 | 65 |
ML62 | -0.076 | -0.350 | -0.213 | 66 |
Site 211 | -0.213 | - | -0.213 | 67 |
G1 | -0.227 | - | -0.227 | 68 |
ML56 | -0.231 | - | -0.231 | 69 |
FM15 | -0.231 | - | -0.231 | 70 |
MB | -0.242 | - | -0.242 | 71 |
Acerv 2 (B-AC) | -0.247 | - | -0.247 | 72 |
ML3 | -0.324 | -0.188 | -0.256 | 73 |
Govt Cut | -0.268 | - | -0.268 | 74 |
North Midchannel-A | -0.271 | - | -0.271 | 75 |
Stagreef | -0.280 | - | -0.280 | 76 |
ML54 | -0.287 | - | -0.287 | 77 |
Alina-A | -0.332 | - | -0.332 | 78 |
BC-H | -0.337 | - | -0.337 | 79 |
Acerv 4 (D-AC) | -0.361 | - | -0.361 | 80 |
Alina-B | -0.399 | - | -0.399 | 81 |
ML13 | -0.692 | -0.133 | -0.412 | 82 |
Grounding | -0.417 | - | -0.417 | 83 |
BC-G | -0.427 | - | -0.427 | 84 |
Cheetos-B | -0.443 | - | -0.443 | 85 |
Almost Done | -0.448 | - | -0.448 | 86 |
ML36 | -0.456 | - | -0.456 | 87 |
ML14 | -0.458 | - | -0.458 | 88 |
FM16 | -0.467 | - | -0.467 | 89 |
Sunny Isles-F | -0.469 | - | -0.469 | 90 |
ML4 | -0.518 | - | -0.518 | 91 |
TT (Thicket 3) | -0.519 | - | -0.519 | 92 |
U24 | -0.533 | - | -0.533 | 93 |
Jons | -0.533 | - | -0.533 | 94 |
Cooper’s | -0.544 | - | -0.544 | 95 |
Fowey | -0.556 | - | -0.556 | 96 |
W/G | -0.569 | - | -0.569 | 97 |
G11 | -0.572 | - | -0.572 | 98 |
G15 | -0.591 | - | -0.591 | 99 |
Inshore | -0.610 | - | -0.610 | 100 |
G6 | -0.615 | - | -0.615 | 101 |
ML38 | -0.637 | - | -0.637 | 102 |
U25 | -0.639 | - | -0.639 | 103 |
Big Bertha | -0.641 | - | -0.641 | 104 |
FM1 | -0.655 | - | -0.655 | 105 |
G2 | -0.675 | - | -0.675 | 106 |
THICK | -0.676 | - | -0.676 | 107 |
ML1 | -0.477 | -0.932 | -0.705 | 108 |
FM5 | -0.728 | - | -0.728 | 109 |
Trans 1 | -0.745 | - | -0.745 | 110 |
MUTANT182 | -0.747 | - | -0.747 | 111 |
FM12 | -0.759 | - | -0.759 | 112 |
B8 | - | -0.760 | -0.760 | 113 |
ML20 | -0.579 | -1.093 | -0.836 | 114 |
FM7 | -0.875 | - | -0.875 | 115 |
FM10 | -0.882 | - | -0.882 | 116 |
ML43 | -0.890 | - | -0.890 | 117 |
FM18 | -0.920 | - | -0.920 | 118 |
FM3 | -0.923 | - | -0.923 | 119 |
FM11 | -0.928 | - | -0.928 | 120 |
FM13 | -0.960 | - | -0.960 | 121 |
B/B | -0.960 | - | -0.960 | 122 |
W/B | -1.011 | - | -1.011 | 123 |
Navassa | -1.026 | - | -1.026 | 124 |
FM9 | -1.054 | - | -1.054 | 125 |
W/Y | -1.092 | - | -1.092 | 126 |
G18 | -1.143 | - | -1.143 | 127 |
FM19 | -1.203 | - | -1.203 | 128 |
ML11 | -1.263 | - | -1.263 | 129 |
M1 | - | -2.065 | -2.065 | 130 |
type | n | mean | sd | median |
---|---|---|---|---|
Both | 13 | -0.133 | 0.353 | 0.004 |
G | 5 | -0.198 | 1.283 | -0.117 |
LE | 112 | 0.077 | 0.939 | -0.229 |
##
## Kruskal-Wallis rank sum test
##
## data: score by type
## Kruskal-Wallis chi-squared = 0.058265, df = 2, p-value = 0.9713
##
## Pairwise comparisons using Wilcoxon rank sum exact test
##
## data: composite_sub$score and composite_sub$type
##
## Both G
## G 1 -
## LE 1 1
##
## P value adjustment method: BH
These plots are much more of what we would hope for - the number of metrics and the type of metrics collected cannot predict the composite index score. Rather, the score is our best calculation of standardized growth.
We can then compare the new index rankings with the old index rankings after the removal of Lohr (2017). We can see these few data points heavily weighed these genotypes.
genotype | score_old | metrics_old | type_old | score_new | metrics_new | type_new |
---|---|---|---|---|---|---|
U47 | 1.849 | 3 | Both | 2.595 | 2 | LE |
U73 | 1.812 | 3 | Both | 2.715 | 2 | LE |
K3 | 1.729 | 4 | Both | 1.204 | 3 | LE |
K2 | 1.705 | 4 | Both | 1.167 | 3 | LE |
U41 | 1.542 | 4 | Both | 1.511 | 3 | LE |
U78 | 1.529 | 3 | Both | 2.140 | 2 | LE |
K1 | 1.213 | 3 | Both | 0.389 | 3 | Both |
U77 | 1.094 | 4 | Both | 0.995 | 3 | LE |
U44 | 0.815 | 4 | Both | 0.712 | 3 | LE |
Programmatically Removing Outliers
Rather than removing the Lohr (2017) calcification data explicitly, we can explore removing outliers programmatically in the calculation of a composite score. The even elimination of outliers in the calculation of the composite index score will help improve the robustness of the composite score. This has precedent in other composite index scores, and I will follow their recommendations (Handbook on constructing composite indicators, methodology and user guide, 2008).
Here, I will identify outliers by using modified z-scores where the median value for a trait is subtracted from each value, and then the value is scaled (divided by) the median of the absolute deviations about the median.
\[ Z_\text{modified} = \frac{(x_i-\widetilde{x})}{\text{median}\{\left|x_i - \widetilde{x}\right|\}\times 1.4826} \] where \(x_i\) is the value to be converted to a modified z-score, \(\widetilde{x}\) is the median value of the trait, and 1.4826 is the constant needed to multiply the median of the absolute deviations about the median to approximate one standard deviation for large values (>80) of n observations for a particular trait as we have in our dataset.
When the modified z score is less than or greater than 3.5, the value is removed and the normal z-scores are then calculated on the filtered data. The threshold of 3.5 was chosen based on recommendations of best practices (Iglewicz & Hoaglin, 1993).
This can be achieved in R quite simply:
data %>%
group_by(trait) %>%
mutate(`modified z-score` = scale(value,
center = median(value, na.rm = T),
#mad function contains the constant outlined above
scale = mad(value, na.rm=T))) %>%
filter(abs(`modified z-score`)<=3.5)
##
## Kruskal-Wallis rank sum test
##
## data: score by type
## Kruskal-Wallis chi-squared = 4.4062, df = 2, p-value = 0.1105
##
## Pairwise comparisons using Wilcoxon rank sum exact test
##
## data: t$score and t$type
##
## Both (19) G (5)
## G (5) 0.11 -
## LE (106) 0.11 0.37
##
## P value adjustment method: BH
The differences among groups are now statistically not significant (p>0.05). The p-value here is certainly not as great as above when we explicitly remove Lohr (2017) data [p-value = 0.9713], but the methodology of removing outliers here is not selective as it was above. While we can visually see differences of the interquartile range, the unevenness of genotypes in each grouping (# in parentheses) prevents us from drawing any conclusions.
Final Rankings
After all is said and done, here are the final genotype rankings:
genotype | G | LE | score | type | rank | metrics | datasets |
---|---|---|---|---|---|---|---|
U78 | 3.039 | 2.023 | 2.531 | Both | 1 | 3 | 1 |
K2 | 3.523 | 1.296 | 2.410 | Both | 2 | 4 | 2 |
U73 | 2.756 | 2.014 | 2.385 | Both | 3 | 2 | 1 |
U77 | 3.160 | 1.326 | 2.243 | Both | 4 | 4 | 2 |
U47 | - | 2.231 | 2.231 | LE | 5 | 2 | 1 |
K25 | 2.976 | 1.315 | 2.145 | Both | 6 | 3 | 1 |
Sunny Isles-A | - | 2.096 | 2.096 | LE | 7 | 1 | 1 |
MB-A | - | 2.066 | 2.066 | LE | 8 | 1 | 1 |
MB-C | - | 2.009 | 2.009 | LE | 9 | 1 | 1 |
U44 | 2.692 | 1.087 | 1.890 | Both | 10 | 4 | 2 |
B | - | 1.736 | 1.736 | LE | 11 | 2 | 1 |
Cheetos-C | - | 1.726 | 1.726 | LE | 12 | 1 | 1 |
K3 | - | 1.663 | 1.663 | LE | 13 | 3 | 2 |
BC-8B | - | 1.594 | 1.594 | LE | 14 | 1 | 1 |
Stag-A | - | 1.414 | 1.414 | LE | 15 | 1 | 1 |
Sunny Isles-C | - | 1.323 | 1.323 | LE | 16 | 1 | 1 |
Tuna Jelly-B | - | 1.292 | 1.292 | LE | 17 | 1 | 1 |
Cheetos-D | - | 1.267 | 1.267 | LE | 18 | 1 | 1 |
MB-D | - | 1.225 | 1.225 | LE | 19 | 1 | 1 |
BC-11 | - | 1.194 | 1.194 | LE | 20 | 1 | 1 |
Stag-B | - | 1.182 | 1.182 | LE | 21 | 1 | 1 |
Sunny Isles-B | - | 1.177 | 1.177 | LE | 22 | 1 | 1 |
MB-B | - | 1.155 | 1.155 | LE | 23 | 1 | 1 |
BC-8A | - | 1.147 | 1.147 | LE | 24 | 1 | 1 |
K1 | 0.180 | 2.113 | 1.146 | Both | 25 | 3 | 2 |
FM17 | - | 0.894 | 0.894 | LE | 26 | 1 | 1 |
Tuna Jelly-A | - | 0.861 | 0.861 | LE | 27 | 1 | 1 |
Yung’s-B | - | 0.847 | 0.847 | LE | 28 | 1 | 1 |
Sunny Isles-D | - | 0.829 | 0.829 | LE | 29 | 1 | 1 |
Yung’s-A | - | 0.766 | 0.766 | LE | 30 | 1 | 1 |
Kelsey-2 | - | 0.741 | 0.741 | LE | 31 | 1 | 1 |
Cheetos-A | - | 0.670 | 0.670 | LE | 32 | 1 | 1 |
ML48 | - | 0.660 | 0.660 | LE | 33 | 1 | 1 |
FM20 | - | 0.623 | 0.623 | LE | 34 | 2 | 1 |
Kelsey-1 | - | 0.566 | 0.566 | LE | 35 | 1 | 1 |
U41 | - | 0.547 | 0.547 | LE | 36 | 3 | 2 |
THIN | - | 0.477 | 0.477 | LE | 37 | 2 | 1 |
BC-1 | - | 0.426 | 0.426 | LE | 38 | 1 | 1 |
DR-A | - | 0.395 | 0.395 | LE | 39 | 2 | 1 |
ML47 | 0.391 | - | 0.391 | G | 40 | 3 | 1 |
ML5 | - | 0.375 | 0.375 | LE | 41 | 2 | 3 |
BC-G | - | 0.309 | 0.309 | LE | 42 | 2 | 1 |
Stagreef | - | 0.235 | 0.235 | LE | 43 | 2 | 1 |
Acerv 1 (A-AC) | - | 0.224 | 0.224 | LE | 44 | 2 | 2 |
Acerv 5 (E-AC) | - | 0.202 | 0.202 | LE | 45 | 2 | 2 |
G16 | - | 0.197 | 0.197 | LE | 46 | 2 | 1 |
Site 406 | - | 0.193 | 0.193 | LE | 47 | 2 | 2 |
ML34 | -0.176 | 0.561 | 0.192 | Both | 48 | 4 | 2 |
Marker 9 | - | 0.159 | 0.159 | LE | 49 | 3 | 3 |
North Midchannel-A | - | 0.141 | 0.141 | LE | 50 | 2 | 1 |
Site 211 | - | 0.135 | 0.135 | LE | 51 | 1 | 1 |
ML56 | - | 0.126 | 0.126 | LE | 52 | 2 | 3 |
Acerv 3 (C-AC) | - | 0.118 | 0.118 | LE | 53 | 2 | 3 |
Dom’s Reef | - | 0.114 | 0.114 | LE | 54 | 2 | 2 |
MB | - | 0.104 | 0.104 | LE | 55 | 1 | 1 |
Britt’s Reef | - | 0.093 | 0.093 | LE | 56 | 2 | 2 |
G17 | - | 0.080 | 0.080 | LE | 57 | 2 | 1 |
Govt Cut | - | 0.078 | 0.078 | LE | 58 | 1 | 1 |
Steph’s | - | 0.060 | 0.060 | LE | 59 | 2 | 3 |
Acerv 2 (B-AC) | - | 0.043 | 0.043 | LE | 60 | 2 | 2 |
ML31 | 0.302 | -0.235 | 0.034 | Both | 61 | 7 | 3 |
G1 | - | 0.027 | 0.027 | LE | 62 | 2 | 1 |
ML41 | 0.165 | -0.124 | 0.020 | Both | 63 | 7 | 4 |
ML54 | - | -0.001 | -0.001 | LE | 64 | 2 | 3 |
Struggle Bus | - | -0.020 | -0.020 | LE | 65 | 2 | 3 |
ELK | - | -0.026 | -0.026 | LE | 66 | 2 | 3 |
Trans 2 | - | -0.033 | -0.033 | LE | 67 | 2 | 1 |
ML44 | 0.096 | -0.163 | -0.034 | Both | 68 | 7 | 3 |
Ford’s Reef | - | -0.042 | -0.042 | LE | 69 | 2 | 2 |
ML7 | 0.123 | -0.275 | -0.076 | Both | 70 | 7 | 4 |
Sunny Isles-F | - | -0.076 | -0.076 | LE | 71 | 2 | 1 |
Acerv 4 (D-AC) | - | -0.077 | -0.077 | LE | 72 | 2 | 2 |
M10 | -0.078 | - | -0.078 | G | 73 | 1 | 1 |
Trav’s Reef | - | -0.112 | -0.112 | LE | 74 | 2 | 2 |
ML62 | -0.342 | 0.106 | -0.118 | Both | 75 | 7 | 3 |
ML14 | - | -0.121 | -0.121 | LE | 76 | 1 | 1 |
FM16 | - | -0.131 | -0.131 | LE | 77 | 1 | 1 |
ML3 | -0.132 | -0.167 | -0.149 | Both | 78 | 7 | 2 |
BC-H | - | -0.153 | -0.153 | LE | 79 | 2 | 1 |
M6 | -0.530 | 0.207 | -0.161 | Both | 80 | 4 | 3 |
TT (Thicket 3) | - | -0.176 | -0.176 | LE | 81 | 2 | 2 |
Grounding | - | -0.186 | -0.186 | LE | 82 | 2 | 3 |
Cheetos-B | - | -0.188 | -0.188 | LE | 83 | 1 | 2 |
Jons | - | -0.200 | -0.200 | LE | 84 | 1 | 1 |
ML36 | - | -0.203 | -0.203 | LE | 85 | 4 | 1 |
ML50 | -0.267 | -0.147 | -0.207 | Both | 86 | 7 | 3 |
Almost Done | - | -0.210 | -0.210 | LE | 87 | 2 | 2 |
Alina-A | - | -0.230 | -0.230 | LE | 88 | 2 | 1 |
ML4 | - | -0.231 | -0.231 | LE | 89 | 2 | 2 |
ML13 | -0.115 | -0.496 | -0.306 | Both | 90 | 7 | 3 |
ML63 | -0.312 | - | -0.312 | G | 91 | 3 | 1 |
U24 | - | -0.314 | -0.314 | LE | 92 | 2 | 1 |
Cooper’s | - | -0.317 | -0.317 | LE | 93 | 2 | 4 |
ML1 | -0.392 | -0.256 | -0.324 | Both | 94 | 7 | 5 |
Alina-B | - | -0.331 | -0.331 | LE | 95 | 2 | 2 |
ML20 | -0.449 | -0.247 | -0.348 | Both | 96 | 2 | 2 |
G11 | - | -0.356 | -0.356 | LE | 97 | 2 | 1 |
Inshore | - | -0.361 | -0.361 | LE | 98 | 2 | 2 |
G15 | - | -0.367 | -0.367 | LE | 99 | 2 | 1 |
B8 | -0.387 | - | -0.387 | G | 100 | 1 | 1 |
G6 | - | -0.396 | -0.396 | LE | 101 | 2 | 1 |
G2 | - | -0.453 | -0.453 | LE | 102 | 2 | 1 |
Big Bertha | - | -0.457 | -0.457 | LE | 103 | 2 | 2 |
FM5 | - | -0.461 | -0.461 | LE | 104 | 2 | 1 |
FM1 | - | -0.462 | -0.462 | LE | 105 | 2 | 1 |
THICK | - | -0.468 | -0.468 | LE | 106 | 2 | 1 |
Fowey | - | -0.474 | -0.474 | LE | 107 | 2 | 2 |
U25 | - | -0.489 | -0.489 | LE | 108 | 2 | 1 |
MUTANT182 | - | -0.537 | -0.537 | LE | 109 | 2 | 1 |
ML38 | - | -0.542 | -0.542 | LE | 110 | 1 | 1 |
Trans 1 | - | -0.563 | -0.563 | LE | 111 | 2 | 1 |
FM3 | - | -0.605 | -0.605 | LE | 112 | 1 | 1 |
FM11 | - | -0.611 | -0.611 | LE | 113 | 1 | 1 |
M1 | -0.633 | - | -0.633 | G | 114 | 1 | 1 |
W/G | - | -0.658 | -0.658 | LE | 115 | 2 | 1 |
FM7 | - | -0.664 | -0.664 | LE | 116 | 2 | 1 |
FM18 | - | -0.672 | -0.672 | LE | 117 | 2 | 1 |
FM10 | - | -0.698 | -0.698 | LE | 118 | 2 | 1 |
FM13 | - | -0.769 | -0.769 | LE | 119 | 2 | 1 |
B/B | - | -0.772 | -0.772 | LE | 120 | 2 | 1 |
FM12 | - | -0.816 | -0.816 | LE | 121 | 2 | 1 |
ML43 | - | -0.839 | -0.839 | LE | 122 | 1 | 1 |
Navassa | - | -0.850 | -0.850 | LE | 123 | 2 | 1 |
W/B | - | -0.855 | -0.855 | LE | 124 | 2 | 1 |
FM15 | - | -0.859 | -0.859 | LE | 125 | 1 | 1 |
FM9 | - | -0.881 | -0.881 | LE | 126 | 2 | 1 |
FM19 | - | -0.897 | -0.897 | LE | 127 | 1 | 1 |
W/Y | - | -0.944 | -0.944 | LE | 128 | 2 | 1 |
G18 | - | -0.983 | -0.983 | LE | 129 | 2 | 1 |
ML11 | - | -1.276 | -1.276 | LE | 130 | 1 | 1 |
Concluding Remarks
In conclusion, I believe the composite growth index can align the datasets and metrics within AcDC to best describe relative performance. While the index is not without its flaws, the robustness will only increase over time with the inclusion of more datasets and data types, pushing all genotypes towards having calcification and linear extension data. By using the temporal, experimental, and location filters, one can further increase the robustness of the index. For instance, one can remove lab or field data using the filters to achieve the filtering of the Lohr (2017) calcification data.