Concordance correlation coefficient

In statistics, the concordance correlation coefficient measures the agreement between two variables, e.g., to evaluate reproducibility or for inter-rater reliability.

Definition

The form of the concordance correlation coefficient ${\displaystyle \rho _{c}}$ as^[1]

${\displaystyle \rho _{c}={\frac {2\rho \sigma _{x}\sigma _{y}}{\sigma _{x}^{2}+\sigma _{y}^{2}+(\mu _{x}-\mu _{y})^{2}}},}$

where ${\displaystyle \mu _{x}}$ and ${\displaystyle \mu _{y}}$ are the means for the two variables and ${\displaystyle \sigma _{x}^{2}}$ and ${\displaystyle \sigma _{y}^{2}}$ are the corresponding variances. ${\displaystyle \rho }$ is the correlation coefficient between the two variables.

This follows from its definition^[1] as

${\displaystyle \rho _{c}=1-{\frac {{\rm {Expected\ orthogonal\ squared\ distance\ from\ the\ diagonal\ }}x=y}{{\rm {Expected\ orthogonal\ squared\ distance\ from\ the\ diagonal\ }}x=y{\rm {\ assuming\ independence}}}}.}$

When the concordance correlation coefficient is computed on a ${\displaystyle N}$-length data set (i.e., ${\displaystyle N}$ paired data values ${\displaystyle (x_{n},y_{n})}$, for ${\displaystyle n=1,...,N}$), the form is

${\displaystyle {\hat {\rho }}_{c}={\frac {2s_{xy}}{s_{x}^{2}+s_{y}^{2}+({\bar {x}}-{\bar {y}})^{2}}},}$

where the mean is computed as

${\displaystyle {\bar {x}}={\frac {1}{N}}\sum _{n=1}^{N}x_{n}}$

and the variance

${\displaystyle s_{x}^{2}={\frac {1}{N}}\sum _{n=1}^{N}(x_{n}-{\bar {x}})^{2}}$

and the covariance

${\displaystyle s_{xy}={\frac {1}{N}}\sum _{n=1}^{N}(x_{n}-{\bar {x}})(y_{n}-{\bar {y}}).}$

Whereas the ordinary correlation coefficient (Pearson's) is immune to whether the biased or unbiased versions for estimation of the variance is used, the concordance correlation coefficient is not. In the original article Lin suggested the 1/N normalization,^[1] while in another article Nickerson appears to have used the 1/(N-1),^[2] i.e., the concordance correlation coefficient may be computed slightly differently between implementations.

Relation to other measures of correlation

The concordance correlation coefficient is nearly identical to some of the measures called intra-class correlations. Comparisons of the concordance correlation coefficient with an "ordinary" intraclass correlation on different data sets found only small differences between the two correlations, in one case on the third decimal.^[2] It has also been stated^[3] that the ideas for concordance correlation coefficient "are quite similar to results already published by Krippendorff^[4] in 1970".

In the original article^[1] Lin suggested a form for multiple classes (not just 2). Over ten years later a correction to this form was issued.^[5]

One example of the use of the concordance correlation coefficient is in a comparison of analysis method for functional magnetic resonance imaging brain scans.^[6]

References

1. Lawrence I-Kuei Lin (March 1989). "A concordance correlation coefficient to evaluate reproducibility". Biometrics. 45 (1): 255–268. doi:10.2307/2532051. JSTOR 2532051. PMID 2720055.
2. Carol A. E. Nickerson (December 1997). "A Note on "A Concordance Correlation Coefficient to Evaluate Reproducibility". Biometrics. 53 (4): 1503–1507. doi:10.2307/2533516. JSTOR 2533516.
3. Reinhold Müller; Petra Büttner (December 1994). "A critical discussion of intraclass correlation coefficients". Statistics in Medicine. 13 (23–24): 2465–2476. doi:10.1002/sim.4780132310. PMID 7701147.
4. Klaus Krippendorff (1970). E. F. Borgatta (ed.). "Bivariate Agreement Coefficients for Reliability of Data". Sociological Methodology. 2. San Francisco: Jossey-Bass: 139–150. doi:10.2307/270787. JSTOR 270787.
5. Lawrence I-Kuei Lin (March 2000). "A Note on the Concordance Correlation Coefficient". Biometrics. 56: 324–325. doi:10.1111/j.0006-341X.2000.00324.x.
6. N Lange; S C Strother; J R Anderson; F A Nielsen; A P Holmes; T Kolenda; R Savoy; L K Hansen (September 1999). "Plurality and resemblance in fMRI data analysis". NeuroImage. 10 (3 Pt 1): 282–303. CiteSeerX 10.1.1.158.6688. doi:10.1006/NIMG.1999.0472. ISSN 1053-8119. PMID 10458943. Wikidata Q21012624.

For a small Excel and VBA implementation by Peter Urbani see here