Opening your learning space
Starting the app …
Opening your learning space
Starting the app …
ROC AUC summarizes score discrimination across all possible thresholds.
Free to browse · flashcards or a multiple-choice quiz · import from Essential
Formula
AUC dimensionless 0…1 · FPR and sensitivity are fractions 0…1
| Symbol | Meaning | Unit |
|---|---|---|
| Area under the receiver operating characteristic curve | dimensionless | |
| False-positive rate, 1−specificity | fraction | |
| True-positive rate at a given threshold | fraction |
AUC=\int_0^1 \text{Sensitivität}(FPR)\,d(FPR)For independent random positive and negative cases, AUC is the probability that a positive case receives a higher score. It measures ranking discrimination, not calibration, utility or performance at a chosen threshold. Comparisons depend on target population, reference standard, case spectrum and uncertainty. With discrete scores the curve is approximated numerically.
Compare curves only for comparable populations, outcomes, reference standards and score direction.
The area integrates sensitivity along the false-positive rate.
Solve for a quantity
The x-axis of the ROC curve.
What does an AUC of 0.5 mean?
With score direction set correctly, it is roughly chance ranking.
Interpreting AUC as calibration or the best threshold.
AUC measures ranking over thresholds, not decision costs at one threshold.
Formula cluster
Threshold choice requires consequences of false positives and negatives.
For ROC points (0,0), (0.25,0.6), (0.5,0.85), (1,1), trapezoids give AUC=0.075+0.181+0.463≈0.72. Check: the area lies between zero and one.
Comparing diagnostic or statistical scores across thresholds
Here is how to work through a typical ROC area under the curve (AUC = Fläche unter der ROC-Kurve) task step by step:
Task
What does an AUC of 0.5 mean?
Solution path
With score direction set correctly, it is roughly chance ranking.
With score direction set correctly, 0.5 corresponds on average to random ranking of a positive and negative case. An AUC below 0.5 may indicate reversed score direction or poor discrimination. It does not mean exactly half of cases are misclassified, because that requires a chosen threshold. AUC assesses ranking across thresholds and should be reported with uncertainty and target population. Report reference standard, population, confidence interval and score direction. AUC replaces neither threshold selection nor calibration or utility assessment. Differences between AUC estimates should be judged with uncertainty and study design.
No. AUC integrates all possible thresholds without weighting their consequences. A decision threshold depends on the costs of false positives and false negatives, prevalence and available resources. Two tests with the same AUC can differ in the clinically relevant threshold region. Selection needs local sensitivity, specificity, predictive values, uncertainty and consequences, not only total area. Report reference standard, population, confidence interval and score direction. AUC replaces neither threshold selection nor calibration or utility assessment. Differences between AUC estimates should be judged with uncertainty and study design.
No. Discrimination asks whether a model ranks people with events above those without. Calibration asks whether predicted probabilities agree with observed frequencies. A model can rank events well while systematically overpredicting risk. Conversely, average calibration can be good without strong ranking. These properties answer different questions and should be evaluated separately. Report reference standard, population, confidence interval and score direction. AUC replaces neither threshold selection nor calibration or utility assessment. Differences between AUC estimates should be judged with uncertainty and study design.
Reproduce the example calculation: For ROC points (0,0), (0.25,0.6), (0.5,0.85), (1,1), trapezoids give AUC=0.075+0.181+0.463≈0.72. ROC area under the curve uses AUC = Fläche unter der ROC-Kurve. In plain terms, rOC AUC summarizes score discrimination across all possible thresholds. Unit check: AUC dimensionless 0…1 · FPR and sensitivity are fractions 0…1. Compare curves only for comparable populations, outcomes, reference standards and score direction. Values are comparable only when their definitions, denominators and periods match. Record these details next to the result so the reference group is clear. If the direction is implausible, check data preparation and the calculation basis before discussing biological causes.
A key limit of ROC area under the curve is this: Compare curves only for comparable populations, outcomes, reference standards and score direction. Do not use the metric without its reference; it is useful for Comparing diagnostic or statistical scores across thresholds. ROC AUC summarizes score discrimination across all possible thresholds. When comparing populations or experiments, check whether definitions, denominators and observation periods match. If the assumption is implausible, the result shows only what the simplified model calculates from its inputs; it is not a reliable estimate for the target population. State this limitation in the report, and do not infer a causal effect from the formula alone.
Quanta exam set
Curated exam set for "ROC area under the curve":
Question (front)
Which formula describes ROC area under the curve?
Answer in your set
Question (front)
How do you rearrange ROC area under the curve for Solve for a quantity?
Answer in your set
Question (front)
Which common mistake happens with ROC area under the curve?
Answer in your set
+ 7 more cards: units, variables, derivation, example, exam task
The formula set contains 10 cards. After importing, review them and start practicing; your ratings determine later review intervals.
This list names subject references and further reading. A page or section number appears when it is part of the reference; these are not verbatim quotations.
Create a curated FSRS exam set for AUC = Fläche unter der ROC-Kurve: formula recall, variables, derivation, rearrangement, worked example, common mistakes and exam context.
Curated formula set · LaTeX · FSRS spaced repetition · import from Essential