Advanced ROC Analysis (psychopdaROC) - Comprehensive Guide
Source:vignettes/meddecide-psychopdaroc-comprehensive.Rmd
meddecide-psychopdaroc-comprehensive.RmdAdvanced ROC Analysis (psychopdaROC)
Overview
The psychopdaROC module provides advanced Receiver
Operating Characteristic (ROC) curve analysis with optimal cutpoint
determination using the cutpointr framework. It supports 12
cutpoint optimization methods, 16 optimization metrics, subgroup
analysis, DeLong’s test for comparing ROC curves, IDI/NRI
reclassification indices, effect size and power analysis, bootstrap ROC
with prior weighting, clinical utility analysis, and fixed
sensitivity/specificity analysis.
All examples below use the test datasets in the
data-raw/non-rda/ folder of the ClinicoPath
repository (.omv for jamovi, .csv for R).
On this website the code is shown without output.
Datasets Used in This Guide
| Dataset | N | Class Levels | Prevalence | Key Features | Primary Use |
|---|---|---|---|---|---|
psychopdaROC_test |
200 | Healthy/Disease | ~50% | 1 biomarker, age, sex | Basic single-marker testing |
psychopdaROC_screening |
250 | No Cancer/Cancer | ~25% | PSA, CA125 | Cancer screening |
psychopdaROC_cardiac |
180 | No MI/MI | ~30% | Troponin, creatinine, BNP | Cardiac biomarkers |
psychopdaROC_multibiomarker |
220 | Negative/Positive | ~30% | 3 markers + combined score | Multi-marker comparison |
psychopdaROC_subgroup |
200 | No Disease/Disease | ~30% | test_score, age_group, sex | Subgroup analysis |
psychopdaROC_perfect |
100 | Negative/Positive | 50% | Perfect separation | AUC=1.0 edge case |
psychopdaROC_poor |
150 | Negative/Positive | ~50% | No discrimination | AUC~0.5 edge case |
psychopdaROC_overlap |
190 | Negative/Positive | ~50% | Moderate overlap | AUC~0.70 |
psychopdaROC_rare |
300 | No Disease/Disease | 5% | Single biomarker | Rare disease |
psychopdaROC_costbenefit |
160 | No Event/Event | ~30% | Risk score, cost columns | Cost-benefit optimization |
psychopdaROC_spectrum |
170 | 3 severity + binary | varies | Continuous marker | Disease spectrum |
psychopdaROC_timedep |
140 | No Event/Event | ~30% | Baseline + follow-up | Longitudinal comparison |
psychopdaROC_small |
30 | Negative/Positive | ~50% | Single marker | Small sample edge case |
psychopdaROC_imbalanced |
200 | No Event/Event | 2% | Single predictor | Extreme imbalance |
psychopdaROC_missing |
150 | Negative/Positive | ~30% | 2 tests + covariate, NAs | Missing data handling |
psychopdaROC_constant |
80 | No Event/Event | ~50% | Constant marker (all=50) | Zero variance edge case |
psychopdaROC_large |
500 | No Disease/Disease | ~30% | 2 biomarkers, site | Large sample / subgroups |
psychopdaROC_advanced |
250 | Negative/Positive | ~30% | 5 markers, site | Meta-analysis / advanced |
1. Basic ROC Analysis (Default Cutpoint)
The default analysis uses Youden Index optimization
(maximize_metric with youden) to find the
optimal cutpoint.
Default single-marker ROC
test_data <- read.csv(paste0(data_path, "psychopdaROC_test.csv"))
psychopdaROC(
data = test_data,
classVar = "disease_status",
positiveClass = "Disease",
negativeClass = "Healthy",
dependentVars = "biomarker",
refVar = NULL
)With confusion matrix and threshold table
psychopdaROC(
data = test_data,
classVar = "disease_status",
positiveClass = "Disease",
negativeClass = "Healthy",
dependentVars = "biomarker",
sensSpecTable = TRUE,
showThresholdTable = TRUE,
maxThresholds = 20,
refVar = NULL
)Lower values indicate positive class
psychopdaROC(
data = test_data,
classVar = "disease_status",
positiveClass = "Disease",
negativeClass = "Healthy",
dependentVars = "biomarker",
direction = "<=",
refVar = NULL
)2. Cutpoint Optimization Methods
Key optimization metrics
psychopdaROC(
data = test_data,
classVar = "disease_status",
positiveClass = "Disease",
negativeClass = "Healthy",
dependentVars = "biomarker",
method = "maximize_metric",
metric = "youden",
refVar = NULL
)
psychopdaROC(
data = test_data,
classVar = "disease_status",
positiveClass = "Disease",
negativeClass = "Healthy",
dependentVars = "biomarker",
method = "maximize_metric",
metric = "accuracy",
refVar = NULL
)
psychopdaROC(
data = test_data,
classVar = "disease_status",
positiveClass = "Disease",
negativeClass = "Healthy",
dependentVars = "biomarker",
method = "maximize_metric",
metric = "F1_score",
refVar = NULL
)
psychopdaROC(
data = test_data,
classVar = "disease_status",
positiveClass = "Disease",
negativeClass = "Healthy",
dependentVars = "biomarker",
method = "maximize_metric",
metric = "cohens_kappa",
refVar = NULL
)Minimize misclassification cost
psychopdaROC(
data = test_data,
classVar = "disease_status",
positiveClass = "Disease",
negativeClass = "Healthy",
dependentVars = "biomarker",
method = "minimize_metric",
metric = "misclassification_cost",
refVar = NULL
)LOESS-smoothed Youden
psychopdaROC(
data = test_data,
classVar = "disease_status",
positiveClass = "Disease",
negativeClass = "Healthy",
dependentVars = "biomarker",
method = "maximize_loess_metric",
metric = "youden",
refVar = NULL
)Bootstrap-optimized cutpoint
psychopdaROC(
data = test_data,
classVar = "disease_status",
positiveClass = "Disease",
negativeClass = "Healthy",
dependentVars = "biomarker",
method = "maximize_boot_metric",
boot_runs = 100,
seed = 123,
refVar = NULL
)Kernel-smoothed Youden
psychopdaROC(
data = test_data,
classVar = "disease_status",
positiveClass = "Disease",
negativeClass = "Healthy",
dependentVars = "biomarker",
method = "oc_youden_kernel",
refVar = NULL
)Parametric normal Youden
psychopdaROC(
data = test_data,
classVar = "disease_status",
positiveClass = "Disease",
negativeClass = "Healthy",
dependentVars = "biomarker",
method = "oc_youden_normal",
refVar = NULL
)Manual cutpoint
psychopdaROC(
data = test_data,
classVar = "disease_status",
positiveClass = "Disease",
negativeClass = "Healthy",
dependentVars = "biomarker",
method = "oc_manual",
specifyCutScore = "7.5",
refVar = NULL
)Cost-benefit optimized cutpoint
costbenefit_data <- read.csv(paste0(data_path, "psychopdaROC_costbenefit.csv"))
psychopdaROC(
data = costbenefit_data,
classVar = "outcome",
positiveClass = "Event",
negativeClass = "No_Event",
dependentVars = "risk_score",
method = "oc_cost_ratio",
costratioFP = 0.1,
refVar = NULL
)Equal sensitivity and specificity
psychopdaROC(
data = test_data,
classVar = "disease_status",
positiveClass = "Disease",
negativeClass = "Healthy",
dependentVars = "biomarker",
method = "oc_equal_sens_spec",
refVar = NULL
)Closest to perfect classifier (0,1)
psychopdaROC(
data = test_data,
classVar = "disease_status",
positiveClass = "Disease",
negativeClass = "Healthy",
dependentVars = "biomarker",
method = "oc_closest_01",
refVar = NULL
)3. Cutpoint Fine-Tuning
Metric tolerance
psychopdaROC(
data = test_data,
classVar = "disease_status",
positiveClass = "Disease",
negativeClass = "Healthy",
dependentVars = "biomarker",
tol_metric = 0.01,
refVar = NULL
)Tie-breaking methods
psychopdaROC(
data = test_data,
classVar = "disease_status",
positiveClass = "Disease",
negativeClass = "Healthy",
dependentVars = "biomarker",
break_ties = "mean",
refVar = NULL
)
psychopdaROC(
data = test_data,
classVar = "disease_status",
positiveClass = "Disease",
negativeClass = "Healthy",
dependentVars = "biomarker",
break_ties = "median",
refVar = NULL
)All observed cutpoints
psychopdaROC(
data = test_data,
classVar = "disease_status",
positiveClass = "Disease",
negativeClass = "Healthy",
dependentVars = "biomarker",
allObserved = TRUE,
refVar = NULL
)4. Multiple Test Variables (Comparative)
Multi-marker ROC overlay
multi_data <- read.csv(paste0(data_path, "psychopdaROC_multibiomarker.csv"))
psychopdaROC(
data = multi_data,
classVar = "diagnosis",
positiveClass = "Positive",
negativeClass = "Negative",
dependentVars = vars(marker1, marker2, marker3, combined_score),
plotROC = TRUE,
combinePlots = TRUE,
refVar = NULL
)DeLong test for AUC comparison
psychopdaROC(
data = multi_data,
classVar = "diagnosis",
positiveClass = "Positive",
negativeClass = "Negative",
dependentVars = vars(marker1, marker2, marker3),
delongTest = TRUE,
refVar = NULL
)Cardiac biomarker comparison
cardiac_data <- read.csv(paste0(data_path, "psychopdaROC_cardiac.csv"))
psychopdaROC(
data = cardiac_data,
classVar = "mi_status",
positiveClass = "MI",
negativeClass = "No_MI",
dependentVars = vars(troponin, creatinine, bnp),
combinePlots = TRUE,
delongTest = TRUE,
refVar = NULL
)5. ROC Visualization Options
Optimal point and confidence bands
psychopdaROC(
data = test_data,
classVar = "disease_status",
positiveClass = "Disease",
negativeClass = "Healthy",
dependentVars = "biomarker",
plotROC = TRUE,
showOptimalPoint = TRUE,
showConfidenceBands = TRUE,
refVar = NULL
)Smoothed ROC with standard error
psychopdaROC(
data = test_data,
classVar = "disease_status",
positiveClass = "Disease",
negativeClass = "Healthy",
dependentVars = "biomarker",
smoothing = TRUE,
displaySE = TRUE,
refVar = NULL
)Publication-ready clean plot
psychopdaROC(
data = test_data,
classVar = "disease_status",
positiveClass = "Disease",
negativeClass = "Healthy",
dependentVars = "biomarker",
cleanPlot = TRUE,
refVar = NULL
)Legend positions
psychopdaROC(
data = multi_data,
classVar = "diagnosis",
positiveClass = "Positive",
negativeClass = "Negative",
dependentVars = vars(marker1, marker2, marker3),
combinePlots = TRUE,
legendPosition = "bottom",
refVar = NULL
)Direct curve labels
psychopdaROC(
data = multi_data,
classVar = "diagnosis",
positiveClass = "Positive",
negativeClass = "Negative",
dependentVars = vars(marker1, marker2, marker3),
combinePlots = TRUE,
directLabel = TRUE,
refVar = NULL
)6. Diagnostic Plots
Sensitivity/Specificity vs Threshold
psychopdaROC(
data = test_data,
classVar = "disease_status",
positiveClass = "Disease",
negativeClass = "Healthy",
dependentVars = "biomarker",
showCriterionPlot = TRUE,
refVar = NULL
)Predictive values vs Prevalence
psychopdaROC(
data = test_data,
classVar = "disease_status",
positiveClass = "Disease",
negativeClass = "Healthy",
dependentVars = "biomarker",
showPrevalencePlot = TRUE,
refVar = NULL
)Test value distribution by class
psychopdaROC(
data = test_data,
classVar = "disease_status",
positiveClass = "Disease",
negativeClass = "Healthy",
dependentVars = "biomarker",
showDotPlot = TRUE,
refVar = NULL
)Precision-Recall curve
psychopdaROC(
data = test_data,
classVar = "disease_status",
positiveClass = "Disease",
negativeClass = "Healthy",
dependentVars = "biomarker",
precisionRecallCurve = TRUE,
refVar = NULL
)7. Prevalence & Prior Settings
Prior prevalence adjustment for rare disease
rare_data <- read.csv(paste0(data_path, "psychopdaROC_rare.csv"))
psychopdaROC(
data = rare_data,
classVar = "rare_disease",
positiveClass = "Disease",
negativeClass = "No_Disease",
dependentVars = "biomarker",
usePriorPrev = TRUE,
priorPrev = 0.05,
refVar = NULL
)Sample prevalence (default)
psychopdaROC(
data = rare_data,
classVar = "rare_disease",
positiveClass = "Disease",
negativeClass = "No_Disease",
dependentVars = "biomarker",
usePriorPrev = FALSE,
refVar = NULL
)8. Subgroup Analysis
By age group
subgroup_data <- read.csv(paste0(data_path, "psychopdaROC_subgroup.csv"))
psychopdaROC(
data = subgroup_data,
classVar = "disease",
positiveClass = "Disease",
negativeClass = "Healthy",
dependentVars = "test_score",
subGroup = "age_group",
refVar = NULL
)By sex
psychopdaROC(
data = subgroup_data,
classVar = "disease",
positiveClass = "Disease",
negativeClass = "Healthy",
dependentVars = "test_score",
subGroup = "sex",
refVar = NULL
)Large dataset with site subgroups
large_data <- read.csv(paste0(data_path, "psychopdaROC_large.csv"))
psychopdaROC(
data = large_data,
classVar = "disease_status",
positiveClass = "Disease",
negativeClass = "No_Disease",
dependentVars = vars(biomarker1, biomarker2),
subGroup = "site",
refVar = NULL
)9. Advanced ROC Analysis
Partial AUC (high specificity region)
psychopdaROC(
data = test_data,
classVar = "disease_status",
positiveClass = "Disease",
negativeClass = "Healthy",
dependentVars = "biomarker",
partialAUC = TRUE,
partialAUCfrom = 0.8,
partialAUCto = 1.0,
refVar = NULL
)Partial AUC (very high specificity)
psychopdaROC(
data = test_data,
classVar = "disease_status",
positiveClass = "Disease",
negativeClass = "Healthy",
dependentVars = "biomarker",
partialAUC = TRUE,
partialAUCfrom = 0.9,
partialAUCto = 1.0,
refVar = NULL
)Binormal smoothing
psychopdaROC(
data = test_data,
classVar = "disease_status",
positiveClass = "Disease",
negativeClass = "Healthy",
dependentVars = "biomarker",
rocSmoothingMethod = "binormal",
refVar = NULL
)Bootstrap confidence intervals
psychopdaROC(
data = test_data,
classVar = "disease_status",
positiveClass = "Disease",
negativeClass = "Healthy",
dependentVars = "biomarker",
bootstrapCI = TRUE,
bootstrapReps = 100,
refVar = NULL
)Quantile-based CIs
psychopdaROC(
data = test_data,
classVar = "disease_status",
positiveClass = "Disease",
negativeClass = "Healthy",
dependentVars = "biomarker",
quantileCIs = TRUE,
quantiles = "0.1,0.25,0.5,0.75,0.9",
refVar = NULL
)10. Fixed Sensitivity / Specificity Analysis
Fixed sensitivity for screening (95%)
screening_data <- read.csv(paste0(data_path, "psychopdaROC_screening.csv"))
psychopdaROC(
data = screening_data,
classVar = "cancer",
positiveClass = "Cancer",
negativeClass = "No_Cancer",
dependentVars = "psa_level",
fixedSensSpecAnalysis = TRUE,
fixedAnalysisType = "sensitivity",
fixedSensitivityValue = 0.95,
refVar = NULL
)Fixed specificity for confirmation (90%)
psychopdaROC(
data = screening_data,
classVar = "cancer",
positiveClass = "Cancer",
negativeClass = "No_Cancer",
dependentVars = "psa_level",
fixedSensSpecAnalysis = TRUE,
fixedAnalysisType = "specificity",
fixedSpecificityValue = 0.90,
refVar = NULL
)Interpolation methods
psychopdaROC(
data = screening_data,
classVar = "cancer",
positiveClass = "Cancer",
negativeClass = "No_Cancer",
dependentVars = "psa_level",
fixedSensSpecAnalysis = TRUE,
fixedAnalysisType = "sensitivity",
fixedSensitivityValue = 0.95,
fixedInterpolation = "linear",
refVar = NULL
)Fixed ROC plot with explanation
psychopdaROC(
data = screening_data,
classVar = "cancer",
positiveClass = "Cancer",
negativeClass = "No_Cancer",
dependentVars = "psa_level",
fixedSensSpecAnalysis = TRUE,
fixedAnalysisType = "sensitivity",
fixedSensitivityValue = 0.95,
showFixedROC = TRUE,
showFixedExplanation = TRUE,
refVar = NULL
)11. Model Comparison (IDI / NRI)
Integrated Discrimination Improvement (IDI)
psychopdaROC(
data = multi_data,
classVar = "diagnosis",
positiveClass = "Positive",
negativeClass = "Negative",
dependentVars = vars(marker1, marker2, marker3),
calculateIDI = TRUE,
refVar = NULL,
idiNriBootRuns = 100
)Category-based Net Reclassification Index (NRI)
psychopdaROC(
data = multi_data,
classVar = "diagnosis",
positiveClass = "Positive",
negativeClass = "Negative",
dependentVars = vars(marker1, marker2, marker3),
calculateNRI = TRUE,
refVar = NULL,
nriThresholds = "0.3,0.7"
)Continuous NRI (no thresholds)
psychopdaROC(
data = multi_data,
classVar = "diagnosis",
positiveClass = "Positive",
negativeClass = "Negative",
dependentVars = vars(marker1, marker2, marker3),
calculateNRI = TRUE,
refVar = NULL,
nriThresholds = ""
)Comprehensive classifier comparison
psychopdaROC(
data = multi_data,
classVar = "diagnosis",
positiveClass = "Positive",
negativeClass = "Negative",
dependentVars = vars(marker1, marker2, marker3),
compareClassifiers = TRUE,
refVar = NULL
)12. Effect Size & Power Analysis
Effect size analysis
psychopdaROC(
data = test_data,
classVar = "disease_status",
positiveClass = "Disease",
negativeClass = "Healthy",
dependentVars = "biomarker",
effectSizeAnalysis = TRUE,
refVar = NULL
)Post-hoc power analysis
psychopdaROC(
data = test_data,
classVar = "disease_status",
positiveClass = "Disease",
negativeClass = "Healthy",
dependentVars = "biomarker",
powerAnalysis = TRUE,
powerAnalysisType = "post_hoc",
significanceLevel = 0.05,
targetPower = 0.80,
refVar = NULL
)Prospective power analysis
psychopdaROC(
data = test_data,
classVar = "disease_status",
positiveClass = "Disease",
negativeClass = "Healthy",
dependentVars = "biomarker",
powerAnalysis = TRUE,
powerAnalysisType = "prospective",
expectedAUCDifference = 0.10,
refVar = NULL
)Sample size estimation
psychopdaROC(
data = test_data,
classVar = "disease_status",
positiveClass = "Disease",
negativeClass = "Healthy",
dependentVars = "biomarker",
powerAnalysis = TRUE,
powerAnalysisType = "sample_size",
correlationROCs = 0.5,
refVar = NULL
)13. Bootstrap ROC with Prior Weighting
Default prior (AUC=0.7, precision=10)
psychopdaROC(
data = test_data,
classVar = "disease_status",
positiveClass = "Disease",
negativeClass = "Healthy",
dependentVars = "biomarker",
bayesianAnalysis = TRUE,
priorAUC = 0.7,
priorPrecision = 10,
refVar = NULL
)Strong prior belief (AUC=0.9, high precision)
psychopdaROC(
data = test_data,
classVar = "disease_status",
positiveClass = "Disease",
negativeClass = "Healthy",
dependentVars = "biomarker",
bayesianAnalysis = TRUE,
priorAUC = 0.9,
priorPrecision = 50,
refVar = NULL
)14. Clinical Utility Analysis
Decision curve analysis
psychopdaROC(
data = test_data,
classVar = "disease_status",
positiveClass = "Disease",
negativeClass = "Healthy",
dependentVars = "biomarker",
clinicalUtilityAnalysis = TRUE,
treatmentThresholdMin = 0.05,
treatmentThresholdMax = 0.5,
treatmentThresholdStep = 0.05,
harmBenefitRatio = 0.25,
refVar = NULL
)With intervention cost analysis
psychopdaROC(
data = test_data,
classVar = "disease_status",
positiveClass = "Disease",
negativeClass = "Healthy",
dependentVars = "biomarker",
clinicalUtilityAnalysis = TRUE,
interventionCost = TRUE,
harmBenefitRatio = 1.0,
refVar = NULL
)15. Within-Cohort Meta-Analysis (Retired)
Pooling multiple markers measured on the same
patients as if they were independent studies is statistically
invalid because the AUCs are correlated. The legacy
metaAnalysis, metaAnalysisMethod,
heterogeneityTest, forestPlot, and
overrideMetaAnalysisWarning options are retained as hidden
arguments for backward compatibility with saved .omv files
and R scripts, but no pooled AUC, heterogeneity test, or pooled forest
plot is emitted. Use delongTest = TRUE or
compareClassifiers = TRUE (Section 6) to compare multiple
markers on the same cohort.
16. Guidance Level (clinicalMode)
clinicalMode only changes which explanatory notes appear
in the Procedure Notes panel; it does not change any statistic. To
tailor the cut-point to a clinical goal, choose the method
and metric (sections above), or report performance at a
fixed sensitivity or specificity
(fixedSensSpecAnalysis).
Basic (default)
psychopdaROC(
data = test_data,
classVar = "disease_status",
positiveClass = "Disease",
negativeClass = "Healthy",
dependentVars = "biomarker",
clinicalMode = "basic",
refVar = NULL
)Advanced mode
psychopdaROC(
data = test_data,
classVar = "disease_status",
positiveClass = "Disease",
negativeClass = "Healthy",
dependentVars = "biomarker",
clinicalMode = "advanced",
refVar = NULL
)Comprehensive mode
psychopdaROC(
data = test_data,
classVar = "disease_status",
positiveClass = "Disease",
negativeClass = "Healthy",
dependentVars = "biomarker",
clinicalMode = "comprehensive",
refVar = NULL
)17. Edge Cases
Perfect separation (AUC=1.0)
perfect_data <- read.csv(paste0(data_path, "psychopdaROC_perfect.csv"))
psychopdaROC(
data = perfect_data,
classVar = "condition",
positiveClass = "Positive",
negativeClass = "Negative",
dependentVars = "perfect_test",
refVar = NULL
)No discrimination (AUC~0.5)
poor_data <- read.csv(paste0(data_path, "psychopdaROC_poor.csv"))
psychopdaROC(
data = poor_data,
classVar = "status",
positiveClass = "Case",
negativeClass = "Control",
dependentVars = "poor_marker",
refVar = NULL
)Moderate overlap (AUC~0.70)
overlap_data <- read.csv(paste0(data_path, "psychopdaROC_overlap.csv"))
psychopdaROC(
data = overlap_data,
classVar = "diagnosis",
positiveClass = "Diseased",
negativeClass = "Non_Diseased",
dependentVars = "test_value",
refVar = NULL
)Small sample (n=30)
small_data <- read.csv(paste0(data_path, "psychopdaROC_small.csv"))
psychopdaROC(
data = small_data,
classVar = "class",
positiveClass = "Positive",
negativeClass = "Negative",
dependentVars = "marker",
refVar = NULL
)Extreme imbalance (2% event rate)
imbalanced_data <- read.csv(paste0(data_path, "psychopdaROC_imbalanced.csv"))
psychopdaROC(
data = imbalanced_data,
classVar = "rare_outcome",
positiveClass = "Event",
negativeClass = "No_Event",
dependentVars = "predictor",
refVar = NULL
)Constant predictor (zero variance)
constant_data <- read.csv(paste0(data_path, "psychopdaROC_constant.csv"))
psychopdaROC(
data = constant_data,
classVar = "outcome",
positiveClass = "Positive",
negativeClass = "Negative",
dependentVars = "constant_marker",
refVar = NULL
)Missing data
missing_data <- read.csv(paste0(data_path, "psychopdaROC_missing.csv"))
psychopdaROC(
data = missing_data,
classVar = "diagnosis",
positiveClass = "Disease",
negativeClass = "Healthy",
dependentVars = vars(test_a, test_b),
refVar = NULL
)Rare disease (5% prevalence)
psychopdaROC(
data = rare_data,
classVar = "rare_disease",
positiveClass = "Disease",
negativeClass = "No_Disease",
dependentVars = "biomarker",
refVar = NULL
)Large dataset (n=500)
psychopdaROC(
data = large_data,
classVar = "disease_status",
positiveClass = "Disease",
negativeClass = "No_Disease",
dependentVars = vars(biomarker1, biomarker2),
refVar = NULL
)18. Time-Dependent & Spectrum Analysis
Compare baseline vs follow-up markers
timedep_data <- read.csv(paste0(data_path, "psychopdaROC_timedep.csv"))
psychopdaROC(
data = timedep_data,
classVar = "outcome",
positiveClass = "Event",
negativeClass = "No_Event",
dependentVars = vars(baseline_marker, followup_marker),
delongTest = TRUE,
combinePlots = TRUE,
refVar = NULL
)Disease spectrum data
spectrum_data <- read.csv(paste0(data_path, "psychopdaROC_spectrum.csv"))
psychopdaROC(
data = spectrum_data,
classVar = "binary_status",
positiveClass = "Positive",
negativeClass = "Negative",
dependentVars = "continuous_marker",
refVar = NULL
)19. Comprehensive Publication-Ready Scenario
Full research-grade analysis combining multiple features.
psychopdaROC(
data = multi_data,
classVar = "diagnosis",
positiveClass = "Positive",
negativeClass = "Negative",
dependentVars = vars(marker1, marker2, marker3, combined_score),
clinicalMode = "comprehensive",
method = "maximize_metric",
metric = "youden",
delongTest = TRUE,
calculateIDI = TRUE,
calculateNRI = TRUE,
refVar = NULL,
bootstrapCI = TRUE,
bootstrapReps = 100,
clinicalUtilityAnalysis = TRUE,
plotROC = TRUE,
combinePlots = TRUE,
cleanPlot = TRUE,
sensSpecTable = TRUE
)References
- Youden WJ (1950). Index for rating diagnostic tests. Cancer, 3(1), 32-35.
- DeLong ER, DeLong DM, Clarke-Pearson DL (1988). Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. Biometrics, 44(3), 837-845.
- Pencina MJ, D’Agostino RB, D’Agostino RB Jr, Vasan RS (2008). Evaluating the added predictive ability of a new marker: from area under the ROC curve to reclassification and beyond. Statistics in Medicine, 27(2), 157-172.
- Thiele C, Hirschfeld G (2021). cutpointr: Improved estimation and validation of optimal cutpoints in R. Journal of Statistical Software, 98(11), 1-27.
- Robin X, Turck N, Hainard A, et al. (2011). pROC: an open-source package for R and S+ to analyze and compare ROC curves. BMC Bioinformatics, 12, 77.
- Vickers AJ, Elkin EB (2006). Decision curve analysis: a novel method for evaluating prediction models. Medical Decision Making, 26(6), 565-574.