Create a synthetic benchmark dataset bundle
Source:R/benchmark-validation.R
createBenchmarkExample.RdGenerates prediction/reference CSV pairs and a manifest for dry-run validation benchmarking when external data are not yet available.
References
Bland JM, Altman DG (1986). "Statistical Methods for Assessing Agreement Between Two Methods of Clinical Measurement." Lancet, 327(8476), 307-310.
See also
runBenchmarkSuite() for running the benchmark suite,
benchmarkManifestTemplate() for creating empty manifest templates.
Examples
ex <- createBenchmarkExample(n_trials = 2, seed = 1)
runBenchmarkSuite(ex$manifest, data_dir = ex$data_dir)
#> Benchmark suite
#> Trials: 2
#> Variables: 6
#> Variable pass rate: 100.0%
#> Trial pass rate: 100.0%
#> Mean RMSE: 0.02067
#> Mean Cor: 0.9998
#> Mean ICC: 0.9998