Skip to content

Commit d2d2a94

Browse files
committed
add note about dcalib use
1 parent c642a31 commit d2d2a94

File tree

4 files changed

+10
-5
lines changed

4 files changed

+10
-5
lines changed

DESCRIPTION

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
Package: mlr3proba
22
Title: Probabilistic Supervised Learning for 'mlr3'
3-
Version: 0.4.0.9000
3+
Version: 0.4.0
44
Authors@R:
55
c(person(given = "Raphael",
66
family = "Sonabend",

NEWS.md

Lines changed: 1 addition & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -1,14 +1,11 @@
1-
# mlr3proba 0.4.0.9000
2-
3-
- Internal changes only.
4-
51

62
# mlr3proba 0.4.0
73

84
* Deprecated measures from 0.2.0 have now been deleted.
95
* IPCW measures such as `surv.graf`, `surv.schmid`, and `surv.intlogloss` now allow training data to be passed to the score function with `task` and `train_set` to allow the censoring distribution to be estimated on the training data. This is automatically applied for resample and benchmark results.
106
* IPCW measures such as `surv.graf`, `surv.schmid`, and `surv.intlogloss` now include a parameter `proper` to determine what weighting scheme should be applied by the estimated censoring distribution, The current method (Graf, 1999) `proper = FALSE`, weights observations either by their event time or 'current' time depending if they're dead or not, the new method `proper = TRUE` weights observations by event time. The `proper = TRUE` method is strictly proper when censoring and survival times are independent and G is estimated on large enough data. The `proper = FALSE` method is never proper. The default is currently `proper = FALSE` to enable backward compatibility, this will be changed to `proper = TRUE` in v0.6.0.
117
* The `rm_cens` parameter in `surv.logloss` has been deprecated in favour of `IPCW`. `rm_cens` will be removed in v0.6.0. If `rm_cens` or `IPCW` are `TRUE` then censored observations are removed and the score is weighted by an estimate of the censoring distribution at individual event times. Otherwise if `rm_cens` and `IPCW` are `FALSE` then no deletion or weighting takes place. The `IPCW = TRUE` method is strictly proper when censoring and survival times are independent and G is estimated on large enough data. The `ipcw = FALSE` method is never proper.
8+
* Add `surv.dcalib` for the D-Calibration measure from Haider et al. (2020).
129

1310
# mlr3proba 0.3.2
1411

R/MeasureSurvDCalibration.R

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -19,6 +19,10 @@
1919
#' is well-calibration. If `chisq = FALSE` and `m` is the predicted value then you can manually
2020
#' compute the p.value with `pchisq(m, B - 1, lower.tail = FALSE)`.
2121
#'
22+
#' NOTE: This measure is still experimental both theoretically and in implementation. Results
23+
#' should therefore only be taken as an indicator of performance and not for
24+
#' conclusive judgements about model calibration.
25+
#'
2226
#' @references
2327
#' `r format_bib("haider_2020")`
2428
#'

man/mlr_measures_surv.dcalib.Rd

Lines changed: 4 additions & 0 deletions
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

0 commit comments

Comments
 (0)