Prepare release notes
Go over PRs since last PR named “Prepare the x.x.x release.”, add all changes to https://github.com/grf-labs/grf/blob/master/releases/CHANGELOG.md
Bump version in DESCRIPTION
Bump patch release version (1.0.0 → 1.0.1), or minor version if it’s a bigger release (1.0.2 → 1.1.0).
Make sure there are no performance regressions
See below for example scripts to run.
Add/delete removed functions
In case of a major release with breaking functionality, or a subsequent minor release, update the removed functions list in deprecated.R.
Make sure the bundled Eigen version is up to date
Ideally RcppEigen and the bundled version will be the same.
Create release tarball
Run Rscript build_package.R --as-cran from r-package directory. The —as-cran argument makes sure to omit most tests from the package build. Only the test grf/tests/testthat/test_cran_smoke_test.R will be run. The command will make a change to .Rbuildignore, do not commit it.
Run CRAN checks
Run R CMD check --as-cran --run-donttest <release tarball>. There should only be 1 or 2 NOTEs, no WARNINGs or ERRORs. There might be some NOTEs around Makefiles, these are okay to ignore. Fix any failing checks. (The flag —run-donttest runs all documentation examples).
Check package using win-builder
Upload the release tarball to https://win-builder.r-project.org/upload.aspx to check it against the latest R-devel and also R-release on Windows. To test a larger release extra carefully on even more systems you can check it here as well: https://builder.r-hub.io/. For extra checks for a major release, upload a tarball that includes all the R tests not intended to be run on CRAN.
Submit to CRAN
Upload package here: https://cran.r-project.org/submit.html
Tag the release
git tag -a v1.1.0 5342d1de47f7604d86c4e59825bb7e4928a97c16
git push --tags
Where the hash is for the commit “Prepare the x.x.x release”.
check statistical performance + timing
File: https://github.com/grf-labs/grf/blob/master/r-package/grf/tests/benchmarks/causal_benchmark.R
From release v2.1.0 and onwards: File: https://github.com/grf-labs/grf/blob/master/r-package/grf/tests/benchmarks/weighting_benchmark.R
check memory usage
Run the massif tool from valgrind on a simple script. Note that valgrind is often broken on OSX and should be run on a Linux machine.
> R -d "valgrind --tool=massif" -f valgrind_benchmark.R
> ms_print massif.out.34681 &> ms_print.out
The plot should look smooth, and should not contain large spikes in memory consumption (because we only perform training).
The script valgrind_benchmark.R is defined as follows:
library(grf)
n <- 1000
p <- 6
X <- matrix(rnorm(n * p), n, p)
W <- rbinom(n, 1, 0.5)
Y <- W * (X[, 1] + X[, 6]) + rnorm(n)
forest <- causal_forest(X, Y, W)For a big release, can also run R CMD check --as-cran --run-donttest --use-valgrind <development tarball> on a Linux machine with Valgrind for a thorough stress test (will take very long).
2.4.0
This is only a minor release with minimal changes.
2.3.2
This is only a patch release with minor aesthetic R fixes.
2.3.1
This is only a patch release with two minor R fixes.
2.3.0
(Machine: Sherlock 12 cores/150G/R version 3.5.1)
statistical performance
oob test stdratio
Y.error "0.047 +/- 0.001" "0.047 +/- 0.001" "2.471 +/- 0.087"
tau.error "0.009 +/- 0.001" "0.009 +/- 0.001" "1.251 +/- 0.099"
csf.error "0.106 +/- 0.011" "0.105 +/- 0.012" "1.647 +/- 0.210"
mcf.error "0.047 +/- 0.002" "0.048 +/- 0.003" "2.735 +/- 0.143"
speed
user.self sys.self elapsed
Y.time "17.017 +/- 0.063" "0.253 +/- 0.010" "17.315 +/- 0.067"
Y.time.pred "2.854 +/- 0.031" "0.095 +/- 0.008" "2.957 +/- 0.029"
Y.time.ci "4.633 +/- 0.039" "0.102 +/- 0.011" "4.747 +/- 0.042"
tau.time "16.110 +/- 0.084" "0.158 +/- 0.006" "16.308 +/- 0.084"
tau.time.pred "2.530 +/- 0.030" "0.048 +/- 0.003" "2.584 +/- 0.030"
tau.time.ci "3.658 +/- 0.029" "0.074 +/- 0.007" "3.741 +/- 0.033"
survival.time "16.993 +/- 0.301" "0.076 +/- 0.004" "17.109 +/- 0.301"
survival.time.pred "3.651 +/- 0.028" "0.120 +/- 0.005" "3.780 +/- 0.033"
quantile.time "11.008 +/- 0.049" "0.097 +/- 0.002" "11.133 +/- 0.050"
quantile.time.pred "4.642 +/- 0.058" "0.101 +/- 0.010" "4.754 +/- 0.063"
ll.Y.time "14.507 +/- 0.043" "0.187 +/- 0.003" "14.735 +/- 0.043"
ll.Y.time.pred "5.659 +/- 0.028" "0.178 +/- 0.007" "5.851 +/- 0.030"
csf.time "20.955 +/- 0.039" "1.244 +/- 0.013" "20.958 +/- 0.046"
csf.time.pred "1.585 +/- 0.011" "0.027 +/- 0.001" "1.616 +/- 0.011"
csf.time.ci "2.966 +/- 0.014" "0.065 +/- 0.006" "3.038 +/- 0.019"
mcf.time "31.237 +/- 0.087" "0.316 +/- 0.005" "31.627 +/- 0.087"
mcf.time.pred "2.508 +/- 0.011" "0.074 +/- 0.002" "2.590 +/- 0.012"
mcf.time.ci "4.701 +/- 0.011" "0.128 +/- 0.004" "4.840 +/- 0.014"
weighting benchmark
[1] 0.4251887 0.2772103
[1] 0.4251887 0.4097712
[1] 0.2834591 0.2772103
memory usage
MB
214.8^ :
| #:::
| ::::::@@#: ::
| @@:::@@:@:@:@@:: :: @ #: ::
| ::::::::::::@ :: @ :@:@:@ :: :: @ #: ::
| @ :::::::::::: :::: :: ::@ :: @ :@:@:@ :: :: @ #: ::
| @::::::: :: : :: :::: :: ::@ :: @ :@:@:@ :: :: @ #: ::
| @:: :::: :: : :: :::: :: ::@ :: @ :@:@:@ :: :: @ #: ::
| @:: :::: :: : :: :::: :: ::@ :: @ :@:@:@ :: :: @ #: ::
| @@@:: :::: :: : :: :::: :: ::@ :: @ :@:@:@ :: :: @ #: ::
| @: @ @:: :::: :: : :: :::: :: ::@ :: @ :@:@:@ :: :: @ #: ::
| @:::::@ @:: :::: :: : :: :::: :: ::@ :: @ :@:@:@ :: :: @ #: ::
| :@:: : @ @:: :::: :: : :: :::: :: ::@ :: @ :@:@:@ :: :: @ #: ::
| :@:: : @ @:: :::: :: : :: :::: :: ::@ :: @ :@:@:@ :: :: @ #: ::
| @@ :@:: : @ @:: :::: :: : :: :::: :: ::@ :: @ :@:@:@ :: :: @ #: ::
| @ ::::@:: : @ @:: :::: :: : :: :::: :: ::@ :: @ :@:@:@ :: :: @ #: ::
| @@ : :@:: : @ @:: :::: :: : :: :::: :: ::@ :: @ :@:@:@ :: :: @ #: ::
| @@ : :@:: : @ @:: :::: :: : :: :::: :: ::@ :: @ :@:@:@ :: :: @ #: ::
| ::@@ : :@:: : @ @:: :::: :: : :: :::: :: ::@ :: @ :@:@:@ :: :: @ #: ::
| : @@ : :@:: : @ @:: :::: :: : :: :::: :: ::@ :: @ :@:@:@ :: :: @ #: ::
0 +----------------------------------------------------------------------->Gi
0 14.28
2.2.1
This is just a minor patch release which does not touch any perf code.
2.2.0
(Machine: Sherlock 12 cores/150G/R version 3.5.1)
statistical performance
oob test stdratio
Y.error "0.047 +/- 0.001" "0.047 +/- 0.001" "2.471 +/- 0.087"
tau.error "0.009 +/- 0.001" "0.009 +/- 0.001" "1.251 +/- 0.099"
csf.error "0.106 +/- 0.011" "0.105 +/- 0.012" "1.647 +/- 0.210"
mcf.error "0.047 +/- 0.002" "0.048 +/- 0.003" "2.735 +/- 0.143"
speed
user.self sys.self elapsed
Y.time "17.053 +/- 0.096" "0.263 +/- 0.007" "17.359 +/- 0.099"
Y.time.pred "2.914 +/- 0.033" "0.091 +/- 0.008" "3.012 +/- 0.030"
Y.time.ci "4.723 +/- 0.052" "0.108 +/- 0.015" "4.843 +/- 0.057"
tau.time "16.180 +/- 0.069" "0.173 +/- 0.007" "16.392 +/- 0.072"
tau.time.pred "2.589 +/- 0.038" "0.048 +/- 0.002" "2.643 +/- 0.038"
tau.time.ci "3.708 +/- 0.037" "0.084 +/- 0.009" "3.801 +/- 0.043"
survival.time "17.003 +/- 0.293" "0.084 +/- 0.003" "17.128 +/- 0.294"
survival.time.pred "3.720 +/- 0.042" "0.130 +/- 0.006" "3.859 +/- 0.046"
quantile.time "10.970 +/- 0.027" "0.105 +/- 0.003" "11.102 +/- 0.027"
quantile.time.pred "4.723 +/- 0.056" "0.112 +/- 0.006" "4.847 +/- 0.058"
ll.Y.time "14.544 +/- 0.036" "0.199 +/- 0.005" "14.781 +/- 0.039"
ll.Y.time.pred "5.700 +/- 0.028" "0.179 +/- 0.011" "5.893 +/- 0.029"
csf.time "21.805 +/- 0.096" "0.778 +/- 0.015" "19.151 +/- 0.078"
csf.time.pred "1.597 +/- 0.015" "0.027 +/- 0.001" "1.628 +/- 0.016"
csf.time.ci "3.009 +/- 0.024" "0.072 +/- 0.005" "3.088 +/- 0.029"
mcf.time "31.361 +/- 0.126" "0.340 +/- 0.006" "31.777 +/- 0.129"
mcf.time.pred "2.630 +/- 0.025" "0.071 +/- 0.003" "2.707 +/- 0.025"
mcf.time.ci "4.754 +/- 0.018" "0.114 +/- 0.010" "4.880 +/- 0.024"
weighting benchmark
> # These should be different
> c(rate1$estimate, rate2$estimate)
[1] 0.4251887 0.2772103
>
> # These should be similar
> c(rate1$estimate, rate3$estimate)
[1] 0.4251887 0.4097712>
> # These should be similar (because in cc sample have 1/2 instead of 3/4 samples with non-zero TAU)
> c(rate1$estimate * 2 / 3, rate2$estimate)
[1] 0.2834591 0.2772103
memory usage
MB
214.5^ :
| @#::::
| ::@:@::@@#:::@
| : :::::::::::::: @ @::@@#:::@
| @ :::@:@::::::: ::: ::::: :: @ @::@@#:::@
| :::::::@:::::: @:@:: :: : ::: ::::: :: @ @::@@#:::@
| ::::: ::: @: :::: @:@:: :: : ::: ::::: :: @ @::@@#:::@
| @: ::: ::: @: :::: @:@:: :: : ::: ::::: :: @ @::@@#:::@
| @@: ::: ::: @: :::: @:@:: :: : ::: ::::: :: @ @::@@#:::@
| @@: ::: ::: @: :::: @:@:: :: : ::: ::::: :: @ @::@@#:::@
| :: @@: ::: ::: @: :::: @:@:: :: : ::: ::::: :: @ @::@@#:::@
| ::: @::@@: ::: ::: @: :::: @:@:: :: : ::: ::::: :: @ @::@@#:::@
| ::: @::@@: ::: ::: @: :::: @:@:: :: : ::: ::::: :: @ @::@@#:::@
| ::: @::@@: ::: ::: @: :::: @:@:: :: : ::: ::::: :: @ @::@@#:::@
| @::: @::@@: ::: ::: @: :::: @:@:: :: : ::: ::::: :: @ @::@@#:::@
| @:::@::: @::@@: ::: ::: @: :::: @:@:: :: : ::: ::::: :: @ @::@@#:::@
| @@:: @::: @::@@: ::: ::: @: :::: @:@:: :: : ::: ::::: :: @ @::@@#:::@
| :@@:: @::: @::@@: ::: ::: @: :::: @:@:: :: : ::: ::::: :: @ @::@@#:::@
| ::@@:: @::: @::@@: ::: ::: @: :::: @:@:: :: : ::: ::::: :: @ @::@@#:::@
| ::@@:: @::: @::@@: ::: ::: @: :::: @:@:: :: : ::: ::::: :: @ @::@@#:::@
0 +----------------------------------------------------------------------->Gi
0 14.20
2.1.0
(Machine: Sherlock 12 cores/150G/R version 3.5.1)
statistical performance
oob test stdratio
Y.error "0.047 +/- 0.001" "0.047 +/- 0.001" "2.471 +/- 0.087"
tau.error "0.009 +/- 0.001" "0.009 +/- 0.001" "1.251 +/- 0.099"
csf.error "0.106 +/- 0.011" "0.105 +/- 0.012" "1.647 +/- 0.210"
mcf.error "0.047 +/- 0.002" "0.048 +/- 0.003" "2.735 +/- 0.143"
speed
user.self sys.self elapsed
Y.time "16.821 +/- 0.079" "0.265 +/- 0.006" "17.131 +/- 0.080"
Y.time.pred "2.918 +/- 0.037" "0.100 +/- 0.009" "3.026 +/- 0.033"
Y.time.ci "4.725 +/- 0.045" "0.100 +/- 0.016" "4.836 +/- 0.042"
tau.time "15.826 +/- 0.082" "0.170 +/- 0.005" "16.033 +/- 0.082"
tau.time.pred "2.615 +/- 0.036" "0.056 +/- 0.006" "2.677 +/- 0.037"
tau.time.ci "3.725 +/- 0.038" "0.088 +/- 0.009" "3.823 +/- 0.043"
survival.time "17.140 +/- 0.284" "0.090 +/- 0.003" "17.270 +/- 0.286"
survival.time.pred "3.721 +/- 0.049" "0.110 +/- 0.006" "3.840 +/- 0.051"
quantile.time "10.856 +/- 0.038" "0.106 +/- 0.003" "10.988 +/- 0.037"
quantile.time.pred "4.723 +/- 0.051" "0.109 +/- 0.007" "4.843 +/- 0.053"
ll.Y.time "14.395 +/- 0.077" "0.184 +/- 0.006" "14.617 +/- 0.082"
ll.Y.time.pred "5.742 +/- 0.020" "0.162 +/- 0.014" "5.918 +/- 0.023"
csf.time "27.040 +/- 0.125" "0.791 +/- 0.012" "19.505 +/- 0.083"
csf.time.pred "1.616 +/- 0.020" "0.028 +/- 0.002" "1.648 +/- 0.020"
csf.time.ci "3.007 +/- 0.028" "0.065 +/- 0.006" "3.080 +/- 0.032"
mcf.time "31.038 +/- 0.133" "0.325 +/- 0.007" "31.437 +/- 0.133"
mcf.time.pred "2.546 +/- 0.014" "0.083 +/- 0.003" "2.635 +/- 0.015"
mcf.time.ci "4.742 +/- 0.015" "0.132 +/- 0.008" "4.885 +/- 0.018"
weighting benchmark
> # These should be different
> c(rate1$estimate, rate2$estimate)
[1] 0.4251887 0.2772103
>
> # These should be similar
> c(rate1$estimate, rate3$estimate)
[1] 0.4251887 0.4097712
>
> # These should be similar (because in cc sample have 1/2 instead of 3/4 samples with non-zero TAU)
> c(rate1$estimate * 2 / 3, rate2$estimate)
[1] 0.2834591 0.2772103
memory usage
MB
214.8^ #
| @#::::
| ::::@:@@#::::
| ::@::@:::::::: : @:@@#::::
| @ ::::@@@::::::: @: @::: :::: : @:@@#::::
| ::::@@:@::::: ::@@ :: :::: @: @::: :::: : @:@@#::::
| :@: ::@ :@:: :: ::@@ :: :::: @: @::: :::: : @:@@#::::
| :@: ::@ :@:: :: ::@@ :: :::: @: @::: :::: : @:@@#::::
| @@@:@: ::@ :@:: :: ::@@ :: :::: @: @::: :::: : @:@@#::::
| @ :@: ::@ :@:: :: ::@@ :: :::: @: @::: :::: : @:@@#::::
| : @ :@: ::@ :@:: :: ::@@ :: :::: @: @::: :::: : @:@@#::::
| ::::::@ :@: ::@ :@:: :: ::@@ :: :::: @: @::: :::: : @:@@#::::
| @@:::: :@ :@: ::@ :@:: :: ::@@ :: :::: @: @::: :::: : @:@@#::::
| @ :::: :@ :@: ::@ :@:: :: ::@@ :: :::: @: @::: :::: : @:@@#::::
| @@ :::: :@ :@: ::@ :@:: :: ::@@ :: :::: @: @::: :::: : @:@@#::::
| @@:@@ :::: :@ :@: ::@ :@:: :: ::@@ :: :::: @: @::: :::: : @:@@#::::
| @ :@@ :::: :@ :@: ::@ :@:: :: ::@@ :: :::: @: @::: :::: : @:@@#::::
| :@@ :@@ :::: :@ :@: ::@ :@:: :: ::@@ :: :::: @: @::: :::: : @:@@#::::
| :@@ :@@ :::: :@ :@: ::@ :@:: :: ::@@ :: :::: @: @::: :::: : @:@@#::::
|@@:@@ :@@ :::: :@ :@: ::@ :@:: :: ::@@ :: :::: @: @::: :::: : @:@@#::::
0 +----------------------------------------------------------------------->Gi
0 14.25
2.0.2
Patch release to retain CRAN Solaris compatibility
2.0.0
(Machine: Sherlock 12 cores/150G/R version 3.5.1)
statistical performance
oob test stdratio
Y.error "0.047 +/- 0.001" "0.047 +/- 0.001" "2.471 +/- 0.087"
tau.error "0.009 +/- 0.001" "0.009 +/- 0.001" "1.251 +/- 0.099"
csf.error "0.105 +/- 0.011" "0.104 +/- 0.011" "1.600 +/- 0.201"
mcf.error "0.047 +/- 0.002" "0.048 +/- 0.003" "2.735 +/- 0.143"
speed
user.self sys.self elapsed
Y.time "16.556 +/- 0.072" "0.251 +/- 0.008" "16.852 +/- 0.078"
Y.time.pred "2.828 +/- 0.033" "0.084 +/- 0.012" "2.919 +/- 0.030"
Y.time.ci "4.606 +/- 0.040" "0.098 +/- 0.018" "4.716 +/- 0.048"
tau.time "15.420 +/- 0.060" "0.169 +/- 0.006" "15.625 +/- 0.062"
tau.time.pred "2.496 +/- 0.030" "0.051 +/- 0.006" "2.553 +/- 0.027"
tau.time.ci "3.624 +/- 0.028" "0.082 +/- 0.008" "3.714 +/- 0.027"
survival.time "16.511 +/- 0.227" "0.083 +/- 0.003" "16.632 +/- 0.227"
survival.time.pred "3.696 +/- 0.033" "0.109 +/- 0.008" "3.814 +/- 0.037"
quantile.time "10.707 +/- 0.025" "0.094 +/- 0.006" "10.828 +/- 0.027"
quantile.time.pred "4.597 +/- 0.053" "0.111 +/- 0.008" "4.720 +/- 0.058"
ll.Y.time "14.064 +/- 0.039" "0.196 +/- 0.006" "14.298 +/- 0.038"
ll.Y.time.pred "5.639 +/- 0.034" "0.173 +/- 0.007" "5.825 +/- 0.038"
csf.time "22.425 +/- 0.086" "1.380 +/- 0.014" "15.227 +/- 0.071"
csf.time.pred "1.540 +/- 0.017" "0.031 +/- 0.001" "1.575 +/- 0.017"
csf.time.ci "2.952 +/- 0.027" "0.065 +/- 0.005" "3.025 +/- 0.031"
mcf.time "30.323 +/- 0.095" "0.269 +/- 0.006" "30.665 +/- 0.100"
mcf.time.pred "2.468 +/- 0.015" "0.078 +/- 0.002" "2.552 +/- 0.015"
mcf.time.ci "4.851 +/- 0.014" "0.131 +/- 0.007" "4.994 +/- 0.018"
memory usage
MB
214.5^ :
| #::::
| :::@:::#::::
| ::::::::::::::: @:: #::::
| @ ::::::@@:::::@@::::: ::::: ::: @:: #::::
| :::@::@:::: :: :@ : :::@ ::::: ::::: ::: @:: #::::
| ::::: :@: @: :: :: :@ : :::@ ::::: ::::: ::: @:: #::::
| :: :: :@: @: :: :: :@ : :::@ ::::: ::::: ::: @:: #::::
| @@:: :: :@: @: :: :: :@ : :::@ ::::: ::::: ::: @:: #::::
| @ :: :: :@: @: :: :: :@ : :::@ ::::: ::::: ::: @:: #::::
| @@ :: :: :@: @: :: :: :@ : :::@ ::::: ::::: ::: @:: #::::
| :::@@:@@ :: :: :@: @: :: :: :@ : :::@ ::::: ::::: ::: @:: #::::
| :: @ :@@ :: :: :@: @: :: :: :@ : :::@ ::::: ::::: ::: @:: #::::
| :: @ :@@ :: :: :@: @: :: :: :@ : :::@ ::::: ::::: ::: @:: #::::
| @ @@:: @ :@@ :: :: :@: @: :: :: :@ : :::@ ::::: ::::: ::: @:: #::::
| @::@ :: @ :@@ :: :: :@: @: :: :: :@ : :::@ ::::: ::::: ::: @:: #::::
| :@::@ :: @ :@@ :: :: :@: @: :: :: :@ : :::@ ::::: ::::: ::: @:: #::::
| :@::@ :: @ :@@ :: :: :@: @: :: :: :@ : :::@ ::::: ::::: ::: @:: #::::
| @@:@::@ :: @ :@@ :: :: :@: @: :: :: :@ : :::@ ::::: ::::: ::: @:: #::::
| @ :@::@ :: @ :@@ :: :: :@: @: :: :: :@ : :::@ ::::: ::::: ::: @:: #::::
0 +----------------------------------------------------------------------->Gi
0 14.25
1.2.0
(Machine: Sherlock 12 cores/150G/R version 3.5.1)
statistical performance
oob test stdratio
Y.error "0.050 +/- 0.002" "0.050 +/- 0.002" "2.823 +/- 0.199"
tau.error "0.008 +/- 0.001" "0.008 +/- 0.001" "1.084 +/- 0.089"
speed (slight time increase is due to removal of the big Q splitting rule #635)
user.self sys.self elapsed
Y.time "18.048 +/- 0.042" "0.213 +/- 0.003" "18.306 +/- 0.042"
Y.time.pred "2.779 +/- 0.018" "0.057 +/- 0.006" "2.843 +/- 0.013"
Y.time.ci "4.657 +/- 0.022" "0.090 +/- 0.011" "4.759 +/- 0.026"
tau.time "17.049 +/- 0.077" "0.128 +/- 0.004" "17.220 +/- 0.078"
tau.time.pred "2.476 +/- 0.019" "0.029 +/- 0.003" "2.511 +/- 0.017"
tau.time.ci "3.677 +/- 0.015" "0.062 +/- 0.003" "3.748 +/- 0.015"
# The following section is new for this release:
survival.time "17.897 +/- 0.279" "0.062 +/- 0.001" "18.000 +/- 0.279"
survival.time.pred "3.769 +/- 0.035" "0.085 +/- 0.003" "3.863 +/- 0.034"
quantile.time "12.978 +/- 0.022" "0.085 +/- 0.002" "13.094 +/- 0.023"
quantile.time.pred "4.611 +/- 0.026" "0.078 +/- 0.005" "4.701 +/- 0.027"
ll.Y.time "15.653 +/- 0.034" "0.166 +/- 0.008" "15.859 +/- 0.032"
ll.Y.time.pred "5.567 +/- 0.009" "0.170 +/- 0.009" "5.750 +/- 0.010"
memory usage
MB
218.7^ :
| @@:#:
| :@::@:@@@:#:
| @::@::@:@::@::@::@::@:@@@:#:
| :@::::::::@::@::@::@:@::@::@::@::@:@@@:#:
| :@:::::@:@::::::::@::@::@::@:@::@::@::@::@:@@@:#:
| ::::@::::@:::::@:@::::::::@::@::@::@:@::@::@::@::@:@@@:#:
| :: :@::::@:::::@:@::::::::@::@::@::@:@::@::@::@::@:@@@:#:
| @:: :@::::@:::::@:@::::::::@::@::@::@:@::@::@::@::@:@@@:#:
| @:: :@::::@:::::@:@::::::::@::@::@::@:@::@::@::@::@:@@@:#:
| @:: :@::::@:::::@:@::::::::@::@::@::@:@::@::@::@::@:@@@:#:
| :::::@:: :@::::@:::::@:@::::::::@::@::@::@:@::@::@::@::@:@@@:#:
| @@:::: @:: :@::::@:::::@:@::::::::@::@::@::@:@::@::@::@::@:@@@:#:
| @ :::: @:: :@::::@:::::@:@::::::::@::@::@::@:@::@::@::@::@:@@@:#:
| @ :::: @:: :@::::@:::::@:@::::::::@::@::@::@:@::@::@::@::@:@@@:#:
| :::@ :::: @:: :@::::@:::::@:@::::::::@::@::@::@:@::@::@::@::@:@@@:#:
| ::: @ :::: @:: :@::::@:::::@:@::::::::@::@::@::@:@::@::@::@::@:@@@:#:
| :::: @ :::: @:: :@::::@:::::@:@::::::::@::@::@::@:@::@::@::@::@:@@@:#:
|:::::: @ :::: @:: :@::::@:::::@:@::::::::@::@::@::@:@::@::@::@::@:@@@:#:
|: :::: @ :::: @:: :@::::@:::::@:@::::::::@::@::@::@:@::@::@::@::@:@@@:#:
0 +----------------------------------------------------------------------->Gi
0 16.28
1.1.0
(Machine: Sherlock 12 cores/150G/R version 3.5.1)
statistical performance
oob test stdratio
Y.error "0.048 +/- 0.001" "0.049 +/- 0.001" "2.667 +/- 0.110"
tau.error "0.010 +/- 0.001" "0.009 +/- 0.001" "1.298 +/- 0.093"
speed
user.self sys.self elapsed
Y.time "15.796 +/- 0.052" "0.212 +/- 0.002" "16.046 +/- 0.052"
Y.time.pred "2.655 +/- 0.006" "0.114 +/- 0.003" "2.776 +/- 0.006"
Y.time.ci "4.449 +/- 0.012" "0.156 +/- 0.002" "4.616 +/- 0.011"
tau.time "15.508 +/- 0.077" "0.117 +/- 0.004" "15.663 +/- 0.075"
tau.time.pred "2.336 +/- 0.013" "0.068 +/- 0.002" "2.409 +/- 0.013"
tau.time.ci "3.495 +/- 0.007" "0.108 +/- 0.003" "3.611 +/- 0.007"
memory usage
MB
219.2^ :
| @#::
| @:::@::@@#::
| :::::::::@@::::::::@: :@::@@#::
| ::::@@:::::::::::: : @ :: :::::@: :@::@@#::
| @@ ::@@::::::::@ ::::: :::::: : @ :: :::::@: :@::@@#::
| @ @:::::::@ : : ::::@ ::::: :::::: : @ :: :::::@: :@::@@#::
| @@ @:::: ::@ : : ::::@ ::::: :::::: : @ :: :::::@: :@::@@#::
| @@ @:::: ::@ : : ::::@ ::::: :::::: : @ :: :::::@: :@::@@#::
| @@ @:::: ::@ : : ::::@ ::::: :::::: : @ :: :::::@: :@::@@#::
| : @@ @:::: ::@ : : ::::@ ::::: :::::: : @ :: :::::@: :@::@@#::
| :::::@@ @:::: ::@ : : ::::@ ::::: :::::: : @ :: :::::@: :@::@@#::
| :: ::@@ @:::: ::@ : : ::::@ ::::: :::::: : @ :: :::::@: :@::@@#::
| :: ::@@ @:::: ::@ : : ::::@ ::::: :::::: : @ :: :::::@: :@::@@#::
| @@:: ::@@ @:::: ::@ : : ::::@ ::::: :::::: : @ :: :::::@: :@::@@#::
| ::@ :: ::@@ @:::: ::@ : : ::::@ ::::: :::::: : @ :: :::::@: :@::@@#::
| :: @ :: ::@@ @:::: ::@ : : ::::@ ::::: :::::: : @ :: :::::@: :@::@@#::
| ::: @ :: ::@@ @:::: ::@ : : ::::@ ::::: :::::: : @ :: :::::@: :@::@@#::
| ::: @ :: ::@@ @:::: ::@ : : ::::@ ::::: :::::: : @ :: :::::@: :@::@@#::
| ::: @ :: ::@@ @:::: ::@ : : ::::@ ::::: :::::: : @ :: :::::@: :@::@@#::
0 +----------------------------------------------------------------------->Gi
0 18.83
1.0.1 (patch release with only one commit that fixes the print order of trees on the R side)
1.0.0
(Machine: Sherlock 12 cores/150G/R version 3.5.1)
statistical performance
oob test stdratio
Y.error "0.048 +/- 0.001" "0.049 +/- 0.001" "2.697 +/- 0.117"
tau.error "0.010 +/- 0.001" "0.009 +/- 0.001" "1.295 +/- 0.096"
speed
user.self sys.self elapsed
Y.time "14.314 +/- 0.053" "0.199 +/- 0.005" "14.549 +/- 0.056"
Y.time.pred "2.469 +/- 0.007" "0.105 +/- 0.002" "2.581 +/- 0.008"
Y.time.ci "4.252 +/- 0.014" "0.149 +/- 0.003" "4.412 +/- 0.013"
tau.time "17.168 +/- 0.039" "0.119 +/- 0.004" "17.328 +/- 0.038"
tau.time.pred "2.172 +/- 0.007" "0.066 +/- 0.002" "2.243 +/- 0.007"
tau.time.ci "3.366 +/- 0.012" "0.107 +/- 0.002" "3.480 +/- 0.011"
memory usage
MB
216.9^ ::
| #: :
| :::::::::::#: :
| :::::@@:@::@::::::: ::: :::#: :
| ::::@::@:::: :: @ :@: @:::: :: ::: :::#: :
| @@ @@@@@@@::: @: @:: : :: @ :@: @:::: :: ::: :::#: :
| @ :::::@ @ @ ::: @: @:: : :: @ :@: @:::: :: ::: :::#: :
| @@ :: : @ @ @ ::: @: @:: : :: @ :@: @:::: :: ::: :::#: :
| @@ :: : @ @ @ ::: @: @:: : :: @ :@: @:::: :: ::: :::#: :
| @@ :: : @ @ @ ::: @: @:: : :: @ :@: @:::: :: ::: :::#: :
| :@@ :: : @ @ @ ::: @: @:: : :: @ :@: @:::: :: ::: :::#: :
| :::::@@ :: : @ @ @ ::: @: @:: : :: @ :@: @:::: :: ::: :::#: :
| @@:: ::@@ :: : @ @ @ ::: @: @:: : :: @ :@: @:::: :: ::: :::#: :
| @ :: ::@@ :: : @ @ @ ::: @: @:: : :: @ :@: @:::: :: ::: :::#: :
| @ :: ::@@ :: : @ @ @ ::: @: @:: : :: @ :@: @:::: :: ::: :::#: :
| @:::@ :: ::@@ :: : @ @ @ ::: @: @:: : :: @ :@: @:::: :: ::: :::#: :
| @: :@ :: ::@@ :: : @ @ @ ::: @: @:: : :: @ :@: @:::: :: ::: :::#: :
| @: :@ :: ::@@ :: : @ @ @ ::: @: @:: : :: @ :@: @:::: :: ::: :::#: :
| ::@: :@ :: ::@@ :: : @ @ @ ::: @: @:: : :: @ :@: @:::: :: ::: :::#: :
| : @: :@ :: ::@@ :: : @ @ @ ::: @: @:: : :: @ :@: @:::: :: ::: :::#: :
0 +----------------------------------------------------------------------->Gi
0 16.64
0.10.4
statistical performance
oob test stdratio
Y.error "0.048 +/- 0.001" "0.049 +/- 0.001" "2.697 +/- 0.117"
tau.error "0.010 +/- 0.001" "0.009 +/- 0.001" "1.295 +/- 0.096"
speed
Y.time "17.371 +/- 0.157" "0.096 +/- 0.006" "17.500 +/- 0.172"
Y.time.pred "2.375 +/- 0.030" "0.071 +/- 0.008" "2.472 +/- 0.053"
Y.time.ci "5.527 +/- 0.147" "0.088 +/- 0.022" "5.693 +/- 0.199"
tau.time "18.416 +/- 0.214" "0.072 +/- 0.016" "18.535 +/- 0.248"
tau.time.pred "2.462 +/- 0.058" "0.035 +/- 0.001" "2.502 +/- 0.058"
tau.time.ci "4.662 +/- 0.090" "0.036 +/- 0.003" "4.704 +/- 0.093"
memory usage
MB
215.9^ :
| @#:
| ::::::@:::@@:@#:
| ::::@@::@@:::::::::::::: : @:::@ :@#:
| :::@:::::::::: :@ ::@ :: : :: :: ::: : @:::@ :@#:
| :::::::: :@: ::::: :: :@ ::@ :: : :: :: ::: : @:::@ :@#:
| @@::::: : ::: :@: ::::: :: :@ ::@ :: : :: :: ::: : @:::@ :@#:
| @@@ :: :: : ::: :@: ::::: :: :@ ::@ :: : :: :: ::: : @:::@ :@#:
| @ @ :: :: : ::: :@: ::::: :: :@ ::@ :: : :: :: ::: : @:::@ :@#:
| @ @ :: :: : ::: :@: ::::: :: :@ ::@ :: : :: :: ::: : @:::@ :@#:
| :@ @ :: :: : ::: :@: ::::: :: :@ ::@ :: : :: :: ::: : @:::@ :@#:
| :::@ @ :: :: : ::: :@: ::::: :: :@ ::@ :: : :: :: ::: : @:::@ :@#:
| :::@ @ :: :: : ::: :@: ::::: :: :@ ::@ :: : :: :: ::: : @:::@ :@#:
| :::::@ @ :: :: : ::: :@: ::::: :: :@ ::@ :: : :: :: ::: : @:::@ :@#:
| : :::@ @ :: :: : ::: :@: ::::: :: :@ ::@ :: : :: :: ::: : @:::@ :@#:
| ::: :::@ @ :: :: : ::: :@: ::::: :: :@ ::@ :: : :: :: ::: : @:::@ :@#:
| ::: :::@ @ :: :: : ::: :@: ::::: :: :@ ::@ :: : :: :: ::: : @:::@ :@#:
| ::: :::@ @ :: :: : ::: :@: ::::: :: :@ ::@ :: : :: :: ::: : @:::@ :@#:
| ::: :::@ @ :: :: : ::: :@: ::::: :: :@ ::@ :: : :: :: ::: : @:::@ :@#:
| ::: :::@ @ :: :: : ::: :@: ::::: :: :@ ::@ :: : :: :: ::: : @:::@ :@#:
0 +----------------------------------------------------------------------->Gi
0 24.72