Logistic regression via hierarchical Bayesian methods
Source:R/logistic_reg_stan_glmer.R
details_logistic_reg_stan_glmer.RdThe "stan_glmer" engine estimates hierarchical regression parameters using
Bayesian estimation.
Details
For this engine, there is a single mode: classification
Important engine-specific options
Some relevant arguments that can be passed to set_engine():
chains: A positive integer specifying the number of Markov chains. The default is 4.iter: A positive integer specifying the number of iterations for each chain (including warmup). The default is 2000.seed: The seed for random number generation.cores: Number of cores to use when executing the chains in parallel.prior: The prior distribution for the (non-hierarchical) regression coefficients.prior_intercept: The prior distribution for the intercept (after centering all predictors).
See ?rstanarm::stan_glmer and ?rstan::sampling for more information.
Translation from parsnip to the original package
The multilevelmod extension package is required to fit this model.
library(multilevelmod)
logistic_reg() %>%
set_engine("stan_glmer") %>%
translate()Predicting new samples
This model can use subject-specific coefficient estimates to make
predictions (i.e. partial pooling). For example, this equation shows the
linear predictor (\eta) for a random intercept:
where $i$ denotes the ith independent experimental unit
(e.g. subject). When the model has seen subject i, it can use that
subject’s data to adjust the population intercept to be more specific
to that subjects results.
What happens when data are being predicted for a subject that was not used in the model fit? In that case, this package uses only the population parameter estimates for prediction:
Depending on what covariates are in the model, this might have the effect of making the same prediction for all new samples. The population parameters are the “best estimate” for a subject that was not included in the model fit.
The tidymodels framework deliberately constrains predictions for new data to not use the training set or other data (to prevent information leakage).
Preprocessing requirements
There are no specific preprocessing needs. However, it is helpful to keep the clustering/subject identifier column as factor or character (instead of making them into dummy variables). See the examples in the next section.
Other details
The model can accept case weights.
With parsnip, we suggest using the formula method when fitting:
library(tidymodels)
data("toenail", package = "HSAUR3")
logistic_reg() %>%
set_engine("stan_glmer") %>%
fit(outcome ~ treatment * visit + (1 | patientID), data = toenail)When using tidymodels infrastructure, it may be better to use a
workflow. In this case, you can add the appropriate columns using
add_variables() then supply the typical formula when adding the model:
library(tidymodels)
glmer_spec <-
logistic_reg() %>%
set_engine("stan_glmer")
glmer_wflow <-
workflow() %>%
# The data are included as-is using:
add_variables(outcomes = outcome, predictors = c(treatment, visit, patientID)) %>%
add_model(glmer_spec, formula = outcome ~ treatment * visit + (1 | patientID))
fit(glmer_wflow, data = toenail)For prediction, the "stan_glmer" engine can compute posterior
intervals analogous to confidence and prediction intervals. In these
instances, the units are the original outcome. When std_error = TRUE,
the standard deviation of the posterior distribution (or posterior
predictive distribution as appropriate) is returned.
Case weights
This model can utilize case weights during model fitting. To use them,
see the documentation in case_weights and the examples
on tidymodels.org.
The fit() and fit_xy() arguments have arguments called
case_weights that expect vectors of case weights.