accuracy {bbl}R Documentation

Compute Prediction Accuracy

Description

Accuracy of predicted response probability is computed.

Usage

accuracy(object, prediction, balanced = FALSE)

Arguments

object

Object of class bbl with test data in data slot.

prediction

Data frame of predicted response group probability from predict.

balanced

Compute balanced accuracy. If TRUE,

s = \frac{1}{K}∑_y \frac{1}{n_y} ∑_{k\in y} δ≤ft({\hat y}_k = y\right).

If FALSE,

s = \frac{1}{n}∑_{k} δ≤ft({\hat y}_k = y_k\right).

Details

An option is provided for computing group-balanced accuracy, where prediction score is calculated for each group separately and averaged.

Value

List of acc (accuracy score) and yhat (predicted response group).

Examples

titanic <- freq2raw(as.data.frame(Titanic), Freq='Freq')
nsample <- NROW(titanic)
mod <- bbl(data=titanic, y='Survived')
mod <- mod[sample(nsample),]
mtrain <- mod[seq(nsample/2),]
mtest <- mod[seq(nsample/2,nsample),]
mtrain <- train(mtrain, method='mf')
pred <- predict(mtrain, newdata=mtest@data)
score <- accuracy(mtest, prediction=pred, balanced=TRUE) 

[Package bbl version 0.1.5 Index]