cvcomp {gcl}R Documentation

Compare two models using crossvalidation

Description

unction to perform crossvalidation comparison of two predictive models on the same data.

Usage

cvcomp(df, mb1, mb2, eval, folds = 5, seed = NULL, cv.verbose = F, ...)

Arguments

df The data frame, last column is outcome
mb1 Model builder 1, must return a function that takes df as input and returns a matrix where entry (i,j) is the classifiers belief of case i's memebership in class j
mb2 Model builder 2, must return a function that takes df as input and returns a matrix where entry (i,j) is the classifiers belief of case i's memebership in class j
eval Evaluation function, takes as input classifier generated by mb[12] above and data frame df
folds Number of folds.
seed Random seed.
cv.verbose If TRUE, spew info.
... Passed on.

Value

Returns a list.

tt T-test of cv differences
tcis cv results from mb1
lcis cv results from mb2

Author(s)

Staal A. Vinterbo staal@dsg.harvard.edu

See Also

cv,cv52, acc.eval,ci.eval

Examples

## Not run: 
cvcomp(df, gcl, tcl, acc.eval)
## End(Not run)

[Package gcl version 1.06.5 Index]