Summarize a design-simulation study
Usage
# S3 method for class 'mfrm_design_evaluation'
summary(object, digits = 3, ...)Arguments
- object
Output from
evaluate_mfrm_design().- digits
Number of digits used in the returned numeric summaries.
- ...
Reserved for generic compatibility.
Value
An object of class summary.mfrm_design_evaluation with components:
overview: run-level overviewdesign_summary: aggregated design-by-facet metrics, with design-variable alias columns when applicablesparse_review: compact planned-missingness and rater-link review counts when sparse linked designs are activeademp: simulation-study metadata carried forward from the original objectfacet_names: public facet labels carried from the simulation specificationdesign_variable_aliases: accepted public aliases for design variablesdesign_descriptor: role-based design-variable metadataplanning_scope: explicit record of the current planning contractplanning_constraints: explicit record of mutable/locked design variablesplanning_schema: structured planning metadatastructural_design_review: deterministic structural review of the named-facet design grid; it reports design bookkeeping rather than simulation performancenotes: short interpretation notes
Details
The summary emphasizes condition-level averages that are useful for practical design planning, especially:
convergence rate
separation and reliability by facet
severity recovery RMSE
mean misfit rate
Examples
# \donttest{
sim_eval <- suppressWarnings(evaluate_mfrm_design(
n_person = c(8, 12),
n_rater = 2,
n_criterion = 2,
raters_per_person = 1,
reps = 1,
maxit = 30,
seed = 123
))
s <- summary(sim_eval)
s$overview
#> # A tibble: 1 × 5
#> Designs Replications SuccessfulRuns ConvergedRuns MeanElapsedSec
#> <dbl> <dbl> <dbl> <dbl> <dbl>
#> 1 2 2 2 1 0.768
head(s$design_summary)
#> # A tibble: 6 × 44
#> design_id Facet n_person n_rater n_criterion raters_per_person Reps
#> <chr> <chr> <dbl> <dbl> <dbl> <dbl> <dbl>
#> 1 D01 Criterion 8 2 2 1 1
#> 2 D02 Criterion 12 2 2 1 1
#> 3 D01 Person 8 2 2 1 1
#> 4 D02 Person 12 2 2 1 1
#> 5 D01 Rater 8 2 2 1 1
#> 6 D02 Rater 12 2 2 1 1
#> # ℹ 37 more variables: ConvergenceRate <dbl>, McseConvergenceRate <dbl>,
#> # MeanSeparation <dbl>, SdSeparation <dbl>, McseSeparation <dbl>,
#> # MeanReliability <dbl>, McseReliability <dbl>, MeanInfit <dbl>,
#> # McseInfit <dbl>, MeanOutfit <dbl>, McseOutfit <dbl>, MeanMisfitRate <dbl>,
#> # McseMisfitRate <dbl>, MeanSeverityRMSE <dbl>, McseSeverityRMSE <dbl>,
#> # MeanSeverityBias <dbl>, McseSeverityBias <dbl>, MeanSeverityRMSERaw <dbl>,
#> # McseSeverityRMSERaw <dbl>, MeanSeverityBiasRaw <dbl>, …
# }
