This article describes an evaluation approach that can be used on both group and single-case research designs (SSED). The approach evaluates types of treatments, research designs, quality of studies and effect sizes. The study follows the graphical presentation of products evaluated by Consumer Reports magazine (no, really–and, it’s cool!).
Research studies were evaluated according to the following criteria:
- Design characteristics and general validity (and internal validity for group methods)
- Measurement and reliability (assessment methods, implementation fidelity)
- General characteristics and results (rationale, treatment effects, statistics)
- Dimensions of external validity (such as social validity)
Advantages of this technique are: patterns can be detected, the presentation of the data is clear, and the study is accessible to many researchers (not just quant folks).
Disadvantages of this technique are: inter-rater issues (complexity and training), categories are quite general.