interrater reliability
The degree of agreement between different raters when scoring the same assessment or rating scale.
Full Definition
Interrater reliability measures the consistency of ratings or assessments when administered by different evaluators. In psychiatric research, this is crucial for ensuring that clinical ratings, diagnostic assessments, and outcome measures produce consistent results regardless of which clinician conducts the evaluation. High interrater reliability is essential for the validity of clinical trials and observational studies. It is typically assessed using statistical measures such as intraclass correlation coefficients (ICC), Cohen's kappa, or percentage agreement. Training programs and calibration exercises are often used to achieve acceptable interrater reliability before study initiation.
Usage
Usage note: Can be written with or without hyphen; commonly abbreviated as IRR in research contexts.
In Context
- "Interrater reliability for the primary efficacy measure exceeded 0.85 across all study sites." — Quality assurance section
- "Raters underwent extensive training to ensure adequate interrater reliability before study commencement." — Methodology section