← All FAQs
multi-rater-quality
What is the baseline inter-rater agreement in oncology adverse event grading?
Inter-rater agreement on adverse event attribution sits at a kappa of 0.59 to 0.68 (Hong et al., 2020). Attribution change rate between investigators and central review runs 31 to 36% (Hillman et al., JCO 2010). The FDA-NCI 2019 attribution workshop characterised the current state as sub-optimal, unreliable, and inefficient. These are the gap statements that motivate Burna AI's citation-bound architecture.