James P. Marcin M.D., M.P.H., Patrick S. Romano M.D., M.P.H., Madan Dharmar M.B.B.S., Ph.D., James M. Chamberlain M.D., Nanette Dudley M.D., Charles G. Macias M.D., M.P.H., Lise E. Nigrovic M.D., M.P.H, Elizabeth C. Powell M.D., M.P.H, Alexander J. Rogers M.D., Meridith Sonnett M.D., Leah Tzimenatos M.D., Elizabeth R. Alpern M.D., M.S.C.E., Rebecca Andrews‐Dickert M.D., Dominic A. Borgialli D.O., M.P.H., Erika Sidney M.D., Charlie Casper Ph.D., Jonathan Michael Dean M.D., Nathan Kuppermann M.D., M.P.H., , J. Callahan, P. Dayan, M. Gerardi, M. Gorelick, J. Hoyle, E. Jacobs, D. Jaffe, R. Lichenstein, K Lillis, P. Mahajan, R. Maio, F. Moler, D. Monroe, R. Ruddy, R. Stanley, M. Tunik, A. Walker, D. Kavanaugh, H. Park, R. Holubkov, S. Knight, A. Donaldson, S. Zuspan, M. Miskin, J. Wade, A. Jones, M. Fjelstad, T. Singh, A. Drongowski, L. Fukushima, E. Kim, G. O'Gara, H. Rincon, K. Brown, L. Babcock, G. Foltin, S. Teach, A. Cooper, N.C. Mann, K. Shaw, P. Ehrlich, R. Enriquez, B. Millar, M. Shults, W. Schalick, S. Atabaki, J. Burr, K. Call, J. Suhajda, N. Schamban
To evaluate the consistency, reliability, and validity of an implicit review instrument that measures the quality of care provided to children in the emergency department ().
Medical records of randomly selected children from 12 s in the Pediatric Emergency Care Applied Research Network ().
Eight pediatric emergency medicine physicians applied the instrument to 620 medical records.
Data Sources/Study Setting
We determined internal consistency using Cronbach's alpha and inter‐rater reliability using the intraclass correlation coefficient (). We evaluated the validity of the instrument by correlating scores with four condition‐specific explicit review instruments.
Individual reviewers' Cronbach's alpha had a mean of 0.85 with a range of 0.76–0.97; overall Cronbach's alpha was 0.90. The was 0.49 for the summary score with a range from 0.40 to 0.46. Correlations between the quality of care score and the four condition‐specific explicit review scores ranged from 0.24 to 0.38.
The quality of care instrument demonstrated good internal consistency, moderate inter‐rater reliability, high inter‐rater agreement, and evidence supporting validity. The instrument could be useful for systems' assessment and research in evaluating the care delivered to children in the .
Data Collection/Extraction Methods