Archive (2016–2006)

Rapid Assessment of Clinical Information Systems in the Healthcare Setting

Journal: Methods of Information in Medicine
Subtitle: A journal stressing, for more than 50 years, the methodology and scientific fundamentals of organizing, representing and analyzing data, information and knowledge in biomedicine and health care
ISSN: 0026-1270

Special Topic: Health IT in Asia-Pacific Region
Guest Editors: M. Kimura, H. A. Park, N. Nakashima

Issue: 2011 (Vol. 50): Issue 4 2011
Pages: 299-307

Rapid Assessment of Clinical Information Systems in the Healthcare Setting

An Efficient Method for Time-pressed Evaluation

Original Article

Online Supplementary Material

C. K. McMullen (1), J. S. Ash (2), D. F. Sittig (3), A. Bunce (2), K. Guappone (4), R. Dykstra (2), J. Carpenter (4), J. Richardson (2), A. Wright (5)

(1) The Center for Health Research, Kaiser Permanente Northwest, Portland, OR, USA; (2) Oregon Health & Science University, Portland, OR, USA; (3) University of Texas School of Biomedical Informatics at Houston, Houston, TX, USA; (4) Providence Portland Medical Center, Portland, OR, USA; (5) Brigham & Women’s Hospital, Boston, MA, USA


Computerized Medical Record Systems, ethnography, Clinical informatics, qualitative methods, healthcare evaluation mechanisms


Objective: Recent legislation in the United States provides strong incentives for implementation of electronic health records (EHRs). The ensuing transformation in U.S. health care will increase demand for new methods to evaluate clinical informatics interventions. Timeline constraints and a rapidly changing environment will make traditional evaluation techniques burdensome. This paper describes an anthropological approach that provides a fast and flexible way to evaluate clinical information systems. Methods: Adapting mixed-method evaluation approaches from anthropology, we describe a rapid assessment process (RAP) for assessing clinical informatics interventions in health care that we developed and used during seven site visits to diverse com-munity hospitals and primary care settings in the U.S. Setting: Our multidisciplinary team used RAP to evaluate factors that either encouraged people to use clinical decision support (CDS) systems or interfered with use of these systems in settings ranging from large urban hospitals to single-practitioner, private family practices in small towns. Results: Critical elements of the method include: 1) developing a fieldwork guide; 2) carefully selecting observation sites and participants; 3) thoroughly preparing for site visits; 4) partnering with local collaborators; 5) collecting robust data by using multiple researchers and methods; and 6) analyzing and reporting data in a structured manner helpful to the oraganizations being evaluated. Conclusions: RAP, iteratively developed over the course of visits to seven clinical sites across the U.S., has succeeded in allowing a multidisciplinary team of informatics researchers to plan, gather and analyze data, and report results in a maximally efficient manner.

You may also be interested in...


Section 2: Patient Records


S. Meystre, Managing Editor for the IMIA Yearbook Section on Patient Records

Yearb Med Inform 2007 : 47-48


S. Garde1 , P. Knaup2 , E. J. S. Hovenga1 , S. Heard 1, 3

Methods Inf Med 2007 46 3: 332-343


P. W. Moorman, J. van der Lei

Methods Inf Med 1999 38 4: 294-297