Applying an Evaluation Framework for Health Information System Design, Development, and Implementation

Dramatic advances in health information technologies necessitate a comprehensive evaluation framework covering all phases of development, from conception to routine operational use. The purpose of this article is to illustrate the application of an informatics evaluation framework that provides a heuristic for matching the stage of system design and the level of evaluation. An evaluation framework is illustrated in the context of five studies in different stages of system design. The studies discussed in this article represent the various stages of the framework. In addition, they are examples of how evaluation research studies not only contribute to the assessment of system design but also constitute distinct contributions to knowledge. A systematic, continuous evaluation increases the likelihood that the conditions for success will be understood, including how to tailor a system, how to maintain the target population's use of the system, and how to innovate continually to enhance the functionality of the system and user experience.