A Systems Engineering Approach: Improving Medication Safety with Clinician Use of Health IT (New York)

Project Final Report (PDF, 724.69 KB) Disclaimer

Project Details - Ended

Project Categories

Summary:

Medication safety is known to be a major problem in ambulatory primary care and existing methodologies to address this issue have had limited success. This project used an analysis based on failure modes and effects in a primary care setting to address this issue. Practices, including safety net practices, with pre-existing electronic medical records (EMRs) were recruited from within a local practice-based research network. The primary outcome measures were adverse drug events (ADEs) in adults 65 and older, ascertained using a trigger tool chart review methodology at two 12-month periods, pre and post intervention. The project also developed and pilot-tested a Web-based implementation of a Team Resource Management (TRM) intervention aimed at improving medication safety in primary care.

The objectives of this study were to:

  1. Examine the impact of an information technology (IT)-based TRM intervention on reducing selected ADEs among geriatric patients in primary care.
  2. Examine the impact of an IT-based TRM intervention on improving monitoring for geriatric patients taking selected chronic medications in primary care.
  3. Evaluate office staff use and application of the IT-based TRM Tool for improving geriatric medication safety in primary care settings.

The study achieved its main aims of developing and implementing a Web-based TRM in a variety of ambulatory settings. The main outcome was a trend toward a decrease in the rate of ADEs in the intervention group over time, in contrast to the control group which showed no such trend. This pilot study was limited by small size and short followup period, and by weaknesses of the trigger tool methodology for measuring ADEs. Nevertheless, it achieved its aim of demonstrating successful implementation of a Web-based TRM in busy primary care practices. The team hopes that future studies will test the intervention on a larger scale over a longer period of time, and will explore methods for overcoming common barriers faced.

A Systems Engineering Approach: Improving Medication Safety with Clinician Use of Health IT - 2010

Summary Highlights

  • Principal Investigator: 
  • Funding Mechanism: 
    RFA: HS07-006: Ambulatory and Safety Quality Program: Improving Quality Through Clinician Use of Health Information Technology (IQHIT)
  • Grant Number: 
    R18 HS 017020
  • Project Period: 
    September 2007 – November 2010, Including No-Cost Extension
  • AHRQ Funding Amount: 
    $1,200,000
  • PDF Version: 
    (PDF, 411.5 KB)


Target Population: Elderly*

Summary: Adverse Drug Events (ADEs), common in all settings, can frequently be prevented through identification and correction of underling systemic vulnerabilities. Most methods for estimating health care vulnerabilities are retrospective, uncovering only the ‘tip of the iceberg’. These are fraught with difficulty due to various issues, including gross under-reporting of ADEs and lack of provision for understanding of the total primary care system. Dr. Singh and his team have developed a prospective bottom-up approach, invoking improvement science, adapted from the established failure modes and effects analysis method. This is known as the Safety Enhancement and Monitoring Instrument – Patient centered (SEMI-P) and is highly transferable. This project studied the impact of an information technology (IT)-based SEMI-P on medication safety in primary care practices serving older adults.

This project conducted an experimental design (single-blind randomized block cluster) of a site-level intervention. Outcome assessment focused on medication safety among geriatric patients, in addition to office staff use and application of the IT-based instrument. Participatory research methods assessed provider- and staff-identified barriers to implementation.

The goal of this study was to conduct and publish the results of an IT demonstration project using a human factors approach to geriatric medication safety in order to: 1) provide pilot data for larger confirmatory studies, and 2) possibly develop and market test the IT-based Crew Resource Management (CRM) software via small business innovation research mechanisms for eventual national release.

Specific Aims:

  • Examine the impact of an IT-based CRM intervention on reducing selected ADEs among geriatric patients in primary care settings by evaluating changes in: 1) number of preventable ADEs that occur, 2) severity of those ADEs, and 3) stage of the medication use process in which they occur (i.e., diagnosis, prescribing, transcribing, dispensing, administration, and monitoring). (Achieved)
  • Examine the impact of an IT-based CRM intervention on improving monitoring for geriatric patients who are on persistent medications in primary care settings by evaluating changes in monitoring rates for subjects age 65 and older on: 1) angiotensin converting enzyme (ACE) inhibitors or angiotensin receptor blockers, 2) digoxin, 3) diuretic, and 4) statins. (Achieved)
  • Evaluate office staff use and application of the IT-based CRM tool for improving geriatric medication safety in primary care settings by examining use of the IT tool and any changes in safety attitude constructs (safety climate, teamwork climate, stress recognition, working conditions, perceptions of management, and job satisfaction). (Achieved)

2010 Activities: All four sites completed implementation of practice changes in 2010 to address identified ADEs. Practices used the ACORNoffice tool, an IT-based quality improvement tool that supported the practice by prioritizing different methods for improving medication safety, assigning responsibility, and tracking their implementation. Examples include: incorporation of patient education brochures for high-risk medications; inclusion of diagnosis on prescriptions; patient reminders regarding followup; patient-carried medication lists; changes in the way that refill requests are handled; and formation of teams to address ongoing communication problems. The “Indicators” tool within the software was used to define specific measurable outcomes for each initiative and to track success at meeting these objectives over time.

Final interviews and surveys with key practice informants were conducted at completion of the intervention to ascertain barriers, facilitators, perceived benefits, and any potential unintended consequences of the intervention.

In June 2010 the team presented a talk on Change Management at the Agency for Healthcare Research and Quality Health IT Grantee and Contractor Meeting. Two papers have been published and another one is under review. An abstract has been submitted to the North American Primary Care Research Group 2011 Annual Meeting.

Grantee’s Most Recent Self-Reported Quarterly Status (as of November 2010): The project is completed, and all aims were achieved.

Impact and Findings: To measure the impact of the IT-based SEMI-P there are two main outcomes: 1) rate of ADEs in participating practices identified through the use of the trigger tool, and 2) compliance with the Healthcare Effectiveness and Data Information Set (HEDIS) guidelines for laboratory monitoring of patients taking a specified set of chronic medications (ACE inhibitor, diuretic, digoxin, statin, and anticonvulsants).

1) ADEs: In the intervention group, ADEs showed a downward trend from 25.8 per 100 patients per year to 18.3 (p=.471 by paired t-test), while the control group showed little change (24.3 to 24.8, p=.899). A two-way ANOVA examining the interaction between time (pre versus post) and group (intervention versus control) showed no significant interaction (p=.407). The intervention proved feasible and demonstrated potential for effectiveness in a variety of ambulatory settings. Future studies should test the intervention on a larger scale, over a longer period of time, and should explore methods for overcoming common barriers.

2) HEDIS measure for lab monitoring for patients on chronic medications: At baseline, ACE inhibitors, diuretics, and statins were used by a high proportion of patients, around 40 percent or more at most practices. At all practices, the majority of patients had appropriate laboratory monitoring for these medications. However, compliance was not complete and there was considerable variation between practices, especially for the statin group of medications. There were no statistically significant differences over time or between intervention and control groups. The team plans to publish three papers. The papers will focus on: 1) the barriers and facilitators for practices to improve safety using the CRM; 2) the impact of the CRM on reducing adverse drug events; and 3) the changes in safety culture as a result of the CRM process.

Strategic Goal: Develop and disseminate health IT evidence and evidence-based tools to improve the quality and safety of medication management via the integration and utilization of medication management systems and technologies.

Business Goal: Synthesis and Dissemination

*AHRQ Priority Population.

A Systems Engineering Approach: Improving Medication Safety with Clinician Use of Health IT - Final Report

Citation:
Singh G. A Systems Engineering Approach: Improving Medication Safety with Clinician Use of Health IT - Final Report. (Prepared by State University of New York at Buffalo under Grant No. R18 HS017020). Rockville, MD: Agency for Healthcare Research and Quality, 2011. (PDF, 724.69 KB)

The findings and conclusions in this document are those of the author(s), who are responsible for its content, and do not necessarily represent the views of AHRQ. No statement in this report should be construed as an official position of AHRQ or of the U.S. Department of Health and Human Services.
Principal Investigator: 
Document Type: 
Technology: 
This project does not have any related survey.
This project does not have any related project spotlight.
This project does not have any related survey.
This project does not have any related story.
This project does not have any related emerging lesson.