March 2005), Cochrane Central Register of Controlled Clinical Trials (through the fourth quarter of 2004), and ... We used Medical Subject Headings (MeSH)
Data Extraction: Mortality and adverse events were the outcomes of interest. Individual-study quality and the overall strength of evidence were dual-reviewed using published criteria. Data Synthesis: Of 13 801 citations, 22 studies met inclusion cri-
statistical analysis. The researchers adhered faithfully to ev-ery detail of that protocol. The results provide convincing ... Kolb DA. Experiential Learning: Experience as the Source of Learning and Development. Englewood Cliffs, NJ: PTR Prentice Ha
As such, simulation is considered a tech-nique rather than any 1 speciﬁc technology (18). Simulation to enhance patient safety has 4 general purposes: education (for example, in transitioning trainees from content knowledge to experiential practice,
ogy systems to provide data about falls, staff education and train-ing, and changes in nihilistic attitudes about fall prevention. ... Inpatient Fall Prevention Programs as a Patient Safety Strategy Supplement ... als in a pooled analysis that found
medical patients. MEDLINE, CINAHL, EMBASE, and Cochrane Da-tabase of Clinical Trials (January 1990 to September 2012) were searched, and 47 controlled studies of fair methodological quality were identified. Forty-six studies reported readmission rate
sufﬁcient quality to foster conﬁdence in the results? ... Teamwork, leadership, and patient safety culture Management tools, such as training resources,
point by using the metan procedure of Stata software, ver-sion 11.2 (Stata Corp., College Station, Texas) (16). For all cases, we analyzed unadjusted relative risks based on the number of events and nonevents. We used the ﬁxed-effects Mantel–Haenszel
Library (2012, Issue 6), MEDLINE (1966 to 2012), EMBASE (1980 to 2012), CINAHL (1982 to 2012), Al-lied and Complementary Medicine Database (1985 to
A Systematic Review and Meta-analysis ... searched several clinical trial registries ... Network Clinical Trials Registry [www.umin.ac.jp/ctr]) to See also:
Annals of Internal Medicine
Academia and Clinic
The Ethics of Using Quality Improvement Methods in Health Care Joanne Lynn, MD; Mary Ann Baily, PhD; Melissa Bottrell, PhD, MPH; Bruce Jennings, MA; Robert J. Levine, MD; Frank Davidoff, MD; David Casarett, MD; Janet Corrigan, PhD, MBA; Ellen Fox, MD; Matthew K. Wynia, MD, MPH; George J. Agich, PhD; Margaret O’Kane, MHA; Theodore Speroff, PhD; Paul Schyve, MD; Paul Batalden, MD; Sean Tunis, MD; Nancy Berlinger, PhD, MDiv; Linda Cronenwett, PhD, RN; J. Michael Fitzmaurice, PhD; Nancy Neveloff Dubler, LLB; and Brent James, MD, MStat
Quality improvement (QI) activities can improve health care but must be conducted ethically. The Hastings Center convened leaders and scholars to address ethical requirements for QI and their relationship to regulations protecting human subjects of research. The group defined QI as systematic, data-guided activities designed to bring about immediate improvements in health care delivery in particular settings and concluded that QI is an intrinsic part of normal health care operations. Both clinicians and patients have an ethical responsibility to participate in QI, provided that it complies with specified ethical requirements. Most QI activities are not human subjects research and should not undergo review by an insti-
tutional review board; rather, appropriately calibrated supervision of QI activities should be part of professional supervision of clinical practice. The group formulated a framework that would use key characteristics of a project and its context to categorize it as QI, human subjects research, or both, with the potential of a customized institutional review board process for the overlap category. The group recommended a period of innovation and evaluation to refine the framework for ethical conduct of QI and to integrate that framework into clinical practice.
Beginning in 2003, The Hastings Center convened a group of experts to address the ethical issues associated with QI methods in health care. Ethicists, clinician leaders, experienced managers, regulators, authors of relevant publications, and others met repeatedly, considered published and newly commissioned scholarly papers, and discussed options with experts and affected parties. The project presented interim findings at national meetings on research ethics, general internal medicine, health services research, and quality improvement, and the project sponsored a listserv to share progress and issues with everyone who expressed interest in the work. The project has published a comprehensive report (8) and a set of commissioned papers (12). We present a summary and explanation of the report’s main conclusions, along with recommendations for developing policy and practices to protect patients from both the harm that QI activities might cause and the harm that quality and safety deficits do cause. The full report contains more details on the process, the arguments, and our conclusions.
mericans expect high-quality health care—safe, effective, patient-centered, timely, equitable, and efficient (1). Unfortunately, reality falls short of this ideal. A growing literature documents serious problems, such as unnecessary surgery, inappropriate use of medications, inadequate prevention, avoidable exacerbations of chronic conditions, and long delays before important research findings become standard (1– 4). We discuss deliberate efforts of providers to meet their obligations to improve the quality of patient care through clinical and managerial changes in the processes of care. Health care practices have always evolved, but mostly in a scattershot way. In recent years, providers have initiated new methods, some of which were modeled first in manufacturing to make ongoing improvements more systematic, data-guided, and efficient (5, 6). These continuous quality improvement methods are commonly referred to as QI. Ethical issues arise in QI because attempts to improve quality may inadvertently cause harm, waste scarce resources, or affect some patients unfairly. For example, efforts at earlier administration of antibiotics for pneumonia may lead to overuse, or efforts to encourage cancer screening may prompt useless, risky, and expensive tests in people who are too near death to benefit. In addition, some activities using QI methods have been categorized as research that uses patients as subjects, which brings the activities under the ethical and regulatory requirements governing human subjects research, including review by institutional review boards (IRBs) (7). Putting improvement activities under research regulations can precipitate substantial delays, costs, and conflicts (8 –11). Key federal agencies have disagreed about the boundaries between research and QI, and QI practitioners, health care organizations, agencies that fund research, policymakers, and IRB members are uncertain about ethical and legal requirements. The situation has already generated disincentives to engage in QI.
Ann Intern Med. 2007;146:666-673. For author affiliations, see end of text.
QI ACTIVITIES: PART OPERATIONS
NORMAL HEALTH CARE
The project group addressed 3 questions: What is QI, and what role does it play in health care? What ethical requirements should QI activities meet? What arrangements do we need to ensure the ethical conduct of QI?
See also: Print Editorial comment. . . . . . . . . . . . . . . . . . . . . . . . . . 680 Web-Only Conversion of figure and tables into slides
The Ethics of Using Quality Improvement Methods in Health Care
The group defined QI as systematic, data-guided activities designed to bring about immediate improvements in health care delivery in particular settings. Quality improvement uses an array of methods and can look like practical problem solving, an evidence-based management style, or an application of a theory-driven science of system change. Quality improvement methods often encourage health care workers to use their experience, along with insights from others, to identify promising improvements, implement changes on a small scale, monitor and interpret effects, and decide about additional changes and wider implementation. Alternatively, a QI activity might start with management review of the organization’s performance from aggregate data or with similar analyses of data across multiple organizations. At its heart, QI is a form of experiential learning that regards improvement to be part of the work process and always involves deliberate actions expected to improve care, guided by data reflecting the effects. Quality improvement is an intrinsic part of good clinical care, in which data from clinicians’ own settings guide them in improving their practices. Quality improvement assumes that quality and safety are largely characteristics of systems, and its methods enable workers to gain insight about their system’s relationships and functions. Many QI activities rely on groups of clinicians, managers, and staff cooperating to improve procedures, such as scheduling, medication handling, and record keeping. Organizations that accredit the education and certify the competence of health care professionals have come to require practitioners to be competent in improving their own practices (13, 14). As health care workers engage in QI, they deepen their understanding of their processes of care and how to improve those processes. Over time, successful QI transforms organizational culture so that everyone is committed to continuous quality improvement and everyone has the requisite skills. In sum, QI is a structured, data-guided form of the innovation and adaptation that has always been part of normal health care operations, and it has proven to be effective in improving U.S. health care (15–19). Requirements for the Ethical Conduct of QI
The project group began by examining how the existing ethical framework that governs research on human subjects might apply (20). Table 1 shows the group’s conclusions, organized under 7 topics considered important for ethical research (21). This analysis highlights the responsibility that health care providers have to improve quality and the responsibility that patients have to cooperate with improvement efforts. Physicians, nurses, and other clinicians have long professed a special ethical responsibility to serve the interests of their patients, including the responsibility to maintain and continually strive to improve the quality of care (22, 23). As health care delivery has come to require complex interdependent systems, a similar ethical www.annals.org
Academia and Clinic
responsibility falls on health care organizations and their managers (24). Participation in QI activities is a systematic way to fulfill this responsibility. Because QI activities are, and should be, part of normal health care operations, patients also have a responsibility to participate in quality improvement, which often requires direct cooperation (for example, permitting collection and use of data about their medical conditions, treatments, and outcomes) (25). A patient who will not be involved in QI constrains the efforts of that care system to improve itself and thereby jeopardizes the very benefits sought. The interests of patients in receiving reliably highquality health care depend on all patients cooperating with QI activities. Hence, the responsibility to cooperate need not turn on whether the particular patient directly benefits from a particular QI activity (although this is often the case); rather, it is justified ethically by the benefits that each patient receives because all are cooperating in the overall QI enterprise. Reaping the benefits of the QI enterprise without participation would be unfair. Of course, the patient’s responsibility to cooperate is subject to standards of reasonableness, which require that patients have access to general information about QI activities and be kept safe from harms and from violations of their rights. For example, patients should be able to count on the confidentiality of their personal health information and on the opportunity to choose whether to participate in a QI activity that exposes them to more than minimal incremental risk (measured relative to the risks of usual medical care). Health care workers (employees and nonemployee professionals who provide care within an organization) who participate in QI activities should also be able to count on confidentiality and the opportunity to opt out of QI activities that present more than minimal incremental risk to themselves. In the case of workers, however, confidentiality and risk are measured relative to the normal work situation; an organization has no ethical requirement to allow a worker to opt out of a QI activity because that activity might reveal that the worker is incompetent or unnecessary (Table 1). The ethical responsibility to cooperate with QI activities contrasts with the fundamental ethical claim that research is voluntary (26). Health care professionals and organizations have no ethical responsibility to do research, and every person is entitled to choose whether to be a research subject. This ethical claim emerged in response to research that imposed substantial risk on nonconsenting persons without offering them any direct benefit (27, 28). Research ethics springs from society’s conclusion that the interests of researchers often conflict with those of subjects and that research is conceptually distinct from health care delivery. Indeed, most published clinical research results have been found to be of little relevance to clinical practice (29). A person’s decision to be a subject in research must be voluntary and fully informed to prevent exploitation. To ensure that researchers meet their ethical obligations to 1 May 2007 Annals of Internal Medicine Volume 146 • Number 9 667
Academia and Clinic
The Ethics of Using Quality Improvement Methods in Health Care
Table 1. Ethical Requirements for the Protection of Human Participants in Quality Improvement Activities* Requirement
Social or scientific value Scientific validity Fair participant selection Favorable risk–benefit ratio
The gains from a QI activity should justify the resources spent and the risks imposed on participants. A QI activity should be methodologically sound (i.e., properly structured to achieve its goals). Participants should be selected to achieve a fair distribution of the burdens and benefits of QI. A QI activity should be designed to limit risks while maximizing potential benefits and to ensure that risks to an individual human participant are balanced by expected benefits to the participant and to society. A QI activity should be designed to protect the privacy of participants and the confidentiality of their personal information. Participants in a QI activity should receive information about findings from the activity that are clinically relevant to their own care. All patients and workers in a care delivery setting should receive basic information about the program of QI activities. The QI results should be freely shared with others in the health care system, but participant confidentiality should be protected by putting results into nonidentifiable form or obtaining specific consent to sharing. Consent to inclusion in minimal-risk QI activities is part of the patient’s consent to receive treatment. Patients should be asked for informed consent to be included in a specific QI activity if the activity imposes more than minimal risk. The risk to patients should be measured relative to the risk associated with receiving standard health care. Workers (employees or nonemployee professionals who provide care in an organization) should participate in minimal-risk QI activities as part of their job responsibilities. Workers should be asked for their informed consent to be included in a QI activity that imposes more than minimal risk. The risk to workers should be measured relative to the risk associated with the usual work situation. This does not include any risk to economic security (for example, if a QI activity reveals that the worker is incompetent or that the organization can provide quality care without that worker). Accountability for the ethical conduct of QI should be integrated into practices that ensure accountability for clinical care. Each QI activity should receive the kind of ethical review and supervision that is appropriate to its level of potential risk and project worth.
Respect for participants
* The 7 topics are derived from reference 21. QI ⫽ quality improvement.
human subjects, representatives of the relevant community (IRBs) should review the design, sample, informed consent process, and risk– benefit relationship of most research projects involving human subjects. In contrast, QI generally aligns with patients’ interests, presents lower risks than continuing with usual care (and certainly less risk than making the same changes without collecting data to monitor its impact), demands the participation of all to be effective, arises from a responsibility of professionals and patients alike, and has no history of ethics scandals. It is appropriate, therefore, that the ethical management of QI should be accomplished through processes and social arrangements that differ substantially from those designed to protect human research subjects. Arrangements to Ensure That QI Meets Ethical Requirements
Although QI practitioners must meet the ethical requirements in Table 1, we concluded that requiring IRB review would not be the most effective approach to ensuring reliable performance. First, the IRB review process requires substantial resources to prepare the submission and perform the review (9 –11, 30). Because many QI activities are of small scale, these costs would often be larger than both the resources available for the activity and the likely benefits. These disproportionate costs would bar smallscale QI and would inhibit many larger projects as well, making it more difficult to improve processes of care and to realize the obligations of professionals. Moreover, the structure of IRB review is generally inappropriate for QI. The IRB process requires registering a fixed protocol with a clearly delineated method and usually a period of analysis 668 1 May 2007 Annals of Internal Medicine Volume 146 • Number 9
after complete data collection. In contrast, QI activities are designed to achieve immediate local improvements in clinical performance and then to sustain them. The activities usually proceed incrementally, and interventions, measurements, and goals are frequently adjusted over time, guided by insights from data and actual clinical experience. Ethical oversight procedures must allow QI activities to remain flexible and be integrated into ongoing service delivery, which the IRB process does not allow. Changes in QI lie within clinical and managerial discretion and are expected to be beneficial; QI methods should ensure that QI practitioners introduce changes in a careful, data-guided way. If QI activities were to entail a costly, cumbersome review process that is minimally relevant to the structure and process, however, managers would have reason to make changes without monitoring effects or to leave malfunctioning care arrangements unchanged. In our view, therefore, instead of exporting QI into IRB-based research review, ethical oversight of QI should become part of an enhanced accountability system for professional responsibility and the supervision and management of clinical care. The arrangements for ensuring ethical conduct of QI should encourage data-driven changes and data-guided assessments and decisions. Organizations should calibrate the rigor of their supervisory procedures for QI activities to key characteristics, such as resource use, expected impact, methods used, and additional risk to patients compared with usual care. Consent to receive care should include consent to participate in routine, minimalrisk QI activities, whereas activities that entail more than minimal incremental risk (additional physical or psychowww.annals.org
The Ethics of Using Quality Improvement Methods in Health Care
logical harm or burden related to the change itself or to additional surveys or medical procedures required for monitoring) should require specific informed consent and a more formal review, potentially including a reviewer from outside of the organization. The social arrangements that normally hold health care professionals, managers, and organizations responsible for the quality of care should also ensure that they meet requirements for the ethical conduct of QI. Health care professionals and organizations need a robust understanding of the ethical requirements for QI, and organizations must have procedures to ensure that QI activities meet ethical standards. Because quality of care is a core management responsibility, leaders should ensure that each health care organization’s accountability procedures are working well. Overlap between QI and Human Subjects Research QI and Federal Human Subject Protection Regulations
The regulatory system implemented by the Common Rule (7) applies to research involving human subjects, in which research is defined as “a systematic investigation, including research development, testing and evaluation, designed to develop or contribute to generalizable knowledge,” and a human subject is “a living individual about whom an investigator . . . conducting research obtains data through intervention or interaction with the individual, or identifiable private information.” The regulations cover federally supported research, with exceptions for certain exempt categories; moreover, organizations engaged in federally funded research ordinarily have federal-wide assurances that promise that the organizations will apply the regulations to all nonexempt research, however funded. The confusion about whether a QI project comes under the regulations stems mainly from differences in the interpretation of the phrase “designed to develop or contribute to generalizable knowledge.” A classic randomized clinical trial of a drug provides the paradigm case for a systematic investigation that is “designed to develop or contribute to generalizable knowledge” and therefore exemplifies the category of research. Quality improvement projects can also provide new insights of various sorts, such as learning that a published improvement strategy was ineffective outside of its original setting or that motivating clinicians to adopt a change required a sequence of interventions. Usually the knowledge that results from QI is most applicable to the local situation and arises naturally as a byproduct of the effort to improve care in a particular setting, but insights about one setting ordinarily have some applicability to other settings or to the original setting in the future. The scope of the term “generalizable” requires interpretation. If a QI project must yield insights that are applicable to most similar situations, now and in the future, to be counted as generalizable, then very few QI activities will qualify. If, however, a QI project’s insights are taken to www.annals.org
Academia and Clinic
be generalizable whenever they might be expected to apply to any other people or situations, then almost every QI activity will qualify. Once local practice and facility standards ensure accountability for QI activities, the Hastings Center project group concluded that the scope of generalizability should be narrow; in which case, most QI projects would not also qualify as research under the Common Rule. However, if a QI activity is designed both to improve local care and to produce broadly generalizable knowledge, it is both QI and research. If that activity has participants who meet the definition of human subjects, it is both QI and human subjects research and the regulations treat it as human subjects research. Resources for QI usually come from clinical care, not federal research funds; nevertheless, overlap activities (being both human subjects research and QI) often come under the research regulations because of federal-wide assurances that include all research or because institutions apply the procedures broadly on their own. Organizations that anticipate problems in reviewing overlap activities as research have 2 options: revise their federal-wide assurances and practices to include only federally funded research or establish specialized QI IRBs to fulfill the requirement for IRB review. Existing flexibility in the regulations governing IRB membership and the process of review allows tailoring the IRB process to the special characteristics and ethical requirements of QI and should make it more effective and efficient for overlap activities (8).
Determining whether a QI Activity Is Also Human Subjects Research
Identifying a project as QI is usually straightforward: It is a systematic, data-guided activity designed to bring about immediate improvement in a local setting. Deciding which QI activities are also human subjects research and may be subject to the regulations is more challenging. Previous authorities have split the categories of human subjects research and QI activities on the basis of their primary intent or project design. The Health Insurance Portability and Accountability Act (HIPAA) regulations say that “[h]ealth care operations means . . . conducting quality assessment and improvement activities . . . provided that the obtaining of generalizable knowledge is not the primary purpose of any studies . . .” (31). (A published report by our group  discusses patient protections in QI under the HIPAA privacy rule.) The National Bioethics Advisory Commission explained that “some data collection and analysis activities in health services are not intended to generate scientific knowledge, but rather are used as management tools to improve the provision of services to a specific health care population. . . . [I]f the purpose is to assess the success of an established program, and the information gained from the evaluation will be used to improve that program, the activity should not be considered research involving human participants” (32). The National 1 May 2007 Annals of Internal Medicine Volume 146 • Number 9 669
Academia and Clinic
The Ethics of Using Quality Improvement Methods in Health Care
Institutes of Health guidance to researchers on the HIPAA privacy rules also relies on the primary intent (33). The Centers for Disease Control and Prevention considers a public health project not to be research when the “[i]ntent of the project is to identify and control a health problem or improve a public health program or service; intended benefits of the project are primarily or exclusively for the participants (or clients) or the participants’ community; data collected are needed to assess and/or improve the program or service, the health of the participants or the participants’ community; knowledge that is generated does not extend beyond the scope of the activity; and project activities are not experimental” (34). This approach does not determine whether an activity requires IRB review, because the regulations on research involving human subjects, as currently interpreted, require any activity that is combined with human subjects research to be treated as research, whatever its primary purpose. For regulatory compliance, QI practitioners therefore need substantive rules that separate QI projects from overlap activities. Constructing such rules requires a clear conceptual framework and a pragmatic set of classification procedures. One would want observable aspects of an activity’s context or design to establish its category—avoiding, for example, reliance solely on the intent of the person initiating the activity. The rules should be as consistent as possible with use of the word “research” in ordinary language and the regulatory definition. Although some arbitrariness and misclassification is inevitable, someone familiar with the rules should be able to classify most projects with confidence, and accepted procedures should be available to resolve difficult cases. Finally, the overall approach should acknowledge that the risks to participants in QI activities are regularly less than the risks from allowing quality and safety deficits to persist or introducing changes without monitoring their effects. Currently, the ethical rules for QI are not clear, and the situation is confusing. Since the Office for Human Research Protections (OHRP) interprets research broadly (see, for example, the report of a project to improve dialysis performance ) and can impose severe penalties for regulatory violations, organizations have been afraid to develop their own explicit guidelines for identifying QI activities that belong in the overlap category. At the same time, the OHRP has shown little inclination to provide specific guidance on how to identify such activities. Given the variety of QI projects and the evolution of QI methods, the stance of the OHRP may be prudent. Producing consistent, practical guidance at the regulatory agency level would be very difficult. Nevertheless, when pressed for guidance on specific situations, the OHRP has repeatedly interpreted the category of research as inclusively as possible. Allowing the current confusion to continue would be unwise. It produces inconsistent decisions, increases costs, retards improvement, and undermines respect for research review. Fear of sanctions from the OHRP could lead some 670 1 May 2007 Annals of Internal Medicine Volume 146 • Number 9
organizations to treat most QI activities as overlap activities, thus requiring IRB review. Even with QI IRBs and other streamlined review strategies, this policy is more likely to slow improvement and add costs than to protect patients. Publication prospects for QI articles are also affected. Many journals will not publish human subjects research without IRB review. In the past, many people assumed that the intent to publish automatically indicated that a project was considered research, but the OHRP has recently affirmed that publication is not confirmation that a project was research (35). Nevertheless, if editors cannot determine when QI is also human subjects research, they may reject manuscripts about QI activities that lack IRB review, even though review was not ethically or legally required. This would be unfortunate, because health care and the QI enterprise benefit from publication of methods and interventions that prove to be important (36, 37). We conclude that the necessary practical guidance can be developed most effectively by combining reflection on the nature of research and the goal of human research protection with experience in managing QI and overlap activities in various organizations. The goal is an interpretation of the definition of human subjects research that enables QI and overlap activities to receive the review and supervision needed to ensure ethical conduct without imposing excessive burdens that prevent health professionals from meeting their obligation of continuous movement to higher levels of performance. As a starting point for such an effort, we propose that the category of research under the Common Rule be interpreted to comprise activities that are designed to increase enduring knowledge about the nature and function of human beings and their environment. This definition is in accord with that in the Common Rule and the concepts underlying it (27); moreover, our interpretation gives a workable conceptual meaning to the phrase “designed to develop or contribute to generalizable knowledge.” We recognized that the Common Rule definition itself could also be revised but chose to work within the current regulatory definition. Under this interpretation, most QI is not also research. Quality improvement implements changes that are within the current standard of care, for example, moving from “unacceptable” and “barely acceptable” to known and established “best” practices. The changes already fall within clinical and managerial discretion; in fact, professional responsibility imposes an ethical, and sometimes a legal, duty to make the changes. Quality improvement activities are generally based on existing knowledge about the enduring nature and function of human beings and their environment, rather than designed to create new knowledge of that sort. Examples include data-guided efforts to ensure adoption of an evidence-based practice guideline or to introduce procedures that will reduce medical errors. Quality improvement teams may gain insights about implementing change in other settings, but their activity is not “designed www.annals.org
The Ethics of Using Quality Improvement Methods in Health Care
to develop or contribute to generalizable knowledge” within the meaning that we recommend. Because improvement almost always involves experiential learning, as well as social and cultural change, it is usually contingent on particular times, places, and situations. Not being research, most QI activities do not require IRB review; however, they do come under local professional managerial review and supervision as required by the organization’s arrangements to ensure accountability for the ethical conduct of QI and health services delivery. When QI activities are designed to produce both local improvement and new, enduring knowledge about the nature and function of human beings and their environment, and they involve human subjects, they should be considered an “overlap project” with human subjects research. For example, an overlap project could seek to learn how best to improve adherence to treatment guidelines by randomly assigning various sites to test different adherencepromoting strategies. Another would be a project researching the effects of a new treatment but embedding that project in a QI process designed to bring about compliance with other well-established aspects of care. Such overlap projects should receive review as both human subjects research and QI. Organizations that sponsor many projects in the overlap group could improve their review process by establishing specialized QI IRBs. Table 2 shows characteristics for use in the construction of guidelines for categorizing QI activities as overlapping with human subjects research. We did not intend this list to be definitive; rather, it provides a starting point for the development of practical models of ethical oversight for both QI and overlap activities, as recommended below.
Table 3 summarizes a broad agenda for implementing accountability for the ethical conduct of QI. The fourth recommendation in Table 3 (to develop new models of internal management and supervision of QI and of QI– human subjects research overlap projects) requires additional discussion. We recommend that the arrangements for internal management of QI and overlap activities discussed in brief here and in the full report (8) be translated into models that work in real health care settings, through collaborative efforts by organizations that are leaders in QI. The OHRP could encourage some organizations to undertake this task, or QI organizations could take the initiative themselves, with central coordination. Individual health care organizations should develop internal management and supervision for their QI activities and should create practical rules and structures for supervising QI, ensuring appropriate review of QI projects, and determining which projects are also research. Some organizations engaged in many activities that combine QI and human subjects research should develop experience with specialized QI IRBs. All involved should share their expewww.annals.org
Academia and Clinic
Table 2. Characteristics Helpful in Defining Activities as Both Quality Improvement and Human Subjects Research Testing of issues that go beyond current knowledge based on science and experience, such as new treatments Random allocation of patients into different intervention groups to enhance confidence in differences that might be obscured by nonrandom selection (but not randomization for equitable allocation of a scarce resource) Deliberately delayed or ineffective feedback of data from monitoring the implementation of changes, especially if this is done to avoid biasing the interpretation of data Involvement in key project roles of researchers who have no ongoing commitment to improvement of the local care situation, even if others in the team do have professional commitments to it Funding, sponsorship, or substantial participation by parties outside the clinical setting or organization in which the activity takes place
riences on a regular basis. Such organizations as the OHRP, the Agency for Healthcare Research and Quality, professional societies, and the Joint Commission on Accreditation of Healthcare Organizations should support and evaluate this work. Federal agencies should develop practical models for review and supervision of QI under the public benefit exemption, which exempts human subjects research from the federal regulations when it involves the study, evaluation, or examination of public benefit or service programs (38). Under the exemption, the agency has more flexibility in developing rules for identifying overlap activities than the OHRP might allow to nongovernment organizations. An obvious candidate agency would be the Centers for Medicare & Medicaid Services, because it already sponsors both QI and research and has accepted the mission of improving care for Medicare and Medicaid patients. The Health Resources and Services Administration, the U.S. Department of Veterans Affairs, and the U.S. Department of Defense could also lead some innovations under the public benefit exemption. Over several years, we believe that this process will arrive at practical, substantive rules and procedures for identifying activities that are QI, human subjects research, or both. The cooperation of the OHRP will be very important in this endeavor, to monitor for adverse effects and to act as a consensus-builder for the development of practical guidance on both the classification of activities as human subjects research and the functioning of QI IRBs. As consensus develops, the Joint Commission on Accreditation of Healthcare Organizations, the OHRP, professional organizations, conferences, and journals should disseminate the results and help educate leaders of IRBs, researchers, clinical managers, and practitioners. Protection of human subjects of research is a proud achievement of our society’s commitment to ethics. Without threat to that achievement, the quality of health care in the United States urgently needs improvement. The most promising strategies for improvement use QI methods to guide the enterprise with data and insight. We have pro1 May 2007 Annals of Internal Medicine Volume 146 • Number 9 671
Academia and Clinic
The Ethics of Using Quality Improvement Methods in Health Care
Table 3. Recommendations for Implementing Accountability for the Ethical Conduct of Quality Improvement* Recommendation
Clarify professional and organizational responsibility for QI
Organizations of health professionals should inform members about their professional responsibility to improve quality, identify the basic QI skills members should have, educate members about standards for ethical conduct of QI, and incorporate QI into professional Codes of Ethics. Organizations of provider entities should inform members about their responsibility to improve quality, the need to ensure that their employees have basic QI skills, and the standards for ethical conduct of QI. Leaders in professional education should press for greater emphasis on the responsibility of health professionals to improve the quality of care and the development of QI skills in educational curricula, including management of the ethical dimensions of QI. People seeking health care should be told why QI activities are important to the quality of their care, be informed that consent to receive care includes consent to a minimum level of cooperation with ongoing QI, be given basic information about the organization’s QI program, and be told how to obtain more information about the program if they want it. Health care organizations should develop patient education materials about patient rights and responsibilities with respect to QI and the conduct of QI within the organization. Such groups as AHRQ should provide ongoing guidance on appropriate methodological standards for QI. Journal editors should adopt a standardized format for reporting of QI activities for publication†, encourage submission of articles on QI methods and results, and become educated about the boundaries of research in QI projects. The AHRQ, CMS, and other federal agencies should provide financial support for the conduct of QI, dissemination of QI results, development of QI methods, and ongoing guidance on the application of privacy rules to QI activities involving collaboration across organizations. The arrangements for internal management of QI, including QI that is also human subjects research, should be translated into models that will work in real health care settings. The arrangements for deciding which QI projects are also human subjects research and should come under IRB review also should be tested in practical application, aiming to implement clear definitions and accepted procedures after a short period of gaining experience. Accrediting bodies, such as JCAHO and NCQA, should expand existing QI-related accreditation requirements to include review of the extent to which organizations have effective mechanisms in place for managing QI and ensuring that it meets ethical standards.
Clarify patient responsibility for QI
Develop guidance on QI methodology and dissemination of QI results
Develop new models of internal management and supervision of QI and of QI–human subjects research overlap projects Develop and expand external accountability for QI
* AHRQ ⫽ Agency for Healthcare Research and Quality; CMS ⫽ Centers for Medicare & Medicaid Services; IRB ⫽ institutional review board; JCAHO ⫽ Joint Commission on Accreditation of Healthcare Organizations; NCQA ⫽ National Committee for Quality Assurance; QI ⫽ quality improvement. † See references 31 and 32.
vided a framework of key concepts and practices that can ensure responsible implementation of QI activities and also can protect persons used as subjects of research. Society needs a period of intentional innovation with structured evaluation, with the cooperation of many federal and private organizations to design practices that reliably protect human subjects of research and that also reliably engineer a high-quality health care system.
authors, including federal agencies.
From RAND Corporation, Arlington, Virginia; National Quality Forum, Veterans Health Administration, and National Committee for Quality Assurance, Washington, DC; The Hastings Center, Garrison, New York; Montefiore Medical Center, Bronx, New York; Veterans Health Administration, Seattle, Washington; Yale University, New Haven, Connecticut; Institute for Healthcare Improvement, Cambridge, Massachusetts; Philadelphia Veterans Affairs Medical Center, Philadelphia, Pennsylvania; American Medical Association, Chicago, Illinois; Joint Commission on Accreditation of Healthcare Organizations, Oakbrook Terrace, Illinois; Bowling Green State University, Bowling Green, Ohio; Vanderbilt University Medical Center, Nashville, Tennessee; Dartmouth Medical School, Hanover, New Hampshire; Health Tech, San Francisco, California; University of North Carolina at Chapel Hill, Chapel Hill, North Carolina; Agency for Healthcare Research and Quality, Rockville, Maryland; and Intermountain Institute for Health Care Delivery Research, Salt Lake City, Utah.
Grant Support: By the Agency for Healthcare Research and Quality (grant 1R13HS13369) and unrestricted funds of The Hastings Center.
Disclaimer: The study sponsors had no role in the work or in reviewing the final manuscripts. The authors are responsible for the content. Statements in this report should not be construed as an endorsement by the Agency for Healthcare Research and Quality or the employers of the 672 1 May 2007 Annals of Internal Medicine Volume 146 • Number 9
Acknowledgments: The authors thank the other members of the work-
ing group who did not join as authors: Michael Carome, MD (U.S. Department of Health and Human Services, Office for Human Research Protections); Stephen F. Jencks, MD, MPH, and Arnold Farley, PhD (Centers for Medicare & Medicaid Services); Karen Maschke, PhD (The Hastings Center); Ethel Mitty, EdD, RN (New York University College of Nursing); and Robyn Y. Nishimi, PhD (National Quality Forum).
Potential Financial Conflicts of Interest: The authors share a broad
dedication to improving health care delivery in the United States, and most have some of their income generated from these activities. Some are also engaged in research or in institutional review board or HIPAA privacy activities. However, none have any other direct conflicts of interest. The project did not require review as research involving human subjects. Requests for Single Reprints: Mary Ann Baily, PhD, The Hastings
Center, 21 Malcolm Gordon Road, Garrison, NY 10524; e-mail, bailym @thehastingscenter.org. Current author addresses are available at www.annals.org.
References 1. Institute of Medicine. Crossing the Quality Chasm. Washington, DC: National Academy Pr; 2001. www.annals.org
The Ethics of Using Quality Improvement Methods in Health Care 2. Schuster MA, McGlynn EA, Brook RH. How good is the quality of health care in the United States? Milbank Q. 1998;76:517-63, 509. [PMID: 9879302] 3. Agency for Healthcare Research and Quality. 2005 National Healthcare Quality Report. Rockville, MD: U.S. Department of Health and Human Services; 2005. 4. McGlynn EA, Asch SM, Adams J, Keesey J, Hicks J, DeCristofaro A, et al. The quality of health care delivered to adults in the United States. N Engl J Med. 2003;348:2635-45. [PMID: 12826639]. 5. Berwick DM. Developing and testing changes in delivery of care. Ann Intern Med. 1998;128:651-6. [PMID: 9537939]. 6. End-of-Life Care Consensus Panel. Reforming care for persons near the end of life: the promise of quality improvement. Ann Intern Med. 2002;137:117-22. [PMID: 12118967]. 7. The Department of Health and Human Services (DHHS) Human Subjects Protection Regulations, 45 CFR §46. Accessed at www.hhs.gov/ohrp/human subjects/guidance/45cfr46.htm#46.102 on 15 August 2006. 8. Baily MA, Bottrell M, Lynn J, Jennings B, Hastings Center. The ethics of using QI methods to improve health care quality and safety. Hastings Cent Rep. 2006;36:S1-40. [PMID: 16898359] Accessed at www.thehastingscenter.org on 10 December 2006. 9. Newgard CD, Hui SH, Stamps-White P, Lewis RJ. Institutional variability in a minimal risk, population-based study: recognizing policy barriers to health services research. Health Serv Res. 2005;40:1247-58. [PMID: 16033503]. 10. Investigators in the Registry of the Canadian Stroke Network. Impracticability of informed consent in the Registry of the Canadian Stroke Network. N Engl J Med. 2004;350:1414-21. [PMID: 15070791]. 11. Green LA, Lowery JC, Kowalski CP, Wyszewianski L. Impact of institutional review board practice variation on observational health services research. Health Serv Res. 2006;41:214-30. [PMID: 16430608]. 12. Jennings B, Baily MA, Bottrell M, Lynn J, eds. Health Care Quality Improvement: Ethical and Regulatory Issues. Garrison, NY: The Hastings Center; 2007. Accessed at www.thehastingscenter.org on 10 December 2006. 13. Leach DC. Changing education to improve patient care. Qual Health Care. 2001;10 Suppl 2:ii54-8. [PMID: 11700380]. 14. Ham HP, Stockman JA 3rd. Why maintenance of certification? J Pediatr. 2002;141:300. [PMID: 12219045]. 15. Schoenbaum SC. Saving Lives, Raising Hopes. New York: The Commonwealth Fund; June 2006. Accessed at www.cmwf.org/aboutus/aboutus_show .htm?doc_id⫽380090doc380090 on 4 September 2006. 16. IHI announces that hospitals participating in 100,000 Lives Campaign have saved an estimated 122,300 lives [press release]. Atlanta: Institute for Healthcare Improvement; 14 June 2006. Accessed at www.ihi.org/NR/rdonlyres/68B891EE5624-45DC-B7F6-E213C56EB60E/4426/UPDATED100kLivesCampaign June14milestonepressreleas.pdf on 17 February 2007. 17. Greenhalgh T, Robert G, Macfarlane F, Bate P, Kyriakidou O. Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Q. 2004;82:581-629. [PMID: 15595944]. 18. Rollow W, Lied TR, McGann P, Poyer J, LaVoie L, Kambic RT, et al. Assessment of the Medicare quality improvement organization program. Ann Intern Med. 2006;145:342-53. [PMID: 16908911]. 19. Margolis PA, Stevens R, Bordley WC, Stuart J, Harlan C, Keyes-Elstein L, et al. From concept to application: the impact of a community-wide intervention to improve the delivery of preventive services to children. Pediatrics. 2001;108: E42. [PMID: 11533360]. 20. Levine RJ. Ethics and Regulation of Clinical Research. 2d ed. New Haven: Yale Univ Pr; 1988. 21. Emanuel EJ, Wendler D, Grady C. What makes clinical research ethical?
Academia and Clinic
JAMA. 2000;283:2701-11. [PMID: 10819955]. 22. Wynia MK, Kurlander JE, Morse R. Physician ethics and participation in quality improvement: renewing a professional obligation. In: Jennings B, Baily MA, Bottrell M, Lynn J, eds. Health Care Quality Improvement: Ethical and Regulatory Issues. Garrison, NY: The Hastings Center; 2007. 23. Lang N. Healthcare quality improvement: a nursing perspective. In: Jennings B, Baily MA, Bottrell M, Lynn J, eds. Health Care Quality Improvement: Ethical and Regulatory Issues. Garrison, NY: The Hastings Center; 2007. 24. Agich G. Healthcare organization responsibility for quality improvement. In: Jennings B, Baily MA, Bottrell M, Lynn J, eds. Health Care Quality Improvement: Ethical and Regulatory Issues. Garrison, NY: The Hastings Center; 2007. 25. Dubler NN, Blustein J, Bhalla R, Bernard D. Informed participation: an alternative ethical process for including patients in quality improvement projects. In: Jennings B, Baily MA, Bottrell M, Lynn J, eds. Health Care Quality Improvement: Ethical and Regulatory Issues. Garrison, NY: The Hastings Center; 2007. 26. Jonas H. Philosophical reflections on human experimentation. In: Freund PA, ed. Experimentation with Human Subjects. New York: George Braziller; 1970:6-15. 27. National Commission for the Protection of Human Subjects of Biomedical and Behavioral Research. The Belmont Report: Ethical Principles and Guidelines for the Protection of Human Subjects of Research. Washington, DC: U.S. Government Printing Office; 1978. 28. Beecher HK. Ethics and clinical research. N Engl J Med. 1966;274:1354-60. [PMID: 5327352]. 29. Pragmatic Trials in Health Care Systems (PRACTIHC). Why are so few randomized trials useful, and what can we do about it? [Editorial]. J Clin Epidemiol. 2006;59:1125-6. [PMID: 17027421] 30. Consortium to Evaluate Clinical Research Ethics. The cost of institutional review boards in academic medical centers [Letter]. N Engl J Med. 2005;352: 1825-7. [PMID: 15858200]. 31. Health Insurance Portability and Accountability Act of 1996. Implementation of Administrative Simplification Requirements by HHS. 45 CFR §164.501. Accessed at www.cms.hhs.gov/HIPAAGenInfo/Downloads/Implementation.pdf on 15 August 2006. 32. National Bioethics Advisory Commission. Ethical and Policy Issues in Research Involving Human Participants. Bethesda, MD: U.S. Gov Pr Off; 2000: 36-7. 33. National Institutes of Health. Health Services Research and the HIPAA Privacy Rule. Accessed at http://privacyruleandresearch.nih.gov/pdf/Health ServicesResearchHIPAAPrivacyRule.pdf on 15 August 2006. 34. Guidelines for Defining Public Health Research and Public Health NonResearch. Revised 4 October 1999. Accessed at www.cdc.gov/od/science/regs /hrpp/researchDefinition.htm on 21 November 2006. 35. Statement by Michael Carome. Secretary’s Advisory Committee on Human Research Protections Meeting [transcript]. 5 October 2004. Accessed at www.hhs .gov/ohrp/sachrp/mtgings/mtg10-04/oct0405.txt on 4 September 2006. 36. Davidoff F. Publication and the ethics of quality improvement. In: Jennings B, Baily MA, Bottrell M, Lynn J, eds. Health Care Quality Improvement: Ethical and Regulatory Issues. Garrison, NY: The Hastings Center; 2007. 37. Davidoff F, Batalden P. Toward stronger evidence on quality improvement. Draft publication guidelines: the beginning of a consensus project. Qual Saf Health Care. 2005;14:319-25. [PMID: 16195563] 38. Chart 6: Does Exemption 45 CFR 46.101(b)(5) (for Public Benefit or Service Programs) Apply? [Exemptions to the Common Rule at Office for Human Research Protections]. Accessed at www.hhs.gov/ohrp/humansubjects/guidance /decisioncharts.htm#c6 on 4 September 2006.
1 May 2007 Annals of Internal Medicine Volume 146 • Number 9 673
Annals of Internal Medicine Current Author Addresses: Dr. Lynn: Office of Clinical Standards and Quality, The Centers for Medicare & Medicaid Services, 7500 Security Boulevard, Baltimore, MD 21244. Drs. Baily and Berlinger: The Hastings Center, 21 Malcolm Gordon Road, Garrison, NY 10524. Dr. Bottrell: National Center for Ethics in Health Care, Veterans Health Administration, 814 Jones Street, Berkeley, CA 94710. Mr. Jennings: Center for Humans and Nature, 109 West 77th Street, Suite 2, New York, NY 10024. Dr. Levine: Institution for Social and Policy Studies, Interdisciplinary Center for Bioethics, PO Box 208209, New Haven, CT 06520-8209. Dr. Davidoff: 143 Gordon Street, Wethersfield, CT 06109. Dr. Casarett: Philadelphia Veterans Affairs Medical Center, 3615 Chestnut Street, Philadelphia, PA 19104. Dr. Corrigan: National Quality Forum, 601 13th Street NW, Washington, DC 20005. Dr. Fox: Department of Veterans Affairs, 810 Vermont Avenue NW, Washington, DC 20420. Dr. Wynia: The Institute for Ethics at the American Medical Association, 515 North State Street, Chicago, IL 60610.
Dr. Agich: BGeXperience Program, 404A Moseley Hall, Bowling Green State University, Bowling Green, OH 43403. Ms. O’Kane: National Committee for Quality Assurance, 2000 L Street NW, Suite 500, Washington, DC 20036. Dr. Speroff: Vanderbilt University Medical Center, 1215 21st Avenue South, Nashville, TN 37232. Dr. Schyve: Joint Commission on Accreditation of Healthcare Organizations, 1 Renaissance Boulevard, Oakbrook Terrace, IL 60181. Dr. Batalden: Dartmouth Medical School, Strasenburgh Hall, Hanover, NH 03755. Dr. Tunis: 4712 Keswick Road, Baltimore, MD 21210. Dr. Cronenwett: University of North Carolina at Chapel Hill, Carrington Hall CB# 7460, Chapel Hill, NC 27599. Dr. Fitzmaurice: Agency for Healthcare Research and Quality, 540 Gaither Road, Rockville, MD 20850. Ms. Dubler: Division of Bioethics, Montefiore Medical Center, 111 East 210th Street, Bronx, NY 10467. Dr. James: Intermountain Institute for Health Care Delivery Research, Intermountain Healthcare, 36 South State Street, 21st Floor, Salt Lake City, UT 84111.
1 May 2007 Annals of Internal Medicine Volume 146 • Number 9 W-161