|
Annals of African Medicine
Annals of African Medicine Society
ISSN: 1596-3519
Vol. 3, Num. 3, 2004, pp. 146-149
|
Annals of African Medicine, Vol.
3, No. 3, 2004, pp. 146-149
Opinion
MEDICAL AUDIT: A VERITABLE TOOL FOR IMPROVING
STANDARDS IN CLINICAL PRACTICE
A. O. Omigbodun and *O. O.
Omigbodun
Department of Obstetrics and Gynaecology,
and *Psychiatry, College of Medicine, University of Ibadan and University College
Hospital Ibadan, Nigeria
Reprint requests to: Professor A.O. Omigbodun, Department
of Obstetrics and Gynaecology, College of Medicine, University College Hospital,
Ibadan, Nigeria. E-mail: tropical@skannet.com
Code Number: am04037
ABSTRACT
Audit in medical practice has conventionally been taken to
refer to self-accounting on the part of medical professionals or health care
institutions to assess the effectiveness and efficiency of the services they
render to the community. Its ultimate purpose is to improve standards in clinical
care and encourage efficient utilisation of resources. In structure, medical
audit takes two main forms - an outcome review to assess the quality of care
being received by patients, and a utilisation review to assess the cost-effectiveness
of the approaches being used to deliver care. The essential components of the
audit process have been pared down to five main steps. These are the identification
of an area of enquiry, interest or concern in healthcare and the outlining
of specific criteria of what is regarded as good quality or outcome; measurement
of current practice through data collection, setting targets for improvement;
introduction of new measures to correct any deficiencies identified; and evaluation
of the effectiveness of the new measures through further targeted data collection.
This approach, also known as criteria-based audit, can be applied to improve
the standard of clinical practice in the developing world, as the experiences
from Uganda and Nigeria that are related here demonstrate. A structured programme
of medical audit in the countries of the developing world is long overdue and
criterion-based audit offers a practical and effective way of employing this
veritable tool for improving the standards of clinical
practice.
Key word: Medical audit, standards, clinical practice
INTRODUCTION
Audit is a term that is more commonly
associated with accountants than with medical practitioners and the mention
of the word auditor often strikes terror in the minds of people because of
the general perception of auditors as stern authoritarian figures trained to
detect fraud, incompetence or inefficiency and report back to an agency that
will punish such errant behaviour. One dictionary actually describes the process
of audit as a
searching examination, especially on the day of judgement.1 Even
accountants do not subscribe to such an apocalyptic view anymore and contemporary
descriptions of audit convey it to be an examination of records or accounts to
check their accuracy and also as an adjustment or correction of
accounts, 2 the emphasis being on accuracy, adjustment and correction.
In medical practice,
audit has been traditionally taken to refer to a procedure carried out by doctors
on their own professional activities with the ultimate aim of upgrading the
standard of
health care. 3 Previously, this was conducted on an ad hoc basis,
but now a more formal approach is adopted in health care delivery systems that
have a serious interest in maintaining and improving the quality of care. In
a working paper prepared for the Secretaries of State for Health in Wales, Northern
Ireland and Scotland in 1989, medical audit was defined as the systematic critical
analysis of the quality of medical care, including the procedures used for diagnosis
and treatment, use of resources and the resulting outcome, and quality of life
for the patient .4
The reasons why
a systematic approach is required are not far-fetched. First of all, advances
in medical knowledge proceed at such a fast pace that doctors need continuing
medical education
(what is now often described as continuous personal development or CPD). Medical
audit provides a means by which those in most urgent need of retraining in certain
areas of practice can be identified and encouraged to undergo such retraining.
Secondly, ignorance of advances in health care practices is not the sole reason
for deficiencies in health care, but rather, failure to apply what had been learnt.
Audit, and the expectation of it, provides an incentive for
people to apply what they have learnt and allows the
detection of those who do not. Thirdly, escalating costs in the face of dwindling
health care resources have motivated a re-appraisal of health practices to
improve efficiency in the management of available resources. Fourthly, in the
current era of evidence-based medicine, the data acquired from systematic medical
audit makes an indispensable contribution to the body of evidence used to build
a
case for best practices in a given clinical situation.
Objectives of Medical
Audit
The purpose of medical audit, ultimately,
is to improve the standard of health care delivery. The enabling objectives
for achieving this are systematic collection of relevant data, problem analysis
of specific clinical conditions or situations to identify root causes, implementation
of changes to current practices to improve effectiveness and efficiency, and
continuous personal development for personnel.
Structure of Medical
Audit
Audit of the healthcare delivery
process can take one of two main forms. There is utilisation review, which
assesses efficiency (often in quantitative terms); and there is an outcome
review that focuses on effectiveness of care and professional performance.
Whatever direction the audit may take, a central feature of medical audit is
the gathering of objective evidence of performance. The
traditional model of medical audit has been criticised for focusing too much
on data collection and not giving due
prominence to the implementation of change. 5 This has led to emphasis
being laid on problem-solving in the audit process and the evolution of what
is now known as criteria based audit.6, 7 The concept of criteria-based
clinical audits has led to a substantial revision of the components of what could
be regarded as an adequate audit and the adoption of a cyclical approach to the
process, making it in essence, a continuous one.
The essential
elements of a systematic approach to medical audit have been streamlined into
five main steps of the audit cycle. 3, 6 - 8
-
Identification of an area
of enquiry, interest or concern in healthcare and the outlining of specific
criteria of what is regarded as good quality or outcome.
- Measurement of current practice
by devising appropriate and reliable mechanisms of data collection, specification
of the period to be covered and analysis tailored to meet the previously set
criteria.
- Feedback of findings and
setting of targets for improvement.
- Introduction of new measures
to correct any deficiencies identified.
- Evaluation of the effectiveness
of the new measures through further targeted data collection.
For someone familiar
with the tenets of clinical operations research, this is familiar ground and
it makes it quite obvious that medical audit is not really a novel concept.
What is required now is a systematic approach to it so that as many aspects
of health care as are possible get included, a prerequisite for an overall
improvement in standards of care and the quality of life of the population
being served.
Medical Audit in the
Developing World
It is sometimes believed that criteria
based audit is applicable only in countries with well-developed basic infrastructure
and advanced healthcare systems that cover the needs of the overwhelming majority
of the population. Recent experiences from Africa, 8, 9 however
tend to suggest that criteria based audit can be effective even in much poorer
areas
with very limited resources.
Weeks and his
co-investigators 9 carried out an audit of maternity care at all
three major levels of health care, primary, secondary and tertiary, in Uganda.
They noted that in spite of the safe motherhood initiative, maternal mortality
ratios had remained unchanged in Uganda in the preceding decade, especially
in the rural areas where the staff tended to be isolated, poorly remunerated,
disempowered, lacking in morale, and having few skills to bring about change.
As a pilot project, they designed a training programme in criteria-based audit
for maternity care workers in a rural district with linkage to a tertiary care
University hospital followed by application of the principles learnt in the
trainees healthcare centres. The results were dramatic: Improvements were
seen in many standards of care. Staff showed universal enthusiasm for the training.
It can empower grassroots health workers to look for their own solutions to
common problems, thus producing sustainable and cost effective changes in the
standard of health care. 9 One important element of their approach
was the focus on problem analysis and implementation of change and this proved
to be highly effective in stimulating health workers to analyse their own situations
and provide creative solutions to problems.
A study following
similar principles, but limited to a tertiary care centre, was recently concluded
in Nigeria. 8 The investigators studied patients over two periods,
using the first two steps of the audit cycle (setting criteria and measuring
current practice) for the first set of patients and applying the last three
steps (target setting, implementing change and evaluation of the effects)
to a second set of subjects in a latter period. Efforts were concentrated
on five
clinical conditions that were identified as contributing the most to maternal
mortality - obstetric haemorrhage, eclampsia, obstructed labour, genital
sepsis and uterine rupture. Statistically significant improvements were noticed
in
the standard of care of the first four and other aspects of care such as
clinical monitoring and rational drug use were also noticed to have improved
considerably.
In fact, in
the first period drug use in the institution (by
the set criteria) was scored zero percent. By the second period, the score
had improved to nearly
90%.
The major lessons
to learn from these two examples are that criteria based clinical audit is
feasible in a developing country setting and that its application brings about
an improvement in the
standard of care.
Introducing Systematic Medical
Audit in Nigeria
The introduction of a systematic
programme of medical audit into health care practices in Nigeria is long overdue.
Some of the advantages to be derived from this have been highlighted above
such as improved efficiency and effectiveness of care. There are also other
potential benefits related to our peculiar socio-cultural environment. Properly
conducted audits demonstrating the kind of improvement in care described in
the examples mentioned above, with results being widely circulated among opinion
leaders in the community and other influential members of the civil society,
will encourage a greater proportion of the population to use orthodox healthcare
facilities rather than going to alternative practitioners, religious or traditional
healers many of whom now dominate our airwaves and the pages of the print media
with all kinds of bogus and unverifiable claims about curing the incurable.
The onus is on the medical profession to seize the bull by the horns and provide
the much needed leadership in this area. If the profession abdicates the leadership
role that rightfully belongs to it by virtue of the nature of the training
received and responsibilities entrusted to its members, externally derived
proposals that may be detrimental to the profession may well be imposed on
it.
Organisation of a Programme
of Medical Audit in
Nigeria
Drawing on the lessons learnt from
the Ugandan project, 9 it is important that all levels of health
care workers be involved in clinical audit and, possibly, utilisation review
as well. The scope would differ based on the level of training, but will include
every healthcare provider working at the three major levels of healthcare.
It is also important to involve administrators and politicians in the process
because many of the changes to be made will require financial or organisational
changes that can be
made only by those who have authority within the system.
As much as possible,
where judgement of competence is one of the set criteria of a particular audit
programme, such should be conducted by the peers of those whose work is being
reviewed. Those who understand the circumstances under which a professional
is practising are the best judges of the quality of the work done by that professional.
These are his/her peers. A situation where patients control the process may
not engender the full co-operation of doctors as the suspicion or fear of possible
litigation may becloud the atmosphere. Certainly, if there is suspicion of
egregious conduct, then it is important that the normal mechanisms put in place
to deal with such situations should be allowed to take their full course.
It is also important
to take local variations in circumstances into account in designing audit processes.
Centrally imposed structures and controls may ultimately prove to be unworkable
because of disparities in health care practices and standards from locality
to locality. It is however essential to ensure that local control does not
result in excessive rigidity or over-restriction of clinical freedom by those
at the
top of the local medical hierarchy.
A multistage approach
may be required in some situations so that problems at both the micro- and
macro-systemic levels can be tackled simultaneously. For instance, audit committees
in a group of local institution may review data about treatment methods and
outcome in patients over a period of time. Another committee may then be set
up at the zonal or central level to review the data from these institutions
to assess the efficiency of resource utilisation, adherence to policy guidelines
and
effectiveness in achieving institutional objectives.
Constraints to Implementation
For audit to be effective, a system
of adequate and meticulously kept medical records is indispensable. Accurate
records remain the only means by which objective evidence of performance can
be collected. Structured proforma, problem-oriented medical record (POMR) or
computer-based record keeping should replace the current narrative random jotting
that is the
hallmark of medical notes taken in Nigeria.
The advantages
of a structured approach to record keeping are exemplified by the experiences
garnered in the process of establishing the Child and Adolescent Psychiatry
Clinic at the University College Hospital, Ibadan. For many years, child and
adolescent referrals were attended to in the general psychiatry outpatient
clinics running twice a week. In the year 2000, a child and adolescent psychiatry
clinic for children and adolescents aged 0-17 years commenced operation. When
services commenced, a standardised assessment procedure involving a detailed
psychiatric interview with a psychiatric history and mental status examination,
as well as the administration of a semi- structured questionnaire containing
questions
pertaining to the childs development, medical, academic, social history and
also the current symptom lists for most of the childhood psychiatric disorders
was done for each patient. The comprehensive information obtained allowed the
identification of psychosocial stressors, arrival at appropriate multi-axial
psychiatric diagnoses using standard criteria and the setting up of a database
of information that could be used for research. The information obtained in the
first two years of operating the clinic has made it possible to identify the
management procedures and support staff required for the service. It has aided
the identification of psychosocial factors of public health importance and the
association between these factors and multi-axial diagnostic categories in the
patients. It has also
enabled the assessment of the influence of culture on the manifestation of
psychosocial factors. Such a structure approach to record keeping can be applied
to virtually
all areas of clinical practice.
Provision of resources
for the audit process and for implementing required changes is another potential
problem in a resource-poor setting like most Nigerian health institutions.
However, as the
findings from the Uganda and Nigerian criteria-based audits 8, 9 showed,
a lot can be achieved in terms of improvements in outcome without significant
additional financial input just by rekindling the interest of health care workers
in the care of their patients and boosting their morale.
The other major
problem is that of sustaining enthusiasm once the process begins to bring about
the desired improvement in standards of care. A mechanism must be put in place
to institutionalise regular audit meetings, possibly incorporating incentives
for
those who are consistent in conducting audits.
CONCLUSION
Audit is an effective means of
monitoring and improving standards in healthcare delivery. The trend now is
toward having an audit cycle where the implementation of desired changes and
evaluation of effectiveness are integrated with the traditional norm of data
collection. A structured programme of medical audit in Nigeria and other developing
countries is long overdue. The medical profession must take the lead in and
responsibility in ensuring that such programmes are commenced.
REFERENCES
-
Fowler HW, Fowler FG. The
concise Oxford dictionary of current English. Oxford University Press, Oxford.
1970.
-
The readers digest universal
dictionary. The Readers Digest, London, New York, Sydney Cape Town,
Montreal. 1987.
-
Omigbodun AO. Maintaining
standards in practice through medical audit. Nigerian Medical Journal 1989;
19: 195-199.
-
Anonymous. Working
papers to form the basis of detailed discussions. Br Med J 1989; 298:
587-593.
-
Berger A. Why doesn't audit
work? Br Med J 1998; 316: 875-876.
-
National institute for clinical
excellence. Principles for best practice in clinical audit. Radcliffe Medical
Press, Oxford. 2002.
-
Graham W, Wagaarachchi P,
Penney G, McCaw-Binns A, Yeboah Antwi K, Hall MH. Criteria for clinical audit
of the quality of hospital-based obstetric care in developing countries.
Bull WHO 2000; 78: 614-620.
-
Hunyinbo K, Sotiloye D,
Fawole B, Otolorin D. The value of criteria-based audits in improving the
quality of obstetric care at the Federal Medical Centre, Abeokuta (Abstr).
Trop J Obstet
Gynaecol 2003, 20 (Suppl 1): S32.
-
Weeks AD, Alia G, Ononge
S, Mutungi A, Otolorin EO, Mirembe FM. Introducing criteria based audit
into Ugandan maternity units. Br Med J 2003; 327: 1329-1331.
Copyright 2004 - Annals of African Medicine
|