Newsletter

Sign up for our quarterly newsletter and get the newest articles from acutecaretesting.org

Printed from acutecaretesting.org

Article

October 2006

What can you do to close the QC gap?

by Zoe Brooks
Quality assurance

This is the forth and final essay in a series of four essays on www.acutecaretesting.org. 

The first essay, "Quality control in theory and practice – a gap analysis", raised the question: Has “the system” given front-line laboratory workers the knowledge and tools they need to make quality control decisions wisely? Or is there a significant gap between QC theory and QC practice at the front line?

The second essay, "I found the gap… it’s in the basement!", provided examples and exercises to support my fear that “the founding principles of laboratory quality management are often poorly understood, inadequately practiced and inherently flawed”.

The third essay, "Quality control… the gap deepens", examined highlights from one of the online quizzes to see if this informal sampling supported the existence of a gap between QC theory and QC practice. It also raised the issue of a deeper and more insidious gap – a gap between perception and reality.

Each previous essay ended with: “These are my observations, and I truly hope that many of you will stand up and prove me wrong. If you would like to discuss this essay, or test your quality savvy with online quizzes, log on to zoebrooksquality.com/harmonize.

We are now at the forth and final essay – and no one has yet attempted to stand up to prove me wrong. So the question remains: "What can you do to close the gap?" 

INTRODUCTION

When the editorial board at acutecaretesting.org agreed to publish this series of articles 18 months ago, it was with the condition that the final essay be “What can you do to close the gap?” I figured that gave me lots of time to come up with a solution. 

This series of articles and the analysis of quiz results from people all around the globe has been a truly fascinating exercise.

It has left me even more convinced that a serious gap does exist between "what should be done" and "what is done" in the critically important field of laboratory quality control, and someone should do something about it. “What can you do to close the gap?”

FIGURE 1 shows a diagram of most of the key players in the laboratory industry.  I could not draw an organizational chart or trace relationships. In theory, the wisdom of the experts should trickle through the entire laboratory industry and permeate every aspect of what we do. 

In practice, I do not see a process to ensure that valid scientific processes are clearly taught in educational institutions and practiced by laboratory staff and manufacturers.  In my experience, regulatory requirements and inspections do not adequately verify that quality practices are referenced to scientific best practices. 

FIGURE 1

FIGURE 1: In theory, the wisdom of the experts should trickle through the entire laboratory industry and permeate every aspect of what we do

What you can do to close the gap depends on who you are and where you can influence practice.

HERE'S WHAT I WOULD DO... IF I WERE WORKING IN A CLINICAL LABORATORY

If I were a member of the front-line staff

  • I would make sure that I understand the concepts of quality control.

  • I would dare to ask “he/she who cannot be questioned” to explain what each number means and where they come from, and what is OK, and why that is OK and what must I do if it is not OK.

  • I would regard each patient sample as if it came from a beloved friend or relative, and make sure that when I initial a report as OK to go to the clinician, that the results are of suitable quality to enable him/her to reach an appropriate decision.

  • I would take pride in the role I play in this very important profession.

If I were a senior scientist
I would do everything the front-line staff member does, plus

  • I would ask the staff reporting to me:

    • What is the right answer for a specific QC sample?
    •  Where does that right answer come from, and
    • When and why would that right answer change?
    • How close do the QC results have to be to the right answer for patient results to meet the needs of local patients and clinicians? (What are the acceptable limits?)
    • Where do those acceptable limits come from?
    • How would you know if results are not good enough to report?
    • What would you do if results shifted from x to y?
    • Oh, by the way, I’d make sure I knew these answer myself first!
    • And I would make sure that what is done in the laboratory is the same as what is written in the procedure manual – and that those written procedures reflect current scientific best practices.

    If I were a laboratory medical director
    I would do everything the front line staff member and the senior scientist do, plus

    • I would communicate with the medical staff in my facility.
    • I’d ask the clinical staff “If a patient sample had a true value of x for test A, at what value would you consider that the patient’s condition was changed and take a different clinical course of action?”
    • I would compare those answers to the allowable error limits recommended in the literature, and use it to set my internal performance standards.
    • I would discuss the concepts of biological and analytical variation with the medial staff and tell them the size of variation that the lab can reliably detect.
    • I would pressure my LIS company to produce reports that couple known information on biological variation with my current quality control data on bias and imprecision to give the clinician an indication of the probability that the difference between two results reflects a true change in the biological condition of the patient.
    • I would conduct studies to confirm that the reference ranges reported in my laboratory reflect the patient population we serve.
    • I would make sure that the quality control processes used in my lab are:
        • based on samples that do indeed reflect changes in patient samples
        • capable of correctly reflecting method accuracy and precision
        • clearly defined in procedures for all staff
        • validated by competency assessment of staff at all levels

      If I were a quality assurance manager
      I would do everything the front-line staff member and the senior scientist do, plus

      • I would ensure that the processes and performance standards approved by the medical director are clearly documented and properly implemented by all staff.
      • I would challenge staff with quizzes and sample scenarios to ensure that unacceptable patient results will be quickly identified and corrected.
      • I would encourage a culture of quality.
      • I’d post results graphically and celebrate meeting performance standards.
      • I would encourage staff to identify OFIs (opportunities for improvement).
      • I would challenge my LIS and/or external QC software to ensure it is performing as recommended by scientific experts.

      HERE'S WHAT I WOULD DO... IF I WERE WORKING IN OTHER CRITICAL AREAS

      If I were in charge of a proficiency testing program or EQA program

      • I would draw on the expertise of the full range of laboratory professionals to create surveys and case studies that challenge the quality control process.

      If I were in charge of legislation governing requirements for laboratories

      • I would require laboratories to prove that their quality control practices can be traced to scientific references.
      • I don’t mean that they show the correct reference at the end of their written procedures, I mean that they are actually doing what is recommended by scientific leaders. 

      If I were in charge of a college or university program teaching preliminary or advanced programs for medical technologists or scientists

      • I would ensure that students are taught the fundamental meaning of quality, and how quality standards are set for clinical laboratories.
      • I would ask the teachers who prepare and present quality control education to show me how their material clearly teaches the students the meaning of the numerical data involved.
      • I would insist that students be able to describe in words the information conveyed by each number.
      • I would require that all educational material be referenced directly to scientific recommendations.
      • I would require tests and case studies that clearly demonstrate competence – the ability to recognize and react appropriately to instances of unacceptable quality.
      • I would fire anyone who still wanted to teach that “As long as your results are within ±2 SD, everything is OK.”

      If I were in the person who signed off on the final examination process to certify medical directors or other laboratory professionals

      • I would make it my personal obligation to ensure that the certification process requires graduates to be competent in the application of current recommended quality management processes.
        • I’d make sure that professionals in charge of safeguarding patient wellbeing would practice in a laboratory ONLY after proving they can assess QC data and charts to decide if a system is operating well enough to meet patient needs.

        If I were in charge of a commercial peer comparison program

        • I would ask a laboratory statistician to check my math to ensure that all the numbers I report are accurate and meaningful.
        • I would explain exactly how each number is calculated and what it means.
        • I would relate the numerical reports for each sample to clinical need or performance standards, in addition to peer comparison.

        If I were a manufacturer of quality control material

        • I would conduct and publish studies proving that my QC samples will indeed shift higher or lower if a change in the analytical process causes patient samples to shift higher or lower.
        • Similarly, I would prove that the precision reflected by my QC samples reflects the precision of patient samples.

        If I were a manufacturer of laboratory instrumentation and/or reagents

        • I would conduct and publish studies proving that my system is capable of meeting defined and referenced performance standards.
        • I would clearly define how the user can adequately monitor ongoing accuracy and precision, using methods referenced to current scientific recommendations. 

        If I were a QC software developer

        • I would publish a certificate that a recognized laboratory quality control expert has verified that my quality control practices are indeed the same as those recommended in scientific references.
        • I would challenge the system to ensure that all possible quality control flags will be generated as planned.
        • I would make sure that people cannot do things like mix data from different reagent batches or instruments, or “turn off all the Westgard rules so they can report results without flags”.
        • I would create action reports to make it easy for senior staff to constantly monitor performance against defined standards. 

        If I were in charge of CLSI, or similar organizations

        • I would develop implementation plans and teaching guides to accompany each guideline.

        If I were a scientific expert who creates and publishes quality control concepts

        • I would rewrite the scientific literature into clear, simple, straightforward language with detailed examples for each discipline
        • I would provide written sample procedures with clear instructions on exactly how to obtain each input number, and interpret each output number
        • I would test what it takes for others to become competent in the applications of my concepts, and provide appropriate teaching tools for all levels of lab professionals

        If I could, in any of the above "personalities"

        • I would create an Internet community where laboratory professionals can come together to share best practices and benchmark their analytical performance against performance standards.
        • I would promote a culture of confidence, competence and pride.
        • I would certify laboratory professionals at various levels based on competency challenges.
        • I would host quality management Olympics.
        • I would applaud those who take steps forward to better quality.

        If I was one of those folks, I would do whatever I could to close the gap.  But I am none of the above.  So here’s what I would do … if I was just me, or maybe you

        I’d start talking about quality. I’d let people know that there may be a problem here. I’d look for opportunities to make things better.

        If we start talking, we might be able to open communication channels so the recommendations of the experts become everyday practice. 

        In theory, the wisdom of the experts should trickle through the entire laboratory industry and permeate every aspect of what we do.

        CONCLUSION

        I wish to thank the editorial board at acutecaretesting.org for providing a forum to explore this potentially controversial topic, and also the many people who visited my website and challenged the QC quizzes. I am delighted that this series of essays has raised awareness, and will apparently make a difference.  

        Once again, these are my observations, and I invite you to discuss this essay or test your quality savvy with QC quizzes by logging on to www.zoebrooksquality.com/harmonize.

        Watch for a future essay to compare the recommendations of experts and provide a checklist to verify your QC processes!

        References
        1. Online quizzes and discussions at www.zoebrooksquality.com/moodle/course/view.php?id=35
        2. Westgard JO, Burnett RW, Bowers GN. Quality management science in clinical chemistry: A dynamic framework for continuous improvement of quality. Clin Chem 1990; 36; 1712-16
        3. Fraser CG. Biological variation and quality for POCT. acutecaretesting.org, 2001
        4. Klee GG. Quality management of blood gas assays. acutecaretesting.org, 2001
        5. Westgard JO. Quality planning and control strategies. acutecaretesting.org 2001
        6. Westgard JO. A six sigma primer desc. acutecaretesting.org, 2002
        7. Bais R. The use of capability index for running and monitoring quality control. acutecaretesting.org, 2003
        8. Kristensen HB. Proficiency testing versus QCdatacomparison programs. acutecaretesting.org, 2003
        9. Thomas A. What is EQA acutecaretesting.org, 2004
        10. Ehrmeyer SS, Laessig RH. The new CLIA quality control regulations and blood gas testing. acutecaretesting.org, 2004
        11. Tonks DB. A study of the accuracy and precision of clinical chemistry determinations in 170 Canadian laboratories. Clin Chem 1963; 9: 217-23
        12. Westgard JO, Quam EF, Barry PL. Selection grids for planning QC procedures. Clin Lab Sci 1990; 3: 271-78
        13. Fraser CG, Kallner A, Kenny D, Hyltoft Petersen P. Introduction: strategies to set global quality specifications in laboratory medicine. Scand J Clin Lab Invest 1999; 59: 477-78
        14. Brooks, Z. Performance-driven quality control. AACC Press, Washington DC, 2001 ISBN 1-899883-54-9
        15. Brooks, Z. Quality Control – From Data to Decisions. Basic Concepts, Trouble Shooting, Designing QC Systems. Educational Courses. Zoe Brooks Quality Consulting. 2003
        16. Brooks Z, Plaut D, Begin C, Letourneau A. Critical systematic error supports use of varied QC rules in routine chemistry. AACC Poster San Francisco 2000
        17. Brooks Z, Massarella G. A computer programme that quickly and rapidly applies the principles of total error in daily quality management. Proceedings of the XVI International Congress of Clinical Chemistry, London, UK, AACB 1996
        18. Brooks Z, Plaut D, Massarella G. How total error can save time and money for the lab. Medical Laboratory Observer, Nov. 1994, 48-54
        19. Brooks Z, Plaut D, Massarella G. Using total allowable error to assess performance, qualify reagents and calibrators, and select quality control rules: real world examples. AACC Poster, New York, 1993
        20. Brooks Z, Plaut D, Massarella G. Using total allowable error to qualify reagents and calibrators. AACC Poster, Chicago, 1992
        + View more
        References
        1. Online quizzes and discussions at www.zoebrooksquality.com/moodle/course/view.php?id=35
        2. Westgard JO, Burnett RW, Bowers GN. Quality management science in clinical chemistry: A dynamic framework for continuous improvement of quality. Clin Chem 1990; 36; 1712-16
        3. Fraser CG. Biological variation and quality for POCT. acutecaretesting.org, 2001
        4. Klee GG. Quality management of blood gas assays. acutecaretesting.org, 2001
        5. Westgard JO. Quality planning and control strategies. acutecaretesting.org 2001
        6. Westgard JO. A six sigma primer desc. acutecaretesting.org, 2002
        7. Bais R. The use of capability index for running and monitoring quality control. acutecaretesting.org, 2003
        8. Kristensen HB. Proficiency testing versus QCdatacomparison programs. acutecaretesting.org, 2003
        9. Thomas A. What is EQA acutecaretesting.org, 2004
        10. Ehrmeyer SS, Laessig RH. The new CLIA quality control regulations and blood gas testing. acutecaretesting.org, 2004
        11. Tonks DB. A study of the accuracy and precision of clinical chemistry determinations in 170 Canadian laboratories. Clin Chem 1963; 9: 217-23
        12. Westgard JO, Quam EF, Barry PL. Selection grids for planning QC procedures. Clin Lab Sci 1990; 3: 271-78
        13. Fraser CG, Kallner A, Kenny D, Hyltoft Petersen P. Introduction: strategies to set global quality specifications in laboratory medicine. Scand J Clin Lab Invest 1999; 59: 477-78
        14. Brooks, Z. Performance-driven quality control. AACC Press, Washington DC, 2001 ISBN 1-899883-54-9
        15. Brooks, Z. Quality Control – From Data to Decisions. Basic Concepts, Trouble Shooting, Designing QC Systems. Educational Courses. Zoe Brooks Quality Consulting. 2003
        16. Brooks Z, Plaut D, Begin C, Letourneau A. Critical systematic error supports use of varied QC rules in routine chemistry. AACC Poster San Francisco 2000
        17. Brooks Z, Massarella G. A computer programme that quickly and rapidly applies the principles of total error in daily quality management. Proceedings of the XVI International Congress of Clinical Chemistry, London, UK, AACB 1996
        18. Brooks Z, Plaut D, Massarella G. How total error can save time and money for the lab. Medical Laboratory Observer, Nov. 1994, 48-54
        19. Brooks Z, Plaut D, Massarella G. Using total allowable error to assess performance, qualify reagents and calibrators, and select quality control rules: real world examples. AACC Poster, New York, 1993
        20. Brooks Z, Plaut D, Massarella G. Using total allowable error to qualify reagents and calibrators. AACC Poster, Chicago, 1992
        Disclaimer

        May contain information that is not supported by performance and intended use claims of Radiometer's products. See also Legal info.

        Zoe Brooks

         

        8070 Highway 17 West 
        Worthington>Ontario 
        Canada P0M 3H0

        Articles by this author
        Acutecaretesting handbook

        Acute care testing handbook

        Get the acute care testing handbook

        Your practical guide to critical parameters in acute care testing. 

        Download now
        Webinar

        Scientific webinars

        Check out the list of webinars

        Radiometer and acutecaretesting.org present free educational webinars on topics surrounding acute care testing presented by international experts.

        Go to webinars

        Related Articles

        Sign up for the Acute Care Testing newsletter

        Sign up
        About this site About Radiometer Contact us Legal notice Privacy policy
        This site uses cookies Read more