John Flemming, DirectorThe laboratory had initially misinterpreted the results and did not investigate the unexpected finding, revealing a gap in their testing procedure. A subsequent review and update of the laboratory’s procedure produced a more robust test system, with lessons applicable to other analytical methods.
The scenario underlines IFM’s deliberate approach to proficiency testing, using challenging samples to uncover weaknesses that routine testing may not reveal. The value of this approach extends beyond confirming the accuracy of a laboratory’s results. It provides insight into where its methods or result interpretation need strengthening.
The proficiency testing samples at IFM are designed with due consideration for the complexities of the organisms and matrix materials under test. Multiple samples offer several analytes at varying concentration levels. Wherever possible, these samples are real and ready-to-test. They also factor in variables that can complicate detection and interpretation, such as the chemistry of the material and competing flora and/or non-target strains. This range of challenges enables laboratories to acquire greater insight into the performance, strengths and limitations of their testing process.
“The aim is to always produce samples that meet the needs of participants. However, it’s also important to ensure the samples address scenarios beyond what’s expected, as these exceptions can trigger a testing failure,” says John Flemming, Director.
Matching Samples to the Testing Method
IFM’s proficiency testing programs cover a range of parameters and sample types suited to different laboratory methods and standards. Some samples are designed for methods like PCR, while others support food, pharmaceutical and water testing. IFM also provides generic samples, with preservation and presentation tailored to the specific sample type.
-
The aim is to always produce samples that meet the needs of participants. But it’s also important to ensure the samples address scenarios beyond what’s expected, as these exceptions can trigger a testing failure.
The goal across all programs is to ensure laboratories produce reliable results that can be trusted by their clients and acted upon with confidence. The health and wellbeing of people, animals and the environment depend on that reliability.
To achieve that, IFM manufactures its samples factoring in characteristics of the base material, the appropriate sample format and associated manufacturing techniques, required shelf life and storage conditions. A strict quality control regime, supported by documented and consistent processes, ensures quality and consistency across batches.
Following Through on the Result
IFM’s role continues after a laboratory submits its proficiency testing results. Its technical staff reviews the outcomes and engages with laboratories when a result warrants further discussion. While IFM cannot see the changes laboratories make internally, it can see their impact over time through more accurate and consistent results. What IFM learns also feeds back into its own work, helping shape future samples and programs.
IFM also sees value in providing learning opportunities across the whole laboratory, not just to a small group of analysts. Proof of proficiency requires the engagement of the entire laboratory. For this reason, IFM does not impose additional fees for the submission of multiple sets of results and offers affordably priced additional sample sets, giving the whole laboratory an opportunity to participate and learn from the process.
Credibility Built In-House
In addition to proficiency testing, IFM also produces reference materials and operates its own accredited biological testing laboratory. The IFM laboratory provides first-hand insight into the practical challenges laboratories face, reinforcing its commitment to rigorous scientific practice. Furthermore, IFM always welcomes customer feedback and suggestions.
This commitment to listen, improve and deliver better results dates back to IFM’s founding in 1994, in Ingleburn, Australia. In the decades since, IFM has worked with more than 2,000 laboratories, challenging them with scenarios ranging from the routine to the unexpected. The purpose is not simply to provide a scorecard, but to keep laboratories ready for what a real-world sample may bring.
Proficiency Testing That Reveals Method Limits
Proficiency testing is less useful when the challenge is easy to predict. A laboratory can do well with familiar concentrations and still have weaknesses in how it chooses a method or interprets results. For life science leaders, the bigger question is whether a program can bring those weaknesses to light before they affect routine reporting. Accreditation is important, but it does not tell buyers how well the test itself has been designed. What matters is whether the scheme simply confirms that a laboratory can perform routine testing or also shows where its test system may start to struggle. Buyers therefore need enough detail on sample construction and scoring to know what a satisfactory result really says about laboratory performance.
A proficiency score can look reassuring when the specimens are too simple, but it does not necessarily show how a method will perform when conditions are less predictable. A useful program should reveal how the method responds when organisms compete, analyte levels shift, matrix chemistry interferes or non-type strains make results harder to interpret. The exercise should put routine methods through a realistic test without making the conditions feel artificial. Concentration ranges should help identify where interpretation becomes difficult, while matrix choices should reflect the chemistry and microbial background laboratories actually encounter. Ready-to-test materials can reduce preparation differences too, making it easier to tell whether a poor result comes from the test system or the exercise itself. The challenge should test judgment as well.
A clean result from one analyst does not tell you much about variation across the rest of the laboratory. Broader participation allows laboratories to compare performance across staff or repeated result sets without making the exercise an unreasonable budget burden. Poor scores should also lead to something useful. Reporting alone has limited value if laboratories cannot investigate an outlier and use the finding to revise a procedure. Technical dialogue becomes valuable at that stage, provided the provider helps clarify the result without taking over the laboratory’s own root-cause work. Repeated participation should then show whether corrective changes are holding rather than simply closing out a single incident.
“IFM Quality Services permits multiple result submissions without extra fees, allowing broader laboratory participation in the same exercise.”
Finding the right program is not always straightforward when laboratories use different microbiological methods and sample matrices. A generic exercise may not pick up problems that are specific to a particular method, especially when molecular techniques or unusual materials affect how results are interpreted. That is why buyers should check whether a program actually covers the test methods and sample types used in their laboratory, rather than relying on a standard template. The materials themselves deserve attention too. Base material, presentation format, shelf life and storage conditions can all influence the usefulness of the results. Consistent production and documented quality control should be part of the buying decision, not something left to the back office. Programs should also be reviewed over time, with sample formats changing when recurring results point to limitations in the exercise.
For laboratories that expect proficiency testing to do more than confirm routine performance, IFM Quality Services is a provider worth considering. Its microbiological programs include multiple samples and different analyte levels, with real ready-to-test materials used where practical. Laboratories can also submit results multiple times without paying extra fees, making it easier for more staff to take part in the same exercise. The programs cover foods, pharmaceuticals, water and generic sample types, including samples developed for PCR-based methods. IFM produces reference materials as well as proficiency testing programs. It also runs an accredited biological testing laboratory, keeping its program design closely connected to laboratory practice. Where sample challenge and method relevance matter, IFM provides a practical option beyond straightforward pass-fail confirmation.
...Read more
