Making performance-based chemistry work: how we created comparable data among laboratories as part of a Southern California marine regional assessment

Quality assurance procedures to ensure consistency among chemistry laboratories typically involves the use of standard methods and state certification programs that require laboratories to demonstrate their ability to attain generic performance criteria. To assess whether these procedures are effective for ensuring comparability when processing local samples with potentially complex matrices, seven experienced, state-certified laboratories participated in an intercalibration exercise. Each laboratory was permitted to use their typical methodology for quantifying PAH, PCB and DDT on shared samples collected from Santa Monica Bay and the Palos Verdes Shelf, two sites with a complex mix of constituents. In the initial intercalibration exercise, results from these laboratories differed by as much as an order of magnitude for all three chemical groups. Much, but not all, of the difference was attributable to differences in detection capability. A series of studies was conducted to identify the reasons for the observed differences, which varied among laboratories and included methodological differences, instrument sensitivity differences, and differing interpretations of chromatograms. Following these investigations and resulting modifications to laboratory procedures, the exercise was repeated. The average coefficient of variation among laboratories across all chemical parameters was reduced to less than 30%. Our results suggest that performance-based chemistry can produce comparable results, but the certification processes presently in place that focus on general laboratory procedures and simple matrices are insufficient to achieve comparability.     

Interlaboratory evaluation of trace element determination in workplace air filter samples by inductively coupled plasma mass spectrometry

Inductively coupled plasma mass spectrometry (ICP-MS) is becoming more widely used for trace elemental analysis in the occupational hygiene field, and consequently new ICP-MS international standard procedures have been promulgated by ASTM International and ISO. However, there is a dearth of interlaboratory performance data for this analytical methodology. In an effort to fill this data void, an interlaboratory evaluation of ICP-MS for determining trace elements in workplace air samples was conducted, towards fulfillment of method validation requirements for international voluntary consensus standard test methods. The study was performed in accordance with applicable statistical procedures for investigating interlaboratory precision. The evaluation was carried out using certified 37-mm diameter mixed-cellulose ester (MCE) filters that were fortified with 21 elements of concern in occupational hygiene. Elements were spiked at levels ranging from 0.025 to 10 μg filter(-1), with three different filter loadings denoted "Low", "Medium" and "High". Participating laboratories were recruited from a pool of over fifty invitees; ultimately twenty laboratories from Europe, North America and Asia submitted results. Triplicates of each certified filter with elemental contents at three different levels, plus media blanks spiked with reagent, were conveyed to each volunteer laboratory. Each participant was also provided a copy of the test method which each participant was asked to follow; spiking levels were unknown to the participants. The laboratories were requested to prepare the filters by one of three sample preparation procedures, i.e., hotplate digestion, microwave digestion or hot block extraction, which were described in the test method. Participants were then asked to analyze aliquots of the prepared samples by ICP-MS, and to report their data in units of μg filter(-1). Most interlaboratory precision estimates were acceptable for medium- and high-level spikes (RSD <25%), but generally yielded greater uncertainties than were anticipated at the outset of the study.     

An interlaboratory comparison of sediment elutriate preparation and toxicity test methods

Elutriate bioassays are among numerous methods that exist for assessing the potential toxicity of sediments in aquatic systems. In this study, interlaboratory results were compared from 96-h Ceriodaphnia dubia and Pimephales promelas static-renewal acute toxicity tests conducted independently by two laboratories using elutriate samples prepared from the same sediment. The goal of the study was to determine if the results from the elutriate tests were comparable between two U.S. Environmental Protection Agency (USEPA) laboratories when different elutriate preparation procedures were employed by each lab. Complete agreement in site characterization was attained in 22 of the 25 samples for both bioassays amongst each lab. Of the 25 samples analyzed, 10 were found to be toxic to at least one of the species tested by either laboratory. The C. dubia elutriate tests conducted by the National Exposure Research Laboratory (NERL) indicated that 7 of the 25 sediment samples were toxic, while 8 sediment samples were characterized as such in testing conducted by USEPA Region 6 (Region 6). The P. promelas elutriate tests conducted by NERL determined 8 samples as toxic, while Region 6 tests displayed toxicity in 5 of the samples. McNemar's test of symmetry for C. dubia (S?=?0.33, p?=?0.5637) and P. promelas (S?=?3.0, p?=?0.0833) tests indicated no significant differences in designating a site toxic between NERL and Region 6 laboratories. Likewise, Cohen's kappa test revealed significant agreement between NERL and Region 6 C. dubia (K?=?0.7148, p?<?0.01) and P. promelas (K?=?0.6939, p?<?0.01) elutriate tests. The authors conclude that differences in interlaboratory elutriate preparation procedures have no bearing on the ability of either the C. dubia or P. promelas bioassay testing methods to detect toxicity while yielding similar results.     

Determination of organochlorinated compounds and petroleum hydrocarbons in sediment sample IAEA-408. Results from a world-wide intercalibration exercise

A sediment sample from the intertidal mudflats of the Tagus estuary was prepared, homogenised and distributed globally to laboratories as the IAEA-408 intercomparison material for the analyses of organochlorinated pesticides, PCBs and petroleum hydrocarbons (PHs). A total of 48 laboratories from 36 countries reported their results. The data from participants show that there still remain some difficulties with the accurate determination of organic contaminants such as pesticides and polycyclic aromatic hydrocarbons (PAHs). More consistent interlaboratory results were obtained for PCBs congeners. The final results of this intercomparison exercise enable individual participants to assess their performance and, where necessary, to introduce appropriate modifications in their analytical procedures. Furthermore, as a series of statistical criteria was fulfilled for a number of compounds, the sample IAEA-408 can now be used as a reference material for quality control in the determination of some persistant organic pollutants (POPs) in marine sediment samples.     

An ultra-clean firn core from the Devon Island Ice Cap, Nunavut, Canada, retrieved using a titanium drill specially designed for trace element studies

An electromechanical drill with titanium barrels was used to recover a 63.7 m long firn core from Devon Island Ice Cap, Nunavut, Canada, representing 155 years of precipitation. The core was processed and analysed at the Geological Survey of Canada by following strict clean procedures for measurements of Pb and Cd at concentrations at or below the pg g(-1) level. This paper describes the effectiveness of the titanium drill with respect to contamination during ice core retrieval and evaluates sample-processing procedures in laboratories. The results demonstrate that: (1) ice cores retrieved with this titanium drill are of excellent quality with metal contamination one to four orders of magnitude less than those retrieved with conventional drills; (2) the core cleaning and sampling protocols used were effective, contamination-free, and adequate for analysis of the metals (Pb and Cd) at low pg g(-1) levels; and (3) results from 489 firn core samples analysed in this study are comparable with published data from other sites in the Arctic, Greenland and the Antarctic.     

Interlaboratory evaluation of endotoxin analyses in agricultural dusts--comparison of LAL assay and mass spectrometry

Endotoxin exposure is associated with wheeze and asthma morbidity, while early life exposure may reduce risk of allergy and asthma. Unfortunately, it is difficult to compare endotoxin results from different laboratories and environments. We undertook this study to determine if lipopolysaccharide (LPS) extraction efficiency could account for differences among laboratories. We generated and collected aerosols from chicken and swine barns, and corn processing. We randomly allocated side-by-side filter samples to five laboratories for Limulus assay of endotoxin. Lyophilized aliquots of filter extracts were analyzed for 3-hydroxy fatty acids (3-OHFAs) as a marker of LPS using gas chromatography-mass spectrometry. There were significant differences in endotoxin assay and GC-MS (LPS) results between laboratories for all dust types (p < 0.01). Patterns of differences between labs varied by dust type. Relationships between assay and GC/MS results also depended on dust type. The percentages of individual 3-OHFA chain lengths varied across labs (p < 0.0001) suggesting that each lab recovered a different fraction of the LPS available. The presence of large amounts of particle associated LPS and absence of a freezing thawing cycle were associated with lower correlations between LPS and bioactivity, consistent with an absence of Limulus response to cell-bound endotoxin. These data suggest that extraction methods affect endotoxin measurements. The LAL methods may be most suitable when comparing exposures within similar environments; GC-MS offers additional information helpful in optimizing sample treatment and extraction. GC-MS may be of use when comparing across heterogeneous environments and should be considered for inclusion in future studies of human health outcomes.     

QUASIMEME laboratory performance study of the biological effects of tributyltin (imposex and intersex) on two marine gastropod molluscs

The disruption of the endocrine systems of gastropod molluscs and consequential physiological changes (imposex and intersex) are used as biomarkers for environmental contamination by tributyltin compounds. The first international laboratory performance study on the determination of imposex and intersex in neogastropod molluscs, Nucella lapillus and Littorina littorea has been undertaken by the QUASIMEME (Quality Assurance of Information for Marine Environmental Monitoring in Europe) project. Samples of live gastropods were distributed and participants were asked to record shell height and sex, together with penis length and vas deferens sequence stage (VDS) in Nucella or the intersex stage (IS) and prostate length in Littorina. Calculations were made of vas deferens sequence index (VDSI) and the relative penis size index (RPSI) in Nucella and of intersex stage index (ISI) and the average female prostate length (FPrL) in Littorina. Thirteen (87%) of the 15 participating laboratories returned data. The remaining two laboratories asked to participate in later exercises. For Nucella, seven laboratories reported sex ratios significantly different from the reference laboratory data. Differences in penis length measurements between laboratories were largely random, although there were indications of systematic errors affecting the data from three laboratories. Seven laboratories reported satisfactory data (Z-score magnitude of Z < 2) for VDSI. The inclusion of a high proportion of sub-adults in the Nucella samples may have made separation of the sexes more difficult than in mature adults. The sub-adults will have had smaller pene than mature adults in the same population, and therefore any errors (random or systematic) in the measurement of penis length or observation of reproductive organs would have a potentially greater impact on the final reported values of the summary imposex indices. The Littorina sample did not show a high degree of intersex (ISI = 0.41). The laboratories could determine the sex of Littorina reliably and only one laboratory reported data significantly different from the reference laboratory. All except two laboratories reported satisfactory data for ISI.     

Bias from two analytical laboratories involved in a long-term air monitoring program measuring organic pollutants in the Arctic: a quality assurance/quality control assessment

Initiated in 1992, air monitoring of organic pollutants in the Canadian Arctic provided spatial and temporal trends in support of Canada's participation in the Stockholm Convention of Persistent Organic Pollutants. The specific analytical laboratory charged with this task was changed in 2002 while field sampling protocols remained unchanged. Three rounds of intensive comparison studies were conducted in 2004, 2005, and 2008 to assess data comparability between the two laboratories. Analysis was compared for organochlorine pesticides (OCPs), polychlorinated biphenyls (PCBs) and polycyclic aromatic hydrocarbons (PAHs) in standards, blind samples of mixed standards and extracts of real air samples. Good measurement accuracy was achieved for both laboratories when standards were analyzed. Variation of measurement accuracy over time was found for some OCPs and PCBs in standards on a random and non-systematic manner. Relatively low accuracy in analyzing blind samples was likely related to the process of sample purification. Inter-laboratory measurement differences for standards (<30%) and samples (<70%) were generally less than or comparable to those reported in a previous inter-laboratory study with 21 participating laboratories. Regression analysis showed inconsistent data comparability between the two laboratories during the initial stages of the study. These inter-laboratory differences can complicate abilities to discern long-term trends of pollutants in a given sampling site. It is advisable to maintain long-term measurements with minimal changes in sample analysis.     

Interlaboratory variability of amphipod sediment toxicity tests in a cooperative regional monitoring program

Marine sediment toxicity tests are widely applied in monitoring programs, yet relatively little is known about the comparability of data from different laboratories. The need for comparability information is increased in cooperative monitoring programs, where multiple laboratories (often with variable skill levels) perform toxicity tests. An interlaboratory comparison exercise was conducted among seven laboratories in order to document the comparability of sediment toxicity measurements during the Bight'98 regional sediment survey in southern California. Sediments from four stations in Los Angeles and Long Beach Harbors were tested using a 10-day survival test of the amphipod Eohaustorius estuarius. All laboratories successfully performed the sediment test and associated reference toxicant test. Statistically significant differences were found in mean amphipod survival rates among some laboratories for the field-collected sediments, but there was little evidence of a consistent bias among laboratories. Although the reference toxicant test indicated a five-fold variation in test sensitivity among laboratories, these results were not accurate predictors of interlaboratory performance for the sediment tests. The laboratories demonstrated excellent concordance (Kendall's W = 0.91) in ranking the field-collected sediments by toxicity. Agreement on classifying the sediments into categories (nontoxic, moderately toxic, and highly toxic) based upon the percent of survival was best for highly toxic sediments. An analysis of test precision based upon the variance among replicates within a test indicated that the measured survival rate for a sample may vary by up to 12 percentage points from the actual response.     

荧光法快速测定水中粪大肠菌群

为研究荧光法测定水中粪大肠菌群的适用性,在6家实验室使用荧光法对粪大肠菌群的标准菌株和实际水样进行测定,并与多管发酵法进行比对。结果表明:6家实验室对标准菌株的监测结果均在误差范围内,实验室内相对误差为-2. 75%～1. 71%,准确度较高;对3个不同浓度实际水样进行精密度测定,实验室内相对标准偏差分别为1. 30%～3. 93%、1. 94%～4. 72%、1. 88%～4. 54%,实验室间的相对标准偏差分别为1. 14%、1. 59%、1. 72%,精密度较高;用荧光法与多管发酵法同时测定实际水样,2种方法测试结果线性相关性良好且变化趋势相同,对测试数据进行t检验,2种方法测试结果无显著差异。     

环境监测实验室方法确认过程中常见问题探讨

根据实验室资质认定对于方法确认的要求,结合环境监测实验室的特点,提出了新项目方法确认的具体步骤,并分析了其中存在的常见问题。指出在方法确认过程中,应严格按照标准方法和监测技术规范进行全过程试验,尤其不能忽视采样现场实验、空白实验和检出限的测定。建议在精密度与准确度检验过程中,使用高、中、低不同浓度的有证标准样品,实际样品加标回收,比对试验（方法比对、人员比对、实验室间比对）,增加分析次数等多种手段,确保新项目开展的可靠性。     

藻密度手工监测实验室间比对研究

为研究不同实验室藻密度监测数据的可靠性,现场采集了藻密度样品,处理为现场平行样和实验室前处理后平行样2种,分别由5家实验室的6名技术人员开展检测分析。参考相关技术规范要求,结合其他领域相似工作的成功应用案例,采用Z比分数法对分析结果开展藻密度实验室间比对。结果表明,数据的相对偏差均符合技术规范要求;对藻密度进行数据直接比对和对数转换后比对,各实验室对现场平行样和实验室前处理后平行样的检测结果均为合格;分析方法原理导致藻密度手工监测的绝对数值偏差较大,对当前的太湖水华预警工作适用性不高。     

Improving data quality on low level mercury wastewater analysis

In order to compare treatability test results evaluating low-level mercury (Hg) removal from oil refinery wastewater, improvements in Hg analytical methods were conducted at two US EPA certified analytical labs. The revisions in the analytical protocols improved Hg recoveries and hence enabled more reliable data interpretation and comparison for the specific wastewater tested. Nevertheless, significant differences between results from the two laboratories were identified in a split-sample experiment.     

Comparison of beach bacterial water quality indicator measurement methods

Three methods (membrane filtration, multiple tube fermentation, and chromogenic substrate technology kits manufactured by IDEXX Laboratories, Inc.) are routinely used to measure indicator bacteria for beach water quality. To assess comparability of these methods, quantify within-laboratory variability for each method, and place that variability into context of variability among laboratories using the same method, 22 southern California laboratories participated in a series of intercalibration exercises. Each laboratory processed three to five replicates from thirteen samples, with total coliforms, fecal coliforms or enterococci measured depending on the sample. Results were generally comparable among methods, though membrane filtration appeared to underestimate the other two methods for fecal coliforms, possibly due to clumping. Variability was greatest for the multiple tube fermentation method. For all three methods, within laboratory variability was greater than among laboratories variability.     

Preparation, certification and interlaboratory analysis of workplace air filters spiked with high-fired beryllium oxide

Occupational sampling and analysis for multiple elements is generally approached using various approved methods from authoritative government sources such as the National Institute for Occupational Safety and Health (NIOSH), the Occupational Safety and Health Administration (OSHA) and the Environmental Protection Agency (EPA), as well as consensus standards bodies such as ASTM International. The constituents of a sample can exist as unidentified compounds requiring sample preparation to be chosen appropriately, as in the case of beryllium in the form of beryllium oxide (BeO). An interlaboratory study was performed to collect analytical data from volunteer laboratories to examine the effectiveness of methods currently in use for preparation and analysis of samples containing calcined BeO powder. NIST SRM(?) 1877 high-fired BeO powder (1100 to 1200 °C calcining temperature; count median primary particle diameter 0.12 μm) was used to spike air filter media as a representative form of beryllium particulate matter present in workplace sampling that is known to be resistant to dissolution. The BeO powder standard reference material was gravimetrically prepared in a suspension and deposited onto 37 mm mixed cellulose ester air filters at five different levels between 0.5 μg and 25 μg of Be (as BeO). Sample sets consisting of five BeO-spiked filters (in duplicate) and two blank filters, for a total of twelve unique air filter samples per set, were submitted as blind samples to each of 27 participating laboratories. Participants were instructed to follow their current process for sample preparation and utilize their normal analytical methods for processing samples containing substances of this nature. Laboratories using more than one sample preparation and analysis method were provided with more than one sample set. Results from 34 data sets ultimately received from the 27 volunteer laboratories were subjected to applicable statistical analyses. The observed performance data show that sample preparations using nitric acid alone, or combinations of nitric and hydrochloric acids, are not effective for complete extraction of Be from the SRM 1877 refractory BeO particulate matter spiked on air filters; but that effective recovery can be achieved by using sample preparation procedures utilizing either sulfuric or hydrofluoric acid, or by using methodologies involving ammonium bifluoride with heating. Laboratories responsible for quantitative determination of Be in workplace samples that may contain high-fired BeO should use quality assurance schemes that include BeO-spiked sampling media, rather than solely media spiked with soluble Be compounds, and should ensure that methods capable of quantitative digestion of Be from the actual material present are used.     

Excel在确定监测方法重复性与再现性中的运用

依据《测量方法与结果的准确度(正确度与精密度)第二部分:确定标准测量方法重复性与再现性的基本方法》(GB/T 6379.2-2004),用事例给出了在实验室数据剔除或缺失时,确定监测方法重复性与再现性的Excel计算表和公式。     

Selection and application of a rainbow trout toxicity testing procedure for screening Sacramento River Watershed, California samples

A number of procedures have been developed to assess toxic effects on the early life stages of salmonid fish. In this study 13 rainbow trout embryo development relatively short-term (7 to 90 day) procedures were reviewed. Three 7-day methods from the published literature and three modifications developed at AQUA-Science (A-S) were evaluated in the laboratory. Based on that evaluation, A-S methods were selected for screening surface water samples (A-S 1) collected in the Sacramento River watershed (California) and for conducting toxicity identification evaluations (TIE) to identify cause(s) of toxicity. Test control performance, test sensitivity, and reference toxicant response variability in the A-S 1 were superior to those in commonly used freshwater toxicity testing methods. The incidence of Sacramento River watershed samples resulting in a notable decrease in embryo development was very low. Of 260 samples screened only 16 (6%) resulted in statistically significant inhibition of embryo development. Of the 16 toxic samples, nine caused minimal (less than 20% abnormal development) and four marginal (less than 30%) toxicity. Samples collected from the agriculture-dominated Colusa Basin Drain and rangeland/forest-dominated Battle Creek on June 16, 2005 caused significant toxicity. TIE procedures indicated that cationic chemicals were the primary cause of toxicity. Metals analysis did not reveal concentrations sufficient to inhibit embryo development, so the most probable cause of toxicity in the two samples was cationic chemicals (perhaps surfactants?) or metals that were not included in the analytical screening.     

Development of an ombrotrophic peat bog (low ash) reference material for the determination of elemental concentrations

Given the increasing interest in using peat bogs as archives of atmospheric metal deposition, the lack of validated sample preparation methods and suitable certified reference materials has hindered not only the quality assurance of the generated analytical data but also the interpretation and comparison of peat core metal profiles from different laboratories in the international community. Reference materials play an important role in the evaluation of the accuracy of analytical results and are essential parts of good laboratory practice. An ombrotrophic peat bog reference material has been developed by 14 laboratories from nine countries in an inter-laboratory comparison between February and October 2002. The material has been characterised for both acid-extractable and total concentrations of a range of elements, including Al, As, Ca, Cd, Cr, Cu, Fe, Hg, Mg, Mn, Na, Ni, P, Pb, Ti, V and Zn. The steps involved in the production of the reference material (i.e. collection and preparation, homogeneity and stability studies, and certification) are described in detail.     

新标准方法实施后水中石油类检测实验室能力验证结果比对研究

为推进国际履约进程,我国自2019年1月1日起停止实验室用途使用四氯化碳,原针对水中石油类的分析方法《水质石油类和动植物油类的测定红外分光光度法》(HJ 637—2012)随之失效,新分析方法则在2018年10月正式发布。随着新分析方法的发布实施,有必要考察实验室采用新方法分析水中石油类的能力。通过汇总两次能力验证计划的统计结果,分析了实验室采用两种新方法分析水中石油类的能力。结果显示:采用紫外分光光度法(HJ 970—2018)和红外分光光度法(HJ 637—2018)测定水中石油类能力验证参加实验室的满意率分别为79.1%和86.6%,分别低于和高于新方法发布之前水中石油类检测能力验证参加实验室的满意率。实验室在操作时的样品空白、正己烷透光率以及器皿污染控制等因素对检测结果的影响较大。目前市场上用于水质检测的石油类标准样品的来源较广泛,原料来源的不同可能导致标准量值存在差异,从而导致不同实验室的分析结果偏差较大。     

环境空气质量国家标准的演变与比较

环境空气质量标准是进行环境空气质量监测、评价和管理的重要规范。研究了环境空气质量国家标准的形成、现状与发展,重点分析了环境空气质量标准的演变内容和背景依据及新标准与典型发达国家或组织标准的差异。结果表明,环境空气质量国家标准的污染物项目、标准形式不断更新完善,浓度阈值更加严格,标准修订的依据和程序更加科学完善。虽然在某些方面仍与其他发达国家标准有一定差距,但总体来说,新标准的建立以及实施有助于我国建立更加完善的环境空气质量管理体系。