Benchmarking road safety performances of countries

In order to obtain political interest in road safety problems and to learn from other countries’ ‘good practices’, it is often helpful to compare one’s own safety situation with that of other countries. In a number of projects tools have been developed for such comparisons. These tools range from simple ratings of countries on their safety outcomes, such as the annual number of fatalities per capita or per kilometre driven by (motor)vehicles to more comprehensive comparisons.These comparisons not only show differences in safety between countries, but to a certain extent also explain such differences in terms of their safety background and measures taken. Finally, tools have been defined to support road safety policy makers in developing possible safety measures or actions. Procedures for such complex safety comparisons have been developed and tested in several so-called SUNflower studies.This promising approach can be further developed into standard procedures for safety comparisons between all countries in the European Union, and other countries worldwide. This paper wishes to outline the development of such standards for the benchmarking of road safety and safety trends as well as procedures for quantifying safety performances of countries.Starting point of this conceptual framework is the so-called SUNflower-pyramid in which three types of indicators are distinguished. The first one of these, the road safety performance indicator, is called an outcome indicator and is based on the number of killed and injured road users. The second indicator type indicates the quality of the implementation of road safety policies: the implementation performance indicators. The third type of indicator indicates the quality of response in policy documents to improve road safety (policy performance indicator). The three types of indicators are embedded in a policy context: the structure and culture of a country, which are considered as background variables.This paper sets out to describe the framework for the development of a comprehensive set of indicators to benchmark road safety performances of countries or of sub-national jurisdictions. The paper also discusses the advantages and disadvantages of combining such indicators and if combined, how to aggregate how different indicators in one composite performance index. It is argued to group countries in different classes with more or less comparable countries. Different procedures are used for this grouping. The results are promising and it is recommended to work with classes of countries.     

Designing a composite indicator for road safety

This study set out to develop a composite road safety indicator for benchmarking countries’ road safety performance, which would combine the main layers of the road safety pyramid which describes the complex nature of road safety activities, performance and outcomes. Four groups of basic safety indicators were considered, which refer to: policy performance (road safety programmes), final road safety outcomes (fatality rates, scope of traffic injury), intermediate outcomes (wearing rates of seat belts, crashworthiness and composition of vehicle fleet, alcohol-impaired driving), and background characteristics of countries (motorization level, population density). The analysis used the data collected for 27 European countries. Weights based on statistical models were used to combine the basic indicators into a composite one. Principal Component Analysis and Common Factor Analysis weighting were examined. The composite indicators, estimated by several methods, enabled us to rank and group the countries according to their safety performance.The analysis revealed that the countries’ ranking based on the composite indicators is not necessarily similar to the traditional ranking of countries based on fatality rates only. Furthermore, it was observed that the indicators belonging to the final outcomes and intermediate outcomes are not uniform in their behaviour. Indicators which were found to be more consistent and influential and termed a ‘core set of basic indicators’ are recommended for future uses. The general conclusion is that the design of a composite road safety indicator in which relevant information from the different components of the road safety pyramid has been captured and weighted is realistic and meaningful. Such an indicator gives a more enriched picture of road safety than a ranking based only on fatality rates, which is the common practice at present. Grouping countries in this process is promising and seems to be preferable to simply ranking countries.     

Predicting major accidents in the process industry based on the barrier status at scenario level: A practical approach

OCI Nitrogen wants to gain knowledge of (leading) indicators regarding the process safety performance of their ammonia production process. This paper answers the question whether indicators can be derived from the barrier system status to provide information about the development and likelihood of the major accident processes in the ammonia production process.The accident processes are visualized as scenarios in bowties. This research focuses on the status of the preventive barriers on the left-hand side of the bowtie. Both the quality – expressed in reliability/availability and effectiveness – and the activation of the barrier system give an indication of the development of the accident scenarios and the likelihood of the central event. This likelihood is calculated as a loss of risk reduction compared to the original design. The calculation results in an indicator called “preventive barrier indicator”, which should initiate further action. Based on an example, it is demonstrated which actions should be taken and what their urgency is.     

我国工业行业安全生产压力指数构建研究

针对单一事故指标在反映行业或区域安全生产形势方面存在的不足,提出采用"安全生产压力指数"这一指标来综合表征我国各行业整体安全生产形势。以工业行业为例,结合我国现有事故统计指标,综合考虑各行业生产安全事故的相对趋势、事故的严重程度以及行业风险控制水平对安全生产形势的影响,构建了以死亡人数占比指数(DNI)、事故严重度指数(ASI)和整体风险水平指数(TRI)为基础指标的安全生产压力指数(SPI)计算模型。通过对工业行业及其11个重点行业事故基础数据的采集整理,分别测算了工业行业1978-2011年度以及11个重点行业2007-2009年度的SPI指数,分析了SPI指数在安全生产形势表征和安全生产形势预警方面的作用,提出了深化和完善SPI指数应用的建议。     

基于ANP的建筑安全管理绩效评价框架研究

基于政府A部门提供的502起建设工程事故调查报告,综合应用比较分析、数据挖掘、网络层次分析法(ANP)和超级决策(SD)决策软件,建立建筑安全管理绩效评价框架,包括6个一级指标和24个二级指标;通过分析各因素之间的关系,修正各个因素的权重,得出事故致因的传递路径。根据和其他偏定性研究的比较还可以发现,基于数据挖掘的ANP和SD的综合运用,更利于对真实情况进行研究模拟,在应对较大建设工程事故风险时更具有针对性和前瞻性。     

Ranking of process safety cultures for risk-based inspections using indicative safety culture assessments

Although major hazard industries have no legal obligations to demonstrate a good safety culture, it is an increasingly important factor for risk-based inspections. This paper describes the development and evaluation of a relatively simple method for external indicative assessment of the process safety culture in major hazard industries. As a first step, a tool was developed. Second, the tool was successfully tested in a workshop with major hazard inspectors. After this ‘proof of concept’ and a few adaptations to improve the tool, quantitative evaluation and validation were carried out with a representative sample of major hazard inspectors in the Netherlands. In this stage, the tool comprised 30 questions, of which 19 sufficiently frequent valid responses were given for the validity test. The evaluations demonstrate that without specific preparations, inspection teams can use the tool to discriminate between plants with poor or good safety cultures. That is sufficient for ranking as additional input for risk-based inspection strategies. The resulting indicative ‘scores’ for safety culture correlate meaningfully with the quality of process safety management systems and the number of (legal) non-compliances, which were identified by the inspection team at the same occasion. The use of the tool can be further improved by training inspectors, making minor adaptations of the inspection process, and broadening the scope of a few questions. It is expected that external assessments of safety culture will become increasingly important not only for inspectorates, but also for a range of other external stakeholders.     

Reference criteria for the identification of accident scenarios in the framework of land use planning

Land use planning (LUP) around industrial sites at risk of major accidents requires the application of sound approaches in the selection of credible accident scenarios. In fact, the ‘technical’ phase of LUP is based on the identification and assessment of relevant accident scenarios. An improper choice of scenarios may critically affect both the ‘technical’ phase of risk assessment and the following ‘policy’ phase concerning decision making on land-use restrictions and/or licensing. The present study introduces a procedure aimed at the systematic identification of reference accident scenarios to be used in the gathering of technical data on potential major accidents, which is a necessary step for LUP around Seveso sites. Possible accident scenarios are generated by an improved version of the MIMAH methodology (Methodology for the Identification of Major Accident Hazards). The accident scenarios are then assessed for LUP relevance considering severity, frequency and time scale criteria. The influence of prevention and mitigation barriers is also taken into account. Two applications are used to demonstrate the proposed procedure. In both case-studies, the proposed methodology proved successful in producing consistent sets of reference scenarios.     

特种设备安全绩效与安全监管能力相关性研究

为强化特种设备安全监管,基于组织能力理论,通过文献计量和专家调查等方法,对特种设备安全绩效和安全监管能力的相关指标进行研究,初步确定27项监管能力指标和4项安全绩效指标。采用相关性分析法,选择安全绩效指标中万台设备事故起数作为基准指标,计算该指标与监管能力和安全绩效各指标的Spearman相关系数。在总体趋势上,基准指标与监管能力指标呈现负相关,与安全绩效指标呈现正相关。计算结果表明:可从增加监管资源投入,提高人员素质,严格监管执行过程等方面提高特种设备安全监管能力。     

Assessment of selected safety performance evaluation methods in regards to their conceptual,methodological and practical characteristics

The evolution of safety performance evaluation, from incident-based to prospective and recently to holistic approaches, follows the similar evolutionary path of accident causation and safety management. Holistic approaches are characterized by an integrated use of technical, organisational and human factors for the development of safety performance indicators. The aim of this paper is to propose a set of assessment criteria for safety performance evaluation methods which will also give emphasis to their holistic nature. Specific criteria related to conceptual, methodological and practical characteristics of the methods have been initially selected and six safety performance evaluation methods are evaluated in a trial implementation of these criteria. Results indicate that the proposed criteria can be applied in different types of safety performance evaluation methods in order to extract useful information in regards to their holistic character as well as to their appropriateness and usefulness.     

从安全生产指标体系透视企业安全管理重点

通过分析安全生产指标体系框架构成,提出了与企业安全管理密切相关的安全指标,并分别从安全管理制度指标、风险评价指标、安全培训指标、安全信息指标、安全检查指标、应急管理指标、事故管理指标和相关方管理指标八个方面分析了企业安全管理工作重点。提出建议,企业的安全管理重点工作一方面应根据安全生产指标体系内容确定,另一方面应结合业务领域和工艺设备技术的更新进行调整,以更好地实现安全生产。     

A pattern of contractor selection for oil and gas industries in a safety approach using ANP-DEMATEL in a Grey environment

Contractor selection is one of the major concerns of industry managers such as those in the oil industry. The objective of this study was to determine a contractor selection pattern for oil and gas industries in a safety approach. Assessment of contractors based on specific criteria and ultimately selecting an eligible contractor preserves the organizational resources. Due to the safety risks involved in the oil industry, one of the major criteria of contractor selection considered by managers today is safety. The results indicated that the most important safety criterion of contractor selection was safety records and safety investments. This represented the industry’s risks and the impact of safety training and investment on the performance of other sectors and the overall organization. The output of this model could be useful in the safety risk assessment process in the oil industry and other industries.     

Identifying elements of poor construction safety management in China

Construction is one of the most hazardous industries due to its unique nature. Measured by international standards, construction site safety records in China are poor. This paper aims to examine the status of safety management in the Chinese construction industry, explore the risk-prone activities on construction sites, and identify factors affecting construction site safety. The findings reveal that the behavior of contractors on safety management are of grave concern, including the lack of provision of personal protection equipment, regular safety meetings, and safety training. The main factors affecting safety performance include ‘poor safety awareness of top management’, ‘lack of training’, ‘poor safety awareness of project managers’, ‘reluctance to input resources to safety’ and ‘reckless operations’. The study also proposes that the government should play a more critical role in stricter legal enforcement and organizing safety training programs.     

中国民航行业可接受的安全水平研究

中国民航局提出持续安全理念,并正在制定国家航空安全方案,推动行业安全管理由目前基于规章符合性的安全监管逐渐转向规章符合性基础上的安全绩效监管,其中一项重要的工作是设定中国民航业可接受的安全水平,来衡量民航业是否满足持续改进安全的目标的要求。本文根据国际民航组织对可接受安全水平的设定指南,同时参考国外民航常用的事故指标,设计了一套中国民航行业可接受安全水平的指标体系,该指标体系包括安全评估指标、安全绩效评估指标和安全指数三层,并对该指标体系内事故率指标和事故征候率指标设定了未来10年的目标值。该指标体系及其目标值的设定不仅可作为衡量民航是否持续安全的标准,也可为航空运输企业设定自身的安全绩效考核指标提供参考。     

A comparison of safety practices used by managers of high and low accident rate postal delivery offices

This study compared safety practices of managers (supervisors) of high and low accident rate postal delivery offices, particularly with respect to slip, trip and fall accidents. Identification of ‘desirable’ management safety activities was achieved using findings from previous research, manager interviews, and a focus group with Royal Mail senior safety personnel. Interviews were then conducted with 20 Delivery Office Managers (DOMs), drawn equally from matched high and low accident rate offices, to examine use of safety practices. DOMs from low accident rate offices appeared to have improved performance with respect to quality of safety communication, dealing with hazards reported on delivery walks, and accident investigation and remedial action. Efforts to reduce risks from severe weather were limited in both high and low accident offices, seemingly influenced by the organisation's emphasis on maintaining quality of service. Confusion existed regarding footwear entitlements of employees, and none of the sample of DOMs encouraged use of alternative methods of delivery to manual pouch carriage. A model is described illustrating the hierarchy of factors that may affect occurrence of slip, trip and fall accidents within a large organisation. The model indicates that supervisors' impact arises both from their attitudes and their actions. The study supports the finding of previous cross-organisational investigations that supervisors have an important influence on workplace safety.     

安全生产“十二五”规划若干统计指标考量

生产安全事故统计指标是安全生产监督管理及宏观决策重要依据。为进一步完善我国职业伤害统计指标体系,对安全生产规划中若干指标的科学性和实用性以及存在问题进行了探索。在进行初步实验计算、理论分析和国内外安全生产事故主要统计指标特点对比研究后,提出：在该规划指标中调整或删去＂亿元国内生产总值死亡率＂;增加非致死性事故统计数据,以能更好代表职业伤害事故总量;适度应用重特大事故起数指标和提高十万人死亡率统计指标精确性等几点建议。作者认为应加强职业伤害指标体系研究,从而尽快实现我国统计指标与国际接轨,在《国际劳工统计年鉴》中重现中国职业伤害统计数据。     

Examining the asymptote in safety progress: a literature review

Many industries are confronted by plateauing safety performance as measured by the absence of negative events – particularly lower-consequence incidents or injuries. At the same time, these industries are sometimes surprised by large fatal accidents that seem to have no connection with their understanding of the risks they faced; or with how they were measuring safety. This article reviews the safety literature to examine how both these surprises and the asymptote are linked to the very structures and practices organizations have in place to manage safety. The article finds that safety practices associated with compliance, control and quantification could be partly responsible. These can create a sense of invulnerability through safety performance close to zero; organizational resources can get deflected into unproductive or counterproductive initiatives; obsolete practices for keeping human performance within a pre-specified bandwidth are sustained; and accountability relationships can encourage suppression of the ‘bad news’ necessary to learn and improve.     

Accidents: A discrepancy between indicators and facts!

Despite, the overwhelming amount of currently available safety management systems (and accompanying tools) accidents with hazardous substances still occur every now and then in the process industries.In this paper a large number of recently occurred accidents in the process industries are analysed showing that reoccurring disruptions during daily operation were present in the causal path of these accidents. The reoccurring disruptions can be seen as pre-warning signals. Their existence forms a gap with the common proactive safety indicators. This gap exists of information, already present and available in daily operation, of which it is UNKNOWN (to the local assessor) that it may lead to unsafe situations/accidents, e.g. maintenance backlogs, quality reports, etc.It is argued that these reoccurring events should be considered to be included in the safety indicators after assessment by an extended body of knowledge, because these events seem to become increasingly important regarding the prevention of accidents that still occur nowadays.     

机场运行安全规划中安全指标体系的构建

通过对机场运行安全规划中安全指标体系定位的分析,遵循可接受、可实施、可量化、可调控的原则,以结果和过程管理思想为指导,结合风险管理理论,构建机场运行安全规划中的安全指标体系。这个体系包括3个子体系,它们分别涉及运行安全的结果、运行安全的业务过程和运行安全管理绩效3个方面。其中,有关运行安全结果的子指标体系包括事故、事故征候、其他不安全事件3个维度11项指标;有关运行安全业务过程的子指标体系包括飞行区管理、机坪运行管理等7个维度20项指标;有关安全管理绩效的子指标体系包括安全政策与目标、风险管理等4个维度7项指标。     

Leading indicators of system safety – Monitoring and driving the organizational safety potential

An indicator can be considered any measure – quantitative or qualitative – that seeks to produce information on an issue of interest. Safety indicators can play a key role in providing information on organizational performance, motivating people to work on safety and increasing organizational potential for safety. We will describe the challenges of monitoring and driving system safety. Currently, the same lead indicators are used – explicitly or implicitly – for both purposes. The fact that the selection and use of safety performance indicators is always based on a certain understanding (a model) of the sociotechnical system and safety is often forgotten. We present a theoretical framework for utilizing safety performance indicators in safety–critical organizations that incorporates three types of safety performance indicators – outcome, monitor and drive indicators. We provide examples of each type of indicator and discuss the application of the framework in organizational safety management. We argue that outcome indicators are lag indicators since outcomes always follow something; they are the consequences arising from multiple other situational and contextual factors. Monitor and drive indicators are lead indicators. The main function of the drive indicators is to direct the sociotechnical activity in the organization by motivating certain safety-related activities. Monitor indicators provide a view on the dynamics of the organization: the practices, abilities, skills and motivation of the personnel – the organizational potential for safety. We conclude that organizations should better acknowledge the significance of monitor and drive indicators in safety management.     

Developing safety indicators for preventing offshore oil and gas deepwater drilling blowouts

An important question with respect to the Macondo blowout is whether the accident is a symptom of systemic safety problems in the deepwater drilling industry. An answer to such a question is hard to obtain unless the risk level of the oil and gas (O&G) industry is monitored and evaluated over time. This article presents information and indicators from the Risk Level Project (RNNP) in the Norwegian O&G industry related to safety climate, barriers and undesired incidents, and discusses the relevance for deepwater drilling. The main focus of the major hazard indicators in RNNP is on production installations, whereas only a limited number of incident indicators and barrier indicators are related to mobile drilling units. The number of kicks is an important indicator for the whole drilling industry, because it is an incident with the potential to cause a blowout. Currently, the development and monitoring of safety indicators in the O&G industry seems to be limited to a short list of “accepted” indicators, but there is a need for more extensive monitoring and understanding. This article suggests areas of extensions of the indicators in RNNP for drilling based on experience from the Macondo blowout. The areas are related to schedule and cost, well planning, operational aspects, well incidents, operators’ well response, operational aspects and status of safety critical equipment. Indicators are suggested for some of the areas. For other areas, more research is needed to identify the indicators and their relevance and validity.