Response to commentary on “The Driver Behaviour Questionnaire as a predictor of accidents: A meta-analysis”

A commentary on our previously published meta-analysis about the predictive validity of the Driver Behaviour Questionnaire (DBQ) raised a number of points. These points do not dispute the quantitative results as such, but suggest that our introduction and discussion overly favor the DBQ and are incomplete in a number of ways. The commentary targeted the following topics: common method variance, intercorrelations of different instruments, accident data validity, correcting for measurement error,

Common method variance

Our meta-analysis provided an extensive discussion of validity threats, including ones not treated before in the DBQ literature, such as common scale anchors and publication bias. We see little added value in the commentary when it informs the readership of common method variance (CMV), as we clearly did this in our article. It is widely understood that CMV can account for a large share of the variance when self-reported data are intercorrelated (see Podsakoff, MacKenzie, Lee, & Podsakoff, 2003

Intercorrelations of different instruments

The commentary reacts to an introductory sentence in which we stated that the DBQ is strongly situated in a network of other questionnaires and tests (such as Trait Anxiety, Cognitive Failures Questionnaire, and Sensation Seeking Scale), by asserting that we seem to interpret such correlations as a positive feature of the DBQ and by pointing out that correlations between the DBQ and other self-reports may have arisen spuriously because of CMV.We dispute the assertion that we regard correlations

Accident data validity

The commentary rejects our position that not only self-reported accident data are susceptible to biases, but recorded data too. Note that our remark applied to all types of recorded accidents, including police reports, hospital data, insurance data, as well as fleet data from professional drivers, and not just company data as in the work by af Wåhlberg, Dorn, and Kline (2011), which is mentioned in the commentary. The literature discusses several sources of bias for recorded accidents that are

Correcting for unreliability

The commentary pointed out that our correction for attenuation is unusual, a surprising claim considering the established importance of correction for measurement error in theory testing (Liu and Salvendy, 2009, Schmidt and Hunter, 1999). The available DBQ research provided almost no information on measurement error, so we did not apply a correction as part of the meta-analysis. Instead, we applied one afterwards, based on the raw data of the largest DBQ study available, and illustrated that

Exposure

The commentary points out that our results were not corrected for exposure in any way. First of all, this statement is false, because our meta-analysis did include effect sizes corrected for exposure. We used a special moderator category for effect sizes other than zero-order correlations. These effect sizes were derived from regression analysis, often with mileage as one of the predictors.Second, it may be noted that af Wåhlberg himself reported that the association between exposure and

Further references

The commentary attended us to 11 studies supposedly not included in our meta-analysis. We appreciate af Wåhlberg and Dorn's close scrutiny of our reference list for potential omissions on the DBQ-accident relationship. It may be noted that missing a small fraction of studies in a meta-analysis of this scope is almost inevitable.The samples of four of the studies (Dobson et al., 1999, Elliott et al., 2007, Parker, 1999, Stradling et al., 2005) identified in the commentary were already included

Discussion

The purpose of a meta-analysis is to provide a quantitative summary of a metric of interest, correlations between the DBQ, and external criteria in our case. af Wåhlberg and Dorn's commentary does not dispute the quantitative results in themselves (except with regard to the correction for exposure), but targets the qualitative introduction and discussion of our article.The commentary raises some valid points, albeit points already discussed in our article. We too believe that common method

     

Evaluation of a healthcare safety climate measurement tool

Problem

Psychometrically validated measurement tools are needed to evaluate an organization's safety climate. In 2000, Gershon and colleagues published a new healthcare safety climate measurement tool to determine its relationship to safe work behavior (Gershon, R., Karkashian, C., Grosch, J., Murphy, L., Escamilla-Cejudo, A., Flanagan, P., et al. (2000). Hospital safety climate and its relationship with safe work practices and workplace exposure incidents. American Journal of Infection Control, 28, 211-21). The present study evaluated the psychometric properties of the Gershon tool when modified to address respiratory rather than bloodborne pathogen exposures.

Method

Medical practitioners, nurses, and nurse aides (n = 460) were surveyed using the modified Gershon tool. Data were analyzed by factor analysis and psychometric properties of the tool evaluated.

Results

Eight safety climate dimensions were extracted from 25 items (Cronbach's alpha range: 0.62 - 0.88). Factor extractions and psychometric properties were reasonably consistent with those of the Gershon tool.

Impact on Industry

The Gershon safety climate tool appears to have sufficient reliability and validity for use by healthcare decision makers as an indicator of employee perceptions of safety in their institution.     

The Driver Behaviour Questionnaire as a predictor of accidents: a meta-analysis

Introduction

Through a meta-analysis, this study investigated the relation of errors and violations from the Driver Behaviour Questionnaire (DBQ) to accident involvement.

Method

We identified 174 studies using the DBQ, and a correlation of self-reported accidents with errors could be established in 32 samples and with violations in 42 samples.

Results

The results showed that violations predicted accidents with an overall correlation of .13 when based on zero-order effects reported in tabular form, and with an overall correlation of .07 for effects reported in multivariate analysis, in tables reporting only significant effects, or in the text of a study. Errors predicted accidents with overall correlations of .10 and .06, respectively. The meta-analysis also showed that errors and violations correlated negatively with age and positively with exposure, and that males reported fewer errors and more violations than females. Supplementary analyses were conducted focusing on the moderating role of age, and on predicting accidents prospectively and retrospectively. Potential sources of bias are discussed, such as publication bias, measurement error, and consistency motif.

Impact on Industry

The DBQ is a prominent measurement scale to examine drivers’ self-reported aberrant behaviors. The present study provides information about the validity of the DBQ and therefore has strong relevance for researchers and road safety practitioners who seek to obtain insight into driving behaviors of a population of interest.     

What does it mean to transform knowledge into action in falls prevention research? Perspectives from the Canadian Institutes of Health Research

Introduction

The concept of knowledge translation as defined by the Canadian Institutes for Health Research and the Knowledge to Action Cycle, described by Graham et al (Graham et al., 2006), are used to make a case for the importance of using a conceptual model to describe moving knowledge into action in the area of falls prevention.

Method

There is a large body of research in the area of falls prevention. It would seem that in many areas it is clear what is needed to prevent falls and further syntheses can determine where the evidence is sufficiently robust to warrant its implementation as well as where the gaps are that require further basic research.

Conclusion

The phases of the action cycle highlight seven areas that should be paid attention to in order to maximize chances of successful implementation.     

Identifying an appropriate driving behaviour scale for the occupational driving context: The DBQ vs. the ODBQ

Self reported driving behaviour in the occupational driving context has typically been measured through scales adapted from the general driving population (i.e., the Manchester Driver Behaviour Questionnaire, (DBQ), Reason et al., 1990). However, research suggests that occupational driving is influenced by unique factors operating within the workplace environment, and thus, a behavioural scale should reflect those behaviours prevalent and unique within the driving context. To overcome this limitation, Newnam et al. (2011) developed the Occupational Driver Behaviour Questionnaire ((ODBQ), Newnam et al., 2011) which utilises a relevant theoretical model to assess the impact of the broader workplace context on driving behaviour. Although the theoretical argument has been established, research is yet to examine whether the ODBQ or the DBQ is a more sensitive measure of the workplace context. As such, this paper identifies selected organisational factors (i.e., safety climate and role overload) as predictors of the DBQ and the ODBQ and compares the relative predictive value in both models. In undertaking this task, 248 occupational drivers were recruited from a community-oriented nursing population. As predicted, hierarchical regression analyses revealed that the organisational factors accounted for a significantly greater proportion of variance in the ODBQ than the DBQ. These findings offer a number of practical and theoretical applications for occupational driving practice and future research.     

Estimating the variance in before-after studies

Problem

To simplify the computation of the variance in before-after studies, it is generally assumed that the observed crash data for each entity (or observation) are Poisson distributed. Given the characteristics of this distribution, the observed value (x_i) for each entity is implicitly made equal to its variance. However, the variance should be estimated using the conditional properties of this observed value (defined as a random variable), that is, f(x_i|μ_i), since the mean of the observed value is in fact unknown.

Method

Parametric and non-parametric bootstrap methods were investigated to evaluate the conditional assumption using simulated and observed data.

Results

The results of this study show that observed data should not be used as a substitute for the variance, even if the entities are assumed to be Poisson distributed. Consequently, the estimated variance for the parameters under study in traditional before-after studies is likely to be underestimated.

Conclusions

The proposed methods offer more accurate approaches for estimating the variance in before-after studies.     

Evaluating impaired drivers confidence and intention to "(Please) drink responsibly"

Introduction

Currently, alcohol industry-sponsored advertisements subsume traditional designated driver and don't drink and drive messages within responsible drinking campaigns. Yet, to date, there remains a dearth of literature specifically examining the attitudinal beliefs impaired drivers attach to the responsible drinking message.

Objective

This investigation sought to examine the responsible drinking attitudes and beliefs of impaired drivers, specifically examining their confidence and intention to drink responsibly the next time they consumed alcohol.

Methods

A random sample of 729 students attending a large, public Texas university completed a web-based administration of the Characteristic of Responsible Drinking Survey (CHORDS).

Results

Participants in this sample who had driven while impaired by alcohol exhibited significantly less confidence in refraining from drinking and driving and reported significantly lower intentions to designate a driver, take a taxi, or use a safe-ride program the next time they consumed alcohol. Additionally, they also reported less confidence, and lower intentions, to ensure their blood alcohol concentrations remained below the legal limit (0.08%) the next time they consumed alcohol.

Conclusions

Drivers who had driven while impaired significantly differed in their confidence and intention to drink responsibly the next time they consumed alcohol. Logistic regression results indicate that by increasing one's confidence in responsible drinking, and increasing their intention to drink responsibly, the likelihood of impaired driving can be decreased.

Impact on industry

Results from this investigation demonstrate one’s responsible drinking attitudinal beliefs accounts for a significant amount of the variance associated with one’s alcohol-related behaviors. Thus, further research should examine and establish how individuals conceptualize and practice responsible drinking.     

Assessing motivation for work environment improvements: Internal consistency, reliability and factorial structure

Problem

Workers' motivation to actively take part in improvements to the work environment is assumed to be important for the efficiency of investments for that purpose. That gives rise to the need for a tool to measure this motivation.

Method

A questionnaire to measure motivation for improvements to the work environment has been designed. Internal consistency and test-retest reliability of the domains of the questionnaire have been measured, and the factorial structure has been explored, from the answers of 113 employees.

Results

The internal consistency is high (0.94), as well as the correlation for the total score (0.84). Three factors are identified accounting for 61.6% of the total variance.

Discussion

The questionnaire can be a useful tool in improving intervention methods.

Impact on Industry

The expectation is that the tool can be useful, particularly with the aim of improving efficiency of companies' investments for work environment improvements.     

Coverage of motor vehicle crashes with injuries in U.S. newspapers, 1999-2002

Problem

The aims of the study were to evaluate information on motor-vehicle crashes with injuries provided in newspaper reports and to assess the frequency of thematic and episodic reporting of motor-vehicle crashes.

Method

The study used Fatal Analysis Reporting System (FARS) derived variables to code a nationally representative sample of U.S. newspaper reports of motor-vehicle crashes from 1999-2002. A total of 473 newspaper reports of motor-vehicle crashes with injuries were included. Information on the crash event, people involved, and vehicles was extracted. The reports were coded for episodic and thematic news framing.

Results

A majority of newspaper reports used episodic framing. The majority of reports included information on the type of crash, but characteristics about people and vehicles were rarely reported.

Discussion

Lack of information in newspapers makes them an incomplete source from which to influence public perceptions and attitudes.

Impact on industry

This provides an opportunity for news print media to improve public health content.

Impact on industry

Newspapers represent an important source of public information; they are, however, an incomplete source [Voight, B., Lapidus, G., Zavoski, R., & Banco, L. (1998). Injury reporting in Connecticut newspapers. Injury Prevention, 4, 292-294.; Baullinger, J., Quan, L., Bennett, E., Cummings, P., & Williams, K. (2001). Use of Washington state newspaper for submersion injury surveillance. Injury Prevention, 7, 339-342]. To increase the accuracy of information provided to the public through media sources, there is a need for increased communication between public health professionals and reporters.The results of this study raise concerns about the contents of motor-vehicle crash information provided in newspapers and suggest that newspapers do not provide information to allow public perception to be in accord with the importance of motor-vehicle crash injuries and health promoting actions to reduce risk of injury. More balanced and detailed information in newspapers would provide an opportunity for news print media to improve public health programs and public perception about the impact of motor-vehicle crashes on safety for all.     

An experimental study on the effect of mobile phone conversation on drivers' reaction time in braking response

Introduction

This paper presents an experimental study in which the effect of three factors (distance between cars, mobile call duration, and time of driving (day or night)) on drivers' reaction time in braking response was investigated.

Methods

The experiment was performed in a real driving environment in which 27 male adults between the ages of 22 and 24 years participated. Three levels of the first two factors (i.e., distance between cars and call duration) and two levels of the last factor (i.e., time of driving) were selected to conduct the experimental study. A full factorial design of experiment with 18 treatment combinations and three replicates of each combination were used. Fifty-four trial runs were performed in a random manner and for each run drivers' reaction time in braking response was measured, which served the data for further analysis. Analysis of variance (ANOVA), interaction effect analysis, and various model adequacy tests were carried out using Design Expert software.

Results

The results of the study indicated that the most important factor affecting the drivers' reaction time in car braking response was the mobile call duration followed by the time of driving, with a high level of interaction between the two factors. It was also found that the distance between cars did not seem to have a significant effect on the reaction time in braking response. It is to be noted that these response times are expected to be higher under normal driving conditions where awareness of experimental environment is not present.

Impact on Industry

The findings of this study would help mobile phone industries in improving safety of mobile phone users in driving environment.     

Making work safer: Testing a model of social exchange and safety management

Introduction

This study tests a conceptual model that focuses on social exchange in the context of safety management. The model hypothesizes that supportive safety policies and programs should impact both safety climate and organizational commitment. Further, perceived organizational support is predicted to partially mediate both of these relationships.

Methods

Study outcomes included traditional outcomes for both organizational commitment (e.g., withdrawal behaviors) as well as safety climate (e.g., self-reported work accidents). Questionnaire responses were obtained from 1,723 employees of a large national retailer.

Results

Using structural equation modeling (SEM) techniques, all of the model's hypothesized relationships were statistically significant and in the expected directions. The results are discussed in terms of social exchange in organizations and research on safety climate.

Impact on Industry

Maximizing safety is a social-technical enterprise. Expectations related to social exchange and reciprocity figure prominently in creating a positive climate for safety within the organization.     

Social desirability effects in driver behavior inventories

Problem

The use of lie scales to control for common method variance in driver behavior inventories has been very limited. Given that such questionnaires often use self-reported safety variables as criteria, and have social implications, the risk of artefactual associations is high.

Method

A questionnaire containing scales from several well known driver inventories that have been claimed to predict traffic accident involvement was distributed three times to a group of young drivers in a driver education program, as well as a random group twice. The Driver Impression Management scale (DIM) was used to control for socially desirable responding.

Results

For all behavior scales, the correlation with the DIM scale was substantial. If a scale correlated with self-reported crashes, the amount of predictive power was more than halved when social desirability was controlled for. Results were similar for both samples and all waves. The predictive power of the behavior scales was not increased when values were averaged over questionnaire waves, as should have been the case if the measurement and predictive power were valid. Results were similar for self-reported penalty points. The present results indicate that even the most well-known and accepted psychometric scales used in driver research are susceptible to social desirability bias.

Discussion

As social desirability is only one of a number of common method variance mechanisms that can create artefactual associations, and the great popularity of the self-report methodology, the problem for traffic research is grave.

Impact on industry

Organizations that fund traffic safety research need to re-evaluate their policies regarding what methods are acceptable. The use of self-reported independent and dependent variables can lead to directly misleading results, with negative effects on traffic safety.     

Differences in urban and rural accident characteristics and medical service utilization for traffic fatalities in less-motorized societies

Introduction

Fatalities from traffic accidents in less-motorized societies are an important global issue. We aimed to characterize the geographic differences of fatalities in such societies to facilitate the development of targeted interventions.

Method

This study linked police reports, hospital data, and vital registration data from Taiwan with special reference to accident factors in pre-hospital deaths and medical care in hospital deaths.

Results

A higher percentage of pre-hospital deaths were observed following rural as compared to urban traffic accidents. The deaths due to rural accidents can be attributed to lower use of restraints (i.e., helmets or seat belts), lower percentage of motorcyclists, and more highway accidents. A higher percentage of victims in rural accidents were transported to distant medical centers rather than to local hospitals.

Conclusion

Specific interventions, such as intelligent emergency medical systems, campaigns for helmets and seat belt usage, enforcement of helmets and seat belt use, and speed control measures should be targeted to rural areas.

Impact on industry

Cooperation between the vehicle industry and emergency medical providers in rural traffic accident rescue teams may decrease the numbers of deaths in these regions.     

Effects of safety climate on safety norm violations: exploring the mediating role of attitudinal ambivalence toward personal protective equipment

Problem

Research on the role of organizational and psychosocial factors in influencing risk behaviors and the likelihood of injury at work showed that safety climate also has great impact on workers’ behavior. However, the mechanisms through which this impact operates are still partially unclear.

Method

In order to explore the role that attitudinal ambivalence toward wearing PPE might play in mediating the impact of safety climate on safety norm violations, a questionnaire was administered to 345 Italian workers.

Results

Three dimensions of safety climate (i.e., company safety concern, senior managers’ safety concern, supervisors’ attitudes towards safety) were found to be positively associated with the individual ambivalence level, whereas the fourth one (i.e., work pressure) was negatively correlated with it. In turn, low levels of ambivalence were associated with a lower tendency to break the safety norms, even though the perception of a good safety climate also maintained a direct effect on unsafe behaviors.

Impact on industry

Designers of training program for the prevention of work related injuries must pay great attention to the psycho-social factors (such as the effects of the safety climate perception by employees on their attitudes and behaviors), and include specific contents into the prevention programs in order to improve workers compliance with safety norms.     

Results from a national survey of Crown prosecutors and defense counsel on impaired driving in Canada: A “System Improvements” perspective

Introduction

This article summarizes the main findings from a study designed to examine the legal process in Canada as it applies to alcohol-impaired driving from the point of view of Crown prosecutors and defense counsel, and to identify evidentiary or procedural factors that may impact the legal process, the rights of the accused, and interactions of all parts in the legal process.

Method

The data in this study were collected by means of a survey that was mailed out to the population of Crown prosecutors and defense counsel in Canada. In total, 765 prosecutors and 270 defense lawyers or an estimated 33% of all Canadian prosecutors and 15% of defense lawyers completed and returned the questionnaire. The "systems improvement" paradigm was used to interpret the findings and draw conclusions. Such an approach acknowledges the importance of the context in which countermeasures are implemented and delivered and the structures or entities used to deliver countermeasures to a designated target group.

Results

Results on type of charges and breath alcohol concentration, caseload, case outcomes, case preparation time, conviction rate at trial and overall conviction rate, reasons for acquittals and time to resolve cases are described.

Discussion

The findings from this national survey suggest that there are important challenges within the criminal justice system that impede the effective and efficient processing of impaired driving cases. Some of these challenges occur as a function of practices and policies, while others occur as a function of legislation.

Impact on industry

This study illustrates that a "system improvements" approach that acknowledges the importance of all elements of the criminal justice system and the interaction between those elements, can be beneficial in overcoming the alcohol-impaired driving problem.     

Overhead drilling: Comparing three bases for aligning a drilling jig to vertical

Problem

Drilling overhead into concrete or metal ceilings is a strenuous task done by construction workers to hang ductwork, piping, and electrical equipment. The task is associated with upper body pain and musculoskeletal disorders. Previously, we described a field usability evaluation of a foot lever and inverted drill press intervention devices that were compared to the usual method for overhead drilling. Both interventions were rated as inferior to the usual method based on poor setup time and mobility.

Method

Three new interventions, which differed on the design used for aligning the drilling column to vertical, were compared to the usual method for overhead drilling by commercial construction workers (n = 16).

Results

The usual method was associated with the highest levels of regional body fatigue and the poorest usability ratings when compared to the three interventions.

Conclusion

Overall, the 'Collar Base' intervention design received the best usability ratings.

Impact on Industry

Intervention designs developed for overhead drilling may reduce shoulder fatigue and prevent subsequent musculoskeletal disorders. These designs may also be useful for other overhead work such as lifting and supporting materials (e.g., piping, ducts) that are installed near the ceiling. Workplace health and safety interventions may require multiple rounds of field-testing prior to achieving acceptable usability ratings by the end users.     

Winter storm-related injuries in Oklahoma, January 2007

Introduction

A January 2007 ice storm occurred in Oklahoma, causing power outages and hazardous travel conditions. The objective of this investigation was to describe the nature of winter storm-related injuries among Oklahoma residents, to determine populations at risk, and to inform prevention-planning personnel.

Methods

Winter storm-related injuries were a temporarily reportable condition; all acute-care hospitals and the state medical examiner logged storm-related injuries and deaths during January 12 − 30, 2007. Medical records were retrospectively abstracted.Risk of injury was described by demographic group, injury type, and mechanism.

Results

Among 6,047 persons experiencing winter storm-related injuries, 74% were injured in falls, 13% in motor-vehicle collisions (MVCs), 8% while sledding, 1% by unintentional carbon monoxide poisoning, 1% in cleanup activities, and 3% by other mechanisms. Median age of injured persons was 39 years. Persons aged ≥ 40 years were 1.4 times more likely to experience falls as the cause of injury than those aged < 40 years, and falls were twice as likely as other mechanisms to cause fractures among persons aged ≥ 40 years. Injured persons aged < 40 years were 2.2 times more likely to experience MVC-related injuries, and 19 times more likely to experience sledding-related injuries than persons aged ≥ 40 years.

Conclusions

Younger persons were more likely injured in MVCs and sledding incidents, whereas older persons were more likely to experience falls and fractures.

Impact on industry

Prevention messages for winter storm-related injuries should target winter-driving safety tips to younger adults and precautions regarding falls to older adults.     

Re-education of young driving offenders; Effects on self-reports of driver behavior

Introduction

Offending drivers are often re-educated, but these courses have seldom been shown to have any safety effects.

Method

An on-line improvement course for offending drivers below the age of 25 was evaluated with several driver inventories.

Results

The drivers reported higher levels of aggression, stress, sensation seeking, drunk driving, and driving violations, six months after the course than before. However, these levels were lower than those of controls, indicating that the initially low levels for the education group were due to socially desirable responding, as measured by a lie scale, an effect that waned after the course.

Discussion

The results can be interpreted as a positive effect of the education, although this conclusion is tentative and not in agreement with all effects in the data.

Impact on industry

The results are in disagreement with previous evaluation studies using the same or similar instruments, and show the need to include controls for social desirability in self-report studies.     

Predicting driver drowsiness using vehicle measures: Recent insights and future challenges

Introduction

Driver drowsiness is a significant contributing factor to road crashes. One approach to tackling this issue is to develop technological countermeasures for detecting driver drowsiness, so that a driver can be warned before a crash occurs.

Method

The goal of this review is to assess, given the current state of knowledge, whether vehicle measures can be used to reliably predict drowsiness in real time.

Results

Several behavioral experiments have shown that drowsiness can have a serious impact on driving performance in controlled, experimental settings. However, most of those studies have investigated simple functions of performance (such as standard deviation of lane position) and results are often reported as averages across drivers, and across time.

Conclusions

Further research is necessary to examine more complex functions, as well as individual differences between drivers.

Impact on Industry

A successful countermeasure for predicting driver drowsiness will probably require the setting of multiple criteria, and the use of multiple measures.     

[Case Study] CityCenter and Cosmopolitan Construction Projects, Las Vegas, Nevada: Lessons learned from the use of multiple sources and mixed methods in a safety needs assessment

Problem

The present study describes a response to eight tragic deaths over an eighteen month times span on a fast track construction project on the largest commercial development project in U.S. history.

Methods

Four versions of a survey were distributed to workers, foremen, superintendents, and senior management. In addition to standard Likert-scale safety climate scale items, an open-ended item was included at the end of the survey.

Results

Safety climate perceptions differed by job level. Specifically, management perceived a more positive safety climate as compared to workers. Content analysis of the open-ended item was used to identify important safety and health concerns which might have been overlooked with the qualitative portion of the survey.

Discussion

The surveys were conducted to understand workforce issues of concern with the aim of improving site safety conditions. Such efforts can require minimal investment of resources and time and result in critical feedback for developing interventions affecting organizational structure, management processes, and communication.

Summary

The most important lesson learned was that gauging differences in perception about site safety can provide critical feedback at all levels of a construction organization.

Impact on the Industry

Implementation of multi-level organizational perception surveys can identify major safety issues of concern. Feedback, if acted upon, can potentially result in fewer injuries and fatal events.