Best‐practice recommendations for estimating interaction effects using meta‐analysis

One of the key advantages of meta‐analysis (i.e., a quantitative literature review) over a narrative literature review is that it allows for formal tests of interaction effects—namely, whether the relationship between two variables is contingent upon the value of another (moderator) variable. Interaction effects play a central role in organizational science research because they highlight boundary conditions of a theory: Conditions under which relationships change in strength and/or direction. This article describes procedures for estimating interaction effects using meta‐analysis, distills the technical literature for a general readership of organizational science researchers, and includes specific best‐practice recommendations regarding actions researchers can take before and after data collection to improve the accuracy of substantive conclusions regarding interaction effects investigated meta‐analytically. Copyright © 2010 John Wiley & Sons, Ltd.     

Relationships between psychological climate perceptions and work outcomes: a meta‐analytic review

In this study, meta‐analytic procedures were used to examine the relationships between individual‐level (psychological) climate perceptions and work outcomes such as employee attitudes, psychological well‐being, motivation, and performance. Our review of the literature generated 121 independent samples in which climate perceptions were measured and analyzed at the individual level. These studies document considerable confusion regarding the constructs of psychological climate, organizational climate, and organizational culture and reveal a need for researchers to use terminology that is consistent with their level of measurement, theory, and analysis. Our meta‐analytic findings indicate that psychological climate, operationalized as individuals' perceptions of their work environment, does have significant relationships with individuals' work attitudes, motivation, and performance. Structural equation modeling analyses of the meta‐analytic correlation matrix indicated that the relationships of psychological climate with employee motivation and performance are fully mediated by employees' work attitudes. We also found that the James and James ( 1989 ) PC_g model could be extended to predict the impact of work environment perceptions on employee attitudes, motivation, and performance. Despite the number of published individual‐level climate studies that we found, there is a need for more research using standardized measures so as to enable analyses of the organizational and contextual factors that might moderate the effects of psychological climate perceptions. Finally, we argue for a molar theory of psychological climate that is rooted in the psychological processes by which individuals make meaning or their work experiences. Copyright © 2003 John Wiley & Sons, Ltd.     

Are the costs worth the benefits? Shared perception and the aggregation of organizational climate ratings

A definitional component of organizational climate is the focus on employees' shared perceptions of the focal climate domain. To operationalize the notion of sharedness, researchers typically aggregate employees' domain‐specific climate perceptions to a higher level and justify this aggregation using quantitative indices of agreement. In the current paper, I argue that although accounting for sharedness among employees can provide some valuable insight, our overreliance on sharedness obscures some of the very organizational phenomena of interest. I discuss this issue by focusing on four costs of making unfounded assumptions regarding sharedness: (a) Aggregation assumes individual differences are a function of random error; (b) aggregation assumes that social situations are uniform across employees; (c) aggregation assumes that the unit of analysis is clear‐cut; and (d) aggregation assumes the group mean is meaningful. I argue that researchers carefully need to weigh the costs of violating these assumptions against the expected benefits of aggregating employees' climate perceptions, recognizing that sometimes employees' perceptions (i.e., psychological climate) might provide greater insight into phenomena of interest. Although I discuss these costs within the context of organizational climate research, these arguments apply to other research areas where individual perceptions are aggregated (e.g., research on leadership and teams).     

Making sense of organizational change: Is hindsight really 20/20?

This qualitative study explores the conceptual links between 2 different approaches to managerial cognition, sensemaking and cognitive bias, in the context of organizational change. A longitudinal case study utilizing both real‐time assessments and retrospective sensemaking data from interviews with 26 hospital employees at 3 points in time was undertaken. Patterns related to individuals' retrospective accounts and real‐time assessments were identified and used to construct 4 prototypical narratives. Data analysis revealed that organizational change was not a markedly negative experience for most informants, which is contrary to the prevailing theme in the literature. This and other findings are discussed in terms of sensemaking and cognitive bias. This study makes 2 contributions to our understanding of how individual's experience and make sense of organizational change over time as (a) little is known about how the process of change unfolds over time at the individual level and (b) extant research has not investigated the extent to which individuals' retrospective sensemaking about organizational change reflects or diverges from their real‐time assessments over the course of the change. More broadly, the study provides insights and focused advice for management researchers regarding the use of retrospective data to understand individuals' perceptions of situations that have already occurred.     

Understanding organizational diversity management programs: A theoretical framework and directions for future research

With the changing demographic composition of the workforce, managing diversity in organizations is an important organizational function. Organizations have employed varying approaches to diversity management (DM), resulting in varying organizational outcomes. Meanwhile, researchers have called for more theoretical development within the DM area. We present a framework rooted in social and cross‐cultural psychological research, to foster theory development and empirical testing in the area of DM. We also derive several propositions to guide future research on DM and note some boundary conditions that suggest research opportunities of their own. Our framework contributes a theoretical conceptualization that enhances our understanding of organizations' DM efforts, integrates current typologies, and suggests new directions of inquiry for management scholars as well as guidelines for practitioners in the area. Copyright © 2012 John Wiley & Sons, Ltd.     

A test of value congruence effects

This study investigated value congruence effects on organizational commitment and job satisfaction. We used the competing values framework to measure values, and response‐surface methodology employing polynomial regression equations to investigate congruence effects. Our sample, 1,358 hospital employees, made judgments about their personal preferences for the four competing value sets—internal process, open systems, rational goal, and human relations. They also rated how much the same values were operating in the organization. We predicted that organizational commitment and job satisfaction would be maximized when a ‘match’ or ‘congruence’ occurred between the two component value measures. We evaluated congruence effects using the following criteria: (1) the proportion of variance explained by the overall equation was significant; (2) the quadratic and interaction terms were significant individually and as a set, and their signs were in the right direction; (3) the implied constraints were valid; and (4) no higher‐order terms beyond those indicated by the model were significant. The results indicated that although quadratic and interaction components were present in all eight models, they were weak in their support for congruence. The study's findings suggested that congruence effects were relatively unimportant compared to main effects in explaining variance in organizational commitment and job satisfaction, at least in the large organization we investigated in this study. Copyright © 1999 John Wiley & Sons, Ltd.     

Differentiating HR systems' impact: moderating effects of age on the HR system–work outcome association

Combining the macro perspective of strategic human resource (HR) management with applied psychology's micro approaches, this paper helps to differentiate the effects of HR practices on individual‐level outcomes by introducing two distinct HR practice bundles. We draw on social exchange theory to hypothesize (i) main effects of both growth‐enhancing and maintenance‐enhancing bundles on affective organizational commitment and in‐role behavior and (ii) moderating effects of age and maintenance‐enhancing practices on work outcomes, such that increasing employee age attenuates the positive impact of HR practices. The results of a multilevel study comprising 600 employees and their direct supervisors in 64 business units provide support for the hypothesized main effects on affective commitment and the interaction between age and maintenance‐enhancing practices on work outcomes. We discuss the results, theoretical contributions, and practical implications of the study, as well as future research directions. Copyright © 2016 John Wiley & Sons, Ltd.     

‘Family’ in organizational research: a review and comparison of definitions and measures

Interest in the impact of family on work has grown in recent years; family is emerging as a significant source of understanding work attitudes and behaviors. However, no consensus and little discussion exists regarding how organizational researchers should define and measure ‘family’. In this article, I reviewed the definitions of family in other literatures and those implied by measures of family used in organizational research on work attitudes and behaviors. Analysis revealed five substantive themes in the measurement of family by organizational researchers: perceptions about the importance of the family role to the individual, attitudes toward family, numbers and types of dependents, the role played in the family, and the support available from family members. I then discussed the need for a comprehensive measure of dependents, and developed a new measure, Responsibility for Dependents (RFD). I examined the five types of measures empirically, and discussed empirical and conceptual differences between measures of family. Finally, I addressed issues regarding the measurement of family for organizational research, including the need for more inclusive and diverse measures and the need for further research. Copyright © 1999 John Wiley & Sons, Ltd.     

25 years of higher‐order confirmatory factor analysis in the organizational sciences: A critical review and development of reporting recommendations

We discuss how confirmatory factor analysis results should be used to examine potential higher‐order constructs and advocate that researchers present five types of evidence, which are as follows: (1) the ability of the higher‐order model to reproduce the observed covariation among manifest variables; (2) the ability of the higher‐order model to reproduce the observed covariation among manifest variables better than more parsimonious alternative models—and no less well than less parsimonious alternative models; (3) the ability of the higher‐order model to reproduce the observed covariation among lower‐order factors; (4) the ability of the higher‐order factor to explain variation in lower‐order factors; and (5) the ability of the higher‐order factor to explain variation in manifest variables. We illustrate how this type of evidence could be presented with a worked example and contrast our recommendations with the manner in which higher‐order confirmatory factor analysis has been used in the organizational sciences over the past 25 years to support claims regarding higher‐order constructs such as core self‐evaluations and transformational leadership. Our review shows that a substantial proportion of the 44 examined articles failed to present enough evidence to allow readers to understand the size and importance of higher‐order factors. Copyright © 2015 John Wiley & Sons, Ltd.     

Getting to the core of core self‐evaluation: a review and recommendations

The theory of core self‐evaluation (CSE) has provided organizational scholars with a framework for describing disposition‐based effects on work attitudes and behaviors. Although the CSE construct has been useful for predicting various phenomena, there are potential weaknesses concerning how it is conceptualized and used. We review limitations regarding CSE theory, its measurement, and specific traits, and provide recommendations for addressing them. Key recommendations include strengthening the theory underlying CSE, specifying CSE as an aggregate construct with causal indicators, representing CSE as a multidimensional construct rather than a scale score, and incorporating a trait that reflects approach motivation. Theoretical and empirical evidence that relate to our recommendations are presented. Copyright © 2007 John Wiley & Sons, Ltd.     

Isms and schisms: A meta‐analysis of the prejudice‐discrimination relationship across racism,sexism, and ageism

Racism, sexism, and ageism persist in modern day organizations and may translate into workplace discrimination, which can undermine organizational effectiveness. We provide the first meta‐analysis comparing the relationships between these three types of prejudice (racism, sexism, and ageism) and three types of workplace discrimination (selection, performance evaluation, and opposition to diversity‐supportive policies). Across outcomes, racism was associated with workplace discrimination, whereas sexism was not. Ageism was associated with discriminatory selection and opposition to organizational policies supporting older workers; however, ageism was not related to discriminatory performance evaluation. Consistent with prior research and theory, Implicit Association Test measures were related to subtle discrimination (opposition to diversity‐supportive policies) but not deliberate discrimination (selection and performance evaluation). Finally, prejudice was more strongly associated with discrimination against real as compared with hypothetical targets. Implications for organizational researchers and practitioners are discussed. Copyright © 2017 John Wiley & Sons, Ltd.     

When “It depends” amounts to more than simple contingent relationships: Three canonical forms of inversions

Organizational behavior theories can be subject to potential inversions in the nature of the effects expected or described (i.e. an effect inverts from positive to negative or vice versa). Yet, inversions are rarely considered or assessed. We explore three possible canonical inversions: the maximum or minimum point in a quadratic regression model, the point of intersection in disordinal interactions, and the change of slope in a moderated regression model. We describe both the motivation for, and the theoretical and empirical importance of, considering such inversions in theory‐building and testing. We consider common situations in which inversions are misinterpreted empirically and present methods to conduct explorations for potential inversions. Two different cases of errors concerning inversions can occur. In the first case entailing omission, an inversion is occurring but is not observed in the sample. In the second case, researchers wrongly assume an inversion is occurring in their model, yet the prospective inversion would actually occur out of the range of possible values on the focal variable(s), and is thus not significant. We illustrate different types of inversions using simulated examples. Ultimately, we seek to encourage and equip management researchers to identify important theoretical boundary conditions imposed by inversions. Copyright © 2016 John Wiley & Sons, Ltd.     

When does adaptive performance lead to higher task performance?

Adaptive performance is a facet of performance that reflects acquiring enhanced competencies in response to change. Micro‐level researchers have assumed that adaptive performance is beneficial for task performance. Similarly, macro‐level researchers have suggested that organizations need to attend to, monitor, and respond to contingencies in their environments for adaptive performance to be beneficial for firm performance. Drawing from the attention‐based theory of the firm and resource theory, we suggest that perceptions of organizational politics and individual differences in conscientiousness constitute contingencies of the adaptive performance–task performance relationship. In a sample of 92 call center employees, we found that adaptive performance is positively associated with task performance but that conscientiousness and organizational politics jointly influence the adaptive performance–task performance relationship. Copyright © 2011 John Wiley & Sons, Ltd.     

Tired of innovations? Learned helplessness and fatigue in the context of continuous streams of innovation implementation

The business environment faced by contemporary organizations is highly uncertain and constantly changing. Thus, organizations have adopted and implemented a continuous stream of innovations to achieve sustainable growth and survival. Considering the demand for additional resources to implement innovations, the present study explores organizational conditions that may lead to innovation‐targeted burnout and fatigue among employees, which impede their active participation in a subsequent innovation. To this end, we propose a theoretical framework that elucidates the effects of previous innovations on the subsequent implementation behavior of employees. We identify two dimensions of the cognitive appraisal of previous innovations (i.e., intensity and failure) that shape employees' beliefs regarding innovations, such as innovation‐targeted helplessness, which ultimately results in innovation fatigue. Data collected from 84 managers and 397 employees of Chinese and Korean organizations prove the significant role of employee perceptions of previous innovations in shaping the innovation‐targeted helplessness and fatigue of employees, which ultimately affect employee behavior toward a subsequent innovation. The present conceptual and empirical analyses suggest that given continuous streams of innovation implementation, managers should carefully consider employee's perceptions of previous innovations (i.e., intensity and failure) for successful implementation of a subsequent innovation. Copyright © 2017 John Wiley & Sons, Ltd.     

Beyond the mean: Understanding firm‐level consequences of variability in diversity climate perceptions

We develop and test an organizational‐level model of the consequences of diversity climate for company performance. Drawing from affective events theory and the organizational climate literature, we highlight the role of idiosyncrasies in employees' diversity climate perceptions. Specifically, we consider diversity climate strength (i.e., agreement in employees' climate perceptions) as a boundary condition of diversity climate's organizational‐level effects and expect high climate strength to be particularly beneficial in demographically diverse organizations. Moreover, we introduce collective positive affect as an underlying mechanism of diversity climate's conditional effects on company performance. Hypotheses are tested in a study of 82 German small‐and‐medium‐sized companies with 13,695 surveyed employees. Results show a moderated mediation relationship where diversity climate is only positively related to organizational performance (via collective positive affect) at relatively high diversity climate strength. Although this finding holds for both demographically diverse and homogeneous organizations, post hoc analyses provide initial evidence that a strong climate only helps to realize the effects of diversity climate on collective positive affect when members of age‐ and gender‐related demographic subgroups converge in their climate perceptions. Our study contributes to a better understanding of diversity climate as an effective lever for managing diversity.     

The relationship between multiple levels of learning practices and objective and subjective organizational financial performance

Multi‐level learning approaches suggest that individuals, groups and organizations act both independently and interact dynamically to contribute to organizational performance. We directly examined this proposition in an Australian sample using a longitudinal design that employed subjective and objective financial performance data. Respondents completed a survey that provided details on their individual, team and organizational learning practices (ILP, TLP and OLP, respectively), and self assessed performance compared to 3 years ago. Concurrently, we collected objective performance data (sales/employee numbers) at 3 yearly intervals and averaged these data to create an index. Using hierarchical and moderated regression, we found a positive main effect for OLP with both subjective and objective performance. Main effects for ILP and TLP were not found. Further, we found a significant interaction between ILP and TLP such that the effect of TLP on productivity was better in organizations with less ILP. Three‐way interactions were not found. Overall, these results provide some support for the model. We discuss some limitations of the study and make recommendations for future studies. Copyright © 2009 John Wiley & Sons, Ltd.     

Introducing the construct curiosity for predicting job performance

The present paper provides a conceptual and empirical examination regarding the relevance of the construct curiosity for work‐related outcomes. On the basis of a review and integration of the literature regarding the construct itself, the construct is conceptually linked with performance in the work context. In line with a confirmatory research strategy, the sample of the present study (N = 320) has requirements which reflect this conceptual link. Results from a concurrent validation study confirmed the hypothesis regarding the significance of curiosity for job performance (r = .34). Furthermore, incremental validity of curiosity above 12 cognitive and non‐cognitive predictors for job performance suggests that curiosity captures variance in the criterion that is not explained by predictors traditionally used in organizational psychology. It is concluded that curiosity is an important variable for the prediction and explanation of work‐related behavior. Furthermore, given the dramatic changes in the world of work, the importance is likely to rise, rather than to decline, which has important implications for organizational theories and applied purposes, such as personnel selection. Copyright © 2012 John Wiley & Sons, Ltd.     

How does the social context fuel the proactive fire? A multilevel review and theoretical synthesis

The role of social context (e.g., leadership, team climate, and organizational support) in shaping employee proactive behavior has received considerable attention and has been investigated across multiple forms of proactive behavior. However, the research has not been well integrated. In this review, we adopt a multilevel approach to synthesize what is known about how social context factors influence employees' proactive behavior, as well as what mechanisms underpin these effects. Our analyses show that leader‐, team‐, and organization‐related social context factors mainly influence employee proactivity through shaping “reason to,” “can do,” and “energized to” states (i.e., proactive motivational states) via individual‐, team‐, and cross‐level processes. That has been most frequently investigated is the effect of the discretionary social context, particularly leadership, on proactive behavior. We also review the interaction effects between social context factors and other factors on employee proactive behavior and found inconsistent support for the motivational‐fit perspective that stimuli with the same directions enhance each other's effect. We offer a research agenda to advance theoretical insights on this important topic.     

Interactive effects of impression management and organizational politics on job performance

The purpose of this research was to explore the interactive effect of organizational politics and impression management on supervisor ratings of employee performance. We hypothesized that the negative relationship between organizational politics and supervisor‐rated performance is weaker among employees who are high in impression management than among those low in impression management. Data were collected from a matched sample of 112 white‐collar employees and their supervisors. Results indicated that the interaction of organizational politics and impression management explained a significant incremental amount of variance in supervisor ratings of employee performance. These findings demonstrated that the extent to which an individual engaged in impression management in a non‐political atmosphere may have been a key component to receiving favorable performance ratings. Copyright © 2004 John Wiley & Sons, Ltd.     

How does coaching interviewees affect the validity of a structured interview?

Coaching interviewees to perform in employment interviews can influence the interview scores. We describe different types of coaching, emphasizing interventions designed to focus interviewees on core, interview‐relevant content and to help them convey the content accurately (as opposed to interventions designed to teach interviewees to manipulate their scores using peripheral means). We then study the effects of the former type of intervention in relation to the criterion‐related validity of a structured employment interview. In a combined sample of 146 public safety job incumbents, a predictive validation study was conducted using scores from a situational panel interview. Predictive validity and reliability was observed to be higher in a sample of coached interviewees compared to a sample of uncoached interviewees. Implications for future research and practice in organizational behavior are discussed. Copyright © 2007 John Wiley & Sons, Ltd.