A local idea space: the value of personal and thematic proximity in academic research. Lukas Kuld. TEP Working Paper No

Size: px
Start display at page:

Download "A local idea space: the value of personal and thematic proximity in academic research. Lukas Kuld. TEP Working Paper No"

Transcription

1 A local idea space: the value of personal and thematic proximity in academic research Lukas Kuld TEP Working Paper No February 2017 Trinity Economics Papers Department of Economics Trinity College Dublin

2 A local idea space: the value of personal and thematic proximity in academic research Lukas Kuld February 20, 2017 Abstract While recent research has found no strong overall effects between colleagues in university departments, this paper shows a clear link between the success of individual research articles and local colleagues when their research is directly related. Using data from the CVs of around 1,000 academic economists, I study research links between department colleagues and their impact on citations. The novel focus on articles also addresses endogeneity concerns using differences in the scope of the effect for article quality and dissemination by publication type and peer group. The estimates show that articles in top 25 journals that draw on research of local colleagues receive significantly more citations than comparable work by the same authors. Conversely, the coauthor network is primarily correlated with low-profile journals and arguably reflect widely the authors field-specific standing. JEL-codes: A14 D83 I23 J24 O31 O32 O33 Keywords: Local research cluster, co-author network, tacit knowledge, scientific productivity, academic economic research Department of Economics, Trinity College Dublin, Dublin 2, Ireland; kuldl@tcd.ie I thank my PhD supervisor, John O Hagan, for extensive comments on several drafts of this paper and for funding, with the Department of Economics, of Interns Kate Hayes, Greg Mangan, Andrew Morrow, Sarah Mortell, Conor Parle and Michael Stone. I also thank Tara Bedi, Christiane Hellmanzik, Martina Kirchberger, Clemens Struck and Alan Walsh, and the participants of the Trinity College Dublin PhD working group for help and comments. The research is also generously supported by a Government of Ireland Postgraduate Scholarship from the Irish Research Council. 1

3 1. Introduction Access to research knowledge and new ideas is fundamental for the production of scientific knowledge. Within a scientific community, parts of this knowledge are created or shared in personal networks. The empirical literature is inconclusive though on the benefits from personal connections and their boundaries, in particular, the existence of localized peer effects. This paper expands and extends on recent empirical work on the decomposition of peer effects in science. In previous literature, the total annual article output of researchers is related to a change in the respective peer group, for example, a change in the department, co-author network or sub-field (see for example Agrawal et al. [2014], Borjas and Doran [2015], Azoulay et al. [2010], Waldinger [2010], Waldinger [2012] and Waldinger [2016]) 1. Most of these studies find no overall effect of researchers on the productivity of local colleagues or vice versa. With a focus on economists, two recent articles also observe no general localized peer effects within university departments over the last twenty years (Kim et al. [2009] and Bolli and Schläpfer [2015]) 2 which confirms the empirical evidence in other fields and time periods. The aggregation of different types of overall researcher profiles and different relations between researchers can, though, mask peer effects in subgroups, as university departments are typically not organized as singular research groups and, therefore, only parts 1 Agrawal et al. [2014] decompose the effects of a department hiring a star researcher in evolutionary biology into effects on overall research output by related and unrelated incumbents as well as new hires. While no positive effect is shown on incumbents overall, incumbents who work on similar research questions as the hired star increase their annual article output on average. The paper s main focus then is on the effect on new hires. Borjas and Doran [2015] study the potential negative effects resulting from the exodus of mathematicians after the end of the Soviet Union on the overall article output of collaborators left behind and previously geographically or thematically close researchers. Out of these groups, only former collaborators of highly productive emigrants appear to have been negatively affected. Azoulay et al. [2010] show the negative effects of the unexpected death of a scientific star on the productivity of collaborators in life science. Waldinger [2010] shows the importance of the quality of the supervisor on the lifelong productivity of PhD students in a sample of pre-world War II mathematicians. Waldinger [2012], in a later paper, finds no aggregated localized peer effects within German physics, chemistry or mathematics departments before the Second World War. Conversely, Waldinger [2016] finds negative short and long term impacts on the overall output of departments of the dismissed scientists. 2 Kim et al. [2009] study the effect of being affiliated with a top American economics or finance department. In their empirical setting, regressions of the individual overall annual publication record on the characteristics of the researcher include university fixed effects. These affiliation fixed effects are positive for the 1970s but are insignificant in the 1990s. As a consequence, they conclude that localized peer effects disappeared with the decrease of communication costs. Similarly, Bolli and Schläpfer [2015] conclude that German economists overall productivity did not profit on average from moves to new institutions between 2004 and

4 of a department s research will overlap. In this paper, I disaggregate from the overall departmental level to study peer effects in a more narrow definition of the research area. As a result, this paper examines the value of research proximity between individual colleagues. The contribution of this paper to the literature then is based on a novel focus on individual articles of researchers rather than the annual productivity of these researchers. 3 This perspective enables a more direct observation of the influence of peers, for example, if the research of a colleague is cited. In addition it allows a more detailed analysis of peer effects in interaction with other characteristics of the publication. 4 As a result and in contrast to earlier studies, this paper checks for local peer effects on individual article influence within specific research areas in the field of economics. A rich and new biographical data set on around 1,000 highly-cited economists makes this empirical study possible. The remainder of the paper is organized as follows. Section 2 describes the theoretical framework for peer effects in knowledge production. Sections 3 and 4 present the empirical framework to identify the influence of peers on research articles and the data used. Section 5 presents the empirical findings and Section 5 provides a discussion of the results and concludes. 2. Theoretical framework The literature on agglomeration commonly emphasizes the gains from clusters for individual productivity. Duranton and Puga [2004] categorize these into benefits from sharing (e.g. infrastructure), matching and learning. The sharing of infrastructure is less important in the empirical setting of economic research even if colleagues in the same area might be beneficial for cost-intensive projects. Following the increases in research collaboration and specialization (see e.g. Jones [2009]), matching of skills is of rising importance but only indirectly studied in this paper. The focus of this paper then is on the potential benefit for research projects from personal connections of the authors to, and hence learning from, other researchers, in particular, if the other researchers are not directly involved in the research project as authors but work on similar topics. 3 A similar classification for thematic proximity but on the level of individual researchers has been used for the analysis of peer effects of an incoming star researcher on incumbent scientists in Agrawal et al. [2014]. 4 However, this focus does not allow conclusions about the overall research output per author. Instead, the success of research articles with thematic links to colleagues or co-authors is compared to other work by the same author(s). 3

5 In the research and dissemination process of an economic research article, colleagues and former co-authors of the article s authors are two not mutually exclusive types of peers that potentially improve the article s quality, its visibility or other success factors. Subsequently, the network of non-local co-authors, local colleagues who are also co-authors and other local colleagues constitute the three main peer groups to be examined in this paper. Studying local colleagues, co-authorship within a university indicates particularly close working relations. However, the connection of colleagues who have not co-authored previously may possibly also add valuable complementary knowledge. In addition, the network of former co-authors is highly related to a researcher s characteristics such as status or specialization which also makes an empirical assessment challenging (see e.g. Ductor et al. [2014] and Kuld and O Hagan [2016]). The empirical estimation is, therefore, focused on the impact of local colleagues. To study benefits from peers formally, the influence that a research paper exerts on future research is used as the key definition of success in this paper. It is assumed that a research article s influence depends on the quality of the research, the dissemination process and the current and future interest in the research topic. Quality of a research article is seen as its potential contribution to the specific area regardless of the overall interest in the topic or dissemination and visibility effects. Dissemination denotes other factors that increase the influence of an article, in particular the reputation of authors and journals in the research area. The reputation gives a quality signal and increases visibility. In an efficiently working scientific field, quality and dissemination should be highly correlated but it is possible, for example, for a high-quality article to have little influence because of very low visibility. I i = f(q i, Dis i, Int i ) (1) Equation 1 then sets the influence of a research article i as a function of its quality, Q i, the dissemination process, Dis i, and the overall interest in the research area, Int i. In turn, quality and dissemination are potentially influenced by peers who are personally connected to the authors such as department colleagues and co-authors. A narrow definition of peer groups, with a resulting small number of peers, excludes a large influence of peers on the overall interest in the research area. As it is posited here that peers potentially can affect the quality of an article during its production, the quality of article i in Equation 2 is set as a function of the researchers in the neighborhood N i of the article, e.g. the departments of the authors. In addition, A i denotes the authors 4

6 and U i are characteristics of the authors institutes. Q i = h(u i, A i, g(a i, N i )) (2) The influence of peers depends potentially on the form of the relationship between the authors and the peers which is expressed by g(a, N). For example, this paper focuses on research proximity and co-location and argues that peers are more helpful if the research is closely related and if the researchers co-locate or co-author during the research process. Two main arguments suggest potential quality effects from close personal contact to thematically related researchers. First, most knowledge to produce research is tacit and not easily accessible but apprehended, i.e. transmitted and created, by personal contact (see Polanyi [1958]). 5 Second, new ideas and knowledge are at first circulated in personal connections or created within personal connections. 6 As a result, personal connections lead to a more efficient research process which is particularly important in a dynamic research field: In the trade-off between maturing a research project and ensuring priority by publication (Bobtcheff et al. [2016]), the help and critique of colleagues lead to a more efficient maturation process and, therefore, a higher quality at the time of publication. The importance of tacit knowledge may change over the career of a researcher. Established researchers possess most of the relevant tacit knowledge within their discipline. However, this shared tacit knowledge facilitates, subsequently, the creation and discussion of new ideas. Therefore, interactions with other researchers are more fruitful if the research focus is similar. As a consequence, the importance of personal connections is expected to be at its highest at the very beginning of a career. Lower but stable effects are expected in later career stages. 7 5 While all knowledge is somewhat tacit or rooted in tacit knowledge, tacit knowledge is defined here as knowledge that is not easily codified and made accessible to other scientists, for example, the appreciation of a mathematical theory by scientists before experimental observation and the theory s relation to the observation thereafter (Polanyi [1958], p.60). 6 See e.g. Borowiecki [2013], Hellmanzik [2010], and Mitchell [2016] for evidence for this concept in artistic production. 7 As argued by Kim et al. [2009], cheap air travel and the Internet can change the setting of this knowledge transfers and creation as it allows for an easier connection with distant colleagues. These connections though have a higher cost and are less likely. In addition, lower communication costs, higher mobility of scientists and the increased specialization of research, can threaten departments as a common social and work space. As a result, the departments role in enabling new research connections and mutual assistance between researchers is potentially weakened. Through the Internet and air travel, scientists can find a better matching of skills with researchers at distant universities and subsequently stay clear of department colleagues. This has potentially negative effects for less experienced researchers without a network and recalls the image of Schopenhauer s republic of geniuses (as opposed to the republic of scholars ) in which according to Nietzsche One giant calls to the other across the bleak intervals of time and the conversation of the great minds goes on 5

7 Besides quality effects, personal connections can impact also on the dissemination process more directly. First, colleagues and former co-authors are potentially more aware of and influenced by ongoing research by the authors. Second, connected researchers can influence the wider dissemination process, for example, as journal editors or through conferences. Furthermore, a high number of personally connected researchers, in particular former co-authors, working in a given sub-field may indicate the authors prominent standing in the sub-field. From the perspective of a potentially influenced researcher, reputation is a quality signal which reduces the effort for quality screening. In addition, aligning with influential research, which is signaled by reputation, makes research more likely to be of interest to (or commensurable with) future research. Therefore, the reputations of the authors and of their affiliations and peers, and the type of journal impact positively on the dissemination of a research article. In turn, the journal depends among others on the quality of the article. Taken together, dissemination can be set as Dis = Dis(A, U, N, J(Q)). As a consequence, peers in the neighborhood N can impact an article s influence through quality and dissemination which leads to the following overall relation between influence and peers in Equation 3, ceteris paribus. ( I(N) = f Q (., N ), Dis ( Q(., N),., N ) ), Int (3) The empirical framework below outlines, first, an estimate of the overall impact of peers on the success of an article and, in a second step, a differentiation of peer effects into dissemination and quality effects. Although less important for individual influence, a distinction between quality and dissemination effects is helpful to assess the social benefit of peer effects and related policies. For the advancement of a scientific field, quality effects are arguably more important than individual dissemination. In addition, dissemination advantages are arguably less intrinsically dependent on co-location. undisturbed by the mischievous, noisy dwarfs who creep among them. (Nietzsche [1954, 1E 1872], p.269)). Analyzing research articles that are explicitly influenced by a colleague allows us to assess peer effects without being as strongly affected in the analysis by this development. 6

8 3. Empirical framework Empirical model The influence of any article is measured in this paper by the number of citations (see e.g. Bornmann and Daniel [2008] or Osterloh and Frey [2014] for a discussion on impact and citation counts) 8. The empirical identification of peer effects then is based on their impact on the total sum of citations received per article (I). Next, research links to local colleagues are estimated by classifying articles on whether they refer to articles by recent colleagues of the authors. Possible endogeneity issues of proximity to eminent researchers are addressed, first, by focusing on linked research instead of university affiliation and using individual and university dummies, second, by comparing publication sub-groups with different scopes for quality maturation and dissemination effects, and, third, by contrasting estimates for the intrinsically endogenous network of former co-authors. More detail is given below. As a first step, the overall impact of peers referenced, colleagues and co-authors, in an article on the influence of the article is estimated by: log ( E(I U, A, T, X, N) ) = U + A + T + Xγ + Nβ (4) Equation 4 shows the estimation of the mean of citations received, I, as an exponential function of university U, author A and time fixed effects T, a vector of control variables X and indicator variables for a reference in the article to a colleague or former co-author: N = (CoAuthor, Colleague). The key variables of interest are the peer variables in N and these will be discussed first. Peer variables The variables in N = (CoAuthor, Colleague) denote articles that reference a recent coauthor and/or colleague of the authors. Figure 1 sketches the applied measurement of personal and thematic links. For illustrative purposes, we assume that three new articles are written by authors at two different affiliations: Square University and Triangle University. Each article refers to five existing articles which defines their research area 8 Bornmann and Daniel [2008] give an overview of studies on the relation of citation counts and impact. While the citation behavior varies between researchers, the authors conclude that citation counts are generally a valid measure of impact. 7

9 Figure 1: Thematic and personal relations in an article citation graph. Old1 Old2 Old3 Old4 Old5 Old6 Old7 Old8 Old9 Old10 Authors at Square Universiy Triangle University Other affiliation New Article 1 New Article 2 New Article 3 relatively. For example, New Article 1 and New Article 2 have a similar research focus based on their references while New Article 3 has a different topic. Of the three new articles, the only article for which the thematic and personal links overlap is Article 1, i.e. the article cites articles that are written by recent colleagues of the authors. In consequence, New Article 1 is the only article of the three that is classified as treated with the respect to the variable Colleague. The further empirical analysis is centered on the effect of this treatment. Formally, S i is constructed as the set of authors referenced in article i after excluding article references that are (co-)authored by an author of the article. 9 Next, this set of individuals is compared with the list of eminent economists in our sample 10 who have a known personal connection to an author around the time of production, i.e. are in the neighborhood N x i of the article. N CoAuthor i and N Colleague i are defined as the sets of economists in the sample who have shared an affiliation or co-authored an article one to five years prior to the publication with at least one of the authors of the article i. The 9 This is varied in robustness check. The exclusion follows the argument that the co-authors should have complementary knowledge on the topic. 10 The sample of 967 eminent economists as described in the data section. 8

10 time frame is chosen to reflect the likely production period of an article. Subsequently, two variables are constructed that indicate the articles in which at least one colleague { or former co-author } from this time span is referenced: Colleague = 1 A, with A = i N Colleague i S i and CoAuthor = 1 B, with B = { i Ni CoAuthor S i }. Control variables The vector X contains a series of further characteristics of the article and its authors. First, the mean age of the authors and the squared mean age. This is included to account for career effects on productivity. Second, the number of affiliations, the number of authors and whether the authors are listed alphabetically is used to complement the individual and university dummies. A non-alphabetical ordering is unusual in economics 11 and can indicate a different background of the authors or authors added without a full contribution which would overestimate the number of authors. Third, the number of references and its squared value are included. More references can indicate a bigger project, more interest in the research area or increase the visibility of the publication independently. 12 The number of pages is not significant if the number of references is used and, subsequently, not used in the estimation. Additional specifications introduce a control variable for the total number of eminent economists cited. Since the sample of economists was selected based on citations in economic journals, a high number of cited eminent economists indicates a research field that attracts a high interest by economic researchers. The interest in the topic could in turn cause a positive effect of peers referenced. However, as shown below, the main estimates for the influence of peers are not changed significantly after the introduction of this control variable. This variable is not included in the main regression models as it is difficult to rule out connections between citing researchers. Finally, the number of selfreferences is counted to indicate prior experience in the area: NumSelfReferences i = M i, where M i is the set of references in i to articles by an author of i. Prior publications could indicate a higher visibility and be helpful in the research process. 11 In the time span studied, 92 per cent of articles published in AER, Ecta, JPE, OJE and REStud with more than one author list the authors alphabetically. 12 For example, on-line databases make it possible to search citing papers. Therefore, the more references an article lists the more such searches include the article. 9

11 Identification The empirical analysis focuses on the impact of research links to local colleagues. Endogenous peer effects, i.e. how the effects are driven by the influence or quality of linked research knowledge, and exogenous peer effects, i.e. the exogenous characteristics of these colleagues, are not explicitly distinguished (see Manski [1993]). Therefore, the main focus is on assessing whether correlated effects are expressed in the estimates. As outlined above, this paper addresses the endogeneity concerns through three channels. First, the focus on linked research articles allows the use of university and author fixed effects to address the endogenous selection into stronger research departments and differences in individual research performances. The fixed effects are varied and additional dummies for the specific group of authors and journal are introduced. Second, the estimates for local colleagues are compared to equivalent estimates for former co-authors. The network of former co-authors is by definition a strong indicator of past research performance. References to the research of former co-authors can, therefore, indicate, for example, previous field-specific research. If the two peer groups express such similar issues, then an equivalent estimation process of this peer group and local colleagues leads to similar estimates. Strongly different estimates support that the estimates are not dominated by common correlated aspects of these peer groups or the estimation process. In addition, regressions for sub-groups, such as authors with less prominent research records or at particularly prestigious universities show if the estimates were caused by specific outliers or correlations. Third, separate estimates for high- and lower-profile journals reflect the outlined theoretical channels for the impact of linked colleagues. As a result, estimates can agree with the theoretical expectations and at the same time contradict possible correlated effects that would, for example, upward bias all estimates. Seeing diverging estimates supports, thereby, the plausibility of the hypotheses posited. The link between the theoretical channels and the analysis by journal profile is based on two assumptions. First, research that is published in high-profile journals should be more challenging to the authors. Therefore, these publications should have more scope for quality benefits from the interaction with peers. Second, low-profile publications in journals that are commonly given less attention should benefit relatively more from increased attention due to the authors or their peers standing in the specific field. A journal with a high reputation gives a strong quality signal and increased visibility independently of the authors characteristics. Positing reputation as the main factor in the dissemination, this implies that articles in top journals should benefit less relatively 10

12 from the reputation of their authors, affiliations, or peers than publications in lowerranked journals. In addition, direct citations by personally connected researchers have a larger relative impact on the citations of less cited articles. 13 For the estimation by journal profile, Colleague and CoAuthor are interacted with the relative standing of the article s journal: The variable T J denotes a publication in a top 25 economics or finance journal. 14 This then gives Equation 5 as log ( E(I U, A, T, X, N, J) ) = U + A + T + J + Xγ + (N, N T J)β (5) As above, U, A and T are university, author and time fixed effects. J are journal fixed effects; X is a vector of control variables. The vector of peer variables takes now the form (N, N T J) = (CoAuthor, Colleague, CoAuthor T J, Colleague T J) and, in consequence, β is the 4-dimensional vector: β = (β 1, β 2, β 3, β 4 ) T. Three main extensions to this regression model are presented below. First, department colleagues are distinguished by whether or not they co-authored prior to the publication. This is used to repeat the estimations with three instead of two peer groups, i.e. the peer vector N includes then non-local co-authors, co-authors within the department and other department colleagues. Second, publications of younger researchers are identified. As outlined in the theoretical section, it is expected that peer effects vary over the career span of a researcher, being the strongest at the very beginning. To address this, the variable M axage5 denotes articles of which no author finished their postgraduate studies more than five years prior to publication. The large majority of the economists in the sample has non-permanent positions and shows different publication patterns with a higher share of single-authored papers during the first five career years (see Kuld and O Hagan [2016]). The peer variables are, subsequently, interacted with the age variable to estimate peer effects at the different age groups. Third and finally, the estimation is repeated for different sub-groups such as more and less eminent economists and lowand high-profile journal publications. This is intended as a robustness check and an indication on how the results hold for less productive researchers outside the sample 13 A wide interest in the specific research area should equally impact high- and low-profile publications. The importance of a publication s visibility for citations received is, for example, suggested by Feenberg et al. [2015] and Judge et al. [2007]. 14 To rank the 255 economics journals, the set of all research articles between 1996 and 2014 as described in the data section is used. First, all citations are divided by the yearly median. Then, the mean of these adjusted citations per article is used to rank the journals. Finally, the first structural break in the mean of citations at 25 was used to classify the publications. 11

13 Figure 2: The affiliations of the authors in the sample Longitude Latitude Articles in sample Under to to 200 Over 200 studied. 4. Data The empirical analysis is carried out using publications by the most cited academic economists between 1996 and The construction of this data set started with the economic journals listed by Kalaitzidakis et al. [2011]. These over two hundred journals were supplemented with a number of other, highly ranked journals in Ideas RePEc, e.g. the relatively recent AEA American Economic Journals, which brings the total number to 255 journals. Next, the authors of these articles were ranked by the number of citations received. From this exercise, a total of 967 economists were chosen based on work published in the period 1996 to 2013 and most highly cited in this period. All of these authors were ranked among the top 1,300 economists. The reasons that not all 1,300 top ranked economists are included is that CVs were not available or that their name details were not individual enough to be confidently attributed to a single economist. As an illustration of the spatial distribution of the universities studied, the affiliations of the selected economists are shown in Figure 2. While many countries are observed, there is still a strong concentration on North-American universities. Within the sample, economists from Harvard and Berkeley account for over ten per cent of the article output 12

14 and the ten universities with the highest share of articles are in the USA. Education is even more concentrated; twenty-one per cent of the sample economists hold a PhD from Harvard or MIT and the top six universities account for forty-four per cent of the doctorates. For the economists selected, complete information on the research career from the undergraduate studies onward was compiled using on-line CVs and the encyclopedia Who s Who in Economics (Blaug and Vane [2003]). This was complemented using name searches on Scopus to retrieve additional publication data. In most cases, the author s Scopus profile contains a complete list of the author s available publications. The data sets used in the regressions below are restricted to publications between 1996 and This yields 28,901 research articles that include at least one sample economist. The main regressions below use a more restricted data set of which all authors are in the sample. In addition, articles in the Journal of Economic Literature or articles that cite less than five or more than 80 other articles are excluded. This main data set, then, contains 7,291 research articles. Figure 3: Citations received per article Colleagues referenced 2000 Co authors referenced 0 0 Articles 1 2 Articles Citations Citations (a) Citations by number of colleagues refer-(benced. Citations by number of co-authors referenced. Notes: The background shows the citations received of 28,901 economic research articles between 1996 and 2014 of which at least one author are eminent economists as described in data section. The vertical lines show the means of citations received by number of eminent colleagues/co-authors referenced. The plots are truncated at 200 citations. Before the estimation of the regression models, Figure 3 shows the citation averages of articles by the number of referenced eminent colleagues and former co-authors. This indicates in a preliminary, descriptive way a positive relation between the citations received by an article and the authors personal connections to eminent researchers with 13

15 related prior publications, something that is tested more formally below. The graph on the left in Figure 3 shows that on average every additional eminent colleague referenced is associated with an increase of slightly over 20 citations received per article with up to four colleagues referenced. In contrast, co-authors are only associated with an increase in citations for the first two co-authors referenced (graph on the right in Figure 3). For both categories, higher counts of peers referenced than depicted are very uncommon. 5. Empirical results This section reports on the empirical estimation applied to the models looked at in Section 4, namely the estimates of the impact of local peers on the success of individual research articles by type of journal. 15 Formally testing, then, the impact of peers on individual articles, Table 1 shows that linked colleagues impact strongly and significantly on the influence of a high-profile article. This holds throughout the different specifications presented in the table which all correspond to Equation 5 in Section For example, in specification (3), the impact of colleagues who are referenced in a high-profile publication is estimated to increase the number of citations received on average by 35 per cent. 17 The estimates in Table 1 also show the distinct effects of the two peer groups: Colleagues impact heavily on the influence of articles that are published in high profile journals while co-authors are associated with a strong increase in citations to publications in journals with a lower profile. Following the preceding discussion, this indicates an impact of department colleagues on the quality of challenging research while linked co-authors may indicate advantages in the dissemination of less central publications. Reassuringly, the estimated parameters of the other co-variates do not surprise. The negative estimates for selfreferences and universities issue from the overlap with other references and the number 15 All main estimates are derived using quasi-poisson regressions using the natural logarithm as the link function. The literature on citation data is inconclusive on estimation methods but none of the models used changes the key results qualitatively. Quasi-Poisson regressions account for the count nature of citations, the observed over-dispersion and is more robust than negative binomial regressions given the high number of dummies. The estimates are robust to different estimation models such as a linear model using a log-transformed variable or negative binomial models. The estimation is carried out using the glm function in R. The packages multiwayvcov (multi-way clusterrobust variance estimation as suggested by Cameron et al. (2011)) and lmtest (hypothesis testing) are used for standard error correction. 16 Here, the impact of colleagues and co-authors is separately estimated for publications in top 25 and other journals. 17 The percentage effect for β = is calculated as (e ) 100 = 35.26, see (Wooldridge [2010], p. 726) 14

16 Table 1: Impact of peers by journal profile Dependent variable: SumReceivedCitations (link: log) (1) (2) (3) (4) (5) CoAuthor:Top25Journal (0.081) (0.097) (0.099) (0.163) (0.108) CoAuthor:OtherJournal (0.102) (0.095) (0.081) (0.136) (0.084) Colleague:Top25Journal (0.062) (0.079) (0.080) (0.119) (0.089) Colleague:OtherJournal (0.104) (0.092) (0.079) (0.108) (0.075) Top25Journal (0.054) (0.053) (0.052) (0.072) NumAuthors (0.080) (0.366) (0.384) (0.333) NumberUnis (0.072) (0.079) (0.206) (0.474) (0.242) MeanAcademicAge (0.007) (0.012) (0.012) (0.137) (0.013) MeanAcademicAge (0.000) (0.000) (0.000) (0.000) (0.000) NumReferences (0.002) (0.002) (0.002) (0.002) (0.002) NumSelfReferences (0.006) (0.007) (0.007) (0.009) (0.007) OrderAuthors (0.054) (0.068) (0.070) (0.181) (0.063) Year dummies Yes Yes Yes Yes Yes Individual dummies No Yes Yes No Yes Authorgroup dummies No No No Yes No University dummies No No Yes Yes Yes Journal dummies No No No No Yes N (df) 6958 (6928) 6958 (5993) 6958 (5730) 6958 (4904) 6958 (4884) Pseudo-R Notes: This table reports estimated coefficients from quasi-poisson regressions with standard errors in parentheses. Standard errors are clustered at the journal-year level except for model (4) which is clustered at the author group level (variables as described in Table A.1). Each observation is an article of which all authors are in the sample described of 967 eminent economists. : Universities with more than two observations. p<0.1; p<0.05; p<

17 of authors and the real estimated effect is, therefore, in both cases the sum of the parameters. For comparison, Table A.2 (appendix) shows the estimates of the overall impact of peers on individual articles without the differentiation by journal profile: Local colleagues are associated with a significant increase in citations received for all specifications. The overall relation of the success of individual articles and linked former co-authors is less clear as the estimated effects are smaller and the variance higher. So far, colleagues who are also co-authors were included in both categories. When estimating the effect of this group on its own (Table 2), it shows that their impact is similar to non-local co-authors once individual dummies are introduced. Importantly, the introduction of individual dummies leads to opposite changes in the estimated impact: a decrease for co-author-colleagues and an increase for other colleagues. The decrease due to individual dummies suggests that co-author-colleagues indicate very productive individuals. However, this peer group is less correlated with higher citation counts once the averages of the authors are considered. Conversely, the use of individual dummies shows that local colleagues outside of the authors co-author network impact positively on high-profile research. Research projects are significantly more influential than other research by the same authors if they relate to research by this complementary group of colleagues. Robustness checks and extensions Tables 1, A.2 and 2 show estimates that are based on publications of which all authors are in the sample of eminent economists. This raises questions on the representativeness for all publications of these authors and for publications of other less prominent authors. For example, the limitation to publications of which all authors are sample economists leads to an under-representation of multi-authored papers. To address representativeness within the sample of top economists, Table A.3 (appendix) repeats the regressions with all publications of the sample economists. While this introduces new problems due to unknown authors, the estimates are still strong and significant for the impact of colleagues on high-profile and the impact of co-authors on low-profile publications. This shows that the results are not limited to the more restrictive sample or caused by the over-representation of single-authored articles. In addition, Table A.6 shows the parameters for colleagues and co-authors estimated separately which rules out that the estimated effect issues from the correlation between the two variables. Table A.7 shows the estimates of the regressions presented in Table 1 while also controlling for the overall 16

18 Table 2: Impact of co-authors, colleague-co-authors and other local colleagues Dependent variable: SumReceivedCitations (link: log) (1) (2) (3) (4) (5) CoAuthor:OtherUni:Top25Journal (0.148) (0.155) (0.169) (0.142) (0.155) CoAuthor:OtherUni:OtherJournal (0.118) (0.175) (0.126) (0.178) (0.118) Colleague:NoCoAuthor:Top25Journal (0.067) (0.076) (0.074) (0.125) (0.079) Colleague:NoCoAuthor:OtherJournal (0.110) (0.084) (0.076) (0.113) (0.078) Colleague:CoAuthor:Top25Journal (0.133) (0.146) (0.153) (0.206) (0.162) Colleague:CoAuthor:OtherJournal (0.160) (0.186) (0.154) (0.181) (0.127) Top25Journal (0.053) (0.051) (0.050) (0.070) NumAuthors (0.091) (0.440) (0.474) (0.423) NumberUnis (0.070) (0.080) (0.177) (0.407) (0.206) MeanAcademicAge (0.007) (0.012) (0.012) (0.150) (0.012) MeanAcademicAge (0.000) (0.000) (0.000) (0.000) (0.000) NumReferences (0.002) (0.002) (0.002) (0.002) (0.002) NumSelfReferences (0.006) (0.007) (0.007) (0.009) (0.007) OrderAuthors (0.079) (0.088) (0.095) (0.193) (0.087) Year dummies Yes Yes Yes Yes Yes Individual dummies No Yes Yes No Yes Authorgroup dummies No No No Yes No University dummies No No Yes Yes Yes Journal dummies No No No No Yes N (df) 6958 (6926) 6958 (5991) 6958 (5746) 6958 (4917) 6958 (4900) Pseudo-R Notes: This table reports estimated coefficients from quasi-poisson regressions with standard errors in parentheses. Standard errors are clustered at the journal-year level except for model (4) which is clustered at the author group level (variables as described in Table A.1). Each observation is an article of which all authors are in the sample described of 967 eminent economists. : Universities with more than two observations. p<0.1; p<0.05; p<

19 number of eminent economists cited. The estimates show that the estimated peer effects are not driven by the interest in the topic as evidenced by eminent colleagues working on it. However, the main specification does not include this control variable since a personal connection between the researchers cannot be ruled out. To indicate the effects on less eminent researchers, Table A.4 (appendix) repeats the estimation of specification (3) in the main Table 1 leaving out publications by the most cited 100 (column 1) to 500 (column 5) economists. The literature stresses the importance of star researchers (see e.g. Agrawal et al. [2014] and Oettl [2012]) on the productivity of peers, hierarchical effects on less productive researchers would, therefore, lead to higher estimates. Conversely, these slightly less cited researchers have on average less eminent sample economists in their departmental or co-author network which would lead to lower effects if the peer effects of stars are larger. Overall, the estimates in Table A.4 do not show a clear trend, while the observed pattern persists that local colleagues strongly impact on high-profile publications. Next, a distinction of the peer effects by age is presented in Table 3. Confirming the expectation outlined in the theoretical framework, the effects of co-authors or colleagues are estimated to be stronger during the first five years following the award of a PhD. Naturally, the number of co-authors is lower for younger researchers which is reflected in higher standard errors. Importantly, colleagues and co-authors persist to impact on articles in the same pattern as in Table 1 even after the initial career stage. Conclusion of empirical results As discussed previously, this paper focuses on individual articles instead of the overall article output of a researcher. Overall, the co-author network might impact more positively on individual productivity, in particular as direct co-authorship is not studied here (see e.g. Azoulay et al. [2010], Borjas and Doran [2015], Ductor et al. [2014] and Ductor [2015]). In particular, learning through co-authorship may lead to an overall higher research performance which does not show in the comparison of individual research projects. In addition, the co-author network is arguably a stronger reflection of a researcher s past productivity than local colleagues, if the affiliation is controlled for. In turn, this lower dependence on past performance reaffirms any estimated positive impact of local colleagues outside the researcher s co-author network. 18 This causality in the estimated impact of local colleagues is further supported by the estimated pattern 18 The negligible impact of university dummies on the estimated effect of colleagues agrees with the posited low dependance. 18

20 Table 3: Impact of peers by age and journal profile Dependent variable: SumReceivedCitations (link: log) (1) (2) (3) (4) (5) CoAuthor:Top25Journal:MaxAge (0.215) (0.245) (0.237) (0.424) (0.243) CoAuthor:Top25Journal:OtherAgeProfile (0.082) (0.105) (0.108) (0.167) (0.122) CoAuthor:OtherJournal:MaxAge (0.219) (0.209) (0.238) (0.305) (0.260) CoAuthor:OtherJournal:OtherAgeProfile (0.112) (0.103) (0.087) (0.144) (0.089) Colleague:Top25Journal:MaxAge (0.123) (0.126) (0.133) (0.200) (0.146) Colleague:Top25Journal:OtherAgeProfile (0.069) (0.085) (0.084) (0.132) (0.091) Colleague:OtherJournal:MaxAge (0.139) (0.126) (0.135) (0.182) (0.145) Colleague:OtherJournal:OtherAgeProfile (0.127) (0.109) (0.091) (0.125) (0.085) Top25Journal (0.054) (0.054) (0.053) (0.072) MaxAge (0.086) (0.087) (0.087) (0.142) (0.092) NumAuthors (0.080) (0.370) (0.388) (0.336) NumberUnis (0.072) (0.078) (0.208) (0.481) (0.246) MeanAcademicAge (0.009) (0.015) (0.014) (0.140) (0.016) MeanAcademicAge (0.000) (0.000) (0.000) (0.000) (0.000) NumReferences (0.002) (0.002) (0.002) (0.002) (0.002) NumSelfReferences (0.006) (0.007) (0.007) (0.009) (0.007) OrderAuthors (0.054) (0.068) (0.070) (0.181) (0.063) Year dummies Yes Yes Yes Yes Yes Individual dummies No Yes Yes No Yes Authorgroup dummies No No No Yes No University dummies No No Yes Yes Yes Journal dummies No No No No Yes N (df) 6958 (6923) 6958 (5988) 6958 (5725) 6958 (4899) 6958 (4879) Pseudo-R Notes: This table reports estimated coefficients from quasi-poisson regressions with standard errors in parentheses. Standard errors are clustered at the journal-year level except for model (4) which is clustered at the author group level (variables as described in Table A.1). Each observation is an article of which all authors are in the sample described of 967 eminent economists. : Universities with more than two observations. p<0.1; p<0.05; p<

21 in which the effect is limited to high-profile research. First, a strong quality effect on low-profile research is unlikely given the sample of eminent researchers. Second, confounding factors that influence both publication types are ruled out. Third, the contrast to the co-author estimates rules out confounding factors that are similarly correlated with both groups. On the other hand, besides dissemination effects, additional arguments suggest a relatively higher importance of co-authors for lower-profile publications: First, in comparison to the individual average, co-authors are an expression of the authors research record in different sub-fields and the indicated ability and reputation are, therefore, field-specific. As a consequence, co-authors have a higher expected impact on field journals which are typically lower ranked. Second, co-authors may be important for the generation of new ideas but that the quality of high-profile publications depends more on the efficiency of the maturation (Bobtcheff et al. [2016]) process which may be more strongly influenced by local colleagues Conclusion This paper argues that personal connections to thematically close researchers are crucial for the production and dissemination of research. To test this proposition, economic research articles are classified by reference to local colleagues or former co-authors. Furthermore, the publications are distinguished by the standing of the journal to separate a researcher s more and less high-profile research. Finally, the number of citations received is taken as an estimate for an article s influence or success. In this framework, thematic proximity to research of local colleagues and former coauthors is shown to increase the average number of citations received significantly. The influence of co-authors is primarily to low-profile publications which might be due to dissemination effects of the co-author network. However, the findings do not allow to confidently distinguish between former co-authors as a reflection of the authors research record and a direct impact of co-authors on the article. The estimates show, though, that high-profile research benefits strongly when it can also draw on the research of local colleagues outside the co-author network. 19 Alternatively, different researchers rely on different peer groups and publish in different journals. However, strong effects are estimated for colleagues throughout different subgroups of researchers in Table A.4 which makes this explanation unlikely. Finally, reverse causality that colleagues are systematically cited in expected stronger publications can be excluded as a strong factor in the estimates. In Table A.5, local colleagues are not cited significantly more often in top journal publications when individual dummies are used. 20

How are Journal Impact, Prestige and Article Influence Related? An Application to Neuroscience*

How are Journal Impact, Prestige and Article Influence Related? An Application to Neuroscience* How are Journal Impact, Prestige and Article Influence Related? An Application to Neuroscience* Chia-Lin Chang Department of Applied Economics and Department of Finance National Chung Hsing University

More information

Carrying out an Empirical Project

Carrying out an Empirical Project Carrying out an Empirical Project Empirical Analysis & Style Hint Special program: Pre-training 1 Carrying out an Empirical Project 1. Posing a Question 2. Literature Review 3. Data Collection 4. Econometric

More information

Describe what is meant by a placebo Contrast the double-blind procedure with the single-blind procedure Review the structure for organizing a memo

Describe what is meant by a placebo Contrast the double-blind procedure with the single-blind procedure Review the structure for organizing a memo Business Statistics The following was provided by Dr. Suzanne Delaney, and is a comprehensive review of Business Statistics. The workshop instructor will provide relevant examples during the Skills Assessment

More information

Field-normalized citation impact indicators and the choice of an appropriate counting method

Field-normalized citation impact indicators and the choice of an appropriate counting method Field-normalized citation impact indicators and the choice of an appropriate counting method Ludo Waltman and Nees Jan van Eck Centre for Science and Technology Studies, Leiden University, The Netherlands

More information

Lecture 1: The Knowledge Production Function

Lecture 1: The Knowledge Production Function Lecture 1: The Knowledge Production Function Fabian Waldinger Waldinger () Knowledge Production 1 / 52 Practical Information Lecturer: Fabian Waldinger E-mail address: f.waldinger@warwick.ac.uk Offi ce

More information

Alternative Explanations for Changes in Similarity Judgments and MDS Structure

Alternative Explanations for Changes in Similarity Judgments and MDS Structure Cornell University School of Hotel Administration The Scholarly Commons Articles and Chapters School of Hotel Administration Collection 8-1990 Alternative Explanations for Changes in Similarity Judgments

More information

Business Statistics Probability

Business Statistics Probability Business Statistics The following was provided by Dr. Suzanne Delaney, and is a comprehensive review of Business Statistics. The workshop instructor will provide relevant examples during the Skills Assessment

More information

Unit 1 Exploring and Understanding Data

Unit 1 Exploring and Understanding Data Unit 1 Exploring and Understanding Data Area Principle Bar Chart Boxplot Conditional Distribution Dotplot Empirical Rule Five Number Summary Frequency Distribution Frequency Polygon Histogram Interquartile

More information

The U-Shape without Controls. David G. Blanchflower Dartmouth College, USA University of Stirling, UK.

The U-Shape without Controls. David G. Blanchflower Dartmouth College, USA University of Stirling, UK. The U-Shape without Controls David G. Blanchflower Dartmouth College, USA University of Stirling, UK. Email: david.g.blanchflower@dartmouth.edu Andrew J. Oswald University of Warwick, UK. Email: andrew.oswald@warwick.ac.uk

More information

Still important ideas

Still important ideas Readings: OpenStax - Chapters 1 13 & Appendix D & E (online) Plous Chapters 17 & 18 - Chapter 17: Social Influences - Chapter 18: Group Judgments and Decisions Still important ideas Contrast the measurement

More information

2.75: 84% 2.5: 80% 2.25: 78% 2: 74% 1.75: 70% 1.5: 66% 1.25: 64% 1.0: 60% 0.5: 50% 0.25: 25% 0: 0%

2.75: 84% 2.5: 80% 2.25: 78% 2: 74% 1.75: 70% 1.5: 66% 1.25: 64% 1.0: 60% 0.5: 50% 0.25: 25% 0: 0% Capstone Test (will consist of FOUR quizzes and the FINAL test grade will be an average of the four quizzes). Capstone #1: Review of Chapters 1-3 Capstone #2: Review of Chapter 4 Capstone #3: Review of

More information

HPS301 Exam Notes- Contents

HPS301 Exam Notes- Contents HPS301 Exam Notes- Contents Week 1 Research Design: What characterises different approaches 1 Experimental Design 1 Key Features 1 Criteria for establishing causality 2 Validity Internal Validity 2 Threats

More information

1.4 - Linear Regression and MS Excel

1.4 - Linear Regression and MS Excel 1.4 - Linear Regression and MS Excel Regression is an analytic technique for determining the relationship between a dependent variable and an independent variable. When the two variables have a linear

More information

Citation for published version (APA): Ebbes, P. (2004). Latent instrumental variables: a new approach to solve for endogeneity s.n.

Citation for published version (APA): Ebbes, P. (2004). Latent instrumental variables: a new approach to solve for endogeneity s.n. University of Groningen Latent instrumental variables Ebbes, P. IMPORTANT NOTE: You are advised to consult the publisher's version (publisher's PDF) if you wish to cite from it. Please check the document

More information

Still important ideas

Still important ideas Readings: OpenStax - Chapters 1 11 + 13 & Appendix D & E (online) Plous - Chapters 2, 3, and 4 Chapter 2: Cognitive Dissonance, Chapter 3: Memory and Hindsight Bias, Chapter 4: Context Dependence Still

More information

Data and Statistics 101: Key Concepts in the Collection, Analysis, and Application of Child Welfare Data

Data and Statistics 101: Key Concepts in the Collection, Analysis, and Application of Child Welfare Data TECHNICAL REPORT Data and Statistics 101: Key Concepts in the Collection, Analysis, and Application of Child Welfare Data CONTENTS Executive Summary...1 Introduction...2 Overview of Data Analysis Concepts...2

More information

Doctors Fees in Ireland Following the Change in Reimbursement: Did They Jump?

Doctors Fees in Ireland Following the Change in Reimbursement: Did They Jump? The Economic and Social Review, Vol. 38, No. 2, Summer/Autumn, 2007, pp. 259 274 Doctors Fees in Ireland Following the Change in Reimbursement: Did They Jump? DAVID MADDEN University College Dublin Abstract:

More information

Describe what is meant by a placebo Contrast the double-blind procedure with the single-blind procedure Review the structure for organizing a memo

Describe what is meant by a placebo Contrast the double-blind procedure with the single-blind procedure Review the structure for organizing a memo Please note the page numbers listed for the Lind book may vary by a page or two depending on which version of the textbook you have. Readings: Lind 1 11 (with emphasis on chapters 10, 11) Please note chapter

More information

Simultaneous Equation and Instrumental Variable Models for Sexiness and Power/Status

Simultaneous Equation and Instrumental Variable Models for Sexiness and Power/Status Simultaneous Equation and Instrumental Variable Models for Seiness and Power/Status We would like ideally to determine whether power is indeed sey, or whether seiness is powerful. We here describe the

More information

Statistics is the science of collecting, organizing, presenting, analyzing, and interpreting data to assist in making effective decisions

Statistics is the science of collecting, organizing, presenting, analyzing, and interpreting data to assist in making effective decisions Readings: OpenStax Textbook - Chapters 1 5 (online) Appendix D & E (online) Plous - Chapters 1, 5, 6, 13 (online) Introductory comments Describe how familiarity with statistical methods can - be associated

More information

An analysis of structural changes in the consumption patterns of beer, wine and spirits applying an alternative methodology

An analysis of structural changes in the consumption patterns of beer, wine and spirits applying an alternative methodology An analysis of structural changes in the consumption patterns of beer, wine and spirits applying an alternative methodology 1. Introduction Jan BENTZEN, Valdemar SMITH Department of Economics and Business

More information

Group Assignment #1: Concept Explication. For each concept, ask and answer the questions before your literature search.

Group Assignment #1: Concept Explication. For each concept, ask and answer the questions before your literature search. Group Assignment #1: Concept Explication 1. Preliminary identification of the concept. Identify and name each concept your group is interested in examining. Questions to asked and answered: Is each concept

More information

11/18/2013. Correlational Research. Correlational Designs. Why Use a Correlational Design? CORRELATIONAL RESEARCH STUDIES

11/18/2013. Correlational Research. Correlational Designs. Why Use a Correlational Design? CORRELATIONAL RESEARCH STUDIES Correlational Research Correlational Designs Correlational research is used to describe the relationship between two or more naturally occurring variables. Is age related to political conservativism? Are

More information

Overbidding and Heterogeneous Behavior in Contest Experiments: A Comment on the Endowment Effect Subhasish M. Chowdhury* Peter G.

Overbidding and Heterogeneous Behavior in Contest Experiments: A Comment on the Endowment Effect Subhasish M. Chowdhury* Peter G. CBESS Discussion Paper 15-17 Overbidding and Heterogeneous Behavior in Contest Experiments: A Comment on the Endowment Effect by Subhasish M. Chowdhury* Peter G. Moffatt* **CBESS and School of Economics,

More information

Cross-Lagged Panel Analysis

Cross-Lagged Panel Analysis Cross-Lagged Panel Analysis Michael W. Kearney Cross-lagged panel analysis is an analytical strategy used to describe reciprocal relationships, or directional influences, between variables over time. Cross-lagged

More information

Chapter 1: Exploring Data

Chapter 1: Exploring Data Chapter 1: Exploring Data Key Vocabulary:! individual! variable! frequency table! relative frequency table! distribution! pie chart! bar graph! two-way table! marginal distributions! conditional distributions!

More information

PLS 506 Mark T. Imperial, Ph.D. Lecture Notes: Reliability & Validity

PLS 506 Mark T. Imperial, Ph.D. Lecture Notes: Reliability & Validity PLS 506 Mark T. Imperial, Ph.D. Lecture Notes: Reliability & Validity Measurement & Variables - Initial step is to conceptualize and clarify the concepts embedded in a hypothesis or research question with

More information

Experimental Psychology

Experimental Psychology Title Experimental Psychology Type Individual Document Map Authors Aristea Theodoropoulos, Patricia Sikorski Subject Social Studies Course None Selected Grade(s) 11, 12 Location Roxbury High School Curriculum

More information

Version No. 7 Date: July Please send comments or suggestions on this glossary to

Version No. 7 Date: July Please send comments or suggestions on this glossary to Impact Evaluation Glossary Version No. 7 Date: July 2012 Please send comments or suggestions on this glossary to 3ie@3ieimpact.org. Recommended citation: 3ie (2012) 3ie impact evaluation glossary. International

More information

Readings: Textbook readings: OpenStax - Chapters 1 13 (emphasis on Chapter 12) Online readings: Appendix D, E & F

Readings: Textbook readings: OpenStax - Chapters 1 13 (emphasis on Chapter 12) Online readings: Appendix D, E & F Readings: Textbook readings: OpenStax - Chapters 1 13 (emphasis on Chapter 12) Online readings: Appendix D, E & F Plous Chapters 17 & 18 Chapter 17: Social Influences Chapter 18: Group Judgments and Decisions

More information

The Impact of Relative Standards on the Propensity to Disclose. Alessandro Acquisti, Leslie K. John, George Loewenstein WEB APPENDIX

The Impact of Relative Standards on the Propensity to Disclose. Alessandro Acquisti, Leslie K. John, George Loewenstein WEB APPENDIX The Impact of Relative Standards on the Propensity to Disclose Alessandro Acquisti, Leslie K. John, George Loewenstein WEB APPENDIX 2 Web Appendix A: Panel data estimation approach As noted in the main

More information

Regression Discontinuity Analysis

Regression Discontinuity Analysis Regression Discontinuity Analysis A researcher wants to determine whether tutoring underachieving middle school students improves their math grades. Another wonders whether providing financial aid to low-income

More information

11/24/2017. Do not imply a cause-and-effect relationship

11/24/2017. Do not imply a cause-and-effect relationship Correlational research is used to describe the relationship between two or more naturally occurring variables. Is age related to political conservativism? Are highly extraverted people less afraid of rejection

More information

Audio: In this lecture we are going to address psychology as a science. Slide #2

Audio: In this lecture we are going to address psychology as a science. Slide #2 Psychology 312: Lecture 2 Psychology as a Science Slide #1 Psychology As A Science In this lecture we are going to address psychology as a science. Slide #2 Outline Psychology is an empirical science.

More information

How Causal Heterogeneity Can Influence Statistical Significance in Clinical Trials

How Causal Heterogeneity Can Influence Statistical Significance in Clinical Trials How Causal Heterogeneity Can Influence Statistical Significance in Clinical Trials Milo Schield, W. M. Keck Statistical Literacy Project. Minneapolis, MN. Abstract: Finding that an association is statistically

More information

Detecting and Disrupting Criminal Networks. A Data Driven Approach. P.A.C. Duijn

Detecting and Disrupting Criminal Networks. A Data Driven Approach. P.A.C. Duijn Detecting and Disrupting Criminal Networks. A Data Driven Approach. P.A.C. Duijn Summary Detecting and Disrupting Criminal Networks A data-driven approach It is estimated that transnational organized crime

More information

Political Science 15, Winter 2014 Final Review

Political Science 15, Winter 2014 Final Review Political Science 15, Winter 2014 Final Review The major topics covered in class are listed below. You should also take a look at the readings listed on the class website. Studying Politics Scientifically

More information

A Comparison of Three Measures of the Association Between a Feature and a Concept

A Comparison of Three Measures of the Association Between a Feature and a Concept A Comparison of Three Measures of the Association Between a Feature and a Concept Matthew D. Zeigenfuse (mzeigenf@msu.edu) Department of Psychology, Michigan State University East Lansing, MI 48823 USA

More information

CHAPTER 1 Understanding Social Behavior

CHAPTER 1 Understanding Social Behavior CHAPTER 1 Understanding Social Behavior CHAPTER OVERVIEW Chapter 1 introduces you to the field of social psychology. The Chapter begins with a definition of social psychology and a discussion of how social

More information

Publishing while female

Publishing while female Publishing while female Are women held to higher standards? Evidence from peer review. Erin Hengel University of Liverpool Gender and Career Progression Conference 14 May 2018 Background Women are underrepresented

More information

A critical look at the use of SEM in international business research

A critical look at the use of SEM in international business research sdss A critical look at the use of SEM in international business research Nicole F. Richter University of Southern Denmark Rudolf R. Sinkovics The University of Manchester Christian M. Ringle Hamburg University

More information

Clinical psychology trainees experiences of supervision

Clinical psychology trainees experiences of supervision Clinical psychology trainees experiences of supervision Item Type Article Authors Waldron, Michelle;Byrne, Michael Citation Waldron, M, & Byrne, M. (2014). Clinical psychology trainees' experiences of

More information

DEPARTMENT OF ECONOMICS AND FINANCE COLLEGE OF BUSINESS AND ECONOMICS UNIVERSITY OF CANTERBURY CHRISTCHURCH, NEW ZEALAND

DEPARTMENT OF ECONOMICS AND FINANCE COLLEGE OF BUSINESS AND ECONOMICS UNIVERSITY OF CANTERBURY CHRISTCHURCH, NEW ZEALAND DEPARTMENT OF ECONOMICS AND FINANCE COLLEGE OF BUSINESS AND ECONOMICS UNIVERSITY OF CANTERBURY CHRISTCHURCH, NEW ZEALAND How does Zinfluence Affect Article Influence? Chia-Lin Chang, Michael McAleer, and

More information

Objective: To describe a new approach to neighborhood effects studies based on residential mobility and demonstrate this approach in the context of

Objective: To describe a new approach to neighborhood effects studies based on residential mobility and demonstrate this approach in the context of Objective: To describe a new approach to neighborhood effects studies based on residential mobility and demonstrate this approach in the context of neighborhood deprivation and preterm birth. Key Points:

More information

Identifying Peer Influence Effects in Observational Social Network Data: An Evaluation of Propensity Score Methods

Identifying Peer Influence Effects in Observational Social Network Data: An Evaluation of Propensity Score Methods Identifying Peer Influence Effects in Observational Social Network Data: An Evaluation of Propensity Score Methods Dean Eckles Department of Communication Stanford University dean@deaneckles.com Abstract

More information

Choosing an Approach for a Quantitative Dissertation: Strategies for Various Variable Types

Choosing an Approach for a Quantitative Dissertation: Strategies for Various Variable Types Choosing an Approach for a Quantitative Dissertation: Strategies for Various Variable Types Kuba Glazek, Ph.D. Methodology Expert National Center for Academic and Dissertation Excellence Outline Thesis

More information

Webinar 3 Systematic Literature Review: What you Need to Know

Webinar 3 Systematic Literature Review: What you Need to Know Webinar 3 Systematic Literature Review: What you Need to Know Camille Kolotylo RN, PhD Andrea Baumann RN, PhD Nursing Health Services Research Unit (NHSRU) McMaster University Date: Thursday May 29, 2014

More information

Modelling Research Productivity Using a Generalization of the Ordered Logistic Regression Model

Modelling Research Productivity Using a Generalization of the Ordered Logistic Regression Model Modelling Research Productivity Using a Generalization of the Ordered Logistic Regression Model Delia North Temesgen Zewotir Michael Murray Abstract In South Africa, the Department of Education allocates

More information

Research Dissemination and Impact: Evidence from Web Site Downloads

Research Dissemination and Impact: Evidence from Web Site Downloads Research Dissemination and Impact: Evidence from Web Site Downloads Lee Pinkowitz Georgetown University G-04 Old North Washington, DC 20057 Phone: (202) 687-2689 Fax: (202) 687-4031 Pinkowitz@msb.edu Abstract:

More information

Analysis of Environmental Data Conceptual Foundations: En viro n m e n tal Data

Analysis of Environmental Data Conceptual Foundations: En viro n m e n tal Data Analysis of Environmental Data Conceptual Foundations: En viro n m e n tal Data 1. Purpose of data collection...................................................... 2 2. Samples and populations.......................................................

More information

Does Knowledge Accumulation Increase the Returns to Collaboration?

Does Knowledge Accumulation Increase the Returns to Collaboration? Does Knowledge Accumulation Increase the Returns to Collaboration? Ajay Agrawal, Avi Goldfarb, and Florenta Teodoridis April 2014 Abstract We report results from the first causal test of the knowledge

More information

The Significance of Empirical Reports in the Field of Animal Science

The Significance of Empirical Reports in the Field of Animal Science The Significance of Empirical Reports in the Field of Animal Science Addison Cheng ABSTRACT Empirical reports published in Animal Science journals have many unique features that may be reflective of the

More information

Journal of Political Economy, Vol. 93, No. 2 (Apr., 1985)

Journal of Political Economy, Vol. 93, No. 2 (Apr., 1985) Confirmations and Contradictions Journal of Political Economy, Vol. 93, No. 2 (Apr., 1985) Estimates of the Deterrent Effect of Capital Punishment: The Importance of the Researcher's Prior Beliefs Walter

More information

Isolating causality between gender and corruption: An IV approach Correa-Martínez, Wendy; Jetter, Michael

Isolating causality between gender and corruption: An IV approach Correa-Martínez, Wendy; Jetter, Michael No. 16-07 2016 Isolating causality between gender and corruption: An IV approach Correa-Martínez, Wendy; Jetter, Michael Isolating causality between gender and corruption: An IV approach 1 Wendy Correa

More information

Choose an approach for your research problem

Choose an approach for your research problem Choose an approach for your research problem This course is about doing empirical research with experiments, so your general approach to research has already been chosen by your professor. It s important

More information

Addendum: Multiple Regression Analysis (DRAFT 8/2/07)

Addendum: Multiple Regression Analysis (DRAFT 8/2/07) Addendum: Multiple Regression Analysis (DRAFT 8/2/07) When conducting a rapid ethnographic assessment, program staff may: Want to assess the relative degree to which a number of possible predictive variables

More information

Answers to end of chapter questions

Answers to end of chapter questions Answers to end of chapter questions Chapter 1 What are the three most important characteristics of QCA as a method of data analysis? QCA is (1) systematic, (2) flexible, and (3) it reduces data. What are

More information

Peer counselling A new element in the ET2020 toolbox

Peer counselling A new element in the ET2020 toolbox shutterstock Peer counselling A new element in the ET2020 toolbox Information Note. Main characteristics of the peer counselling tool Peer learning in the context of the education cooperation at EU level

More information

Causal Mediation Analysis with the CAUSALMED Procedure

Causal Mediation Analysis with the CAUSALMED Procedure Paper SAS1991-2018 Causal Mediation Analysis with the CAUSALMED Procedure Yiu-Fai Yung, Michael Lamm, and Wei Zhang, SAS Institute Inc. Abstract Important policy and health care decisions often depend

More information

Changing the Graduate School Experience: Impacts on the Role Identity of Women

Changing the Graduate School Experience: Impacts on the Role Identity of Women Changing the Graduate School Experience: Impacts on the Role Identity of Women Background and Purpose: Although the number of women earning Bachelor s degrees in science, technology, engineering and mathematic

More information

Technical Specifications

Technical Specifications Technical Specifications In order to provide summary information across a set of exercises, all tests must employ some form of scoring models. The most familiar of these scoring models is the one typically

More information

1 Online Appendix for Rise and Shine: The Effect of School Start Times on Academic Performance from Childhood through Puberty

1 Online Appendix for Rise and Shine: The Effect of School Start Times on Academic Performance from Childhood through Puberty 1 Online Appendix for Rise and Shine: The Effect of School Start Times on Academic Performance from Childhood through Puberty 1.1 Robustness checks for mover definition Our identifying variation comes

More information

THE USE OF MULTIVARIATE ANALYSIS IN DEVELOPMENT THEORY: A CRITIQUE OF THE APPROACH ADOPTED BY ADELMAN AND MORRIS A. C. RAYNER

THE USE OF MULTIVARIATE ANALYSIS IN DEVELOPMENT THEORY: A CRITIQUE OF THE APPROACH ADOPTED BY ADELMAN AND MORRIS A. C. RAYNER THE USE OF MULTIVARIATE ANALYSIS IN DEVELOPMENT THEORY: A CRITIQUE OF THE APPROACH ADOPTED BY ADELMAN AND MORRIS A. C. RAYNER Introduction, 639. Factor analysis, 639. Discriminant analysis, 644. INTRODUCTION

More information

How financial incentives and cognitive abilities. affect task performance in laboratory settings: an illustration

How financial incentives and cognitive abilities. affect task performance in laboratory settings: an illustration How financial incentives and cognitive abilities affect task performance in laboratory settings: an illustration Ondrej Rydval, Andreas Ortmann CERGE-EI, Prague, Czech Republic April 2004 Abstract Drawing

More information

Volume 36, Issue 3. David M McEvoy Appalachian State University

Volume 36, Issue 3. David M McEvoy Appalachian State University Volume 36, Issue 3 Loss Aversion and Student Achievement David M McEvoy Appalachian State University Abstract We conduct a field experiment to test if loss aversion behavior can be exploited to improve

More information

Lecture II: Difference in Difference and Regression Discontinuity

Lecture II: Difference in Difference and Regression Discontinuity Review Lecture II: Difference in Difference and Regression Discontinuity it From Lecture I Causality is difficult to Show from cross sectional observational studies What caused what? X caused Y, Y caused

More information

I. Identifying the question Define Research Hypothesis and Questions

I. Identifying the question Define Research Hypothesis and Questions Term Paper I. Identifying the question What is the question? (What are my hypotheses?) Is it possible to answer the question with statistics? Is the data obtainable? (birth weight, socio economic, drugs,

More information

Lecture Outline. Biost 517 Applied Biostatistics I. Purpose of Descriptive Statistics. Purpose of Descriptive Statistics

Lecture Outline. Biost 517 Applied Biostatistics I. Purpose of Descriptive Statistics. Purpose of Descriptive Statistics Biost 517 Applied Biostatistics I Scott S. Emerson, M.D., Ph.D. Professor of Biostatistics University of Washington Lecture 3: Overview of Descriptive Statistics October 3, 2005 Lecture Outline Purpose

More information

Project exam in Cognitive Psychology PSY1002. Autumn Course responsible: Kjellrun Englund

Project exam in Cognitive Psychology PSY1002. Autumn Course responsible: Kjellrun Englund Project exam in Cognitive Psychology PSY1002 Autumn 2007 674107 Course responsible: Kjellrun Englund Stroop Effect Dual processing causing selective attention. 674107 November 26, 2007 Abstract This document

More information

Direct memory access using two cues: Finding the intersection of sets in a connectionist model

Direct memory access using two cues: Finding the intersection of sets in a connectionist model Direct memory access using two cues: Finding the intersection of sets in a connectionist model Janet Wiles, Michael S. Humphreys, John D. Bain and Simon Dennis Departments of Psychology and Computer Science

More information

Experimental Design. Dewayne E Perry ENS C Empirical Studies in Software Engineering Lecture 8

Experimental Design. Dewayne E Perry ENS C Empirical Studies in Software Engineering Lecture 8 Experimental Design Dewayne E Perry ENS 623 Perry@ece.utexas.edu 1 Problems in Experimental Design 2 True Experimental Design Goal: uncover causal mechanisms Primary characteristic: random assignment to

More information

Child Mental Health: A Review of the Scientific Discourse

Child Mental Health: A Review of the Scientific Discourse Child Mental Health: A Review of the Scientific Discourse Executive Summary and Excerpts from A FrameWorks Research Report Prepared for the FrameWorks Institute by Nat Kendall-Taylor and Anna Mikulak February

More information

MEA DISCUSSION PAPERS

MEA DISCUSSION PAPERS Inference Problems under a Special Form of Heteroskedasticity Helmut Farbmacher, Heinrich Kögel 03-2015 MEA DISCUSSION PAPERS mea Amalienstr. 33_D-80799 Munich_Phone+49 89 38602-355_Fax +49 89 38602-390_www.mea.mpisoc.mpg.de

More information

Assignment 4: True or Quasi-Experiment

Assignment 4: True or Quasi-Experiment Assignment 4: True or Quasi-Experiment Objectives: After completing this assignment, you will be able to Evaluate when you must use an experiment to answer a research question Develop statistical hypotheses

More information

Lecture II: Difference in Difference. Causality is difficult to Show from cross

Lecture II: Difference in Difference. Causality is difficult to Show from cross Review Lecture II: Regression Discontinuity and Difference in Difference From Lecture I Causality is difficult to Show from cross sectional observational studies What caused what? X caused Y, Y caused

More information

Econ 270: Theoretical Modeling 1

Econ 270: Theoretical Modeling 1 Econ 270: Theoretical Modeling 1 Economics is certainly not the only social science to use mathematical theoretical models to examine a particular question. But economics, since the 1960s, has evolved

More information

Summary and conclusions

Summary and conclusions Summary and conclusions Aggression and violence, posttraumatic stress, and absenteeism among employees in penitentiaries The study about which we have reported here was commissioned by the Sector Directorate

More information

Readings: Textbook readings: OpenStax - Chapters 1 4 Online readings: Appendix D, E & F Online readings: Plous - Chapters 1, 5, 6, 13

Readings: Textbook readings: OpenStax - Chapters 1 4 Online readings: Appendix D, E & F Online readings: Plous - Chapters 1, 5, 6, 13 Readings: Textbook readings: OpenStax - Chapters 1 4 Online readings: Appendix D, E & F Online readings: Plous - Chapters 1, 5, 6, 13 Introductory comments Describe how familiarity with statistical methods

More information

Empirical Tools of Public Finance. 131 Undergraduate Public Economics Emmanuel Saez UC Berkeley

Empirical Tools of Public Finance. 131 Undergraduate Public Economics Emmanuel Saez UC Berkeley Empirical Tools of Public Finance 131 Undergraduate Public Economics Emmanuel Saez UC Berkeley 1 DEFINITIONS Empirical public finance: The use of data and statistical methods to measure the impact of government

More information

LAB ASSIGNMENT 4 INFERENCES FOR NUMERICAL DATA. Comparison of Cancer Survival*

LAB ASSIGNMENT 4 INFERENCES FOR NUMERICAL DATA. Comparison of Cancer Survival* LAB ASSIGNMENT 4 1 INFERENCES FOR NUMERICAL DATA In this lab assignment, you will analyze the data from a study to compare survival times of patients of both genders with different primary cancers. First,

More information

Preliminary Report on Simple Statistical Tests (t-tests and bivariate correlations)

Preliminary Report on Simple Statistical Tests (t-tests and bivariate correlations) Preliminary Report on Simple Statistical Tests (t-tests and bivariate correlations) After receiving my comments on the preliminary reports of your datasets, the next step for the groups is to complete

More information

Ecological Statistics

Ecological Statistics A Primer of Ecological Statistics Second Edition Nicholas J. Gotelli University of Vermont Aaron M. Ellison Harvard Forest Sinauer Associates, Inc. Publishers Sunderland, Massachusetts U.S.A. Brief Contents

More information

What is analytical sociology? And is it the future of sociology?

What is analytical sociology? And is it the future of sociology? What is analytical sociology? And is it the future of sociology? Twan Huijsmans Sociology Abstract During the last few decades a new approach in sociology has been developed, analytical sociology (AS).

More information

Readings: Textbook readings: OpenStax - Chapters 1 11 Online readings: Appendix D, E & F Plous Chapters 10, 11, 12 and 14

Readings: Textbook readings: OpenStax - Chapters 1 11 Online readings: Appendix D, E & F Plous Chapters 10, 11, 12 and 14 Readings: Textbook readings: OpenStax - Chapters 1 11 Online readings: Appendix D, E & F Plous Chapters 10, 11, 12 and 14 Still important ideas Contrast the measurement of observable actions (and/or characteristics)

More information

MULTIPLE LINEAR REGRESSION 24.1 INTRODUCTION AND OBJECTIVES OBJECTIVES

MULTIPLE LINEAR REGRESSION 24.1 INTRODUCTION AND OBJECTIVES OBJECTIVES 24 MULTIPLE LINEAR REGRESSION 24.1 INTRODUCTION AND OBJECTIVES In the previous chapter, simple linear regression was used when you have one independent variable and one dependent variable. This chapter

More information

Statistical analysis DIANA SAPLACAN 2017 * SLIDES ADAPTED BASED ON LECTURE NOTES BY ALMA LEORA CULEN

Statistical analysis DIANA SAPLACAN 2017 * SLIDES ADAPTED BASED ON LECTURE NOTES BY ALMA LEORA CULEN Statistical analysis DIANA SAPLACAN 2017 * SLIDES ADAPTED BASED ON LECTURE NOTES BY ALMA LEORA CULEN Vs. 2 Background 3 There are different types of research methods to study behaviour: Descriptive: observations,

More information

August 29, Introduction and Overview

August 29, Introduction and Overview August 29, 2018 Introduction and Overview Why are we here? Haavelmo(1944): to become master of the happenings of real life. Theoretical models are necessary tools in our attempts to understand and explain

More information

The Psychology of Behavioral Economics

The Psychology of Behavioral Economics Vienna University of Economics and Business 1 The Psychology of Behavioral Economics Working Paper, M. Sc. 1 Abstract Behavioral economics has established the idea that the psychology of decisions is an

More information

9 research designs likely for PSYC 2100

9 research designs likely for PSYC 2100 9 research designs likely for PSYC 2100 1) 1 factor, 2 levels, 1 group (one group gets both treatment levels) related samples t-test (compare means of 2 levels only) 2) 1 factor, 2 levels, 2 groups (one

More information

Understanding Uncertainty in School League Tables*

Understanding Uncertainty in School League Tables* FISCAL STUDIES, vol. 32, no. 2, pp. 207 224 (2011) 0143-5671 Understanding Uncertainty in School League Tables* GEORGE LECKIE and HARVEY GOLDSTEIN Centre for Multilevel Modelling, University of Bristol

More information

Statistics 571: Statistical Methods Summer 2003 Final Exam Ramón V. León

Statistics 571: Statistical Methods Summer 2003 Final Exam Ramón V. León Name: Statistics 571: Statistical Methods Summer 2003 Final Exam Ramón V. León This exam is closed-book and closed-notes. However, you can use up to twenty pages of personal notes as an aid in answering

More information

Private Health Investments under Competing Risks: Evidence from Malaria Control in Senegal

Private Health Investments under Competing Risks: Evidence from Malaria Control in Senegal Private Health Investments under Competing Risks: Evidence from Malaria Control in Senegal Pauline ROSSI (UvA) and Paola VILLAR (PSE) UNU-WIDER Seminar October 18, 2017 Motivation Malaria has long been

More information

CHAMP: CHecklist for the Appraisal of Moderators and Predictors

CHAMP: CHecklist for the Appraisal of Moderators and Predictors CHAMP - Page 1 of 13 CHAMP: CHecklist for the Appraisal of Moderators and Predictors About the checklist In this document, a CHecklist for the Appraisal of Moderators and Predictors (CHAMP) is presented.

More information

Describe what is meant by a placebo Contrast the double-blind procedure with the single-blind procedure Review the structure for organizing a memo

Describe what is meant by a placebo Contrast the double-blind procedure with the single-blind procedure Review the structure for organizing a memo Please note the page numbers listed for the Lind book may vary by a page or two depending on which version of the textbook you have. Readings: Lind 1 11 (with emphasis on chapters 5, 6, 7, 8, 9 10 & 11)

More information

investigate. educate. inform.

investigate. educate. inform. investigate. educate. inform. Research Design What drives your research design? The battle between Qualitative and Quantitative is over Think before you leap What SHOULD drive your research design. Advanced

More information

Statistics is the science of collecting, organizing, presenting, analyzing, and interpreting data to assist in making effective decisions

Statistics is the science of collecting, organizing, presenting, analyzing, and interpreting data to assist in making effective decisions Readings: OpenStax Textbook - Chapters 1 5 (online) Appendix D & E (online) Plous - Chapters 1, 5, 6, 13 (online) Introductory comments Describe how familiarity with statistical methods can - be associated

More information

Analysis A step in the research process that involves describing and then making inferences based on a set of data.

Analysis A step in the research process that involves describing and then making inferences based on a set of data. 1 Appendix 1:. Definitions of important terms. Additionality The difference between the value of an outcome after the implementation of a policy, and its value in a counterfactual scenario in which the

More information

Chapter 13 Estimating the Modified Odds Ratio

Chapter 13 Estimating the Modified Odds Ratio Chapter 13 Estimating the Modified Odds Ratio Modified odds ratio vis-à-vis modified mean difference To a large extent, this chapter replicates the content of Chapter 10 (Estimating the modified mean difference),

More information