1 Introduction

Framework and systemic conditions constitute key elements of entrepreneurial ecosystems (Stam and Spigel 2016). Framework conditions include the institutions, physical conditions or demand for new value, and systemic conditions contain, among others, networks, leadership, finance, talent or new knowledge. Whereas the role of the public sector in creating entrepreneurship-friendly framework conditions is relatively well understood (Fuerlinger et al. 2015; Van Roy and Nepelski 2016, 2017), its impact on systemic conditions is less clear. The most obvious is the function of public funding. In Europe, for example, various instruments of funding exist to improve the process of knowledge creation and innovation at all stages of technology development and commercialisation (Gampfer et al. 2016). Many young companies benefit from early-stage financing and state-sponsored technologies, which often form the basis for their new products and services (Mazzucato 2013). Through a high-level investment in risky and new technology projects, the public sector helps to create the markets of the future. In this context, the European Commission’s (EC) Framework Programmes (FPs) have a long history of public support of the innovation and entrepreneurship ecosystems. But the objectives of the FPs go far beyond providing funding to technology development. They also aim at improving the systemic conditions of the innovation and entrepreneurship ecosystems by facilitating the creation of research networks between different organisations. In creating and exploiting diversified research networks, FPs are expected to trigger technological and economic transformation (Audretsch and Link 2016; EC 2016; Leyden 2016; Link 2016). One of the underlying assumptions behind the design of the FPs is that network diversity is a positive factor. It is expected to increase the level of innovation and to facilitate discovery of cross-border applications and solutions.

In this context, an important question for policy makers is: to what extent is a greater degree of organisational and geographic diversity in EU-funded collaborative research networks beneficial to their economic outcomes. In this paper, we explore the innovation potential of EU-funded collaborative research networks and investigate how this potential is related to the degree of organisational and geographic diversity of organisations involved in the development of innovations. We analysed a sample of 603 collaborative research networks from various EU-funded FPs.

An extensive body of literature has explored the benefits and drawbacks of organisational and geographic diversity in collaborative research networks and strategic alliances (e.g. Belderbos et al. 2004; Laursen and Salter 2006; Duysters and Lokshin 2011). Overall, a greater diversity in the type of research partners opens up greater opportunities for inter-organisational learning (Luukkonen 1998, 2000), provides access to diverse competencies (Kogut 1988; Hagedoorn 1993; Caloghirou et al. 2001), leads to a greater variety of ideas and creativity and contributes to more effective problem solving. At the same time, institutionally more diverse research consortia face difficulties due to differences in institutional culture across research partners (Goerzen and Beamish 2005; Pandza et al. 2011). In addition, managerial problems may arise when the various organisations engaged in collaborative projects attempt to reconcile their different objectives and time-frames (Harryson et al. 2008). Finally, a greater degree of geographic diversity in collaborative research networks is generally associated with greater coordination and transaction costs.

This paper contributes in various ways to the literature on this topic. First, it focuses on the collective performance of research projects. So far, impact assessment studies of EU-funded collaborative research projects have mainly explored how participating in these projects has affected aspects of firms’ economic performance, such as profitability or employment change (Bayona-Sáez and García-Marco 2010; Barajas et al. 2012; Aguiar and Gagnepain 2017). Second, it exploits a unique survey database developed by DG CONNECT that provides valuable information about both the innovators participating in EU-funded collaborative research projects with an ICT theme and the innovations developed by them (De Prato et al. 2015; Nepelski and Piroli 2018). This allows us to approach the notion of innovation from a holistic perspective in which innovation potential is not merely measured by innovation output, i.e. filed patent applications. In this paper, the innovation potential of EU-funded research projects is measured as a composite indicator which captures various determining dimensions of the innovation and technology development process, including the levels of innovation readiness, management and market potential.

The remainder of this article is structured as follows. Section 2 briefly reviews the relevant existing literature on the benefits and drawbacks of organisational and geographic diversity in collaborative research settings. It presents the most recent literature on impact assessments of Framework Programmes.Footnote 1 This is followed by a description of the methodology and data sources used to measure innovation potential and diversity in EU-funded research networks. Descriptive statistics are given in Sect. 4 and the empirical results in Sect. 5. Finally Sect. 6 offers some concluding remarks and recommendations for future research.

2 Previous literature

Since 1984, the European Commission has launched several Framework Programmes (FP) to support cooperative R&D within the European Union. The main objectives of these programmes are to sustain and enhance the international competitiveness of European industry and to increase the wellbeing of citizens (Caloghirou et al. 2004). FPs allocate public funding specifically to research consortia which involve partners from various countries and institutional settings to carry out collaborative research projects. Usually these consortia are made up of firms (SMEs and large firms), universities, public research centres and government institutions (Barajas et al. 2012).

Public interventions of this kind are traditionally seen as mechanisms to overcome market failures. Market failures can arise when firms cannot preclude dissemination of knowledge to competitors and hence are prevented from fully appropriating the returns of their R&D efforts. This may lead to lower investment in innovation activity than is socially desirable (Nelson 1959; Arrow 1962). The FPs incorporate two types of public policies that are commonly used to reduce this market failure. First, FP projects must be co-funded through grants from the European Commission and private funds from consortia partners. The use of direct financial support for R&D by means of grants incentivises firms to pursue socially valuable R&D projects that would not be conducted otherwise. Second, FPs are designed to encourage close and strategic R&D collaboration among different partners. This collaboration makes it possible to partially internalise knowledge leaks and thus increases the appropriability of returns within the research consortia.

In addition to the intervention to solve market failures, FPs also play a more active and mission-oriented role in creating and encouraging new market opportunities and in developing emerging sectors (Audretsch and Link 2016; Leyden 2016; Mazzucato 2016). In this respect, FPs serve as policy tools that shape the directionality of technology and economic transformations. By fostering the creation and consolidation of institutionally and internationally diverse research networks within the European area, FPs facilitate discovery of cross-border applications and solutions. One of the objectives of FPs is to tackle large-scale societal challenges and complex research projects that require relevant knowledge more likely to be found in networks of organisations. Thus, publically-funded research programmes such as the FPs have a threefold impact on systemic conditions of entrepreneurship ecosystems. First, they provide finance for high-risk projects with uncertain commercial potential. Second, they direct and accelerate the process of novel, market-creating technologies. Third, they increase the level of connectedness between organisations of various types, background and roles in the economy and society.

In line with these considerations, the economic and societal impacts of research networks and in particular FPs are manifold. First, FPs have been particularly successful in incorporating smaller and peripheral communities in the wider European network, strengthening the research integration and cohesion in Europe (Protogerou et al. 2013). Second, research networks are effective for both the creation and diffusion of knowledge and technologies, which can further spur regional or national wealth and competitiveness (Lehmann and Menter 2016). Analysing a panel of countries that participated in FP over the period 1994-2005, Di Cagno et al. (2014) find that participation in EU-funded research projects is an important channel of knowledge transfer. New knowledge produced within research networks can for instance spill over to the local market by means of labour mobility, patent licensing and research contacts. Finally, besides the beneficial societal impact of the creation of new technologies and spillover effects, research networks can lead to the creation of new firms that emerge during the collaborative efforts.

To increase the economic and societal impact of research networks, a better understanding of the formation of the networks in terms of the organisational and geographic diversity of participating entities and their economic outcome is of great importance. The impact of both organisational and geographic diversity in collaborative research networks has been extensively explored. As organisations and nations provide institutional and national boundaries for groups of people with different cultural backgrounds, the literature on organisational and geographic diversity relate extensively to the literature on cultural diversity. To a large extent the variety of cultural backgrounds of individuals shapes the diversity in terms of education, know-how, experiences and objectives in organisations and defines the advantages and drawbacks of collaborative endeavours in a setting with multiple organisations and countries. A large strand of literature has analysed the effect of cultural diversity on individual, group and organisational outcomes (Cox 1993). The most recurrent arguments highlighting the positive advantages of cultural diversity are the access to a broad base of talent thriving creativity, a better problem-solving capacity and a better ability in dealing with complex issues (Cox and Blake 1991; Ely and Thomas 2001). Common drawbacks of a large cultural diversity are increased costs in time and financial resources due to conflicts and communication issues (Brett et al. 2006; Stahl et al. 2010).

Performing an in-depth study by means of interviews of a small EU project funded by the Framework Programme, Ahonen and Tienari (2009) highlight the importance of diversity management in an institutional diversified setting with transnational organisations. The authors mainly analyse power relations and the role of knowledge. In line with their discussion and the literature on cultural diversity, we provide below a detailed overview of the advantages and disadvantages of organisational and geographic diversity in research networks.

2.1 Organisational diversity

Given the increasing complexity of innovations and the limited resources and competencies of individual organisations, the number of research collaborations has grown rapidly during the last few decades (Hagedoorn and Kranenburg 2003; Faems et al. 2005; Pavitt 2005; Aristei et al. 2016). The rapid development of research carried out in collaboration by different types of organisations is driven by several advantages.

Working together with other organisations gives research partners access to knowledge and complementary assets that they do not possess in-house (Teece 1986; Hagedoorn 1993; Powell et al. 1996). Conducting research and development with external partners allows partners to create and mobilize more resources than would be possible through their individual efforts (Das and Teng 2000). Collaborative research reduces the risks associated with the R&D-intensive projects, but requires enough internal R&D knowledge on the part of the research partners to understand, assimilate and exploit the accessed or acquired external technology (Cohen and Levinthal 1990). Overall, research collaborations with different types of partners serve as conduits for information and learning and are of strategic importance in the diffusion of tacit and codified knowledge (Eisenhardt and Schoonhoven 1996; Doz and Hamel 1997; Ahuja 2000). Hence, research collaborations are seen as effective means of getting information about new practices and they serve as a radar function to screen promising new technologies (Freeman 1991; Powell and Brantley 1992; Ahuja 2000; Ahuja and Lampert 2001).

Luukkonen (1998, 2000) investigated the benefits of participating in Framework Programmes. He reported that improvement of skills, expansion of research lines and access to larger networks of contacts and capabilities were among the most frequently mentioned advantages of European Framework Programmes.

At the same time, greater heterogeneity of organisation types in research collaborations can be a hindrance to the economic performance of research networks. The potential benefits of organisational diversity may be consumed by greater communication and information exchange problems, differences in institutional culture (Zucker 1986; Hennart and Zeng 2002), incompatible reward systems (e.g. publications versus commercial products and services), managerial issues and barriers to trust (Goerzen and Beamish 2005; Pandza et al. 2011). Analysing research collaborations in FP projects, Archibugi and Coco (2004) show that firms may be reluctant to engage in collaborative partnerships for competitive reasons. Similarly, Röller et al. (2007) show that large firms are less willing to share their economic knowledge with smaller rivals and prefer to collaborate with other large firms in order to maximise the internalisation of spillovers.

According to Harryson et al. (2008), another fundamental issue in interorganisational collaboration arises from having to reconcile different objectives, time-frames and from finding optimal network structures for innovation. For SMEs, alliances with external partners are often driven by a lack of internal financial resources or technological and managerial competences (Lerner and Merges 1998). Accordingly, SMEs have a strong strategic alignment with FP projects and explicit goals related to innovation outputs such as developing a prototype, a patentable technology, or a complementary technology that will directly enhance their competitiveness (Polt et al. 2008). They focus on projects with an applied orientation and engage only in cooperative agreements that are likely to yield tangible benefits and guarantee their immediate survival and growth (Miles et al. 1999; Baum et al. 2000).

Large firms appeared much less inclined to commercialise right out of the project than SMEs which are highly committed to commercialisation. Because of the more marginal role of FP projects, larger companies reported weaker strategic alignment and less explicit goals. For them, participation in research collaborations means technology watch, acquisition of new knowledge and building partnerships (Hernán et al. 2003).

Universities and public research centres, on the other hand, participate in research collaborations in order to acquire complementary resources that allow them to advance research (Caloghirou et al. 2001; Polt et al. 2008). Based on their scientific capabilities, universities engage in research collaborations for their research contents (Carayol 2003). The main criterion for collaboration is that this content feeds a university’s own research agenda. Commercialisation is not the main objective, but rather the building up of new knowledge and technology and the investigation of new research areas.

Overall, industry players tend to engage in research collaborations from a knowledge exploitation strategy which is characterised by a short- and medium-term horizon. Public research institutions, on the other hand, follow a knowledge exploration strategy which tends to have a long-term perspective (Hansen 1999). A wider diversity of organisation types in FP projects provides a variety of roles, competences and expectations through the different phases of the research projects. Hence, collaborations between industry and public institutions may create beneficial complementary effects, but they can at the same time be potential sources of conflict (Pandza et al. 2011).

2.2 Geographic diversity and geographical proximity

A great international heterogeneity of partners in a research collaboration implies advantages but also challenges in collaborating with partners located in different countries. The literature highlights the benefits of geographic diversity in gaining access to highly sophisticated, specialised and tacit knowledge from various local sources (Meyer-Krahmer and Reger 1999; Lavie and Miller 2008). Diversity of national backgrounds extends the scope of accessible knowledge bases and provides access to network resources that may spur innovation (Gulati 1999).

However, greater geographic diversity entails higher coordination and transaction costs (Hagedoorn et al. 2000; Caloghirou et al. 2003; Caloghirou et al. 2004; Goerzen and Beamish 2005). Research collaborations characterised by large international heterogeneity are much more complex and difficult to manage. Difficulties in assimilating and coordinating operations across national borders are driven by a lack of face-to-face communications, language barriers and higher costs of information transfer. In addition, when research collaboration involves a wide diversity of internationally dispersed research partners, there is greater difficulty in specifying intellectual property rights, legally enforcing intellectual property, and monitoring partner activities (Pisano 1990; Oxley 1997), which further increases transaction costs. The difficulties that geographic diversity brings along may contribute to the creation of smaller informal clusters within the collaborative research project, which can potentially affect the overall coherence of the project (Goerzen and Beamish 2005).

Besides geographic diversity, the geographical proximity between research partners is recognised as a salient factor, which affects collective innovative endeavours (Audretsch and Feldman 1996; Asheim and Gertler 2005; Boschma 2005). Geographical proximity between research partners is of crucial importance in getting access to tacit and non-codified knowledge from other partners, given that knowledge spillovers are geographically bounded (Jaffe et al. 1993; Anselin et al. 1997). Larger distance may increase communication and coordination difficulties between research partners, and may hamper the innovation potential of cooperative projects (Keller 1986; Hoegl and Proserpio 2004; Mora-Valentin et al. 2004).

2.3 Impact assessment of Framework Programmes

Despite the long-term tradition of EU-wide public support for R&D in the form of Framework Programmes, studies evaluating the impact of these interventions on research projects’ innovation performance remain relatively scarce. Impact assessment studies of FPs have mainly explored the effect of firms’ participation on their economic performance, such as profitability or employment change (Bayona-Sáez and García-Marco 2010; Barajas et al. 2012; Aguiar and Gagnepain 2017). In their analysis of a sample of firms active in FP projects, Aguiar and Gagnepain (2017) showed that participation in the Framework Programme led to a considerable increase in labour productivity though the effect on profit margins remained limited. Similarly, Barajas et al. (2012) found that participating in FPs had a positive impact on Spanish manufacturing firms’ technological capabilities, which indirectly translated into an increase of labour productivity. Bayona-Sáez and García-Marco 2010 found that the completion of an FP project had a positive impact on firm performance measured as return over assets.

Notable exceptions are the studies of Nepelski and Piroli (2018) and Schwartz et al. (2012). Nepelski and Piroli (2018) analysed the relationship between the diversity of research partners in FP projects and the potential of their innovations. The authors show that the innovative potential of research output of homogenous partnerships, e.g. between two SMEs or two large companies, is likely to be higher than that of heterogeneous partnerships, e.g. an SME and a large company. In contrast to the current paper, the analysis did not account for all participants of the research networks but explored only the diversity of the three key organisations in delivering innovations in FP projects.

Similarly, Schwartz et al. (2012) explored the factors that drive innovation output from subsidised R&D cooperation projects in Germany. Using patent applications and publications as measures for the innovation output of the projects, the involvement of large firms in the research consortium is strongly and positively associated with the number of patent applications but not with the number of publications, while university involvement yields the opposite results.

In their exploration of diversity in FP projects, Coad et al. (2017) found negative relationships between the level of organisational diversity, geographic diversity and diversity in terms of members’ shares of project cost. These findings suggest that the optimum amount of diversity in one dimension depends on the amount of diversity in other dimensions. Hence, the authors argue that a high level of diversity in one dimension may not necessarily be a liability as long as it can be compensated by sufficient similarity in another dimension. While shedding new light on the interactions across various diversity dimensions in FP projects, Coad et al. (2017) did not explore their effect on research projects’ performance.

3 Data sources and methodology

3.1 Innovation potential of research projects

To investigate the relationship between the organisational and geographic diversity in EU-funded collaborative research projects and their innovation potential, we used information from the Innovation Radar. The Innovation Radar (IR) is an EC support initiative that aims to assess the potential of innovations developed within FP research projects and to identify the bottlenecks to their commercialisation (De Prato et al. 2015). Data used to build the innovation potential assessment framework of the Innovation Radar stem from a survey developed by DG CONNECT. The survey was conducted by external experts commissioned by DG CONNECT during periodic reviews of the research projects between October 2014 and January 2016. The Innovation Radar monitors the ICT research actions and the e-infrastructures activity under the seventh Framework Programme 2007-2013 (under cooperation and capacities themes), the policy support actions carried out under the competitiveness and innovation framework policy support programme (CIP ICT PSP) and the ICT-related projects in Horizon 2020 (EC 2014).

The innovation potential assessment framework of the IR is extensively based on the extant literature analysing the antecedents and success factors of new product performances and R&D projects (Rothwell 1992; Balachandra and Friar 1997; Heslop et al. 2001; Astebro 2004; Evanschitzky et al. 2012). The literature discussing success in innovations and R&D projects is vast and lacks uniformity in the use of project outcome measures (Balachandra and Friar 1997; Cooper and Kleinschmidt 1997). According to Astebro (2004), project commercialisation is one of the most easily operationalized and replicable definition across studies and is in this sense the most objective measure for a project’s outcome. In the same vein, the Innovation Radar aims at providing a contingency framework and metrics measuring the project’s development towards commercialisation. However, in contrast with this literature the innovation potential indicator does by no means intend to provide a predictive signal of the innovation success, but rather aims to measure the progress that has been undertaken in developing and commercialising an innovation on the market.

A large body of empirical studies has emerged over the past decades aiming at unravelling factors determining the technology development and commercialisation process (for extended surveys see Montoya-Weiss and Calantone 1994; Griffin 1997; Galbraith et al. 2006). Within this empirical literature little convergence exists regarding the number, definition and theoretical grounding for the key factors of effective technology commercialisation (Astebro 2004). Despite the lack of agreement on the specific variables that are used in the empirical analyses, there does, however, seem to be some consensus on the overall classes or groups of these key factors. Based on a meta-analysis of 60 peer-reviewed publications, Balachandra and Friar (1997) proposes four major categories on market, technology, environment, and organisational related characteristics. These categories have been widely recognised and adopted by many scholars in the field of technology commercialisation of R&D projects (Linton et al. 2002; Astebro 2004). Alternatively, Heslop et al. (2001) use factor analyses to group more than fifty variables related to the technology commercialisation process into four comprehensive dimensions of market readiness, technology readiness, commercial readiness, and management readiness.

Taking stock of these considerations, the Innovation Radar framework is built along the areas discussed in this stream of literature and incorporates them in the following dimensions: market potential, innovation readiness and innovation management (De Coster and Butler 2005; Liao and Witsil 2008). Each of these dimensions is discussed in more detail below.

Innovation readiness A successful launch of innovative products or services begins with the identification of technologies that are ready for commercialisation (Heslop et al. 2001; Galbraith et al. 2006). In this respect, innovation readiness is closely related to the notion of “technology readiness levels” (TRLs) which aim to provide a common understanding of the status and development stage of new technologies (Mankins 2009). Originally developed by the NASA in the mid-1970s, the use of TRLs rapidly increased as they enable consistent and uniform assessments of technological maturity across different types of technologies and disciplines. Being discipline-independent, they facilitate more effective communications of the maturity of evolving innovations among diverse organisation types. Factors related to innovation readiness include, among others, the quality of the technology, age, scope, how pioneering it is, and expected time to market. Innovation readiness aims to define the development phase of the innovation, e.g. conceptualization, experimentation or commercialisation. It also takes into account the steps that were taken in order to prepare innovations for commercialisation, e.g. prototyping, demonstration or testing activities or a feasibility study, and to secure the necessary technological resources, e.g. skills, to bring the innovation to the market. In addition, this criterion takes into account the development stage of an innovation and the time to its potential commercialisation.

Innovation management This criterion addresses the issue of the project consortium and its commitment to bringing an innovation to the market. This is often seen as the most important success indicator of a technology venture (Meseri and Maital 2001; Kirchberger and Pohl 2016). In broad terms, it is related to the assessment and management of risks associated with innovation commercialisation. It involves measures such as securing resources, organizing the process and setting milestones for technology transfer. This requires commitment from the top management (Nevens 1990; Davenport et al. 1998). Interactions with external actors, e.g. potential customers or users, also increase the chances of successful commercialisation of technologies (Gerard et al. 2002). Thus, the concept of innovation management aims to capture how far the project’s development and/or management team are able to execute the necessary steps to transform an innovative technology or research results into a marketable product and, finally, to prepare its commercialisation. These steps may include, for example, clarifying ownership and IPR issues, preparing a business plan or market study, securing capital investment from public and/or private sources, or engaging end-users in the project.

Market potential A commercially viable innovation must demonstrate economic benefit. The greater the benefit, the more desirable and marketable an innovation is. At the same time, the innovation commercialisation process involves acquiring ideas about existing or potential market needs and looking for solutions to satisfy them (Mitchell and Singh 1996). The market potential criterion relates to the demand and supply side of an innovation. Regarding the demand side, it concerns the prospective size of the market for a product and the chances of its successful commercialisation. It aims to assess how the product satisfies a market sector and to indicate that there is a potential customer base. Market size and dynamics are among the most relevant factors behind a successful innovation commercialisation (Meseri and Maital 2001). With respect to the supply side, it aims to assess whether there are potential barriers, e.g. regulatory frameworks or existing IPR issues, which could weaken the commercial exploitation of an innovation. In the current undertaking, the focus is placed on the supply side. This is mostly because information on markets for individual innovations is not available.

In order to observe and measure the above-specified criteria, each of them was matched with relevant questions in the Innovation Radar questionnaire. The outcome of the matching process is presented in more detail in prior studies on the IR (De Prato et al. 2015; Pesole and Nepelski 2016). Composite sub-indicators for each assessment criterion were created, i.e. Innovation Readiness Indicator (IRI), Innovation Management Indicator (IMI), and Market Potential Indicator (MPI). In the second step, the Innovation Potential Indicator (IPI) was constructed. IPI is an arithmetic composite indicator which aggregates the values of the three earlier sub-indicators.Footnote 2

As mentioned above, the conceptual framework of the Innovation Radar builds on the extant literature on success factors of innovations (see Evanschitzky et al. 2012; Kirchberger and Pohl 2016 for recent surveys). Evanschitzky et al. (2012) provide a meta-analysis of papers published between 1999 and 2011 to assess the effects of factors predicting success of new product innovations and compares the magnitude of these effects found in a previous meta-analysis study of Henard and Szymanski (2001). Both meta-analysis studies show large divergences in the magnitude of success factors of new product innovations. Due to a lack of convergence about the magnitude of success factors in the previous literature, we follow a conservative approach and opt to equally weight the sub-indicators of the Innovation Potential Indicator. With this approach we follow the perspective of scholars claiming that successful development and commercialisation of a new technology is a matter of competence in all factors and of balance and coordination between them and not doing one or two things brilliantly well (Cooper and Kleinschmidt 1988; Rothwell 1992; Conceição et al. 2012).

Hence, equal weighting is applied to construct the Innovation Potential Indicator as follows:

$$ IPI = \frac{1}{3}IRI + \frac{1}{3}IMI + \frac{1}{3}MPI $$
(1)

Observed values of the IPI indicator are brought to a scale between 0 and 100 multiplying the IPI by a score of 10. The left-hand side indicator of Eq. (1) measures the innovation potential of each EU-funded research project and serves as dependent variable in the regression analyses of Sect. 5.

3.2 Organisational and geographic diversity

To construct the focus explanatory variables which measure the organisational and geographic diversity in EU-funded collaborative research projects, IR survey data was complemented with information on projects’ characteristics retrieved from the CORDIS database (Mankins 2009). This database is the European Commission’s public repository of information on all EU-funded research projects and their results. For the purpose of this study, we retrieved, among others, information on the type and location of project participants, which allowed us to create measures of organisational and geographic diversity at project level. The organisational and geographic diversity measures are calculated as inverse Herfindahl indices. The Herfindahl index is among the most accepted measures of diversity in the economic literature (Patil and Taillie 1982; McDonald and Dimmick 2003). It has been widely used in the context of innovation and R&D collaborations to measure geographic (Beers and Zand 2014), organisational (Talke et al. 2011; Von Raesfeld et al. 2012) or technological diversity (Baum et al. 2000; Van de Vrande 2013). Organisational and geographic diversity—respectively denoted as D ORG p and D GEO p —are calculated as follows:

$$ \mathop {\text{D}}\nolimits_{\text{p}}^{ORG} = 1{ - }\sum\limits_{o = 1}^{O} { ( {\text{s}}_{op} )^{ 2} } \quad {\text{and}}\quad \mathop {\text{D}}\nolimits_{\text{p}}^{GEO} = 1{ - }\sum\limits_{c = 1}^{C} { ( {\text{s}}_{cp} )^{ 2} } $$
(2)

Indices D ORG p and D GEO p sums the squared shares of respectively organisation type o and country c in FP project p and deducts it from unity. Hence, the higher the values of D ORG p and D GEO p , the more diverse the distributions of organisation types and countries in the research networks.

3.3 Project characteristics

We control for other types of characteristics that may affect the innovation potential of EU-funded research projects. First, we include the geographic distance between the different partners of the research consortium. Using geographical latitude and longitude information from the Geonames geographical database, we calculate - for each partner of the project - the distances between its city and the cities of its co-partners with the great-circle distance method. The geographical distance in a research project is then defined as the average of all these distance measures.

Second, we include two dummy variables that control for the maturity of the project, denoted as interim review and final review. Each of them takes the value of 1 if the project is reviewed for the second or third time respectively and 0 otherwise. The reference group is the first review of a project. The maturity of the research project might influence its innovation potential in several ways. Time is a salient factor in developing a fertile ground for knowledge dissemination, assimilation and understanding within the project network (Schwartz et al. 2012). It requires frequent social interactions between the research partners, which are essentially based on trust and reciprocity (Dahl and Pedersen 2004; Niedergassel and Leker 2011). However, the development of trust and reciprocity takes considerable time and requires continuous efforts from all cooperating partners. Hence, as the duration of the cooperation advances, trust-based relationships between research partners strengthen, which further reduces freeriding or opportunistic behaviour and increases the project’s probability of innovative success (Morgan and Cooke 1998).

Finally, we control for the amount of funding the project consortium received (project funding) and for the total duration of the project (project duration).

4 Descriptive statistics

Table 1 provides an overview of the sample of innovation projects and organisation types that we have investigated in the current study. Between October 2014 and January 2016, 603 EU-funded collaborative research projects were reviewed using the Innovation Radar questionnaire, including nearly 10% of all ICT FP7, CIP ICT PSP and Horizon2020 projects. As a result, 1128 innovations were identified. This means that, on average, every project produces nearly 2 innovations. The number of organisations active in these projects amounted to 7193. We distinguished six types of organisations, including universities, research centres, small –and medium-sized enterprises, large firms, governmental institutions and others. Universities account for almost one third of the organisations, while research centres and the two types of firms have respective shares around 20%. The percentage of both the governmental institutions and other types of organisations amounts to 6% and 5% respectively.

Table 1 Overview of innovation projects and organisation types

Further insights at the project level are presented in Table 2, highlighting the number of organisations, organisation types and represented countries per project. On average, every project involves twelve organisations and includes four different organisation types, active in six different countries. These descriptive statistics demonstrate the aim of EU-funded research frameworks to create institutionally and internationally diverse research networks. Most of the projects include three to four different organisation types (65%), while the share of projects having five to six types amounts to 23%. Only eleven projects report that they have one organisation type active in the innovation development (only involving universities). Concerning the geographical dispersion of research partners, projects include at least two different countries, and can include as many as 30 countries.

Table 2 Organisational and geographic dispersion at project level

Table 3 presents summary statistics of the 603 EU-funded research projects. Research projects diverge widely in their innovation potential. The project with the highest score obtained 88.33 points, while the lowest-ranked project got only 14.08 points. Substantial differences can also be observed for organisational and geographic diversity measures. The table provides further details about project characteristics, including geographical distance across all research partners, project duration, project funding and the review stage. The correlation table between the variables is included in the Appendix.

Table 3 Descriptive statistics of EU-funded research projects

5 Empirical results

We report the OLS estimations analysing the relationship between the organisational and geographic diversity in EU-funded research projects and their innovation potential in Table 4. The results reveal that organisational diversity in EU-funded research projects has a positive effect on their innovation potential. In other words, research projects with a greater heterogeneity of organisation partners have more innovation potential. In line with previous studies, these findings point to the advantages of organisational diversity that may arise through various means such as access to complementary assets (Teece 1986; Hagedoorn 1993), a wider range of capabilities and perspectives driven by a broader network of relationships, and the promotion of knowledge diffusion (Ahuja 2000; Das and Teng 2000), among others. Though innovative outcomes of organisational collaborations may be negatively affected by the variety of institutional cultures, problems of distrust or differences in objectives across organisations (Goerzen and Beamish 2005; Harryson et al. 2008; Pandza et al. 2011), the positive coefficient of the organisational diversity indicator suggests that the beneficial effects of a wider diversity of organisation types outweigh the negative impact of these challenges.

Table 4 Organisational and geographic diversity and innovation potential of EU-funded research projects

The innovation potential of EU-funded research projects is negatively affected by geographic diversity. This finding is consistent with the previous literature which points to the challenges arising from collaborations with internationally-diverse partners. Research projects with a wider heterogeneity of international partners may encounter increased costs of information transfer and face-to-face communications and difficulties due to language differences (De Meyer 1993; Welch and Welch 2008).

In column 2, we control for the geographical distance between the various organisations of the research consortia. Contrary to our expectations, the geographical distance between partners has a positive impact on the innovation potential of research projects (Audretsch and Feldman 1996; Asheim and Gertler 2005). This positive impact can be due to the fact that we do not control for partner-specific characteristics (Branstetter and Sakakibara 2002). As such, the geographical distance indicator may capture the beneficial effects of strong relational ties with more distant partners that possess the specialised knowledge needed for innovation development. In a similar context of strategic alliances, Capaldo and Petruzzelli (2014) and Petruzzelli (2011) suggest that high geographical distance between partners can provide the alliance with the heterogeneous knowledge resources needed for successful innovation.

Both control variables – final review and interim review – which account for the maturity of the research project are positive and significant. As research projects in the first review serve as a reference group, these findings indicate that the innovation potential of research projects increases during the project. Concerning the remaining features of the research projects, the amount of funding has a positive impact on innovation potential while the project duration seems to negatively affect its innovative outcome. The positive effect of the amount of resources that is devoted to an FP project is in line with findings of Schwartz et al. (2012) that explored a sample of German subsidised R&D cooperative projects.

As both the dependent variable and the variables of interest are expressed as logarithms, estimated coefficients can be interpreted as elasticities. A doubling of the degree of organisational diversity would increase the innovation potential of a project by 7.5 percent. In sharp contrast, a doubling of the degree of geographic diversity would lead to a nearly 20 percent decrease of a project’s innovation potential. The negative impact of geographic diversity increases to roughly 30 percent after controlling for the geographical distance.

These results highlight the importance of the project design and in particular the relatively high negative impact of a large geographic diversity within the research consortium. Although results provide an indication of the magnitude and importance of the diversity impact, caution is required in interpreting the directionality of the effects. Given the cross-sectional nature of the data, we cannot ascertain causality and should merely interpret results as associations.

6 Conclusions

Considering that the publically-funded research programmes produce technologies that often form the basis for new products, services and markets, such instruments as the EC Framework Programme improve the framework and systemic conditions of entrepreneurial ecosystems. It accelerates the knowledge and technology production process and increases the stock of knowledge available to new technology-based firms. These firms are often the vehicles for the commercialisation of new knowledge and technologies. The key element of the EC FP is facilitating and exploiting the potential of diversified research networks.

The level of diversity of EC FP is quite considerable. For example, during the 7th Framework Programme, 25.000 projects out of more than 139.000 research proposals received funding. Nearly 30.000 organisations participated to these projects. Universities and research organisations accounted for over 71% of all participating organisations. Private companies, including SMEs, represented the second largest group (Fresco et al. 2015). The Framework Programme by conception is a collaborative programme with global outreach open to all researchers and research organisations irrespective of their country of origin. FP7 has attained unprecedented levels of international participation by involving researchers in retained proposals from as many as 170 countries from all continents (EC 2015).

In this paper, we examined the impact of both organisational and geographic diversity on the commercial potential of innovations developed by research networks funded by EU Framework Programmes. An extensive body of literature has analysed the advantages and drawbacks of organisational diversity in collaborative research and explored the various challenges that can arise in collaborations with internationally-dispersed research partners. Not many studies have specifically assessed the effect of diversity in Framework Programmes. These studies were more descriptive in nature (Pandza et al. 2011) and often assessed the beneficial effects on firms’ economic performance from engaging in these collaborative research projects (Bayona-Sáez and García-Marco 2010; Barajas et al. 2012; Aguiar and Gagnepain 2017). However, none of these studies investigated how the design of the research consortium in terms of organisational and geographic diversity related to the commercial potential of innovations of EU-funded collaborative research projects.

Using a sample of 603 EU-funded collaborative research projects with an ICT theme, this paper provides evidence of the importance of the composition of innovation partnerships in research collaborations. Our findings suggest that projects with a wider diversity in research partners are more likely to deliver innovations with a greater potential. This indicates that these projects reap the benefits of the various advantages associated with more organisational diversity such as greater learning opportunities, enhanced creativity and access to a broader network of knowledge sources and competences. Although wider organisational diversity generates difficulties in reconciling the different objectives and time-frames of the various types of research partners, the net effect of a more institutionally diverse research team seems to be positive.

In contrast, research networks with greater geographic diversity are associated with lower levels of innovation potential. This finding is in line with the literature which suggests that a larger heterogeneity of international partners in collaborative projects may increase the costs of information transfer and face-to-face communications (De Meyer 1993; Welch and Welch 2008). Contrary to our expectations, the geographical distance between partners has a positive impact on the innovation potential of research projects. This lets us assume that organisations choose their partners based on their specialised knowledge assets and that the geographic distance does not prevent them from engaging in collaboration. This conjecture can be confirmed once information on partner-specific scientific and technological capabilities is available.

The construction of such a large research programme as the EC FP represents a major challenge. Our results show that besides such elements as the duration of funding of projects, the composition of the teams participating to them plays an equally important role. Just as there are decreasing returns to the number of participants (Breschi and Malerba 2011), there are limits to diversity of the participating organisations. Our results show, in particular, that the geographical mix poses a challenge and can create tensions within the project consortia, which can reduce their performance. Thus, such requirements as, for example, in the H2020 programme to create consortia of organisations including at least 3 participants from 3 different EU Member States or Associated countries may not necessarily increase the productivity of project consortia (EC 2018).

Our sample is restricted to the ICT theme of the FP. We have however to acknowledge that various scientific and technological domains exhibit specific dynamics and configurations (Bonaccorsi 2008). In particular, emerging and high-growth fields in science, such as computer science, biotechnology and life sciences, materials sciences and nanotechnology, are characterized by theme-specific degrees of diversity and of complementarities, both at the cognitive and institutional level, requiring active cooperation forms between different disciplines and actors. In order to achieve efficient productive settings, these theme-specific characteristics need to be taken into account while constructing heterogeneous collaborations.

In the context of the ICT or digital theme, one needs to consider the issue of participation of early-stage ventures in collaborative projects or the process of creation of such ventures with the objective of commercialisation of the research results. Young, technology-based enterprises, including start-ups and spin-offs, are the main vehicles through which new knowledge from science and engineering is converted into economic benefits (Acs et al. 2009a; b). These companies are more likely than others to pursue opportunities associated with radical innovations that produce positive knowledge externalities and may have transformative consequences for the entire society (Baumol et al. 2007). This is particularly true for ICT sector companies and digitally-enabled companies. By increasing the level of participation of early-stage ventures in FP projects, the EC could accelerate the knowledge and technology production and commercialisation process.

Our research was subject to a number of limitations, which may also suggest directions for future research. First, we lacked information about the level of technological relatedness across industry partners within research networks, which had been reported in prior studies as a relevant factor for the outcome of collaborations (Branstetter and Sakakibara 2002). A greater degree of technological proximity between firms could facilitate the exchange, the assimilation and the use of knowledge within the research consortium. If technological divergence between the partners is large, an industry partner’s knowledge would be largely unexploitable for its counterparts. Hence, an interesting future research project would be to construct a technological proximity measure based on patent information of the industry partners. Second, linking industry partners to third-party databases would also allow us to control for the quality of firms active in the research project, including measures of firm size, value added and productivity growth. Information on the use of VC funding by organisations participating to the EU-funded research projects would improve our understanding of the position and role of publically-funded research programmes within the entrepreneurial ecosystems. It would cast light on the interplay between public and private sources of funding and the access to funding at each stage of technology development and commercialisation (Auerswald and Branscomb 2003). Third, the innovation potential of EU-funded research projects may also depend on the quality of other types of research partners. This calls for the inclusion of quality measures of universities, public research centres and governmental institutions in the estimation analyses.