- Research Article
- Open Access
Limits and benefits of participatory agenda setting for research and innovation
European Journal of Futures Research volume 9, Article number: 8 (2021)
Current governance of science, technology and innovation (STI) faces tough challenges to meet demands arising from complex issues such as societal challenges or targets, e.g. the United Nations’ Sustainable Development Goals. For decades, scholars and civil society institutions have called for increased public participation in STI, and political institutions have been taking up the request to integrate engagement activities into their decision-making processes, at least in the form of consultations. Moving engagement in research and development further upstream makes early interventions and social shaping of technologies and innovation possible. Since research has also faced repeated requests towards taking on more responsibility for solving societal problems, engagement processes thus help in shaping research. Here, the earliest point for possible engagement can be found within the constituting phase of research agendas as topics, general lines of enquiry and targets are shaped in this phase. These are the boundaries in between which researchers later navigate. This article serves as introduction to this journal’s topical collection on participatory agenda setting for research and innovation (PASE). It provides a review of the literature on theory and practice of PASE activities, summarises the topical collection’s contributions regarding current international cases and analyses respective PASE limits and benefits, thereby promoting its conceptual and practical understanding.
Theory and practice of open agenda setting (a short history of PASE)
Current governance of science, technology and innovation (STI) faces tough challenges to meet demands arising from complex issues such as societal challenges [1,2,3] or the United Nations’ Sustainable Development GoalsFootnote 1. When tackling complex problems, expertise in research integration and implementation is particularly important, yet currently exists in rather fragmented approaches such as inter- and transdisciplinary research, systems thinking or action research . Here, transdisciplinary research generally refers to the integration of three types of knowledge: systems knowledge, target knowledge and transformation knowledge . Providing these types of knowledge has long been reserved for a small and privileged group of actors.
As a result, and under the header of responsible research and innovation (RRI), there have been calls in the European Union and beyond for research and innovation (R&I) to orient itself more strongly towards societal needs, demands, and preferences. Building upon the ongoing development of democratic science and technology governance, for several decades, there has been a demand for reflexive and responsive institutions facilitating more constructive science-society interactions . RRI emerged from preceding and ongoing developments in technology assessment, anticipatory governance or upstream engagement (Owen, ). Participatory technology assessment (pTA) specifically aimed at strengthening inclusive deliberation on emerging technologies and STI agendas [8, 9], whilst foresight, and here especially horizon scanning activities with participatory elements, focussed early on the potential of stakeholder engagement for on identifying new topics for STI governance [10,11,12,13]. Even though RRI is shifting its concept, its main dimensions inclusion, anticipation, responsiveness and reflexivity are established, with the addition of two emerging dimensions, i.e. sustainability and care . Combining these dimensions can become “a transformative ingredient of ‘responsibilisation’ of actors and institutions in R&I systems” . Whilst RRI’s shift from academic discussion to institutional practice is well underway, a good part of these practices focusses on opening up research and innovation . This shift has “inevitable institutional consequences for research funding, priority-setting and new collaborative models between science, policy, society and industry” . Here, the question of whom to engage in such settings has evolved considerably over the years, whilst the triple helix has long been the main model for a reflexive innovation system, involving academia, industry and governments . Within the last decade, however, the quadruple helix, adding the public as an additional factor, has gained importance [19, 20] and is being further refined by accepting the established socio-ecological necessities of the twenty-first century by adding natural environments as major driver for knowledge production and innovation .
From science communication to participatory science governance
Modern science’s relationship with the public during the past century up until the present can roughly be divided into three distinct paradigmatic phases: science literacy (1960s onwards), public understanding (after 1985) and science and society (1990s to present) . The first two paradigms were characterised by attributing knowledge and attitude deficiencies to the public, rendering it incapable of understanding science, with the result of limited appreciation for and raising fears of science (and technology). Science literacy measures, attitude change and image marketing are the reported viable tools to meet such challenges. This “deficit model” has been much critiqued and resulted in the third paradigm of a rather equal science and society relation. Criticism towards the deficit model followed several lines of arguments, for instance that it fails to recognise the importance of local knowledge-in-context , or the flawed general assumption that because citizens show mistrust in science, they are deficient and therefore not to be trusted when asked about issues related to science and technology.
Lash et al.  describe how technology creates new forms of risk, whilst scientists are repeatedly drawn to mitigating problems created by science and technology, with Jasanoff  arguing that industrial society’s capacity for prediction and control was outrun by its ability to create vast technological systems. As science is increasingly embedded in society, respective accountability and quality control, too, need to be shared with society . Against this background, the “participatory turn” took place in science, and the governance of science and technology underwent reforms towards more and discursive engagement activities .
Sturgis and Allum  summarise that, on the one hand, perception of risk towards new technologies is strongly influenced by norms and values which do not primarily depend on peoples’ scientific understanding. On the other hand, scientific knowledge does have an additional independent effect. Consequently, the first two paradigms of science literacy and public understanding of science are not superseded by the dialogical form of science and society relation, but continue to simultaneously inform research and policy . This resulted in criticism, for instance regarding conflict between integrity/impartiality of science and its “involvement with the vested interests of the State and commerce on policy issues”, threatening to destroy public trust in science , or regarding the alloted diminishing of democratically credible and sometimes effective “street-protest” in response to uneffective laboratory-like partcipation experiments [29, 30]. Stilgoe et al. , however, describe a ‘gradual and incomplete shift from understanding to engagement’, or, in short, from deficit to dialogue. Comparing the last four European science policy framework programmes with regard to the science-society relationship, Conceição et al.  also find a shift towards strengthening issues of governance of science and the transformation of scientific institutions when compared with to science education and public communication of science.
In general, there are three main arguments that are presented the most when examining why public participation is necessary for political decision-making . (a) Democracy: counteracting a crisis of representative democracy by alleviating the general lack of transparency of political processes by involving the public more directly, ensuring a consideration of different opinions; (b) function: improving effectiveness of decisions on controversial issues when disagreement exists within scientific communities on a magnitude of problems and their solutions whilst public trust in experts simultaneously declines; (c) normativity: the moral obligation of involving a wider public in decisions on matters of public interest. Here, another addition may be the issue of capacity building, an often underrated effect of public engagement (PE) activities .
As institutions shifted towards public engagement and more activities were requested and commissioned, a participation industry came to life , keeping public participation alive until today, in some countries more than in others. Chilvers and Kearnes  classify this reconfiguration of the science and democracy relationship as “what appear on face value to be novel and emergent participatory experiments are thus part of the cyclical and continual readjustments in the democratic order of things”. Curato et al.  review the most discussed issues in deliberative democracy within the political and social sciences, and demonstrate, amongst others, that deliberation: (a) is a realistic endeavour (responding to criticism of being utopian), being implemented within and outside governmental institutions; (b) is essential to any democratic process; (c) is more than discussion and involves multiple sorts of communication; (d) can curtail elitist domination of policy; (e) does not primarily aim at consensus; however, (f) mitigates group polarisation and thus applies to deeply divided societies.
Methods and methodologies continue to evolve, not only driven by countless activities and actors on several levels, from local to global, but also topic-wise from single technologies to engaging with questions of macro-level governance. Attempting to grapple with this diversification, Rowe and Frewer  categorise public engagement activities by differentiating between public communication, public consultation, and public participation according to characteristics of information flow in the respective settings. To clarify the strength of engagement, Manafò et al.  define six levels arranged on a spectrum with increasingly required resources (time, knowledge, funds): learn/inform, participate, consult, involve, collaborate and lead/support. Gastil  highlights the need for analysing public deliberation methods, particularly in relation to the different points of entry within the policymaking system. Participatory science governance is a broadening field and it has been criticised mainly for failing to reach the intended impact, in both formal settings  and informal ones . Abels and Bora  for instance conclude that regarding the “high potentials of conflict in ethical debates […] participatory TA is an unpredictable tool with limited possibilities”. Whilst there are several reasons for failing to reach the intended impact, more and more scholars point towards public engagement activities to be inserted within the research and innovation system as early as possible (upstream engagement), as lateness of respective activities has been identified as an important reason for the failure [30, 43,44,45,46].
Conveying the argument of favouring public engagement in agenda-setting, participation (a) helps to democratise the research arena dominated by an elite, making research funding decisions more transparent; (b) contributes to better understand societal impact of and a need towards science and technology, thus producing better decisions whilst increasing public trust in science; and (c) fulfils the moral obligation of involving the public into guiding decisions of distributing tax-money for research and innovation which may concern public and individual lives.
Research priority setting to research agenda setting
The terms “research priority setting” and “research agenda setting” are often used interchangeably . Since health research has been, until today, the most prominent scientific field that applies participatory agenda setting, taking a closer look at the abovementioned arguments is essential. Referring to the three arguments described above, Schölvinck et al.  provide the following review: Involving patients at an early stage of research policy increases the chances of successful implementation of innovations, which increases quality and legitimacy of research policies (the democracy argument); patients require valuable experiential knowledge when dealing with their condition and its consequences that complements scientific and biomedical knowledge (the functional (substantial) argument); they have the moral right to engage in decision-making on research policy since they are affected by it (the normative argument).
After the value of experiential knowledge gained wider recognition around the turn of the millennium, for instance patient participation for health research, research priority setting became one focus within growing field of engagement activities for governing health systems, and included, amongst others, the setting and monitoring of ethical standards. Health research priority setting is arguably required by the judiciary when state interests are at stake, for example in the promotion of health equity .
Research funding organisations started to engage with the public to identify and prioritise research topics for investment and to decide between proposals . Evaluations, for instance of the criteria used to take such decisions, show mixed results as well as possible bias regarding who presented the proposal . Nevertheless, Smith  presents evidence indicating that “voting decisions were most influenced by potential benefits of the planned research to society”.
Today, health research priority setting represents a maturing field, with patients mainly being involved “most often at the pre-preparation stage to identify ‘high-level’ priorities in health ecosystem priority setting, and at the preparation phase for health research” . Here, specific focus is given to what knowledge and questions patients and the public value most when becoming experts for their own health care experiences Footnote 2. This involvement can “redress power imbalances in health research agenda setting” .
However, except for those four cases1 where public engagement in priority setting takes place, it is rather informal and ad hoc, and not routinely used by research funding organisations because it threatens established research structures, procedures, and scientists’ cultures and priorities [54, 55]. Such structures and an uneven distribution of power and resources lead to “undone science”, a term referring to “areas of research that are left unfunded, incomplete, or generally ignored but that social movements or civil society organisations often identify as worthy of more research” .
Nonetheless, when such priority setting takes place, important framing decisions have already been taken. Participatory agenda setting inserts public opinion further upstream, at an earlier stage than priority setting. Here, a very early point of engagement can be found within the constituting phase of research agendas as topics, general lines of enquiry, and targets are shaped in this phase. These are the boundaries in between which researchers later navigate when proposing their intended research.
However, the inclusion of experts, stakeholders and even laypeople into agenda setting maybe acceptable to more applied fields of research, where benefits of such activities are more obvious. For instance, researchers may be more inclined to “listen” to outsiders in terms of agenda setting, when the issues at stake directly concern those outsiders, for instance when studying futures, medical treatments, or political issues. Actors within more basic research-oriented fields, e.g. in the natural sciences, may struggle more to see such benefits , especially when public engagement requires comprehensive information about the field prior to the involvement, e.g. in nanotechnologies . Additionally, public interest in such basic research may be limited. Some fields actively foster PE activities, for instance space research . PE in the natural sciences often comes in form of citizen science, which primarily focusses on science communication or the involvement in data collection [60, 61]. Whilst citizen science rather seldomly influences basic research agendas, it contributes to policy agenda setting, e.g. in environmental policy .
Agenda setting is a specific way of shaping futures by guiding the allocation of significant funds towards the chosen targets or fields of priority. Orienting research and innovation is a complex task in itself, and respective agenda setting processes have traditionally been expert-driven because scientific knowledge has long been considered the only appropriate form of knowledge for, e.g. framing research agendas. Expert- and stakeholder-based anticipation of future developments, identification of possible challenges and solutions to frame respective strategic decisions has been embedded into research programming [11, 63, 64]; nevertheless, it presents a limited approach to shaping futures as this may neglect societal needs and values and therefore valid alternative futures.
Such a goal is shared by the open science initiative which has been unfolding for the past decade, aiming at increasing science’s responsiveness to public needs amongst other things . The integration of organised stakeholders’ interests has, of course, a long tradition (e.g. in form of lobbyism) as agenda setting is in most cases partly, or mainly, a political process. This elitist form of visioning renders large parts of the population “not having futures” . As a result, advice-giving processes opened up to public participation, becoming a norm in, for instance, foresight . Technology assessment over the last decades [8, 9, 68]. As TA is inherently democratic, it has actively promoted public engagement in science and technology, relying not only on functional arguments of inclusion in modern democracy, but also on a normative one such as the empowerment of citizens and stakeholders, and its value in itself . Participatory agenda setting is therefore, as deliberative democracy is in general, a normative project.
In summary, research agendas are increasingly becoming the target of multi-actor engagement processes aiming at integrating a broader base of information by considering other forms of knowledge . Research programme development acts as an early entry point for public needs and values into the innovation process [71, 72]. Experience with participatory agenda setting processes suggests that “laypeople’s experiential and value-based knowledge is highly relevant for complementing expertise to inform socially robust decision-making in science and technology” . Recent empirical evidence from comparing citizen-driven STI agenda setting with expert-based foresight studies strengthens this claim [73, 74]. Aiming at producing sustainable strategies for responsible socio-technical change, research funding can benefit from combining forward-looking and public participation to elicit socially robust knowledge by consulting with multi-actors, including citizens . However, the inclusion of laypeople into futures studies and foresight in general, and into forward-looking STI governance in particular, is underexplored.
Topical collection: participatory agenda setting for research and innovation
This current topical collection collects theoretical contributions as well as empirical papers regarding cases and methods of participatory agenda setting activities to map international progress in this upcoming field of research and practice. It includes contributions from several disciplines and interdisciplines as well as adjacent fields, including futures studies, foresight, technology assessment (TA), science and technology studies (STS), design and innovation management. The topical collection maps selected international cases in the field, analyses barriers and drivers for participatory agenda setting, thereby develops its conceptual understanding further.
This article serves as introduction to the topical collection and presents an analysis of the contributions’ content asking: What are beneficial and limiting factors for conducting participatory agenda setting activities?
First, the diverse contributions are summarised to provide readers with an overview. The following section presents an analysis of their content with regard to limits and benefits of participatory agenda setting processes and discusses the results in relation to the literature.
A qualitative content analysis was performed by ‘assigning categories to text passages as a qualitative-interpretative act, following content-analytical rule’  to analyse content and contextual meaning of text passages . The applied exploratory study with inductive category development  allowed categories to emerge from the data. This is also referred to as ‘open coding’ in grounded theory , aimed at ‘at a true description without bias owing to the preconceptions of the researcher, an understanding of the material in terms of the material’ .
Quotes that at least partially related to the research question and large enough to provide sufficient context were extracted and comprised in a database, where preliminary categories were assigned. These preliminary categories were revisited several times during the course of analysis and revised if necessary to allow clustering with other quotes. In this way, overarching clusters emerged from the data which resulted in the final categories. Whilst these categories may be somewhat arbitrary and other researcher may have assigned different labels, they fulfil their function in allowing for a structured discussion of limits and benefits of the reported PASE activities as well as for drawing generalised conclusions for the field.
Summary of contributions: international cases
This section shortly summarises the diverse contributions to the topical collection. Each case included in this paper points towards the dynamics of change and continuity.
Matschoss et al.  describe how transdisciplinary co-creation of a research agenda for global change research at national level in Finland led to the inclusion of important societal topics that may otherwise have been neglected by researchers. In their pilot study, the authors describe how a large variety of participants, including actors outside of academia or research funding, engaged in a series of events. The authors conclude that a particular strength of the analysed approach to research agenda setting could be found in its capacity to combine the multiplicity of views emerging from the diversity of participants.
Rosa et al.  scrutinise two recent participatory foresight activities within the framework of reflexive innovation as forums for contextualising alternative futures. They discuss the activities’ capability to advise on mission-oriented innovation policy-making and their potential in strengthening citizens’ role in providing strategic input for the European Commission’s framework programme for research and innovation that has recently been issued. The authors stress the importance of furthering multilateral dialogues methodologically, in implementation and reception, to ensure mutual learning and balanced actor-power relations in reflexive innovation.
Hinrichs and Johnston  assess two PASE exercises for future-oriented education and health governance taking place within a specifically designed workshop space (the decision theatre), aimed at fostering informed decision-making. Mediators facilitated discussions between scientists, policymakers, and the public, supported by the co-creation of boundary objects such as data-driven models, to stimulate complex systems thinking in order to imagine alternative futures.
Schroth et al.  describe a participatory agenda setting process aimed at integrating the needs of rural areas into research and innovation processes. Visions as outcomes of a participatory social foresight were translated into scenarios which were illustrated by speculative design artefacts, followed by a participatory needs assessment regarding technological innovations in three rural areas across Germany. The authors identify fields of action with opportunities to strengthen innovation, and describe how networks of local and national actors facilitated their integration into regional planning processes. They investigate both the effects and epistemic community and translation processes within PASE, and conclude that their effectiveness depends primarily on the translation and transference of results to relevant arenas as well as relevant networks and actors. Here, they describe the organisers of PASE as non-neutral actors who exercise agency when they translate and transfer issues into respective networks and agendas.
Gudowsky et al.  assess methods applied in a standardised trans-European citizen visioning process that elicited laypeople’s experiential and value-based knowledge, forming the base for EU research and innovation agenda setting. Setting out for methodological improvement, the authors discuss empirical results of participant evaluation questionnaire to explore potential loss and gain of diversity of opinions and creativity.
Fritz and Binder  discuss the dimensions of politics and power inherent to transdisciplinary sustainability research. Differentiating between instrumental, structural, and discursive power, the authors uncover how funding bodies, researchers, and practitioners exert power over participatory processes, and how this limits participation in STI governance.
Pagliarino et al.  critique the linear top-down model which has characterised agricultural innovation since the green revolution in which farmers are mainly recipients and users of technology, with this dependency resulting in a loss of much of the knowledge, experience and skills necessary for sustainable production. The authors describe the rise of agroecology as innovative paradigm in agriculture, which relies on participatory research and sustainability principles. The authors use ethnographic methods to analyse the learning and empowerment processes of a participatory research network consisting of farmers, scientists, public officials and managers of private companies who are concerned with organic rice production in Italy.
Balázs et al.  analyse data from a participatory research agenda setting process for green care services which employ nature in a therapeutic context to offer well-being and health-promoting activities. Examining outputs of a multi-step method of expert interviews and a science café setting, the authors conclude that a mutually responsive engagement of laypeople and experts can serve for successfully mapping societal concerns and knowledge needs in emerging research fields. Referring to the concept of “undone science” , the authors show that several research questions emerged during the PASE, which are largely ignored by health research.
Limits and benefits of PASE activities
This section presents results of the qualitative content analysis that examined and clustered factors influencing limits and benefits of the PASE activities that authors report in this topical collection. These are discussed in relation to the body of literature presented in the introduction.
Factors limiting successful PASE implementation
This topical collection’s contributions elaborate factors instrumental in limiting both the uptake of PASE results into the political arena as well as their impact, i.e. the organisers’ agency or normativity, unreflected power relations within or insufficient inclusiveness of the process, a lack of skills and resources as well as inadequate quality of the results. Furthermore, political appreciation of results and a will to implement democratic STI governance is a key limiting factor.
Whilst agency and normativity are tolerated, appreciated or even aimed for in stakeholder or other public engagement settings, the organisers’ potential normativity and agency within a certain topic are less transparently reflected on or even discussed. Organisers of PASE processes, who are often researchers, bear great responsibility when selecting the appropriate tools and methods applied in the respective exercise , and agency may influence these decisions. Here, Fritz and Binder  describe how the preselection of issues and rules governing the processes has an effect on the inclusion of values and knowledge, and call for increased reflexivity and transparency concerning mechanisms which may have been omitted. Additionally, Schroth et al.  reflect on PASE organisers’ non-neutrality in exercising agency when they are translating and transferring issues into respective networks and agendas. For this reason, amongst others, reflecting the field’s normativity, actors’ roles and trailing implications have recently experienced a revival in technology assessment [86, 87] and sustainability science , and remain an ongoing activity. Other fields that frequently act as organisers of agenda setting activities, e.g. foresight, or public actors such as non-governmental organisations (NGOs), may benefit from increased attention towards reflexivity and transparency of inherent normativity.
Focusing on power relations within PASE, Fritz and Binder  find that the ascription of roles within processes was shaped by the exercise of discursive power, which, in their cases, led to preserving traditional roles of users and producers of knowledge, then to knowledge co-creation. In relation, Abma  examines how the involvement of patients can “redress power imbalances in health research agenda setting”. Furthermore, the transference of a dominant actor’s power onto the process may lead to reproduction of an already dominant societal discourse or one that is politically desirable. To some extent, such settings emerge from conditions prescribed by the funding body of the PASE activity, resulting in limited accountability of the dominant groups . This argument is in line with Bora and Hausendorf  who critiqued participatory science governance, and Stilgoe et al.  who observed that outcomes may “not sufficiently challenge, and so serve to reinforce, incumbent power structures”. Here, Gudowsky et al.  conclude that “the impact of a participatory agenda setting activity on research and innovation governance needs to become transparently traceable”, as otherwise trust the commissioning institution suffers. This underlines the importance of several factors in procedural designs, which can limit coercive power through, e.g. participant recruitment, facilitator training or transparency of deliberations .
A selection bias towards elitist representations of futures leads to the aforementioned mechanism of rendering entire groups in the population to “not having futures” , with a direct link to the importance of recruitment in participatory settings and therefore also concerns about insufficient inclusiveness as a limiting factor for successful PASE activities. Balázs et al.  emphasise that it was mainly participants with a specific professional interest who took part in their study, which lead to biassed knowledge production, whilst Fritz and Binder  conclude that the agenda of the participatory setting affected the actor composition. Matschoss et al.  add that simultaneous reproduction of a PASE setting in various localities, supported by digital conflation, would have ensured better inclusiveness.
Whilst insufficient skills can also be a limiting factor, it has become apparent that successful implementation of PASE activities requires organisers and participants to have separate sets of skills. Inter- and transdisciplinary skills of participants are crucial, with scientists in need of acquiring profound expertise in very specific fields often lacking interdisciplinary perspective, whilst transdisciplinarity requires both researchers and other stakeholders to have a new set of practical and interpersonal skills . Clearly, organisers’ participatory skills play a major role, especially with regard to the co-creation of knowledge. Here, Schroth et al.  find that facilitating the adaptation and translation of issues and concepts for specific target audiences is a key step that should receive greater attention in multi-stage processes. Rosa et al.  support this and go further by stating that this adaptation of issues through “translation, comparison, categorisation, and combination” should be subject to close scrutiny, especially where different actor groups such as laypeople and experts are concerned. This shows that expert takeovers in citizen involvement processes can contribute to a loss of authenticity .
Resources in terms of availability of funding have been a much-discussed limiting factor in public engagement literature (e.g. [57, 90]. Public engagement activities, especially multi-stage PASE ones, need sufficient resources, and a lack thereof decreases process function, quality and ownership, and thus any impact. A comprehensive range of skills and resources is needed for the management of co-creation processes  which are often open-ended and therefore greatly dependent on the availability of financial resources . Dedicating time and space to the development of interaction is also contingent upon the availability of resources, and influences the development of relationships between groups, especially where competing agendas are supported and receive targeted attention and funding . Societal power relations, including inequalities, are reproduced within funding structures; consequently Fritz and Binder  note that demands for greater participation are irresponsible without respective adaptation of funding mechanisms. And it is not only the lack of financial resources alone that hampers successful co-creation in the STI context but also missing incentives and reward systems which allow researchers to engage in such activities “without the fear of losing in academic merits or career opportunities” .
Whilst all the abovementioned factors contribute to ineffectiveness, translation of PASE results into the policy realm remains a central challenge , for instance when aiming at inspiring a change in national funding schemes . Here, the initial positioning and rationality of participatory agenda setting activities within STI governance often only allows for a limited—if not marginal—influence on policy-making . This is however not a design fault made by organisers, but already inscribed into the funding schemes of such initiatives. And this leads to pondering over, again, the most important limiting factor: political appreciation of results and a will to implement democratic STI governance, emphasising the importance of both gatekeepers’ roles at the margins as well as central political actors.
Benefits of PASE
The analysis of all contributions of this topical collection suggests that PASE can contribute to enhanced reflexivity of research and innovation systems as well as participants; network building in diverse actor groups; mutual learning; co-creation; contextualisation of research with regard to local social and cultural specifics; science communication; increased responsiveness of science to society by translating societal needs and values into research agendas; and finally transformation when such research is carried out, providing new knowledge, resulting in actual change of practices.
Establishing and deepening networks between various actor groups can be a primary task of PASE activities, for instance when common concerns are addressed and mutual trust is built . However, network building can be a side-effect as well. Politically neutral boundary organisations can also foster the growth of networks between diverse social groups and therefore foster collaboration . This corresponds to Selin et al.  who discuss intra-personal relations in public engagement and conclude that building such networks contributes to the notion of capacity building, and should be seen as a major effect.
Alongside anticipation, inclusion and responsiveness, reflexivity is one of the main dimensions of the concept of RRI (Stilgoe, ), and defined as ability to reflect on values and beliefs during research and development . Enhancing reflexivity is an often-mentioned benefit of PASE activities. Balázs et al.  conclude that the examined PASE exercise created “reflection on and momentum for pressing research needs”. Diversifying stakeholder dialogues and enabling citizens to demonstrate greater agency enhances reflexive capacities . Stakeholders previously unknown to each other get the opportunity to interact on topics which affect them directly, discussing contradicting or competing viewpoints to explicitly highlight differences, and even partially overcome those . Whilst PE’s ability to enhance reflexivity is often discussed with a focus on science and scientists , these finding also show the important effect of enhancing reflexivity within participants, i.e. stakeholder communities. Pagliarino et al.  found that the room created for reflection had an emancipatory effect as it committed participants to “changing unsatisfactory and oppressive realities”.
The ability to build trust and enhance reflexivity in participants is a basis for mutual learning to take place within participatory processes. Here, mutual learning is built on a common understanding of an issue and a prerequisite for “meaningful deliberations” in participatory agenda setting . Creating a depoliticised space for deliberation lowered cultural barriers between stakeholder groups and facilitated mutual learning . Pagliarino et al.  describe how an “effective process of scientific and local knowledge sharing” took place within the agenda setting activities. Balázs et al. , too, observed mutual learning between “experts, practitioners and lay audiences on substantive research topics”. Several authors report that the use of boundary objects—data-driven or design-based—in terms of models, scenarios or artefacts as tools for facilitating dialogue was successful in establishing a common understanding of issues and partially shared meaning [80,81,82].
Enabling mutual learning and reflexivity lays the foundation for (knowledge) co-creation [93,94,95,96]. PASE activities show the possibility of harnessing diversity by combining a multiplicity of views emerging from a diverse group of participants  whilst negotiating knowledge between science, policy, and the public. Continuity of the process and face-to-face participation were procedural aspects identified to support co-creation: whilst a series of workshops provided a sense of stability for participants, who were thus able to build sequential lines of arguments , ongoing network activities over several years provided the necessary trust for sharing sensible data and practices which were then copied, adapted, and combined . Moreover, face-to-face encounters fostered prosocial behaviour, collaboration, and increased participation and innovative thinking . Whilst knowledge integration is uncontested, the authors nevertheless state that much less is known about “the how”, which is in line with previous findings regarding the often prevalent implicitness of knowledge on knowledge integration .
Contextualisation of research by fostering systems thinking is described as another benefit of PASE activities. For instance, Rosa et al.  highlight how citizens’ input into holistic, systemic and transdisciplinary research displays high embeddedness into local, cultural, and social context. Gudowsky et al.  describe that participatory agenda setting uncovers “alternative rationalities, values and realities that may serve as important counter-weights to state-of-the-art policy and its priorities and hence the business as usual”. Others such as Matschoss et al.  find that the respective PASE was successful in contextualising global sustainability issues by highlighting regional research needs. Hinrichs and Johnston  conclude that quadruple helix actors are increasingly engaged in systems thinking through mapping interrelated social systems influencing the respective research question or issue.
Whilst all PASE exercises explored in this topical collection had other primary aims, successful science communication was noted in some of the cases. Complex scientific issues were made accessible through the help of speculative objects and narrative futures framed towards the challenges faced by people in rural areas . Quantitative data, modelling and qualitative storytelling helped to make complex phenomena visible and understandable for public actors . Balázs et al.  describe how especially the creation of an open and informal platform supported the bridging of the science-society gap.
Increasing science’s responsiveness to society is a main pillar of RRI (Stilgoe, ) and a primary aim of most PASE activities since responsiveness can be reached, in terms of upstream engagement, by translating societal needs and values into research agendas [43, 71]. Providing spaces for co-creation and bringing together various actor groups allowed for the co-design of a future research agenda which focused on how to “solve real-life societal questions”, for instance by exploring emergency usages, behaviours and market opportunities based on societal and user needs . Others conclude that stakeholders’ active participation in a networked PASE activity was mainly the result of the fact that the activities’ content originated “from real needs and concrete research questions”, and that their personal attitudes and values were crucial to the process . Schroth et al.  state that “challenges of the investigated rural areas were translated into political and scientific problems”, delivering a product that can be integrated into national research and local development agendas. Referring to the concept of “undone science” , Balázs et al.  show that several research questions emerged during the PASE, which were previously largely ignored by health research, whilst Matschoss et al.  state that the PASE lead to the “inclusion of important societal topics that may otherwise have been neglected by researchers”.
Finally, it has been described that PASE activities have transformative capacities, e.g. when new knowledge is gained by solving the co-created research topics, which is then put into practice, or by changing ideas and believes or paradigms. PASE activities, for instance in form of horizon scanning with participatory elements as established in foresight, can focus attention on emerging technologies and breakthroughs as well as emerging challenges and questions outside the present scope of the major scientific establishment on research agendas.
“In combination with anticipation and reflection, responsiveness can become a transformative ingredient of ‘responsibilisation’ of actors and institutions in R&I systems” . Here, Pagliarino et al.  describe how agronomic techniques in organic farming have been improved, yields stabilised and increased, and actual discoveries made, for example the allelopathic function of certain species used as cover crop. Furthermore, a change of science governance itself is carried out by successfully implementing PASE activities or even by carrying out experiments towards that goal. Hinrichs and Johnston  conclude that refined PASE “can support the development of governance infrastructures that maintain inclusion and accountability of the public in the decision-making process”, whilst Balázs et al.  state that a better alignment “with societal values and demands is essential to gaining more democratic legitimacy, beyond expert- or technology-driven processes”.
This introduction builds upon the call for papers for this topical collection written by the author: https://eujournalfuturesresearch.springeropen.com/pase
There are four global, highly structured patient and public engagement planning activities: the James Lind Alliance Priority Setting Partnerships (UK), Dialogue Method (Netherlands), Global Evidence Mapping (Australia), and the Deep Inclusion Method/CHoosing All Together (US) .
Participatory agenda setting
Research and innovation
Responsible research and innovation
Science, technology and innovation
Boden M, Johnston R, Scapolo F (2012) The role of FTA in responding to grand challenges: a new approach for STI policy? Sci Public Policy 39(2):135–139. https://doi.org/10.1093/scipol/scs026
EuropeanCommission. (2016). “Societal challenges.” https://ec.europa.eu/programmes/horizon2020/en/h2020-section/societal-challenges.
Georghiou L, Cassingena Harper J (2011) From priority-setting to articulation of demand: foresight for research and innovation policy and strategy. Futures 43(3):243–251. https://doi.org/10.1016/j.futures.2010.11.003
Bammer G, O’Rourke M, O’Connell D, Neuhauser L, Midgley G, Klein JT, Grigg NJ, Gadlin H, Elsum IR, Bursztyn M, Fulton EA, Pohl C, Smithson M, Vilsmaier U, Bergmann M, Jaeger J, Merkx F, Vienni Baptista B, Burgman MA, Walker DH, Young J, Bradbury H, Crawford L, Haryanto B, Pachanee C-a, Polk M, Richardson GP (2020) Expertise in research integration and implementation for tackling complex problems: when is it needed, where can it be found and how can it be strengthened? Palgrave Commun 6(1):5. https://doi.org/10.1057/s41599-019-0380-0
Hirsch-Hadorn G, Pohl C (2007) Principles for designing transdisciplinary research. oekom verlag, München
Wynne B (1993) Public uptake of science: a case for institutional reflexivity. Public Underst Sci 2(4):321–337. https://doi.org/10.1088/0963-6625/2/4/003
Stilgoe J, Owen R, Macnaghten P (2013) Developing a framework for responsible innovation. Res Policy 42(9):1568–1580. https://doi.org/10.1016/j.respol.2013.05.008
Abels G, Bora A (2016) Ethics and public participation in technology assessment
Grunwald A (2018) Technology assessment in practice and theory. Routledge. https://doi.org/10.4324/9780429442643
Amanatidou E, Butter M, Carabias V, Konnola T, Leis M, Saritas O, Schaper-Rinkel P, van Rij V (2012) On concepts and methods in horizon scanning: lessons from initiating policy dialogues on emerging issues. Sci Public Policy 39(2):208–221. https://doi.org/10.1093/scipol/scs017
Brummer V, Könnölä T, Salo A (2008) Foresight within ERA-NETs: experiences from the preparation of an international research program. Technol Forecast Soc Chang 75(4):483–495. https://doi.org/10.1016/j.techfore.2008.02.005
Ravetz J, Popper R, Miles I (2011) Applications of wild cards and weak signals to the grand challenges & thematic priorities of the European Research Area (ERA Toolkit)
van Rij V (2010) Joint horizon scanning: identifying common strategic choices and questions for knowledge. Sci Public Policy 37(1):7–18
Burget M, Bardone E, Pedaste M (2017) Definitions and conceptual dimensions of responsible research and innovation: a literature review. Sci Eng Ethics 23(1):1–19. https://doi.org/10.1007/s11948-016-9782-1
van Oost E, Kuhlmann S, Ordóñez-Matamoros G, Stegmaier P (2016) Futures of science with and for society: towards transformative policy orientations. Foresight 18(3):276–296. https://doi.org/10.1108/FS-10-2014-0063
Schuijff M, Dijkstra AM (2020) Practices of responsible research and innovation: a review. Sci Eng Ethics 26(2):533–574. https://doi.org/10.1007/s11948-019-00167-3
Weber KM, Amanatidou E, Erdmann L, Nieminen M (2016) Research and innovation futures: exploring new ways of doing and organizing knowledge creation. Foresight 18(3):193–203. https://doi.org/10.1108/FS-04-2016-0017
Etzkowitz H, Leydesdorff L (1995) The triple helix -- university-industry-government relations: a laboratory for knowledge based economic development. EASST Rev 14(1):14–19
Carayannis EG, Campbell DFJ (2010) Triple helix, quadruple helix and quintuple helix and how do knowledge, innovation and the environment relate to each other? : a proposed framework for a trans-disciplinary analysis of sustainable development and social ecology. Int J Soc Ecol Sustain Dev 1(1):41–69. https://doi.org/10.4018/jsesd.2010010105
Miller K, McAdam R, McAdam M (2018b) A systematic literature review of university technology transfer from a quadruple helix perspective: toward a research agenda. R&D Manag 48(1):7–24. https://doi.org/10.1111/radm.12228
Carayannis EG, Barth TD, Campbell DFJ (2012) The Quintuple Helix innovation model: global warming as a challenge and driver for innovation. J Innov Entrep 1(1):2. https://doi.org/10.1186/2192-5372-1-2
Bauer MW, Allum N, Miller S (2007) What can we learn from 25 years of PUS survey research? Liberating and expanding the agenda. Public Underst Sci 16(1):79–95. https://doi.org/10.1177/0963662506071287
Wynne B (1996) In: Lash S, Szerszynski B, Wynne B (eds) May the sheep safely graze? a reflexive view of the expert-lay knowledge divide. Risk, environment and modernity: towards a new ecology. SAGE Publications Ltd, London, pp 44–83
Lash S, Beck U, Giddens A (1994) Reflexive modernization: politics, tradition and aesthetics in the modern social order. Stanford University Press, Stanford
Jasanoff S (2003) Technologies of humility: citizen participation in governing science. Minerva 41(3):223–244. https://doi.org/10.1023/A:1025557512320
Gibbons M, Limoges C, Nowotny H, Schwartzman S, Scott P, Trow M (1994) The new production of knowledge: the dynamics of science and research in contemporary societies. Sage, London
Sturgis P, Allum N (2004) Science in society: re-evaluating the deficit model of public attitudes. Public Underst Sci 13(1):55–74. https://doi.org/10.1177/0963662504042690
Ravetz JR (2011) Postnormal science and the maturing of the structural contradictions of modern European science. Futures 43(2):142–148. https://doi.org/10.1016/j.futures.2010.10.002
Bogner A (2011) The paradox of participation experiments. Sci Technol Hum Values 37(5):506–527
Krzywoszynska A, Matt W, Buckley A, Chiles P, Gregson N, Holmes H, Mawyin J (2018) Opening up the participation laboratory: the cocreation of publics and futures in upstream participation. Sci Technol Hum Values 43(5):785–809. https://doi.org/10.1177/0162243917752865
Stilgoe J, Lock SJ, Wilsdon J (2014) Why should we promote public engagement with science? Public Underst Sci 23(1):4–15. https://doi.org/10.1177/0963662513518154
Conceição CP, Ávila P, Coelho AR, Costa AF (2019) European action plans for science–society relations: changing buzzwords, changing the agenda. Minerva.
Boussaguet L (2015) Participatory mechanisms as symbolic policy instruments? Comp Eur Politics 14(1):107–124
Selin C, Rawlings KC, de Ridder-Vignone K, Sadowski J, Altamirano Allende C, Gano G, Davies SR, Guston DH (2016) Experiments in engagement: designing public engagement with science and technology for capacity building. Public Underst Sci 26(6):634–649. https://doi.org/10.1177/0963662515620970
Lee CW (2014) Do-it-yourself democracy: the rise of the public engagement industry. Oxford University Press. https://doi.org/10.1093/acprof:oso/9780199987269.001.0001
Chilvers JE, Kearnes ME (2016) Remaking participation. Routledge, London
Curato N, Dryzek JS, Ercan SA, Hendriks CM, Niemeyer S (2017) Twelve key findings in deliberative democracy research. Daedalus 146(3):28–38. https://doi.org/10.1162/DAED_a_00444
Rowe G, Frewer LJ (2005) A typology of public engagement mechanisms. Sci Technol Hum Values 30(2):251–290. https://doi.org/10.1177/0162243904271724
Manafò E, Petermann L, Vandall-Walker V, Mason-Lai P (2018) Patient and public engagement in priority setting: a systematic rapid review of the literature. PLoS ONE 13(3):e0193579. https://doi.org/10.1371/journal.pone.0193579
Gastil J (2017) In: Jamieson KH, Kahan DM, Scheufele DA (eds) Designing public deliberation at the intersection of science and public policy. Oxford University Press
Bora A, Hausendorf H (2006) Participatory science governance revisited: normative expectations versus empirical evidence. Sci Public Policy 33(7):478–488. https://doi.org/10.3152/147154306781778740
Rask M (2013) The tragedy of citizen deliberation – two cases of participatory technology assessment. Tech Anal Strat Manag 25(1):39–55. https://doi.org/10.1080/09537325.2012.751012
Gudowsky N, Sotoudeh M (2017) Into blue skies—a transdisciplinary foresight and co-creation method for adding robustness to visioneering. NanoEthics 11(1):93–106. https://doi.org/10.1007/s11569-017-0284-7
Krabbenborg L, Mulder HAJ (2015) Upstream public engagement in nanotechnology. Sci Commun 37(4):452–484. https://doi.org/10.1177/1075547015588601
Wang X (2015) Revisiting “Upstream Public Engagement”: from a Habermasian Perspective. NanoEthics 10(1):63–74
Wilsdon, J. and R. Willis (2004). See-through science: why public engagement needs to move upstream.
Abma TA, Pittens CACM, Visse M, Elberse JE, Broerse JEW (2015) Patient involvement in research programming and implementation. Health Expect 18(6):2449–2464. https://doi.org/10.1111/hex.12213
Schölvinck A-FM, Pittens CACM, Broerse JEW (2020) Patient involvement in agenda-setting processes in health research policy: a boundary work perspective. Science and Public Policy
Pratt B, Merritt M, Hyder AA (2016) Towards deep inclusion for equity-oriented health research priority-setting: a working model. Soc Sci Med 151:215–224. https://doi.org/10.1016/j.socscimed.2016.01.018
O’Donnell M, Entwistle V (2004) Consumer involvement in decisions about what health-related research is funded. Health Policy 70(3):281–290. https://doi.org/10.1016/j.healthpol.2004.04.004
Rowe G, Rawsthorne D, Scarpello T, Dainty JR (2009) Public engagement in research funding: a study of public capabilities and engagement methodology. Public Underst Sci 19(2):225–239
Smith C (2014) Public engagement in prioritizing research proposals: a case study. SAGE Open 4(1):2158244014523791
Abma TA (2018) Dialogue and deliberation: new approaches to including patients in setting health and healthcare research agendas. Action Res 17(4):429–450
Miller FA, Patton SJ, Dobrow M, Berta W (2018a) Public involvement in health research systems: a governance framework. Health Res Policy Syst 16(1):79. https://doi.org/10.1186/s12961-018-0352-7
Mitton C, Smith N, Peacock S, Evoy B, Abelson J (2009) Public participation in health care priority setting: a scoping review. Health Policy 91(3):219–228. https://doi.org/10.1016/j.healthpol.2009.01.005
Frickel S, Gibbon S, Howard J, Kempner J, Ottinger G, Hess DJ (2009) Undone science: charting social movement and civil society challenges to research agenda setting. Sci Technol Hum Values 35(4):444–473
Devonshire IM, Hathway GJ (2014) Overcoming the barriers to greater public engagement. PLoS Biol 12(1):e1001761. https://doi.org/10.1371/journal.pbio.1001761
Grunwald A, Hocke P (2010) In: Kaiser M, Kurath M, Maasen S, Rehmann-Sutter C (eds) The risk debate on nanoparticles: contribution to a normalisation of the science/society relationship? Governing future technologies: nanotechnology and the rise of an assessment regime. Springer Netherlands, Dordrecht, pp 157–177
Durán JM, Pirtle Z (2020) Epistemic standards for participatory technology assessment: suggestions based upon well-ordered science. Sci Eng Ethics 26(3):1709–1741. https://doi.org/10.1007/s11948-020-00211-7
Peter M, Diekötter T, Kremer K (2019) Participant outcomes of biodiversity citizen science projects: a systematic literature review. Sustainability 11(10). https://doi.org/10.3390/su11102780
Woolley JP, McGowan ML, Teare HJA, Coathup V, Fishman JR, Settersten RA, Sterckx S, Kaye J, Juengst ET (2016) Citizen science or scientific citizenship? Disentangling the uses of public engagement rhetoric in national research initiatives. BMC Med Ethics 17(1):33. https://doi.org/10.1186/s12910-016-0117-1
Turbé A, Barba J, Pelacho M, Mugdal S, Robinson LD, Serrano-Sanz F, Sanz F, Tsinaraki C, Rubio J-M, Schade S (2019) Understanding the citizen science landscape for European environmental policy: an assessment and recommendations. Citiz Sci 4(1)
Haegeman K, Spiesberger M, Könnölä T (2017) Evaluating foresight in transnational research programming. Technol Forecast Soc Chang 115:313–326. https://doi.org/10.1016/j.techfore.2016.07.017
Könnöla T, Haegeman K (2012) Embedding foresight in transnational research programming. Sci Public Policy 39(2):191–207. https://doi.org/10.1093/scipol/scs020
Lakomý M, Hlavová R, Machackova H (2019) Open science and the science-society relationship. Society 56(3):246–255. https://doi.org/10.1007/s12115-019-00361-w
Sand M (2019) On “not having a future”. Futures 107:98–106. https://doi.org/10.1016/j.futures.2019.01.002
Nikolova B (2013) The rise and promise of participatory foresight. Eur J Futur Res 2(1)
Joss S, Bellucci S (2002) Participatory technology assessment – European perspectives. University of Westminster, London
Grunwald A (2019) The inherently democratic nature of technology assessment. Sci Public Policy 46(5):702–709. https://doi.org/10.1093/scipol/scz023
OECD (2017). “Open research agenda setting.”
Gudowsky N, Peissl W (2016) Human centred science and technology—transdisciplinary foresight and co-creation as tools for active needs-based innovation governance. Eur J Futur Res 4(1). https://doi.org/10.1007/s40309-016-0090-4
Jacobi A, Klüver L, Rask M (2010) Relevant research in a knowledge democracy: citizens’ participation in defining research agendas for Europe. Knowledge Democracy. R. J. i. t. Veld. Berlin Heidelberg Springer-Verlag, pp 87–98
Rosa A, Gudowsky N, Warnke P (2018) But do they deliver? Participatory agenda setting on the test bed. Eur J Futur Res 6(1). https://doi.org/10.1186/s40309-018-0143-y
Gudowsky N, Bechtold U, Peissl W, Sotoudeh M (2021) Democratising utopian thought for research and innovation. Eur J Futur Res
Gudowsky N, Sotoudeh M, Bechtold U, Peissl W (2017) Contributing to an European imaginary of democratic education by engaging multiple actors in shaping responsible research agendas. Special Issue ‘Participatory Methods for Information Society’. Public Philos Democ Edu 5(2):29–50
Mayring P (2014) Qualitative content analysis: theoretical foundation, basic procedures and software solution. Klagenfurt
Hsieh H-F, Shannon SE (2005) Three approaches to qualitative content analysis. Qual Health Res 15(9):1277–1288. https://doi.org/10.1177/1049732305276687
Strauss A, Corbin JM (1990) Basics of qualitative research: grounded theory procedures and techniques. Sage Publications, Inc., Thousand Oaks
Matschoss K, Pietilä M, Rask M, Suni T (2020) Co-creating transdisciplinary global change research agendas in Finland. Eur J Futur Res 8(1):2. https://doi.org/10.1186/s40309-020-0162-3
Rosa AB, Kimpeler S, Schirrmeister E, Warnke P (2021b) Participatory foresight and reflexive innovation: setting policy goals and developing strategies in a bottom-up, mission-oriented, sustainable way. Eur J Futur Res 9(1):2. https://doi.org/10.1186/s40309-021-00171-6
Hinrichs MM, Johnston EW (2020) The creation of inclusive governance infrastructures through participatory agenda-setting. Eur J Futur Res 8(1):10. https://doi.org/10.1186/s40309-020-00169-6
Schroth F, Glatte H, Kaiser S, Heidingsfelder M (2020) Participatory agenda setting as a process — of people, ambassadors and translation: a case study of participatory agenda setting in rural areas. Eur J Futur Res 8(1):6. https://doi.org/10.1186/s40309-020-00165-w
Fritz L, Binder CR (2020) Whose knowledge, whose values? An empirical analysis of power in transdisciplinary sustainability research. Eur J Futur Res 8(1):3. https://doi.org/10.1186/s40309-020-0161-4
Pagliarino E, Orlando F, Vaglia V, Rolfo S, Bocchi S (2020) Participatory research for sustainable agriculture: the case of the Italian agroecological rice network. Eur J Futur Res 8(1):7. https://doi.org/10.1186/s40309-020-00166-9
Balázs B, Horváth J, Pataki G (2020) Science-society dialogue from the start: participatory research agenda-setting by Science Cafés. Eur J Futur Res 8(1):5. https://doi.org/10.1186/s40309-020-00164-x
Bauer A, Kastenhofer K (2019) Policy advice in technology assessment: shifting roles, principles and boundaries. Technol Forecast Soc Chang 139:32–41. https://doi.org/10.1016/j.techfore.2018.06.023
Nierling L, Torgersen H (2020) Die neutrale Normativität der Technikfolgenabschätzung: Konzeptionelle Auseinandersetzung und praktischer Umgang, Baden-Baden. Nomos Verlagsgesellschaft mbH & Co, KG. https://doi.org/10.5771/9783748907275
Wittmayer JM, Schäpke N (2014) Action, research and participation: roles of researchers in sustainability transitions. Sustain Sci 9(4):483–496. https://doi.org/10.1007/s11625-014-0258-4
Repo P, Matschoss K (2019) Considering expert takeovers in citizen involvement processes. J Res Innov 6(2):119–142. https://doi.org/10.1080/23299460.2019.1568145
Lang DJ, Wiek A, Bergmann M, Stauffacher M, Martens P, Moll P, Swilling M, Thomas CJ (2012) Transdisciplinary research in sustainability science: practice, principles, and challenges. Sustain Sci 7(S1):25–43. https://doi.org/10.1007/s11625-011-0149-x
Owen R, Stilgoe J, Macnaghten P, Gorman M, Fisher E, Guston D (2013) A framework for responsible innovation. Resp Innov:27–50. https://doi.org/10.1002/9781118551424.ch2
Salmon RA, Priestley RK, Goven J (2017) The reflexive scientist: an approach to transforming public engagement. J Environ Stud Sci 7(1):53–68. https://doi.org/10.1007/s13412-015-0274-4
Regeer B, Bunders J (2009) Knowledge co-creation: interaction between science and society. A transdisciplinary approach to complex societal issues. Den Haag, RMNO (Advisory Council for Spatial Planning, Nature and the Environment)
Sotoudeh M, Gudowsky N (2018) Participatory foresight for technology assessment - towards an evaluation approach for knowledge co-creation. TATuP – Zeitschrift für Technikfolgenabschätzung in Theorie und Praxis 27(2):53–59. https://doi.org/10.14512/tatup.27.2.53
van Veen S, Bunders J, Regeer B (2013) Mutual learning for knowledge co-creation about disability inclusive development: experiences with a community of practice. Knowl Manag Dev J 9(2):105–124
Voorberg WH, Bekkers VJJM, Tummers LG (2014) A systematic review of co-creation and co-production: embarking on the social innovation journey. Public Manag Rev 17(9):1333–1357
Availability data and materials
Supporting data can be found in the annex of the manuscript.
Ethics approval and consent to participate
Consent for publication
The author declares that he has no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Gudowsky, N. Limits and benefits of participatory agenda setting for research and innovation. Eur J Futures Res 9, 8 (2021). https://doi.org/10.1186/s40309-021-00177-0
- Participatory agenda setting
- Research and innovation governance
- responsible research and innovation