Abstract
In this chapter, Implementation; Ethical Aspects, Validation, and Testing of Complex Societal Methodologies, the discussion about the use of the Compram methodology will continue with four issues:
-
Possible opposition against implementation of large technological projects
-
Ethical aspects of the Compram methodology
-
External, internal, boundary, and report validation of research of complex societal problems
-
Scientific testing of methodologies of societal complexity.
The cases of the high-speed railway, the expansion of Schiphol airport, and the floods of Dutch rivers will be addressed to illustrate the Theory of the Methodology of Societal Complexity.
This Chapter, Implementation; Ethical Aspects, Validation and Testing of Complex Societal Methodologies, is based on the articles. DeTombe (2000a, b, c); DeTombe (2001h); DeTombe (2003e); DeTombe (2008a, c); DeTombe (2010).
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
HSL is an abbreviation of Hoge Snelheids Lijn (high-speed railway).
- 2.
The plans for creating this line were already mentioned in 1968 (Jansen 1972). As of 2014 this subway line has not been completed.
- 3.
In 1972 Siemens (Germany, The Netherlands, and France) was given by the German government the commission to build a nuclear power plant in Germany, because Germany wanted to decrease its energy import. The fast breeder nuclear reactor SNR-300 in Gorleben (North Rhine-Westphalia) was finished in 1985. The project cost 3.5 billion Euros. However, already during the development of this nuclear power plant a huge societal protest was started because of the safety-threatening elements of the nuclear power plant. The opposition was successful; therefore the power plant was never taken into use. After one decade of waiting the plant was sold in 1995 for about 2.5 million Euros and turned into an amusement park called Corewater Wonderland (Wikipedia).
- 4.
- 5.
A steering instrument is a political power instrument, such as a law.
- 6.
Formal power refers to official letters and replies; informal power refers to discussions outside the official meetings.
- 7.
The concept of self-steering is a central concept of the Theory of Socio-Cybernetics. It points to the fact that an actor is a self-organizing identity and able on its own initiative to react and to decide what kind of reaction he/she will give (see also DeTombe and VanDijkum 1998).
- 8.
Remember the fairytale of Sleeping Beauty in which the fairy, who was not invited to the birth celebration of the princes, was so angry that she wished the child to die (Grimm 1812).
- 9.
This could be seen in the high-speed railway project in The Netherlands (HSL project) where some local governments wanted the railway link to be connected with their city.
- 10.
The Netherlands implemented cruise missiles with nuclear power elements at the military base Woensdrecht in the 1970s. In spite of the large societal demonstrations against it in the 1980s these missiles are still there.
- 11.
Gorleben is a small town in Germany, where the nuclear power plant Kalkar was built.
- 12.
See, for instance, the ecological lobby, which started with a small group of highly engaged people fighting against pollution.
- 13.
Support groups are groups that support the person who is directly involved in the problem handling process with providing knowledge and advice (see Chap. 7).
- 14.
The Betuwe is a beautiful landscape area in the middle of The Netherlands between the two large rivers Rhine and Meuse. Here fruit trees grow in green orchards and cows and sheep graze in the meadows.
- 15.
See also Chap. 9.
- 16.
Mintzberg (1983, p. 4) defines power in organizations as the capacity to effect and affect organizational outcomes. In relation to large technological projects power can be defined as the way an actor effects and affects the outcome of a project.
- 17.
The costs for Shell for dismantling the platform have grown to more than 23 million US dollars. Shell defends the high costs pointing to the importance for Shell to discuss this issue with society.
- 18.
These last two projects are stopped because of too much opposition and other objections.
- 19.
See also Chap. 14.
- 20.
See Fig. 4.1.
- 21.
See Fig. 11.3: The Netherlands above and under sea level.
- 22.
The amount of water the river has to carry can be as high as 12,000 m3/s, which means 12,000 l water per second. It is the amount of water versus the speed, which, when the water level is too high or the water comes too fast, creates the floods.
- 23.
In The Netherlands all along the river Rhine and Meuse the land near the rivers is protected by dikes.
- 24.
Fortunately there was only economic damage.
- 25.
This was a clear example of privatizing the benefits and socializing the debts of a complex societal problem.
- 26.
Translated this means: Give the rivers more space.
- 27.
Translated this means: A combined search at the last track of the rivers.
- 28.
In Dutch also known as “Calamiteiten plan.”
- 29.
A polder is a former lake that has been artificially dried. Because the area is so low the water has to be pushed out constantly by pumping stations. This used to be operated by windmills.
- 30.
These plans are called “Ruimte voor de rivier” (Give the rivers more space), “Advies Ruimte voor de Rivieren” (Advise about giving the rivers more space), and “Advies Integrale Verkenning Beneden Rivieren” (Advise on a combined search of the last track of the rivers) (Ministerie van Verkeer en Waterstaat 2000; Bestuurlijke Begeleidingsgroep Ruimte voor Rijntakken 2000; Bestuurlijke Begeleidingsgroep Integrale Verkenning Benedenrivieren 2000).
- 31.
- 32.
See for a further discussion of the Schiphol case Sect. 13.24.1.
- 33.
In 1973 the Dutch government addressed the possibility of making a high-speed direction from Amsterdam to Brussels and Paris. The project started in 1988, and the implementation started in 2000. In 2009 the first track to Anvers was ready. However, until now the project is not successfully completed (Derix and De Groot (2013).
- 34.
A high-speed railway system was planned as a fast train connection between Amsterdam (Schiphol airport) and Paris as a part of the European high-speed railway connection (the HSL, High-Speed line (Dutch: Hoge Snelheids Lijn)). This plan provoked much discussion and opposition, which increased the cost enormously. In 2014 the interventions of the plan are still not fully implemented.
- 35.
CEO is an abbreviation of chief executive officer.
- 36.
- 37.
In 1991 the “First Iraq war” (The Persian Gulf War) was started by the Bush senior Administration and in 2003 the Second Iraq War was started by the Bush junior Administration.
- 38.
NSA stands for National Security Agency. The NSA is one of the secret services of the USA.
- 39.
NRC Handelsblad 2013.
- 40.
See also Chap. 10.
- 41.
Introduced in Kant’s 1785 Groundwork of the Metaphysic of Morals , it may be defined as a way of evaluating motivations for action also referred to as Foundations of the Metaphysics of Morals, Grounding of the Metaphysics of Morals, and the Grounding for the Metaphysics of Morals (Wikipedia). Freely interpreted: what you do not want others do to you, do not do that to others.
- 42.
War is the main cause of the famine and immigrant problems such as in Africa, and in this way also partly responsible for the HIV/Aids problem.
- 43.
- 44.
An example is the politically vulnerable question of gas drilling in an environmentally highly valued part of the Dutch North Sea, the Waddenzee, a UNESCO world heritage site from 2009 on, in which many birds, fishes, and seals live in peaceful coexistence. Before the government could give an answer in this long-lasting debate it wanted the opinion of experts on the question: “Does, or does not, the drilling harm the environment?” (NRC Handelsblad, November 1999).
- 45.
Socially burning questions are different from the societal demands for research. Societal demands for research are translated into helping the government or large organizations to do their research. Research money for socially burning questions like healthcare problems for women and the elderly or child abuse is often lacking or extremely meager.
- 46.
Validity refers to external and internal validity (Swanborn 1987, p. 189). The difference between external and internal validity comes from experimental psychology.
- 47.
- 48.
I.Q. is intelligence quotient.
- 49.
Not always the distinction between internal and external validity is made. In some textbooks on methodology the differentiation is not made (see ‘t Hart et al. (1996)).
- 50.
Remember the cautionary tale of storks and numbers of babies born. There is no causal relation between the amount of storks and the number of babies born.
- 51.
In Dutch: enquete commissie.
- 52.
The AMC is the Amsterdam Medical Center, which is the academic hospital of the University of Amsterdam.
- 53.
In the Bijlmermeer there live many Afro-Caribbean people.
- 54.
We also reflect on the Schiphol Case in Sect. 13.3, 13.24.1, and 13.26.
- 55.
Three departments of the government were fighting over this issue. The Department of Transport, Public Works and Water Management, in charge of transport, infrastructure, and water management, wanted to expand Schiphol. The Department of Housing responsible for building houses, town and country planning, and environmental issues was strongly against expanding Schiphol and wanted to build houses in this area instead. The Department of Economy wanted an expansion of the airport (Spanjerberg and Pe 1998; DeTombe 2013c).
- 56.
- 57.
See Chap. 8.
- 58.
- 59.
Similar things can be said about the floods of the Saint Lawrence river that wanders at the border between the USA and Canada.
- 60.
When the answer is yes the report is valid.
- 61.
When the answer is yes the report is invalid.
- 62.
The Schiphol Case is described in Sects. 13.13, 13.24.1, and 13.26.
- 63.
The Roman Catholic Church asked a former minister and mayor of a large town in The Netherlands, W. Deetman, to investigate sexual abuse of children by their clergymen (see Deetman et al. 2011a, b). This was also the case in Germany where a research commission was given to a similar kind of person, also a (former) governmental high civil servant (see Die Zeit 2013). By giving the commission of the research to these people the impression was made that the research was going to be carried out by a neutral person from outside, actually by the government. However, both research groups which received the commission were assigned and paid by the Roman Catholic Church, the object of research itself (DeTombe 2014a).
- 64.
See discussion generated by DeKwaadsteniet on the presentation of the research results in the report of the RIVM (Rijksinstituut voor Volksgezondheid (Governmental Institute for Healthcare)). The description of the results gave the impression that these results are certain instead a possible outcome (De Trouw 1999). The uncertainty, inherent of these processes, was not included in the report.
- 65.
- 66.
See Chap. 7.
- 67.
See also this Sect. 13.20.1.
- 68.
See the cases of HSL (High-Speed train Line—Hoge Snelheids Lijn) line (Tweede Kamer der Staten Generaal, 1991) and the expansion of Schiphol airport and the opposition against flooding the Hedwige Polder (Vermeer 2012).
- 69.
See Chap. 7 for more hypotheses about the Compram methodology.
- 70.
Many expensive additional tunnels were needed to save the landscape view (DeTombe 1997f).
- 71.
We have given here just one example. In order to confirm the hypotheses more examples should follow.
- 72.
Gökmen, Sinan, Weber, Gökmen, Ecevit, Sürmeli, Bali, Ecevit, Gökmen, and DeTombe (2004).
- 73.
JST-RISTEX see Chap. 14.
References
Allaraj, M., & Lind-Braucher, S. (2013). Demand dynamics of construction materials in Europe – Lessons learned: Combination of resource and knowledge management as a contribution to successful decision making and investment plans. In Leopold-Wildburger, U., Dargam, F., Pickl, S., DeTombe, D. J., Pla, L, Liu, S., Hernandez, J., Delibasic, B., Ribeiro, R. & Zarate, P. (Eds.), Collaborative decision systems in Economics and in Complex Societal and Environmental Applications. Proceedings of the EURO Mini-Conference Graz-2013 (p. 42). Graz: EURO.
AMC Report. (1998). Derde Tussenrapport Gezondheidsklachten Bijlmerramp (AMC is Amsterdam Medical Center) (The third report on health complains of the Bijlmermeer disaster).
Bestuurlijke Begeleidingsgroep Integrale Verkenning Benedenrivieren. (2000). Advies Integrale Verkenning Beneden Rivieren. Vergroting van de afvoercapaciteit in de benedenloop van Rijn en Maas. Bestuurlijk advies aangeboden aan de staatssecretaris van Verkeer en Waterstaat (Advise for the Department of Public Works on the Water Dranaige Capacity of the River Estuaries). Rotterdam: Rijkswaterstaat.
Bestuurlijke Begeleidingsgroep Ruimte voor Rijntakken. (2000). Advies Ruimte voor Rijntakken. (Advise for the Department of Public Works about giving the branches of the Rhine river more space). Arnhem: Rijkswaterstaat.
Blokker, B. (2014, January 16). Ineens is er weer veel lawaai in the lucht (Suddenly there is much noise in the air, p. 8). Amsterdam: NRC Handelsblad.
Blokker, B., & Vermeer O. (2014, January 22). En weer is er onrust over Schiphol (Again there is turmoil about Schiphol, p. 4). Amsterdam: NRC Handelsblad.
Boskma, A. F., & Herweijer, M. (1988). Beleidseffectiviteit en case-studies: Een vergelijking van verschilllende onderzoeksontwerpen. Beleidswetenschap, 2, 52–69.
Bulz, N. (2013). Contemporary Natural and Artificial Biodiversity set of problems and COMPRAM method. In D. DeTombe (Ed.), Book of abstracts of the 26th European Conference on Operational Research Rome 2013 Euro Working Group Methodology of Societal Complexity (Vol. 26). Greenhill & Waterfront, Europe, The Netherlands, Amsterdam; UK, Guilford; North-America, Canada, Montreal.
Groot, de, A. D. (1969). Methodologie: Grondslagen van onderzoek en denken in de gedragswetenschappen. Den Haag: Mouton.
De Trouw. (1999, Winter). RIVM discussion generated by DeKwaadsteniet.
De Volkskrant. (1993, December 23). Wateroverlast rivieren breid zich verder uit (p.1). Amsterdam: De Volkskrant.
Deetman, W., Draijer, N., Kalbfleisch, P., Merckelbach, H., Monteiro, M., & de Vries, G. (2011a). Seksueel misbruik van minderjarigen in de Rooms - Katholieke Kerk. Amsterdam: Uitgeverij Balans, Eindrapport.
Deetman, W., N. Draijer, P. Kalbfleisch, H. Merckelbach, M. Monteiro & G. de Vries. (2011b). Seksueel misbruik van minderjarigen in de Rooms - Katholieke Kerk. Amsterdam: Uitgeverij Balans, ISBN 978 94 600 3362 9 Handelseditie.
Derix, S., & Groot, de, D. (2013, August 24). De Beneluxlijn is de stoplap voor de mislukte hsl. (The Beneluxlijn is the stopgap for the failing of the HSL). Amsterdam: NRC Handelsblad.
DeTombe, D. J. (1989a). Ontwikkelingsfasen in educatieve software. In J. Klep, & P. Kommers (red.) Courseware en leerplanontwikkeling, Symposium Didactische Systeemanalyse, Studies in leerplanontwikkeling, 14 (pp. 313–329). Enschede: SLO, (published as Tombe de, D. J.).
DeTombe, D. J. (1992d). Chaos en epidemiologische scenarios: Het aids scenario. Onzekerheden in de voorspelling van de Aids epidemie (Dutch, pp. 126–137). In C. vanDijkum, & D. J. de Tombe (red.), Gamma Chaos. Onzekerheid en orde in de menswetenschappen. Bloemendaal: Aramith uitgevers. ISBN 90-68341057.
DeTombe, D. J. (1993e). Setting complex domain extended problems. In K. Nowak (Ed.), School of Simulation and Gaming, proceedings 1990. Krakow: Academy of Economics, Statistics and Informatics.
DeTombe, D. J. (1994). Defining Complex Interdisciplinary Societal Problems. A Theoretical Study for Constructing a Cooperative Problem Analyzing Method: The Method COMPRAM. Amsterdam: Thesis publishers. ISBN 90 5170 302-3.
DeTombe, D. J. (1995a). Gaming and simulations as methods for analyzing complex technical policy problems (abstract). In A. G. Carbonell, & F. Watts (Eds.), Learning through experience: The challenge of change, ISAGA conference 1995. Spain: University Politechnica of Valencia.
DeTombe, D. J. (1997a). An integral approach for sustainable development of technical policy problems. In Elohimjl, F. P.-L., & Stuhler, E. A. (Eds.), Sustainable development: Towards measuring of the performance of integrated socioeconomic and environmental systems, Proceedings of the 14th International Conference of Wacra Europe. Universidad Complutense de Madrid, Spain.
DeTombe, D. J. (1997f). Een aantal methodologische vragen ten aanzien van de bijdrage van socio-cybernetica aan het analyseren, sturen en beschrijven van complexe technisch bestuurskundige problemen. Tijdschrift voor modelbouw en informatica, Amsterdam: Siswo, 96 1-4, 97 1-2.
DeTombe, D. J. (1999a). Compram: A methodology for handling complex societal problems. ETH, auDes Conference Zurich, Internet.
DeTombe, D. J. (2000a). Anticipating and avoiding opposition in large technological projects. In B. Giampiero & M. A. Dorgham (Eds.), International Journal of Technology Management (IJTM) (Vol. 19, Nos 3/4/5, pp. 301–312). ISSN 0267-5730.
DeTombe, D. J. (2000b). Testing methods for complex real life problems. In J. Blasius, J. Hox, E. de Leeuw & P. Schmidt (Eds.), Social science methodology in the new millennium. Proceedings of the Fifth International Conference on Logic and Methodology (pp. 1– 14), Cologne, Germany. T-T publications. ISBN 90-801073-8-7, P110101.
DeTombe, D. J. (2000c). Validation of scientific research of complex societal problems for policy use. International Journal of Risk Assessment and Management.
DeTombe, D. J. (2001h). Compram a policy making method for prevention of floods. Proceedings TIEMS conference 2001, Orlando, FL.
DeTombe, D. J. (2003e). Ethical aspects in the Compram method, a method for handling complex societal problems. Special Focus Symposium on Cognitive, Emotive and Ethical Aspects of Decision Making in Humans and in AI InterSymp-2003 15th International Conference on Systems Research, Informatics and Cybernetics, July 28 - August 2, 2003, Baden-Baden, Germany.
DeTombe, D. (2008a). Towards sustainable development: A complex process. International Journal on Environment and Sustainable Development, 7(1), 49–62.
DeTombe, D. J. (2008c). Climate change: A complex societal process; analyzing a problem according to the Compram methodology. Journal of Transformation & Social Change, 5(3), 235–266. doi:10.1386/jots5.3.235/1.
DeTombe, D. J. (2010). Global Safety. Pesquisa Operacional, v. 30, n. 2, p. 387 - 404, Maio a Agosto de 2010, versão impressa ISSN 0101-7438/versão online ISSN 1678 - 514.
DeTombe, D. J. (2013c). Special groups support session on the operationalizing of the Kosten index of the noise pollution on Schiphol ‘Voldoet de Kosten maat nog”, February 1998 TuDelft. A discussion with experts with the Ministry of Ministry of Transport, Public Works and Water Management, VROM, and TuDelft. Amsterdam: Greenhill & Waterfront. ISBN 978-90-77171-44-8.
DeTombe, D. J. (2014a). De Rooms Katholieke Kerk als een complex maatschappelijk probleem. In C. J. VanDijkum & T. Louis (Eds.), Praktijkonderzoek in ontwikkeling. Den Haag: Boom - Lemma.
DeTombe, D. J., & Hart, ‘t, H. (1996). Using system dynamic modelling techniques for constructing scenarios of societal problems. In D. J. DeTombe & C. VanDijkum (Eds.), Analyzing societal problems, (pp. 57–75). Mering: Rainer Hampp Verlag. ISBN 3-87988-189-8.
DeTombe, D. J., & Rosendaal, B. (1998). Cooperative and interactive policy making. In J. Geurts, C. Joldersma, & E. Roelofs (Eds.), Gaming/simulation for policy development and organizational change. Tilburg University Press, ISBN 90-361-9879-8.
DeTombe, D. J., & VanDijkum, C. (1996a). Methods and tools for analyzing complex interdisciplinary problems. An introduction to the theme. In D. J. De Tombe & C. VanDijkum (Eds.), Analyzing societal problems (pp. 1–6). Mering: Rainer Hampp Verlag. ISBN 3-87988-1189-8.
DeTombe, D. J., & VanDijkum, C. (Eds.). (1996b). Analyzing societal problems. A methodological approach (p. 300). Mering: Rainer Hampp. ISBN 3-87988-189-8.
DeTombe, D. J., & VanDijkum C. (Eds.). (1998). Socio-cybernetics - Methodology for Complex Societal Problem and Socio-Cybernetic Concepts. 14th International Sociology Conference in Special Session Using Socio-Cybernetica Concepts for Analysing Complex Societal Problems. Volume 4. Montreal, QC: The Netherlands, Delft: Delft University of Technology. http://149.170.198.2/~bruce/pcp-discuss/1357.html
Die Zeit. (2013, January 9). Die Aufarbeitung der Kirche is gescheitert. Die Zeit online.
Frijda, N. H. (1986). The emotions. Cambridge: Cambridge University Press.
Geyer, F., & van der Zouwen, J. (1986). Socio-Cybernetic Paradoxes. London: Sage Publications.
Grimm & Grimm (Gebr.) (1812). Kinder- und Hausmärchen. Dornröschen.
Hain, V. (2012). Výskum prostredníctvom tvorby pri obnove pamiatok. In Veda vo výstavbe. Medzinárodná vedecká konferencia doktorandského štúdia v oblasti architektúry a urbanizmu. ALFA, 3/2012, ročník 17, číslo 3/2012. Bratislava: Fakulta architektúry STU, 2012, s. 24. ISSN: 1135-2679.
Hain, V. & Kráľová, E. (2013) Industrial heritage as an educational polygon for development strategies. In D. DeTombe, B. Cathal, G.-W. Weber, F. Wenstøp (Eds.), Book of abstracts of State of the Art Workshop Rome Operational Research EUROMSC/EURO MCDA/EUROPT/EURO ORD/Ethics and ORVolume 27. Amsterdam: Greenhill & Waterfront. ISBN/EAN 978-90-77171-42-4.
Hart, ‘t, H., van Dijk, J., de Goede, M., Jansen, W., & Teunissen, J. (1996). Onderzoeksmethoden. Meppel/Amsterdam: Boom.
Jansen, L. (1972). Een oud metroplan. Ons Amsterdam, 24, 310–314.
Kant, I. (1785). Grundlegung zur Metaphysik der Sitten (1797) Metaphysische Anfangsgründe der Tugendlehre. In: K. Werke. Akademie Textausgabe. Bd. 6: Die Religion innerhalb der Grenzen der bloßen Vernunft. Die Metaphysik der Sitten. Unveränderter photomechanischer Abdruck von Kants gesammelte Schriften. Herausgegeben von der Königlich Preußischen Akademie der Wissenschaften, Band VI, Berlin 1907/14. De Gruyter, Berlin 1968 [1797], S. 203 – 492. ISBN 3-11-001439-4.
Kavtaradze, D. (2013). Simulation Modeling and Games. In J. Tolordava, D. J. DeTombe, D. Kavtaradze, G. Panizzi, P. Rizzi, & F. Leigh (Eds.), International experience in simulation modeling: Economics and business, ecology, sociology. Tiblisi: Tiblisi State University Press.
Kets de Vries, M. F. R. (1995). Organizational paradoxes. London: Routledge.
Köbben. (1996, May 15). Kafka in Zoetermeer. Rotterdam: NRC Handelsblad.
Kohler, W. (1999, May 1). Zieke cijfers; AMC herziet bijlmerstatistiek. Rotterdam: NRC Handelsblad.
Koshlai, L., & Mikhalevich, M. (2007). Fuzzy-Based Models and Hierarchy Procedures as a Tool for Suburban Area Classfication. In D. DeTombe (2007). global safety & sustainable development & healthcare methodology of complex societal issues book of abstracts, (Vol. 16). Europe, The Netherlands, Amsterdam, UK, Guilford; North-America, Canada, Montreal: Greenhill & Waterfront, ISBN 978-90-77171-21-9.
Kwakkel, J. H. (2010). The treatment of uncertainty in airport strategic planning. TRAIL Thesis Series nr. T2010/13. Delft: The Netherlands TRAIL Research School, TuDelft.
Lamme, V. (2011). De vrije wil bestaat niet. Amsterdam: Bert Bakker. ISBN 9789035135390.
Lintsen, H.W. (1980). Ingenieurs in Nederland in de Negentiende Eeuw, een streven naar erkenning en macht. Den Haag: Eigen beheer.
Lorenz, E. N. (1963). Deterministic Nonperiodic Flow. Journal of the Atmospheric Sciences, 20: 130–141.
Lorenz, E. (1979, December 29). Predictability: Does the flap of a butterfly's wings in Brazil set off a tornado in Texas? In Speech at the annual meeting of the American Association for the Advancement of Science. Washington.
Lynn, B. G. (1998). Brent spar, atlantic oil and greenpeace (7, pp. 89–102). Hansard Society Series in Politics and Government.
Ministerie van Verkeer en Waterstaat. (2000). Ruimte voor de Rivier (Department of Public Works Deltaplan Large Rivers). Den Haag: Ministerie van Verkeer en Waterstaat Directoraat-Generaal Rijkswaterstaat.
Mintzberg, H. (1983). Power in and around organizations. Engelewood Cliff, NJ: Prentice-Hall.
NRC Handelsblad. (1996, March). George Sores. NRC Dutch Daily Quality Newspaper. Rotterdam: NRC Handelsblad.
NRC Handelsblad. (2002, May). Enron. NRC Dutch Daily Newspaper. Rotterdam: NRC Handelsblad.
NRC Handelsblad. (2003a, April). Ahold, NRC Dutch Daily Newspaper. 14 May 2003, p. 15, 18, 16 May 2003, p. 9. Rotterdam: NRC Handelsblad.
NRC Handelsblad. (2003b). CEO’s. NRC Dutch Daily Newspaper, 14 May p. 23, 17 May p.1, p. 55. Rotterdam: NRC Handelsblad.
NRC Handelsblad. (2013, December 17). Red de democratie, doe als wij en word klokkenluider (Save the democracy, do as we do, become a whistleblower). NRC Dutch Daily Newspaper. Amsterdam: NRC Handelsblad.
Spanjerberg & Pe (1998, Febrauary 27). Werkconferentie dosismaten luchtvaartgeluid. Delft: TuDelft.
Rooze, E. J. (1998). Supporting creativity. In Problem Handling by Generating Requisite Chaos. Munchen/Mering: Hampp Verlag.
Romiszowski, A. J. (1986). Developing auto-instructional materials. From programmed texts to CAL and interactive video. London: Kogan Page.
Rutgers van de Loeff, A. (1965). Lawines razen. Amsterdam: Ploegsma.
Saviano, R. (2013). Gomorra. Amsterdam: Lebowski.
Segers, J. H. G. (1977). Sociologische onderzoeksmethoden: Inleiding tot de structuur van het onderzoeksproces en tot de methoden van dataverzameling. Assen/Amsterdam: Van Gorcum.
Siddiqui, F. (1998). Op weg naar een miljardenstrop. Intermediair, 34, nr 24.
Staman, J. (2014, April 22). Wetenschap hangt in a strop (p. 19). NRC Dutch Daily Newspaper. Amsterdam: NRC Handelsblad.
Stil, H. (1996). De megaprojecten: De vier grote werken ten behoeve van de Nederlandse economie. Den Haag: Sdu Uitgevers.
Stolp. A. (2004). Belevingswaardenonderzoek: beleidsanalyse vanuit het perspectief van burgers . Utrecht: Utrecht Bouwdienst Rijkswaterstaat, Afdeling Milieubouw, Adviesgroep.
Swanborn, P. G. (1987). Methoden van sociaal wetenschappelijk onderzoek. Nieuwe editie. Meppel/Amsterdam: Boom.
Swanborn, P. G. (2005). Methoden van sociaal-wetenschappelijk onderzoek. Amsterdam: Boom.
Taylor, S. (2013). Governance and Dissent in the Complex Society. In D. DeTombe, C. Brugha, G.-W. Weber, F. Wenstøp (Eds.), Book of abstracts of State of the Art Workshop Rome Operational Research EUROMSC/EURO MCDA/EUROPT/EURO ORD/Ethics and OR (Vol. 27). Amsterdam: Greenhill & Waterfront; UK, Guilford; North-America: Canada Montreal, ISBN EAN 978-90-77171-42-4.
Tennekes, H. (1990a). Dan leef ik liever in onzekerheid. Bloemendaal: Aramith.
Tennekes, H. (Ed.). (1990b). De vlinder van Lorenz. De verrassende dynamica van chaos. Bloemendaal: Aramith.
Termeer, C. J. A. M. (1993). Dynamiek en inertie rondom mestbeleid; een studie naar veranderingsprocessen in het varkenshouderijnetwerk.’s-Gravenhage: Vuga.
Tolordava, J. (2013). Experimental Economics and Simulation Games. In J. Tolordava, D. J. DeTombe, D. Kavtaradze, G. Panizzi, P. Rizzi, & F. Leigh (Eds.), International experience in simulation modeling: Economics and business, ecology, sociology. Tiblisi: Tiblisi State University Press.
Van der Riet, O. (1998). What’s the problem? The problem formulation task in infrastructure. Delft: TuDelft.
van Eeten, M. J. G. (1997, February). Studie naar de achterliggende visies in het debat rondom de toekomstige Nederlandse luchtvaart infrastructuur en hun consequenties voor procesontwerp; Rapportage aan het project TNLI van de ministeries van Verkeer en Waterstaat, Volkshuisvesting, Ruimtelijke Ordening en Milieubeheer en Economische Zaken, Delft University of Technology/Faculteit Technische Bestuurskunde, Delft.
VanDijkum, C., DeTombe, D., & van Kuijk, E. (Eds.). (1999). Validation of Simulations models. Amsterdam: Siswo.
Vermeer, O. (2012, 20 April). Wel onder water. Niet onder water. Bleker krijgt het maar niet rond. Rotterdam: NRC Handelsblad.
Verplaetse, J. (2011). Zonder vrije wil. Een filosofisch essay over verantwoordelijkheid. Amsterdam: NieuweZijds. ISBN 9789057123283.
Wiel, van der, C. (2014). Betrouwbare proefkonijnen gezocht. Folia Magazine nr 28 16-04-2014 (pp. 22–24). Amsterdam: Stichting Folia Civitatis.
WRR. (1994). Besluiten over grote projecten. Wetenschappelijke Raad voor het Regeringsbeleid (Rapport 46). Den Haag: Sdu Uitgeverij.
Author information
Authors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
DeTombe, D. (2015). Implementation: Ethical Aspects, Validation, and Testing of Complex Societal Methodologies. In: Handling Societal Complexity. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-662-43917-3_13
Download citation
DOI: https://doi.org/10.1007/978-3-662-43917-3_13
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-662-43916-6
Online ISBN: 978-3-662-43917-3
eBook Packages: Business and EconomicsBusiness and Management (R0)