Advertisement

Designing Behaviors to Interactively Interlace Natural Language Processing, Text to Speech Procedures and Algorithmic Images

  • Tania Fraga
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10919)

Abstract

This article presents the artwork Interlace and its related application, #ELIZA_Interlacements, as a case study. Both are works in progress aiming to develop and explore an interface with ELIZA, a natural language processing software using text to speech – TTS – procedures interweaving them with algorithmic images. ELIZA was modeled as a pseudo Rogerian ‘psychotherapist’ and was created between 1964 and 1966 at the MIT Artificial Intelligence Laboratory by Joseph Weizenbaum. ELIZA is a very simple program but it is still quite entertaining and thought provoking. The new application created using ELIZA aims to design behaviors that interactively interlace natural language processing, with text to speech procedures, entwining algorithmically generated images with dialogues of ELIZA and the public. By interweaving images with onscreen dialogues obtained with ‘talks’ to ELIZA it is possible to experiment the visual poetic potential of such explorations and their immanent relations. These visual poetic results point to a potential symbiotic relationship between man and machine. This experimental artwork shows different aspects of the poetic, aesthetic and technical characteristics of the explored object for art and design aims. The application’s interface is being developed using the IDE Processing. Autonomous bots, represented as images processed in real time are presented interactively with the dialogs in a graphic interface that will be shown in big projected screens in site specific installations and performances.

Keywords

Computer Art Algorithmic art Virtual reality Natural Language Processing (NLP) Text-To-Speech (TTS) ELIZA 

Notes

Acknowledgments

Customized software in Java (Processing IDE); Programmers: Pedro Garcia and Tania Fraga; Conception, implementation, Graphic interface, Interactive project, Photos and images: Tania Fraga; Mathematician consultant: Donizetti Louro.

References

  1. 1.
  2. 2.
    Natural Language Processing. https://machinelearningmastery.com/natural-language-processing/. Accessed 04 Dec 2017
  3. 3.
  4. 4.
    Penrose, R.: A mente nova do rei. Campus, Rio de janeiro (1993)Google Scholar
  5. 5.
    Processing. http://processing.org. Accessed 04 Dec 2017
  6. 6.
    Hayden, C.: https://github.com/codeanticode/eliza. Accessed 04 Dec 2017
  7. 7.
    Busch, K.: Artistic research concept. Artistic Research and the Poetics of Knowledge (2014). http://www.artandresearch.org.uk/v2n2/busch.html. Accessed 06 Oct 2017
  8. 8.
    Norvig, P., Russel, S.J.: Artificial Intelligence. Prentice Hall, Englewood Cliffs (2003)Google Scholar
  9. 9.
    Fraga, T.: Caracolomobile: affect in computer systems. AI Soc. J. Faustian Exch. 28, 167–176 (2013). http://www.springerlink.com/content/d8u21638134u834g/export-citation/,vol21. Accessed 06 Oct 2017CrossRefGoogle Scholar
  10. 10.
    Fraga, T.: Por trás da cena: produção de espetáculos com cenários interativos/Behind the scene: production of spectacles with interactive scenarios. In: Garcia, I.H. (ed) Estética de los mundos possibles/Aesthetic of Possible Worlds, pp. 183–198. Pontifícia Universidad Javeriana, Bogotá (2016)Google Scholar
  11. 11.
    Fraga, T.: Exoendogenias/Endogenously. In: Costa, M.C.C. (ed.) A pesquisa na Escola de Comunicações e Artes da USP/Research at the School of Communications and Arts from USP, pp. 46–66. ECA, Sao Paulo (2012)Google Scholar
  12. 12.
    Fraga, T., Donizetti, L., Pichiliani, M.: Experimental art with brain controlled interface. In: Human Computer Interfaces Proceedings, HCI 2013, Las Vegas (2013)Google Scholar
  13. 13.
    Hirata, C.M., Pichiliani, M.C., Fraga, T.: Exploring a brain controlled interface for emotional awareness. In: Proceedings of SBC, SBSC 2012, Sao Paulo (2012)Google Scholar
  14. 14.
    Baum, E.B.: What is Thought?. MIT Press, Cambridge (2004)Google Scholar
  15. 15.
    Caillaud, B.: La creation numerique visuelle. Europia, Paris (2012)Google Scholar
  16. 16.
    Fraga, T.: Artes interativas e método relacional para criação de obras/Interactive arts and relational method for artworks creation (2006). http://taniafraga.art.br/arquivos_pdf/ArtesInterativasMetodoRelacionalParaCriacaoObras.pdf. Accessed 06 Oct 2017
  17. 17.
    Norman, D.: O design do futuro/The Future of Design. ROCCO, Rio de Janeiro (2010)Google Scholar
  18. 18.
    Kaku, M.: A Física do Futuro. ROCCO, Rio de Janeiro (2012)Google Scholar
  19. 19.
    Penrose, R.: A Mente Virtual. Gradiva, Lisboa (1997)Google Scholar
  20. 20.
    Ascott, R.: Telematic Embrace. University of California, Los Angeles (2003)Google Scholar
  21. 21.
    Fraga, T.: 21st Century Brazilian Computer Art (2014). https://www.youtube.com/watch?v=nVjmgROEp5A. Accessed 01 Nov 2017
  22. 22.
    Gasparetto, D.A.: O “curto-circuito” da arte digital no Brasil. Edição do autor, Santa Maria (2014)Google Scholar
  23. 23.
    Fraga, T., Fragoso, M.L.: 21st Century Brazilian (Experimental) Computer Art. In: CAC.3 Proceedings, Europia, Paris (2012)Google Scholar
  24. 24.
    Venturelli, S.: Arte Computacional. UnB, Brasilia (2017)Google Scholar
  25. 25.
    Eduardo Miranda’s BCI device to play music. http://www.abledata.com/product/bci-music. Accessed 14 Nov 2017
  26. 26.
    Emovere Group. http://www.emovere.cl/en/. Accessed 14 Nov 2017

Copyright information

© Springer International Publishing AG, part of Springer Nature 2018

Authors and Affiliations

  1. 1.Institute of Mathematics and Arts of São PauloSão PauloBrazil
  2. 2.University of BrasiliaBrasíliaBrazil

Personalised recommendations