Sound Synthesis by Flexible Activation Function Recurrent Neural Networks
In this paper we investigate on the use of adaptive spline neural networks, to define a new general class of physical-like sound synthesis models, based on a learning from examples strategy (in particular in this paper we study single-reed woodwind instruments). It is well known that one of the main problems in physical modeling concerns the difficulty of parameter identification and the definition of the exciter nonlinear function shape (which plays a key rule in the instrument timbre). In the proposed neural model we make use of FIR-IIR synapses followed by a Catmul-Rom spline based flexible nonlinear function whose shape can be modified by adapting its control points. This general structure can imitate an entire class of instruments by learning all the parameters (synaptic weights and spline control points) from recorded sounds. In order to obtain an efficient hardware/software implementation, the synaptic weights are constrained to be power-of-two terms while the nonlinear function can be implemented as a simple spline interpolation scheme or through a small lookup table. In order to demonstrate the effectiveness of the proposed model, experiments on a single-reed woodwind instruments have been carried out.
Keywordssound synthesis physical model flexible activation function spline neural networks power-of-two neural networks
Unable to display preview. Download preview PDF.
- G. Borin, G De Poli, and A. Sarti, “Sound Synthesis by Dynamic Systems Interaction”, in Readings in Computer-Generated Music, pp. 139–160, IEEE Comp. Soc. Press, D. Baggi ed., 1992.Google Scholar
- Gary Paul Scavone, “An acoustical analysis of single-reed woodwind instruments with an emphasis on design and performance issues and digital waveguide modeling techniques”, Ph.D. thesis, Music Dept., Stanford University, March 1997.Google Scholar
- N.H. Fletcher, T.D. Rossing, “The Physics of Musical Instruments”, Springer-Verlang, New-York, 1981.Google Scholar
- Gary P. Scavone, Perry Cook, “Real Time Computer Modeling of woodwind instruments”, International Symposium on Musical Acoustics, Leavenworth, WA 1998.Google Scholar
- J. O. Smith, “Technique for Digital Filter Design and System Identification with Application to the Violin”, PhD Thesis, CCRM, Standford University, Report n. STAN-M-14, 1983.Google Scholar
- J. Vuori and V. Vlimki, “Parameter Estimation of Non-linear Physical Models by Simulated Evolution: Application to the Flute Model”, Proc. Int. Comp. Music Conf., pp. 402–404, Tokyo 1993.Google Scholar
- Carlo Drioli, Davide Rocchesso, “Learning Pseudo-Physical Models for Sound Synthesis and Trasformation”, IEEE International Conference on Systems, Man, and Cybernetics, vol. 2, pp 1085–1090, 1998.Google Scholar
- Aurelio Uncini, Lorenzo Vecci, Paolo Campolucci and Francesco Piazza, “Complex-valued Neural Networks with Adaptive Spline Activation Function for Digital Radio Links Nonlinear Equalization”, IEEE Trans. on Signal Processing, Vol. 47, No. 2, February 1999.Google Scholar
- F. Glover, M. Laguna, “Tabu search”, Kluver Academic Publisher, 1997.Google Scholar
- Stefano Traferro and Aurelio Uncini, “Power-of-Two Adaptive Filters Using Tabu Search”, IEEE Transactions on Circuits and Systems-II: Analog and Digital Signal Processing, Vol. 47, No. 6, June 2000.Google Scholar