Abstract
USER (Universal SEmantic Representation) is a bio-inspired module implemented in a system on a chip (SoC), which builds a link between multichannel perception and semantic representation. The input data are projected into a generic bioinspired higher dimensional non-linear semantic space with high sparsity. A pooling of these semantic representations (global, dynamic and structural) is done automatically by a set of dynamic attractors embedding spatio-temporal histograms, being drastically more efficient than back-propagation. A supervised learning is used to build the association between the invariant multimodal semantic representations (histogram results) and the labels (‘words’). The invariant recognition is achieve thanks to multichannel multiscale dynamic attractors and bilinear representations - imitating brain attentional processes. USER modules can be cascaded, allowing to work at different levels of abstraction (or complexity). Due to its low consumption, small size and minimal price, USER targets deep learning, robotics, and Internet of Things (IoT) applications.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Bach-y-Rita, P.: Theoretical aspects of sensory substitution and of neurotransmission-related reorganization in spinal cord injury. Spinal Cord 37(7), 465–474 (1999)
Bernard, M., N’Guyen, S., Pirim, P., Guillot, A., Meyer, J.-A., Gas, B.: A supramodal vibrissa tactile and auditory model for texture recognition. In: Doncieux, S., Girard, B., Guillot, A., Hallam, J., Meyer, J.-A., Mouret, J.-B. (eds.) SAB 2010. LNCS, vol. 6226, pp. 188–198. Springer, Heidelberg (2010)
Colgin, L.L., Leutgeb, S., Jezek, K., Leutgeb, J.K., Moser, E.I., McNaughton, B.L., Moser, M.B.: Attractor-map versus autoassociation based attractor dynamics in the hippocampal network. J. Neurophysiol. 104, 35–50 (2010)
Goodale, M.A., Milner, A.D.: Separate visual pathways for perception and action. Trends Neurosci. 15(1), 20–25 (1992)
Hubel, D.H., Wiesel, T.N.: Receptive fields of single neurons in the cat’s striate cortex. J. Physiol. (London) 148, 574–591 (1959)
Nilsen, K.E., Russell, I.J.: The spatial and temporal representation of a tone on the guinea pig basilar membrane. Proc. Nat. Acad. Sci. 97(22), 11751–11758 (2000)
Pagiamtzis, K., Sheikholeslami, A.: Content-addressable memory (CAM) circuits and architectures: a tutorial and survey. IEEE J. Solid-State Circuits 41(3), 712–727 (2006)
Pirim, P.: Method and device for real-time processing of a sequenced data flow, and application to the processing and digital video signal representing a video image, Patent FR2611063 (1987)
Pirim, P.: Method and device for real-time detection, localization and determination of the speed and direction of movement of an area of relative movement in a scene, Patent FR2751772 (1996)
Pirim, P.: Automated method and device for perception associated with determination and characterisation of borders and boundaries of an object of a space, contouring and applications, Patent WO2005010820 (2003)
Pirim, P.: Generic bio-inspired chip model-based on spatio-temporal histogram computation: application to car driving by gaze-like control. In: Lepora, N.F., Mura, A., Krapp, H.G., Verschure, P.F.M.J., Prescott, T.J. (eds.) Living Machines 2013. LNCS, vol. 8064, pp. 228–239. Springer, Heidelberg (2013)
Pirim, P.: Processeur de perception bio-inspiré: une approche neuromorphique. Techn. Ingénieur. IN-220 (2015). (in French)
Rasetshwane, D.M., Gorga, M.P., Neely, S.T.: Signal-processing strategy for restoration of cross-channel suppression in hearing-impaired listeners. IEEE Trans. Biomed. Eng. 61(1), 64–75 (2014)
Rennó-Costa, C., Lisman, J.E., Verschure, P.F.: A signature of attractor dynamics in the CA3 region of the hippocampus. PLoS Comput. Biol. 10(5), e1003641 (2014)
Touzet, C.F.: The theory of neural cognition applied to robotics. Int. J. Adv. Robot. Syst. 12, 74 (2015)
Somasundaram, M.: Circuit to generate a sequential index for an input number in a pre-defined list of numbers, Patent US7155563 B1, 26 Dec 2006
Strasburger, H., Rentschler, I., Jüttner, M.: Peripheral vision and pattern recognition: a review. J. Vis. 11(5), 1–82 (2011)
Van Rullen, R., Gautrais, J., Delorme, A., Thorpe, S.: Face processing using one spike per neurone. Biosystems 48(1–3), 229–239 (1998)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland
About this paper
Cite this paper
Pirim, P. (2016). Perceptive Invariance and Associative Memory Between Perception and Semantic Representation USER a Universal SEmantic Representation Implemented in a System on Chip (SoC). In: Lepora, N., Mura, A., Mangan, M., Verschure, P., Desmulliez, M., Prescott, T. (eds) Biomimetic and Biohybrid Systems. Living Machines 2016. Lecture Notes in Computer Science(), vol 9793. Springer, Cham. https://doi.org/10.1007/978-3-319-42417-0_25
Download citation
DOI: https://doi.org/10.1007/978-3-319-42417-0_25
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-42416-3
Online ISBN: 978-3-319-42417-0
eBook Packages: Computer ScienceComputer Science (R0)