Emerging multimodal memristors for biorealistic neuromorphic applications

Xuanyu Shan; Ya Lin; Zhongqiang Wang; Xiaoning Zhao; Ye Tao; Haiyang Xu; Yichun Liu

doi:10.1088/2752-5724/ad119e

Volume 3 Issue 1

March 2024

Turn off MathJax

Article Contents

Xuanyu Shan, Ya Lin, Zhongqiang Wang, Xiaoning Zhao, Ye Tao, Haiyang Xu, Yichun Liu. Emerging multimodal memristors for biorealistic neuromorphic applications[J]. Materials Futures, 2024, 3(1): 012701. doi: 10.1088/2752-5724/ad119e

Citation:

Xuanyu Shan, Ya Lin, Zhongqiang Wang, Xiaoning Zhao, Ye Tao, Haiyang Xu, Yichun Liu. Emerging multimodal memristors for biorealistic neuromorphic applications[J]. Materials Futures, 2024, 3(1): 012701. doi: 10.1088/2752-5724/ad119e

Citation:

PDF( 4970 KB)

Topical Review •

OPEN ACCESS

Emerging multimodal memristors for biorealistic neuromorphic applications

Materials Futures, Volume 3, Number 1

Received Date: 2023-10-07
Accepted Date: 2023-11-23
Rev Recd Date: 2023-11-13
Publish Date: 2024-01-03

Article information

doi: 10.1088/2752-5724/ad119e

Key Laboratory of UV-Emitting Materials and Technology of Ministry of Education, Northeast Normal University, Changchun, People’s Republic of China
Authors to whom any correspondence should be addressed.

More Information

Corresponding author: E-mail: liny474@nenu.edu.cn; E-mail: wangzq752@nenu.edu.cn; E-mail: hyxu@nenu.edu.cn

Abstract

Abstract

The integration of sensory information from different modalities, such as touch and vision, is essential for organisms to perform behavioral functions such as decision-making, learning, and memory. Artificial implementation of human multi-sensory perception using electronic supports is of great significance for achieving efficient human-machine interaction. Thanks to their structural and functional similarity with biological synapses, memristors are emerging as promising nanodevices for developing artificial neuromorphic perception. Memristive devices can sense multidimensional signals including light, pressure, and sound. Their in-sensor computing architecture represents an ideal platform for efficient multimodal perception. We review recent progress in multimodal memristive technology and its application to neuromorphic perception of complex stimuli carrying visual, olfactory, auditory, and tactile information. At the device level, the operation model and undergoing mechanism have also been introduced. Finally, we discuss the challenges and prospects associated with this rapidly progressing field of research.
- multimodal memristor,
- neuromorphic perception,
- in-sensor computing

FullText(HTML)

References(81)

References

[1]	Shi Q, Dong B, He T, Sun Z, Zhu J, Zhang Z, Lee C 2020 Progress in wearable electronics/photonicsmoving toward the era of artificial intelligence and internet of things InfoMat 2 1131-62 doi: 10.1002/inf2.12122
[2]	Yan Z, et al 2021 Flexible highresolution triboelectric sensor array based on patterned laserinduced graphene for selfpowered realtime tactile sensing Adv. Funct. Mater. 31 2100709 doi: 10.1002/adfm.202100709
[3]	Liang S J, Li Y, Cheng B, Miao F 2022 Emerging lowdimensional heterostructure devices for neuromorphic computing Small Struct. 3 2200064 doi: 10.1002/sstr.202200064
[4]	Du J, et al 2021 A robust neuromorphic vision sensor with optical control of ferroelectric switching Nano Energy 89 106439 doi: 10.1016/j.nanoen.2021.106439
[5]	Wang Y, et al 2023 A three-dimensional neuromorphic photosensor array for nonvolatile in-sensor computing Nano Lett. 23 4523-32 doi: 10.1021/acs.nanolett.3c00899
[6]	Leo F, Bolognini N, Passamonti C, Stein B E, Ladavas E 2008 Cross-modal localization in hemianopia: new insights on multisensory integration Brain 131 855-65 doi: 10.1093/brain/awn003
[7]	Frgnac Y, Bathellier B 2015 Cortical correlates of low-level perception: from neural circuits to percepts Neuron 88 110-26 doi: 10.1016/j.neuron.2015.09.041
[8]	Tan H, Zhou Y, Tao Q, Rosen J, van Dijken S 2021 Bioinspired multisensory neural network with crossmodal integration and recognition Nat. Commun. 12 1120 doi: 10.1038/s41467-021-21404-z
[9]	Albustanji R N, Elmanaseer S, Alkhatib A A A 2023 Robotics: five senses plus onean overview Robotics 12 68 doi: 10.3390/robotics12030068
[10]	Wan C, Cai P, Guo X, Wang M, Matsuhisa N, Yang L, Lv Z, Luo Y, Loh X J, Chen X 2020 An artificial sensory neuron with visual-haptic fusion Nat. Commun. 11 4602 doi: 10.1038/s41467-020-18375-y
[11]	Zhao B, Zhao X, Li Q, Xun X, Ouyang T, Zhang Z, Kang Z, Liao Q, Zhang Y 2022 Reproducible and lowpower multistate biomemristor from interpenetrating network electrolyte design InfoMat 4 e12350 doi: 10.1002/inf2.12350
[12]	Lin Y, Meng F, Zeng T, Zhang Q, Wang Z, Cheng Y, Zhao X, Gu L, Xu H, Liu Y 2023 Direct observation of oxygen ion dynamics in a WO_3x based secondorder memristor with dendritic integration functions Adv. Funct. Mater. 33 2302787 doi: 10.1002/adfm.202302787
[13]	Yan X, Zhao J, Liu S, Zhou Z, Liu Q, Chen J, Liu X Y 2018 Memristor with Agclusterdoped TiO₂ films as artificial synapse for neuroinspired computing Adv. Funct. Mater. 28 1705320 doi: 10.1002/adfm.201705320
[14]	Xu L, Yuan R, Zhu Z, Liu K, Jing Z, Cai Y, Wang Y, Yang Y, Huang R 2019 Memristorbased efficient inmemory logic for cryptologic and arithmetic applications Adv. Mater. Technol. 4 1900212 doi: 10.1002/admt.201900212
[15]	Tan H, Liu G, Yang H, Yi X, Pan L, Shang J, Long S, Liu M, Wu Y, Li R-W 2017 Light-gated memristor with integrated logic and memory functions ACS Nano 11 11298-305 doi: 10.1021/acsnano.7b05762
[16]	Jo S H, Chang T, Ebong I, Bhadviya B B, Mazumder P, Lu W 2010 Nanoscale memristor device as synapse in neuromorphic systems Nano Lett. 10 1297-301 doi: 10.1021/nl904092h
[17]	Wang Z Q, Xu H Y, Li X H, Yu H, Liu Y C, Zhu X J 2012 Synaptic learning and memory functions achieved using oxygen ion migration/diffusion in an amorphous InGaZnO memristor Adv. Funct. Mater. 22 2759-65 doi: 10.1002/adfm.201103148
[18]	Lin H, Wang C, Hong Q, Sun Y 2020 A multi-stable memristor and its application in a neural network IEEE Trans. Circuits Syst. II 67 3472-6 doi: 10.1109/TCSII.2020.3000492
[19]	Choi S, Jang S, Moon J-H, Kim J C, Jeong H Y, Jang P, Lee K-J, Wang G 2018 A self-rectifying TaO_y/nanoporous TaO_x memristor synaptic array for learning and energy-efficient neuromorphic systems NPG Asia Mater. 10 1097-106 doi: 10.1038/s41427-018-0101-y
[20]	Kim S, Kim H, Hwang S, Kim M-H, Chang Y-F, Park B-G 2017 Analog synaptic behavior of a silicon nitride memristor ACS Appl. Mater. Interfaces 9 40420-7 doi: 10.1021/acsami.7b11191
[21]	Zhang C, et al 2019 Bioinspired artificial sensory nerve based on nafion memristor Adv. Funct. Mater. 29 1808783 doi: 10.1002/adfm.201808783
[22]	Lee D, Chae M, Jung J, Kim H D 2023 Correlation between sensing accuracy and read margin of a memristor-based NO gas sensor array estimated by neural network analysis ACS Sens. 8 2105-14 doi: 10.1021/acssensors.3c00541
[23]	Zhou Y, et al 2020 Black phosphorus based multicolor light-modulated transparent memristor with enhanced resistive switching performance ACS Appl. Mater. Interfaces 12 25108-14 doi: 10.1021/acsami.0c04493
[24]	Yan B, Kuang D, Wang W, Wang Y, Sun B, Zhou G 2022 Investigation of multi-photoconductance state induced by light-sensitive defect in TiO_x-based memristor Appl. Phys. Lett. 120 253506 doi: 10.1063/5.0097106
[25]	Park J, Lee S, Lee J, Yong K 2013 A light incident angle switchable ZnO nanorod memristor: reversible switching behavior between two nonvolatile memory devices Adv. Mater. 25 6423-9 doi: 10.1002/adma.201303017
[26]	Chen S, Lou Z, Chen D, Shen G 2018 An artificial flexible visual memory system based on an UVmotivated memristor Adv. Mater. 30 1705400 doi: 10.1002/adma.201705400
[27]	Wu X, Li E, Liu Y, Lin W, Yu R, Chen G, Hu Y, Chen H, Guo T 2021 Artificial multisensory integration nervous system with haptic and iconic perception behaviors Nano Energy 85 106000 doi: 10.1016/j.nanoen.2021.106000
[28]	Duan Q, Zhang T, Liu C, Yuan R, Li G, Jun Tiw P, Yang K, Ge C, Yang Y, Huang R 2022 Artificial multisensory neurons with fused haptic and temperature perception for multimodal insensor computing Adv. Intell. Syst. 4 2200039 doi: 10.1002/aisy.202200039
[29]	Pei Y, et al 2022 A multifunctional and efficient artificial visual perception nervous system with Sb₂Se₃/CdSCore/Shell (SC) nanorod arrays optoelectronic memristor Adv. Funct. Mater. 32 2203454 doi: 10.1002/adfm.202203454
[30]	Wang T-Y, Meng J-L, Li Q-X, He Z-Y, Zhu H, Ji L, Sun Q-Q, Chen L, Zhang D W 2021 Reconfigurable optoelectronic memristor for in-sensor computing applications Nano Energy 89 106291 doi: 10.1016/j.nanoen.2021.106291
[31]	Sun L, Wang Z, Jiang J, Kim Y, Joo B, Zheng S, Lee S, Yu W J, Kong B-S, Yang H 2021 In-sensor reservoir computing for language learning via two-dimensional memristors Sci. Adv. 7 eabg1455 doi: 10.1126/sciadv.abg1455
[32]	Bae B, Park M, Lee D, Sim I, Lee K 2023 Heterointegrated InGaAs photodiode and oxide memristorbased artificial optical nerve for insensor NIR image processing Adv. Opt. Mater. 11 2201905 doi: 10.1002/adom.202201905
[33]	Sun J, et al 2022 A dual-mode organic memristor for coordinated visual perceptive computing Fundam. Res. doi: 10.1016/j.fmre.2022.06.022
[34]	Dang B, et al 2020 Physically transient optic-neural synapse for secure in-sensor computing IEEE Electron Device Lett. 41 1641-4 doi: 10.1109/LED.2020.3025791
[35]	Li Z, Tang W, Zhang B, Yang R, Miao X 2023 Emerging memristive neurons for neuromorphic computing and sensing Sci. Technol. Adv. Mater. 24 2188878 doi: 10.1080/14686996.2023.2188878
[36]	Liu H, et al 2023 Artificial neuronal devices based on emerging materials: neuronal dynamics and applications Adv. Mater. 35 2205047 doi: 10.1002/adma.202205047
[37]	Wang M, et al 2022 Tactile nearsensor analogue computing for ultrafast responsive artificial skin Adv. Mater. 34 2201962 doi: 10.1002/adma.202201962
[38]	Cho S W, Kwon S M, Kim Y-H, Park S K 2021 Recent progress in transistorbased optoelectronic synapses: from neuromorphic computing to artificial sensory system Adv. Intell. Syst. 3 2000162 doi: 10.1002/aisy.202000162
[39]	Yuan Y, et al 2023 Artificial leaky integrate-and-fire sensory neuron for in-sensor computing neuromorphic perception at the edge ACS Sens. 8 2646-55 doi: 10.1021/acssensors.3c00487
[40]	Yuan R, et al 2022 A calibratable sensory neuron based on epitaxial VO₂ for spike-based neuromorphic multisensory system Nat. Commun. 13 3973 doi: 10.1038/s41467-022-31747-w
[41]	John R A, et al 2021 Diffusive and drift halide perovskite memristive barristors as nociceptive and synaptic emulators for neuromorphic computing Adv. Mater. 33 2007851 doi: 10.1002/adma.202007851
[42]	Seo S, et al 2018 Artificial optic-neural synapse for colored and color-mixed pattern recognition Nat. Commun. 9 5106 doi: 10.1038/s41467-018-07572-5
[43]	Zhou F, et al 2019 Optoelectronic resistive random access memory for neuromorphic vision sensors Nat. Nanotechnol. 14 776-82 doi: 10.1038/s41565-019-0501-3
[44]	Sun L, Zhang Y, Hwang G, Jiang J, Kim D, Eshete Y A, Zhao R, Yang H 2018 Synaptic computation enabled by Joule heating of single-layered semiconductors for sound localization Nano Lett. 18 3229-34 doi: 10.1021/acs.nanolett.8b00994
[45]	Zeng T, Wang Z, Lin Y, Cheng Y, Shan X, Tao Y, Zhao X, Xu H, Liu Y 2023 Doppler frequencyshift information processing in WO_xbased memristive synapse for auditory motion perception Adv. Sci. 10 2300030 doi: 10.1002/advs.202300030
[46]	Wang T, Huang H M, Wang X X, Guo X 2021 An artificial olfactory inference system based on memristive devices InfoMat 3 804-13 doi: 10.1002/inf2.12196
[47]	Qian C, Choi Y, Choi Y J, Kim S, Choi Y Y, Roe D G, Kang M S, Sun J, Cho J H 2020 Oxygendetecting synaptic device for realization of artificial autonomic nervous system for maintaining oxygen homeostasis Adv. Mater. 32 2002653 doi: 10.1002/adma.202002653
[48]	Jiang C, Tan D, Sun N, Huang J, Ji R, Li Q, Bi S, Guo Q, Wang X, Song J 2021 60 nm Pixel-size pressure piezo-memory system as ultrahigh-resolution neuromorphic tactile sensor for in-chip computing Nano Energy 87 106190 doi: 10.1016/j.nanoen.2021.106190
[49]	Ayyad A, Halwani M, Swart D, Muthusamy R, Almaskari F, Zweiri Y 2023 Neuromorphic vision based control for the precise positioning of robotic drilling systems Robot. Comput.-Integr. Manuf. 79 102419 doi: 10.1016/j.rcim.2022.102419
[50]	Cho S W, Jo C, Kim Y H, Park S K 2022 Progress of materials and devices for neuromorphic vision sensors Nano-Micro Lett. 14 203 doi: 10.1007/s40820-022-00945-y
[51]	Kumar D, Li H, Das U K, Syed A M, ElAtab N 2023 Flexible solution processable black phosphorus based optoelectronic memristive synapse for neuromorphic computing and artificial visual perception applications Adv. Mater. 35 2300446 doi: 10.1002/adma.202300446
[52]	Chen W, Zhang Z, Liu G 2022 Retinomorphic optoelectronic devices for intelligent machine vision Iscience 25 103729 doi: 10.1016/j.isci.2021.103729
[53]	Subin P S, Midhun P S, Antony A, Saji K J, Jayaraj M K 2022 Optoelectronic synaptic plasticity mimicked in ZnO-based artificial synapse for neuromorphic image sensing application Mater. Today Commun. 33 104232 doi: 10.1016/j.mtcomm.2022.104232
[54]	Ai L, Pei Y, Song Z, Yong X, Song H, Liu G, Nie M, Waterhouse G I N, Yan X, Lu S 2023 Ligandtriggered selfassembly of flexible carbon dot nanoribbons for optoelectronic memristor devices and neuromorphic computing Adv. Sci. 10 2207688 doi: 10.1002/advs.202207688
[55]	Kong N S P, Ibrahim H 2008 Color image enhancement using brightness preserving dynamic histogram equalization IEEE Trans. Consum. Electron. 54 1962-8 doi: 10.1109/TCE.2008.4711259
[56]	Tsuruoka T, Terabe K, Hasegawa T, Valov I, Waser R, Aono M 2012 Effects of moisture on the switching characteristics of oxide-based, gapless-type atomic switches Adv. Funct. Mater. 22 70-77 doi: 10.1002/adfm.201101846
[57]	Ahmed T, et al 2019 Multifunctional optoelectronics via harnessing defects in layered black phosphorus Adv. Funct. Mater. 29 1901991 doi: 10.1002/adfm.201901991
[58]	Li H, Jiang X, Ye W, Zhang H, Zhou L, Zhang F, She D, Zhou Y, Han S-T 2019 Fully photon modulated heterostructure for neuromorphic computing Nano Energy 65 104000 doi: 10.1016/j.nanoen.2019.104000
[59]	Ahmed T, et al 2021 Fully lightcontrolled memory and neuromorphic computation in layered black phosphorus Adv. Mater. 33 2004207 doi: 10.1002/adma.202004207
[60]	Hu L, Yang J, Wang J, Cheng P, Chua L O, Zhuge F 2021 Alloptically controlled memristor for optoelectronic neuromorphic computing Adv. Funct. Mater. 31 2005582 doi: 10.1002/adfm.202005582
[61]	Shan X, et al 2022 Plasmonic optoelectronic memristor enabling fully lightmodulated synaptic plasticity for neuromorphic vision Adv. Sci. 9 2104632 doi: 10.1002/advs.202104632
[62]	Qiao Q, Zhang X, Lu Z, Wang L, Liu Y, Zhu X, Li J 2009 Formation of holographic fringes on photochromic Ag/TiO₂ nanocomposite films Appl. Phys. Lett. 94 074104 doi: 10.1063/1.3078232
[63]	Xie D, Gao G, Tian B, Shu Z, Duan H, Zhao -W-W, He J, Jiang J 2023 Porous metal-organic framework/ReS₂ heterojunction phototransistor for polarizationsensitive visual adaptation emulation Adv. Mater. 35 2212118 doi: 10.1002/adma.202212118
[64]	Xie D, Yin K, Yang Z, Huang H, Li X, Shu Z, Duan H, He J, Jiang J 2022 Polarization-perceptual anisotropic two-dimensional ReS₂ neuro-transistor with reconfigurable neuromorphic vision Mater. Horiz. 9 1448-59 doi: 10.1039/D1MH02036F
[65]	Liu Q, Wei Q, Ren H, Zhou L, Zhou Y, Wang P, Wang C, Yin J, Li M 2023 Circular polarization-resolved ultraviolet photonic artificial synapse based on chiral perovskite Nat. Commun. 14 7179 doi: 10.1038/s41467-023-43034-3
[66]	Lv Z, Hu Q, Xu Z, Wang J, Chen Z, Wang Y, Chen M, Zhou K, Zhou Y, Han S-T 2019 Organic memristor utilizing copper phthalocyanine nanowires with infrared response and cation regulating properties Adv. Electron. Mater. 5 1800793 doi: 10.1002/aelm.201800793
[67]	Kim T, Choi C, Hur J, Ha D, Kuh B J, Kim Y, Cho M H, Kim S, Jeong J K 2022 Progress, challenges, and opportunities in oxide semiconductor devices: a key building block for applications ranging from display backplanes to 3D integrated semiconductor chips Adv. Mater. 35 2204663 doi: 10.1002/adma.202204663
[68]	Zhu J, Zhang X, Wang R, Wang M, Chen P, Cheng L, Wu Z, Wang Y, Liu Q, Liu M 2022 A heterogeneously integrated spiking neuron array for multimodefused perception and object classification Adv. Mater. 34 2200481 doi: 10.1002/adma.202200481
[69]	Brattoli M, De Gennaro G, De Pinto V, Demarinis Loiotile A, Lovascio S, Penza M 2011 Odour detection methods: olfactometry and chemical sensors Sensors 11 5290-322 doi: 10.3390/s110505290
[70]	Plutowska B, Wardencki W 2008 Application of gas chromatography-olfactometry (GC-O) in analysis and quality assessment of alcoholic beverages-a review Food Chem. 107 449-63 doi: 10.1016/j.foodchem.2007.08.058
[71]	Baldovini N, Chaintreau A 2020 Identification of key odorants in complex mixtures occurring in nature Nat. Prod. Rep. 37 1589-626 doi: 10.1039/d0np00020e
[72]	Song Z, Tong Y, Zhao X, Ren H, Tang Q, Liu Y 2019 A flexible conformable artificial organ-damage memory system towards hazardous gas leakage based on a single organic transistor Mater. Horiz. 6 717-26 doi: 10.1039/C8MH01577E
[73]	Kolarik A J, Moore B C J, Zahorik P, Cirstea S, Pardhan S 2016 Auditory distance perception in humans: a review of cues, development, neuronal bases, and effects of sensory loss Atten. Percept. Psychophys. 78 373-95 doi: 10.3758/s13414-015-1015-1
[74]	Wang W, Pedretti G, Milo V, Carboni R, Calderoni A, Ramaswamy N, Spinelli A S, Ielmini D 2018 Learning of spatiotemporal patterns in a spiking neural network with resistive switching synapses Sci. Adv. 4 eaat4752 doi: 10.1126/sciadv.aat4752
[75]	Ji X, Zhao X, Tan M, Zhao R 2020 Artificial perception built on memristive system: visual, auditory, and tactile sensations Adv. Intell. Syst. 2 1900118 doi: 10.1002/aisy.201900118
[76]	Yu J, Zeng F, Wan Q, Lu Z, Pan F 2023 Emulation of auditory senses depending on chaotic dynamics of threshold switching memristor InfoMat 5 e12458 doi: 10.1002/inf2.12458
[77]	Coen M H 2001 Multimodal integration-a biological view Int. Joint Conf. on Artificial Intelligence [bold]vol 17[/bold](Lawrence Erlbaum Associates Ltd) 1417-24
[78]	Navarro-Guerrero N, Toprak S, Josifovski J, Jamone L 2023 Visuo-haptic object perception for robots: an overview Auton. Robots 47 377-403 doi: 10.1007/s10514-023-10091-y
[79]	Steil J J, Rthling F, Haschke R, Ritter H 2004 Situated robot learning for multi-modal instruction and imitation of grasping Robot. Auton. Syst. 47 129-41 doi: 10.1016/j.robot.2004.03.007
[80]	Yu J, Yang X, Gao G, Xiong Y, Wang Y, Han J, Chen Y, Zhang H, Sun Q, Wang Z L 2021 Bioinspired mechano-photonic artificial synapse based on graphene/MoS₂ heterostructure Sci. Adv. 7 eabd9117 doi: 10.1126/sciadv.abd9117
[81]	Wang Y, et al 2021 MXeneZnO memristor for multimodal insensor computing Adv. Funct. Mater. 31 2100144 doi: 10.1002/adfm.202100144

Relative Articles

Supplements(0)

Cited By

Article Statistics

Article Statistics

Figures(12)

Citation Export

PDF

XML

Article Metrics

Article Views(552) PDF downloads(151)

Emerging multimodal memristors for biorealistic neuromorphic applications

doi: 10.1088/2752-5724/ad119e

Abstract

References

Article Statistics

Catalog

Article Metrics

Article Statistics

Related articles from

Quick Links

Contact Us

Relevant Links

Emerging multimodal memristors for biorealistic neuromorphic applications

doi: 10.1088/2752-5724/ad119e

Abstract

References

Article Statistics

Catalog

Article Metrics

Article Statistics

Related articles from

Quick Links

Contact Us

Relevant Links

Export File

Citation

Format

Content