Volume 3 Issue 1
March  2024
Turn off MathJax
Article Contents
Xuanyu Shan, Ya Lin, Zhongqiang Wang, Xiaoning Zhao, Ye Tao, Haiyang Xu, Yichun Liu. Emerging multimodal memristors for biorealistic neuromorphic applications[J]. Materials Futures, 2024, 3(1): 012701. doi: 10.1088/2752-5724/ad119e
Citation: Xuanyu Shan, Ya Lin, Zhongqiang Wang, Xiaoning Zhao, Ye Tao, Haiyang Xu, Yichun Liu. Emerging multimodal memristors for biorealistic neuromorphic applications[J]. Materials Futures, 2024, 3(1): 012701. doi: 10.1088/2752-5724/ad119e
Topical Review •

Emerging multimodal memristors for biorealistic neuromorphic applications

© 2024 The Author(s). Published by IOP Publishing Ltd on behalf of the Songshan Lake Materials Laboratory
Materials Futures, Volume 3, Number 1
  • Received Date: 2023-10-07
  • Accepted Date: 2023-11-23
  • Rev Recd Date: 2023-11-13
  • Publish Date: 2024-01-03
  • The integration of sensory information from different modalities, such as touch and vision, is essential for organisms to perform behavioral functions such as decision-making, learning, and memory. Artificial implementation of human multi-sensory perception using electronic supports is of great significance for achieving efficient human-machine interaction. Thanks to their structural and functional similarity with biological synapses, memristors are emerging as promising nanodevices for developing artificial neuromorphic perception. Memristive devices can sense multidimensional signals including light, pressure, and sound. Their in-sensor computing architecture represents an ideal platform for efficient multimodal perception. We review recent progress in multimodal memristive technology and its application to neuromorphic perception of complex stimuli carrying visual, olfactory, auditory, and tactile information. At the device level, the operation model and undergoing mechanism have also been introduced. Finally, we discuss the challenges and prospects associated with this rapidly progressing field of research.
  • loading
  • [1]
    Shi Q, Dong B, He T, Sun Z, Zhu J, Zhang Z, Lee C 2020 Progress in wearable electronics/photonicsmoving toward the era of artificial intelligence and internet of things InfoMat 2 1131-62 doi: 10.1002/inf2.12122
    Yan Z, et al 2021 Flexible highresolution triboelectric sensor array based on patterned laserinduced graphene for selfpowered realtime tactile sensing Adv. Funct. Mater. 31 2100709 doi: 10.1002/adfm.202100709
    Liang S J, Li Y, Cheng B, Miao F 2022 Emerging lowdimensional heterostructure devices for neuromorphic computing Small Struct. 3 2200064 doi: 10.1002/sstr.202200064
    Du J, et al 2021 A robust neuromorphic vision sensor with optical control of ferroelectric switching Nano Energy 89 106439 doi: 10.1016/j.nanoen.2021.106439
    Wang Y, et al 2023 A three-dimensional neuromorphic photosensor array for nonvolatile in-sensor computing Nano Lett. 23 4523-32 doi: 10.1021/acs.nanolett.3c00899
    Leo F, Bolognini N, Passamonti C, Stein B E, Ladavas E 2008 Cross-modal localization in hemianopia: new insights on multisensory integration Brain 131 855-65 doi: 10.1093/brain/awn003
    Frgnac Y, Bathellier B 2015 Cortical correlates of low-level perception: from neural circuits to percepts Neuron 88 110-26 doi: 10.1016/j.neuron.2015.09.041
    Tan H, Zhou Y, Tao Q, Rosen J, van Dijken S 2021 Bioinspired multisensory neural network with crossmodal integration and recognition Nat. Commun. 12 1120 doi: 10.1038/s41467-021-21404-z
    Albustanji R N, Elmanaseer S, Alkhatib A A A 2023 Robotics: five senses plus onean overview Robotics 12 68 doi: 10.3390/robotics12030068
    Wan C, Cai P, Guo X, Wang M, Matsuhisa N, Yang L, Lv Z, Luo Y, Loh X J, Chen X 2020 An artificial sensory neuron with visual-haptic fusion Nat. Commun. 11 4602 doi: 10.1038/s41467-020-18375-y
    Zhao B, Zhao X, Li Q, Xun X, Ouyang T, Zhang Z, Kang Z, Liao Q, Zhang Y 2022 Reproducible and lowpower multistate biomemristor from interpenetrating network electrolyte design InfoMat 4 e12350 doi: 10.1002/inf2.12350
    Lin Y, Meng F, Zeng T, Zhang Q, Wang Z, Cheng Y, Zhao X, Gu L, Xu H, Liu Y 2023 Direct observation of oxygen ion dynamics in a WO3x based secondorder memristor with dendritic integration functions Adv. Funct. Mater. 33 2302787 doi: 10.1002/adfm.202302787
    Yan X, Zhao J, Liu S, Zhou Z, Liu Q, Chen J, Liu X Y 2018 Memristor with Agclusterdoped TiO2 films as artificial synapse for neuroinspired computing Adv. Funct. Mater. 28 1705320 doi: 10.1002/adfm.201705320
    Xu L, Yuan R, Zhu Z, Liu K, Jing Z, Cai Y, Wang Y, Yang Y, Huang R 2019 Memristorbased efficient inmemory logic for cryptologic and arithmetic applications Adv. Mater. Technol. 4 1900212 doi: 10.1002/admt.201900212
    Tan H, Liu G, Yang H, Yi X, Pan L, Shang J, Long S, Liu M, Wu Y, Li R-W 2017 Light-gated memristor with integrated logic and memory functions ACS Nano 11 11298-305 doi: 10.1021/acsnano.7b05762
    Jo S H, Chang T, Ebong I, Bhadviya B B, Mazumder P, Lu W 2010 Nanoscale memristor device as synapse in neuromorphic systems Nano Lett. 10 1297-301 doi: 10.1021/nl904092h
    Wang Z Q, Xu H Y, Li X H, Yu H, Liu Y C, Zhu X J 2012 Synaptic learning and memory functions achieved using oxygen ion migration/diffusion in an amorphous InGaZnO memristor Adv. Funct. Mater. 22 2759-65 doi: 10.1002/adfm.201103148
    Lin H, Wang C, Hong Q, Sun Y 2020 A multi-stable memristor and its application in a neural network IEEE Trans. Circuits Syst. II 67 3472-6 doi: 10.1109/TCSII.2020.3000492
    Choi S, Jang S, Moon J-H, Kim J C, Jeong H Y, Jang P, Lee K-J, Wang G 2018 A self-rectifying TaOy/nanoporous TaOx memristor synaptic array for learning and energy-efficient neuromorphic systems NPG Asia Mater. 10 1097-106 doi: 10.1038/s41427-018-0101-y
    Kim S, Kim H, Hwang S, Kim M-H, Chang Y-F, Park B-G 2017 Analog synaptic behavior of a silicon nitride memristor ACS Appl. Mater. Interfaces 9 40420-7 doi: 10.1021/acsami.7b11191
    Zhang C, et al 2019 Bioinspired artificial sensory nerve based on nafion memristor Adv. Funct. Mater. 29 1808783 doi: 10.1002/adfm.201808783
    Lee D, Chae M, Jung J, Kim H D 2023 Correlation between sensing accuracy and read margin of a memristor-based NO gas sensor array estimated by neural network analysis ACS Sens. 8 2105-14 doi: 10.1021/acssensors.3c00541
    Zhou Y, et al 2020 Black phosphorus based multicolor light-modulated transparent memristor with enhanced resistive switching performance ACS Appl. Mater. Interfaces 12 25108-14 doi: 10.1021/acsami.0c04493
    Yan B, Kuang D, Wang W, Wang Y, Sun B, Zhou G 2022 Investigation of multi-photoconductance state induced by light-sensitive defect in TiOx-based memristor Appl. Phys. Lett. 120 253506 doi: 10.1063/5.0097106
    Park J, Lee S, Lee J, Yong K 2013 A light incident angle switchable ZnO nanorod memristor: reversible switching behavior between two nonvolatile memory devices Adv. Mater. 25 6423-9 doi: 10.1002/adma.201303017
    Chen S, Lou Z, Chen D, Shen G 2018 An artificial flexible visual memory system based on an UVmotivated memristor Adv. Mater. 30 1705400 doi: 10.1002/adma.201705400
    Wu X, Li E, Liu Y, Lin W, Yu R, Chen G, Hu Y, Chen H, Guo T 2021 Artificial multisensory integration nervous system with haptic and iconic perception behaviors Nano Energy 85 106000 doi: 10.1016/j.nanoen.2021.106000
    Duan Q, Zhang T, Liu C, Yuan R, Li G, Jun Tiw P, Yang K, Ge C, Yang Y, Huang R 2022 Artificial multisensory neurons with fused haptic and temperature perception for multimodal insensor computing Adv. Intell. Syst. 4 2200039 doi: 10.1002/aisy.202200039
    Pei Y, et al 2022 A multifunctional and efficient artificial visual perception nervous system with Sb2Se3/CdSCore/Shell (SC) nanorod arrays optoelectronic memristor Adv. Funct. Mater. 32 2203454 doi: 10.1002/adfm.202203454
    Wang T-Y, Meng J-L, Li Q-X, He Z-Y, Zhu H, Ji L, Sun Q-Q, Chen L, Zhang D W 2021 Reconfigurable optoelectronic memristor for in-sensor computing applications Nano Energy 89 106291 doi: 10.1016/j.nanoen.2021.106291
    Sun L, Wang Z, Jiang J, Kim Y, Joo B, Zheng S, Lee S, Yu W J, Kong B-S, Yang H 2021 In-sensor reservoir computing for language learning via two-dimensional memristors Sci. Adv. 7 eabg1455 doi: 10.1126/sciadv.abg1455
    Bae B, Park M, Lee D, Sim I, Lee K 2023 Heterointegrated InGaAs photodiode and oxide memristorbased artificial optical nerve for insensor NIR image processing Adv. Opt. Mater. 11 2201905 doi: 10.1002/adom.202201905
    Sun J, et al 2022 A dual-mode organic memristor for coordinated visual perceptive computing Fundam. Res. doi: 10.1016/j.fmre.2022.06.022
    Dang B, et al 2020 Physically transient optic-neural synapse for secure in-sensor computing IEEE Electron Device Lett. 41 1641-4 doi: 10.1109/LED.2020.3025791
    Li Z, Tang W, Zhang B, Yang R, Miao X 2023 Emerging memristive neurons for neuromorphic computing and sensing Sci. Technol. Adv. Mater. 24 2188878 doi: 10.1080/14686996.2023.2188878
    Liu H, et al 2023 Artificial neuronal devices based on emerging materials: neuronal dynamics and applications Adv. Mater. 35 2205047 doi: 10.1002/adma.202205047
    Wang M, et al 2022 Tactile nearsensor analogue computing for ultrafast responsive artificial skin Adv. Mater. 34 2201962 doi: 10.1002/adma.202201962
    Cho S W, Kwon S M, Kim Y-H, Park S K 2021 Recent progress in transistorbased optoelectronic synapses: from neuromorphic computing to artificial sensory system Adv. Intell. Syst. 3 2000162 doi: 10.1002/aisy.202000162
    Yuan Y, et al 2023 Artificial leaky integrate-and-fire sensory neuron for in-sensor computing neuromorphic perception at the edge ACS Sens. 8 2646-55 doi: 10.1021/acssensors.3c00487
    Yuan R, et al 2022 A calibratable sensory neuron based on epitaxial VO2 for spike-based neuromorphic multisensory system Nat. Commun. 13 3973 doi: 10.1038/s41467-022-31747-w
    John R A, et al 2021 Diffusive and drift halide perovskite memristive barristors as nociceptive and synaptic emulators for neuromorphic computing Adv. Mater. 33 2007851 doi: 10.1002/adma.202007851
    Seo S, et al 2018 Artificial optic-neural synapse for colored and color-mixed pattern recognition Nat. Commun. 9 5106 doi: 10.1038/s41467-018-07572-5
    Zhou F, et al 2019 Optoelectronic resistive random access memory for neuromorphic vision sensors Nat. Nanotechnol. 14 776-82 doi: 10.1038/s41565-019-0501-3
    Sun L, Zhang Y, Hwang G, Jiang J, Kim D, Eshete Y A, Zhao R, Yang H 2018 Synaptic computation enabled by Joule heating of single-layered semiconductors for sound localization Nano Lett. 18 3229-34 doi: 10.1021/acs.nanolett.8b00994
    Zeng T, Wang Z, Lin Y, Cheng Y, Shan X, Tao Y, Zhao X, Xu H, Liu Y 2023 Doppler frequencyshift information processing in WOxbased memristive synapse for auditory motion perception Adv. Sci. 10 2300030 doi: 10.1002/advs.202300030
    Wang T, Huang H M, Wang X X, Guo X 2021 An artificial olfactory inference system based on memristive devices InfoMat 3 804-13 doi: 10.1002/inf2.12196
    Qian C, Choi Y, Choi Y J, Kim S, Choi Y Y, Roe D G, Kang M S, Sun J, Cho J H 2020 Oxygendetecting synaptic device for realization of artificial autonomic nervous system for maintaining oxygen homeostasis Adv. Mater. 32 2002653 doi: 10.1002/adma.202002653
    Jiang C, Tan D, Sun N, Huang J, Ji R, Li Q, Bi S, Guo Q, Wang X, Song J 2021 60 nm Pixel-size pressure piezo-memory system as ultrahigh-resolution neuromorphic tactile sensor for in-chip computing Nano Energy 87 106190 doi: 10.1016/j.nanoen.2021.106190
    Ayyad A, Halwani M, Swart D, Muthusamy R, Almaskari F, Zweiri Y 2023 Neuromorphic vision based control for the precise positioning of robotic drilling systems Robot. Comput.-Integr. Manuf. 79 102419 doi: 10.1016/j.rcim.2022.102419
    Cho S W, Jo C, Kim Y H, Park S K 2022 Progress of materials and devices for neuromorphic vision sensors Nano-Micro Lett. 14 203 doi: 10.1007/s40820-022-00945-y
    Kumar D, Li H, Das U K, Syed A M, ElAtab N 2023 Flexible solution processable black phosphorus based optoelectronic memristive synapse for neuromorphic computing and artificial visual perception applications Adv. Mater. 35 2300446 doi: 10.1002/adma.202300446
    Chen W, Zhang Z, Liu G 2022 Retinomorphic optoelectronic devices for intelligent machine vision Iscience 25 103729 doi: 10.1016/j.isci.2021.103729
    Subin P S, Midhun P S, Antony A, Saji K J, Jayaraj M K 2022 Optoelectronic synaptic plasticity mimicked in ZnO-based artificial synapse for neuromorphic image sensing application Mater. Today Commun. 33 104232 doi: 10.1016/j.mtcomm.2022.104232
    Ai L, Pei Y, Song Z, Yong X, Song H, Liu G, Nie M, Waterhouse G I N, Yan X, Lu S 2023 Ligandtriggered selfassembly of flexible carbon dot nanoribbons for optoelectronic memristor devices and neuromorphic computing Adv. Sci. 10 2207688 doi: 10.1002/advs.202207688
    Kong N S P, Ibrahim H 2008 Color image enhancement using brightness preserving dynamic histogram equalization IEEE Trans. Consum. Electron. 54 1962-8 doi: 10.1109/TCE.2008.4711259
    Tsuruoka T, Terabe K, Hasegawa T, Valov I, Waser R, Aono M 2012 Effects of moisture on the switching characteristics of oxide-based, gapless-type atomic switches Adv. Funct. Mater. 22 70-77 doi: 10.1002/adfm.201101846
    Ahmed T, et al 2019 Multifunctional optoelectronics via harnessing defects in layered black phosphorus Adv. Funct. Mater. 29 1901991 doi: 10.1002/adfm.201901991
    Li H, Jiang X, Ye W, Zhang H, Zhou L, Zhang F, She D, Zhou Y, Han S-T 2019 Fully photon modulated heterostructure for neuromorphic computing Nano Energy 65 104000 doi: 10.1016/j.nanoen.2019.104000
    Ahmed T, et al 2021 Fully lightcontrolled memory and neuromorphic computation in layered black phosphorus Adv. Mater. 33 2004207 doi: 10.1002/adma.202004207
    Hu L, Yang J, Wang J, Cheng P, Chua L O, Zhuge F 2021 Alloptically controlled memristor for optoelectronic neuromorphic computing Adv. Funct. Mater. 31 2005582 doi: 10.1002/adfm.202005582
    Shan X, et al 2022 Plasmonic optoelectronic memristor enabling fully lightmodulated synaptic plasticity for neuromorphic vision Adv. Sci. 9 2104632 doi: 10.1002/advs.202104632
    Qiao Q, Zhang X, Lu Z, Wang L, Liu Y, Zhu X, Li J 2009 Formation of holographic fringes on photochromic Ag/TiO2 nanocomposite films Appl. Phys. Lett. 94 074104 doi: 10.1063/1.3078232
    Xie D, Gao G, Tian B, Shu Z, Duan H, Zhao -W-W, He J, Jiang J 2023 Porous metal-organic framework/ReS2 heterojunction phototransistor for polarizationsensitive visual adaptation emulation Adv. Mater. 35 2212118 doi: 10.1002/adma.202212118
    Xie D, Yin K, Yang Z, Huang H, Li X, Shu Z, Duan H, He J, Jiang J 2022 Polarization-perceptual anisotropic two-dimensional ReS2 neuro-transistor with reconfigurable neuromorphic vision Mater. Horiz. 9 1448-59 doi: 10.1039/D1MH02036F
    Liu Q, Wei Q, Ren H, Zhou L, Zhou Y, Wang P, Wang C, Yin J, Li M 2023 Circular polarization-resolved ultraviolet photonic artificial synapse based on chiral perovskite Nat. Commun. 14 7179 doi: 10.1038/s41467-023-43034-3
    Lv Z, Hu Q, Xu Z, Wang J, Chen Z, Wang Y, Chen M, Zhou K, Zhou Y, Han S-T 2019 Organic memristor utilizing copper phthalocyanine nanowires with infrared response and cation regulating properties Adv. Electron. Mater. 5 1800793 doi: 10.1002/aelm.201800793
    Kim T, Choi C, Hur J, Ha D, Kuh B J, Kim Y, Cho M H, Kim S, Jeong J K 2022 Progress, challenges, and opportunities in oxide semiconductor devices: a key building block for applications ranging from display backplanes to 3D integrated semiconductor chips Adv. Mater. 35 2204663 doi: 10.1002/adma.202204663
    Zhu J, Zhang X, Wang R, Wang M, Chen P, Cheng L, Wu Z, Wang Y, Liu Q, Liu M 2022 A heterogeneously integrated spiking neuron array for multimodefused perception and object classification Adv. Mater. 34 2200481 doi: 10.1002/adma.202200481
    Brattoli M, De Gennaro G, De Pinto V, Demarinis Loiotile A, Lovascio S, Penza M 2011 Odour detection methods: olfactometry and chemical sensors Sensors 11 5290-322 doi: 10.3390/s110505290
    Plutowska B, Wardencki W 2008 Application of gas chromatography-olfactometry (GC-O) in analysis and quality assessment of alcoholic beverages-a review Food Chem. 107 449-63 doi: 10.1016/j.foodchem.2007.08.058
    Baldovini N, Chaintreau A 2020 Identification of key odorants in complex mixtures occurring in nature Nat. Prod. Rep. 37 1589-626 doi: 10.1039/d0np00020e
    Song Z, Tong Y, Zhao X, Ren H, Tang Q, Liu Y 2019 A flexible conformable artificial organ-damage memory system towards hazardous gas leakage based on a single organic transistor Mater. Horiz. 6 717-26 doi: 10.1039/C8MH01577E
    Kolarik A J, Moore B C J, Zahorik P, Cirstea S, Pardhan S 2016 Auditory distance perception in humans: a review of cues, development, neuronal bases, and effects of sensory loss Atten. Percept. Psychophys. 78 373-95 doi: 10.3758/s13414-015-1015-1
    Wang W, Pedretti G, Milo V, Carboni R, Calderoni A, Ramaswamy N, Spinelli A S, Ielmini D 2018 Learning of spatiotemporal patterns in a spiking neural network with resistive switching synapses Sci. Adv. 4 eaat4752 doi: 10.1126/sciadv.aat4752
    Ji X, Zhao X, Tan M, Zhao R 2020 Artificial perception built on memristive system: visual, auditory, and tactile sensations Adv. Intell. Syst. 2 1900118 doi: 10.1002/aisy.201900118
    Yu J, Zeng F, Wan Q, Lu Z, Pan F 2023 Emulation of auditory senses depending on chaotic dynamics of threshold switching memristor InfoMat 5 e12458 doi: 10.1002/inf2.12458
    Coen M H 2001 Multimodal integration-a biological view Int. Joint Conf. on Artificial Intelligence [bold]vol 17[/bold](Lawrence Erlbaum Associates Ltd) 1417-24
    Navarro-Guerrero N, Toprak S, Josifovski J, Jamone L 2023 Visuo-haptic object perception for robots: an overview Auton. Robots 47 377-403 doi: 10.1007/s10514-023-10091-y
    Steil J J, Rthling F, Haschke R, Ritter H 2004 Situated robot learning for multi-modal instruction and imitation of grasping Robot. Auton. Syst. 47 129-41 doi: 10.1016/j.robot.2004.03.007
    Yu J, Yang X, Gao G, Xiong Y, Wang Y, Han J, Chen Y, Zhang H, Sun Q, Wang Z L 2021 Bioinspired mechano-photonic artificial synapse based on graphene/MoS2 heterostructure Sci. Adv. 7 eabd9117 doi: 10.1126/sciadv.abd9117
    Wang Y, et al 2021 MXeneZnO memristor for multimodal insensor computing Adv. Funct. Mater. 31 2100144 doi: 10.1002/adfm.202100144
  • 加载中



    Article Metrics

    Article Views(543) PDF downloads(151)
    Article Statistics
    Related articles from


    DownLoad:  Full-Size Img  PowerPoint