Skip to content

BINUCOE/Awesome-Neuromorphic-Navigation-Resources

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

26 Commits
 
 
 
 
 
 

Repository files navigation

Awesome-Neuromorphic-Navigation-Resources Awesome

Neuromorphic Navigation

This is a repository of Neuromorphic Navigation survey from Southeast University, Nanjing, China.

It aims to provide a curated collection of resources for researchers and practitioners interested in neuromorphic navigation, including datasets, hardware platforms, and software tools.

If you find this repository helpful, please consider Stars ⭐ or Sharing 👋.

Note

If you find any missing resources, feel free to submit a Pull Request or open an Issue. We're thrilled to collaborate with you on this repository.

BibTeX Citation

@article{zhang2026survey,
  author = {Zhang, Youdong and He, Xu and Meng, Xiaolin and et al.},
  title = {A Survey on Neuromorphic Navigation: Implementation Resources, Challenges and Perspectives},
  journal = {TechRxiv},
  year = {2026},
  month = {feb},
  doi = {10.36227/techrxiv.177040597.75784815/v1},
  note = {Preprint}
}

🧠 Neuromorphic Resource Decision Guide

🌳 Decision Tree Flowchart

graph TD
    %% 定义样式类别
    classDef startNode fill:#f9f,stroke:#333,stroke-width:2px;
    classDef decisionNode fill:#bbf,stroke:#333,stroke-width:2px;
    classDef hardwareNode fill:#ffb,stroke:#333,stroke-width:1px;
    classDef softwareNode fill:#bfb,stroke:#333,stroke-width:1px;
    classDef repoNode fill:#eee,stroke:#333,stroke-width:1px,stroke-dasharray: 5 5;

    %% 主流程起点
    A([Start: What is your primary goal?]):::startNode --> B{Hardware Deployment?}:::decisionNode
    A --> C{Algorithm & Simulation?}:::decisionNode

    %% 硬件分支
    B -- Yes --> D[Which Target Platform?]:::hardwareNode
    D -- Intel Loihi Series --> H1[(Lava)]:::repoNode
    D -- SpiNNaker Series --> H2[(sPyNNaker / PyNN)]:::repoNode
    D -- SynSense Speck/Dynap --> H3[(Samna)]:::repoNode
    D -- BrainScaleS --> H4[(BrainScaleS OS)]:::repoNode

    %% 软件与算法分支
    C -- Neuroscience / Bio-plausible --> E[Focus on Local Learning e.g., STDP]:::softwareNode
    E --> S1[(Brian 2 / NEST / BindsNET)]:::repoNode

    C -- Deep Learning Integration --> F[Preferred Training Method?]:::softwareNode
    
    %% 深度学习训练方法分支
    F -- ANN-to-SNN Conversion --> S2[(SNN Toolbox / SpikingJelly)]:::repoNode
    F -- Direct Training with Surrogate Gradients --> S3[(snnTorch / Norse / SpikingJelly)]:::repoNode
    F -- Both / General Purpose --> S4[(SpikingJelly / snnTorch)]:::repoNode
Loading

Data Resources

Real-World Datasets

Dataset Pub. Paper Open Resource
DAVIS240C IJRR-2017 The event-camera dataset and simulator: Event-based data for pose estimation, visual odometry, and SLAM Website
MVSEC RAL-2018 The Multivehicle Stereo Event Camera Dataset: An Event Camera Dataset for 3D Perception Website
DSEC RAL-2021 DSEC: A Stereo Event Camera Dataset for Driving Scenarios GitHub
M2DGR RAL-2022 M2DGR: A Multi-Sensor and Multi-Scenario SLAM Dataset for Ground Robots GitHub
UZH-FPV ICRA-2019 Are We Ready for Autonomous Drone Racing? The UZH-FPV Drone Racing Dataset Website
D-eDVS ICRA-2014 Event-based 3D SLAM with a depth-augmented dynamic vision sensor -
DDD17 ICML-2017 DDD17: End-To-End DAVIS Driving Dataset Website
DDD20 ITSC-2020 DDD20 End-to-End Event Camera Driving Dataset: Fusing Frames and Events with Deep Learning for Improved Steering Prediction Website
VECtor RAL-2022 VECtor: A Versatile Event-Centric Benchmark for Multi-Sensor SLAM Website
ViViD++ RAL-2022 ViViD++ : Vision for Visibility Dataset Website
TUM-VIE IROS-2021 TUM-VIE: The TUM Stereo Visual-Inertial Event Dataset Website
Brisbane-Event-VPR RAL-2020 Event-Based Visual Place Recognition With Ensembles of Temporal Windows GitHub
GRIFFIN RAL-2021 The GRIFFIN Perception Dataset: Bridging the Gap Between Flapping-Wing Flight and Robotic Perception Website
AGRI-EBV ICRA-2021 An Event-based Vision Dataset for Visual Navigation Tasks in Agricultural Environments Website
FusionPortable IROS-2022 FusionPortable: A Multi-Sensor Campus-Scene Dataset for Evaluation of Localization and Mapping Accuracy on Diverse Platforms Website
M3ED CVPRW-2023 M3ED: Multi-Robot, Multi-Sensor, Multi-Environment Event Dataset GitHub
Hadviger et al. ECMR-2023 Stereo Visual Localization Dataset Featuring Event Cameras Website
PKU-DAVIS-SOD TPAMI-2023 SODFormer: Streaming Object Detection With Transformer Using Events and Frames Website
ECMD TIV-2024 ECMD: An Event-Centric Multisensory Driving Dataset for SLAM GitHub
MA-VIED TITS-2024 MA-VIED: A Multisensor Automotive Visual Inertial Event Dataset GitHub
CEAR RAL-2024 CEAR: Comprehensive Event Camera Dataset for Rapid Perception of Agile Quadruped Robots GitHub
NSAVP IJRR-2025 Dataset and Benchmark: Novel Sensors for Autonomous Vehicle Perception Website
M2P2 ArXiv-2025 M2P2: A Multi-Modal Passive Perception Dataset for Off-Road Mobility in Extreme Low-Light Conditions Website
M3DSS ICRA-2025 M3DSS: A Multi-Platform, Multi-Sensor, and Multi-Scenario Dataset for SLAM System GitHub
NYC-Event-VPR ICRA-2025 NYC-Event-VPR: A Large-Scale High-Resolution Event-Based Visual Place Recognition Dataset in Dense Urban Environments GitHub
FusionPortableV2 IJRR-2025 FusionPortableV2: A unified multi-sensor dataset for generalized SLAM across diverse platforms and scalable environments Website
  • ITSC: International Conference on Intelligent Transportation Systems
  • ECMR: European Conference on Mobile Robots

Event Simulators and Simulated Datasets

Event Simulators

Simulator Pub. Paper Open Resource
ESIM CoRL-2018 ESIM: an Open Event Camera Simulator GitHub
v2e CVPRW-2021 v2e: From Video Frames to Realistic DVS Events GitHub
DVS Gazebo Plugin SIMPAR-2016 Towards a framework for end-to-end control of a simulated vehicle with spiking neural networks -
PIX2NVS ICIP-2017 PIX2NVS: Parameterized conversion of pixel-domain video frames to neuromorphic vision streams GitHub
pyDVS SSCI-2016 pyDVS: An extensible, real-time Dynamic Vision Sensor emulator using off-the-shelf hardware GitHub
EventGAN ICCP-2021 EventGAN: Leveraging Large Scale Image Datasets for Event Cameras GitHub
ViSim ArXiv-2018 InteriorNet: Mega-scale Multi-sensor Photo-realistic Indoor Scenes Dataset Website
VID2E CVPR-2020 Video to Events: Recycling Video Datasets for Event Cameras GitHub
ICNS Frontiers in Neuroscience-2021 Event Camera Simulator Improvements via Characterized Parameters GitHub
VISTA ICRA-2022 VISTA 2.0: An Open, Data-driven Simulator for Multimodal Sensing and Policy Learning for Autonomous Vehicles GitHub
DVS-Voltmeter ECCV-2022 DVS-Voltmeter: Stochastic Process-Based Event Simulator for Dynamic Vision Sensors GitHub
V2CE ICRA-2024 V2CE: Video to Continuous Events Simulator GitHub
EREBUS ArXiv-2025 EREBUS: End-to-end Robust Event Based Underwater Simulation GitHub
  • CoRL: Conference on Robot Learning
  • SIMPAR: IEEE International Conference on Simulation, Modeling, and Programming for Autonomous Robots
  • ICIP: IEEE International Conference on Image Processing
  • SSCI: IEEE Symposium Series on Computational Intelligence
  • ICCP: IEEE International Conference on Computational Photography

Representative Work Using Simulated Datasets

Hardware Resources

Neuromorphic Sensors

Vision Sensors

Sensor Pub. Paper Link
DVS IEEE Journal of Solid-State Circuits-2008 A 128 × 128 120 dB 15 μs Latency Asynchronous Temporal Contrast Vision Sensor -
ATIS ISSCC-2010 A QVGA 143dB dynamic range asynchronous address-event PWM dynamic image sensor with lossless pixel-level video compression -
DAVIS240 IEEE Journal of Solid-State Circuits-2014 A 240 × 180 130 dB 3 µs Latency Global Shutter Spatiotemporal Vision Sensor Link
DAVIS346 IEEE Trans. Circuits Syst. II-Express Briefs-2018 Front and Back Illuminated Dynamic and Active Pixel Vision Sensors Comparison Link
CeleX-V CVPRW-2019 Live Demonstration: CeleX-V: A 1M Pixel Multi-Mode Event-Based Sensor Link
Vidar Engineering-2023 1000× Faster Camera and Machine Vision with Ordinary Devices -
Speck Nat. Commun.-2024 Spike-based dynamic computing with asynchronous sensing-computing neuromorphic chip Link
Tianmouc Nature-2024 A vision chip with complementary pathways for open-world sensing -
Company Cameras / Devices Softwares/Tools
iniVation & SynSense DAVIS346, DAVIS346 AER, DVXplorer, DVXplorer Lite, DVXplorer Micro, DVXplorer S Duo, Stereo Kit Software Solutions
Prophesee Metavision® sensor GENX320, Metavision® sensor IMX636, Metavision® sensor IMX646, Metavision® sensor IMX637, Metavision® sensor IMX647,
GenX320 – CM2, GenX320 – 4×5, GenX320 – CN1, GenX320 – CN3
Metavision SDK

OpenEB
Lucid Vision Labs Triton2 EVS 0.9 MP Model (IMX636), Triton2 EVS 0.3 MP Model (IMX637)
IDS Imaging µEye XCP-E UE-39B0XCP-E (IMX636) Metavision SDK (≥ 4.6.2)
DVSense DVSLume, DVSLume-G1, DVSync DvsenseDriver
SONY IMX636, IMX637, IMX646, IMX647,

Auditory Sensors

  • AER EAR: A Matched Silicon Cochlea Pair With Address Event Representation Interface [Paper]
  • Asynchronous binaural spatial audition sensor with 2 × 64 × 4 channel output [Paper] [Link]
  • A 0.5V 55μW 64×2-channel binaural silicon cochlea for event-driven stereo-audio sensing [Paper]
  • Neuromorphic acoustic sensing using an adaptive microelectromechanical cochlea with integrated feedback [Paper]

Tactile Sensors

  • NeuroTac: A Neuromorphic Optical Tactile Sensor applied to Texture Recognition [Paper]
  • A spiking and adapting tactile sensor for neuromorphic applications [Paper]
  • An artificial piezotronic synapse for tactile perception [Paper]
  • Neuromorphic capacitive tactile sensors inspired by slowly adaptive mechanoreceptors [Paper]
  • Neuromorphic antennal sensory system [Paper]

Olfactory Sensors

  • Analog VLSI Circuit Implementation of an Adaptive Neuromorphic Olfaction Chip [Paper]
  • Artificial Olfactory Neuron for an In-Sensor Neuromorphic Nose [Paper]
  • A Neuromorphic Electronic Nose Design [Paper]
  • A bio-inspired neuromorphic olfaction system for highly sensitive and selective gas sensing at room temperature [Paper]
  • Gas localization and tracking using neuromorphic olfactory circuit with coupled sensors and memristive neurons [Paper]
  • Neuromorphic olfaction with ultralow-power gas sensors and ovonic threshold switch [Paper]

Wireless Sensors

  • NeuroRadar: A Neuromorphic Radar Sensor for Low-Power IoT Systems [Paper]
  • RF neuromorphic spiking sensor for smart IoT devices [Paper]
  • Neuromorphic Wireless Cognition: Event-Driven Semantic Communications for Remote Inference [Paper]
  • Neuromorphic Integrated Sensing and Communications [Paper]

Neuromorphic Processors

Chips Signals Architecture On-chip learning Process (nm) Neurons / Synapses Power (mW) Energy/SOP (pJ) Software
Neurogrid Mixed Async No 180 64 K / 100 M 2700 119 NEF
Braindrop Mixed Async Yes 28 4 K / 16 M N. A. 0.38 NEF
BrainScaleS Mixed Sync Yes 180 512 / 128 K N. A. 100 BrainScaleS OS
BrainScaleS2 Mixed Sync Yes 65 512 / 131 K ~1000 N. A. BrainScaleS OS
ROLLS Mixed Sync Yes 180 256 / 64 K ~5 N. A. PyNCS
Dynap-SE Mixed Async No 180 1024 / 65 K ~5 260 Samna
Dynap-SE2 Mixed Async Yes 180 1024 / 65 K N. A. 150 Samna
Loihi Digital Async Yes 14 128 K / 128 M ~1000 23.6 Lava
Loihi2 Digital Async Yes 7 1 M / 120 M <50 N. A. Lava
TrueNorth Digital Hybrid async-sync No 28 1 M / 256 M ~70 26 Corelet
NorthPole Digital Sync No 12 N. A. N. A. N. A. Custom
SpiNNaker Digital GALS Yes 130 18 K / 18 M ~1000 4000 PyNN, NEST
SpiNNaker2 Digital GALS Yes 22 Configuration ~1000 10 PyNN, NEST
Tianjic Digital Sync No 28 40 K / 10 M ~1000 1.54 LynOS
TianjicX Digital Hybrid async-sync Yes 28 160 K / 20 M ~600 N. A. LynOS
Darwin Digital Sync No 180 2048 / 4.19 M 0.84 N. A. DarwinOS
Darwin2 Digital Sync No 55 147 k / 10 M ~100 N. A. DarwinOS
Darwin3 Digital GALS Yes 22 2.3 M / — N. A. 5.47 DarwinOS

Architecture. Async: Asynchronous; Sync: Synchronous; GALS: Globally Asynchronous Locally Synchronous.

Software Resources

Algorithm Programming Tools

Software Year Programming Language Paper Open Resource
SNN-TB 2017 Python Conversion of Continuous-Valued Deep Networks to Efficient Event-Driven Networks for Image Classification GitHub
BindsNET 2018 Python BindsNET: A Machine Learning-Oriented Spiking Neural Networks Library in Python GitHub
SpykeTorch 2019 Python SpykeTorch: Efficient Simulation of Convolutional Spiking Neural Networks With at Most One Spike per Neuron GitHub
Sinabs 2019 Python - GitHub
cuSNN 2020 C++ Unsupervised Learning of a Hierarchical Spiking Neural Network for Optical Flow Estimation: From Events to Global Motion Perception GitHub
Norse 2021 Python - GitHub
EvtSNN 2022 C++ EvtSNN: Event-driven SNN simulator optimized by population and pre-filtering -
SNNtorch 2023 Python Training Spiking Neural Networks Using Lessons From Deep Learning GitHub
SpikingJelly 2023 Python SpikingJelly: An open-source machine learning infrastructure platform for spike-based intelligence GitHub
SPAIC 2024 Python SPAIC: A Spike-Based Artificial Intelligence Computing Framework GitHub

Brain Network Simulators

Software Year Programming Language Paper Open Resource
GENESIS 1988 Customized Language GENESIS: A System for Simulating Neural Networks Website
Brian 2008 Python Brian: a simulator for spiking neural networks in Python GitHub
PyNN 2008 Python PyNN: a common interface for neuronal network simulators GitHub
Brian2 2014 Python Equation-oriented specification of neural models for simulations GitHub
Nengo 2014 Python Nengo: a Python tool for building large-scale functional brain models GitHub
CARLsim 2015 C++ CARLsim 6: An Open Source Library for Large-Scale, Biologically Detailed Spiking Neural Network Simulation GitHub
NEST 2019 Python NEST: The Neural Simulation Tool GitHub
NEURON 2022 Customized Language, Python NEURON Simulation Environment Website
BrainCog 2023 Python BrainCog: A spiking neural network based, brain-inspired cognitive intelligence engine for brain-inspired AI and brain simulation GitHub
BrainPy 2023 Python BrainPy, a flexible, integrative, efficient, and extensible framework for general-purpose brain dynamics programming GitHub

Neuromorphic Hardware Toolchains

Software Year Programming Language Paper Open Resource
DV-SDK 2020 C++, Python - Website
Metavision SDK 2020 C++, Python - Website
NAVIS 2017 C# NAVIS: Neuromorphic Auditory VISualizer Tool GitHub
pyNAVIS 2021 Python pyNAVIS: An open-source cross-platform software for spike-based neuromorphic audio information processing GitHub
OpenNAS 2021 C++, VHDL OpenNAS: Open Source Neuromorphic Auditory Sensor HDL code generator for FPGA implementations GitHub
DarwinOS 2022 DarwinMDL Darwin-S: A Reference Software Architecture for Brain-Inspired Computers -
BrainScaleS OS 2022 C++, Python The operating system of the neuromorphic BrainScaleS-1 system -
LynOS 2021 C++, Python - Website
Lava 2021 Python - GitHub
sPyNNaker 2018 Python, C sPyNNaker: A Software Package for Running PyNN Simulations on SpiNNaker GitHub
Corelet 2013 Matlab Cognitive computing programming paradigm: A Corelet Language for composing networks of neurosynaptic cores -
Samma 2020 Python - Website
PyNCS 2014 Python PyNCS: a microkernel for high-level definition and configuration of neuromorphic electronic systems GitHub
NIR 2024 Python Neuromorphic intermediate representation: A unified instruction set for interoperable brain-inspired computing GitHub

Scene Simulators

Software Year Programming Language Paper Open Resource
Gazebo 2004 C++, Python Design and use paradigms for Gazebo, an open-source multi-robot simulator GitHub
DeepMind Lab 2016 Python DeepMind Lab GitHub
AI2-THOR 2017 C#, Python AI2-THOR: An Interactive 3D Environment for Visual AI GitHub
CARLA 2017 C++, Python CARLA: An Open Urban Driving Simulator GitHub
MINOS 2017 Python MINOS: Multimodal Indoor Simulator for Navigation in Complex Environments -
House3D 2018 C++, Python Building Generalizable Agents with a Realistic and Rich 3D Environment GitHub
Habitat 2019 Python Habitat: A Platform for Embodied AI Research GitHub
RoboTHOR 2020 Python RoboTHOR: An Open Simulation-to-Real Embodied AI Platform GitHub
LGSVL 2020 C# LGSVL Simulator: A High Fidelity Simulator for Autonomous Driving GitHub
AirSim 2020 Python AirSim Drone Racing Lab GitHub

Others

Software Year Programming Language Paper Open Resource
NRP 2017 Python Connecting Artificial Brains to Robots in a Comprehensive Simulation Framework: The Neurorobotics Platform Website
Tonic 2021 Python - GitHub
OpenRatSLAM 2013 MATLAB, C++, Python OpenRatSLAM: an open source brain-based SLAM system Website
SpikeCoding 2022 MATLAB, Python A toolbox for neuromorphic perception in robotics GitHub
CARLsim++ 2025 C++, Python An integrated toolbox for creating neuromorphic edge applications GitHub

Open Research and Development Communities

Open Neuromorphic is a global community dedicated to advancing education, research, and open-source collaboration in brain-inspired AI and neuromorphic computing.

The Intel Neuromorphic Research Community (Intel NRC) is an ecosystem of academic groups, government labs, research institutions, and companies around the world working with Intel to further neuromorphic computing and develop innovative AI applications.

NeuroPAC was launched in 2021 as an NSF-supported effort under the AccelNet (Accelerating Research through International Network-to-Network Collaborations) program led by the University of Maryland and Johns Hopkins University. Its goal is to network neuromorphic engineers with computational neuroscientists, roboticists, and computational theory and perception researchers to advance the foundations of Neuromorphic Intelligence.

Welcome to the brand new NEUROMORPHS home for all students, researchers, faculty, developers, entrepreneurs and all interested in the field of neuromorphic engineering and computing!
Here are the services available for our community:
- https://forum.neuromorphs.net (Flarum): this is a forum service for the community at large to share general news and results, make announcements and start discussions on topics related to neuromorphic engineering and computing. Here we can share information in smaller sub-groups and teams, but it is nice to have a place where all information is available to all.
- https://mm.neuromorphs.net (MatterMost): this is an open-source messaging service, similar to Slack, for small, focused groups to coordinate projects (such as Telluride or CapoCaccia work-groups), to get quick replies to questions or post announcements relevant to the specific group (e.g., 2025 CapoCaccia Workshop participants)
- https://cloud.neuromorphs.net (NextCloud): this is a cloud-based file and storage server with many additional features such as a shared calendar. Given the limited quota available per user, it is useful only for temporary storage and for sharing working material (code, reports, papers, pictures, etc.)
- https://login.neuromorphs.net (Keykloak): convenient common log-in single-sign-on portal for all neuromorphs.net services.


About

This repository aims to provide a curated collection of resources for researchers and practitioners interested in neuromorphic navigation, including datasets, hardware platforms, and software tools.

Topics

Resources

License

Stars

10 stars

Watchers

1 watching

Forks

Packages

 
 
 

Contributors