Skip to content

A curated list of anything related to Neural Cellular Automata (NCA) research, frameworks and applications.

Notifications You must be signed in to change notification settings

MECLabTUDA/awesome-nca

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

51 Commits
 
 
 
 
 
 

Repository files navigation

Awesome NCA

A curated list of anything related to Neural Cellular Automata (NCA) research, frameworks and applications.

NCA are a new type of neural architecture, marrying cellular automata and neural networks to create memory-efficient, robust models. Mostly, NCAs are applied in image segmentation, classification and generation. However, there are also works that use NCAs for reinforcement learning or generation of three-dimensional structures. This list is a curated collection of research papers and code repositories, presenting ideas and applications for NCA.

Scope: Other types of self-organizing systems, traditional cellular automata, other deep learning techiques are not covered, unless they utilize a cellular automaton with a learned rule in their computation. Review papers are not listed here, unless they are reviews of Neural Cellular Automata in particular (no reviews of, e.g., self-organizing systems in general that mention NCA).

You are welcome to contribute if you've found other NCA papers, code repositories or resources that you like to share.

Awesome


Table of contents

Research

Papers presenting theoretical and methodological contributions to NCA research, ordered by publication year.

Open Access

On 2D/3D Image Grids

Works that study NCAs applied to 2D or 3D lattices.

Graph NCA

Works that study Graph Neural Cellular Automata.

Restricted Access

None so far

Overview

Tabular overview of research papers on NCA since 2020, ordered by publication year.

Paper URL Year Downstream Task Dataset(s) Code Model
Paper 2020 Grow from seed Emojis tensorflow, torch NCA
Paper 2020 Classification MNIST Digits tensorflow NCA
Paper 2020 Generation Emojis, MNIST, CelebA torch NCA + VAE
Paper 2020 Traffic Prediction Maps+Traffic overlay (custom) torch Multi-layer NCA
Paper 2020 Image Segmentation Oxford cats & dogs N/A NCA with Gate
Paper 2021 Texture Generation Dataset torch, tensorflow NCA
Paper 2021 3D Structure Gen. Minecraft Structures torch Multi-layer 3D NCA
Paper 2021 Classification, Reprogramming MNIST tensorflow NCA
Paper 2021 Generation Emojis tensorflow/keras NCA + GAN
Paper 2022 Shape self-classification on µC H/W Digits (custom, but simple) N/A NCA
Paper 2022 Control of self-organization Emojis torch NCA
Paper 2022 Gen. Modelling Emojis, CelebA torch NCA + VAE
Paper 2022 Grow from seed Custom shapes numpy NCA trained with information-theoretic fitness function and age-fitness pareto optimization
Paper 2022 Classification Tiny ImageNet, MNIST, FashionMNIST, CelebA torch ViT + NCA (ViTCA)
Paper 2022 Generating policy networks for reinforcement learning torch 3D NCA
Paper 2023 MRI Segmentation on Raspberry Pi Decathlon (Hippocampus & Prostate), ISBI 2013 challenge torch Multi-scale NCA
Paper 2023 MRI Segmentation on Raspberry Pi Decathlon (Hippocampus & Prostate) torch 3D NCA with patchification
Paper 2023 Grow from seed(s) Emojis torch Steerable NCA
Paper 2024 MRI Registration (Prostate, Hippocampus, other) OASIS-1, PROMISE12, Dryad torch 3D NCA with patchification
Paper 2024 X-ray segmentation on smartphone Padchest, ChestX-ray8, MIMIC-III torch Med-NCA, trained with variance-weighted loss
Paper 2024 Classification CIFAR-10-C N/A NCA-based Autoencoder
Paper 2024 Classification FashionMNIST N/A NCA on photonics hardware
Paper 2024 Shape generation Custom shapes numpy+numba HNCA (Hierarchical NCA)
Paper 2024 Skin lesion segmentation ISIC2017 N/A UNet-style network with NCA bottleneck
Paper 2024 Generation Optical Coherence Tomography torch Diffusion + NCA
Paper 2025 Segmentation, Depth Est., edge AI Capsule Endoscopic torch NCA
Paper 2025 Continual Hippocampus MRI Segmentation HarP, Dryad, DecathHip torch NCA with adaptible layers and multiple heads
Paper 2025 Image Compression COCO 2017 N/A Grid-based, "GNCA"
Paper 2025 Grow from seed using learned logic gates Emojis, Icons jax Differential Logic Gates + NCA
Paper 2025 Image Generation CelebA, Pathology torch FourierDiff-NCA, Fourier-based diffusion
Paper 2025 Federated Learning Ultrasound, X-ray torch Med-NCA backbone in federated setup

Code

NCA code repositories, including accompanying repositories for publications listed above.

Tutorials

Tutorials and study material related to NCA.

Videos and Visuals

Cool demo videos and visuals of NCAs in action.

Contributing

Contribution guidelines can be found in CONTRIBUTING.md

License

This list is under the Creative Commons Attribution-ShareAlike 4.0 License. The list of authors can be found in the AUTHORS file.

About

A curated list of anything related to Neural Cellular Automata (NCA) research, frameworks and applications.

Topics

Resources

Contributing

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Contributors 2

  •  
  •