Transtreaming Codebase

Code for Transtreaming: Adaptive Delay-aware Transformer for Real-time Streaming Perception

Note: We are currently refactoring our work to build our streaming perception pipeline on ROS for a better simulation of real-world autonomous driving scenarios(end-to-end delay adaptation).

Install

• Install dependency

conda env create -f environment.yaml

• Download Argoverse-HD inside ./data (from https://mtli.github.io/streaming/)

Run

• training

python src/train.py experiment=xxx

• testing

python src/test.py experiment=xxx

• sap testing

python src/sap.py experiment=xxx

Detailed configurations are in ./configs

Checkpoints (with config and logs)

• Transtreaming S
• Transtreaming_M
• Transtreaming_L