Hailo Camera Applications - Reference Pipelines for Video-Processing and AI

---

Overview

Hailo Camera Apps is a set of full application examples for Hailo VPU devices, combining vision pipeline elements and pre-trained AI tasks.

These references showcase best practices to leverage hardware accelerated components of Hailo-15, optimizing performance and memory usage.

Hailo Camera Apps can be used for evaluations, reference code, and demos: accelerating time to market by reducing development time and deployment effort.

---

A Note on Hailo-8

Note

This repo is intended for Hailo-15 only. For Hailo-8 applications and packages, please refer to the main branch. While many SW features here still parallel the Hailo-8 branch, subtle differences optimize this branch for Hailo-15. This includes a utilization in DSP accelerated operations and a Hailo-15 focused native example application.

---

Getting Started with Hailo-15

For a quick start with Hailo-15, please refer to the Vision Processor Software Package documentation section in Hailo's Developer Zone.

See the relationsips between the different software components in the illustration below:

---

Accessing Hailo Camera Viewer

Start the Server:

ssh root@10.0.0.1
camera-viewer-server

Open Browser on the host: Visit http://10.0.0.1 in Google Chrome (only fully supported browser).

Stream Video: Click Play in the Vision Control interface.

For more details, see the Camera Viewer Application Guide.

---

Example Applications Built with Hailo Camera Apps Hailo-15

Note

Running application examples requires a connected host with monitor for display.

Hailo Camera Apps offers a comprehensive example of a complete AI application, showcasing the integration of multiple vision elements and AI tasks. We encourage you to try the application, and follow along with the guide provided. Pipeline decisions will be explained and example code will be elaborated on. These examples should serve as a reference with good practices to build a complete AI camera application on Hailo-15, while taking full advantage of the hardware accelerated features provided on board.

Read the full guide on the Hailo-15 C++ Example Application.

Other example applications are also provided, albeit with less guided analysis, in the apps/ folder on the Hailo-15 image (provided that Hailo Camera Apps is included in the image). These applications are references for additional features and configurations.

A Detection Pipeline, for example, is provided to showcase single-stream detection with a pre-trained model. This pipeline is a good starting point for seeing the basic capabilities of Hailo-15 in action.

To run the detection pipeline, follow the steps below:

1. Connect a host machine with monitor for display to the Hailo-15 device.
2. On the host machine, open a terminal and prepare a display pipeline to capture UDP output (it is all one command line):

$ gst-launch-1.0 udpsrc port=5000 address=10.0.0.2 ! application/x-rtp,encoding-name=H264 ! queue max-size-buffers=30 max-size-bytes=0 max-size-time=0 leaky=no ! \
  rtpjitterbuffer mode=0 ! queue max-size-buffers=30 max-size-bytes=0 max-size-time=0 leaky=no ! rtph264depay ! \
  queue max-size-buffers=30 max-size-bytes=0 max-size-time=0 leaky=no ! h264parse ! avdec_h264 ! \
  queue max-size-buffers=30 max-size-bytes=0 max-size-time=0 leaky=downstream ! videoconvert n-threads=8 ! \
  queue max-size-buffers=30 max-size-bytes=0 max-size-time=0 leaky=no ! \
  fpsdisplaysink fps-update-interval=2000 name=hailo_display text-overlay=false sync=false

3. On the Hailo-15, run the application:

$ ./apps/detection/detection.sh

The application will now start and you should see a display window open with the detection results. You can repeat this process for the other applications in the apps/ folder.

Note

If your host is struggling to decode and display high resolutions in real-time, you can try using VA-API for hardware accelerated decoding. To see if your host machine is VA-API capable and then use it, refer to this guide.

---

Further Reading

While this repo provides a fast track to Hailo-15 application development, it is recommended to visit the Hailo Developer Zone SW development page for a step-by-step journey to develop and deploy AI applications, and easy access to the required documentation, tools, and resources for each stage.

Specifically, we recommend to start with Hailo Media Library (HML) documentation. HML is a powerful library of vision pipeline tools and modules that leverage the hardware accelerated components of Hailo-15 to build robust, real-time pipelines.

To access the documentation, sign up for the Hailo Developer Zone and then use the filters to reach the relevant documentation:

To access the latest version of the media library documentation click here

Changelog

Important

This release branch is focused on Hailo-15. Hailo-8 applications will continue to be supported in the main branch. As such, the versioning scheme is aligned to Vision Processor Software Package versioning.

v1.7.0 (Vision Processor Software Package) (Apr 2025)

• Reference Camera API includes Frontend and Encoders
• Add stream synchronization to AI Example Application
• Vision and AI Pipelines separated into different streams
• New Camera Viewer application released

v1.5.0 (Vision Processor Software Package) (Oct 2024)

• Refactor CPP AI Example Application as a standalone application
• Add Multi-Scale tiling support in AI Example Application
• Support pkg-config for Hailo Camera Apps modules
• Shift branch focus to Hailo-15

v3.29.1 (Hailo-8 Suite) (Aug 2024) and Below

• For previous versions, please refer to the Hailo-8 branch.