This repo holds several examples for RGB-Infrared camera usage on Edge AI SoC AM62A.
The main camera used in these applications is a 5 MP global shutter RGB-Ir sensor, OX05B1S from Omnivision. For these applications, we use a camera module from Leopard imaging: * Leopard Imaging LI-OX05B1S-MIPI-137H * Additional cables needed: FAW-1233-03 and LI-FPC22-IPEX-PI.
These applications are provided in accordance with an application note. The applications include:
- Gstreamer pipelines under gstreamer-pipelines:
- Visualization of RGB stream on a display with Gstreamer
- Dual visualization of RGB and Infrared streams on the same display with Gstreamer
- DMS+OMS+Video Telephony representative application built with Gstreamer.
- Driver monitoring and Occupancy monitoring are emulated with a face-detection and segmentation AI model (respectively) on the Ir stream, and video telephony runs on the RGB stream to encode and save compressed frames to a local file
- TI OpenVX pipeline based on edgeai-tiovx-apps under tiovx-pipeline
- Dual visualization of RGB and Infrared streams on the same display with TIOVX (build to be 1:1 with gstreamer for comparing performance)
- Tested against SDK 10.0 and 10.1 versions. Please use version within those SDK's or from version tags 10.00.00.08 or 10.01.00.06 for the respective SDKs. Versions beyond 10.1.x may not cleanly apply the patch
Please note that before running any of these applications with camera OX05B1S, it is required to apply a device tree overlay and run several media-ctl and v4l2-ctl commands.
- Apply DTBO:
- in the boot partition's uEnv.txt, add the ox05b1s module to the names_overlay, like so:
- name_overlays=ti/k3-am62a7-sk-csi2-ox05b1s.dtbo
- This DTBO file exists on the targetfs partition under /boot/dtb
- in the boot partition's uEnv.txt, add the ox05b1s module to the names_overlay, like so:
- Setup commands:
- Please refer to setup_camera_ox05b.sh in edgeai-gst-apps for OX05B module setup commands
App note available on TI.com: https://www.ti.com/lit/pdf/spradp7
