WebRTC and a UI issue

[luvap]

I searched before posting and didn't see anything but I may have missed it, so posting a discussion here for now.

First issue, I've set up the go2rtc component with the webrtc section:

  streams:
    1_truck:
      - rtsp://<stream_ip>/TruckLive
    2_driveway:
      - rtsp://<stream_ip>/DrivewayLive
    3_north:
      - rtsp://<stream_ip>/NorthLive
    4_frontporch:
      - rtsp://<stream_ip>/FrontPorchLive
    5_frontsouth:
      - rtsp://<stream_ip>/FrontSouthLive
    6_backporch:
      - rtsp://<stream_ip>/BackPorchLive
  webrtc:
    candidates:
      - 192.168.1.82:8555
      - stun:8555

But, live view always uses MSE in any browser I've tried (Chrome on Win11, Safari on mac, etc).

I noticed that the WebRTC port wasn't mapped in the default compose example, so I added those for testing as well as the other go2rtc ports:

  viseron:
    image: roflcoopter/viseron:latest
    container_name: viseron
    shm_size: "1024mb"
    volumes:
      - ./segments:/segments
      - ./snapshots:/snapshots
      - ./thumbnails:/thumbnails
      - ./event_clips:/event_clips
      - ./config:/config
      - /etc/localtime:/etc/localtime:ro
    ports:
      - 8888:8888
      - 8554:8554
      - 1984:1984/tcp
      - 8555:8555/tcp
      - 8555:8555/udp
    devices:
      - /dev/dri

But, I still can't get anything to actually use WebRTC. If I go directly to the now exposed go2rtc through :1984 I can click the WebRTC links and they work fine.

Second, the only other thing I've run into is that the timeline view doesn't seem to arrange cameras correctly if I select too many. So far, I only have 6 cameras set up, but will eventually have 11.

In the screenshot, the cameras on the bottom row are cut off and there doesn't seem to be a way to scroll down. I'd rather have them all resize to fit on one screen, but the ability to scroll would work as well.

If I use the fullscreen button, then I can view them all but can't use the timeline controls at the same time.

[luvap]

Ok, so my issue with it defaulting to MSE is because of the AAC audio coming from some of my cameras. I can't change it in the cameras, but go2rtc can make quick work of transcoding to opus for me, so that should be solved once I update my config.

And, for the timeline view, it apparently just didn't handle those exact camera resolutions as a group. Once I added the rest of the cameras, everything shows on the page as expected.

11 cameras doing continuous recording with motion detection using MOG2 and my raspberry pi 5 only sits at about 20% cpu usage. I have a coral, so I may throw that in the mix next.

Great work on this project, thank you :)

[roflcoopter]

Glad you got it sorted! WebRTC can be a bit tricky to get working. The support in Viseron is still very new so documentation is not great yet, will try to get write down some troubleshooting steps so other people dont have the same problem as you do.

The view should show all cameras, regardless of number or resolution, but its a complex implementation so there might be some bug hidden in there

[luvap]

Yeah, it worked out. Most of my cameras only do AAC, which is fine for recordings, but not WebRTC. Changed the go2rtc to copy the existing audio and video, but also add an opus audio track and now WebRTC works fine.

go2rtc:
  streams:
    4_frontporch:
      - ffmpeg:rtsp://192.168.1.124:8554/FrontPorchLive#video=copy#audio=copy#audio=opus

Up next on my list is setting up the Coral and trying out notifications.