[Bug]: Ubuntu Scaling not applied correctly (Wrong recording dimensions)

[jkowalk]

Firefly Luciferin version

2.11.7

Glow Worm Luciferin version

5.10.6

Firmware type

FULL

What is the stream method?

WiFi Stream

Fiefly Luciferin config file

---
hueMap: ...
topLed: 36
leftLed: 20
rightLed: 20
bottomLeftLed: 13
bottomRightLed: 13
bottomRowLed: 37
orientation: "Clockwise"
numberOfCPUThreads: 1
captureMethod: "XIMAGESRC"
baudRate: "500000"
defaultLedMatrix: "FullScreen"
autoDetectBlackBars: true
timeout: 100
screenResX: 3840
screenResY: 2160
osScaling: 150
gamma: 2.2
whiteTemperature: 65
colorMode: 1
mqttServer: "tcp://192.168.1.3:1883"
mqttTopic: "glowwormluciferin"
mqttUsername: ""
mqttPwd: ""
mqttDiscoveryTopic: "homeassistant"
mqttEnable: false
streamType: "UDP stream"
checkForUpdates: true
eyeCare: false
nightModeFrom: "22:00"
nightModeTo: "08:00"
nightModeBrightness: "0%"
toggleLed: true
desiredFramerate: "30"
frameInsertion: "No smoothing"
colorChooser: "51,51,51,255"
brightness: 255
ledStartOffset: 76
splitBottomMargin: "0%"
grabberAreaTopBottom: "8%"
grabberSide: "8%"
gapTypeTopBottom: "8%"
gapTypeSide: "0%"
startWithSystem: true
multiMonitor: 1
monitorNumber: 0
syncCheck: true
effect: "Bias light"
audioLoopbackGain: 0.0
audioDevice: "Default audio output (Native)"
audioChannels: "2 channels"
multiScreenSingleDevice: false
powerSaving: "Disabled"
theme: "Classic theme"
language: "English"
groupBy: 1
defaultProfile: "tray.icon.default"
enableLDR: false
ldrTurnOff: false
ldrInterval: 0
ldrMin: 0
brightnessLimiter: 1.0
sampleRate: 0
ledMatrix: ...
splitBottomRow: true
configVersion: "2.11.7"
serialPort: "GlowWorm"
wifiEnable: true
mqttStream: true
extendedLog: "INFO"

Relevant log output

[Instance #1] 2023-06-24 13:23:41,894 INFO o.d.JavaFXStarter [main] Starting default instance
[Instance #1] 2023-06-24 13:23:42,349 INFO o.d.g.ImageProcessor [JavaFX Application Thread] GStreamer path in use=opt/fireflyluciferin/lib/app/classes
[Instance #1] 2023-06-24 13:23:42,455 INFO o.d.m.PipelineManager [JavaFX Application Thread] ximagesrc startx=1 endx=2559 starty=0 endy=1439 ! videoscale ! videoconvert
[Instance #1] 2023-06-24 13:23:42,500 INFO o.d.m.UpgradeManager [JavaFX Application Thread] Checking for Firefly Luciferin Update
[Instance #1] 2023-06-24 13:23:42,645 INFO o.d.FireflyLuciferin [JavaFX Application Thread] MQTT disabled.
[Instance #1] 2023-06-24 13:23:42,647 INFO o.d.n.t.UdpServer [JavaFX Application Thread] Local IP= 192.168.178.110
[Instance #1] 2023-06-24 13:23:42,648 INFO o.d.n.t.UdpServer [JavaFX Application Thread] Network adapter in use=enp5s0
[Instance #1] 2023-06-24 13:23:42,648 INFO o.d.n.t.UdpServer [JavaFX Application Thread] Broadcast address found=/192.168.178.255
[Instance #1] 2023-06-24 13:23:42,649 INFO o.d.m.PowerSavingManager [JavaFX Application Thread] Adding hook for power saving.
[Instance #1] 2023-06-24 13:23:43,659 INFO o.d.m.PipelineManager [pool-11-thread-1] Waiting device for my instance...
[Instance #1] 2023-06-24 13:23:44,337 INFO o.d.m.DisplayManager [JavaFX Application Thread] Width: 2560.0 Height: 1440.0 Scaling: 2.0 MinX: 0.0 MinY: 0.0
[Instance #1] 2023-06-24 13:23:44,651 INFO o.d.m.PipelineManager [pool-11-thread-1] Waiting device for my instance...
[Instance #1] 2023-06-24 13:23:45,651 INFO o.d.m.PipelineManager [pool-11-thread-1] Waiting device for my instance...
[Instance #1] 2023-06-24 13:23:47,456 INFO o.d.g.GrabberManager [gstreamer service thread 1] Starting a new pipeline
[Instance #1] 2023-06-24 13:23:57,645 INFO o.d.m.UpgradeManager [pool-4-thread-1] Checking for Glow Worm Luciferin Update

How to reproduce

I have a 3840x2160 4k Monitor set up with Firefly Luciferin. In the OS I have a scaling of 150%. Same Settings in the Firefly App. On Windows it works as expected, whole screen gets captured and so on.
But on Ubuntu only the top left corner of the screen gets recorded. The log also states, that the scaling seems to be applied wrong:
ximagesrc startx=1 endx=2559 starty=0 endy=1439 ! videoscale ! videoconvert (Width: 2560.0 Height: 1440.0 Scaling: 2.0 MinX: 0.0 MinY: 0.0)

I also tried 100%, which works correct:
ximagesrc startx=1 endx=3839 starty=0 endy=2159 ! videoscale ! videoconvert (Width: 3840.0 Height: 2160.0 Scaling: 1.0 MinX: 0.0 MinY: 0.0)

And 200%, which again only records a forth of the screen:
ximagesrc startx=1 endx=1919 starty=0 endy=1079 ! videoscale ! videoconvert (Width: 1920.0 Height: 1080.0 Scaling: 2.0 MinX: 0.0 MinY: 0.0)

I was able to verify this by running:
gst-launch-1.0 ximagesrc startx=1 endx=2559 starty=0 endy=1439 ! video/x-raw,framerate=30/1 ! videoscale method=0 ! video/x-raw,width=1920,height=1080 ! ximagesink
which resulted in only the top left corner showing up.
The correct settings for 150% scaling would be:
ximagesrc startx=1 endx=5759 starty=0 endy=3239
which is screen_resolution * 1.5 - 1

So I thought I'll just set the screen resolution to 5760 to 3240 and scaling to 100% in the app settings, which didn't work either. Log output was:
ximagesrc startx=1 endx=2559 starty=0 endy=1439 ! videoscale ! videoconvert (Width: 2560.0 Height: 1440.0 Scaling: 2.0 MinX: 0.0 MinY: 0.0)

It seems to me that there is something wrong with the calculation of the dimensions, but maybe someone can help me out.

Thanks anyways for the great system and your work so far.

[sblantipodi]

Hi @jkowalk
thank you for reporting this issue.

I was able to reproduce the issue... I sincerely don't know if it's a Luciferin problem or a GStreamer one, I'll investigate the problem and let you know if I find some news about it.

[sblantipodi]

just for reference, this problem does not affect Wayland.

[gk1089]

I just want to add plus one to this issue. Looking forward to a solution or a workaround. I am using it on Debian 12.

Cheers!

[sblantipodi]

@gk1089 what is the version of GStreamer you are using? can you try to update it to 1.24.4?
what GPU are you using? is drivers correctly installed?
What version of GNOME are you using?

[Yury-MonZon]

Same problem here with the latest Pop OS stable (22.04)
gst-launch-1.0 --gst-version
GStreamer Core Library version 1.24.7

My display is

But Firefly detects it like so

log:
INFO o.d.m.DisplayManager [JavaFX Application Thread] Width: 2560.0 Height: 1440.0 Scaling: 2.0 MinX: 0.0 MinY: 0.0

On previous deb version I had it working fine with forcing the resolution and scaling to the correct values and using PIPEWIREXDG capture method. But on the latest version (via flatpack) it doesn't work anymore(any capture method, yes I granted screen capturing rights) - for some reason I get very low FPS and the lights are not doing it's job.

FireflyLuciferin.log

FireflyLuciferin.yaml.txt

I can assist with any test needed.

[sblantipodi]

@Yury-MonZon if you are using Wayland you need to use PIPEWIREXDG and not XIMAGERC.
we can try to debug it using various .deb versions.

can yoy try this please:
https://drive.google.com/file/d/1-JcEQ0yfsNyKnqT2_wYu99fPqqItSoLF/view?usp=sharing

before installing this deb,
please remove your current firefly configuration and start with a fresh new configuration.
to do so simply remove your
~/Documents/FireflyLuciferin
folder

[Yury-MonZon]

No, I'm not using Wayland:

echo $XDG_SESSION_TYPE
x11

Installed without any problems (old configs deleted before that)

Unpacking fireflyluciferin (2.17.6) ...
Setting up fireflyluciferin (2.17.6) ...

XIMAGESRC works fine

But the resolution is wrong. Captured area is not the whole screen.

Overall it starts/stops much faster than flatpack latest version.

Works fine with PIPEWIREXDG (still wrong resolution, capture area looks correct)
FireflyLuciferin.log