Horizontal lines (red and white) appear in encoded video using NVEncC versions 8.06 and below on RTX 3070 Ti

[SanchoandPancho]

When encoding MPEG-2 videos with NVEncC versions 8.06 and below on an NVIDIA RTX 3070 Ti, the output video shows horizontal lines across the picture. These lines are not present in the original video and do not resemble typical compression artifacts but appear as clear horizontal stripes. The issue does not occur when using NVEncC version 7.82, where encoding completes without any such lines.

Details:

GPU: NVIDIA RTX 3070 Ti
NVEncC versions affected: 8.06 and below
NVEncC version without issue: 7.82
Input format: MPEG-2 video (e.g., DVD sources)
Filters used: Deinterlacing with --vpp-yadif mode=tff
Encoding settings: HEVC codec, VBR, preset "quality"
NVIDIA driver version: 576.80 (latest as of June 2025)

Logs: No errors or warnings during encoding process
Problem: Horizontal lines visible in output video, not present in source
Workaround: Using NVEncC 7.82 avoids the problem
Steps to reproduce:
Encode an MPEG-2 video with NVEncC 8.03 or 8.06 using a command similar to:

nvencc64 --output-res 720x540 --input-csp yuv420p --vpp-yadif mode=tff --codec hevc --tier high --output-depth 8 --vbr 1944 --preset quality --vbr-quality 1 --chromaloc auto --colormatrix auto --colorprim auto --transfer auto --colorrange auto --atc-sei auto -i "c:\ROBINS_RECKONING_PART_1_DVD.mkv" -o "c:\ROBINS_RECKONING_PART_1_DVD.hevc"

Check the output video for horizontal lines.
Repeat encoding with NVEncC 7.82 to confirm absence of the issue.

If you want I can upload the original video to MEGA.

regards
Marco

[rigaya]

Thank you for reporting, there are many changes in 8.00, so it should be the cause.

But unfortunately, I've tested using NVEnc 8.06, 576.80 driver, RTX4080 @ Win11, using MPEG2 interlaced files with the same command line, but everything seems fine, cannot see red and white lines(?).

So might depend on input file...?

[SanchoandPancho]

Hello,

Thanks for contacting me. (I answered the email I got 2 weeks ago, but nothing happened)

The original source is fine. If I use nvencc 7.82 the result is fine too. If I use nvencc 8.06, 8.03 I get the stripes. I ripped yesterday 6 DVD again and reencoded new.
But only one time I encoded with 7.82, I found a 2 stripes in the reencode, but after a new encode with same verison and settings, the stripes are gone and the others encodes are fine too. I think it a bug inside of nvidia driver and nvencc64.
Do you want the original file to encode and the encode cmd what I use for?

regards,
Marco

[rigaya]

I'm sorry but I haven't been able to get your mail.

I'm not being able to reproduce your issue, as it might depend on input file. There might be a chance to get better result by try using --vpp-deinterlace normal.

[SanchoandPancho]

No problem. I think I did a mistake so you don't got my email.
I had this issue on all rips from "DC 75 Anniversary Collection". I can upload some video - so you can check by yourself. If you want.
I'll test this again on a different DVD video an report this to you.
BTW I appreciate your great work - so I can backup all my BD's, DVD's in a great and almost lossless, perfect way. Thanks.

[rigaya]

Yes, thanks, some part of the original data might help checking the difference between 7.82 and 8.06.

[SanchoandPancho]

How can I send the password to you for downloading the video, bc. not everyone should have the ability to download the video.

[rigaya]

Please try e-mail to rigaya34589@live.jp.