Request: Download from netu-Player

[AitschPi]

Your question

Some websites integrate videos using the player of netu. These videos where not detected by the addone.

Example: https://maxi.show/it/comedy/175-kendi-dusen-aglamaz.html

Addon & CoApp version and details

version: 9.0.2.3
target: mozilla
channel: stable
lang: de
coapp: {"found":true,"path":"/Applications/net.downloadhelper.coapp.app/Contents/MacOS/vdhcoapp","version":"2.0.19","new_version":false}
license: {"accepted":true,"email":"","key":"adfcf72f845f4478"}
platform: aarch64 mac
UA: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:126.0) Gecko/20100101 Firefox/126.0
{
"valid_license_message_has_been_displayed": true,
"used_sidebar_button": true,
"used_popup_button": true,
"download_directory": "/Users/aitschpi/dwhelper",
"never_show_no_incognito_msg_again": true,
"view_options": {
"all_tabs": false,
"low_quality": false,
"sort_by_status": true,
"sort_reverse": false,
"show_button_clean": true,
"show_button_clean_all": false,
"show_button_convert_local": false,
"hide_downloaded": false
},
"use_sidebar": false,
"open_count_store": 64,
"successfull_dl": 45
}

[Mattmjs]

I'm not the dev of the software but a user like you. I looked at the video on that link and no detection like you say.
I tried opening the developer tools to see what's going on. But they won't allow the developer tools to be open while the
video is playing. This is a tactic some sites deploy to stop people from fishing around in there.

Ok no problem, there is a way to record network activity using the developer tools without having it open. And the website doesn't
know any better. I see why there is no detection, there is no streaming manifest to be found. It seems there is some stealthy method
of streaming the video uses. I don't know if downloading will be possible for this site. I did find an m3u8 link after saving the response
from the embed video link in a text file. I used this in ffmpeg but there was an error:

[tcp @ 000001b34be46dc0] Connection to tcp://4fw4gd.cfglobalcdn.com:443 failed: Error number -138 occurred
https://4fw4gd.cfglobalcdn.com/secip/1/861rQM940fF8R1fZDCdglg/OTQuMjUuMTcwLjI2/1606597200/hls-vod-s03/flv/api/files/videos/2018/08/01/153311550983uua.mp4.m3u8: Error number -138 occurred

Perhaps @paulrouget would have more insight on what this site is doing and whether it'll work or not.

[AitschPi]

I also tried the developer tools… But it seems like Grim‘s „The Hare and the Hedgehog“. This player is the only one I know that won‘t work with the downloader (yet).

[Mattmjs]

You can get a better look in the developer tools / Network by switching on a setting in ublock origin.
In the filters list tick ublock filters - annoyances. Then the video won't complain that the developer tools are open.

Here is an example that was posted on stackoverflow https://netu.tv/view_page.php?pid=4
If you save the response from the embedded player and view it in a text editor. there is whole lot of code.

Use the find function to look for m3u8, there is one url that it finds. But it has the same error that I saw for the other site up the top
in ffmpeg.

[tcp @ 000001eb59f56d80] Connection to tcp://4fw4gd.cfglobalcdn.com:443 failed: Error number -138 occurred
https://4fw4gd.cfglobalcdn.com/secip/1/861rQM940fF8R1fZDCdglg/OTQuMjUuMTcwLjI2/1606597200/hls-vod-s03/flv/api/files/videos/2018/08/01/153311550983uua.mp4.m3u8: Error number -138 occurred

In yt-dlp it says this
[generic] Extracting URL: https://4fw4gd.cfglobalcdn.com/secip/1/861rQM940fF8R1fZDCdglg/OTQuMjUuMTcwLjI2/1606597200/hls-vod...11550983uua.mp4.m3u8
[generic] 153311550983uua.mp4: Downloading webpage
ERROR: [generic] Unable to download webpage: <urllib3.connection.HTTPSConnection object at 0x000001C80116E100>: Failed to establish a new connection: [WinError 10061] No connection could be made because the target machine actively refused it (caused by TransportError('<urllib3.connection.HTTPSConnection object at 0x000001C80116E100>: Failed to establish a new connection: [WinError 10061] No connection could be made because the target machine actively refused it'))

If it's possible to workaround it, it may possibly work.

[lonemadmax]

For the privacy paranoid: those links contain the IP and time of your request, maybe other data. Consider that before posting them. They are also probably time limited.

For the video from netu.tv, one URL I get for the manifest is https://t9lr3d.cfglobalcdn.com/silverlight/secip/7755/12479/FpMUkRMQofKcKpEsNqk6uw/OTAuMTYyLjE0Ni4xNDc=/1748985067/hls-vod-s002/flv/api/files/videos/2016/03/01/14568685065eb92, surely a different video now, as it has a different upload time.

Tried getting it with curl and I get 404 or no response unless I add the right Referer and Origin headers, which I don't know if you can do with ffmpeg. The lack of response might be due to my connection, so maybe just Origin will do. On top of that, the response has Content-Type: application/octet-stream and X-Content-Type-Options: nosniff headers. So unless the addon ignores those and sniffs the content of everything, it won't know it's a manifest. Although curl gave me a nice file, the response in firefox's dev tools is base64-encoded, if it makes any difference.

The video fragments are "manifest URL".mp666/Frag-1-v1-a1, where that first 1 goes up sequence. These are again blocked without the right headers, and for some added fun, respond as text/x-html, nosniff.

If you get the right manifest URL and origin header and the stars align, this shell script may get you a video file:

#!/bin/bash
set -e

if [ $# -ne 3 ]; then
  >&2 printf "%s URL ORIGIN FILE\n" "$0"
  exit 1
fi

UA="User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:138.0) Gecko/20100101 Firefox/138.0"
PLAYER=https://netuplayer.top

URL="$1"
PLAYER="$2"
FILE="$(realpath $3)"

if [ -f "${FILE}" ]; then
  >&2 printf "%s already exists\n" "${FILE}"
  exit 2
fi

TMPWD="$(mktemp -d)"
pushd "${TMPWD}"
curl -L -H "${UA}" -H "Origin: ${PLAYER}" -H "Referer: ${PLAYER}" "${URL}" -o manifest.m3u8
sed '/^#/d' manifest.m3u8 | while read -r url; do curl -L -H "${UA}" -H "Origin: ${PLAYER}" -H "Referer: ${PLAYER}" -H 'Accept: video/mp4' "${URL%/*}/${url}" -o "${url##*/}"; done
sed -i 's,.*/,,' manifest.m3u8
ffmpeg -protocol_whitelist file -allowed_extensions ALL -extension_picky 0 -i manifest.m3u8 -c copy "${FILE}"
popd

rm -r "${TMPWD}"

For a site where I use it, I have to pipe curl's output through gunzip, but the responses for the one from netu.ca were not gzip-encoded, so YMMV.

[Mattmjs]

@lonemadmax , you can add referer and origin headers to ffmpeg I think.
So if this link is used https://netu.tv/view_page.php?pid=4 what would the referer and origin headers be.

[lonemadmax]

It was https://netu.ca for me, as I was redirected. You can see all the headers if you click in the request in dev tools.

[Mattmjs]

Ok I see what it is, I can add the referer but I don't think there is a origin parameter for ffmpeg.

[Froktime]

If anyone wants to download on netu then use File Centipede. It works very well with Netu, however there are limitations on usage. To extend usage, you have to buy premium