Inverter Path / Replace Operator Problem

[the-real-moz]

Hey y'all!
First and foremost this is probably the best epg grabber for sure, I truly love it. Really really well done K-vanc!

Maybe some of you can help me though. I am working with Webgrab+ alongside Tempest and wrote myself a Perl script to replace the from numbers to star symbols ☆, and also adding them to the tag.
That worked quite well and then I looked at the EPGs in Tempest and I wanted to adapt the configs also to be able to use my script.

So far so good, and after reading through the superb manual dozens of times, I figured this should be possible without any script at all, just via the inverter path settings. But apparently I am too dumb for that :D
I hope someone can help me. Here's what I got:

["subtitle":"##episode# • #","##subtitle##"]["desc":"##country(,)##","# • #date##","# • #episode##","#\n#desc#..#","#\n-\nIMDb: #star-rating##"][“credits”:||#delete#]["writer":||#delete#]["producer":||#delete#]["composer":||#delete#]["actor":||#delete#]["director":||#delete#]["date":"#(.*?)#"]["category":"##category(,)##"||#max#2][“country”:||#delete#]["episode":"#(.*?)#"]["rating":||#delete#]

that's the main part of the inverter config. but then I tried the star-rating parts, quite different versions but nothing worked as I wanted it:

[“star-rating”:"##star-rating##"||#replace#(/5)||☆]
that's where I started but I read that I could shorten the code even so I went through various versions:
[“star-rating”:||#replace#(/5)$||]

[“star-rating”:||#replace#(\/5)||⭐]

[“star-rating”:||#replace#(\/5)$||⭐||#max#1]

["star-rating":"#(.*?)#"||#replace#(/5)||blubb]
right now I am debugging and using some different strings to replace in order to find it easily in the final epg "blubb".
Anyway, I hope someone can help me.... here is what it should look like when it's finished (the output is from Webgrab+ and my perl script):

[K-vanc]

Hi and thanks for the good words but yes, this is the best epg grabber ever made 😄

Anyway, what you asked is possible with inverter module but requires some experience since it is a bit complicated. I will explain step by step so you can modify or directly use as it is based on your needs. First of all, star rating shall be in "value/limit" format as per xmltv.dtd and Tempest applies the same standard so some commands such as ||#max# will not work for this format. Up to now, I only saw 4 types of limit as "/4", "/5", "/10" and "/100" so to convert all into 5 stars limit, you need to calculate them into a fixed format such as "/10" by adding below string to top of inverter-path;

["star-rating":||#calc#(\d(?:\.\d+)?)\/4||*2.5||#calc#\/(4)||*2.5||#calc#(\d(?:\.\d+)?)\/5||*2||#calc#\/(5)||*2||#calc#(\d+)\/100||/10||#calc#\/(100)||/10]

so all our star-rating values converted to "/10" limiter such as "6.7/10", Now you need to replace them with star symbols based on a logic. It should go from lowest value to highest since replace operations will be performed with first-in/first-out sequence. The second input of inverter-path will be;

["star-rating":||#replace#(^(?:1|2)(?:\.\d+)?\/10)##(^(?:3|4)(?:\.\d+)?\/10)##(^(?:5|6)(?:\.\d+)?\/10)##(^(?:7|8)(?:\.\d+)?\/10)##(^(?:9|10)(?:\.\d+)?\/10)||★☆☆☆☆##★★☆☆☆##★★★☆☆##★★★★☆##★★★★★]

this will replace scores upto but not including 3 values such as 1.6/10 or 2.4/10 into "★☆☆☆☆" and stars will increase on each range of "3-4" , "5-6", "7-8" and "9-10"

since above 2 following commands belong to same element, you can merge them into single block as;

["star-rating":||#calc#(\d(?:\.\d+)?)\/4||*2.5||#calc#\/(4)||*2.5||#calc#(\d(?:\.\d+)?)\/5||*2||#calc#\/(5)||*2 ||#calc#(\d+)\/100||/10||#calc#\/(100)||/10||#replace#(^(?:1|2)(?:\.\d+)?\/10)##(^(?:3|4)(?:\.\d+)?\/10)##(^(?:5|6)(?:\.\d+)?\/10)##(^(?:7|8)(?:\.\d+)?\/10)##(^(?:9|10)(?:\.\d+)?\/10)||★☆☆☆☆##★★☆☆☆##★★★☆☆##★★★★☆##★★★★★]

Now, star-rating value is completely converted to star order. Next step is to move it into another element since players will not recognize it in this format.

["desc":"##desc##","#\nStars\[{system}\]: #star-rating##"]

will move it to the end of description with a new line and "Stars[{system}]: ★★★★☆" format. {system} there is a dynamic variable which takes the star-rating system name from siteconfig and replace it so if star-rating system is defined as IMDb in siteconfig, it will be shown as "Stars[IMDb]: ★★★★☆" or you can hardcode it as you want. And finally, you can remove star-rating type from the xml file since it has been moved to desc and remaining tag is useless in that format so you can add below command to end of inverter path;

["star-rating":||#delete#]

This is how it looked in my file after conversion;

Edit: btw I noticed you are using star symbol in something like html format. I used only unicode values for not having issue with some players. Not all the players may render your star symbol but all will render mine as fine. You may replace the stars on above code with your symbols.

[the-real-moz]

Damn son! Thanks for the amazing reply and in such a short time :). Really appreciate it! I will get back to you as soon as I went through your reply carefully in order to understand it correctly.
Big thanks! 💪🏻

[K-vanc]

you are welcome 👍

[the-real-moz]

for some reason, I get this output:

this being my inverpert path. I just copied yours and tried to understand... hm.
Here is my config file:
https://file.io/JFc2Et38gGdX

<inverter-path>["subtitle":"##episode# • #","##subtitle##"]["desc":"##country(,)##","# • #date##","# • #episode##","#\n#desc#..#","#\nStars\[{system}\]: #star-rating##"][“credits”:||#delete#]["writer":||#delete#]["producer":||#delete#]["composer":||#delete#]["actor":||#delete#]["director":||#delete#]["date":"#(.*?)#"]["category":"##category(,)##"||#max#2][“country”:||#delete#]["episode":"#(.*?)#"]["rating":||#delete#]["star-rating":||#calc#(\d(?:\.\d+)?)\/4||*2.5||#calc#\/(4)||*2.5||#calc#(\d(?:\.\d+)?)\/5||*2||#calc#\/(5)||*2 ||#calc#(\d+)\/100||/10||#calc#\/(100)||/10||#replace#(^(?:1|2)(?:\.\d+)?\/10)##(^(?:3|4)(?:\.\d+)?\/10)##(^(?:5|6)(?:\.\d+)?\/10)##(^(?:7|8)(?:\.\d+)?\/10)##(^(?:9|10)(?:\.\d+)?\/10)||★☆☆☆☆##★★☆☆☆##★★★☆☆##★★★★☆##★★★★★]["showicon":||#delete#]["star-rating":||#delete#]</inverter-path>

Not quite sure what's wrong here... or is it the order of inverter path commands? like in your original post you posted the [desc] after the big [star-rating]...

[the-real-moz]

Forget my previous reply - it was indeed the order of the inverter path commands. :) works now! :)

[K-vanc]

Good to see you noticed order was the problem. Inverter module is extreamly powerful and works like an operating system. You need to understand what you asked it and in which order. On your old order, first you added star rating into description without any modification. The you modified star rating tag and then deleted the modified tag so it never appeared 😀

[the-real-moz]

Good to see you noticed order was the problem. Inverter module is extreamly powerful and works like an operating system. You need to understand what you asked it and in which order. On your old order, first you added star rating into description without any modification. The you modified star rating tag and then deleted the modified tag so it never appeared 😀

yeah now I get it. Originally I thought I had to write the inverter paths order similar to how the xml tree will be inside the grabbed xml data so to speak you know. Which of course is not the case at all, and now it makes sense why it didn't work at all. Thanks a lot man :)

[the-real-moz]

I have another question on top of that if I may :).
I grabbed my epgs with WebGrab+Plus before and usually for the German site tvspielfilm.de there is a imdb star-rating for almost all channels I think. As far as I remember the star rating is most common in the tvspielfilm grapped channels anyway - but in tempest the tvspielfilm site config doesn't grab the star rating. Would it be able to update the enc site config to add the star ratings if that's possible?
As far as I saw until now, the texxas.de has star-ratings, but the time the grabbing takes in comparison to the encoded tvspielfilm is huge.
While the tvspielfilm grabs amazingly fast with tempest. So witht he star-rating values an top of that (in order to make my inverter config also possible) that would be amazing.

Thanks for getting in touch already!

[K-vanc]

Hi;

Siteconfig that I prepared for tvspielfilm does not belong to their website and there is no imdb rating on the source that I am using. Maybe in the future I can prepare another siteconfig for their website but it will not be fast as expected since imdb ratings are located in additional show pages which means 1 additional url will be called for each show same as texxas.de siteconfig does.

[the-real-moz]

Ah! ok then it wouldn't make that much difference and therefore not needed that much. I mean I didn't compare it side by side but I get the feeling that TVSpielfilm usually has "more" star ratings and better descriptions than Texxas, even though Texxas is also fine. I'm not complaining u know... thanks for everything!

[the-real-moz]

One (hopefully) last question K-vanc if I may.
I don’t want to open another topic just for this so I‘m just gonna ask it here.

Is there a way to limit the amount of characters in inverter parh for let‘s say „desc“ in an elegant way?
I‘m not that fond with regular expressions even though I have some php/js/java skills but as I looked up some stuff that might help me with the logic behind the inverter path system, I found some suggestions to use for example this in the regex to limit the characters to 50 (in this example), nevertheless which characters or digits:

%^.{1,50}

Is there a way to put that into the inverter path? I tried some ways, but I fail. Thanks for your help again dude!

ps: I studied the manual carefully but either I‘m overseeing something or I don’t get it. 😂
I hoped there's an equivalent to ||#max# but for characters instead of elements like max_chars or max_sentences even.

[K-vanc]

hi, you can do it by adding a replace command to description tag. There are tons of ways but below lines as example will do it;

||#replace#^(.{50}).*||\1 => will capture first 50 chars and replace all by this

or

||#replace#^([\w\s\S]{50}).*||\1 => will capture first 50 chars(as letters(Unicode),numbers,whitespaces and symbols) and replace all by this

[the-real-moz]

Thanks a lot my man!

[the-real-moz]

thanks for your help as always K-Vanc, but for some reason it doesn't work for me.
I tried multiple variations alongside:

["desc":"#(.?)#"||#replace#^(.{50}).||\1]

and I tried

["desc":"#(.?)#"||#replace#^([\w\s\S]{50}).||\1]

I even tried adding it in my existing line:
["desc":"##country(,)##","# (#date#)#","#\•#star-rating#\•#","#\n#desc##"||#replace#^([\w\s\S]{10}).*||\1]

And I tried to change 50 to 10 or whatever, so that I can see if there's any difference but nothing changes the length of the desc text block/the numbers of chars in desc.

What am I doing wrong?

[K-vanc]

this works fine here...

["desc":"##country(,)##","# (#date#)#","#\•#star-rating#\•#","#\n#desc##"||#replace#^(.{50}).*||\1]

but only if you copy/paste properly since one "*" is missing on your version.......

don't use other line one atm. Noticed square bracket in replace may cause some parse error. I will fix it on next release...

[the-real-moz]

thanks amigo. just wanted to let you know that I got it to work in the meantime.

and ooops... didn't see the missing *. :) thanks!