Mass copy TeachUI commands to another account

[Bench2]

Greetings!

SEPIA is the most wonderful piece of programming I've ever played with. (Florian if you still check in here I take my hat off to you--I'm blown away!) I've been exploring SEPIA for about a year and it currently runs my home connected to Openhabian. While I've only fiddled a little bit under the hood (I have so many questions, but those will wait until I understand more), my current task leads me to this question:

Is there an easy way to mass copy TeachUI commands to another client account?

Up to now I've been exporting commands and importing them one by one into another account. It was OK at first, but I've amassed 100+ commands and I'm hoping there's a better way. It looks like this data is in Elasticsearch, but before I delve into that rabbit hole I thought someone might have a simpler solution.

Thank you!

[fquirin]

Hi @Bench2 ,

first of all thanks a lot for the kind words! 😃
Sorry for my late reply, I've been quite busy the last months and barely had any time to check on my open-source projects :-(.

Unfortunately I've never implemented an 'export-all' button, but in theory it shouldn't be that hard to do. I'll have a look at the files to see, if I can maybe offer a hotfix that you can upload to your server manually. I'd love to release an official update, but that is too much work atm.

In the meantime there is something that might help in the future. Did you know that any Teach-UI command that you create for the "assistant" user, will work for all users? :-). This may or may not make sense, depending on if you have a lot of individual, user-specific commands or more general things.

[Bench2]

Hello, @fquirin

Thank you for your reply. No worries I understand the time thing, but that makes me even more blown away by your work you've done in your "spare time"!! Am I right in my gathering that you've done all of this with S.E.P.I.A by yourself? I'm in awe by the scope and breadth of what you've built. It's truly incredible.

No, I didn't realize that all Teach-UI commands are universal! Of course. Doh! :embarassed:

Thank you for the offer of a mass export feature, it would be a useful feature but I think what would be of more use (rescue?) for my going down the wrong path of not using the "assistant" account from the start is a mass import feature if that would be possible.

On another note, I've run into a new error with Hey SEPIA wake word feature. I've started getting the following error:

Porcupine error: Failed to create module. - Name: Error - Message: 'pv_porcupine_init' failed with status RUNTIME_ERROR

I've been using 2.1en Hey SEPIA with a Key (v2+) key for months. The error goes away if I use 1.4 Hey SEPIA (as expected).

I've got SEPIA on Raspbian Bookworm. My initial thought is Porcupine has changed something, but I'm clueless as to how to verify this. The strange thing is I don't get the error on some accounts on different clients while others have been getting the error consistently. (I've managed to trigger a "Error: 'pv_porcupine_init' failed with status ACTIVATION_LIMIT_REACHED" error trying various things--understandable.)

Thank you for your time!
Best,
Ben

[fquirin]

Hi Ben ,

Am I right in my gathering that you've done all of this with S.E.P.I.A by yourself?

That is correct, yes. Of cause there are dependencies from things like TTS, STT or wake-word systems etc., where I wrote "only" the integration code and some ideas where created in the discussion with other people or inspired by other projects, but I wrote all the server and UI/frontend code and made all the design stuff and graphics, so basically everything you will find in the SEPIA GitHub repositories 🙂. Its a project that I've started a very long time ago and it has changed a lot over the years. Currently I'm experimenting with local LLMs ^^, exciting times (again).

No, I didn't realize that all Teach-UI commands are universal!

I think you got the point, but just to make sure: Its not "all" Teach-UI commands, but all commands that are explicitly stored via the "assistant" user (by default: uid1005). I think its mentioned somewhere in the "docs", but documentation has always been a weak spot of the project and its certainly not very visible for users 🙈.

I've been using 2.1en Hey SEPIA with a Key (v2+) key for months. The error goes away if I use 1.4 Hey SEPIA (as expected).

I've got SEPIA on Raspbian Bookworm. My initial thought is Porcupine has changed something, but I'm clueless as to how to verify this. The strange thing is I don't get the error on some accounts on different clients while others have been getting the error consistently. (I've managed to trigger a "Error: 'pv_porcupine_init' failed with status ACTIVATION_LIMIT_REACHED" error trying various things--understandable.)

I ran into the same problem today :-(. My first guess is that Picovoice indeed changed something. It has always bothered me, that Porcupine 2 required an occasional license check by contacting their servers and it might be that this check is failing, although the error is very generic. Fortunately they've created a "Hey SEPIA" wake-word back in the Porcupine 1.4 days for the SEPIA project that is completely independent. In theory it works a bit worse, but I've been using it the whole day without any false positives. I'm going to investigate the issue further.

Thank you for the offer of a mass export feature, it would be a useful feature but I think what would be of more use (rescue?) for my going down the wrong path of not using the "assistant" account from the start is a mass import feature if that would be possible.

I felt inspired today and had some time to implement the 'export/import all' feature 😁. It would be very helpful, if you could try it out in your system. I ran some tests and everything looked good, but there is a small chance that I might have missed some edge cases ^^. I'd suggest to make a SEPIA backup first and then try out the import with a clean, new user maybe. Here are the files that you need to replace on your SEPIA server and/or client: www.zip

The server hosts a version of the client located in the folder: ~/SEPIA/sepia-assist-server/Xtensions/WebContent/app which can be accessed via http://[server-IP]:20721/app/ or any hostname you are using.
If you use the stand-alone Raspberry Pi client then you should look for ~/clexi/www/sepia/.
Plz let me know if that worked for you 🙂

[Bench2]

Hi, Florian.

Thanks for the clarification. Yes, that's how I understood what you've done. It really is amazing. Honestly simply fantastic!

YES! I saw your LLM model integration posting. I'm VERY interested in this. It will be a game changer for end user experience. I would love to play with it, but your post there left out a lot of how to start. If you need beta testers... ;)

Understood about how "assistant" would work with multiple accounts.

OK, I think I might be able to help on the documentation side. I didn't want to assert myself presumptuously, but in a former life I was writer and author (tech, non-fiction). I seemed to have a knack for tutorials (11 books published in 9 languages--translated by the publisher--is German your primary language?). I would like to offer my help if I may. My gut feeling is when the general public comes to really understand the pitfalls of cloud personal assistants, home automation, LLM's, etc., what you're doing is the obvious way to go. It's just getting things up and going is not something a lot of people have the skills, understanding or patience to get going. I have a few thoughts on that, but that's a another conversation.

As terrible as this sounds, it's a relief that the porcupine thing is not just me (that I didn't break anything or a hardware failure on my end caused it). :)

Thank you for the feature! I will download and will report back.

Best!
Ben

[fquirin]

OK, I think I might be able to help on the documentation side. I didn't want to assert myself presumptuously, but in a former life I was writer and author (tech, non-fiction). I seemed to have a knack for tutorials (11 books published in 9 languages--translated by the publisher--is German your primary language?). I would like to offer my help if I may.

That sounds pretty awesome, congratulations to your publications! 😎
I'd love to see some kind of tutorials section, maybe this could actually be its own repository within the SEPIA project. I've tried to collect the important things in the sepia-docs repository, but a lot of information is still scattered all around the different components or simply missing. It is a bit tricky though to keep the docs up-to-date, because things have been changing quickly in the past. I'm not sure what's the best way to proceed, especially considering the resulting workload for both of us, but maybe you have some things in mind that would have helped you a lot, when you've experimented with SEPIA.

P.S.: German is my primary language, yes. That is also the reason why SEPIA only works properly in German and English atm, since it requires a lot of hand-crafted rules to recognize commands properly. LLMs would be the next step forward here, but right now there is absolutely no chance to run them in acceptable speed on a Raspberry Pi, which has always been one of my primary goals.

[Bench2]

That sounds pretty awesome, congratulations to your publications! 😎 I'd love to see some kind of tutorials section, maybe this could actually be its own repository within the SEPIA project. I've tried to collect the important things in the sepia-docs repository, but a lot of information is still scattered all around the different components or simply missing. It is a bit tricky though to keep the docs up-to-date, because things have been changing quickly in the past. I'm not sure what's the best way to proceed, especially considering the resulting workload for both of us, but maybe you have some things in mind that would have helped you a lot, when you've experimented with SEPIA.

I've been reading your docs (scattered as they are on the nets) and I don't mean to continue to gush, but what you've done with documentation is incredible too. The more I looked, the more I found. You've been VERY busy!

Yes, I understand. Sepia has been a "living" project ("she" really has become a member of our household in so many ways--as crazy as this might sound, I would be upset if I lost her) and with so many changes along the way, it's really a wonder to behold how you've done all of this by yourself.

Yes, I've been keeping notes (pages and pages--I could write a book!). When it comes to "products" (things you produce for others), having an overview of 5 w's is critical. In this case, the "Who" you're writing for (the end user). Looking/writing for the end-user perspective/experiece has worked best in my experience. If I may, there are some rough edges with the user experience, etc., you might like to know about. I'm not sure if you'd like to hear about these things and/or where it should be done. Seperate topics here?

Anyway, I think task-centric tutorials are the way to go with complex stuff like this. Where we put this stuff I'll leave to you, but I do think a link to the things should be in the "For Newcomers:" welcome screen eventually.

P.S.: German is my primary language, yes. That is also the reason why SEPIA only works properly in German and English atm, since it requires a lot of hand-crafted rules to recognize commands properly. LLMs would be the next step forward here, but right now there is absolutely no chance to run them in acceptable speed on a Raspberry Pi, which has always been one of my primary goals.

Thank you for confirming my thought. It just makes everything you've done much much more impressive.

I do not speak German, but I notice a few bits and piece of German here and there in the English setting. ("Meine" Clients in Menu 3 for example)

These are not a big deal, but perhaps there could be a list kept if you get the time for another release one day?

As to LLM's (as with everything?) it seem to all depend on which models you use. I've been playing with various LLM's on a Pi 5b 8g and phi3:mini runs locally on nvme has been acceptable. SEPIA probably wouldn't need full-on LLM capability, but local "good enough" knowledge would be suficient IMHO (more than your average acquaintance you'd have over to your home). I would really like to try out what you've got posted at: https://github.com/SEPIA-Framework/sepia-llm-experiments/tree/main but I'm at a loss on how to get that started/running. Perhaps we can move this to another topic if you have time?

Thanks again and have a great day!
Ben

[Bench2]

Hi, again Florian.

Clicking the Export All button returns:

No commands found for language: EN.

I only see an Import (which only allows me to select a single json to import)-- I don't see an Import All button.

It's the same when restarting SEPIA using restart-sepia.sh and logging in again.

Edit:
I had a look at your code.
teach.html is does not have a button

and

sepiaFW.teach.sh
does not have a sepiaFW-teachUI-import-all (assuming that's what you'll call it) function.

Thank you!
Ben

[fquirin]

No commands found for language: EN.

hmmm, that's odd. If you press 'Load recent' you do see commands?
Maybe there is an issue with the language setting, because I think technically you can have a "preferred" language and an UI language that don't necessarily have to be identical. Do you use English everywhere?

I don't see an Import All button

I forgot to mention that I rewrote the "Import" button to handle both files. If you select a file that was created by "Export All" it should be recognized automatically :-)

[Bench2]

No commands found for language: EN.

hmmm, that's odd. If you press 'Load recent' you do see commands? Maybe there is an issue with the language setting, because I think technically you can have a "preferred" language and an UI language that don't necessarily have to be identical. Do you use English everywhere?

I have English set everywhere and I got it to work (more in a sec). Just FYI the "No commands found for language: EN" must be due to no error handling message for "No Teach-UI commands found." I loaded up the "assistant" to try your new feature (which had no commands).

I forgot to mention that I rewrote the "Import" button to handle both files. If you select a file that was created by "Export All" it should be recognized automatically :-)

Ah, of course! So when I loaded another account with all of my Teach-UI commands (I had 370 of them!) and it all worked brilliantly!

Question: Before I go through editing my various accounts and moving universal commands to "assistant", do duplicate commands on satellites default to "assistant" or do the currently loaded user command take prioriety?

Thank you, Florian!

[fquirin]

Happy to hear that it worked out :-).

About your question, I'm 94% certain (rough estimation), that the personal command should always have the priority, since this is the first thing that will be checked internally.