Webserver install on 2nd Pi

[bemo47]

Hi, i want to install my webserver on a second Pi, its a Pizero 2W equipped with 2 Wifi, one on the lan where Allsky is hosted and one on a lan with an ADSL connection able to be reached from internet.
But as i am not skilled in Linux, i don't know how to install it, the Web documentation says to download source from github, so i did, its now in a folder in my Pi Zero. But then what to do next ?
There an install script in the Allsky folders but it is on the Allsky Pi4, so how to create this webserver on the Pi Zero ?
I miss some guidance here to succeed....
One option i am thinking about is to install the full Allsky also on the Pi Zero and then i will just run the install script for webserver.
And after i will have to adapt the FTP or an Rsync process to move images from the Pi4 to the Pi Zero...
But maybe there is a simpler step to install the webserver on a second Pi...
Thanks for help.... :)

[EricClaeys]

@bemo47 The option you came up with is probably the easiest thing to do. The Allsky Website requires some web server to be present, and the WebUI installation script (~/allsky/gui/install.sh) installs one. Many people run their website on a remote server, often one hosted by a commercial company, and that company provides the web server so those users just have to install the allsky-website package.

A couple things to keep in mind:

• When installing the WebUI on the Pi Zero, don't call it "allsky", since you already have a machine on your network with that name.
• Disable Allsky on the Pi Zero so it doesn't try to access a camera that doesn't exist: sudo systemctl disable allsky.service.
• If you can have the Pi Zero run an FTP server, then your other Pi can simply FTP files to the Pi Zero, just like it's a remote server. Another option is to share /var/www/html/allsky from the Pi Zero and then have your other Pi mount it (possibly as /var/www/html/allsky), so you can then simply copy files to it. You'll need to Google how to do those. My main Pi mounts a filesystem from my NAS, and copies files there.
• As I think about it more, if you can mount the Pi Zero's /var/www/html/allsky onto your other Pi, you can then run the website/install.sh script on the other Pi and "pretend" like the website is on the other Pi. You would still need to install allsky and the WebUI on the Pi Zero, but not the website. This has the advantage that any future upgrades are only done from your main Pi.

[bemo47]

Thanks a lot, i think i already have installed Allsky, webui and web on the Pi zero, so i just have to mount the /var/www files of the Pï4 on the Pi Zero, and then the Webserver will be able to work on the Pi Zero.
Not sure that your lats option could work in the way i need, the PiZero is the only one able to be open on internet, so i think that the webserver must be located on it and not on the PI4.
And thks for the remind of deactivation of Allsky service. Done also.

[EricClaeys]

@bemo47

Not sure that your lats option could work in the way i need, the PiZero is the only one able to be open on internet, so i think that the webserver must be located on it and not on the PI4.

What is my "lats option"?
I agree the webserver needs to be on the Pi Zero since it's the only one on the Internet.

In my 4th bullet point you don't need to run website/install.sh since the website is already on the Pi Zero, but future upgrades of any of the repositories would only need to be done from the Pi4, even upgrading the website, since it would either exist on the Pi Zero, or appear to exist on the Pi Zero, depending on which way you share/mount.

[bemo47]

so i did, the whole /var/www/html/allsky folder on Pi4 is shared via Samba under name allskyweb, on Pi Zero i have installed allsky and webser, and then deactivated allsky from running, then i have mounted the allskyweb share in the /va/www/html/allsky folder (emptied before), and now i can see all files from the Pi4 share on the Pi Zero. Sounds good.
But i can't get the current image, the live view which is from the tmp folder on the pi4. I think i have to change the way it is written. I tried to replace IMG_DIR="current/tmp" in allsky config.sh by "/var/www/html/allsky" but then i don't get any image in allsky live and neither on the website. So i went back to "current/tmp".
I miss something to get this current image in the website. For timelapse, keogram, startrail i will see tomorrow.

[EricClaeys]

@bemo47. Good progress. You need the P4 to copy image.jpg to /var/www/html/allsky and in the config.js file change imageName to image.jpg.
Assuming the only place the website is installed is on the Samba share, then in the allsky/config/ftp-settings.sh file, set PROTOCOL="local" and the various *_DIR variables to /var/www/html/allsky, /var/www/html/allsky/startrails, etc.
This will cause the files to simply be copied to the website; FTP isn't needed.

If you have the latest Allsky you can use the WEB_DAYS_TO_KEEP setting to limit how many days of data are kept.

[bemo47]

@bemo47. Good progress. You need the P4 to copy image.jpg to /var/www/html/allsky

this is the IMG_DIR setting i guess

and in the config.js file change imageName to image.jpg. Assuming the only place the website is installed is on the Samba share, then in the allsky/config/ftp-settings.sh file, set PROTOCOL="local" and the various *_DIR variables to /var/www/html/allsky, /var/www/html/allsky/startrails, etc. This will cause the files to simply be copied to the website; FTP isn't needed.

IMAGE_DIR and WEB_IMAGE_DIR to /var/www/html/allsky ? and same for all others vidoe, startrail and keogram ? both DIR and WEB_DIR ?

If you have the latest Allsky you can use the WEB_DAYS_TO_KEEP setting to limit how many days of data are kept.

!!!!!!!!!!!!!>>>>>>>>>>>>>>>>> working !!! by setting both DIR and WEB_DIR , i think it is ok, now i just need to check if the internet access will work !! Thanks a lot !!!

[bemo47]

Live image from the Pi Zero through the Samba share on the Pi4 hosting the Allsky soft and the camera

Tomorrow i should get the timelapse, startrial and keogram

[EricClaeys]

@bemo47. You did it! Good job.
You shouldn't need the WEB_*_DIR variables- they are only needed if you want the files to go to two places, on the Pi and to a remote server. In your case, the Pi4 considers the website to be local.

What is your Internet URL? And are you going to put this on the global Allsky map?

[bemo47]

The url is still not ready, and yes i should put it on the map. Le lun. 11 avr. 2022 à 18:58, EricClaeys ***@***.***> a écrit :

…

@bemo47 <https://github.com/bemo47>. You did it! Good job. You shouldn't need the WEB_*_DIR variables- they are only needed if you want the files to go to two places, on the Pi and to a remote server. In your case, the Pi4 considers the website to be local. What is your Internet URL? And are you going to put this on the global Allsky map? — Reply to this email directly, view it on GitHub <#1140 (reply in thread)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AKSF2YF6XEEXTOXTPPFRM5TVERK3DANCNFSM5TARXGTA> . You are receiving this because you were mentioned.Message ID: ***@***.***>

[bemo47]

This url seems to work allskygonthiers.ddns.net/allsky Le lun. 11 avr. 2022 à 18:58, EricClaeys ***@***.***> a écrit :

…

@bemo47 <https://github.com/bemo47>. You did it! Good job. You shouldn't need the WEB_*_DIR variables- they are only needed if you want the files to go to two places, on the Pi and to a remote server. In your case, the Pi4 considers the website to be local. What is your Internet URL? And are you going to put this on the global Allsky map? — Reply to this email directly, view it on GitHub <#1140 (reply in thread)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AKSF2YF6XEEXTOXTPPFRM5TVERK3DANCNFSM5TARXGTA> . You are receiving this because you were mentioned.Message ID: ***@***.***>

[bemo47]

still many things to improve, but at least the web is working, now the map !

map should be ok now

Thanks again for all the help !

[bemo47]

This morning, ddns url doesn't work, i will check that
but keogram, startrail and timelapse doesn't appear on the Pi Zero, they have been copied on the right directories on the Pi4 but these directories mounted on the Pi Zero stays empty

here the Pi Zero with mounting point at "allsky" level

here the shared "allsky" on the Pi4

an option for subfolder not set ?

[EricClaeys]

@bemo47. I would guess your Samba share isn't working. That's not an Allsky problem. If you manually create a file in /var/www/html/allsky on the Zero do you see it on the Pi 4? And if you create a file on the Pi 4 do you see it on the Zero?

I noticed you have a file called "gonthiers". Did you create that manually? Allsky calls the startrails files "startrails-YYYYMMDD.jpg".

[bemo47]

Oh, right, at least i forgot to put the mount in the boot on the Pi Zero but the live image is working, and updating continuously, so the share is still working but only at allsky folder level And yes, here are my settings in the ftp-settings.sh, but i will remove this name gonthiers and let it empty as before. [image: image.png] Le mar. 12 avr. 2022 à 11:05, EricClaeys ***@***.***> a écrit :

…

@bemo47 <https://github.com/bemo47>. I would guess your Samba share isn't working. That's not an Allsky problem. If you manually create a file in /var/www/html/allsky on the Zero do you see it on the Pi 4? And if you create a file on the Pi 4 do you see it on the Zero? I noticed you have a file called "gonthiers". Did you create that manually? Allsky calls the startrails files "startrails-YYYYMMDD.jpg". — Reply to this email directly, view it on GitHub <#1140 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AKSF2YDV37RH3ZSZNTTT7RTVEU4FLANCNFSM5TARXGTA> . You are receiving this because you were mentioned.Message ID: ***@***.***>

[EricClaeys]

@bemo47 The thumbnails directories need to be writable by the web server, which runs as www-data. Do the following on both Pi's:

ls -ld /var/www/html/allsky/*/thumbnails

On whichever Pi the files actually exist, www-data has permissions and on the other it doesn't.

[bemo47]

result on PI4 which has the files, on Pi Zero they don't exist

and on Pi Zero but on allskyweb folder which is the mount for allsky Pi4 (maybe i should keep the same name ?)

[EricClaeys]

@bemo47. Looks like your Samba mount isn't working.
I don't know if it matters, but before mounting on the Pi Zero, /var/www/html/allsky probably should be empty since its contents will be hidden after the mount.

[bemo47]

hmm, i think its working, i see the gonthiers files which i removed from the Pi4 and they disappear on the PiZero, so the mount is working.
maybe the fact that these gonthiers were there could create some trouble ?
we will see tomorrow morning with the second set of files coming....

[EricClaeys]

@bemo47 Sorry about that. I didn't see the 2nd half of your post. You are getting the "Permission denied" message because the Pi Zero's web server can't create anything in the "thumbnails" directories, because they are owned and grouped to root, not www-data, which is the login used to run the web server.
See if there's a setting in Samba that will use the same user and group IDs as well as permissions, on the Zero as are on the Pi 4.

I would suggest mounting the Pi 4's filesystem in the same place on the Zero - I think it'll be less confusing. You can delete the contents of the /var/www/html/allsky and /var/www/html/allskyold directories on the Zero since they aren't used.

[bemo47]

@EricClaeys so i have now allsky on each Pi, but still this write error due to different owners.

So i will ask help on some linux forums to try to get the same users on both side with same rights.

But, maybe there is another possibility which could be enough, i mean if i could launch a run of the webserver on the Pi4 through a script, just to make it creating these thumbnails, and then when the one on the Pi Zero will run it will just have to read and this is working perfectly.
Is there a simple way to launch an automatic run of the webserver on the Pi4 through a crontab ?

[bemo47]

@EricClaeys ok i found a syntax able to run the webserver on each folder to create all thumbnails everydays

easy...........

but... at which time should i launch that....
just after the copy of the new files each day, can i link that to the ftp ?
or is there a fixed time everyday ? i think it is following the sunrise...

[EricClaeys]

@bemo47. The timelapse video and keogram/startrails files are created after the transition from night to day. See the Information for advanced users section of the README.md file on the main GitHub page for information on where to put the commands you want.

[bemo47]

@EricClaeys ahhh sorry, the texts says its a rename, i guess to change .repo in .sh ?
but the commands seems not adapted, so i do a rename instead and will check...

[EricClaeys]

@bemo47 You found a bug in the documentation. Sorry about that. Here is what you want to execute to rename the file:

cd ~/allsky/scripts
mv endOfNight_additionalSteps.repo  endOfNight_additionalSteps.sh

I put in a change request to fix the documentation.

The Linux mv command is used to move a file or directory or to rename it. If you type mv A B and B does not exist and does not include a / (meaning it does not include a directory) then A is renamed to B. Because the command you executed incorrectly had scripts/ in the second name (my fault, not yours), the mv command looked for a directory called scripts and didn't find one, so it produced an error message and quit.

[bemo47]

@EricClaeys oh, proud to have found a bug, normally its more me who is bugging on all linux commands :)
ok, anyway, i did the rename, i deleted all thumnails already created, i copied my 3 commands for chrome and we will see tomorrow morning

[EricClaeys]

@bemo47 Congratulations!
A couple comments about your scripts:

• You shouldn't need the "sleep 10" before the first command or after the last one.
• You can optionally add debugging output, for example:

if [ "${ALLSKY_DEBUG_LEVEL}" -ge 3 ]; then
   echo "${ME}: Creating thumbnails for keogram, timelapse, and startrails.
fi

This will add the message to the /var/log/allsky.log file if the Debug Level in the WebUI is 3 or 4. Of course you can change that level to anything you want.
This is useful for debugging, for example, to make sure the script is called, and in case the chromium-browser command produces an error message you're more likely to know it came from this script.

[bemo47]

@EricClaeys ok, done, thks a lot once again

[EricClaeys]

@bemo47 My pleasure. Enjoy your Allsky!

[bemo47]

@EricClaeys so, the script did not run or did not create the thumbnails, so i tried to do a run in the terminal and i think there are some syntax error in th IF command added for the log, here the result of my run in terminal :

pi@allsky:~/allsky/scripts $ ./endOfNight_additionalSteps.sh
./endOfNight_additionalSteps.sh: ligne 14 : [:  : nombre entier attendu comme expression
[3843626:3843626:0415/102140.841876:ERROR:gpu_init.cc(453)] Passthrough is not supported, GL is egl, ANGLE is 
[3843124:3844069:0415/102140.891504:ERROR:object_proxy.cc(642)] Failed to call method: org.freedesktop.DBus.Properties.Get: object_path= /org/freedesktop/UPower: org.freedesktop.DBus.Error.ServiceUnknown: The name org.freedesktop.UPower was not provided by any .service files
[3843124:3844069:0415/102140.892844:ERROR:object_proxy.cc(642)] Failed to call method: org.freedesktop.UPower.GetDisplayDevice: object_path= /org/freedesktop/UPower: org.freedesktop.DBus.Error.ServiceUnknown: The name org.freedesktop.UPower was not provided by any .service files
[3843124:3844069:0415/102140.895236:ERROR:object_proxy.cc(642)] Failed to call method: org.freedesktop.UPower.EnumerateDevices: object_path= /org/freedesktop/UPower: org.freedesktop.DBus.Error.ServiceUnknown: The name org.freedesktop.UPower was not provided by any .service files
[3843124:3843512:0415/102145.753786:ERROR:chrome_browser_main_extra_parts_metrics.cc(230)] crbug.com/1216328: Checking Bluetooth availability started. Please report if there is no report that this ends.
[3843124:3843512:0415/102145.753857:ERROR:chrome_browser_main_extra_parts_metrics.cc(233)] crbug.com/1216328: Checking Bluetooth availability ended.
[3843124:3843512:0415/102145.753884:ERROR:chrome_browser_main_extra_parts_metrics.cc(236)] crbug.com/1216328: Checking default browser status started. Please report if there is no report that this ends.
[3843626:3843626:0415/102145.961110:ERROR:sync_control_vsync_provider.cc(140)] Calculated bogus refresh interval=0.97603 s, last_timebase_=59910092303 bogo-microseconds, timebase=59911068333 bogo-microseconds, last_media_stream_counter_=59910, media_stream_counter=59911
[3843124:3843512:0415/102145.977139:ERROR:chrome_browser_main_extra_parts_metrics.cc(240)] crbug.com/1216328: Checking default browser status ended.
[3843626:3843626:0415/102146.952534:ERROR:sync_control_vsync_provider.cc(140)] Calculated bogus refresh interval=0.991429 s, last_timebase_=59911068333 bogo-microseconds, timebase=59912059762 bogo-microseconds, last_media_stream_counter_=59911, media_stream_counter=59912
[3843626:3843626:0415/102147.951206:ERROR:sync_control_vsync_provider.cc(140)] Calculated bogus refresh interval=0.998716 s, last_timebase_=59912059762 bogo-microseconds, timebase=59913058478 bogo-microseconds, last_media_stream_counter_=59912, media_stream_counter=59913
[3843626:3843626:0415/102148.934392:ERROR:sync_control_vsync_provider.cc(140)] Calculated bogus refresh interval=0.983211 s, last_timebase_=59913058478 bogo-microseconds, timebase=59914041689 bogo-microseconds, last_media_stream_counter_=59913, media_stream_counter=59914
[3843626:3843626:0415/102149.902102:ERROR:sync_control_vsync_provider.cc(140)] Calculated bogus refresh interval=0.96663 s, last_timebase_=59914041689 bogo-microseconds, timebase=59915008319 bogo-microseconds, last_media_stream_counter_=59914, media_stream_counter=59915
[3843626:3843626:0415/102150.899368:ERROR:sync_control_vsync_provider.cc(140)] Calculated bogus refresh interval=0.998085 s, last_timebase_=59915008319 bogo-microseconds, timebase=59916006404 bogo-microseconds, last_media_stream_counter_=59915, media_stream_counter=59916
[3843626:3843626:0415/102151.944639:ERROR:sync_control_vsync_provider.cc(140)] Calculated bogus refresh interval=1.03756 s, last_timebase_=59916006404 bogo-microseconds, timebase=59917043962 bogo-microseconds, last_media_stream_counter_=59916, media_stream_counter=59917
[3843626:3843626:0415/102152.935547:ERROR:sync_control_vsync_provider.cc(140)] Calculated bogus refresh interval=0.998878 s, last_timebase_=59917043962 bogo-microseconds, timebase=59918042840 bogo-microseconds, last_media_stream_counter_=59917, media_stream_counter=59918
[3843626:3843626:0415/102153.899745:ERROR:sync_control_vsync_provider.cc(140)] Calculated bogus refresh interval=0.964235 s, last_timebase_=59918042840 bogo-microseconds, timebase=59919007075 bogo-microseconds, last_media_stream_counter_=59918, media_stream_counter=59919
./endOfNight_additionalSteps.sh: ligne 29: fin de fichier (EOF) prématurée lors de la recherche du « " » correspondant
./endOfNight_additionalSteps.sh: ligne 33: erreur de syntaxe : fin de fichier prématurée
pi@allsky:~/allsky/scripts $

Here my endofnight script, line 14 is the first IF :

#!/bin/bash
# This script is a hook to run additional operations at the end of the night,
# such as copying all the images to an additional server or publishing videos
# to a hosting service. It is run prior to the deletion of any old image files.
# To use this script, first copy it to
# $ALLSKY_HOME/scripts/endOfNight_additionalSteps.sh, and then edit the copy.
# This will prevent your changes from being lost in future upgrades.
# Include "${ME}" in any output so it's easier to find in the log file, for debugging.
ME="$(basename "$BASH_ARGV0")"
if [ "${ALLSKY_DEBUG_LEVEL}" -ge 4 ]; then
   echo "${ME}: Creating thumbnails for keogram.
fi
timeout 20 chromium-browser 192.168.2.223/allsky/keograms/
sleep 10
if [ "${ALLSKY_DEBUG_LEVEL}" -ge 4 ]; then
   echo "${ME}: Creating thumbnails for timelapse.
fi
timeout 20 chromium-browser 192.168.2.223/allsky/videos/
sleep 10
if [ "${ALLSKY_DEBUG_LEVEL}" -ge 4 ]; then
   echo "${ME}: Creating thumbnails for startrails.
fi
timeout 20 chromium-browser 192.168.2.223/allsky/startrails/

but without these IF statements, my EON script seems working, even if it gives many errors in the terminal

sorry for the format here......................

[EricClaeys]

@bemo47 My bad. The echo statements need a double quote at the end, which closes the string started by the initial double quote:

echo "${ME}: Creating thumbnails for keogram."

FYI you can surround code or anything else with lines that contain three ~~~ and it will format correctly. Edit your last post to see how I did it. That makes it MUCH easier to read.

[bemo47]

@EricClaeys thanks once again, i will learn a new things from each of your answer... sorry to be so time consuming !
but still uncleat if my chromium command will work fine when it is called in your EOD treatments...
will see again tomorrow
i have the feeling that calling chromium like this is not a very clean way
one question i have, but maybe a dumb one... is why these thumbnails cannot be created during this EOD process, before the FTP, then nothing will be asked to the webserver except the display which is working fine...

[EricClaeys]

@bemo47 Don't worry about taking too much time. I enjoy helping people get Allsky working so they can enjoy it, and am retired so I have the time.
Your commands should work - I don't see any reason why not. But we'll see tomorrow.

This isn't an ideal way to get the thumbnails to the server, but it will do until I implement a more permanent solution, which is on my "to do" list. The user will have an option to request Allsky to create the thumbnails after it creates the files/movies, and upload them to the server. This isn't really needed on the Pi since it can create new thumbnails whenever someone clicks on the timelapse, startrails, and keogram icons on the web page. But may remote servers don't allow external commands to be executed for security reasons, so those servers would benefit by having the thumbnails created on the Pi and uploaded.

[bemo47]

@EricClaeys so... now the script is working, i was able to test it from terminal and seems ok.

Except the comment in the log....

I wrote this
if [ "${ALLSKY_DEBUG_LEVEL}" -ge 1 ]; then
echo "${ME}: Creating thumbnails for keogram, timelapse, and startrails"
fi

So with quotes at the end of echo command, and debug_level -ge 1, i guess it should write for any debug level ?
But i have an error on each IF lines saying that an integer is expected on this line

pi@allsky:~/allsky/scripts $ ./endOfNight_additionalSteps.sh
./endOfNight_additionalSteps.sh: ligne 14 : [:  : nombre entier attendu comme expression
./endOfNight_additionalSteps.sh: ligne 18 : [:  : nombre entier attendu comme expression

Lines 14 and 18 are the same IF command, and then no message shown in the log and neither in the terminal

So i removed all the IF and got the messages in the terminal but still not in the log.

Maybe if its executed from Allsky program they will go to the log ? but its ok to have the comments for any debug level, its only once a day.

And yes, if in the future there is the option to do the thumbnails by Allsky, it will be fine for me.
And also if in the meantime the fiber is connected to my house (right now the fiber is awaiting on the other side of my street, and me also awaiting....), i will not need anymore to work with two servers, one being on 2 different lan's ! I will be able to publish directly the Allsky Pi4.

[EricClaeys]

@bemo47 If you are executing endOfNight_additionalSteps.sh from the command line then you will get those errors since ALLSKY_DEBUG_LEVEL is set in endOfNight.sh. I suggest adding these lines to the top of the file, after the ME="..... line:

# Allow this script to be executed manually, which requires several variables to be set.
if [ -z "${ALLSKY_HOME}" ] ; then
	ALLSKY_HOME="$(realpath "$(dirname "${BASH_ARGV0}")/..")"
        export ALLSKY_HOME
fi
# shellcheck disable=SC1090
source "${ALLSKY_HOME}/variables.sh"

You can check for any Debug Level you want. They go from 0 to 4. If you ALWAYS want them, remove the if and fi lines and just use the echo lines.

When you execute a command from the command line it's output goes to your terminal. When Allsky is executed automatically from the service, the service captures Allsky's output and puts it in the log file, because there may not be a terminal to send it to.

I am at my observatory this month which is in New Mexico, about 22 hours from my house in the suburbs of Chicago. I just got fiber at the observatory a week ago and it is significantly faster. If you zoom in on the pin in the south part of New Mexico you will see there are two pins close together. One is for my observatory and the other is for my second Pi that has both a ZWO and RPiHQ camera I use for testing. It's sitting in the observatory right now so the view is of the ceiling.

[bemo47]

@EricClaeys okkk, got it, and i understand what u mean ! anyway now i have just removed the IF and it will run called by Allsky in the morning, so it should be ok. Next step will be to be able to publish that website... still not working now...
And yes, i see your obs ! nice installation ! the grass is a bit rare but not an issue for astro !

[EricClaeys]

@bemo47 I just realized my location is slightly off so it's showing the middle of a field. If you enter 5 Serenity St, Mayhill, New Mexico, United States into https://maps.bing.com (not google) you can actually see the observatory - it's the square building.
Much of the southwest US is desert-like, including my place which is 2200 meters elevation.

[bemo47]

@EricClaeys
this morning the last thumbnails for yesterday were not created
when i look into the log i can see my echo messages but for each chromium command there is a message talking about "a trap for stopping point and logging" with the command itself
and also i can see the update command of the map, is this command going on internet to update coordinates ?

Apr 16 07:02:31 allsky allsky.sh[1884519]: endOfNight.sh: ===== Timelapse complete
Apr 16 07:02:35 allsky allsky.sh[1831247]: STARTING EXPOSURE at: 2022-04-16 07:02:35   @ 43.94 ms (0.04 sec)
Apr 16 07:02:42 allsky allsky.sh[1897495]: endOfNight_additionalSteps.sh: Start of thumbnails creation
Apr 16 07:02:42 allsky allsky.sh[1897495]: endOfNight_additionalSteps.sh: Creating thumbnails for keogram
Apr 16 07:02:43 allsky allsky.sh[1831247]:   > Sleeping 8.0 sec from histogram exposure
Apr 16 07:02:43 allsky allsky.sh[1831247]:   > Saving DAY image 'image-20220416070235.jpg'
Apr 16 07:02:46 allsky allsky.sh[1897495]: /home/pi/allsky/scripts/endOfNight_additionalSteps.sh : ligne 22 : 1897500 Trappe pour point d'arrêt et de trace              timeout 20 chromium-browser 192.168.2.223/allsky/keograms/
Apr 16 07:02:51 allsky allsky.sh[1897495]: endOfNight_additionalSteps.sh: Creating thumbnails for timelapse
Apr 16 07:02:51 allsky allsky.sh[1831247]: STARTING EXPOSURE at: 2022-04-16 07:02:51   @ 43.94 ms (0.04 sec)
Apr 16 07:02:52 allsky allsky.sh[1831247]: === next exposure=39066 (multiply by 0.889) [last_exposure_us=43935, maxAcceptable=134, mean=137]
Apr 16 07:02:52 allsky allsky.sh[1897495]: /home/pi/allsky/scripts/endOfNight_additionalSteps.sh : ligne 29 : 1897591 Trappe pour point d'arrêt et de trace              timeout 20 chromium-browser 192.168.2.223/allsky/videos/
Apr 16 07:02:52 allsky allsky.sh[1831247]:   > Saving DAY image 'image-20220416070251.jpg'
Apr 16 07:02:52 allsky allsky.sh[1831247]:   > Sleeping 8.0 sec from histogram exposure
Apr 16 07:02:57 allsky allsky.sh[1897495]: endOfNight_additionalSteps.sh: Creating thumbnails for startrails
Apr 16 07:02:57 allsky allsky.sh[1897495]: /home/pi/allsky/scripts/endOfNight_additionalSteps.sh : ligne 36 : 1897686 Trappe pour point d'arrêt et de trace              timeout 20 chromium-browser 192.168.2.223/allsky/startrails/
Apr 16 07:02:57 allsky allsky.sh[1897495]: endOfNight_additionalSteps.sh: End of thumbnails creation
Apr 16 07:02:58 allsky allsky.sh[1884519]: endOfNight.sh: Deleting old directory /home/pi/allsky/images/20220401
Apr 16 07:02:59 allsky allsky.sh[1884519]: endOfNight.sh: ===== Posting camera details to allsky map
Apr 16 07:03:00 allsky allsky.sh[1831247]: STARTING EXPOSURE at: 2022-04-16 07:03:00   @ 39.06 ms (0.04 sec)
Apr 16 07:03:00 allsky allsky.sh[1897748]: postToMap.sh: Map data UPDATED.
Apr 16 07:03:01 allsky allsky.sh[1831247]:   > Sleeping 8.0 sec from histogram exposure
Apr 16 07:03:01 allsky allsky.sh[1831247]:   > Saving DAY image 'image-20220416070300.jpg'
Apr 16 07:03:09 allsky allsky.sh[1831247]: STARTING EXPOSURE at: 2022-04-16 07:03:09   @ 39.06 ms (0.04 sec)

[EricClaeys]

@bemo47. Did you create the chromium-browser command? What exactly does it do?
My first guess was that the chromium-browser commands are timing out, but the message are appearing only a few seconds after chromium-browser is executed, not 20 seconds later.

What happens if you execute this?

timeout 5 sleep 10

For your map question, allsky automatically uploads your map data every other day, even if it didn't change so the server knows the site still exists. It deletes information that is old.

[bemo47]

@EricClaeys
yes, here the script

#!/bin/bash
# This script is a hook to run additional operations at the end of the night,
# such as copying all the images to an additional server or publishing videos
# to a hosting service. It is run prior to the deletion of any old image files.
# To use this script, first copy it to
# $ALLSKY_HOME/scripts/endOfNight_additionalSteps.sh, and then edit the copy.
# This will prevent your changes from being lost in future upgrades.
# Include "${ME}" in any output so it's easier to find in the log file, for debugging.
ME="$(basename "$BASH_ARGV0")"
#if [ "${ALLSKY_DEBUG_LEVEL}" -ge 1 ]; then
   echo "${ME}: Start of thumbnails creation"
#fi
#if [ "${ALLSKY_DEBUG_LEVEL}" -ge 1 ]; then
   echo "${ME}: Creating thumbnails for keogram"
#fi
timeout 20 chromium-browser 192.168.2.223/allsky/keograms/
sleep 5
#if [ "${ALLSKY_DEBUG_LEVEL}" -ge 1 ]; then
   echo "${ME}: Creating thumbnails for timelapse"
#fi
timeout 20 chromium-browser 192.168.2.223/allsky/videos/
sleep 5
#if [ "${ALLSKY_DEBUG_LEVEL}" -ge 1 ]; then
   echo "${ME}: Creating thumbnails for startrails"
#fi
timeout 20 chromium-browser 192.168.2.223/allsky/startrails/
#if [ "${ALLSKY_DEBUG_LEVEL}" -ge 1 ]; then
   echo "${ME}: End of thumbnails creation"
#fi

i comment all IF and FI and let only the echo and chromium commands
in the log i have all the echo msgs
this script has been run in terminal several time and was working perfectly, all thumbnails created
but in the End Of Night process the thumbnails haven't been created, i can only see the echo msgs in the log as shown above
not sure if i can shorten the timeout, but i can try

got it for the map coordinates, we will see tomorrow if it updates the map correctly

[EricClaeys]

@bemo47. I was asking about the `chromium-browser' command. Did you create it, and what does it do?

Did you try timeout 5 sleep 10 ?

Did you change the endOfNight_additionalSteps.sh file after the error messages? The line numbers in the error messages (22, 29, 36) don't line up with anything in endOfNight_additionalSteps.sh.

[bemo47]

@EricClaeys yes, the script is as above, but sorry i removed spaces and so line numbers are not good in this above view, but i can confirm that 22, 29 and 36 are the 3 chromium-browser commands. When i run them in terminal they work, thumbnails are created. When its run by EON process of Allsky, i get the errors above in the log and thumnails are not created.

And i changed the 1st chromium command with timeout 5 and sleep 10 but i am now in spain and cannot acces my network to check... i will try .... maybe....

[EricClaeys]

@bemo47 I just tried timeout 5 sleep 10 from the terminal and it killed the sleep command as expected. I also tried it being called from allsky, and it worked fine.
Try the chromium command with OUT the timeout and see if it makes any difference.

Can you attach the chromium command so I can try?

[EricClaeys]

@bemo47 Yes, please install the latest website (cd ~/allsky; website/install.sh), then use the attached file, removing the trailing ".txt".
Again, this won't fix the problem but will give us additional information to fix it.

No need to update the main allsky software at this time.

functions.php.txt

[bemo47]

@EricClaeys not sure how to install "only" the website, i just ran the install.sh script hoping that its the last version on my Pi4....
Then i had to reboot both Pi as the mount was apprently broken, after reboot the WS from PiZero is ok, but when i activate the new functions.php script i get this message asking to update the webserver, so i do the update, i install again the new functions.php and i get again the message to update the webserver....

[EricClaeys]

@bemo47 Assuming the Website is on the Pi, you install it or upgrade it by executing cd ~/allsky; website/install.sh. That saves your current website, creates a new one, and moves all the images and configuration files from the old to the new one. Since it moved /var/www/html/allsky to /var/www/html/allsky-OLD, you link from the Pi Zero was probably pointing to the OLD directory. That's something you'll need to be aware of whenever you upgrade the website.

Part of the installation updates functions.php so it doesn't produce that red message you saw. When you installed the new functions.php file I sent, it needed to be modified to not produce the message, which is what website/install.sh --update does. You normally will never need to do that, but it's different while we're testing.

You should have only seen the red message immediately after you installed the new functions.php script, which you only needed to do once.

Does that make sense?

In order to test the new file you may need to remove a thumbnail from the "videos" directory and either "startrails" or "keograms".
Then see what F12 has to say.

[bemo47]

@bemo47 Assuming the Website is on the Pi, you install it or upgrade it by executing cd ~/allsky; website/install.sh. That saves your current website, creates a new one, and moves all the images and configuration files from the old to the new one. Since it moved /var/www/html/allsky to /var/www/html/allsky-OLD, you link from the Pi Zero was probably pointing to the OLD directory. That's something you'll need to be aware of whenever you upgrade the website.

==> Yes, i just rebooted both Pi and the mount command occurs again and the pointing from Pi Zero to Pi4 was again ok

For the red message i will rerun the webserver install script, reboot both Pi, and install your new functions.php, is this process correct ?

[EricClaeys]

@bemo47 You should only need to run website/install.sh --update on the Pi 4 in order to fix the red message. No need to reboot anything.

[bemo47]

Ok but no need also to reinstall your special functions script ? Because this is what i did, install --update and then change functions script for the specific one, and i have the red msg. But i will try again. Le mer. 11 mai 2022, 14:22, EricClaeys ***@***.***> a écrit :

…

@bemo47 <https://github.com/bemo47> You should only need to run website/install.sh --update on the Pi 4 in order to fix the red message. No need to reboot anything. — Reply to this email directly, view it on GitHub <#1140 (reply in thread)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AKSF2YHTTWQPJOYXN77LLIDVJORBRANCNFSM5TARXGTA> . You are receiving this because you were mentioned.Message ID: ***@***.***>

[bemo47]

@EricClaeys so i just ran the webserver --update (no install of your specific functions.php given above) and it works, thumbnails are not created from the Pi Zero and i have the console displayed after F12 but not sure if i have the detailed messages expected...

then i install your functions.php.txt, rename it and try again the webserver from PiZero and i get the red message

[EricClaeys]

@bemo47 That's progress - we know it's a permissions problem which we can fix. Please do:

cd /var/www/html/allsky/keograms
ls -l

[bemo47]

@EricClaeys here on the Pi4

[bemo47]

@EricClaeys here on the Pi Zero

[EricClaeys]

@bemo47 I forgot you're having the Pi zero create the thumbnails. It doesn't have permissions - its view of the "thumbnails" directory is only writable by "root", not "www-data" like it needs to be.
Can you mount the Pi 4's filesystem on the Pi zero in such a way that it has the same owner/group and permissions? I think the "user=" and "group=" options in /etc/fstab do that.

[EricClaeys]

@bemo47 If you can't figure out how to do that, then on the Pi zero do a
~~shell
sudo chmod 775 /var/www/html/allsky//thumbnails
sudo chgrp www-data /var/www/html/allsky//thumbnails

and see if that works AND see if the permissions remain after a reboot.  If not, you'll need to write a cron job or something else to redo the permissions after every reboot.

[bemo47]

@EricClaeys i tried, on the Pi Zero the 2 last commands on keograms folder, and also on keograms/thumbnails, but when i do the ls -l nothing changes, and i still have the same error when accessing keograms from the Pi Zero

regarding the 1st option, for the mount on the Pi4, its is done via root crontab, i can check how to use user= and group= in the mount command, but which user and which group should i specify ?

piweb@allskyweb:/var/www/html/allsky/keograms $ sudo chmod 775 /var/www/html/allsky/keograms
piweb@allskyweb:/var/www/html/allsky/keograms $ sudo chgrp www-data /var/www/html/allsky/keograms
piweb@allskyweb:/var/www/html/allsky/keograms $ ls -l
total 40812
-rwxr-xr-x 1 root root     103 May 11 11:37 index.php
-rwxr-xr-x 1 root root 1790964 Apr 13 06:52 keogram-20220412.jpg
-rwxr-xr-x 1 root root 1613477 Apr 14 06:51 keogram-20220413.jpg
-rwxr-xr-x 1 root root 1490016 Apr 15 06:49 keogram-20220414.jpg
-rwxr-xr-x 1 root root 1566105 Apr 16 06:47 keogram-20220415.jpg
-rwxr-xr-x 1 root root 1648192 Apr 17 06:45 keogram-20220416.jpg
-rwxr-xr-x 1 root root 1748285 Apr 18 06:44 keogram-20220417.jpg
-rwxr-xr-x 1 root root 1785561 Apr 19 06:41 keogram-20220418.jpg
-rwxr-xr-x 1 root root 1655119 Apr 20 06:39 keogram-20220419.jpg
-rwxr-xr-x 1 root root 1255151 Apr 24 06:32 keogram-20220423.jpg
-rwxr-xr-x 1 root root 1982258 Apr 25 06:31 keogram-20220424.jpg
-rwxr-xr-x 1 root root 1801442 Apr 26 06:29 keogram-20220425.jpg
-rwxr-xr-x 1 root root 1302672 Apr 27 06:28 keogram-20220426.jpg
-rwxr-xr-x 1 root root 1560148 Apr 28 06:26 keogram-20220427.jpg
-rwxr-xr-x 1 root root 1474995 Apr 29 06:24 keogram-20220428.jpg
-rwxr-xr-x 1 root root 1454465 Apr 30 06:23 keogram-20220429.jpg
-rwxr-xr-x 1 root root 1578703 May  1 06:21 keogram-20220430.jpg
-rwxr-xr-x 1 root root 1517564 May  2 06:19 keogram-20220501.jpg
-rwxr-xr-x 1 root root 1378192 May  3 06:18 keogram-20220502.jpg
-rwxr-xr-x 1 root root 1521416 May  4 06:16 keogram-20220503.jpg
-rwxr-xr-x 1 root root 1664164 May  5 06:14 keogram-20220504.jpg
-rwxr-xr-x 1 root root 1735861 May  6 06:13 keogram-20220505.jpg
-rwxr-xr-x 1 root root 1825059 May  7 06:12 keogram-20220506.jpg
-rwxr-xr-x 1 root root 1834118 May  8 06:10 keogram-20220507.jpg
-rwxr-xr-x 1 root root 1595195 May  9 06:09 keogram-20220508.jpg
-rwxr-xr-x 1 root root 1470072 May 10 06:08 keogram-20220509.jpg
-rwxr-xr-x 1 root root 1486441 May 11 06:06 keogram-20220510.jpg
drwxr-xr-x 2 root root       0 Apr 29 06:41 thumbnails
piweb@allskyweb:/var/www/html/allsky/keograms $ 

[bemo47]

@EricClaeys here is the detail on the mounted folder on the Pi Zero

piweb@allskyweb:/var/www/html/allsky/keograms $ mount -l -t cifs
//192.168.2.223/allsky on /var/www/html/allsky type cifs (rw,nosuid,nodev,noexec,relatime,vers=3.1.1,cache=strict,username=root,uid=0,noforceuid,gid=0,noforcegid,addr=192.168.2.223,file_mode=0755,dir_mode=0755,soft,nounix,serverino,mapposix,rsize=4194304,wsize=4194304,bsize=1048576,echo_interval=60,actimeo=1)
piweb@allskyweb:/var/www/html/allsky/keograms $ 

[bemo47]

@EricClaeys

BINGO !!!!!!!!!!!!!!!!!
I just changed the mount command to this : sudo mount //192.168.2.223/allsky /var/www/html/allsky -o password=pi,uid=www-data

and now it works from the Pi Zero !!!

maybe i should add the gid options also but i don't know which group i should name here, but at least with uid it works !

[EricClaeys]

@bemo47. GREAT!
The files on the Pi 4 are owned to "pi" and grouped to "www-data", I believe. That's what you want.

[bemo47]

@EricClaeys hmm, here i just say uid=www-data which sounds like a userid and it seems enough, but anyway if it works, its enough for me, thks for all ur patience :)