Unable to update Allsky map data New Software

[BobW55]

Tried to update information on the Allsky Map
Data currently shown is from before I upgraded.
Get this error:

jq: error: Could not open file /home/pi/allsky/html/allsky/configuration.json: No such file or directory
WARNING: Unable to update Allsky Settings in /home/pi/allsky/html/allsky/configuration.json; ignoring.

I promiss to stop breaking it

[EricClaeys]

@BobW55 This is a known error I will fix. Did the information you changed get updated on the map?

I assume you don't have the Allsky Website on your Pi ?

[BobW55]

No allsky Map did not update. NOT running the web on my PI. I FTP to a remote server

…

On Fri, Dec 30, 2022, 11:28 PM EricClaeys ***@***.***> wrote: @BobW55 <https://github.com/BobW55> This is a known error I will fix. Did the information you changed get updated on the map? I assume you don't have the Allsky Website on your Pi ? — Reply to this email directly, view it on GitHub <#2081 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/A4JBJ2Z7JJC2DVYNIH5PHLTWP6ZAPANCNFSM6AAAAAATNJS734> . You are receiving this because you were mentioned.Message ID: ***@***.***>

[EricClaeys]

@BobW55 When you got this error, what field(s) did you change?
I get the error when changing the Display Settings field, but if I also change one of the other map-related fields I also get a message Map data UPDATED, and I see the update on the map.

[BobW55]

Just the ones for the map.
Map still shows my data from previous allsky version.
Northern /Eastern most pin in Michigan on the map.

[EricClaeys]

@BobW55 Can you download the latest scripts/makeChanges.sh from the "dev" branch and try again? It should fix the error message.

For the issue with the map not being updated, please run:

cd ~/allsky
scripts/postToMap.sh --force --debug

and then post the output.

Thanks - Eric

[BobW55]

This is the output I received. The map did not update.

pi@allsky1:~ $ cd ~/allsky
scripts/postToMap.sh --force --debug
*** postToMap.sh:     

[EricClaeys]

@BobW55. I'm pretty sure I know what the problem is. Would you please add the following to line 92 of scripts/postToMap.sh, then rerun the command?

set -x

It will produce a lot more output but will show exactly what's happening.
This release performs some checks on the data sent to the map, and I think some criteria is failing, but due to a bug in the script, the message isn't being displayed.

[BobW55]

I may be missing a directory.

pi@allsky1:~/allsky/html $ ls
config  css  documentation  favicon.ico  includes  index.php  js  lib  overlay  public.php  raspap.php
pi@allsky1:~/allsky/html $

[EricClaeys]

@BobW55 Those are the correct directories for allsky/html when you don't have the Allsky Website installed. The fix is described in my post from a minute ago.

[BobW55]

Per your request

p:i@allsky1:~/allsky $ cd ~/allsky
scripts/postToMap.sh --force --debug
+ DEBUG=false
+ DELETE=false
+ UPLOAD=false
+ WHISPER=false
+ ENDOFNIGHT=false
+ MACHINE_ID=
+ '[' 2 -ne 0 ']'
+ '[' --force = --help ']'
+ '[' --force = --delete ']'
+ '[' --force = --debug ']'
+ '[' --force = --force ']'
+ UPLOAD=true
+ shift
+ '[' 1 -ne 0 ']'
+ '[' --debug = --help ']'
+ '[' --debug = --delete ']'
+ '[' --debug = --debug ']'
+ DEBUG=true
+ shift
+ '[' 0 -ne 0 ']'
+ [[ 1 -eq 0 ]]
+ BR='\n'
+ wOK='\033[0;32m'
+ wWARNING='\033[0;33m'
+ wERROR='\033[0;31m'
+ wDEBUG='\033[0;33m'
+ wNC='\033[0m'
+ [[ false = \t\r\u\e ]]
+ '[' false = true ']'
+ MSG_START='postToMap.sh: '
+ ERROR_MSG_START='\033[0;31m*** postToMap.sh: '
+ WARNING_MSG_START='\033[0;33m*** postToMap.sh: '
+ [[ -z '' ]]
+ MACHINE_ID=efdf36442fe14fb3a2b0a0025b7984a5
+ '[' -z efdf36442fe14fb3a2b0a0025b7984a5 ']'
+ OK=true
+ E=
++ settings .latitude
+++ jq -r .latitude /home/pi/allsky/config/settings.json
++ j=43.183602N
++ echo 43.183602N
++ return
+ LATITUDE=43.183602N
+ '[' 43.183602N = '' ']'
++ settings .longitude
+++ jq -r .longitude /home/pi/allsky/config/settings.json
++ j=82.861145W
++ echo 82.861145W
++ return
+ LONGITUDE=82.861145W
+ '[' 82.861145W = '' ']'
+ [[ true == \f\a\l\s\e ]]
++ convertLatLong 43.183602N latitude
++ local LATLONG=43.183602N
++ local TYPE=latitude
++ LATLONG=43.183602N
++ local SIGN=4
++ local DIRECTION=N
++ [[ 4 != \+ ]]
++ [[ 4 != \- ]]
++ SIGN=
++ [[ '' != '' ]]
++ [[ -z N ]]
++ [[ -n '' ]]
++ echo 43.183602N
++ return 0
+ LATITUDE=43.183602N
+ LATRET=0
++ convertLatLong 82.861145W longitude
++ local LATLONG=82.861145W
++ local TYPE=longitude
++ LATLONG=82.861145W
++ local SIGN=8
++ local DIRECTION=W
++ [[ 8 != \+ ]]
++ [[ 8 != \- ]]
++ SIGN=
++ [[ '' != '' ]]
++ [[ -z W ]]
++ [[ -n '' ]]
++ echo 82.861145W
++ return 0
+ LONGITUDE=82.861145W
+ LONGRET=0
+ OK=true
+ [[ 0 -ne 0 ]]
+ [[ 0 -ne 0 ]]
+ [[ true == \f\a\l\s\e ]]
+ false
+ '[' false = true ']'
++ settings .location
+++ jq -r .location /home/pi/allsky/config/settings.json
++ j='Melvin, Michigan'
++ echo 'Melvin, Michigan'
++ return
+ LOCATION='Melvin, Michigan'
++ settings .owner
+++ jq -r .owner /home/pi/allsky/config/settings.json
++ j='Bob Waterfield'
++ echo 'Bob Waterfield'
++ return
+ OWNER='Bob Waterfield'
++ settings .websiteurl
+++ jq -r .websiteurl /home/pi/allsky/config/settings.json
++ j=http://www.melvinweather.com/template/indexDesktop.php
++ echo http://www.melvinweather.com/template/indexDesktop.php
++ return
+ WEBSITE_URL=http://www.melvinweather.com/template/indexDesktop.php
++ settings .imageurl
+++ jq -r .imageurl /home/pi/allsky/config/settings.json
++ j=http://melvinweather.com/allsky/allsky.jpg
++ echo http://melvinweather.com/allsky/allsky.jpg
++ return
+ IMAGE_URL=http://melvinweather.com/allsky/allsky.jpg
++ settings .camera
+++ jq -r .camera /home/pi/allsky/config/settings.json
++ j='ZWO 120MC-S'
++ echo 'ZWO 120MC-S'
++ return
+ CAMERA='ZWO 120MC-S'
++ settings .lens
+++ jq -r .lens /home/pi/allsky/config/settings.json
++ j='1.2mm (12mm mount)'
++ echo '1.2mm (12mm mount)'
++ return
+ LENS='1.2mm (12mm mount)'
++ settings .computer
+++ jq -r .computer /home/pi/allsky/config/settings.json
++ j='Pi 4B 8Gb  POE powered'
++ echo 'Pi 4B 8Gb  POE powered'
++ return
+ COMPUTER='Pi 4B 8Gb  POE powered'
+ OK=true
+ E=
+ W=
+ '[' 'ZWO 120MC-S' = '' ']'
+ '[' 'Pi 4B 8Gb  POE powered' = '' ']'
+ '[' 'Melvin, Michigan' = '' ']'
+ '[' 'Bob Waterfield' = '' ']'
+ '[' '1.2mm (12mm mount)' = '' ']'
+ [[ -n http://www.melvinweather.com/template/indexDesktop.php ]]
+ [[ -z http://melvinweather.com/allsky/allsky.jpg ]]
+ [[ -z http://www.melvinweather.com/template/indexDesktop.php ]]
+ '[' -n http://www.melvinweather.com/template/indexDesktop.php ']'
++ get_domain http://www.melvinweather.com/template/indexDesktop.php
++ URL=http://www.melvinweather.com/template/indexDesktop.php
++ D=www.melvinweather.com/template/indexDesktop.php
++ D=www.melvinweather.com
++ echo www.melvinweather.com
+ Wurl=www.melvinweather.com
++ get_domain http://melvinweather.com/allsky/allsky.jpg
++ URL=http://melvinweather.com/allsky/allsky.jpg
++ D=melvinweather.com/allsky/allsky.jpg
++ D=melvinweather.com
++ echo melvinweather.com
+ Iurl=melvinweather.com
+ '[' www.melvinweather.com '!=' melvinweather.com ']'
+ E='ERROR: The Website and Image URLs must have the same domain name or IP address.\n'
+ OK=false
+ '[' -n http://www.melvinweather.com/template/indexDesktop.php ']'
+ check_URL http://www.melvinweather.com/template/indexDesktop.php websiteurl 'Website URL'
+ URL=http://www.melvinweather.com/template/indexDesktop.php
+ URL_TYPE=websiteurl
+ FIELD_NAME='Website URL'
++ get_domain http://www.melvinweather.com/template/indexDesktop.php
++ URL=http://www.melvinweather.com/template/indexDesktop.php
++ D=www.melvinweather.com/template/indexDesktop.php
++ D=www.melvinweather.com
++ echo www.melvinweather.com
+ D=www.melvinweather.com
+ [[ www.mel = \1\9\2\.\1\6\8 ]]
+ [[ www. = \1\0\.\0 ]]
+ [[ www.me = \1\7\2\.\1\6 ]]
+ [[ www.melvi = \1\6\9\.\2\5\4\.\0 ]]
+ [[ www.me = \1\9\8\.\1\8 ]]
+ [[ www.melvin = \1\9\8\.\5\1\.\1\0\0 ]]
+ [[ www.melvi = \2\0\3\.\0\.\1\1\3 ]]
+ [[ www = \2\4\0 ]]
+ '[' http: '!=' http: ']'
++ curl --head --silent --show-error --connect-timeout 30 http://www.melvinweather.com/template/indexDesktop.php
+ CONTENT='HTTP/1.1 200 OK
Date: Wed, 04 Jan 2023 18:03:21 GMT
Server: Apache
X-Powered-By: PHP/7.4.22
Expires: Thu, 19 Nov 1981 08:52:00 GMT
Cache-Control: no-store, no-cache, must-revalidate
Pragma: no-cache
Set-Cookie: PHPSESSID=6c9b0d80ce8d787b67a4c0424348351f; path=/
Upgrade: h2,h2c
Connection: Upgrade
Access-Control-Allow-Origin: *
Content-Type: text/html; charset=UTF-8
'
+ RET=0
+ '[' 0 -eq 6 ']'
+ '[' 0 -eq 28 ']'
+ '[' 0 -ne 0 ']'
+ '[' websiteurl = websiteurl ']'
++ echo 'HTTP/1.1 200 OK
Date: Wed, 04 Jan 2023 18:03:21 GMT
Server: Apache
X-Powered-By: PHP/7.4.22
Expires: Thu, 19 Nov 1981 08:52:00 GMT
Cache-Control: no-store, no-cache, must-revalidate
Pragma: no-cache
Set-Cookie: PHPSESSID=6c9b0d80ce8d787b67a4c0424348351f; path=/
Upgrade: h2,h2c
Connection: Upgrade
Access-Control-Allow-Origin: *
Content-Type: text/html; charset=UTF-8
'
++ grep -i 'Content-Type: text'
' TYPE='Content-Type: text/html; charset=UTF-8
+ T='web site'
' ']' -z 'Content-Type: text/html; charset=UTF-8
+ return 0
+ '[' -n http://melvinweather.com/allsky/allsky.jpg ']'
+ check_URL http://melvinweather.com/allsky/allsky.jpg imageurl 'Image URL'
+ URL=http://melvinweather.com/allsky/allsky.jpg
+ URL_TYPE=imageurl
+ FIELD_NAME='Image URL'
++ get_domain http://melvinweather.com/allsky/allsky.jpg
++ URL=http://melvinweather.com/allsky/allsky.jpg
++ D=melvinweather.com/allsky/allsky.jpg
++ D=melvinweather.com
++ echo melvinweather.com
+ D=melvinweather.com
+ [[ melvinw = \1\9\2\.\1\6\8 ]]
+ [[ melv = \1\0\.\0 ]]
+ [[ melvin = \1\7\2\.\1\6 ]]
+ [[ melvinwea = \1\6\9\.\2\5\4\.\0 ]]
+ [[ melvin = \1\9\8\.\1\8 ]]
+ [[ melvinweat = \1\9\8\.\5\1\.\1\0\0 ]]
+ [[ melvinwea = \2\0\3\.\0\.\1\1\3 ]]
+ [[ mel = \2\4\0 ]]
+ '[' http: '!=' http: ']'
++ curl --head --silent --show-error --connect-timeout 30 http://melvinweather.com/allsky/allsky.jpg
+ CONTENT='HTTP/1.1 200 OK
Date: Wed, 04 Jan 2023 18:03:22 GMT
Server: Apache
Upgrade: h2,h2c
Connection: Upgrade
Last-Modified: Wed, 04 Jan 2023 18:00:38 GMT
Accept-Ranges: bytes
Content-Length: 606202
Access-Control-Allow-Origin: *
Content-Type: image/jpeg
'
+ RET=0
+ '[' 0 -eq 6 ']'
+ '[' 0 -eq 28 ']'
+ '[' 0 -ne 0 ']'
+ '[' imageurl = websiteurl ']'
++ echo 'HTTP/1.1 200 OK
Date: Wed, 04 Jan 2023 18:03:22 GMT
Server: Apache
Upgrade: h2,h2c
Connection: Upgrade
Last-Modified: Wed, 04 Jan 2023 18:00:38 GMT
Accept-Ranges: bytes
Content-Length: 606202
Access-Control-Allow-Origin: *
Content-Type: image/jpeg
'
++ grep -i 'Content-Type: image'
' TYPE='Content-Type: image/jpeg
+ T=image
' ']' -z 'Content-Type: image/jpeg
+ return 0
+ '[' '' '!=' '' ']'
+ '[' false = false ']'
+ echo -e '\033[0;31m*** postToMap.sh: \033[0m'
*** postToMap.sh:
+ '[' false = true ']'
+ exit 2
pi@allsky1:~/allsky $

[EricClaeys]

@BobW55 Thanks for the output.
The code checks several things with the map data, including that the image is on the same domain as the Allsky Website.

It didn't like that your Image URL started with http://melvinweather.com but your website URL started with http://www.melvinweather.com (with "www."). I fixed the bug that wasn't displaying the error message and changed the code to ignore the "www.".

If you download the latest scripts/postToMap.sh it should work. Let me know.

[BobW55]

this command?

git clone --recursive https://github.com/thomasjacquin/scripts/postToMap.sh 

[EricClaeys]

@BobW55. I'm not sure what the git command is to get a single file. I always just go to the file on the GitHub page (make sure you are in the dev branch), then click on the icon that looks like two overlapping boxes to copy the file to the clipboard. I then get in the file on the Pi using my favorite editor and paste.

@Alex-developer, what's the git command to get a single file from the dev branch?

[Alex-developer]

Assuming its already checked out on a branch, i.e. dev, then navigate to the folder containing the file and do

git checkout filename

You can checkout files across branches but I would not recommend it

[BobW55]

I didn't run it yet.
took the WWW from my URL now updating properly

[EricClaeys]

@BobW55 FYI, because your site uses http, most people, myself included, can't see the image since most browsers won't show http images from an https site.

[BobW55]

Fixed.... now uses https

[BobW55]

Interesting how a simple https://www. yoursite.com is read different from https://yoursite.com
Should add a caution to be careful in future release instructions.

[EricClaeys]

@BobW55 The code now ignores the "www." so https://www.yoursite.com is functionally the same as https://yoursite.com.

I can see your image now - thanks for changing to https.