failed to download error messages compatibility issue with wget2

[elidana]

Dear PRIDE-PPAR team,

I am having issues in using the most recent version of the PRID-PPP software on my Fedora40 (/RedHat) operating system.

I did a fresh installation by cloning this repository and can successfully run the installation step.

but then when I run the test examples (or try to run pride-ppr with some of the configurations I successfully used with previous version) it fails when trying to download any type of supplementary files.

If I download each manually and try to re-run the individual step will run successfullly but any download step will fail at the next file type download attempt.

I believe the issue is related to my operating system and new updates to wget (and wget2) but I am opening this in case of interest for the team or other users.

I can solve this with a patch on my OS (see last comment section in this ticket), but I wonder if you would you be able to recommend other options on how this can be solved?

Additional details are reported below, and I'll be happy to provide more details if useful.

Thank you so much for your amazing work!

Elisabetta

Additional details

successful installation

                  .:::::::::::..                  
               ::::...        .:::.  .:.          
            .:::..........:--     :-:::.          
           :-....          :..:. .. .-:           
          -:.:.           .   .::     --          
         -:::             :..   .:     :-         
        :-.:           .:-       .:     -:        `o+///+/`  .o/:://+.    +:  .o//+o++:    `o+/////`
        -.:        .:----:        -     :-        -s     :s  :o     -y        /+      :s.  -s
    :-:.-.-.  ...::------         :.    .-        -s     /s  :o    .o+    o:  /o      .-s  -s     
     . .-.:: ...      --:         -     .-        -y////+/`  :s//+y/`     o:  //       `y  :s::::::
       .-::-:          -         :.     -:        -s         :o   .s:     o:  //       -s  :o
       .--..:.         :.       :.     .-         -s         :o    `o/    o:  /+      -s.  -s
       .-:-  ::.      ...     .:      .-.         -o         :+      :o+  o:  `oo////+:`   `/+/////:
       .- .-:  .:..   :  ::.:.       :-           
       .-   ::.    ..::..:-.       .:.            Positioning                   .-            o
       .-     .-:.   .          .::.              ``.......`.`.-                -/            o
       .-      :-.::::.....:::::.                 Racers to Image               -:      :-:/  s:--/.
       .-      ::  :-:  ..                        ``..``` ` `` `````..          ::      :--s  o   `o
       .-      ::  ..                             & Decipher the Earth          .+::::`/:-:o-`s:--/-
       .-      ::                                 
       .-::::::-:                                 
       .-::::::-:                                 

:: PRIDE-PPPAR (v3.0) installation successfully completed!
:: executable binaries are copy to /home/elidana/.PRIDE_PPPAR_BIN
:: /home/elidana/.PRIDE_PPPAR_BIN added to PATH

error message when running ./test.sh

side note: I can successfully download all the files that errored using curl

$:~/git/PRIDE-PPPAR/example$ ./test.sh 
(1) static daily fixed
===> CheckExecutables ...
===> CheckExecutables done
:: Processing time range: 2020-01-01 00:00:00.000 <==> 2020-01-01 23:59:30.000
:: Processing interval: 30
:: Site name: abmf
:: Positioning mode: S
:: AR switch: A
:: Frequency combination: G12 R12 E15 C26 J12
:: Configuration file: /home/elidana/.PRIDE_PPPAR_BIN/config_template
:: RINEX observation file: /home/elidana/git/PRIDE-PPPAR/example/data/2020/001/abmf0010.20o
===> ProcessSingleSession from 2020 001 to 2020 001 ...
===> PrepareTables ...
===> PrepareTables done
===> PrepareRinexNav ...
warning: failed to download RINEX navigation file: BRDC00IGN_R_20200010000_01D_MN.rnx
warning: failed to download GPS navigation file: brdc0010.20n
warning: failed to download GLONASS navigation file: brdc0010.20g
error: failed to download RINEX navigation file: /home/elidana/git/PRIDE-PPPAR/example/data/2020/001/brdm0010.20p
:: please download from ftp://igs.gnsswhu.cn/pub/gps/data/daily/2020/001/20g/brdc0010.20g.Z to /home/elidana/git/PRIDE-PPPAR/example/data/2020/001 for processing
error: PrepareRinexNav failed
error: from 2020 001 to 2020 001 processing failed
:: mv existing ./results/static-24h-fixed to ./results/static-24h-fixed.9WcW25V2Mr

(2) kinematic daily fixed
===> CheckExecutables ...
===> CheckExecutables done
:: Processing time range: 2021-08-08 00:00:00.000 <==> 2021-08-08 23:59:30.000
:: Processing interval: 30
:: Site name: bako
:: Positioning mode: K
:: AR switch: A
:: Frequency combination: G12 R12 E15 C26 J12
:: Configuration file: /home/elidana/.PRIDE_PPPAR_BIN/config_template
:: RINEX observation file: /home/elidana/git/PRIDE-PPPAR/example/data/2021/220/BAKO00IDN_R_20212200000_01D_30S_MO.rnx
===> ProcessSingleSession from 2021 220 to 2021 220 ...
===> PrepareTables ...
===> PrepareTables done
warning: no observation for GNSS (C): C6 L6
===> PrepareRinexNav ...
warning: failed to download RINEX navigation file: BRDC00IGN_R_20212200000_01D_MN.rnx
warning: failed to download GPS navigation file: brdc2200.21n
warning: failed to download GLONASS navigation file: brdc2200.21g
error: failed to download RINEX navigation file: /home/elidana/git/PRIDE-PPPAR/example/data/2021/220/brdm2200.21p
:: please download from ftp://igs.gnsswhu.cn/pub/gps/data/daily/2021/220/21g/brdc2200.21g.Z to /home/elidana/git/PRIDE-PPPAR/example/data/2021/220 for processing
error: PrepareRinexNav failed
error: from 2021 220 to 2021 220 processing failed
:: mv existing ./results/kinematic-24h-fixed to ./results/kinematic-24h-fixed.gEmhSKdivR

(3) kinematic fixed (LAMBDA) 1h
===> CheckExecutables ...
===> CheckExecutables done
:: Processing time range: 2021-07-29 00:00:00.000 <==> 2021-07-29 00:59:30.000
:: Processing interval: 30
:: Site name: ccj2
:: Positioning mode: K
:: AR switch: A
:: Frequency combination: G12 R12 E15 C26 J12
:: Configuration file: /home/elidana/.PRIDE_PPPAR_BIN/config_template
:: RINEX observation file: /home/elidana/git/PRIDE-PPPAR/example/data/2021/210/ccj22100.21o
===> ProcessSingleSession from 2021 210 to 2021 210 ...
===> PrepareTables ...
===> PrepareTables done
warning: no observation for GNSS (C)
===> PrepareRinexNav ...
warning: failed to download RINEX navigation file: BRDC00IGN_R_20212100000_01D_MN.rnx
warning: failed to download GPS navigation file: brdc2100.21n
warning: failed to download GLONASS navigation file: brdc2100.21g
error: failed to download RINEX navigation file: /home/elidana/git/PRIDE-PPPAR/example/data/2021/210/brdm2100.21p
:: please download from ftp://igs.gnsswhu.cn/pub/gps/data/daily/2021/210/21g/brdc2100.21g.Z to /home/elidana/git/PRIDE-PPPAR/example/data/2021/210 for processing
error: PrepareRinexNav failed
error: from 2021 210 to 2021 210 processing failed
:: mv existing ./results/kinematic-1h-fixed-LAMBDA to ./results/kinematic-1h-fixed-LAMBDA.pSl4NZiZZN

(4) high-rate fixed (LAMBDA) 1h
===> CheckExecutables ...
===> CheckExecutables done
:: Processing time range: 2021-07-29 06:00:00.000 <==> 2021-07-29 07:00:00.000
:: Processing interval: 1
:: Site name: ac12
:: Positioning mode: K
:: AR switch: A
:: Frequency combination: G12 R12 E15 C26 J12
:: Configuration file: /home/elidana/.PRIDE_PPPAR_BIN/config_template
:: RINEX observation file: /home/elidana/git/PRIDE-PPPAR/example/data/2021/210/ac122100.21o
===> ProcessSingleSession from 2021 210 to 2021 210 ...
===> PrepareTables ...
===> PrepareTables done
warning: no observation for GNSS (R)
warning: no observation for GNSS (E)
warning: no observation for GNSS (C)
warning: no observation for GNSS (J)
===> PrepareRinexNav ...
warning: failed to download RINEX navigation file: BRDC00IGN_R_20212100000_01D_MN.rnx
warning: failed to download GPS navigation file: brdc2100.21n
warning: failed to download GLONASS navigation file: brdc2100.21g
error: failed to download RINEX navigation file: /home/elidana/git/PRIDE-PPPAR/example/data/2021/210/brdm2100.21p
:: please download from ftp://igs.gnsswhu.cn/pub/gps/data/daily/2021/210/21g/brdc2100.21g.Z to /home/elidana/git/PRIDE-PPPAR/example/data/2021/210 for processing
error: PrepareRinexNav failed
error: from 2021 210 to 2021 210 processing failed
:: mv existing ./results/highrate-1h-fixed-LAMBDA to ./results/highrate-1h-fixed-LAMBDA.cZHe3HPVog

(5) troposphere daily
===> CheckExecutables ...
===> CheckExecutables done
:: Processing time range: 2020-01-03 00:00:00.000 <==> 2020-01-03 23:59:30.000
:: Processing interval: 30
:: Site name: abpo
:: Positioning mode: F
:: AR switch: A
:: Frequency combination: G12 R12 E15 C26 J12
:: Configuration file: /home/elidana/.PRIDE_PPPAR_BIN/config_template
:: RINEX observation file: /home/elidana/git/PRIDE-PPPAR/example/data/2020/003/abpo0030.20o
===> ProcessSingleSession from 2020 003 to 2020 003 ...
===> PrepareTables ...
===> PrepareTables done
===> PrepareRinexNav ...
warning: failed to download RINEX navigation file: BRDC00IGN_R_20200030000_01D_MN.rnx
warning: failed to download GPS navigation file: brdc0030.20n
warning: failed to download GLONASS navigation file: brdc0030.20g
error: failed to download RINEX navigation file: /home/elidana/git/PRIDE-PPPAR/example/data/2020/003/brdm0030.20p
:: please download from ftp://igs.gnsswhu.cn/pub/gps/data/daily/2020/003/20g/brdc0030.20g.Z to /home/elidana/git/PRIDE-PPPAR/example/data/2020/003 for processing
error: PrepareRinexNav failed
error: from 2020 003 to 2020 003 processing failed
:: mv existing ./results/tropo-24h-fixed to ./results/tropo-24h-fixed.vNiOCqfjHG
:: computation results are put in ./results/
:: reference results are in ./results_ref/

system details

I am running the software on a Fedora40 OS
Linux hostname 6.10.9-200.fc40.x86_64 #1 SMP PREEMPT_DYNAMIC Sun Sep 8 17:23:55 UTC 2024 x86_64 GNU/Linux

wget is installed and

$:~/git/PRIDE-PPPAR/example$ which wget
/usr/bin/wget

S:~$ wget --version
GNU Wget2 2.1.0 - multithreaded metalink/file/website downloader

issue with using pdp3.sh wget command

If i replicate the wget command stated in pdp3.sh (and change "-q" to verbose), I get this error message

$:~/git/PRIDE-PPPAR/example$ wget -v -nv -nc -c -t 3 --connect-timeout=10 --read-timeout=60 ftp://igs.gnsswhu.cn/pub/gps/data/daily/2020/003/20g/brdc0030.20g.Z
Failed to parse URI 'ftp://igs.gnsswhu.cn/pub/gps/data/daily/2020/003/20g/brdc0030.20g.Z'
Nothing to do - goodbye

I get the same error message when adding quotes to the brdc file URI

compatibility issue with Fedora40?

I found this post: https://forums.fedoraforum.org/showthread.php?332571-F40-wget2-breaks-wget-compatibility that looks similar to the problem I'm facing, so I can try to follow those instructions, but I wonder if there is any alternative option you might suggest that I can use?

Thanks in advance!

Elisabetta

[listwanites]

| warning: failed to download RINEX navigation file: BRDC00IGN_R_20200010000_01D_MN.rnx
| warning: failed to download GPS navigation file: brdc0010.20n
| warning: failed to download GLONASS navigation file: brdc0010.20g
| error: failed to download RINEX navigation file: /home/elidana/git/PRIDE-PPPAR/example/data/2020/001/brdm0010.20p
|:: please download from ftp://igs.gnsswhu.cn/pub/gps/data/daily/2020/001/20g/brdc0010.20g.Z to /home/elidana/git/PRIDE-PPPAR/example/data/2020/001 for processing
| error: PrepareRinexNav failed
| error: from 2020 001 to 2020 001 processing failed
| :: mv existing ./results/static-24h-fixed to ./results/static-24h-fixed.9WcW25V2Mr

^This type of error happened to me (and to my colleague) several times before when their server is down. So I'd usually wait a few days before running PRIDE again.

[elidana]

Thanks @listwanites for replying to this!
I missed to add that I can successfully download the required files using an alternative method (such as curl), so I thought the issue I have is not related to the server being down?

[listwanites]

@elidana I'm sorry, my hunch is wrong. I just tried running PRIDE a while ago and it was successful. But yeah, I usually encounter that kind of problem when the server is down. So probably the problem is with the command that your OS is using to download those files.

I've checked the PRIDE PPP-AR user manual and unfortunately, it doesn't list the exact script that it uses for PrepareRinexNav(). But your hunch may be correct (about wget2 breaking compatibility).

For reference, I'm using Ubuntu 22.04 and I don't think I have ever downloaded other versions of wget.

[elidana]

Thanks a lot @listwanites and no worries at all!

FYI, the script is pdp3.sh, and the wget command that is using for downloads is
wget -v -nv -nc -c -t 3 --connect-timeout=10 --read-timeout=60 (also posted above)

[elidana]

Following suggestion found in the Fedora40 forum posted above, I solved this by

• remove wget2 from my Fedora40 OS sudo dnf remove wget
• download Fedora39 wget 1.x version (curl -O https://mirror.math.princeton.edu/pub/fedora/linux/updates/39/Everything/x86_64/Packages/w/wget-1.21.4-1.fc39.x86_64.rpm
• install wget1 sudo dnf install ./wget-1.21.4-1.fc39.x86_64.rpm
• ensure system updates are not updating wget sudo dnf update --refresh --exclude=wget

with the steps above, the PRIDE-PPPAR's test.sh now passes and completes successfully.

the @PrideLab team might want to have a look at this in the future as future versions of wget might not be compatible with FTP download (a potentially option could be to include curl as a tool to download in the various packages of PRIDE-PPAR)

[PrideLab]

Hi Both, the latest version has been modified to use curl when there is problem with wget. Thank you for your question.

[elidana]

that is excellent, thanks a lot @PrideLab , really appreciate! looking forward to download the latest version :)