pl-download
is a ChRIS plugin which downloads files from URLs.
pl-download
has two modes: "single" mode (as a fs-type plugin),
or "bulk" mode (as a ds-type plugin).
In "single" mode, pl-download
downloads a file from one URL
and writes it to the output directory.
apptainer exec docker://ghcr.io/fnndsc/pl-download:latest downloader --url https://upload.wikimedia.org/wikipedia/commons/d/d1/Rubin_Observatory_and_Its_Target.jpg outputdir/
In "bulk" mode, pl-download
scans an input directory of files
where each file contains a list of URLs separated by whitespace.
cat > inputdir/urls.txt << EOF
https://upload.wikimedia.org/wikipedia/commons/a/ad/Devon_Rex_Cassini.jpeg
https://upload.wikimedia.org/wikipedia/commons/3/35/Saucer-eyed_Devon_Rex.jpg
https://upload.wikimedia.org/wikipedia/commons/1/10/Devon_Rex_Tortoiseshell.jpg
EOF
apptainer exec docker://ghcr.io/fnndsc/pl-download:latest downloader inputdir/ outputdir/