美文网首页
wget multiple files in parallel

wget multiple files in parallel

作者: 为了梦走一遭 | 来源:发表于2021-11-10 07:06 被阅读0次

    download complete dataset and in parallel processes

    wget -c --input SJHGG.txt

    You can use xargs

    -P is the number of processes, for example, if set -P 4, four links will be downloaded at the same time, if set to -P 0, xargs will launch as many processes as possible and all of the links will be downloaded.

    copy from https://stackoverflow.com/questions/3430810/multiple-simultaneous-downloads-using-wget

    cat SJHGG.txt | xargs -P 0 -I{} wget -c {}

    相关文章

      网友评论

          本文标题:wget multiple files in parallel

          本文链接:https://www.haomeiwen.com/subject/exrbzltx.html