[Anonymous GitHub]代码下载方法,一次性全下载

news/2025/2/15 6:09:35/
  • 工具分享:

https://github.com/kynehc/clone_anonymous_github​github.com/kynehc/clone_anonymous_github

  • 注意:下载链接格式一定要确保结尾有个/

注意:下载链接格式要弄成readme之前的链接:例如下面的链接:

https://anonymous.4open.science/r/GraphCL-7105/README.md/

你应该写为:

 https://anonymous.4open.science/r/GraphCL-7105/

使用:

注意原来的代码有问题,用我这个

python download.py --url https://anonymous.4open.science/r/GraphCL-7105/ --dir data/
import argparse
import timeimport requests
import os
from time import sleep
import concurrent.futuresdef parse_args():parser = argparse.ArgumentParser(description='Clone from the https://anonymous.4open.science')parser.add_argument('--dir', type=str, default='master',help='save dir')parser.add_argument('--url', type=str,help='target anonymous github link eg., https://anonymous.4open.science/r/840c8c57-3c32-451e-bf12-0e20be300389/')parser.add_argument('--max-conns', type=int, default=128,help='max connections number')return parser.parse_args()def dict_parse(dic, pre=None):pre = pre[:] if pre else []if isinstance(dic, dict):for key, value in dic.items():if isinstance(value, dict):for d in dict_parse(value, pre + [key]):yield delse:yield pre + [key, value]else:yield pre + [dic]def req_url(dl_file, max_retry=5):url = dl_file[0]save_path = dl_file[1]save_dir = '/'.join(save_path.split('/')[:-1])if not os.path.exists(save_dir) and save_dir:try:os.makedirs(save_dir)except OSError:passheaders = {"User-Agent": "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/15.2 Safari/605.1.15"}for i in range(max_retry):try:r = requests.get(url, headers=headers)with open(save_path, "wb") as f:f.write(r.content)returnexcept Exception as e:print('file request exception (retry {}): {} - {}'.format(i, e, save_path))sleep(0.4)if __name__ == '__main__':args = parse_args()assert args.url, '\nPlese specifipy your target anonymous github link, \n e.g:    ' \+ 'python download.py --target https://anonymous.4open.science/r/840c8c57-3c32-451e-bf12-0e20be300389/'url = args.urlname = url.split('/')[-2]max_conns = args.max_connsprint("[*] cloning project:" + name)list_url = "https://anonymous.4open.science/api/repo/" + name + "/files/"headers = {"User-Agent": "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/15.2 Safari/605.1.15"}resp = requests.get(url=list_url, headers=headers)file_list = resp.json()print("[*] downloading files:")dl_url = "https://anonymous.4open.science/api/repo/" + name + "/file/"files = []out = []for file in dict_parse(file_list):file_path = os.path.join(*file[-len(file):-2])  # * operator to unpack the arguments out of a listsave_path = os.path.join(args.dir, file_path)file_url = dl_url + file_pathfiles.append((file_url, save_path))with concurrent.futures.ThreadPoolExecutor(max_workers=max_conns) as executor:future_to_url = (executor.submit(req_url, dl_file) for dl_file in files)for future in concurrent.futures.as_completed(future_to_url):time.sleep(2)try:data = future.result()except Exception as exc:data = str(type(exc))finally:out.append(data)print("The current file is :", str(len(out)), end="\r")print("[*] files saved to:" + args.dir)


http://www.ppmy.cn/news/359201.html

相关文章

JDK的下载与安装

一、下载 1、首先,打开浏览器,输入以上Oracle的官网网址 2、然后点开产品,打开产品的列表,点击Java 3、点击Download Java,进入Java的下载页 4、滚动到下面,找到Java8版本。虽然最新版本是Java14&#xff0…

下载文件文件类型

文件后缀 MIME TYPE .doc ——application/msword .dot ——application/msword .docx ——application/vnd.openxmlformats-officedocument.wordprocessingml.document .dotx ——application/vnd.openxmlformats-officedocument.wordprocessingml.template .docm ——applica…

如何下载???

只是刚加入csdn....在这里找到了很好的资料想下载..但是没法获取下载列表啊???该如何办呢>??谢谢了

Elasticsearch下载/安装

Elasticsearch 官网版本支持矩阵Elasticsearch 下载地址Kibana 下载地址Logstash 下载地址 以下示例为 window 系统 前置条件 需要先安装 jdk 安装 Elasticsearch 下载安装包之后解压文件,进入 bin 文件夹 执行 elasticsearch.bat 文件,启动 elasticse…

一、如何下载JDK?

1.https://www.oracle.com/java/technologies/javase/javase-jdk8-downloads.html 打开链接,进入该页面: 2. 然后点开产品,打开产品的列表,点击Java 3.点击Download Java,进入Java的下载页 4.滚动到下面&#xff0c…

【文件下载】

前言 在前端开发中,有时需要让用户下载文件,比如下载PDF文档、Excel表格等。这时候,我们可以使用JavaScript来实现文件下载功能。本文将介绍几种常用的前端JS下载文件的方法,包括XMLHttpRequest、Fetch API、Blob、FileSaver.js等…

下载

// 设置为下载application/x-download resp.setContentType("application/x-download"); // 下载后的文件名称 String downloadFileName "abc.txt"; // 编码转换 downloadFileName URLEncoder.encode(downloadFileName, "UTF-8"…

下载~!!!

找到个下载资料的好地方,大家来顶一下(fpt也能免费,还随时更新.数千G!!) 找到个下载资料的好地方,大家来顶一下(fpt也能免费,还随时更新.数千G!!) 精品资料免费fpt下载使用方法 http://www.ibeifeng.com/…