github 上下载单个目录 python 实现

网上说 Git1.7.0 以后加入了 Sparse Checkout 模式，即可以指定下载哪些文件，但试了下   git remote add -f origin <url>  还是会下载很多缓存东西放在 .git 目录中，根本不是我想要的，于是手写一个吧。

 

先安装扩展

python  -m pip install --upgrade pip

pip install requests bs4 

 

#!/usr/bin/env python3
# -*- coding: utf8 -*-

import requests
import sys
import os
from bs4 import BeautifulSoup

url = sys.argv[1]
path = sys.argv[2]

if url.isspace():
    print('url 地址为空!')
    exit()

if not path.isspace():
    if not os.path.exists(path):
        print('新建目录:' + path)
        os.mkdir(path)
else:
    path = '.'
    
html = requests.request('get', url)
html.encoding = 'utf8'
html = html.text

soup = BeautifulSoup(html, 'html.parser')
files = soup.select('div[aria-labelledby="files"] div[role="rowheader"] a')
files.pop(0)

#生成 url 地址，类似于: https://raw.githubusercontent.com/docker-library/php/master/8.0/buster/fpm
url = url.replace("github.com", "raw.githubusercontent.com")
url = url.replace("/tree/", "/")

for name in files:
    name = name.string

    print("文件" + name + " :" + url + "/" + name)
    content = requests.request('get', url + "/" + name)
    content.encoding = 'utf8'
    content = content.text

    with open(path + '/' + name, 'w', encoding='utf-8') as fp:
        fp.write(content)