Skip to content

Latest commit

 

History

10 Commits

Folders and files

NameName
Last commit message
Last commit date
 
 
 
 

Repository files navigation

SimpleCrawler

简单的python爬虫(单线程下载,暂不支持多线程)

book_crawler.py

使用BeautifulSoup的SS选择器进行内容选择和抓取

BeautifulSoup中文文档

小说爬虫,需要配置config.json文件
{
"config": [
    {
        "base_url": "https://www.bqg5200.com", //base地址,搜索目录后,需要添加到目录签名
        "search_url": "", //搜索地址
        "list": "#readerlist li a", //目录搜索规则
        "title": ".title h1", //标题过滤规则
        "content": "#content", //内容过滤规则
        "encoding": "gbk" //网页格式
    }
  ]
}

About

简单的python爬虫

Resources

Stars

0 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages