Commits

Breadcrumbs

History for

onmaster

User selector

All users

All time

Commit History

Commits on Feb 12, 2022

• 优化好提示

  Boris-code

  committed
  dba0d0b

  Copy full SHA for dba0d0b

Commits on Dec 30, 2021

• 爬虫集成支持传参

  Boris-code

  committed
  3a1afb2

  Copy full SHA for 3a1afb2

Commits on Nov 18, 2021

• 适配python3.10

  Boris-code

  committed
  aa3df59

  Copy full SHA for aa3df59

Commits on Sep 22, 2021

• pipeline 支持close方法

  Boris-code

  committed
  493ff7b

  Copy full SHA for 493ff7b

Commits on Aug 27, 2021

• 框架主线程捕获异常，防止爬虫某个线程死掉 1.6.7-beta2

  Boris-code

  committed
  744608a

  Copy full SHA for 744608a

Commits on Aug 25, 2021

• 优化 redis锁，修复转字符串cookie为json时的bug，添加cookie池，response的源码支持重新赋值，以便浏览器渲染时使用

  Boris-code

  committed
  d1e0c78

  Copy full SHA for d1e0c78

Commits on Aug 17, 2021

• 数据入库失败 自动重试

  Boris-code

  committed
  1b00eb3

  Copy full SHA for 1b00eb3

Commits on Aug 15, 2021

• auto_stop_when_spider_done参数改为keep_alive

  Boris-code

  committed
  21d1737

  Copy full SHA for 21d1737

Commits on Aug 4, 2021

• 解决jion报错问题

  Boris-code

  committed
  32721c6

  Copy full SHA for 32721c6

• 集成打点监控

  Boris-code

  committed
  f5f17f9

  Copy full SHA for f5f17f9

Commits on Jul 15, 2021

• 优化批次爬虫下发新批次任务时需等待1分钟问题

  Boris-code

  committed
  239ba71

  Copy full SHA for 239ba71

• 优化锁的问题

  Boris-code

  committed
  15ed732

  Copy full SHA for 15ed732

Commits on Jun 18, 2021

• 日志支持带颜色输出

  Boris-code

  committed
  3f7491f

  Copy full SHA for 3f7491f

Commits on May 28, 2021

• 修改邮箱

  Boris-code

  committed
  1ef34e2

  Copy full SHA for 1ef34e2

Commits on May 23, 2021

• 爬虫支持重复启动

  Boris-code

  committed
  3108880

  Copy full SHA for 3108880

Commits on May 13, 2021

• 线程可重复启动

  Boris-code

  committed
  b423722

  Copy full SHA for b423722

Commits on May 7, 2021

• change REQUEST_TIME_OUT 为 REQUEST_LOST_TIMEOUT

  Boris-code

  committed
  c587877

  Copy full SHA for c587877

Commits on Apr 25, 2021

• Merge pull request #64 from yufengsoft/master

  Show description for ee33a9e
  Boris-code

  authored
  ee33a9e

  Copy full SHA for ee33a9e

• AirSpider 支持爬虫开始与结束的回调函数

  Boris-code

  committed
  a83614e

  Copy full SHA for a83614e

Commits on Apr 24, 2021

• Update batch_spider.py

  Show description for 9f2e46d
  YufengSoft

  authored
  9f2e46d

  Copy full SHA for 9f2e46d

Commits on Apr 8, 2021

• add perfect_dict

  

  Boris

  committed
  e04d3df

  Copy full SHA for e04d3df

Commits on Mar 30, 2021

• AirSpider 支持itemz自动入库

  

  Boris

  committed
  a410275

  Copy full SHA for a410275

Commits on Mar 26, 2021

• 支持邮件报警

  

  Boris

  committed
  12a2c57

  Copy full SHA for 12a2c57

Commits on Mar 19, 2021

• 修复浏览器渲染问题

  

  Boris

  committed
  5cf33fd

  Copy full SHA for 5cf33fd

Commits on Mar 18, 2021

• 支持浏览器渲染下载

  

  Boris

  committed
  7b1e067

  Copy full SHA for 7b1e067

• 完善文档, update_items改为非必须实现接口

  

  Boris

  committed
  e017bdd

  Copy full SHA for e017bdd

Commits on Mar 17, 2021

• 删除无用的配置

  

  Boris

  committed
  601f3fc

  Copy full SHA for 601f3fc

• 修改AirSpider任务启动顺序

  

  Boris

  committed
  f47cf62

  Copy full SHA for f47cf62

Commits on Mar 15, 2021

• 更新注释

  

  Boris

  committed
  5c920fc

  Copy full SHA for 5c920fc

• 删除无用的process_num参数

  

  Boris

  committed
  22a813e

  Copy full SHA for 22a813e

Commits on Mar 12, 2021

• 修复日志等级问题

  

  Boris

  committed
  1fa8c85

  Copy full SHA for 1fa8c85

Commits on Mar 11, 2021

• delete_tabs 改为 delete_keys，添加常见问题-运行问题

  

  Boris

  committed
  b7f8bff

  Copy full SHA for b7f8bff

Commits on Mar 7, 2021

• 完善爬虫进阶文档

  

  Boris

  committed
  5825e00

  Copy full SHA for 5825e00

Commits on Mar 3, 2021

• 修改爬虫parser函数为parse， 添加集成爬虫示例

  

  Boris

  committed
  416dd13

  Copy full SHA for 416dd13

Commits on Feb 25, 2021

• 修改注释

  

  Boris

  committed
  61cd355

  Copy full SHA for 61cd355