Commits

Breadcrumbs

History for

onmaster

User selector

All users

All time

Commit History

Commits on Feb 12, 2022

• 优化好提示

  Boris-code

  committed
  dba0d0b

  Copy full SHA for dba0d0b

Commits on Jan 24, 2022

• 日志友好化

  Boris-code

  committed
  ca4299d

  Copy full SHA for ca4299d

Commits on Dec 30, 2021

• 爬虫集成支持传参

  Boris-code

  committed
  3a1afb2

  Copy full SHA for 3a1afb2

Commits on Nov 18, 2021

• 适配python3.10

  Boris-code

  committed
  aa3df59

  Copy full SHA for aa3df59

Commits on Sep 22, 2021

• pipeline 支持close方法

  Boris-code

  committed
  493ff7b

  Copy full SHA for 493ff7b

Commits on Sep 8, 2021

• 下载中间件支持指定多个

  Boris-code

  committed
  80aa40c

  Copy full SHA for 80aa40c

Commits on Aug 27, 2021

• 框架主线程捕获异常，防止爬虫某个线程死掉 1.6.7-beta2

  Boris-code

  committed
  744608a

  Copy full SHA for 744608a

Commits on Aug 25, 2021

• 优化 redis锁，修复转字符串cookie为json时的bug，添加cookie池，response的源码支持重新赋值，以便浏览器渲染时使用

  Boris-code

  committed
  d1e0c78

  Copy full SHA for d1e0c78

Commits on Aug 17, 2021

• 数据入库失败 自动重试

  Boris-code

  committed
  1b00eb3

  Copy full SHA for 1b00eb3

Commits on Aug 15, 2021

• auto_stop_when_spider_done参数改为keep_alive

  Boris-code

  committed
  21d1737

  Copy full SHA for 21d1737

Commits on Aug 4, 2021

• 解决jion报错问题

  Boris-code

  committed
  32721c6

  Copy full SHA for 32721c6

• 集成打点监控

  Boris-code

  committed
  f5f17f9

  Copy full SHA for f5f17f9

Commits on Jul 20, 2021

• 钉钉报警支持提示所有人

  Boris-code

  committed
  07f350c

  Copy full SHA for 07f350c

Commits on Jul 15, 2021

• 优化批次爬虫下发新批次任务时需等待1分钟问题

  Boris-code

  committed
  239ba71

  Copy full SHA for 239ba71

• 优化锁的问题

  Boris-code

  committed
  15ed732

  Copy full SHA for 15ed732

• 重置丢失任务

  Boris-code

  committed
  931b514

  Copy full SHA for 931b514

Commits on Jul 8, 2021

• 去掉特殊的空白符

  Boris-code

  committed
  928e196

  Copy full SHA for 928e196

Commits on Jun 18, 2021

• 日志支持带颜色输出

  Boris-code

  committed
  3f7491f

  Copy full SHA for 3f7491f

Commits on May 28, 2021

• 修改邮箱

  Boris-code

  committed
  1ef34e2

  Copy full SHA for 1ef34e2

Commits on May 26, 2021

• 下载时间间隔支持随机 添加爬虫文档

  Boris-code

  committed
  a73682c

  Copy full SHA for a73682c

Commits on May 23, 2021

• 爬虫支持重复启动

  Boris-code

  committed
  3108880

  Copy full SHA for 3108880

Commits on May 13, 2021

• 线程可重复启动

  Boris-code

  committed
  b423722

  Copy full SHA for b423722

Commits on May 8, 2021

• update tip

  Boris-code

  committed
  24f858c

  Copy full SHA for 24f858c

Commits on May 7, 2021

• change REQUEST_TIME_OUT 为 REQUEST_LOST_TIMEOUT

  Boris-code

  committed
  c587877

  Copy full SHA for c587877

Commits on May 6, 2021

• redis 断开重连

  Boris-code

  committed
  43b357e

  Copy full SHA for 43b357e

Commits on Apr 25, 2021

• Merge pull request #64 from yufengsoft/master

  Show description for ee33a9e
  Boris-code

  authored
  ee33a9e

  Copy full SHA for ee33a9e

• AirSpider 支持爬虫开始与结束的回调函数

  Boris-code

  committed
  a83614e

  Copy full SHA for a83614e

Commits on Apr 24, 2021

• Update batch_spider.py

  Show description for 9f2e46d
  YufengSoft

  authored
  9f2e46d

  Copy full SHA for 9f2e46d

Commits on Apr 19, 2021

• download_midware 支持自定义下载

  Boris-code

  committed
  b198c2a

  Copy full SHA for b198c2a

• 浏览器渲染模式下response携带browser, 可操控浏览器

  Boris-code

  committed
  fee5e61

  Copy full SHA for fee5e61

Commits on Apr 16, 2021

• 接入企业微信报警

  Boris-code

  committed
  ee28d8a

  Copy full SHA for ee28d8a

• 添加校验函数

  Boris-code

  committed
  2f4b551

  Copy full SHA for 2f4b551

Commits on Apr 15, 2021

• 修改个错别词

  s0ing

  committed
  8f9160d

  Copy full SHA for 8f9160d

Commits on Apr 8, 2021

• add perfect_dict

  

  Boris

  committed
  e04d3df

  Copy full SHA for e04d3df

Commits on Apr 7, 2021

• 修改提示

  

  Boris

  committed
  748c496

  Copy full SHA for 748c496