Commits

Breadcrumbs

History for

ondevelop

User selector

All users

All time

Commit History

Commits on Feb 12, 2022

• 优化好提示

  Boris-code

  committed
  dba0d0b

  Copy full SHA for dba0d0b

Commits on Dec 30, 2021

• 爬虫集成支持传参

  Boris-code

  committed
  3a1afb2

  Copy full SHA for 3a1afb2

Commits on Nov 18, 2021

• 适配python3.10

  Boris-code

  committed
  aa3df59

  Copy full SHA for aa3df59

Commits on Aug 27, 2021

• 框架主线程捕获异常，防止爬虫某个线程死掉 1.6.7-beta2

  Boris-code

  committed
  744608a

  Copy full SHA for 744608a

Commits on Aug 25, 2021

• 优化 redis锁，修复转字符串cookie为json时的bug，添加cookie池，response的源码支持重新赋值，以便浏览器渲染时使用

  Boris-code

  committed
  d1e0c78

  Copy full SHA for d1e0c78

Commits on Aug 17, 2021

• 数据入库失败 自动重试

  Boris-code

  committed
  1b00eb3

  Copy full SHA for 1b00eb3

Commits on Aug 15, 2021

• auto_stop_when_spider_done参数改为keep_alive

  Boris-code

  committed
  21d1737

  Copy full SHA for 21d1737

Commits on Aug 4, 2021

• 集成打点监控

  Boris-code

  committed
  f5f17f9

  Copy full SHA for f5f17f9

Commits on Jul 15, 2021

• 优化批次爬虫下发新批次任务时需等待1分钟问题

  Boris-code

  committed
  239ba71

  Copy full SHA for 239ba71

• 优化锁的问题

  Boris-code

  committed
  15ed732

  Copy full SHA for 15ed732

Commits on May 28, 2021

• 修改邮箱

  Boris-code

  committed
  1ef34e2

  Copy full SHA for 1ef34e2

Commits on May 23, 2021

• 爬虫支持重复启动

  Boris-code

  committed
  3108880

  Copy full SHA for 3108880

Commits on May 7, 2021

• change REQUEST_TIME_OUT 为 REQUEST_LOST_TIMEOUT

  Boris-code

  committed
  c587877

  Copy full SHA for c587877

Commits on Apr 24, 2021

• Update batch_spider.py

  Show description for 9f2e46d
  YufengSoft

  authored
  9f2e46d

  Copy full SHA for 9f2e46d

Commits on Apr 8, 2021

• add perfect_dict

  

  Boris

  committed
  e04d3df

  Copy full SHA for e04d3df

Commits on Mar 26, 2021

• 支持邮件报警

  

  Boris

  committed
  12a2c57

  Copy full SHA for 12a2c57

Commits on Mar 18, 2021

• 完善文档, update_items改为非必须实现接口

  

  Boris

  committed
  e017bdd

  Copy full SHA for e017bdd

Commits on Mar 17, 2021

• 删除无用的配置

  

  Boris

  committed
  601f3fc

  Copy full SHA for 601f3fc

Commits on Mar 15, 2021

• 更新注释

  

  Boris

  committed
  5c920fc

  Copy full SHA for 5c920fc

• 删除无用的process_num参数

  

  Boris

  committed
  22a813e

  Copy full SHA for 22a813e

Commits on Mar 11, 2021

• delete_tabs 改为 delete_keys，添加常见问题-运行问题

  

  Boris

  committed
  b7f8bff

  Copy full SHA for b7f8bff

Commits on Mar 7, 2021

• 完善爬虫进阶文档

  

  Boris

  committed
  5825e00

  Copy full SHA for 5825e00

Commits on Mar 3, 2021

• 修改爬虫parser函数为parse， 添加集成爬虫示例

  

  Boris

  committed
  416dd13

  Copy full SHA for 416dd13

Commits on Feb 25, 2021

• 修改注释

  

  Boris

  committed
  61cd355

  Copy full SHA for 61cd355

Commits on Feb 21, 2021

• 添加Spider文档

  

  Boris

  committed
  0b7963b

  Copy full SHA for 0b7963b

Commits on Feb 8, 2021

• delete parser_args parser_kwargs

  

  Boris

  committed
  973dc66

  Copy full SHA for 973dc66

• rename parser to spider, rename parser_count to thread_count

  

  Boris

  committed
  88a244d

  Copy full SHA for 88a244d

• 支持AirSpider Spider BatchSpider 爬虫模板, 重命名table_folder 为 redis_key, 重命名SingleSpider为AirSpider

  

  Boris

  committed
  3519dd4

  Copy full SHA for 3519dd4

• boris-spider重命名为feapder

  

  Boris

  committed
  b65f081

  Copy full SHA for b65f081

Loading