diff options
author | CoprDistGit <infra@openeuler.org> | 2023-05-05 11:08:43 +0000 |
---|---|---|
committer | CoprDistGit <infra@openeuler.org> | 2023-05-05 11:08:43 +0000 |
commit | 4c0687b99b9ab68222d2417e2af1ffb8134165dc (patch) | |
tree | ffd11c5c18e77ef70cbea1dbb4208a4a0b349a4f | |
parent | 51c83a836513927ab636c84e74ae69977d70be26 (diff) |
automatic import of python-feapderopeneuler20.03
-rw-r--r-- | .gitignore | 1 | ||||
-rw-r--r-- | python-feapder.spec | 189 | ||||
-rw-r--r-- | sources | 1 |
3 files changed, 191 insertions, 0 deletions
@@ -0,0 +1 @@ +/feapder-1.8.5.tar.gz diff --git a/python-feapder.spec b/python-feapder.spec new file mode 100644 index 0000000..7f37423 --- /dev/null +++ b/python-feapder.spec @@ -0,0 +1,189 @@ +%global _empty_manifest_terminate_build 0 +Name: python-feapder +Version: 1.8.5 +Release: 1 +Summary: feapder是一款支持分布式、批次采集、任务防丢、报警丰富的python爬虫框架 +License: MIT +URL: https://github.com/Boris-code/feapder.git +Source0: https://mirrors.nju.edu.cn/pypi/web/packages/7a/c2/188a81e98d3ea68a245d3be32929b755e0decbcb045455f68e9d1bc35e5a/feapder-1.8.5.tar.gz +BuildArch: noarch + +Requires: python3-better-exceptions +Requires: python3-DBUtils +Requires: python3-parsel +Requires: python3-PyMySQL +Requires: python3-redis +Requires: python3-requests +Requires: python3-bs4 +Requires: python3-ipython +Requires: python3-redis-py-cluster +Requires: python3-cryptography +Requires: python3-selenium +Requires: python3-pymongo +Requires: python3-urllib3 +Requires: python3-loguru +Requires: python3-influxdb +Requires: python3-pyperclip +Requires: python3-webdriver-manager +Requires: python3-terminal-layout +Requires: python3-playwright +Requires: python3-bitarray +Requires: python3-PyExecJS + +%description + url = https://www.baidu.com + method = GET + body = {'timeout': 22, 'stream': True, 'verify': False, 'headers': {'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/27.0.1453.93 Safari/537.36'}} +<Response [200]> +Thread-2|2021-02-09 14:55:11,610|parser_control.py|run|line:415|DEBUG| parser 等待任务... +FirstSpider|2021-02-09 14:55:14,620|air_spider.py|run|line:80|INFO| 无任务,爬虫结束 +``` +代码解释如下: +1. start_requests: 生产任务 +2. parse: 解析数据 +## 爬虫工具推荐 +1. 爬虫在线工具库:http://www.spidertools.cn +2. 爬虫管理系统:http://feapder.com/#/feapder_platform/feaplat +3. 验证码识别库:https://github.com/sml2h3/ddddocr +## 微信赞赏 +如果您觉得这个项目帮助到了您,您可以帮作者买一杯咖啡表示鼓励 🍹 +也可和作者交个朋友,解决您在使用过程中遇到的问题 + +## 学习交流 +<table border="0"> + <tr> + <td> 知识星球:17321694 </td> + <td> 作者微信: boris_tm </td> + <td> QQ群号:485067374 </td> + </tr> + <tr> + <td> <img src="http://markdown-media.oss-cn-beijing.aliyuncs.com/2020/02/16/zhi-shi-xing-qiu.jpeg" width=250px> + </td> + <td> <img src="http://markdown-media.oss-cn-beijing.aliyuncs.com/2021/07/12/er-wei-ma.jpeg?x-oss-process=style/markdown-media" width="250px" /> </td> + <td> <img src="https://tva1.sinaimg.cn/large/008vxvgGly1h8byl060lnj30ku11c76h.jpg" width="250px" /> </td> + </tr> + </table> + 加好友备注:feapder + +%package -n python3-feapder +Summary: feapder是一款支持分布式、批次采集、任务防丢、报警丰富的python爬虫框架 +Provides: python-feapder +BuildRequires: python3-devel +BuildRequires: python3-setuptools +BuildRequires: python3-pip +%description -n python3-feapder + url = https://www.baidu.com + method = GET + body = {'timeout': 22, 'stream': True, 'verify': False, 'headers': {'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/27.0.1453.93 Safari/537.36'}} +<Response [200]> +Thread-2|2021-02-09 14:55:11,610|parser_control.py|run|line:415|DEBUG| parser 等待任务... +FirstSpider|2021-02-09 14:55:14,620|air_spider.py|run|line:80|INFO| 无任务,爬虫结束 +``` +代码解释如下: +1. start_requests: 生产任务 +2. parse: 解析数据 +## 爬虫工具推荐 +1. 爬虫在线工具库:http://www.spidertools.cn +2. 爬虫管理系统:http://feapder.com/#/feapder_platform/feaplat +3. 验证码识别库:https://github.com/sml2h3/ddddocr +## 微信赞赏 +如果您觉得这个项目帮助到了您,您可以帮作者买一杯咖啡表示鼓励 🍹 +也可和作者交个朋友,解决您在使用过程中遇到的问题 + +## 学习交流 +<table border="0"> + <tr> + <td> 知识星球:17321694 </td> + <td> 作者微信: boris_tm </td> + <td> QQ群号:485067374 </td> + </tr> + <tr> + <td> <img src="http://markdown-media.oss-cn-beijing.aliyuncs.com/2020/02/16/zhi-shi-xing-qiu.jpeg" width=250px> + </td> + <td> <img src="http://markdown-media.oss-cn-beijing.aliyuncs.com/2021/07/12/er-wei-ma.jpeg?x-oss-process=style/markdown-media" width="250px" /> </td> + <td> <img src="https://tva1.sinaimg.cn/large/008vxvgGly1h8byl060lnj30ku11c76h.jpg" width="250px" /> </td> + </tr> + </table> + 加好友备注:feapder + +%package help +Summary: Development documents and examples for feapder +Provides: python3-feapder-doc +%description help + url = https://www.baidu.com + method = GET + body = {'timeout': 22, 'stream': True, 'verify': False, 'headers': {'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/27.0.1453.93 Safari/537.36'}} +<Response [200]> +Thread-2|2021-02-09 14:55:11,610|parser_control.py|run|line:415|DEBUG| parser 等待任务... +FirstSpider|2021-02-09 14:55:14,620|air_spider.py|run|line:80|INFO| 无任务,爬虫结束 +``` +代码解释如下: +1. start_requests: 生产任务 +2. parse: 解析数据 +## 爬虫工具推荐 +1. 爬虫在线工具库:http://www.spidertools.cn +2. 爬虫管理系统:http://feapder.com/#/feapder_platform/feaplat +3. 验证码识别库:https://github.com/sml2h3/ddddocr +## 微信赞赏 +如果您觉得这个项目帮助到了您,您可以帮作者买一杯咖啡表示鼓励 🍹 +也可和作者交个朋友,解决您在使用过程中遇到的问题 + +## 学习交流 +<table border="0"> + <tr> + <td> 知识星球:17321694 </td> + <td> 作者微信: boris_tm </td> + <td> QQ群号:485067374 </td> + </tr> + <tr> + <td> <img src="http://markdown-media.oss-cn-beijing.aliyuncs.com/2020/02/16/zhi-shi-xing-qiu.jpeg" width=250px> + </td> + <td> <img src="http://markdown-media.oss-cn-beijing.aliyuncs.com/2021/07/12/er-wei-ma.jpeg?x-oss-process=style/markdown-media" width="250px" /> </td> + <td> <img src="https://tva1.sinaimg.cn/large/008vxvgGly1h8byl060lnj30ku11c76h.jpg" width="250px" /> </td> + </tr> + </table> + 加好友备注:feapder + +%prep +%autosetup -n feapder-1.8.5 + +%build +%py3_build + +%install +%py3_install +install -d -m755 %{buildroot}/%{_pkgdocdir} +if [ -d doc ]; then cp -arf doc %{buildroot}/%{_pkgdocdir}; fi +if [ -d docs ]; then cp -arf docs %{buildroot}/%{_pkgdocdir}; fi +if [ -d example ]; then cp -arf example %{buildroot}/%{_pkgdocdir}; fi +if [ -d examples ]; then cp -arf examples %{buildroot}/%{_pkgdocdir}; fi +pushd %{buildroot} +if [ -d usr/lib ]; then + find usr/lib -type f -printf "/%h/%f\n" >> filelist.lst +fi +if [ -d usr/lib64 ]; then + find usr/lib64 -type f -printf "/%h/%f\n" >> filelist.lst +fi +if [ -d usr/bin ]; then + find usr/bin -type f -printf "/%h/%f\n" >> filelist.lst +fi +if [ -d usr/sbin ]; then + find usr/sbin -type f -printf "/%h/%f\n" >> filelist.lst +fi +touch doclist.lst +if [ -d usr/share/man ]; then + find usr/share/man -type f -printf "/%h/%f.gz\n" >> doclist.lst +fi +popd +mv %{buildroot}/filelist.lst . +mv %{buildroot}/doclist.lst . + +%files -n python3-feapder -f filelist.lst +%dir %{python3_sitelib}/* + +%files help -f doclist.lst +%{_docdir}/* + +%changelog +* Fri May 05 2023 Python_Bot <Python_Bot@openeuler.org> - 1.8.5-1 +- Package Spec generated @@ -0,0 +1 @@ +295e689033c0c0620660d04768237df6 feapder-1.8.5.tar.gz |