%global _empty_manifest_terminate_build 0 Name: python-gerapy Version: 0.9.12 Release: 1 Summary: Distributed Crawler Management Framework Based on Scrapy, Scrapyd, Scrapyd-Client, Scrapyd-API, Django and Vue.js. License: MIT URL: https://github.com/Gerapy/Gerapy Source0: https://mirrors.nju.edu.cn/pypi/web/packages/bc/39/45775823a60847f5d5cee6304c7f45f7ab47ea34c43ecad2b4ae9d60d337/gerapy-0.9.12.tar.gz BuildArch: noarch Requires: python3-apscheduler Requires: python3-cryptography Requires: python3-django Requires: python3-django-cors-headers Requires: python3-django-apscheduler Requires: python3-furl Requires: python3-jinja2 Requires: python3-scrapy Requires: python3-scrapy-redis Requires: python3-scrapy-splash Requires: python3-scrapyd-api Requires: python3-redis Requires: python3-requests Requires: python3-pymongo Requires: python3-pymysql Requires: python3-pyquery Requires: python3-beautifulsoup4 Requires: python3-djangorestframework Requires: python3-websocket Requires: python3-pyppeteer %description # Gerapy ![Build](https://github.com/Gerapy/Gerapy/workflows/build/badge.svg) ![Read the Docs](https://img.shields.io/readthedocs/gerapy) ![PyPI - Python Version](https://img.shields.io/badge/python-3.6%2B-blue) [![GitHub stars](https://img.shields.io/github/stars/Gerapy/Gerapy)](https://github.com/Gerapy/Gerapy/stargazers) ![PyPI - Downloads](https://img.shields.io/pypi/dm/gerapy) ![Docker Pulls](https://img.shields.io/docker/pulls/germey/gerapy) ![PyPI - License](https://img.shields.io/pypi/l/gerapy) Distributed Crawler Management Framework Based on Scrapy, Scrapyd, Scrapyd-Client, Scrapyd-API, Django and Vue.js. ## Documentation Documentation is available online at [https://docs.gerapy.com/](https://docs.gerapy.com/) and [https://github.com/Gerapy/Docs](https://github.com/Gerapy/Docs). ## Support Gerapy is developed based on Python 3.x. Python 2.x may be supported later. ## Usage Install Gerapy by pip: ```bash pip3 install gerapy ``` After the installation, you need to do these things below to run Gerapy server: If you have installed Gerapy successfully, you can use command `gerapy`. If not, check the installation. First use this command to initialize the workspace: ```bash gerapy init ``` Now you will get a folder named `gerapy`. Also you can specify the name of your workspace by this command: ``` gerapy init ``` Then `cd` to this folder, and run this command to initialize the Database: ```bash cd gerapy gerapy migrate ``` Next you need to create a superuser by this command: ``` gerapy createsuperuser ``` Then you can runserver by this command: ```bash gerapy runserver ``` Then you can visit [http://localhost:8000](http://localhost:8000) to enjoy it. Also you can vist [http://localhost:8000/admin](http://localhost:8000/admin) to get the admin management backend. If you want to run Gerapy in public, just run like this: ``` gerapy runserver 0.0.0.0:8000 ``` Then it will run with public host and port 8000. In Gerapy, You can create a configurable project and then configure and generate code of Scrapy automatically. But this module is unstable, we're trying to refine it. Also you can drag your Scrapy Project to `projects` folder. Then refresh web, it will appear in the Project Index Page and comes to un-configurable, but you can edit this project through the web page. As for deployment, you can move to Deploy Page. Firstly you need to build your project and add client in the Client Index Page, then you can deploy the project just by clicking button. After the deployment, you can manage the job in Monitor Page. ## Docker Just run this command: ``` docker run -d -v ~/gerapy:/app/gerapy -p 8000:8000 germey/gerapy ``` Then it will run at port 8000. You can use the temp admin account (username: admin, password: admin) to login. And please change the password later for safety. Command Usage: ``` docker run -d -v :/app/gerapy -p : germey/gerapy ``` Please specify your workspace to mount Gerapy workspace by `-v :/app/gerapy` and specify server port by `-p :`. If you run Gerapy by Docker, you can visit Gerapy website such as [http://localhost:8000](http://localhost:8000) and enjoy it, no need to do other initialzation things. ## TodoList - [x] Add Visual Configuration of Spider with Previewing Website - [x] Add Scrapyd Auth Management - [x] Add Gerapy Auth Management - [x] Add Timed Task Scheduler - [ ] Add Visual Configuration of Scrapy - [ ] Add Intelligent Analysis of Web Page ## Communication If you have any questions or ideas, you can send [Issues](https://github.com/Gerapy/Gerapy/issues) or [Pull Requests](https://github.com/Gerapy/Gerapy/pulls), your suggestions are really import for us, thanks for your contirbution. %package -n python3-gerapy Summary: Distributed Crawler Management Framework Based on Scrapy, Scrapyd, Scrapyd-Client, Scrapyd-API, Django and Vue.js. Provides: python-gerapy BuildRequires: python3-devel BuildRequires: python3-setuptools BuildRequires: python3-pip %description -n python3-gerapy # Gerapy ![Build](https://github.com/Gerapy/Gerapy/workflows/build/badge.svg) ![Read the Docs](https://img.shields.io/readthedocs/gerapy) ![PyPI - Python Version](https://img.shields.io/badge/python-3.6%2B-blue) [![GitHub stars](https://img.shields.io/github/stars/Gerapy/Gerapy)](https://github.com/Gerapy/Gerapy/stargazers) ![PyPI - Downloads](https://img.shields.io/pypi/dm/gerapy) ![Docker Pulls](https://img.shields.io/docker/pulls/germey/gerapy) ![PyPI - License](https://img.shields.io/pypi/l/gerapy) Distributed Crawler Management Framework Based on Scrapy, Scrapyd, Scrapyd-Client, Scrapyd-API, Django and Vue.js. ## Documentation Documentation is available online at [https://docs.gerapy.com/](https://docs.gerapy.com/) and [https://github.com/Gerapy/Docs](https://github.com/Gerapy/Docs). ## Support Gerapy is developed based on Python 3.x. Python 2.x may be supported later. ## Usage Install Gerapy by pip: ```bash pip3 install gerapy ``` After the installation, you need to do these things below to run Gerapy server: If you have installed Gerapy successfully, you can use command `gerapy`. If not, check the installation. First use this command to initialize the workspace: ```bash gerapy init ``` Now you will get a folder named `gerapy`. Also you can specify the name of your workspace by this command: ``` gerapy init ``` Then `cd` to this folder, and run this command to initialize the Database: ```bash cd gerapy gerapy migrate ``` Next you need to create a superuser by this command: ``` gerapy createsuperuser ``` Then you can runserver by this command: ```bash gerapy runserver ``` Then you can visit [http://localhost:8000](http://localhost:8000) to enjoy it. Also you can vist [http://localhost:8000/admin](http://localhost:8000/admin) to get the admin management backend. If you want to run Gerapy in public, just run like this: ``` gerapy runserver 0.0.0.0:8000 ``` Then it will run with public host and port 8000. In Gerapy, You can create a configurable project and then configure and generate code of Scrapy automatically. But this module is unstable, we're trying to refine it. Also you can drag your Scrapy Project to `projects` folder. Then refresh web, it will appear in the Project Index Page and comes to un-configurable, but you can edit this project through the web page. As for deployment, you can move to Deploy Page. Firstly you need to build your project and add client in the Client Index Page, then you can deploy the project just by clicking button. After the deployment, you can manage the job in Monitor Page. ## Docker Just run this command: ``` docker run -d -v ~/gerapy:/app/gerapy -p 8000:8000 germey/gerapy ``` Then it will run at port 8000. You can use the temp admin account (username: admin, password: admin) to login. And please change the password later for safety. Command Usage: ``` docker run -d -v :/app/gerapy -p : germey/gerapy ``` Please specify your workspace to mount Gerapy workspace by `-v :/app/gerapy` and specify server port by `-p :`. If you run Gerapy by Docker, you can visit Gerapy website such as [http://localhost:8000](http://localhost:8000) and enjoy it, no need to do other initialzation things. ## TodoList - [x] Add Visual Configuration of Spider with Previewing Website - [x] Add Scrapyd Auth Management - [x] Add Gerapy Auth Management - [x] Add Timed Task Scheduler - [ ] Add Visual Configuration of Scrapy - [ ] Add Intelligent Analysis of Web Page ## Communication If you have any questions or ideas, you can send [Issues](https://github.com/Gerapy/Gerapy/issues) or [Pull Requests](https://github.com/Gerapy/Gerapy/pulls), your suggestions are really import for us, thanks for your contirbution. %package help Summary: Development documents and examples for gerapy Provides: python3-gerapy-doc %description help # Gerapy ![Build](https://github.com/Gerapy/Gerapy/workflows/build/badge.svg) ![Read the Docs](https://img.shields.io/readthedocs/gerapy) ![PyPI - Python Version](https://img.shields.io/badge/python-3.6%2B-blue) [![GitHub stars](https://img.shields.io/github/stars/Gerapy/Gerapy)](https://github.com/Gerapy/Gerapy/stargazers) ![PyPI - Downloads](https://img.shields.io/pypi/dm/gerapy) ![Docker Pulls](https://img.shields.io/docker/pulls/germey/gerapy) ![PyPI - License](https://img.shields.io/pypi/l/gerapy) Distributed Crawler Management Framework Based on Scrapy, Scrapyd, Scrapyd-Client, Scrapyd-API, Django and Vue.js. ## Documentation Documentation is available online at [https://docs.gerapy.com/](https://docs.gerapy.com/) and [https://github.com/Gerapy/Docs](https://github.com/Gerapy/Docs). ## Support Gerapy is developed based on Python 3.x. Python 2.x may be supported later. ## Usage Install Gerapy by pip: ```bash pip3 install gerapy ``` After the installation, you need to do these things below to run Gerapy server: If you have installed Gerapy successfully, you can use command `gerapy`. If not, check the installation. First use this command to initialize the workspace: ```bash gerapy init ``` Now you will get a folder named `gerapy`. Also you can specify the name of your workspace by this command: ``` gerapy init ``` Then `cd` to this folder, and run this command to initialize the Database: ```bash cd gerapy gerapy migrate ``` Next you need to create a superuser by this command: ``` gerapy createsuperuser ``` Then you can runserver by this command: ```bash gerapy runserver ``` Then you can visit [http://localhost:8000](http://localhost:8000) to enjoy it. Also you can vist [http://localhost:8000/admin](http://localhost:8000/admin) to get the admin management backend. If you want to run Gerapy in public, just run like this: ``` gerapy runserver 0.0.0.0:8000 ``` Then it will run with public host and port 8000. In Gerapy, You can create a configurable project and then configure and generate code of Scrapy automatically. But this module is unstable, we're trying to refine it. Also you can drag your Scrapy Project to `projects` folder. Then refresh web, it will appear in the Project Index Page and comes to un-configurable, but you can edit this project through the web page. As for deployment, you can move to Deploy Page. Firstly you need to build your project and add client in the Client Index Page, then you can deploy the project just by clicking button. After the deployment, you can manage the job in Monitor Page. ## Docker Just run this command: ``` docker run -d -v ~/gerapy:/app/gerapy -p 8000:8000 germey/gerapy ``` Then it will run at port 8000. You can use the temp admin account (username: admin, password: admin) to login. And please change the password later for safety. Command Usage: ``` docker run -d -v :/app/gerapy -p : germey/gerapy ``` Please specify your workspace to mount Gerapy workspace by `-v :/app/gerapy` and specify server port by `-p :`. If you run Gerapy by Docker, you can visit Gerapy website such as [http://localhost:8000](http://localhost:8000) and enjoy it, no need to do other initialzation things. ## TodoList - [x] Add Visual Configuration of Spider with Previewing Website - [x] Add Scrapyd Auth Management - [x] Add Gerapy Auth Management - [x] Add Timed Task Scheduler - [ ] Add Visual Configuration of Scrapy - [ ] Add Intelligent Analysis of Web Page ## Communication If you have any questions or ideas, you can send [Issues](https://github.com/Gerapy/Gerapy/issues) or [Pull Requests](https://github.com/Gerapy/Gerapy/pulls), your suggestions are really import for us, thanks for your contirbution. %prep %autosetup -n gerapy-0.9.12 %build %py3_build %install %py3_install install -d -m755 %{buildroot}/%{_pkgdocdir} if [ -d doc ]; then cp -arf doc %{buildroot}/%{_pkgdocdir}; fi if [ -d docs ]; then cp -arf docs %{buildroot}/%{_pkgdocdir}; fi if [ -d example ]; then cp -arf example %{buildroot}/%{_pkgdocdir}; fi if [ -d examples ]; then cp -arf examples %{buildroot}/%{_pkgdocdir}; fi pushd %{buildroot} if [ -d usr/lib ]; then find usr/lib -type f -printf "/%h/%f\n" >> filelist.lst fi if [ -d usr/lib64 ]; then find usr/lib64 -type f -printf "/%h/%f\n" >> filelist.lst fi if [ -d usr/bin ]; then find usr/bin -type f -printf "/%h/%f\n" >> filelist.lst fi if [ -d usr/sbin ]; then find usr/sbin -type f -printf "/%h/%f\n" >> filelist.lst fi touch doclist.lst if [ -d usr/share/man ]; then find usr/share/man -type f -printf "/%h/%f.gz\n" >> doclist.lst fi popd mv %{buildroot}/filelist.lst . mv %{buildroot}/doclist.lst . %files -n python3-gerapy -f filelist.lst %dir %{python3_sitelib}/* %files help -f doclist.lst %{_docdir}/* %changelog * Wed May 31 2023 Python_Bot - 0.9.12-1 - Package Spec generated