diff options
| author | CoprDistGit <infra@openeuler.org> | 2023-05-17 03:49:41 +0000 |
|---|---|---|
| committer | CoprDistGit <infra@openeuler.org> | 2023-05-17 03:49:41 +0000 |
| commit | c3d23e0efdcaa036eeedb226dc39fded820d11e8 (patch) | |
| tree | 317ad4f380f3039f665a9159ace2667d45445b48 /python-data-lineage.spec | |
| parent | 2ebc09e69d21517e7b9b42a5e8e236e682346107 (diff) | |
automatic import of python-data-lineage
Diffstat (limited to 'python-data-lineage.spec')
| -rw-r--r-- | python-data-lineage.spec | 419 |
1 files changed, 419 insertions, 0 deletions
diff --git a/python-data-lineage.spec b/python-data-lineage.spec new file mode 100644 index 0000000..879aac4 --- /dev/null +++ b/python-data-lineage.spec @@ -0,0 +1,419 @@ +%global _empty_manifest_terminate_build 0 +Name: python-data-lineage +Version: 0.9.0 +Release: 1 +Summary: Open Source Data Lineage Tool for Redshift. Snowflake and many other databases +License: MIT +URL: https://tokern.io/ +Source0: https://mirrors.nju.edu.cn/pypi/web/packages/7c/03/68282a2ecfbff10d97d7b6141a3cc3f436c3f115a4eaa1d59f862c3bb207/data-lineage-0.9.0.tar.gz +BuildArch: noarch + +Requires: python3-pglast +Requires: python3-inflection +Requires: python3-networkx +Requires: python3-click +Requires: python3-PyYAML +Requires: python3-dbcat +Requires: python3-gunicorn +Requires: python3-flask +Requires: python3-flask-restless-ng +Requires: python3-requests +Requires: python3-furl +Requires: python3-flask-restful +Requires: python3-psycopg2 +Requires: python3-SQLAlchemy +Requires: python3-botocore +Requires: python3-rq +Requires: python3-redis + +%description +# Tokern Lineage Engine + +[](https://circleci.com/gh/tokern/data-lineage) +[](https://codecov.io/gh/tokern/data-lineage) +[](https://pypi.python.org/pypi/data-lineage) +[](https://pypi.org/project/data-lineage/) +[](https://pypi.org/project/data-lineage/) + + +Tokern Lineage Engine is _fast_ and _easy to use_ application to collect, visualize and analyze +column-level data lineage in databases, data warehouses and data lakes in AWS and GCP. + +Tokern Lineage helps you browse column-level data lineage +* visually using [kedro-viz](https://github.com/quantumblacklabs/kedro-viz) +* analyze lineage graphs programmatically using the powerful [networkx graph library](https://networkx.org/) + +## Resources + +* Demo of Tokern Lineage App + + + +* Checkout an [example data lineage notebook](http://tokern.io/docs/data-lineage/example/). + +* Check out [the post on using data lineage for cost control](https://tokern.io/blog/data-lineage-on-redshift/) for an +example of how data lineage can be used in production. + +## Quick Start + +### Install a demo of using Docker and Docker Compose + +Download the docker-compose file from Github repository. + + + # in a new directory run + wget https://raw.githubusercontent.com/tokern/data-lineage/master/install-manifests/docker-compose/catalog-demo.yml + # or run + curl https://raw.githubusercontent.com/tokern/data-lineage/master/install-manifests/docker-compose/tokern-lineage-engine.yml -o docker-compose.yml + + +Run docker-compose + + + docker-compose up -d + + +Check that the containers are running. + + + docker ps + CONTAINER ID IMAGE CREATED STATUS PORTS NAMES + 3f4e77845b81 tokern/data-lineage-viz:latest ... 4 hours ago Up 4 hours 0.0.0.0:8000->80/tcp tokern-data-lineage-visualizer + 1e1ce4efd792 tokern/data-lineage:latest ... 5 days ago Up 5 days tokern-data-lineage + 38be15bedd39 tokern/demodb:latest ... 2 weeks ago Up 2 weeks tokern-demodb + +Try out Tokern Lineage App + +Head to `http://localhost:8000/` to open the Tokern Lineage app + +### Install Tokern Lineage Engine + + # in a new directory run + wget https://raw.githubusercontent.com/tokern/data-lineage/master/install-manifests/docker-compose/tokern-lineage-engine.yml + # or run + curl https://raw.githubusercontent.com/tokern/data-lineage/master/install-manifests/docker-compose/catalog-demo.yml -o tokern-lineage-engine.yml + +Run docker-compose + + + docker-compose up -d + + +If you want to use an external Postgres database, change the following parameters in `tokern-lineage-engine.yml`: + +* CATALOG_HOST +* CATALOG_USER +* CATALOG_PASSWORD +* CATALOG_DB + +You can also override default values using environement variables. + + CATALOG_HOST=... CATALOG_USER=... CATALOG_PASSWORD=... CATALOG_DB=... docker-compose -f ... up -d + +For more advanced usage of environment variables with docker-compose, [refer to docker-compose docs](https://docs.docker.com/compose/environment-variables/) + +**Pro-tip** + +If you want to connect to a database in the host machine, set + + CATALOG_HOST: host.docker.internal # For mac or windows + #OR + CATALOG_HOST: 172.17.0.1 # Linux + +## Supported Technologies + +* Postgres +* AWS Redshift +* Snowflake + +### Coming Soon + +* SparkSQL +* Presto + +## Documentation + +For advanced usage, please refer to [data-lineage documentation](https://tokern.io/docs/data-lineage/index.html) +## Survey + +Please take this [survey](https://forms.gle/p2oEQBJnpEguhrp3A) if you are a user or considering using data-lineage. Responses will help us prioritize features better. + + +%package -n python3-data-lineage +Summary: Open Source Data Lineage Tool for Redshift. Snowflake and many other databases +Provides: python-data-lineage +BuildRequires: python3-devel +BuildRequires: python3-setuptools +BuildRequires: python3-pip +%description -n python3-data-lineage +# Tokern Lineage Engine + +[](https://circleci.com/gh/tokern/data-lineage) +[](https://codecov.io/gh/tokern/data-lineage) +[](https://pypi.python.org/pypi/data-lineage) +[](https://pypi.org/project/data-lineage/) +[](https://pypi.org/project/data-lineage/) + + +Tokern Lineage Engine is _fast_ and _easy to use_ application to collect, visualize and analyze +column-level data lineage in databases, data warehouses and data lakes in AWS and GCP. + +Tokern Lineage helps you browse column-level data lineage +* visually using [kedro-viz](https://github.com/quantumblacklabs/kedro-viz) +* analyze lineage graphs programmatically using the powerful [networkx graph library](https://networkx.org/) + +## Resources + +* Demo of Tokern Lineage App + + + +* Checkout an [example data lineage notebook](http://tokern.io/docs/data-lineage/example/). + +* Check out [the post on using data lineage for cost control](https://tokern.io/blog/data-lineage-on-redshift/) for an +example of how data lineage can be used in production. + +## Quick Start + +### Install a demo of using Docker and Docker Compose + +Download the docker-compose file from Github repository. + + + # in a new directory run + wget https://raw.githubusercontent.com/tokern/data-lineage/master/install-manifests/docker-compose/catalog-demo.yml + # or run + curl https://raw.githubusercontent.com/tokern/data-lineage/master/install-manifests/docker-compose/tokern-lineage-engine.yml -o docker-compose.yml + + +Run docker-compose + + + docker-compose up -d + + +Check that the containers are running. + + + docker ps + CONTAINER ID IMAGE CREATED STATUS PORTS NAMES + 3f4e77845b81 tokern/data-lineage-viz:latest ... 4 hours ago Up 4 hours 0.0.0.0:8000->80/tcp tokern-data-lineage-visualizer + 1e1ce4efd792 tokern/data-lineage:latest ... 5 days ago Up 5 days tokern-data-lineage + 38be15bedd39 tokern/demodb:latest ... 2 weeks ago Up 2 weeks tokern-demodb + +Try out Tokern Lineage App + +Head to `http://localhost:8000/` to open the Tokern Lineage app + +### Install Tokern Lineage Engine + + # in a new directory run + wget https://raw.githubusercontent.com/tokern/data-lineage/master/install-manifests/docker-compose/tokern-lineage-engine.yml + # or run + curl https://raw.githubusercontent.com/tokern/data-lineage/master/install-manifests/docker-compose/catalog-demo.yml -o tokern-lineage-engine.yml + +Run docker-compose + + + docker-compose up -d + + +If you want to use an external Postgres database, change the following parameters in `tokern-lineage-engine.yml`: + +* CATALOG_HOST +* CATALOG_USER +* CATALOG_PASSWORD +* CATALOG_DB + +You can also override default values using environement variables. + + CATALOG_HOST=... CATALOG_USER=... CATALOG_PASSWORD=... CATALOG_DB=... docker-compose -f ... up -d + +For more advanced usage of environment variables with docker-compose, [refer to docker-compose docs](https://docs.docker.com/compose/environment-variables/) + +**Pro-tip** + +If you want to connect to a database in the host machine, set + + CATALOG_HOST: host.docker.internal # For mac or windows + #OR + CATALOG_HOST: 172.17.0.1 # Linux + +## Supported Technologies + +* Postgres +* AWS Redshift +* Snowflake + +### Coming Soon + +* SparkSQL +* Presto + +## Documentation + +For advanced usage, please refer to [data-lineage documentation](https://tokern.io/docs/data-lineage/index.html) +## Survey + +Please take this [survey](https://forms.gle/p2oEQBJnpEguhrp3A) if you are a user or considering using data-lineage. Responses will help us prioritize features better. + + +%package help +Summary: Development documents and examples for data-lineage +Provides: python3-data-lineage-doc +%description help +# Tokern Lineage Engine + +[](https://circleci.com/gh/tokern/data-lineage) +[](https://codecov.io/gh/tokern/data-lineage) +[](https://pypi.python.org/pypi/data-lineage) +[](https://pypi.org/project/data-lineage/) +[](https://pypi.org/project/data-lineage/) + + +Tokern Lineage Engine is _fast_ and _easy to use_ application to collect, visualize and analyze +column-level data lineage in databases, data warehouses and data lakes in AWS and GCP. + +Tokern Lineage helps you browse column-level data lineage +* visually using [kedro-viz](https://github.com/quantumblacklabs/kedro-viz) +* analyze lineage graphs programmatically using the powerful [networkx graph library](https://networkx.org/) + +## Resources + +* Demo of Tokern Lineage App + + + +* Checkout an [example data lineage notebook](http://tokern.io/docs/data-lineage/example/). + +* Check out [the post on using data lineage for cost control](https://tokern.io/blog/data-lineage-on-redshift/) for an +example of how data lineage can be used in production. + +## Quick Start + +### Install a demo of using Docker and Docker Compose + +Download the docker-compose file from Github repository. + + + # in a new directory run + wget https://raw.githubusercontent.com/tokern/data-lineage/master/install-manifests/docker-compose/catalog-demo.yml + # or run + curl https://raw.githubusercontent.com/tokern/data-lineage/master/install-manifests/docker-compose/tokern-lineage-engine.yml -o docker-compose.yml + + +Run docker-compose + + + docker-compose up -d + + +Check that the containers are running. + + + docker ps + CONTAINER ID IMAGE CREATED STATUS PORTS NAMES + 3f4e77845b81 tokern/data-lineage-viz:latest ... 4 hours ago Up 4 hours 0.0.0.0:8000->80/tcp tokern-data-lineage-visualizer + 1e1ce4efd792 tokern/data-lineage:latest ... 5 days ago Up 5 days tokern-data-lineage + 38be15bedd39 tokern/demodb:latest ... 2 weeks ago Up 2 weeks tokern-demodb + +Try out Tokern Lineage App + +Head to `http://localhost:8000/` to open the Tokern Lineage app + +### Install Tokern Lineage Engine + + # in a new directory run + wget https://raw.githubusercontent.com/tokern/data-lineage/master/install-manifests/docker-compose/tokern-lineage-engine.yml + # or run + curl https://raw.githubusercontent.com/tokern/data-lineage/master/install-manifests/docker-compose/catalog-demo.yml -o tokern-lineage-engine.yml + +Run docker-compose + + + docker-compose up -d + + +If you want to use an external Postgres database, change the following parameters in `tokern-lineage-engine.yml`: + +* CATALOG_HOST +* CATALOG_USER +* CATALOG_PASSWORD +* CATALOG_DB + +You can also override default values using environement variables. + + CATALOG_HOST=... CATALOG_USER=... CATALOG_PASSWORD=... CATALOG_DB=... docker-compose -f ... up -d + +For more advanced usage of environment variables with docker-compose, [refer to docker-compose docs](https://docs.docker.com/compose/environment-variables/) + +**Pro-tip** + +If you want to connect to a database in the host machine, set + + CATALOG_HOST: host.docker.internal # For mac or windows + #OR + CATALOG_HOST: 172.17.0.1 # Linux + +## Supported Technologies + +* Postgres +* AWS Redshift +* Snowflake + +### Coming Soon + +* SparkSQL +* Presto + +## Documentation + +For advanced usage, please refer to [data-lineage documentation](https://tokern.io/docs/data-lineage/index.html) +## Survey + +Please take this [survey](https://forms.gle/p2oEQBJnpEguhrp3A) if you are a user or considering using data-lineage. Responses will help us prioritize features better. + + +%prep +%autosetup -n data-lineage-0.9.0 + +%build +%py3_build + +%install +%py3_install +install -d -m755 %{buildroot}/%{_pkgdocdir} +if [ -d doc ]; then cp -arf doc %{buildroot}/%{_pkgdocdir}; fi +if [ -d docs ]; then cp -arf docs %{buildroot}/%{_pkgdocdir}; fi +if [ -d example ]; then cp -arf example %{buildroot}/%{_pkgdocdir}; fi +if [ -d examples ]; then cp -arf examples %{buildroot}/%{_pkgdocdir}; fi +pushd %{buildroot} +if [ -d usr/lib ]; then + find usr/lib -type f -printf "/%h/%f\n" >> filelist.lst +fi +if [ -d usr/lib64 ]; then + find usr/lib64 -type f -printf "/%h/%f\n" >> filelist.lst +fi +if [ -d usr/bin ]; then + find usr/bin -type f -printf "/%h/%f\n" >> filelist.lst +fi +if [ -d usr/sbin ]; then + find usr/sbin -type f -printf "/%h/%f\n" >> filelist.lst +fi +touch doclist.lst +if [ -d usr/share/man ]; then + find usr/share/man -type f -printf "/%h/%f.gz\n" >> doclist.lst +fi +popd +mv %{buildroot}/filelist.lst . +mv %{buildroot}/doclist.lst . + +%files -n python3-data-lineage -f filelist.lst +%dir %{python3_sitelib}/* + +%files help -f doclist.lst +%{_docdir}/* + +%changelog +* Wed May 17 2023 Python_Bot <Python_Bot@openeuler.org> - 0.9.0-1 +- Package Spec generated |
